Sr. DevOps Data Hadoop Engineer

1 Month ago • 4-8 Years • Data Analysis

Job Summary

Job Description

The Sr. DevOps Data Hadoop Engineer will be responsible for implementing and maintaining the platform with all associated components. The role involves driving change and delivering new technology, working closely with other platforms and product teams. Key responsibilities include hands-on experience with Cloudera, automating pipelines, scripting, containerization, and ensuring security and regulatory compliance. The engineer will also participate in relationship management with stakeholders and contribute to project delivery and operational support within a DevOps model.
Must have:
  • Hands-on production experience with Cloudera
  • Automated pipelines and workflows for data projects
  • Shell and Groovy scripting experience
  • Experience with containerization
  • Experience with source control
Good to have:
  • Public cloud exposure
  • Experience with Data Science projects

Job Details

Job Purpose (Why does the job exist? What is the unique contribution made by the job holder?)

Group IT has a matrix management structure. The Technology Engineer role will have line management and reporting into the VP Technology Chapter, but will be assigned to a Platform squad for task management and prioritisation. The engineer will implement the design and build of the platform along with all associated components from inception to maturity of the running environment over time. The role will be responsible for driving change and delivering new technology into the Bank by onboarding customers and applications to the Platform via self-service and automation.

The engineer will work closely with other Platforms and Product teams in educating them on the new Platform, services and features to ensure any transition and consumption is optimal. Teams work using Agile + DevOps + Product Management methodologies, delivering work packages based on the priority in the backlog.

Job Content (Describe the key results delivered by the job holder, how they are measured and the tasks performed to achieve the results?)

Key Results

Performance Measures

Main Tasks

 

Technology Engineering

  • Hands on Tier – 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation – Ansible, data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
  • Shell, Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization – Podman, Docker
  • Container Management – Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)
  • Agile engineering and practices
  • Some Python programming experience

 

Relationship Management

  • Trustful and professional relationships with key stakeholders
  • Has developed synergies across services, optimizing re-use, promoting simplification and demonstrating speed-to-market benefits
  • Commercial and business focused to improve IT services
  • Trustful and pragmatic approach to problem solving
  • Ability to adopt the Group’s values and drive adoption of the values across the team

Delivery Experience

  • Ability to work on projects from inception to delivery
  • Decision making to decide on best solution based on cost, time and quality of options
  • Cross skills in delivery but also operational support as per the new DevOps model
  • Implementing robust solutions to minimize operational effort

Internal / External Relationships and Committee Memberships ( Internal relationships cover other units within the organization; External relationships relate customers, government bodies, suppliers etc; Committees include formal forums where membership is nominated)

Interface (Int/Ext)

Reason

Committee

Reason

Technical Platforms

Work with the wider infrastructure team to ensure consistency of the deliverables.

Security Chapter

Align with Security standards and collaborate on different design forums

Architecture Chapter

Align with Architecture standards and collaborate on different design forums

Business Platforms

Work with the wider application and product teams to ensure consistency of the deliverables.

Data Chapter

Align with Data standards and collaborate on different design forums

Agile Chapter

Align with Agile standards and collaborate on different design forums

Problems & Decisions ( State problems solved and decisions made on a regular basis by the job holder and the desired outcomes of actions)

Problems and Decision

Desired Outcome

Non-Standardized stack or product

Establish an updated stack of standard products

High TCO of the products

Look for improvements and automate where possible

Platform Strategy is not well defined

Drive Product Roadmaps and backlog

Person Specifications (required to carry out the job, not what the current or recommended incumbent possesses)

Specifications

Description of Knowledge / Skill etc.

Desirable or Essential

Education

  • General
  • Professional
  • IT or similar bachelor’s degree or higher
  • Equivalent work experience

Experiences

(Years & Type)

  • Industry
  • Regional
  • Functional
  • At least 4 years production Hadoop experience
  • 8+ years hands on Technology experience
  • Experience with large and complex global enterprises defined by high availability, broad observability, and high level of reliability.
  • At least 1 project experience in Data Science project/products
  • Excellent communication and articulation skills

Knowledge & Skills

  • Technical
  • Managerial

Technical/Functional:

  • Hands on Tier – 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation – Ansible, data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
  • Some Python programming experience
  • Shell, Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization – Podman, Docker
  • Container Management – Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)

Agile engineering and practices

Nice to have:

  • Public cloud exposure
  • Data Science projects/products

Behavioral Competencies

  • Collaboration
  • Self-starter with strong initiative
  • Innovative and experimental mindset
  • Calm under pressure
  • Pragmatic and focused

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

USE Insider - Sales Team Lead

USE Insider

Paris, Île-de-France, France (Hybrid)
2 Months ago
Rackspace Technology - Senior Tableau BI Engineer

Rackspace Technology

Egypt (Hybrid)
3 Weeks ago
MathWorks - Japanese Localization Specialist

MathWorks

Tokyo, Japan (Hybrid)
11 Months ago
BioFire - EHS Specialist 2

BioFire

Hazelwood, Missouri, United States (On-Site)
5 Months ago
Opendoor - Senior Data Engineer

Opendoor

India (Remote)
1 Month ago
Scopely - Data Scientist

Scopely

Barcelona, Catalonia, Spain (Hybrid)
2 Months ago
Scientific Games - Senior Business Analyst

Scientific Games

Georgia, United States (Remote)
2 Months ago
Apple - AI Solutions Architect, Data Solutions & Initiatives

Apple

Cupertino, California, United States (On-Site)
3 Weeks ago
Playtika - Senior Data/AI SRE Engineer

Playtika

Ukraine (On-Site)
8 Months ago
beghou consulting - Data Science Manager

beghou consulting

Pune, Maharashtra, India (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Electronic Arts - Associate Marketing Creative Producer

Electronic Arts

Los Angeles, California, United States (Hybrid)
3 Weeks ago
Marsh McLennan - Senior Health & Benefits Consultant

Marsh McLennan

Irvine, California, United States (Hybrid)
1 Month ago
Techland - Art Director

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Year ago
Bitpet - Senior UNITY DEVELOPER

Bitpet

Oslo, Oslo, Norway (On-Site)
2 Months ago
Ceragon Networks - Revenue Recognition Analyst

Ceragon Networks

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
version 1 - Senior JDE CNC Consultant

version 1

Bengaluru, Karnataka, India (On-Site)
6 Months ago
zoox - Manager, Contingent Workforce Operations

zoox

Foster City, California, United States (Hybrid)
5 Months ago
PayPal - Sr. Manager, Voice of Customer

PayPal

Chicago, Illinois, United States (Hybrid)
1 Month ago
BioFire - Director, Medical Writing

BioFire

Salt Lake City, Utah, United States (On-Site)
1 Month ago
Fandom  - Manager Software Engineering (AdTech)

Fandom

(Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Dubai, Dubai, United Arab Emirates

Nahc.io - Technical Product Manager (Chinese Speaking)

Nahc.io

Dubai, Dubai, United Arab Emirates (On-Site)
1 Month ago
bytedance - Software Engineer Intern, Information System - 2025 Start

bytedance

Dubai, Dubai, United Arab Emirates (On-Site)
3 Months ago
Tencent - Senior Game Publishing Manager

Tencent

Dubai, Dubai, United Arab Emirates (On-Site)
4 Months ago
Nagarro - Staff Engineer, CRM Dynamics

Nagarro

Abu Dhabi, Abu Dhabi, United Arab Emirates (On-Site)
2 Years ago
AECOM - Document Controller

AECOM

Dubai, Dubai, United Arab Emirates (On-Site)
3 Weeks ago
Salesforce - KSA Enterprise Account Executive - Health & Life Science

Salesforce

Dubai, Dubai, United Arab Emirates (On-Site)
1 Month ago
binance - Binance Accelerator Program - Data Analyst

binance

Dubai, Dubai, United Arab Emirates (Remote)
3 Years ago
Actian - Enterprise Sales Engineer

Actian

Dubai, Dubai, United Arab Emirates (On-Site)
3 Weeks ago
Sperasoft - Senior 3D Artist

Sperasoft

Abu Dhabi, Abu Dhabi, United Arab Emirates (On-Site)
3 Months ago
binance - PR Lead - MENAP

binance

Dubai, Dubai, United Arab Emirates (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Monzo - Data Science Manager, Financial Crime

Monzo

London, England, United Kingdom (Hybrid)
1 Month ago
Revenera - Senior Data Analyst

Revenera

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Wargaming - BI Analyst (World of Tanks)

Wargaming

Vilnius, Vilnius County, Lithuania (Hybrid)
3 Weeks ago
Euromonitor - Data Platform Engineer II

Euromonitor

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Forcepoint - Principal Engineer (Data Analytics & Java)

Forcepoint

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Capgemini - Artificial Intelligence Business Analyst

Capgemini

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Ion - Data Center Architect, Italy

Ion

Italy (Hybrid)
9 Months ago
onwards Search - Principal Insights Analyst

onwards Search

Los Angeles, California, United States (On-Site)
1 Month ago
kaizen gaming  - Data Science Team Lead

kaizen gaming

Lisbon, Lisbon, Portugal (Hybrid)
2 Weeks ago
Unity - Senior Big Data and Machine Learning Engineer

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies spanend-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in ourFinLabswe develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.Over the last20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of14,500+,and has58offices in 21 countrieswithin key global markets.For more information on the company, please visit ourwebsiteorLinkedIncommunity.

Mississauga, Ontario, Canada (Hybrid)

Jersey City, New Jersey, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

Mississauga, Ontario, Canada (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Synechron

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug