Sr. DevOps Data Hadoop Engineer

9 Hours ago • 4-8 Years

Job Summary

Job Description

The Sr. DevOps Data Hadoop Engineer will be responsible for implementing and maintaining the platform with all associated components. The role involves driving change and delivering new technology, working closely with other platforms and product teams. Key responsibilities include hands-on experience with Cloudera, automating pipelines, scripting, containerization, and ensuring security and regulatory compliance. The engineer will also participate in relationship management with stakeholders and contribute to project delivery and operational support within a DevOps model.
Must have:
  • Hands-on production experience with Cloudera
  • Automated pipelines and workflows for data projects
  • Shell and Groovy scripting experience
  • Experience with containerization
  • Experience with source control
Good to have:
  • Public cloud exposure
  • Experience with Data Science projects

Job Details

Job Purpose (Why does the job exist? What is the unique contribution made by the job holder?)

Group IT has a matrix management structure. The Technology Engineer role will have line management and reporting into the VP Technology Chapter, but will be assigned to a Platform squad for task management and prioritisation. The engineer will implement the design and build of the platform along with all associated components from inception to maturity of the running environment over time. The role will be responsible for driving change and delivering new technology into the Bank by onboarding customers and applications to the Platform via self-service and automation.

The engineer will work closely with other Platforms and Product teams in educating them on the new Platform, services and features to ensure any transition and consumption is optimal. Teams work using Agile + DevOps + Product Management methodologies, delivering work packages based on the priority in the backlog.

Job Content (Describe the key results delivered by the job holder, how they are measured and the tasks performed to achieve the results?)

Key Results

Performance Measures

Main Tasks

 

Technology Engineering

  • Hands on Tier – 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation – Ansible, data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
  • Shell, Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization – Podman, Docker
  • Container Management – Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)
  • Agile engineering and practices
  • Some Python programming experience

 

Relationship Management

  • Trustful and professional relationships with key stakeholders
  • Has developed synergies across services, optimizing re-use, promoting simplification and demonstrating speed-to-market benefits
  • Commercial and business focused to improve IT services
  • Trustful and pragmatic approach to problem solving
  • Ability to adopt the Group’s values and drive adoption of the values across the team

Delivery Experience

  • Ability to work on projects from inception to delivery
  • Decision making to decide on best solution based on cost, time and quality of options
  • Cross skills in delivery but also operational support as per the new DevOps model
  • Implementing robust solutions to minimize operational effort

Internal / External Relationships and Committee Memberships ( Internal relationships cover other units within the organization; External relationships relate customers, government bodies, suppliers etc; Committees include formal forums where membership is nominated)

Interface (Int/Ext)

Reason

Committee

Reason

Technical Platforms

Work with the wider infrastructure team to ensure consistency of the deliverables.

Security Chapter

Align with Security standards and collaborate on different design forums

Architecture Chapter

Align with Architecture standards and collaborate on different design forums

Business Platforms

Work with the wider application and product teams to ensure consistency of the deliverables.

Data Chapter

Align with Data standards and collaborate on different design forums

Agile Chapter

Align with Agile standards and collaborate on different design forums

Problems & Decisions ( State problems solved and decisions made on a regular basis by the job holder and the desired outcomes of actions)

Problems and Decision

Desired Outcome

Non-Standardized stack or product

Establish an updated stack of standard products

High TCO of the products

Look for improvements and automate where possible

Platform Strategy is not well defined

Drive Product Roadmaps and backlog

Person Specifications (required to carry out the job, not what the current or recommended incumbent possesses)

Specifications

Description of Knowledge / Skill etc.

Desirable or Essential

Education

  • General
  • Professional
  • IT or similar bachelor’s degree or higher
  • Equivalent work experience

Experiences

(Years & Type)

  • Industry
  • Regional
  • Functional
  • At least 4 years production Hadoop experience
  • 8+ years hands on Technology experience
  • Experience with large and complex global enterprises defined by high availability, broad observability, and high level of reliability.
  • At least 1 project experience in Data Science project/products
  • Excellent communication and articulation skills

Knowledge & Skills

  • Technical
  • Managerial

Technical/Functional:

  • Hands on Tier – 2 production experience with Cloudera:
    • Installing and maintenance
    • Optimizing cluster performance
    • Working with data engineers to optimize Spark job performance
    • Automation – Ansible, data/analytics jobs CI/CD
    • Observability
  • Automated pipelines/workflows (GitHub Actions, Jenkins, ArgoCD etc.) for data projects. Python based preferred.
  • Some Python programming experience
  • Shell, Groovy scripting experience
  • Automating security/regulatory checks
  • Automated patching
  • Containerization – Podman, Docker
  • Container Management – Kubernetes/OpenShift
  • Linux OS & Networking basics
  • Source control (git)

Agile engineering and practices

Nice to have:

  • Public cloud exposure
  • Data Science projects/products

Behavioral Competencies

  • Collaboration
  • Self-starter with strong initiative
  • Innovative and experimental mindset
  • Calm under pressure
  • Pragmatic and focused

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Dubai, Dubai, United Arab Emirates

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies spanend-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in ourFinLabswe develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.Over the last20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of14,500+,and has58offices in 21 countrieswithin key global markets.For more information on the company, please visit ourwebsiteorLinkedIncommunity.

Pune, Maharashtra, India (On-Site)

Pittsburgh, Pennsylvania, United States (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by Synechron

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug