Data Engineer

9 Months ago • 7 Years +

Job Description

We are seeking a senior Data Engineer with at least 7 years of experience to design, develop, and maintain our database systems. This role involves close collaboration with software development and IT teams to ensure effective database solutions aligned with business objectives. Responsibilities include providing technical guidance, ensuring process compliance, preparing status reports, and minimizing project risks. The ideal candidate will have strong programming skills (Groovy/Java), expertise in data structures, ETL design, and data storage, and experience with streaming data environments and pipelines using frameworks like Apache Spark, Streamsets, or Apache NiFi. Experience with Kafka (kSQL/Mirror Maker) is essential.
Must Have:
  • 7+ years Data Engineering experience
  • Kafka Framework (kSQL/Mirror Maker)
  • Groovy/Java programming skills
  • Data Structure, ETL Design, Data Storage knowledge
  • Streaming data pipelines (Spark/Streamsets/NIFI)

Add these skills to join the top 1% applicants for this job

java
spark

Project description

We are looking for an experienced Data Engineer to contribute to the design, development, and maintenance of our database systems. This role will work closely with our software development and IT teams to ensure the effective implementation and management of database solutions that align with client's business objectives.

Responsibilities

The successful candidate would be responsible for managing technology in projects and providing technical guidance/solutions for work completion:

(1.) To be responsible for providing technical guidance/solutions

(2.) To ensure process compliance in the assigned module and participate in technical discussions/reviews

(3.) To prepare and submit status reports for minimizing exposure and risks on the project or closure of escalations

(4.) Being self-organized, focused on develop on time and quality software

Skills

Must have

At least 7 years of experience in development in Data specific projects.

Must have working knowledge of streaming data Kafka Framework (kSQL/Mirror Maker etc)

Strong programming skills in at least one of these programming language Groovy/Java

Good knowledge of Data Structure, ETL Design, and storage. Must have worked in streaming data environments and pipelines

Experience working in near real-time/Streaming Data pipeline development using Apache Spark/Streamsets/ Apache NIFI or similar frameworks

Nice to have

N/A

Other

Languages

English: B2 Upper Intermediate

Seniority

Senior

Set alerts for new jobs by Luxoft
Set alerts for new jobs in India
Contact Us
hello@outscal.com
Made in INDIA 💛💙