Senior Data Engineer (AWS, Airflow, DBT & Cloud Data Pipelines)

9 Minutes ago • 8 Years +

Job Summary

Job Description

The Senior Data Engineer will design and implement scalable and reliable data pipelines using AWS, Apache Airflow, and DBT. Responsibilities include collaborating with data teams and business stakeholders to develop data solutions, optimizing ETL processes, monitoring pipeline performance, enforcing data governance, mentoring junior engineers, and staying current with emerging data technologies. This role requires strong technical skills and the ability to work in a fast-paced environment. The engineer will be expected to translate business requirements into technical solutions.
Must have:
  • Proficiency in AWS services: S3, Redshift, Lambda, Glue
  • Expertise in Apache Airflow for workflow orchestration
  • Experience with DBT for data transformation
  • Solid knowledge of SQL for data querying and manipulation
Good to have:
  • Familiarity with Hadoop, Spark, or other big data technologies
  • Experience with NoSQL databases (e.g., DynamoDB, Cassandra)
  • Knowledge of data governance and security best practices

Job Details

Job Summary:
Synechron is seeking an experienced Senior Data Engineer with expertise in AWS, Apache Airflow, and DBT to design and implement scalable, reliable data pipelines. The role involves collaborating with data teams and business stakeholders to develop data solutions that enable actionable insights and support organizational decision-making. The ideal candidate will bring data engineering experience, demonstrating strong technical skills, strategic thinking, and the ability to work in a fast-paced, evolving environment.

Software Requirements:

  • Required:
    • Strong proficiency in AWS services including S3, Redshift, Lambda, and Glue, with proven hands-on experience
    • Expertise in Apache Airflow for workflow orchestration and pipeline management
    • Extensive experience with DBT for data transformation and modeling
    • Solid knowledge of SQL for data querying and manipulation
  • Preferred:
    • Familiarity with Hadoop, Spark, or other big data technologies
    • Experience with NoSQL databases (e.g., DynamoDB, Cassandra)
    • Knowledge of data governance and security best practices within cloud environments

Overall Responsibilities:

  • Lead the design, development, and maintenance of scalable and efficient data pipelines and workflows utilizing AWS, Airflow, and DBT
  • Collaborate with data scientists, analysts, and business teams to gather requirements and translate them into technical solutions
  • Optimize Extract, Transform, Load (ETL) processes to enhance data quality, integrity, and timeliness
  • Monitor pipeline performance, troubleshoot issues, and implement improvements to ensure operational excellence
  • Enforce data management, governance, and security protocols across all data flows
  • Mentor junior data engineers and promote best practices within the team
  • Stay current with emerging data technologies and industry trends, recommending innovations for the data ecosystem

Technical Skills (By Category):

  • Programming Languages:
    • Essential: SQL, Python (preferred for scripting and automation)
    • Preferred: Spark, Scala, Java (for big data integration)
  • Databases/Data Management:
    • Extensive experience with data warehousing (Redshift, Snowflake, or similar) and relational databases (MySQL, PostgreSQL)
    • Familiarity with NoSQL databases such as DynamoDB or Cassandra is a plus
  • Cloud Technologies:
    • AWS cloud platform, leveraging services like S3, Lambda, Glue, Redshift, and IAM security features
  • Frameworks and Libraries:
    • Apache Airflow, dbt, and related data orchestration and transformation tools
  • Development Tools and Methodologies:
    • Git, Jenkins, CI/CD pipelines, Agile/Scrum environment experience
  • Security Protocols:
    • Knowledge of data encryption, access control, and compliance standards in cloud data engineering

Experience Requirements:

  • At least 8 years of professional experience in data engineering or related roles with a focus on cloud ecosystems and big data pipelines
  • Demonstrated experience designing and managing end-to-end data workflows in AWS environments
  • Proven success in collaborating with cross-functional teams and translating business requirements into technical solutions
  • Prior experience mentoring junior engineers and leading data projects is highly desirable

Day-to-Day Activities:

  • Develop, deploy, and monitor scalable data pipelines using AWS, Airflow, and DBT
  • Collaborate regularly with data scientists, analysts, and business stakeholders to refine data requirements and deliver impactful solutions
  • Troubleshoot production data pipeline issues to resolve data quality or performance bottlenecks
  • Conduct code reviews, optimize existing workflows, and implement automation to improve efficiency
  • Document data architecture, pipelines, and governance practices for knowledge sharing and compliance
  • Keep abreast of emerging data tools and industry best practices, proposing enhancements to existing systems

Qualifications:

  • Bachelor’s degree in Computer Science, Data Science, Engineering, or related field; Master’s degree preferred
  • Professional certifications such as AWS Certified Data Analytics – Specialty or related credentials are advantageous
  • Commitment to continuous professional development and staying current with industry trends

Professional Competencies:

  • Strong analytical, problem-solving, and critical thinking skills
  • Excellent communication abilities to effectively liaise with technical and business teams
  • Proven leadership in mentoring team members and managing project deliverables
  • Ability to work independently, prioritize tasks, and adapt to changing business needs
  • Innovative mindset focused on scalable, efficient, and sustainable data solutions

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Bengaluru, Karnataka, India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,500+, and has 43 offices in 18 countries within key global markets. For more information on the company, please visit our website: www.synechron.com.

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Pune, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

Pune, Maharashtra, India (On-Site)

Irving, Texas, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Synechron

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug