The Senior Data Engineer will design, build, and manage data pipelines using Airflow, ensuring seamless data integration and accessibility. They will contribute to the development of the data platform, build custom plugins, and manage cloud-based infrastructure using AWS and Terraform. The role involves translating business needs into data architecture, designing and maintaining data models, and using SQL to optimize data models. They will implement data governance best practices and data quality checks. Collaboration with cross-functional teams and clear communication are crucial. For senior roles, leadership in projects, mentoring, and driving cross-team collaboration are expected.
Good To Have:- Experience with Retrieval-Augmented Generation (RAG) AI systems
Must Have:- 5+ years of data engineering experience
- Proficiency in Python for production-grade code
- Experience with AWS and orchestration tools like Airflow
- Expertise in SQL and analytical data warehouses
- Strong data modeling skills
- Understanding of data governance practices
- Excellent communication skills