Sr. Data Engineer

5 Hours ago • 3-5 Years
Data Analysis

Job Description

As a Data Engineer II, you will be responsible for developing, optimizing, and managing large data lakes and data warehouses, integrating data from various sources. Key responsibilities include designing and maintaining robust data pipelines, creating and updating data models, managing database systems, ensuring data quality, and automating processes using programming languages. You will also work with cloud platforms, implement security best practices, and provide troubleshooting support for data-related issues.
Good To Have:
  • Knowledge of DBT
Must Have:
  • Design, build, and maintain robust and scalable data pipelines.
  • Ensure high-quality data by implementing monitoring, validation, and error-handling processes.
  • Create and update data models to represent the structure of the data.
  • Design, implement, and maintain database systems; optimize performance and ensure data integrity.
  • Build and manage data warehouses for storage and analysis of large datasets.
  • Implement and enforce data quality standards and contribute to data governance.
  • Develop and automate data processes through programming languages (e.g., Python, Java, SQL).
  • Use version control systems (e.g., Git) to manage codebase changes.
  • Implement monitoring solutions and optimize data processes for efficiency.
  • Work with cloud platforms (AWS, Azure, GCP) to deploy and manage data infrastructure.
  • Implement and adhere to data security best practices.
  • Provide support for data-related issues and participate in root cause analysis.
  • Expertise in data modeling, database design, and data warehousing.
  • Proficient in SQL and programming languages such as Python, Java, or Scala.
  • Cloud-native architecture expertise (AWS, GCP, or Azure), including containerization (Docker, Kubernetes) and infrastructure-as-code (Terraform, CloudFormation).
  • Bachelor’s/Master’s degree in engineering (computer science, information systems) with 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
  • Excellent command on SQL and one or more programming languages, preferably Python or Java.
  • Experience working with Kubernetes.

Add these skills to join the top 1% applicants for this job

problem-solving
github
game-texts
aws
azure
terraform
spark
docker
kubernetes
git
python
scala
sql
java

About Zeta

Zeta is a Next-Gen Banking Tech company that empowers banks and fintechs to launch banking products for the future. It was founded by Bhavin Turakhia and Ramki Gaddipati in 2015.

Our flagship processing platform - Zeta Tachyon - is the industry’s first modern, cloud-native, and fully API-enabled stack that brings together issuance, processing, lending, core banking, fraud & risk, and many more capabilities as a single-vendor stack. 20M+ cards have been issued on our platform globally.

Zeta is actively working with the largest Banks and Fintechs in multiple global markets transforming customer experience for multi-million card portfolios.

Zeta has over 1,700+ employees across the US, EMEA, and Asia, with 70%+ roles in R&D. Backed by SoftBank, Mastercard, and other investors, we raised $330M at a $2B valuation in 2025.

Learn more @ www.zeta.tech, careers.zeta.tech, Linkedin, Twitter

About the Role

As a Data Engineer II, you will play a crucial role in developing, optimizing, and managing several large data lakes and data warehouses, comprising data from multiple disparate sources.

Responsibilities

  • Data Pipeline Operations
  • Design, build, and maintain robust and scalable data pipelines to ingest, transform, and deliver structured and unstructured data from multiple sources.
  • Ensure high-quality data by implementing monitoring, validation, and error-handling processes.
  • Platform Engineering & Optimization
  • Create and update data models to represent the structure of the data.
  • Design, implement, and maintain database systems. Optimize database performance and ensure data integrity. Troubleshoot and resolve database issues.
  • Build and manage data warehouses for storage and analysis of large datasets.
  • Collaborate on data modeling, schema design, and performance optimization for large-scale datasets.
  • Data Quality and Governance: Implement and enforce data quality standards. Contribute to data governance processes and policies.
  • Scripting and Programming: Develop and automate data processes through programming languages (e.g., Python, Java, SQL). Implement data validation scripts and error handling mechanisms.
  • Version Control: Use version control systems (e.g., Git) to manage codebase changes for data pipelines.
  • Monitoring and Optimization: Implement monitoring solutions to track the performance and health of data systems. Optimize data processes for efficiency and scalability.
  • Cloud Platforms: Work with cloud platforms (e.g., AWS, Azure, GCP) to deploy and manage data infrastructure. Utilize cloud-based services for data storage, processing, and analytics.
  • Security: Implement and adhere to data security best practices. Ensure compliance with data protection regulations.
  • Troubleshooting and Support: Provide support for data-related issues and participate in root cause analysis.

Skills

  • Expertise in data modeling, database design, and data warehousing. Proficient in SQL and programming languages such as Python, Java, or Scala.
  • Cloud-native architecture expertise (AWS, GCP, or Azure), including containerization (Docker, Kubernetes) and infrastructure-as-code (Terraform, CloudFormation).

Experience and Qualifications

  • Bachelor’s/Master’s degree in engineering (computer science, information systems) with 3-5 years of experience in data engineering, BI engineering, and data warehouse development.
  • Excellent command on SQL and one or more programming languages, preferably Python or Java.
  • Knowledge of Flink, Airflow, Apache Spark, DBT (good to have), Athena / Presto
  • Experience working with Kubernetes.

Equal Opportunity

Zeta is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We encourage applicants from all backgrounds, cultures, and communities to apply and believe that a diverse workforce is key to our success

Set alerts for more jobs like Sr. Data Engineer
Set alerts for new jobs by zeta
Set alerts for new Data Analysis jobs in India
Set alerts for new jobs in India
Set alerts for Data Analysis (Remote) jobs

Contact Us
hello@outscal.com
Made in INDIA 💛💙