Senior Data Engineer

3 Months ago • 8 Years + • Data Analysis

Job Summary

Job Description

The Senior Data Engineer will be responsible for architecting and implementing scalable data pipelines using modern data platforms like Spark, Databricks, and Snowflake. This includes developing ETL/ELT processes, performing exploratory data analysis, and collaborating with data scientists and engineers to design data models. The role involves leading data infrastructure projects, ensuring data governance and security, and mentoring junior engineers. The individual will also monitor and optimize data systems, and stay current with emerging technologies in data engineering.
Must have:
  • 8+ years of experience in data engineering.
  • Proficiency with Python and SQL.
  • Experience with data pipeline orchestration tools.
  • Experience with cloud-based data platforms (AWS, GCP, Snowflake, Databricks).
  • Understanding of data modeling, warehousing, and distributed systems.
  • Experience with big data technologies like Apache Spark.
  • Familiarity with DevOps practices.
Good to have:
  • Experience with real-time data processing and streaming.
  • Knowledge of data security and privacy regulations.
  • Exposure to machine learning pipelines.
  • Familiarity with prompt engineering and LLMs.
  • Experience working in cross-functional teams.

Job Details

At Netomi AI, we are on a mission to create artificial intelligence that builds customer love for the world’s largest global brands.

Some of the largest brands are already using Netomi AI’s platform to solve mission-critical problems. This would allow you to work with top-tier clients at the senior level and build your network.

Backed by the world’s leading investors such as Y-Combinator, Index Ventures, Jeffrey Katzenberg (co-founder of DreamWorks) and Greg Brockman (co-founder & President of OpenAI/ChatGPT), you will become a part of an elite group of visionaries who are defining the future of AI for customer experience. We are building a dynamic, fast growing team that values innovation, creativity, and hard work. You will have the chance to significantly impact the company’s success while developing your skills and career in AI.

Want to become a key part of the Generative AI revolution? We should talk.

We are looking for a Senior Data Engineer with a passion for using data to discover and solve real-world problems. You will enjoy working with rich data sets, modern business intelligence technology, and the ability to see your insights drive the features for our customers. You will also have the opportunity to contribute to the development of policies, processes, and tools to address product quality challenges in collaboration with teams.

What You’ll Do

    • Architect and implement scalable, secure, and reliable data pipelines using modern data platforms (e.g., Spark, Databricks, Airflow, Snowflake, etc.).
    • Develop ETL/ELT processes to ingest data from various structured and unstructured sources.
    • Perform Exploratory Data Analysis (EDA) to uncover trends, validate data integrity, and derive insights that inform data product development and business decisions.
    • Collaborate closely with data scientists, analysts, and software engineers to design data models that support high-quality analytics and real-time insights.
    • Lead data infrastructure projects including management of data on cloud platforms (AWS/Azure), data lake/warehouse implementations, and data quality frameworks.
    • Ensure data governance, security, and compliance best practices are followed.
    • Monitor and optimize the performance of data systems, addressing any issues proactively.
    • Mentor junior data engineers and contribute to establishing best practices in data engineering standards, tooling, and development workflows.
    • Stay current with emerging technologies and trends in data engineering and recommend improvements as needed.

Required Qualifications

    • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
    • 8+ years of hands-on experience in data engineering or backend software development roles.
    • Proficiency with Python, SQL, and at least one data pipeline orchestration tool (e.g., Apache Airflow, Luigi, Prefect).
    • Strong experience with cloud-based data platforms (e.g., AWS Redshift, GCP BigQuery, Snowflake, Databricks).
    • Deep understanding of data modeling, data warehousing, and distributed systems.
    • Experience with big data technologies such as Apache Spark, Kafka, Hadoop, etc.
    • Familiarity with DevOps practices (CI/CD, infrastructure as code, containerization with Docker/Kubernetes).

Preferred Qualifications

    • Experience working with real-time data processing and streaming data architectures.
    • Knowledge of data security and privacy regulations (e.g., GDPR, HIPAA).
    • Exposure to machine learning pipelines or supporting data science workflows.
    • Familiarity with prompt engineering and how LLM-based systems interact with data.
    • Experience working in cross-functional teams and with stakeholders from non-technical domains.
Netomi is an equal opportunity employer committed to diversity in the workplace. We evaluate qualified applicants without regard to race, color, religion, sex, sexual orientation, disability, veteran status, and other protected characteristics.

Similar Jobs

Mashgin - Business Operations Director

Mashgin

Palo Alto, California, United States (Hybrid)
8 Months ago
Apple - Architecture Engineering Program Manager (Mac, iPad, Home)

Apple

Cupertino, California, United States (On-Site)
1 Month ago
appzen - Integration Architect

appzen

Pune, Maharashtra, India (On-Site)
4 Months ago
Tide - Staff Data Engineer

Tide

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Match Group - Corporate Counsel

Match Group

New York, United States (Hybrid)
4 Weeks ago
miniclip - Data Analyst

miniclip

Lisbon, Lisbon, Portugal (On-Site)
2 Months ago
Capgemini - Data Engineer

Capgemini

Kolkata, West Bengal, India (On-Site)
2 Months ago
Next Level Business Services - Senior Data Engineer

Next Level Business Services

Chicago, Illinois, United States (On-Site)
9 Months ago
EXUSIA - Senior BI/Data Analyst (Power BI / Tableau) - India

EXUSIA

India (Remote)
1 Week ago
PwC - Functional Data Architect

PwC

Singapore (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Patreon - Engineering Manager, Platform

Patreon

San Francisco, California, United States (Hybrid)
3 Months ago
Sailpoint - Manager, DevOps (AWS Infrastructure)

Sailpoint

Austin, Texas, United States (On-Site)
2 Months ago
WebTech Corporation - HR Operations Manager - CIS

WebTech Corporation

Astana, Astana, Kazakhstan (On-Site)
1 Week ago
Discord - Advertising Operations Manager

Discord

California, United States (On-Site)
1 Week ago
PwC - HR Service Desk Manager

PwC

Auckland, Auckland, New Zealand (On-Site)
2 Weeks ago
whoop - Senior Manager, Community Engagement

whoop

Boston, Massachusetts, United States (On-Site)
1 Week ago
Proscia - AI Systems Integration Engineer

Proscia

Philadelphia, Pennsylvania, United States (Remote)
1 Month ago
Postman - Software Engineer - IAM

Postman

San Francisco, California, United States (Hybrid)
5 Days ago
Cubic corporation - IT Program Manager

Cubic corporation

Hyderabad, Telangana, India (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Canada

quience - Customer Service Representative, Retention Specialist

quience

Toronto, Ontario, Canada (On-Site)
1 Month ago
Zoic studios - Concept/Visual Development Artist - Environments

Zoic studios

Vancouver, British Columbia, Canada (Hybrid)
3 Weeks ago
2K - Localization Producer

2K

Montreal, Quebec, Canada (Hybrid)
1 Week ago
Wolters Kluwer - Senior Technology Project and Program Manager

Wolters Kluwer

Sherbrooke, Quebec, Canada (Hybrid)
1 Week ago
Marsh McLennan - Employee benefit associate

Marsh McLennan

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Krafton - AI Programmer

Krafton

Montreal, Quebec, Canada (Hybrid)
6 Months ago
Ubisoft - Programming Team Lead

Ubisoft

Saguenay, Quebec, Canada (Hybrid)
1 Month ago
Autodesk - Principal Software Developer - Experimentation and Data Analytics

Autodesk

Ontario, Canada (Remote)
1 Week ago
Epic Games - Senior Technical Product Manager, Identity

Epic Games

Vancouver, British Columbia, Canada (On-Site)
3 Months ago
Autodesk - Distinguished Research Scientist, Physics Informed AI

Autodesk

Toronto, Ontario, Canada (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

PwC - Senior data analyst | Deals (M&A) | Lyon | CDI | H/F

PwC

Lyon, Auvergne-Rhône-Alpes, France (On-Site)
10 Months ago
Ion - Senior Data Engineer, Risk Technology

Ion

New York, United States (On-Site)
7 Months ago
TransUnion - Data Analyst

TransUnion

São Paulo, Brazil (Hybrid)
1 Week ago
Unity - Senior Data Scientist

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
4 Months ago
Qualcomm - Data Cache & Coherent Interconnect Architect/Engineer (Multiple Levels)

Qualcomm

Austin, Texas, United States (On-Site)
1 Week ago
Wildlife Studios - Senior Data Scientist

Wildlife Studios

São Paulo, Brazil (On-Site)
3 Months ago
Apple - Data Scientist - Apple Ads

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Nasdaq - Senior Director- Data Engineer (Databricks/AWS)

Nasdaq

Bengaluru, Karnataka, India (On-Site)
5 Days ago
Caramel tech studios - BI Quantitative Analyst

Caramel tech studios

Lahore, Punjab, Pakistan (On-Site)
1 Month ago
Apple - Lab and Data Automation Engineer

Apple

Cupertino, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Gurugram, India (Remote)

Toronto, Ontario, Canada (Remote)

Gurugram, India (Remote)

Gurugram, India (Remote)

Gurugram, India (Remote)

Gurugram, India (Remote)

India (Remote)

Gurugram, India (Remote)

Canada (Remote)

View All Jobs

Get notified when new jobs are added by Netomi

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug