Senior/Lead Data Engineer

1 Month ago • 3-5 Years • Data Analyst

Job Summary

Job Description

N-iX is seeking a Senior/Lead Data Engineer to design complex ETL processes, build and maintain data pipelines using Python, improve data quality through anomaly detection, optimize data delivery, and automate manual processes. The role involves data modeling, collaborating with various teams, and partnering with stakeholders to resolve data-related technical issues. The company works with a major school transportation provider, handling data related to millions of student journeys daily. Responsibilities include improving efficiency and latency in data pipelines, building internal tools for data measurement, and designing infrastructure for scalability.
Must have:
  • Proficiency in Python and SQL
  • 3-5 years experience building Data Lakes
  • AWS Glue framework knowledge
  • Apache Kafka maintenance
  • Airflow for job scheduling
  • ETL process optimization
Good to have:
  • Schema and dimensional data design
  • Agile methodology experience
Perks:
  • Flexible working format
  • Competitive salary
  • Personalized career growth
  • Professional development tools
  • Education reimbursement
  • Corporate events

Job Details

N-iX is looking for a Senior/Lead Data Engineer to join our team!

About the project:

Our customer is the leading school transportation provider in North America, being the owner of more than a half of all yellow school buses in the United States. Every day, the company completes 5 million student journeys, moving more passengers than all U.S. airlines combined and delivers reliable, quality services for 1,100 school districts. 

N-iX has built a successful cooperation with the client delivering a range of complex initiatives. As a result, N-iX has been selected as a strategic long-term partner to drive the digital transformation on an enterprise level, fully remodeling the technology landscape for 55,000 employees and millions of people across North America. 

Responsibilities:

  • Design complex ETL processes of various data sources in the data warehouse
  • Build new and maintain existing data pipelines using Python to improve efficiency and latency
  • Improve data quality through anomaly detection by building and working with internal tools to measure data and automatically detect changes
  • Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes
  • Perform data modeling and improve our existing data models for analytics
  • Collaborate with SMEs, architects, analysts, and others to build solutions that integrate data from many of our enterprise data sources
  • Partner with stakeholders, including data, design, product, and executive teams, and assist them with data-related technical issues

Requirements: 

  • Proficiency in Python and SQL
  • 3-5 years of commercial experience in building and maintaining a Data Lake
  • Good knowledge of AWS cloud services, including the Glue framework
  • Experience maintaining Apache Kafka
  • Knowledge of job scheduling and orchestration using Airflow
  • Well-versed in the optimization of ETL processes
  • Steady expertise in data processing tools, including Elasticsearch, Apache Spark, Apache Hive, Apache HBase, Apache Flink, Apache Hudi, Presto.
  • Decent knowledge of CI/CD (Docker, Jenkins, Terraform, Git)
  • Good understanding of algorithms and data structures
  • Excellent communication skills, both written and verbal
  • Ukrainian language Advanced or higher.

Nice to have: 

  • Experience in the schema and dimensional data design
  • Collaboration within a scaled team, using Agile methodology

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Similar Jobs

Calix - Senior Software Engineer, Cloud Build and Release

Calix

Mexico City, Mexico (Remote)
2 Weeks ago
Fanatee - Monetization Analyst

Fanatee

Spain (Hybrid)
7 Months ago
Canonical - Linux Cryptography and Security Engineer

Canonical

(Remote)
2 Weeks ago
bytedance - Research Scientist Graduate (Foundation Model - Generative AI) - 2025 Start (PhD)

bytedance

Seattle, Washington, United States (On-Site)
5 Months ago
PwC - Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
7 Months ago
Tencent - WeChat Product Management Intern

Tencent

(On-Site)
1 Month ago
PwC - IN_Senior Associate_Tableau Developer_Data & Analytics_Advisory_PAN India

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Magna International - Data Scientist

Magna International

Bengaluru, Karnataka, India (On-Site)
8 Months ago
bytedance - Risk Data Analytics Business Partner

bytedance

Singapore (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

AlphaSense - Technical Support Engineer

AlphaSense

United States (Remote)
1 Month ago
Zscaler - Principal Security Researcher

Zscaler

(Remote)
2 Weeks ago
Qualcomm - Engineer - Debugging

Qualcomm

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
SciPlay - Director, Software Engineering

SciPlay

Cedar Falls, Iowa, United States (Hybrid)
3 Days ago
Activision - Senior Analytics Engineer

Activision

Santa Monica, California, United States (On-Site)
2 Months ago
Google - Staff Software Engineer, Network Management

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
bytedance - Backend Engineer Intern, Video-On-Demand

bytedance

Singapore (On-Site)
1 Month ago
PwC - IN_Senior Associate _Data Migration and ETL_Enterprise Apps SAP_Advisory_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
bytedance - Data Engineer, Cloud and System

bytedance

Seattle, Washington, United States (On-Site)
2 Months ago
Zynga - Senior Data Analyst

Zynga

Austin, Texas, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

Gunzilla - Senior Manual QA Tester

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
2 Months ago
Nordcurrent - QA

Nordcurrent

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
7 Months ago
Playtika - Senior Network Engineer

Playtika

Ukraine (On-Site)
1 Month ago
playrix  - Senior Technical Designer

playrix

Ukraine (Remote)
7 Months ago
Better ME - Legal Counsel

Better ME

Ukraine (Remote)
2 Weeks ago
N-ix - Engineering Manager with Data Engineering Experience

N-ix

Ukraine (Remote)
1 Month ago
Better ME - HR Generalist

Better ME

Kyiv, Kyiv City, Ukraine (On-Site)
5 Days ago
playrix  - Senior UI Artist

playrix

Ukraine (Remote)
7 Months ago
Better ME - Junior/Middle Node.js Developer (Web)

Better ME

Kyiv, Kyiv City, Ukraine (Hybrid)
2 Weeks ago
N-ix - Lead Java Software Engineer

N-ix

Ukraine (Hybrid)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Jam City - Product Manager

Jam City

Montevideo, Montevideo Department, Uruguay (On-Site)
9 Months ago
Patreon - Senior Data Scientist

Patreon

New York, New York, United States (Hybrid)
2 Months ago
Next Level Business Services - Data Architect

Next Level Business Services

Sunnyvale, California, United States (On-Site)
7 Months ago
Google - Principal Analyst, Gen AI, Trust and Safety

Google

Sunnyvale, California, United States (On-Site)
1 Month ago
Next Level Business Services - SDE 3 (BI Analyst-Cosmos)

Next Level Business Services

Redmond, Washington, United States (On-Site)
7 Months ago
Hawk Eye Innovations - Data Processing Assistant

Hawk Eye Innovations

Atlanta, Georgia, United States (On-Site)
2 Months ago
Aristocrat Gaming - Data Analyst

Aristocrat Gaming

Barcelona, Catalonia, Spain (Hybrid)
2 Months ago
Zengame Technology - Advertisement Optimizer

Zengame Technology

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
GoTo Group - Senior Data Scientist  (Singapore)

GoTo Group

Singapore (On-Site)
7 Months ago
plarium - Marketing Business Analyst

plarium

Herzliya, Tel Aviv District, Israel (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded