Senior Data Engineer

2 Months ago • 5 Years + • Data Analysis

Job Summary

Job Description

As a Senior Data Engineer, you will be responsible for designing and implementing data pipelines, building and maintaining data storage systems, and collaborating with data analysts and scientists. The role involves following data governance policies, participating in code reviews, and ensuring solutions are production-ready. You'll work with Big Data Solution Architects to optimize data ingestion and provide technical support. Effective communication about project status and blockers is essential. The candidate will need to have experience with SQL, Python, and cloud technologies like Azure, AWS, or GCP. Proven skills in real-time processing, batch processing, and data orchestration are needed.
Must have:
  • 5+ years of experience with big data technologies.
  • Proficiency in SQL and Python.
  • Experience in cloud technologies like Azure, AWS, GCP.
  • Experience with Docker, Helm, Kubernetes.
  • Skills in real-time Processing: Kafka, Apache Flink, Apache Spark.
  • Experience with Batch Processing: Apache Spark (PySpark).
  • Experience with Data Orchestration: Azure Data Factory, Apache Airflow.
  • Experience with Data Storage: Parquet, Delta Lake, Iceburg.
  • Experience with DevOps & CI/CD: Git, Docker, Terraform or Ansibel.
  • Skills in querying and manipulating data from various databases.
  • Experience in writing unit and integration tests.
  • Excellent communication, problem-solving, and leadership skills.
Good to have:
  • Experience with data visualization tools (e.g., SSRS, Power BI).
  • Knowledge of machine learning algorithms and their applications.
  • Familiarity with data privacy regulations (e.g., GDPR, CCPA).
  • Experience with Great Expectations
Perks:
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Job Details

N-iX is looking for a talented Senior Data Engineer to join our team!  

Our client is one of Europe's fastest-growing mobile companies with almost 5  million active customers, 1,000 employees worldwide, and operations in five countries. The client is using the mobile virtual network operator business model.

Responsibilities:

  • Design and implement data pipelines to collect, clean, and transform data from various sources​
  • Build and maintain data storage and processing systems, including databases, data warehouses, and data lakes​
  • Follow data governance policies and procedures​
  • Collaborate with data analysts, data scientists, and other stakeholders to understand and meet their data needs​
  • Participate in code reviews, performance tuning, and best practice discussions within the team, and brainstorming sessions​
  • Work with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines​
  • Ensure solutions are production-ready in terms of operational, security, and compliance standards​
  • Participate in daily project and agile meetings, providing technical support for issue resolution​
  • Communicate clearly and concisely with the business about item status and blockers​
  • Maintain comprehensive knowledge of the client's data landscape

Requirements:

  • 5+ years of design & development experience with big data technologies​
  • Proficiency in SQL and Python​
  • Experience in cloud technologies like Azure, AWS, GCP​
  • Experience with Docker, Helm, Kubernetes ​
  • Proven skills in real-time Processing: Kafka, Apache Flink, Apache Spark Structured Streaming​
  • Experience with Batch Processing: Apache Spark (PySpark)​
  • Data Orchestration: Azure Data Factory, Apache Airflow,  ​
  • Data Storage: Parquet, Delta Lake, Iceburg​
  • DevOps & CI/CD: Git, Docker, Terraform or Ansibel (basic infra provisioning)​
  • Strong skills in querying and manipulating data from various databases (relational and big data)​
  • Experience in writing effective and maintainable unit and integration tests for ingestion pipelines​
  • Excellent communication, problem-solving, and leadership skills​
  • Experience working on high-traffic and large-scale software products​
  • Strong intermediate level of English

Nice to have:

  • Experience with data visualization tools (e.g., SSRS, Power BI)​
  • Knowledge of machine learning algorithms and their applications in big data​
  • Familiarity with data privacy regulations (e.g., GDPR, CCPA)​
  • Experience with Great Expectations

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Similar Jobs

Hasbro - Director Tax

Hasbro

Pawtucket, Rhode Island, United States (Hybrid)
2 Months ago
Discord - Senior Developer Analytics Manager

Discord

San Francisco, California, United States (On-Site)
1 Month ago
Trailer park group - Client Game Capture Artist

Trailer park group

Los Angeles, California, United States (On-Site)
1 Month ago
PwC - Corporate Tax Manager Zentralschweiz

PwC

Lucerne, Lucerne, Switzerland (On-Site)
10 Months ago
nubank - Tech Manager

nubank

Bogota, Colombia (Hybrid)
1 Year ago
Play Perfect - Senior Marketing Data Analyst

Play Perfect

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Next Level Business Services - Big Data Engineer

Next Level Business Services

Phoenix, Arizona, United States (On-Site)
9 Months ago
LLNL - Business Analyst (Mid/Senior)

LLNL

Livermore, California, United States (On-Site)
1 Month ago
PwC - Data Engineer Associate

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
1 Year ago
Capgemini - IAM Business Analyst

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

EveryMatrix - Director of Photography (Fixed-term contract, 3 months)

EveryMatrix

Batumi, Adjara, Georgia (On-Site)
8 Months ago
Sony Pictures Entertainment - Executive Director of Product Management – Distribution

Sony Pictures Entertainment

Culver City, California, United States (Hybrid)
2 Months ago
Rackspace Technology - Incident Manager - IN ( Night Shift )

Rackspace Technology

Gurugram, Haryana, India (Remote)
2 Weeks ago
Site Core - Director of Engineering

Site Core

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
3 Months ago
Scopely - Analytics Engineering Manager

Scopely

Barcelona, Catalonia, Spain (Hybrid)
6 Months ago
USE Insider - Technical Support Specialist - Vietnam

USE Insider

Ho Chi Minh City, Vietnam (Hybrid)
2 Weeks ago
Virtuos - Human Resource Manager

Virtuos

Vietnam (On-Site)
4 Months ago
eBay - Senior Manager, Strategy & Business Operations, eBay Motors

eBay

Kleinmachnow, Brandenburg, Germany (On-Site)
3 Weeks ago
Blink - Gen AI Product Design Strategist

Blink

Atlanta, Georgia, United States (On-Site)
2 Months ago
PwC - Associate-SAP FICO-Kolkata-RDC

PwC

Kolkata, West Bengal, India (On-Site)
10 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

Luxoft - Senior Software Support Engineer

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
8 Months ago
PwC - Senior ESG consulting expert

PwC

Kyiv, Kyiv City, Ukraine (On-Site)
10 Months ago
seeking alpha - IT Specialist

seeking alpha

Ukraine (Remote)
2 Weeks ago
EveryMatrix - Trainee / Junior Technical Project Manager

EveryMatrix

Lviv, Lviv Oblast, Ukraine (Hybrid)
1 Month ago
luxsoft - Android Unreal 3D HMI Developer

luxsoft

Odesa, Odesa Oblast, Ukraine (On-Site)
2 Months ago
D-market - Customer Support Specialist

D-market

Ukraine (On-Site)
3 Weeks ago
Playtika - Senior Motion Designer

Playtika

Kyiv, Kyiv City, Ukraine (On-Site)
4 Months ago
playrix  - Lead C++ Software Engineer (Gameplay)

playrix

Ukraine (Remote)
9 Months ago
Luxoft - Data Engineer for Market Data Projects (with Streamlit Expertise)

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
8 Months ago
Virtuos - PMO Producer

Virtuos

Ukraine (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

TransUnion - Sr Analyst, Data Analysis and Consulting

TransUnion

Burlington, Ontario, Canada (Hybrid)
3 Weeks ago
Hashlist - Principal Data Engineer

Hashlist

Chennai, Tamil Nadu, India (Hybrid)
9 Months ago
Bluevine India - Senior Data Scientist

Bluevine India

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Diligent Corporation - Product Data Scientist

Diligent Corporation

Budapest, Hungary (On-Site)
3 Months ago
Match Group - Manager, Data Science

Match Group

Palo Alto, California, United States (Hybrid)
1 Month ago
Spaulding Ridge - Data Engineer Associate

Spaulding Ridge

Jaipur, Rajasthan, India (On-Site)
1 Month ago
Next Level Business Services - Senior Data Engineer

Next Level Business Services

Chicago, Illinois, United States (On-Site)
9 Months ago
Sword Health - Data Engineer

Sword Health

Porto, Porto District, Portugal (Remote)
1 Year ago
Nagarro - Associate Staff Engineer, Big Data

Nagarro

(On-Site)
9 Months ago
Monzo - Lead Data Scientist

Monzo

London, England, United Kingdom (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded