Senior Data Engineer
Job Summary
Job Description
N-iX is seeking a Senior Data Engineer in Kyiv with 5+ years of experience in data engineering, focusing on PySpark. Responsibilities include designing, developing, and optimizing large-scale data pipelines using PySpark, collaborating with stakeholders to define data requirements, ensuring data integrity and security, and optimizing Spark jobs. Experience with Palantir Foundry is a significant plus. The role involves working with big data technologies (Hadoop, Databricks, etc.) and cloud platforms (AWS, Azure, GCP). Proficiency in SQL, data modeling, ETL processes, CI/CD, Git, and DevOps practices is essential.
Must have:
- 5+ years PySpark Data Engineering experience
- Apache Spark, distributed computing expertise
- SQL, data modeling, ETL processes
- Big data technologies (Hadoop, Databricks)
- Data pipeline design & optimization
Good to have:
- Palantir Foundry
- Kafka
- Docker, Kubernetes, Airflow
- AWS, Azure, GCP
Perks:
- Flexible working format
- Competitive salary
- Personalized career growth
- Professional development tools
- Education reimbursement
- Corporate events
12 skills required
Job Details
N-iX is looking for a Senior Data Engineer with strong expertise in PySpark to join our team in Kyiv. In this role, you will design, develop, and optimize large-scale data pipelines, ensuring efficient data processing and integration. You will also collaborate closely with business stakeholders to gather and refine data requirements, ensuring solutions align with business needs. Experience with Palantir Foundry is a huge plus.
Responsibilities:
- Design and implement scalable ETL/ELT pipelines using PySpark.
- Work closely with product owners, and different stakeholders to gather, analyze, and translate data requirements into technical solutions.
- Optimize data processing workflows for performance and reliability.
- Ensure data integrity, governance, and security best practices.
- Develop and maintain technical documentation for data pipelines and transformations.
- Troubleshoot and optimize Spark jobs to improve efficiency.
- Work with cloud-based or on-premises big data technologies.
Requirements:
- 5+ years of experience in data engineering, with a focus on PySpark.
- Strong knowledge of Apache Spark, distributed computing, and performance tuning.
- Experience gathering and refining business and technical data requirements.
- Hands-on experience with SQL, data modeling, and ETL processes.
- Proficiency in working with big data technologies (Hadoop, Databricks, etc.).
- Experience with cloud platforms (AWS, Azure, GCP) is a plus.
- Knowledge of CI/CD, version control (Git), and DevOps practices.
- Excellent problem-solving and communication skills.
Nice to have:
- Experience with Palantir Foundry.
- Familiarity with streaming technologies (Kafka).
- Exposure to containerization and orchestration (Docker, Kubernetes, Airflow).
We offer*:
- Flexible working format - remote, office-based or flexible
- A competitive salary and good compensation package
- Personalized career growth
- Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
- Active tech communities with regular knowledge sharing
- Education reimbursement
- Memorable anniversary presents
- Corporate events and team buildings
- Other location-specific benefits
*not applicable for freelancers
Similar Jobs
Nielsen Holdings
Bengaluru, Karnataka, India (Hybrid)
• 5 Months ago
Sony Interactive Entertainment
Tokyo, Japan (On-Site)
• 3 Months ago
PwC
Shanghai, Shanghai, China (On-Site)
• 6 Months ago
Next Level Business Services
Santa Clara, California, United States (On-Site)
• 5 Months ago
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
The Walt Disney Company
Orlando, Florida, United States (On-Site)
• 2 Weeks ago
Get notifed when new similar jobs are uploaded
Jobs in Kyiv, Kyiv city, Ukraine
Get notifed when new similar jobs are uploaded
Data Analyst Jobs
(On-Site)
• 4 Months ago
PwC
Gurugram, Haryana, India (On-Site)
• 4 Months ago
PwC
Mumbai, Maharashtra, India (On-Site)
• 6 Months ago
PlayStation Global
Aliso Viejo, California, United States (On-Site)
• 4 Weeks ago
Netflix
Warsaw, Masovian Voivodeship, Poland (Hybrid)
• 5 Hours ago
Get notifed when new similar jobs are uploaded
