Middle/Senior Big Data Engineer (with Palantir Foundry Familiarity)

1 Week ago • 4 Years + • Data Analyst

Job Summary

Job Description

N-iX seeks a proactive Middle/Senior Big Data Engineer to design, develop, and maintain data pipelines using Palantir Foundry. Responsibilities include collaborating with cross-functional teams, gathering data requirements, creating data models, developing ETL/ELT processes, monitoring pipeline performance, and troubleshooting issues. The ideal candidate will have 4+ years of experience in data engineering, strong Python and PySpark proficiency, and experience with big data technologies and cloud services. The role requires expertise in data modeling, data warehousing, and ETL/ELT concepts.
Must have:
  • 4+ years data engineering experience
  • Python & PySpark proficiency
  • Big data tech experience (Hadoop, Spark, etc.)
  • Cloud service experience (AWS, Azure, GCP)
  • Data modeling, warehousing, ETL/ELT expertise
  • Database systems experience (PostgreSQL, MySQL, etc.)
  • Palantir Foundry familiarity
Good to have:
  • Cloud certifications
  • OpenAI/LLM API experience
  • Containerization (Docker, Kubernetes)
  • HTTP understanding
  • JavaScript/TypeScript experience
Perks:
  • Flexible working format
  • Competitive salary
  • Personalized career growth
  • Professional development tools
  • Education reimbursement
  • Corporate events

Job Details

N-iX is looking for a proactive Middle/Senior Big Data Engineer to join our vibrant team!

You will play a critical role in designing, developing, and maintaining sophisticated data pipelines, and using Foundry tools such as Ontology, Pipeline Builder, Code Repositories, etc. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.

Tools and skills you will use in this role: Palantir Foundry, Python, PySpark, SQL, basic TypeScript.

Responsibilities:

  • Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
  • Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
  • Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
  • Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency.
  • Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
  • Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.
  • Be eager to get familiar with new tools and technologies

Requirements:

  • 4+ years of experience in data engineering;
  • Strong proficiency in Python and PySpark;
  • Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
  • Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
  • Expertise in data modeling, data warehousing, and ETL/ELT concepts;
  • Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
  • Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;
  • Strong communication and teamwork abilities;
  • Understanding of data security and privacy best practices;
  • Strong mathematical, statistical, and algorithmic skills.

Nice to have:

  • Certification in Cloud platforms, or related areas;
  • OpenAI/any other LLM API experience 
  • Familiarity with containerization technologies (e.g., Docker, Kubernetes);
  • Basic HTTP understanding to make API calls;
  • Familiarity with Palantir Foundry;
  • Previous work or academic experience with JavaScript / TypeScript

 

 

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Velotio Technologies - Software Engineer (Data Engineering)

Velotio Technologies

Maharashtra, India (Remote)
2 Weeks ago
PwC - Manager Fund Accounting (m/f/d)

PwC

Luxembourg (On-Site)
5 Months ago
PwC - Risk Services - BD Industry Driver

PwC

Singapore (On-Site)
5 Months ago
Aristocrat Gaming - Senior Global Marketing Researcher

Aristocrat Gaming

Las Vegas, Nevada, United States (Hybrid)
5 Days ago
Onward Search - Manager, International Brand Marketing

Onward Search

New York, New York, United States (Hybrid)
1 Month ago
Google - Senior Data Insights Lead, People with Disabilities

Google

São Paulo, State Of São Paulo, Brazil (On-Site)
3 Months ago
The Walt Disney Company - Graduate Associate, Decision Science

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
1 Week ago
SuperPlay - Senior Game Economist

SuperPlay

Tel Aviv District, Israel (On-Site)
6 Days ago
Cognite - Data Engineer

Cognite

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
DraftKings - Vice President, Advanced Analytics & Data Science

DraftKings

Boston, Massachusetts, United States (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

ByteDance - Central Strategy and Sales Policy Associate - Monetization Strategy & Operations

ByteDance

New York, New York, United States (On-Site)
6 Days ago
Scientific Games  - Field Service Technician I

Scientific Games

Kansas, United States (On-Site)
2 Months ago
Metacore - LiveOps Specialist

Metacore

Berlin, Berlin, Germany (Hybrid)
2 Weeks ago
The Walt Disney Company - Senior Manager, Business Integration - International

The Walt Disney Company

Hong Kong (On-Site)
2 Months ago
Animoca Brands - Strategic Finance Manager

Animoca Brands

Hong Kong (Hybrid)
4 Months ago
Super - Manager, Data Analytics

Super

Canada (Remote)
1 Month ago
NVIDIA - Senior Solution Architect, HPC and AI

NVIDIA

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
1 Month ago
PlayStation Global - Senior Legal Operations Specialist

PlayStation Global

San Mateo, California, United States (Hybrid)
3 Weeks ago
Zazz - Data Engineer

Zazz

(Remote)
2 Months ago
InMobiInMobi - Senior Product Analyst

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Ukraine

seeking alpha - Senior Data Engineer

seeking alpha

Ukraine (Remote)
1 Month ago
N-iX - Senior Node.js Engineer

N-iX

Ukraine (Remote)
1 Week ago
Gunzilla - Senior Gameplay Programmer

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
1 Week ago
N-iX - Senior Fullstack Engineer (Java+TypeScript)

N-iX

Ukraine (Remote)
1 Week ago
Innovecs - Middle Technical Artist

Innovecs

Ukraine (Remote)
8 Months ago
Playtika - IT Engineering Team Lead

Playtika

Ukraine (On-Site)
1 Month ago
DMarket - Senior Back-end Developer

DMarket

Ukraine (Remote)
1 Week ago
DMarket - Sr. Back-end Developer

DMarket

Ukraine (Remote)
6 Days ago
Playtika - Senior Manual QA Engineer

Playtika

Ukraine (On-Site)
1 Week ago
Virtuos - Material Artist

Virtuos

Ukraine (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Twitch - Data Science Intern (MA/PhD)

Twitch

San Francisco, California, United States (On-Site)
3 Months ago
Epic Games - Data Analyst - CorpTech Analytics

Epic Games

Cary, North Carolina, United States (On-Site)
1 Week ago
PAPAYA - Business Analytics Team Lead

PAPAYA

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Days ago
The Walt Disney Company - Senior Data Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
1 Week ago
Hashlist - Principal Data Engineer

Hashlist

Chennai, Tamil Nadu, India (Hybrid)
4 Months ago
Tencent - Data Science Intern

Tencent

Palo Alto, California, United States (On-Site)
1 Month ago
Gameplay Galaxy - Senior Data Engineer

Gameplay Galaxy

(Remote)
1 Month ago
ION - Data Engineer

ION

Budapest, Hungary (On-Site)
5 Months ago
Aristocrat Gaming - ERP Data Specialist

Aristocrat Gaming

Greystanes, New South Wales, Australia (Hybrid)
6 Days ago
Framestore - Lead DataOps and Render-Support

Framestore

Mumbai, Maharashtra, India (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded