Senior Data Engineer

1 Month ago • 5 Years + • Data Analyst

Job Summary

Job Description

Senior Data Engineer needed to design, develop, and maintain data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. Responsibilities include collaborating with cross-functional teams, gathering data requirements, creating data models, implementing ETL/ELT processes, monitoring pipeline performance, troubleshooting issues, and staying current with emerging technologies. The ideal candidate will have 5+ years of experience in data engineering, proficiency in Python and PySpark, experience with big data technologies and cloud services, expertise in data modeling and warehousing, and experience with database systems and containerization technologies. Strong problem-solving, communication, and collaboration skills are essential.
Must have:
  • 5+ years data engineering experience (Pharma/Life Sciences preferred)
  • Proficiency in Python & PySpark
  • Big data technologies (Hadoop, Spark, Kafka, BigQuery)
  • Cloud services (AWS Glue, Azure Data Factory, GCP Dataflow)
  • Data modeling, warehousing, ETL/ELT
  • Database systems (PostgreSQL, MySQL, NoSQL)
  • Containerization (Docker, Kubernetes)
  • Data security & privacy best practices
Good to have:
  • Cloud certifications
  • Apache Lucene, REST API experience
  • Veeva CRM, Reltio, SAP, Palantir Foundry familiarity
  • Pharmaceutical industry regulations knowledge
  • JavaScript and TypeScript experience
Perks:
  • Flexible working format (remote, office, hybrid)
  • Competitive salary & compensation
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events & team buildings

Job Details

We are seeking a proactive Senior Data Engineer to join our vibrant team.

As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges. 

Key Responsibilities:

  • Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
  • Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
  • Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
  • Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency. 
  • Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
  • Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

Tools and skills you will use in this role:

  • Palantir Foundry
  • Python
  •  PySpark
  • SQL
  • TypeScript

Required:

  • 5+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry;
  • Strong proficiency in Python and PySpark;
  • Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
  • Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
  • Expertise in data modeling, data warehousing, and ETL/ELT concepts;
  • Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes);
  • Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;
  • Strong communication and teamwork abilities;
  • Understanding of data security and privacy best practices;
  • Strong mathematical, statistical, and algorithmic skills.

Nice to have:

  • Certification in Cloud platforms, or related areas;
  • Experience with search engine Apache Lucene, Webservice Rest API;
  • Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry;
  • Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous;
  • Previous experience working with JavaScript and TypeScript.

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

GoFundMe - Senior Software Engineer, Salesforce Integrations

GoFundMe

Buenos Aires, Buenos Aires, Argentina (Hybrid)
5 Hours ago
Google - Web Solutions Engineer

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Vercel - Content Engineer

Vercel

(Remote)
7 Hours ago
Adtran - Junior Software Engineer

Adtran

Gdynia, Pomeranian Voivodeship, Poland (Hybrid)
17 Hours ago
Canva - Senior Fullstack Engineer - Editing Experience

Canva

Adelaide, South Australia, Australia (Remote)
2 Weeks ago
Trendyol - Data Science Team Lead - Dolap

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
4 Months ago
Wargaming - BI Analyst (World of Tanks)

Wargaming

Belgrade, Serbia (Hybrid)
2 Weeks ago
Google - Staff Software Engineer, GenAI, Data Quality

Google

Mountain View, California, United States (On-Site)
2 Weeks ago
Canva - Senior Analytics Engineer

Canva

Melbourne, Victoria, Australia (Remote)
1 Week ago
Microsoft - Senior Analytics Engineer

Microsoft

Redmond, Washington, United States (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Level lr - Full Stack Engineer

Level lr

(Remote)
1 Day ago
Maxis Studios - Senior Multiplayer & Online Engineer

Maxis Studios

Melbourne, Victoria, Australia (Hybrid)
2 Weeks ago
Sony Interactive Entertainment - Software Engineer (Automation Framework Development/Team Lead Candidate)

Sony Interactive Entertainment

Tokyo, Japan (On-Site)
3 Months ago
PlayStation Global - Staff Software Engineer

PlayStation Global

Dublin, County Dublin, Ireland (On-Site)
3 Weeks ago
Patreon - Frontend Engineer, Platform

Patreon

San Francisco, California, United States (Hybrid)
1 Month ago
VGW - Software Engineer

VGW

Sydney, New South Wales, Australia (On-Site)
1 Day ago
Brave Group (Language barrier) - Server-Side Engineer

Brave Group (Language barrier)

(Remote)
23 Hours ago
Mendix - Senior Full-stack developer

Mendix

Rotterdam, South Holland, Netherlands (Hybrid)
6 Months ago
Nine - Senior Full Stack Engineer - React/PHP

Nine

Sydney, New South Wales, Australia (On-Site)
4 Months ago
Every matrix - Frontend Game Developer

Every matrix

Stockholm, Stockholm County, Sweden (Hybrid)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Armenia

Playrix - Creatives Producer

Playrix

Armenia (Remote)
6 Months ago
Playrix - Game Designer

Playrix

Armenia (Remote)
6 Months ago
G5 Games - 2D Character Artist (Hidden objects project)

G5 Games

Yerevan, Yerevan, Armenia (Remote)
6 Months ago
Playrix - Senior C++ Software Engineer (Build System)

Playrix

Armenia (Remote)
5 Months ago
Sperasoft - Lead Environment Artist

Sperasoft

Yerevan, Yerevan, Armenia (On-Site)
1 Week ago
Sperasoft - 2D Character Artist (stylized)

Sperasoft

Yerevan, Yerevan, Armenia (On-Site)
1 Month ago
Evolution - Game Presenter - Night Shift

Evolution

Yerevan, Yerevan, Armenia (On-Site)
8 Months ago
Playrix - Lead User Acquisition Manager

Playrix

Armenia (Remote)
6 Months ago
Playrix - Senior HR Generalist

Playrix

Armenia (Remote)
6 Months ago
Playrix - Principal VFX Artist

Playrix

Armenia (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

The Walt Disney Company - Consumer Insights Analyst

The Walt Disney Company

Hong Kong (On-Site)
5 Months ago
Playtika - Software Architect

Playtika

Israel (On-Site)
3 Months ago
PwC - Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Ciklum - Senior Data Scientist

Ciklum

Pune, Maharashtra, India (Hybrid)
6 Months ago
Sigma Software - Data Engineer

Sigma Software

Lviv, Lviv Oblast, Ukraine (On-Site)
6 Months ago
Trendyol - Data Science Team Lead - Dolap

Trendyol

İstanbul, İstanbul, Türkiye (Hybrid)
4 Months ago
Tencent - AML and Sanctions Compliance Analytics Manager

Tencent

Hong Kong (On-Site)
5 Months ago
Luxoft - Senior Data Ops Engineer

Luxoft

(Remote)
5 Months ago
SciPlay - Business Intelligence Developer

SciPlay

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Token Metrics - Senior Crypto Data Engineer (Remote)

Token Metrics

Budapest, Hungary (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded