Senior Data Engineer

2 Months ago • 5 Years + • Data Analyst

Job Summary

Job Description

Senior Data Engineer needed to design, develop, and maintain data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. Responsibilities include collaborating with cross-functional teams, gathering data requirements, creating data models, implementing ETL/ELT processes, monitoring pipeline performance, troubleshooting issues, and staying current with emerging technologies. The ideal candidate will have 5+ years of experience in data engineering, proficiency in Python and PySpark, experience with big data technologies and cloud services, expertise in data modeling and warehousing, and experience with database systems and containerization technologies. Strong problem-solving, communication, and collaboration skills are essential.
Must have:
  • 5+ years data engineering experience (Pharma/Life Sciences preferred)
  • Proficiency in Python & PySpark
  • Big data technologies (Hadoop, Spark, Kafka, BigQuery)
  • Cloud services (AWS Glue, Azure Data Factory, GCP Dataflow)
  • Data modeling, warehousing, ETL/ELT
  • Database systems (PostgreSQL, MySQL, NoSQL)
  • Containerization (Docker, Kubernetes)
  • Data security & privacy best practices
Good to have:
  • Cloud certifications
  • Apache Lucene, REST API experience
  • Veeva CRM, Reltio, SAP, Palantir Foundry familiarity
  • Pharmaceutical industry regulations knowledge
  • JavaScript and TypeScript experience
Perks:
  • Flexible working format (remote, office, hybrid)
  • Competitive salary & compensation
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events & team buildings

Job Details

We are seeking a proactive Senior Data Engineer to join our vibrant team.

As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges. 

Key Responsibilities:

  • Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
  • Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
  • Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
  • Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency. 
  • Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
  • Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

Tools and skills you will use in this role:

  • Palantir Foundry
  • Python
  •  PySpark
  • SQL
  • TypeScript

Required:

  • 5+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry;
  • Strong proficiency in Python and PySpark;
  • Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
  • Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
  • Expertise in data modeling, data warehousing, and ETL/ELT concepts;
  • Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes);
  • Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;
  • Strong communication and teamwork abilities;
  • Understanding of data security and privacy best practices;
  • Strong mathematical, statistical, and algorithmic skills.

Nice to have:

  • Certification in Cloud platforms, or related areas;
  • Experience with search engine Apache Lucene, Webservice Rest API;
  • Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry;
  • Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous;
  • Previous experience working with JavaScript and TypeScript.

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Assist software  - React Developer

Assist software

Suceava, Suceava County, Romania (On-Site)
6 Months ago
OpenText - Software Security Research

OpenText

Bengaluru, Karnataka, India (On-Site)
8 Months ago
LeoVegas - JavaScript Engineer

LeoVegas

Málaga, Andalusia, Spain (Hybrid)
2 Months ago
Crunchyroll - Staff DevOps Engineer

Crunchyroll

San Francisco, California, United States (Hybrid)
3 Weeks ago
Ziff Davis - Software Engineer II

Ziff Davis

Helsinki, Uusimaa, Finland (On-Site)
1 Week ago
Netflix - Analytics Engineer (L4) - Acquisition

Netflix

Los Gatos, California, United States (On-Site)
1 Month ago
Tencent - Game Data Analyst

Tencent

Shenzhen, Guangdong Province, China (On-Site)
3 Months ago
Nagarro - Senior Staff Consultant, Business Analyst

Nagarro

(On-Site)
7 Months ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

(On-Site)
4 Months ago
N-ix - Data Engineer (with Databricks)

N-ix

Poland (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

hogarth - Software Architect

hogarth

Bucharest, Bucharest, Romania (Hybrid)
1 Week ago
Highspot - Associate Engineer Internship

Highspot

Seattle, Washington, United States (Hybrid)
1 Month ago
Epic Games - SDET

Epic Games

Helsinki, Uusimaa, Finland (On-Site)
1 Month ago
Temporal Technologies - Senior Developer Success Engineer

Temporal Technologies

Bengaluru, Karnataka, India (On-Site)
2 Weeks ago
ARHS - Full Stack Developer

ARHS

Brussels, Brussels, Belgium (On-Site)
3 Months ago
Temporal Technologies - Staff Solutions Architect: Growth

Temporal Technologies

(Remote)
2 Weeks ago
Hedra - Senior Frontend Engineer

Hedra

New York, New York, United States (On-Site)
2 Months ago
OpenText - Software Security Research

OpenText

Bengaluru, Karnataka, India (On-Site)
8 Months ago
VGW - Senior Software Engineer

VGW

Perth, Western Australia, Australia (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Jobs in Armenia

Entlgd  - 3D Material Artist

Entlgd

Yerevan, Yerevan, Armenia (Hybrid)
2 Weeks ago
playrix  - Lead VFX Artist

playrix

Armenia (Remote)
7 Months ago
playrix  - Feature Owner (LiveOps)

playrix

Armenia (Remote)
7 Months ago
playrix  - Game Designer

playrix

Armenia (Remote)
7 Months ago
G5 games - VP of Business Development

G5 games

Yerevan, Yerevan, Armenia (Remote)
2 Months ago
G5 games - 2D HOG Grind Artist

G5 games

Yerevan, Yerevan, Armenia (Remote)
2 Months ago
playrix  - Senior HR Generalist

playrix

Armenia (Remote)
7 Months ago
Sperasoft - Senior 3D Props Artist

Sperasoft

Yerevan, Yerevan, Armenia (On-Site)
2 Months ago
playrix  - Principal 2D Artist

playrix

Armenia (Remote)
7 Months ago
G5 games - Game Product Manager

G5 games

Yerevan, Yerevan, Armenia (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

bytedance - Risk Data Analytics Business Partner

bytedance

Singapore (On-Site)
2 Months ago
playrix  - Data QA Engineer

playrix

Georgia (Remote)
7 Months ago
bytedance - Risk Data Analytics Business Partner

bytedance

Singapore (On-Site)
1 Month ago
Meta - Marketing Science Partner (Financial Services)

Meta

Los Angeles, California, United States (On-Site)
6 Months ago
Epic Games - Principal Data Analyst, Ecosystem Economy & UGC

Epic Games

Cary, North Carolina, United States (On-Site)
4 Months ago
Onward Search - SEO Analyst

Onward Search

Florida, United States (Hybrid)
1 Month ago
Nagarro - Staff Engineer

Nagarro

Sri Lanka (Remote)
7 Months ago
bytedance - Corporate Level Risk Control Business Partner

bytedance

Singapore (On-Site)
4 Months ago
PwC - Senior Associate_AI Engineer_Data & Analytics_Advisory_PAN India

PwC

Kolkata, West Bengal, India (On-Site)
8 Months ago
Microsoft - Member of Technical Staff, Machine Learning Engineer

Microsoft

Mountain View, California, United States (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded