Senior Data Engineer

1 Month ago • 5 Years + • Data Analyst

Job Summary

Job Description

We are seeking a proactive Senior Data Engineer to join our team. You will design, develop, and maintain data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. Responsibilities include collaborating with cross-functional teams to understand data requirements, implementing scalable data pipelines, creating data models, developing ETL/ELT processes, monitoring pipeline performance, troubleshooting issues, and staying current with emerging technologies. The ideal candidate possesses a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges. The role requires expertise in Palantir Foundry, Python, PySpark, SQL, and cloud services (AWS, Azure, GCP).
Must have:
  • 5+ years data engineering experience (Pharma/Life Sciences preferred)
  • Proficiency in Python and PySpark
  • Big data technologies (Hadoop, Spark, Kafka, BigQuery)
  • Cloud services (AWS Glue, Azure Data Factory, GCP Dataflow)
  • Data modeling, warehousing, ETL/ELT
  • Database systems (PostgreSQL, MySQL, NoSQL)
  • Containerization (Docker, Kubernetes)
  • Problem-solving, communication, collaboration
Good to have:
  • Cloud certifications
  • Apache Lucene, REST API experience
  • Veeva CRM, Reltio, SAP, Palantir Foundry familiarity
  • Pharmaceutical industry regulations knowledge
  • JavaScript and TypeScript experience
Perks:
  • Flexible working format (remote, office, hybrid)
  • Competitive salary and benefits package
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events

Job Details

We are seeking a proactive Senior Data Engineer to join our vibrant team.

As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges. 

Key Responsibilities:

  • Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
  • Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.
  • Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
  • Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency. 
  • Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
  • Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.

Tools and skills you will use in this role:

  • Palantir Foundry
  • Python
  •  PySpark
  • SQL
  • TypeScript

Required:

  • 5+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry;
  • Strong proficiency in Python and PySpark;
  • Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);
  • Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);
  • Expertise in data modeling, data warehousing, and ETL/ELT concepts;
  • Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);
  • Proficiency in containerization technologies (e.g., Docker, Kubernetes);
  • Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;
  • Strong communication and teamwork abilities;
  • Understanding of data security and privacy best practices;
  • Strong mathematical, statistical, and algorithmic skills.

Nice to have:

  • Certification in Cloud platforms, or related areas;
  • Experience with search engine Apache Lucene, Webservice Rest API;
  • Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry;
  • Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous;
  • Previous experience working with JavaScript and TypeScript.

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Similar Jobs

Coda - Senior/Staff Full Stack Engineer

Coda

Bangkok, Thailand (Hybrid)
2 Years ago
Ruby play - Engineering Lead (Engagement Tools)

Ruby play

Warsaw, Masovian Voivodeship, Poland (Remote)
1 Month ago
Neolytix - Full Stack Developer

Neolytix

Gurugram, Haryana, India (Hybrid)
4 Weeks ago
Qualcomm - Embedded Linux Dev Engineer

Qualcomm

London, England, United Kingdom (On-Site)
3 Weeks ago
Dentsu Aegis - Senior Developer

Dentsu Aegis

Aarhus, Denmark (On-Site)
5 Days ago
Luxoft - Senior Data Ops Engineer

Luxoft

Delhi, India (On-Site)
6 Months ago
bytedance - LLM Global Data - LLM Coding Trainer Intern - 2025 Start

bytedance

Singapore (On-Site)
4 Months ago
Canva - Staff Data Scientist – Analytics Prototyping and Development, Remote across ANZ

Canva

Sydney, New South Wales, Australia (Remote)
6 Months ago
playrix  - Senior Data Analyst (Attribution)

playrix

Montenegro (Remote)
7 Months ago
Jam City - Product Manager

Jam City

Buenos Aires, Buenos Aires, Argentina (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Wind River - Member of Technical Staff

Wind River

Chennai, Tamil Nadu, India (Hybrid)
1 Week ago
affinidi - Engineering Manager, Full Stack

affinidi

Dublin, County Dublin, Ireland (Hybrid)
2 Weeks ago
Canva - Senior Frontend Engineer - Help Content and Findability

Canva

Sydney, New South Wales, Australia (Remote)
2 Months ago
NetBrain - Full-Stack Software Engineer

NetBrain

Burlington, Massachusetts, United States (On-Site)
1 Month ago
BigID - R&D Team Lead

BigID

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Weeks ago
Grid - DevOps Engineer

Grid

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
2 Weeks ago
Qualcomm - Embedded Linux Dev Engineer

Qualcomm

London, England, United Kingdom (On-Site)
3 Weeks ago
VGW - Software Engineer

VGW

Sydney, New South Wales, Australia (On-Site)
1 Week ago
Ion - Principal Software Engineer, Italy

Ion

Collecchio, Emilia-Romagna, Italy (On-Site)
7 Months ago
Fluxon - Staff Software Engineer

Fluxon

Bengaluru, Karnataka, India (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

Jobs in Armenia

peter and sons games - Chief Technology Officer

peter and sons games

Yerevan, Yerevan, Armenia (On-Site)
1 Week ago
G5 games - 2D Character Artist (Match-3 project)

G5 games

Yerevan, Yerevan, Armenia (Remote)
1 Month ago
playrix  - Lead Location Designer

playrix

Armenia (Remote)
7 Months ago
G5 games - Lead Game Creative 2D Artist (Match-3 project)

G5 games

Yerevan, Yerevan, Armenia (Remote)
1 Month ago
playrix  - Senior Unity Software Engineer (Gameplay)

playrix

Armenia (Remote)
7 Months ago
G5 games - 2D Character Artist (Hidden objects project)

G5 games

Yerevan, Yerevan, Armenia (Remote)
7 Months ago
Sperasoft - 2D Weapon Artist

Sperasoft

Yerevan, Yerevan, Armenia (On-Site)
1 Month ago
playrix  - Senior Technical Designer

playrix

Armenia (Remote)
7 Months ago
playrix  - Senior C++/Python Software Engineer (Engine)

playrix

Armenia (Remote)
7 Months ago
G5 games - Strategic Product Analyst

G5 games

Yerevan, Yerevan, Armenia (Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Embark Studios - Product Manager - Games

Embark Studios

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago
Joyteractive - Market Research Analyst

Joyteractive

Poland (Remote)
2 Months ago
Gulliver's Games - Data Analyst/Engineer

Gulliver's Games

İstanbul, Türkiye (On-Site)
8 Months ago
PwC - IN_Manager_ Data Governance, D&A_Advisory_Manager

PwC

Mumbai, Maharashtra, India (On-Site)
8 Months ago
Playtika - Marketing Systems Analyst

Playtika

Israel (On-Site)
6 Months ago
Ion - Analyst - LCM - Mumbai - 764

Ion

Mumbai, Maharashtra, India (On-Site)
7 Months ago
bytedance - Asset Manager, Datacenter Infrastructure and Services

bytedance

Singapore (On-Site)
2 Months ago
GoTo Group - Senior Data Warehouse Engineer - India

GoTo Group

Bengaluru, Karnataka, India (On-Site)
7 Months ago
PwC - IN-Senior Associate_ Data Modeler _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Every matrix - Business Intelligence Lead

Every matrix

Bucharest, Bucharest, Romania (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded