Middle/Senior Data Engineer (#2477)

We are seeking a proactive Middle Strong/Senior Data Engineer to join our vibrant team. In this role, you will take on a pivotal position, collaborating closely with senior data engineers to architect, develop, and maintain sophisticated data pipelines, Ontology Objects, and Foundry Functions within Palantir Foundry. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.

Responsibilities:

• Design, implement, and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.
• Collaborate with cross-functional teams to gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering.
• Develop and optimize ETL processes to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.
• Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.
• Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.
  
  

Requirements:

• 4+ years of experience in data engineering, preferably within the pharmaceutical or life sciences industry
• Proven experience as a Data Engineer with a focus on cloud-based solutions.
• Strong proficiency in Python, and PySpark
• Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow).
• Expertise in data modeling, database design, and optimization.
• Familiarity with Big Data technologies (e.g., Apache Spark, Hadoop) is a plus.
• Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities.
• US working hours

Nice to have:

• Certification in Cloud platforms, or related areas.
• Proficiency in containerization technologies (e.g., Docker, Kubernetes).
• Experience with search engine Apache Lucene, Webservice Rest API
• Familiarity with Veeva CRM, Reltio, SAP, and/or Palantir Foundry.
• Knowledge of pharmaceutical industry regulations, such as data privacy laws, is advantageous.
• Previous experience working with JavaScript and TypeScript