N-iX seeks a proactive Middle/Senior Big Data Engineer to design, develop, and maintain data pipelines using Palantir Foundry.  Responsibilities include collaborating with cross-functional teams, gathering data requirements, creating data models, developing ETL/ELT processes, monitoring pipeline performance, and troubleshooting issues.  The ideal candidate will have 4+ years of experience in data engineering, strong Python and PySpark proficiency, and experience with big data technologies and cloud services.  The role requires expertise in data modeling, data warehousing, and ETL/ELT concepts.

N-iX

Mobile Lead Engineer (iOS and Android Team)

Strong Middle Data Engineer (Azure Databricks)

Senior Python Engineer

Senior Full Stack Engineer (TypeScript)

Junior Automation QA Engineer (with Python)

Senior/Lead Power BI Engineer

Senior AQA Engineer (With .NET)

Senior (Lead) DevOps Engineer

Senior Product Owner

Senior Data Engineer

<div class="section-description">
 N-iX is looking for a proactive Middle/Senior Big Data Engineer to join our vibrant team!
You will play a critical role in designing, developing, and maintaining sophisticated data pipelines, and using Foundry tools such as Ontology, Pipeline Builder, Code Repositories, etc. The ideal candidate will possess a robust background in cloud technologies, data architecture, and a passion for solving complex data challenges.
Tools and skills you will use in this role: Palantir Foundry, Python, PySpark, SQL, basic TypeScript.
Responsibilities:
<ul>
<li>Collaborate with cross-functional teams to understand data requirements, and design, implement and maintain scalable data pipelines in Palantir Foundry, ensuring end-to-end data integrity and optimizing workflows.</li>
<li>Gather and translate data requirements into robust and efficient solutions, leveraging your expertise in cloud-based data engineering. Create data models, schemas, and flow diagrams to guide development.</li>
<li>Develop, implement, optimize and maintain efficient and reliable data pipelines and ETL/ELT processes to collect, process, and integrate data to ensure timely and accurate data delivery to various business applications, while implementing data governance and security best practices to safeguard sensitive information.</li>
<li>Monitor data pipeline performance, identify bottlenecks, and implement improvements to optimize data processing speed and reduce latency.</li>
<li>Troubleshoot and resolve issues related to data pipelines, ensuring continuous data availability and reliability to support data-driven decision-making processes.</li>
<li>Stay current with emerging technologies and industry trends, incorporating innovative solutions into data engineering practices, and effectively document and communicate technical solutions and processes.</li>
<li>Be eager to get familiar with new tools and technologies</li>
</ul>
Requirements:
<ul>
<li>4+ years of experience in data engineering;</li>
<li>Strong proficiency in Python and PySpark;</li>
<li>Proficiency with big data technologies (e.g., Apache Hadoop, Spark, Kafka, BigQuery, etc.);</li>
<li>Hands-on experience with cloud services (e.g., AWS Glue, Azure Data Factory, Google Cloud Dataflow);</li>
<li>Expertise in data modeling, data warehousing, and ETL/ELT concepts;</li>
<li>Hands-on experience with database systems (e.g., PostgreSQL, MySQL, NoSQL, etc.);</li>
<li>Effective problem-solving and analytical skills, coupled with excellent communication and collaboration abilities;</li>
<li>Strong communication and teamwork abilities;</li>
<li>Understanding of data security and privacy best practices;</li>
<li>Strong mathematical, statistical, and algorithmic skills.</li>
</ul>
Nice to have:
<ul>
<li>Certification in Cloud platforms, or related areas;</li>
<li>OpenAI/any other LLM API experience&nbsp;</li>
<li>Familiarity with containerization technologies (e.g., Docker, Kubernetes);</li>
<li>Basic HTTP understanding to make API calls;</li>
<li>Familiarity with Palantir Foundry;</li>
<li>Previous work or academic experience with JavaScript / TypeScript</li>
</ul>
&nbsp;
&nbsp;<div class="content-conclusion">We offer:
<ul>
<li>Flexible working format - remote, office-based or flexible</li>
<li>A competitive salary and good compensation package</li>
<li>Personalized career growth</li>
<li>Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)</li>
<li>Active tech communities with regular knowledge sharing</li>
<li>Education reimbursement</li>
<li>Memorable anniversary presents</li>
<li>Corporate events and team buildings</li>
<li>Other location-specific benefits</li>
</ul></div> </div>

Middle/Senior Big Data Engineer (with Palantir Foundry Familiarity)