Senior Data Engineer (#4260)

N-iX is expanding in Latin America, seeking a Senior Data Engineer to join its global software development team. This role involves building scalable, cloud-native data solutions and growing into a broader architecture role. The successful candidate will lead the technical delivery of modern data platform solutions, engaging with clients and internal stakeholders to design, implement, and optimize enterprise-grade data systems. This position offers flexible work options and collaboration on international projects within a vibrant, inclusive tech community.

Must Have

• Design, build, and maintain robust data pipelines within Databricks
• Collaborate with international teams to develop scalable data solutions
• Debug complex issues in data pipelines and enhance system performance and reliability
• Set up Databricks environments on cloud platforms (Azure/AWS)
• Automate processes using CI/CD practices and infrastructure tools like Terraform
• Create and maintain detailed documentation, including workflows and operational checklists
• Develop integration and unit tests to ensure data quality and reliability
• Migrate legacy data systems to Databricks
• Participate in defining data governance and management strategies
• 5+ years of proven experience as a Data Engineer
• Advanced proficiency in Python for developing production-grade data pipelines
• Extensive hands-on experience with Databricks platform
• Strong knowledge of Apache Spark for big data processing
• Familiarity with cloud environments, specifically Azure or AWS
• Proficiency with SQL and experience managing relational databases (MS SQL preferred)
• Practical experience with Airflow or similar data orchestration tools
• Strong understanding of CI/CD pipelines and experience with tools like GitLab
• Solid skills in debugging complex data pipeline issues
• Proficiency in structured documentation practices
• B2 level or higher proficiency in English
• Strong collaboration skills, ability to adapt, and eagerness to learn

Good to Have

• Experience with Docker and Kubernetes
• Familiarity with Elasticsearch or other vector databases
• Understanding of DBT (data build tool)
• Ability to travel abroad twice a year for on-site workshops

Perks & Benefits

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

N-iX is expanding in Latin America! As a global software development company, we unite over 2,400 professionals across Europe and the Americas, delivering innovative solutions for industry-leading enterprises and Fortune 500 companies. Recognized as a Great Place to Work in Colombia, we invite you to join our growing team, enjoy flexible work options, collaborate on international projects, and thrive in a vibrant, inclusive tech community.

We are looking for a Senior Data Engineer who is passionate about building scalable, cloud-native data solutions and eager to grow into a broader architecture role. You will lead the technical delivery of modern data platform solutions while engaging with clients and internal stakeholders to design, implement, and optimize enterprise-grade data systems.

Key Responsibilities:

• Design, build, and maintain robust data pipelines within Databricks.
• Collaborate closely with international teams, including data scientists and architects, to develop scalable data solutions.
• Debug complex issues in data pipelines and proactively enhance system performance and reliability.
• Set up Databricks environments on cloud platforms (Azure/AWS).
• Automate processes using CI/CD practices and infrastructure tools such as Terraform.
• Create and maintain detailed documentation, including workflows and operational checklists.
• Develop integration and unit tests to ensure data quality and reliability.
• Migrate legacy data systems to Databricks, ensuring minimal disruption.
• Participate actively in defining data governance and management strategies.

Qualifications:

• 5+ years of proven experience as a Data Engineer.
• Advanced proficiency in Python for developing production-grade data pipelines.
• Extensive hands-on experience with Databricks platform.
• Strong knowledge of Apache Spark for big data processing.
• Familiarity with cloud environments, specifically Azure or AWS.
• Proficiency with SQL and experience managing relational databases (MS SQL preferred).
• Practical experience with Airflow or similar data orchestration tools.
• Strong understanding of CI/CD pipelines and experience with tools like GitLab.
• Solid skills in debugging complex data pipeline issues.
• Proficiency in structured documentation practices.
• B2 level or higher proficiency in English.
• Strong collaboration skills, ability to adapt, and eagerness to learn in an international team environment.

Would be a plus:

• Experience with Docker and Kubernetes.
• Familiarity with Elasticsearch or other vector databases.
• Understanding of DBT (data build tool).
• Ability to travel abroad twice a year for on-site workshops.

We offer*:

• Flexible working format - remote, office-based or flexible
• A competitive salary and good compensation package
• Personalized career growth
• Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
• Active tech communities with regular knowledge sharing
• Education reimbursement
• Memorable anniversary presents
• Corporate events and team buildings
• Other location-specific benefits

*not applicable for freelancers