Middle Data Engineer (Databricks)

undefined ago • 3-4 Years • Data Analysis

Job Summary

Job Description

Join a team enhancing a robust data pipeline for a SaaS product, focusing on contextualization, validation, and ingestion of customer data. Collaborate with product teams to leverage data insights for new user experiences and build data quality solutions. Develop self-service tools for streamlined data onboarding. The client's platform transforms capital projects and operations, empowering users to digitally manage assets, backed by 30 years of software expertise and a strong industrial legacy.
Must have:
  • Design, build, and maintain data pipelines using Python.
  • Minimum 3-4 years experience as a data engineer.
  • Advanced Python for production-grade data pipelines.
  • Familiarity with cloud platforms, preferably Azure.
  • Experience with Databricks, Snowflake, or similar data platforms.
  • Proficiency in SQL and relational databases.
  • Experience using Apache Spark.
  • Proficiency in testing frameworks.
  • Experience with Gitlab or equivalent version control.
  • English proficiency (B2 level or higher).
  • Ability to collaborate in international teams.
Good to have:
  • Experience with Docker and Kubernetes.
  • Experience with document and graph databases.
  • Ability to travel abroad twice a year for on-site workshops.
Perks:
  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Job Details

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client’s platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2)
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 3-4 years as data engineer, or in a relevant field.
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights.
  • Cloud: Familiarity with cloud platforms (preferably Azure).
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms.
  • Database Skills: Knowledge of relational databases, with proficiency in SQL.
  • Big Data: Experience using Apache Spark.
  • Documentation: Experience in creating and maintaining structured documentation.
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability.
  • Version Control: Experience with Gitlab or equivalent tools.
  • English Proficiency: B2 level or higher.
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset

Nice to have:

  • Experience with Docker and Kubernetes.
  • Experience with document and graph databases.
  • Ability to travel abroad twice a year for an on-site workshops.

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Poland

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!