SENIOR DATA ENGINEER (DATABRICKS) (#2703)

3 Months ago • 3-4 Years • Data Analyst

Job Summary

Job Description

This Senior Data Engineer (Databricks) role involves designing, building, and maintaining data pipelines using Python within a robust SaaS product environment. Collaborate with international teams on scalable data solutions, conduct in-depth system debugging, develop smart documentation, set up Databricks tenants, write integration tests, and manage code using Gitlab. Responsibilities include ensuring data quality, building self-service tools, and analyzing real-world engineering data to inspire customer confidence. The role requires advanced Python proficiency, experience with Databricks, and strong collaboration skills.
Must have:
  • 3-4 years Data Engineering experience
  • Advanced Python proficiency
  • Databricks expertise
  • SQL proficiency
  • Strong collaboration skills
  • Experience with Gitlab
  • Data pipeline design & maintenance
Good to have:
  • Docker and Kubernetes experience
  • Document and graph database experience
  • 3D modeling familiarity
  • Azure cloud platform experience
  • Snowflake experience
Perks:
  • Flexible working format
  • Competitive salary
  • Personalized career growth
  • Professional development tools
  • Active tech communities
  • Education reimbursement
  • Corporate events

Job Details

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collaborate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Scandinavian-based client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client’s platform empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2) 
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 3-4 years as data engineer, or in a relevant field
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights
  • Cloud: Familiarity with cloud platforms (preferably Azure)
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms
  • Database Skills: Knowledge of relational databases, with proficiency in SQL
  • Big Data: Experience using Apache Spark 
  • Documentation: Experience in creating and maintaining structured documentation
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability
  • Version Control: Experience with Gitlab or equivalent tools
  • English Proficiency: B2 level or higher
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset 

Nice to have:

  • Experience with Docker and Kubernetes
  • Experience with document and graph databases
  • 3D Modeling: Familiarity with 3D matching and model refinement processes is a plus
  • Ability to travel abroad twice a year for an on-site workshops 

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

Metacore - DevOps Advocate

Metacore

Helsinki, Uusimaa, Finland (Hybrid)
5 Months ago
Egnyte - Sr. Test Performance Engineer

Egnyte

Poznań, Greater Poland Voivodeship, Poland (Remote)
2 Months ago
Activision - Staff Backend Engineer - Activision Blizzard Media

Activision

San Francisco, California, United States (On-Site)
4 Months ago
Saviynt - Sr. Principal Software Engineer - Privileged Access Management (PAM)

Saviynt

El Segundo, California, United States (Hybrid)
6 Months ago
Razer - Lead Site Reliability Engineer

Razer

Shanghai, Shanghai, China (On-Site)
6 Months ago
Socialpoint - Lead Game Data Scientist

Socialpoint

Barcelona, Catalonia, Spain (Hybrid)
3 Months ago
GameChanger  - Senior Strategy Data Analyst

GameChanger

(Hybrid)
2 Months ago
Conjointly - Quantitative Market Researcher

Conjointly

Bogotá, Bogota, Colombia (Remote)
3 Months ago
CrazyLabs - Game Analytics Team Leader

CrazyLabs

Berlin, Berlin, Germany (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CloudHire - Senior Full Stack Architect : Angular & NestJS

CloudHire

Hyderabad, Telangana, India (Remote)
6 Months ago
NVIDIA - Senior Network Engineer

NVIDIA

Yokne'am Illit, North District, Israel (On-Site)
3 Months ago
Enphase Energy - DevOps Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Ubisoft - DevOps Linux Administrator

Ubisoft

Saint-Mandé, Île-de-France, France (On-Site)
2 Months ago
PwC - Cloud DevSecOps Architect

PwC

Toronto, Ontario, Canada (Hybrid)
3 Months ago
Brightline - Web Streaming Engineer

Brightline

Virginia, United States (Hybrid)
3 Months ago
Ubisoft - Fullstack Developer Assistant

Ubisoft

Bordeaux, Nouvelle-Aquitaine, France (On-Site)
2 Months ago
Playtech - Junior Java Developer

Playtech

Sofia, Sofia City Province, Bulgaria (On-Site)
1 Month ago
Paytm - DevOps - Lead DevOps

Paytm

Noida, Uttar Pradesh, India (Hybrid)
6 Months ago
Next Level Games - Senior IT Administrator

Next Level Games

British Columbia, Canada (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Poland

PwC - Senior Analyst with German | Financial Crime Unit

PwC

Gdańsk, Pomeranian Voivodeship, Poland (Hybrid)
6 Months ago
PwC - Senior Data Scientist

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
6 Months ago
Techland - Senior System Designer - Live Ops

Techland

Poland (On-Site)
6 Months ago
PAPAYA - Backend Engineer

PAPAYA

Warsaw, Masovian Voivodeship, Poland (Hybrid)
5 Months ago
Keywords Studios (Player Support) - AI - Research Associate (Prompts)

Keywords Studios (Player Support)

Katowice, Silesian Voivodeship, Poland (On-Site)
2 Months ago
Futurum Technology  - Młodszy Specjalista ds. finansowych i prawnych

Futurum Technology

Wadowice, Lesser Poland Voivodeship, Poland (On-Site)
7 Months ago
CD PROJEKT RED - Intern in Online Services Team (C++)

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
1 Month ago
Tripledot Studios - Game Designer

Tripledot Studios

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Warner Bros Discovery - Financial Analyst - German Speaking

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
5 Months ago
Keywords Studios (Player Support) - Brazilian or European Portuguese Speaking Game Tester (LQA)

Keywords Studios (Player Support)

Katowice, Silesian Voivodeship, Poland (On-Site)
11 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

prizepicks - Data Scientist - Simulation/Sports Modeling

prizepicks

Atlanta, Georgia, United States (Remote)
2 Months ago
PwC - IN_Senior Associate _Visualization Engineer _Data & Analytics _Advisory _Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Canva - Staff Data Scientist - Canva Growth

Canva

Sydney, New South Wales, Australia (Hybrid)
5 Months ago
PwC - Senior Associate_Java Full Stack Developer_Data & Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
FanCode - ML Engineer

FanCode

Mumbai, Maharashtra, India (On-Site)
5 Months ago
Tencent - Data Science Intern

Tencent

Palo Alto, California, United States (On-Site)
2 Months ago
Velotio Technologies - Software Engineer (DE)

Velotio Technologies

Pune, Maharashtra, India (Remote)
6 Months ago
Spin Master - eCommerce Data Analyst

Spin Master

Ontario, Canada (Hybrid)
2 Months ago
InvenioLSI - SAP Analytics SEM

InvenioLSI

New Delhi, Delhi, India (On-Site)
4 Months ago
HP - Senior Adobe Analytics Developer

HP

Sant Cugat Del Vallès, Catalonia, Spain (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded