Data Engineer (with Databricks)

1 Month ago • 3-4 Years • Data Analyst

Job Summary

Job Description

Enhance a robust data pipeline for a SaaS product, ensuring data contextualization, validation, and ingestion. Collaborate on scalable data solutions, conduct system debugging, develop self-service tools, and maintain documentation. Design, build, and maintain data pipelines using Python, working with an international team. Responsibilities include data analysis, bug fixing, documentation creation, tenant setup, integration testing, and GitLab code management. Utilizing Databricks for data processing and management is crucial. The role requires expertise in Python, SQL, relational databases, and cloud platforms (preferably Azure).
Must have:
  • Python proficiency (production-grade pipelines)
  • Databricks experience
  • SQL & relational databases
  • Data pipeline design & maintenance
  • Cloud platform familiarity (Azure preferred)
  • System debugging & analysis
  • Documentation creation & maintenance
  • Testing frameworks proficiency
  • GitLab or equivalent experience
Good to have:
  • Docker and Kubernetes experience
  • Document & graph databases
  • Ability to travel for workshops
Perks:
  • Flexible working format
  • Competitive salary & benefits
  • Career growth & development
  • Professional development tools
  • Tech communities & knowledge sharing
  • Education reimbursement
  • Corporate events & team buildings

Job Details

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collabs engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client’s platform with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2) 
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 3-4 years as data engineer, or in a relevant field
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights
  • Cloud: Familiarity with cloud platforms (preferably Azure)
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms
  • Database Skills: Knowledge of relational databases, with proficiency in SQL.
  • Big Data: Experience using Apache Spark
  • Documentation: Experience in creating and maintaining structured documentation.
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability
  • Version Control: Experience with Gitlab or equivalent tools.
  • English Proficiency: B2 level or higher.
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset 

Nice to have:

  • Experience with Docker and Kubernetes
  • Experience with document and graph databases
  • Ability to travel abroad twice a year for an on-site workshops 

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Similar Jobs

Cubic corporation - AWS Cloud Architect

Cubic corporation

Hyderabad, Telangana, India (On-Site)
2 Weeks ago
Reality studios - Scala Backend Developer

Reality studios

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
1 Week ago
AGS - American Gaming Systems - Lead DevSecOps Engineer

AGS - American Gaming Systems

Georgia (On-Site)
1 Month ago
BigID - Solutions Engineer

BigID

Tel Aviv-Yafo, Tel Aviv District, Israel (Hybrid)
2 Weeks ago
Airbyte - Solutions Architect

Airbyte

New York, United States (On-Site)
2 Weeks ago
PwC - IN-Senior Associate_ Data Governance _D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
5 Months ago
Gulliver's Games - Data Analyst/Engineer

Gulliver's Games

İstanbul, Türkiye (On-Site)
8 Months ago
PwC - Senior BI/Data analyst – Technology Consulting

PwC

Prague, Prague, Czechia (On-Site)
7 Months ago
Twitch - Data Scientist

Twitch

San Francisco, California, United States (On-Site)
1 Month ago
truecaller - Data Architect

truecaller

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

VGW - Software Engineer

VGW

Perth, Western Australia, Australia (On-Site)
1 Week ago
Zazz - Cloud Engineer (Azure)

Zazz

(Remote)
3 Months ago
Meta - Production Engineering

Meta

Austin, Texas, United States (Hybrid)
6 Months ago
Gigamon - Staff Software Engineer - Gigasmart - Mobility

Gigamon

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Leapwork - Sr. Software Engineer

Leapwork

Gurugram, India (On-Site)
2 Weeks ago
AI Fund - Senior Frontend Engineer

AI Fund

Palo Alto, California, United States (Hybrid)
7 Months ago
Scale AI - Senior Software Engineer, Enterprise GenAI

Scale AI

San Francisco, California, United States (On-Site)
1 Week ago
Sprinkler - Technical Project Manager

Sprinkler

Gurugram, Haryana, India (On-Site)
2 Weeks ago
Maersk Careers - Elixir Software Engineer

Maersk Careers

Bengaluru, Karnataka, India (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Poland

ten square games - User Acquisition Manager

ten square games

Wrocław, Lower Silesian Voivodeship, Poland (Hybrid)
3 Weeks ago
Haleon - Brand Manager

Haleon

Warsaw, Masovian Voivodeship, Poland (Hybrid)
4 Weeks ago
Marsh McLennan - Junior Quality of Living Analyst

Marsh McLennan

Warsaw, Masovian Voivodeship, Poland (Hybrid)
4 Weeks ago
Visa - Software Engineer - Backend

Visa

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
smartbear - API Product Owner

smartbear

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
2 Weeks ago
PwC - Starszy Konsultant  / Starsza Konsultantka | Ryzyko Kredytowe

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
6 Months ago
N-ix - Senior Data Scientist/AI Engineer

N-ix

Poland (Hybrid)
1 Month ago
Wargaming - UX/UI Designer (Unannounced Project)

Wargaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
flying wild hog - Lead User Researcher

flying wild hog

Poland (Remote)
3 Months ago
CD PROJEKT RED - Senior DevOps Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Hitachi - Azure Data Engineer (MS)

Hitachi

Pune, Maharashtra, India (Remote)
7 Months ago
playrix  - Data QA Engineer

playrix

Almaty, Almaty Region, Kazakhstan (Remote)
7 Months ago
Fanatee - Product Business Analyst

Fanatee

(Remote)
1 Month ago
Canva - Staff Data Scientist – Analytics Prototyping and Development, Remote across ANZ

Canva

Sydney, New South Wales, Australia (Remote)
6 Months ago
Axinous - Associate, Strategic Finance/Investor Relations

Axinous

Hyderabad, Telangana, India (Remote)
2 Months ago
Zen consultancy - Data science interns

Zen consultancy

Bengaluru, Karnataka, India (On-Site)
6 Months ago
PW (PhysicsWallah) - Product Analytics Manager

PW (PhysicsWallah)

Noida, Uttar Pradesh, India (On-Site)
7 Months ago
Krafton - Product Analyst

Krafton

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Maersk Careers - Vendor Master Data Lead

Maersk Careers

Bengaluru, Karnataka, India (On-Site)
340 Years ago
Bungie - Senior Product Security Analyst

Bungie

(Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded