Data Engineer (with Databricks)

3 Months ago • 3-4 Years • Data Analysis

Job Summary

Job Description

Enhance a robust data pipeline for a SaaS product, ensuring data contextualization, validation, and ingestion. Collaborate on scalable data solutions, conduct system debugging, develop self-service tools, and maintain documentation. Design, build, and maintain data pipelines using Python, working with an international team. Responsibilities include data analysis, bug fixing, documentation creation, tenant setup, integration testing, and GitLab code management. Utilizing Databricks for data processing and management is crucial. The role requires expertise in Python, SQL, relational databases, and cloud platforms (preferably Azure).
Must have:
  • Python proficiency (production-grade pipelines)
  • Databricks experience
  • SQL & relational databases
  • Data pipeline design & maintenance
  • Cloud platform familiarity (Azure preferred)
  • System debugging & analysis
  • Documentation creation & maintenance
  • Testing frameworks proficiency
  • GitLab or equivalent experience
Good to have:
  • Docker and Kubernetes experience
  • Document & graph databases
  • Ability to travel for workshops
Perks:
  • Flexible working format
  • Competitive salary & benefits
  • Career growth & development
  • Professional development tools
  • Tech communities & knowledge sharing
  • Education reimbursement
  • Corporate events & team buildings

Job Details

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collabs engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client’s platform with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-world empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2) 
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 3-4 years as data engineer, or in a relevant field
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights
  • Cloud: Familiarity with cloud platforms (preferably Azure)
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms
  • Database Skills: Knowledge of relational databases, with proficiency in SQL.
  • Big Data: Experience using Apache Spark
  • Documentation: Experience in creating and maintaining structured documentation.
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability
  • Version Control: Experience with Gitlab or equivalent tools.
  • English Proficiency: B2 level or higher.
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset 

Nice to have:

  • Experience with Docker and Kubernetes
  • Experience with document and graph databases
  • Ability to travel abroad twice a year for an on-site workshops 

We offer*:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

*not applicable for freelancers

Similar Jobs

Archipelago - DevOps Engineer

Archipelago

Noida, Uttar Pradesh, India (On-Site)
3 Months ago
Zinnia - Revenue Operations Manager (Data and Analytics)

Zinnia

New York, New York, United States (Hybrid)
2 Weeks ago
Scopely - Technical Lead of Analytics Engineering

Scopely

Barcelona, Catalonia, Spain (Hybrid)
8 Months ago
Mark43 - Contract Manager

Mark43

(Remote)
2 Weeks ago
JDA - Senior Support Engineer 2 (BY SCPO/ BY Demand, Fulfillment)

JDA

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Western Digital - Engineer, Data Analyst Equipment Engineering

Western Digital

Bayan Lepas, Penang, Malaysia (On-Site)
3 Months ago
Meta - Data Science Director

Meta

Austin, Texas, United States (Remote)
8 Months ago
luxsoft - Technical Lead / Senior Data Engineer

luxsoft

Italy, New York, United States (Remote)
1 Month ago
Capgemini - Cloud Data Platform Engineer

Capgemini

Mumbai, Maharashtra, India (On-Site)
1 Month ago
Apple - AI Data Scientist

Apple

Cupertino, California, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Gusto - Head of Pricing

Gusto

Denver, Colorado, United States (Hybrid)
1 Week ago
Glean - Enterprise Account Executive

Glean

Austin, Texas, United States (Remote)
4 Weeks ago
Minecast - Senior Data Analyst

Minecast

Lexington, Massachusetts, United States (On-Site)
1 Week ago
Aledade - Director, Design Systems & Operations

Aledade

Arlington, Virginia, United States (Remote)
1 Week ago
Figma - Account Executive, Federal

Figma

San Francisco, California, United States (Remote)
1 Month ago
Cognite - Vice President, Global Customer Support

Cognite

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Glean - Product Manager, AI Governance

Glean

Palo Alto, California, United States (On-Site)
2 Months ago
smarsh - Sr. Account Executive, Enterprise

smarsh

United States (On-Site)
9 Months ago
Mixpanel - Account Manager, Small and Medium-sized Businesses

Mixpanel

San Francisco, California, United States (Hybrid)
2 Weeks ago
Lead Venture - Sales Enablement Content Specialist

Lead Venture

Belmopan, Cayo District, Belize (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Poland

LeoVegas - Backend Engineer - Payments

LeoVegas

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Week ago
Veeam Software - Middle/Senior C# Developer for Azure Backup

Veeam Software

Poland (Remote)
2 Months ago
Sperasoft - Senior Landscape Artist

Sperasoft

Lesser Poland Voivodeship, Poland (Hybrid)
3 Months ago
Playtika - TypeScript Technical Lead

Playtika

Poland (Hybrid)
9 Months ago
Marsh McLennan - Process Efficiency Project Manager

Marsh McLennan

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
Veeam Software - C++ Developer (System Components)

Veeam Software

Poland (Remote)
2 Months ago
Social Discovery Ventures - Senior Product Designer (AI Product)

Social Discovery Ventures

Warsaw, Masovian Voivodeship, Poland (Remote)
2 Months ago
Techland - Senior Level Designer

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
Veeam Software - Sales Development Representative

Veeam Software

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
ElevenLabs - Design Engineer

ElevenLabs

Poland (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Capgemini - Data Engineer

Capgemini

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Ziff Davis - Data Engineer

Ziff Davis

London, England, United Kingdom (Hybrid)
1 Month ago
Nice - Senior Data Engineer

Nice

Atlanta, Georgia, United States (On-Site)
4 Weeks ago
luxsoft - Data Engineer

luxsoft

Toronto, Ontario, Canada (On-Site)
3 Weeks ago
Devoteam - Data engineer -Apache NIFI

Devoteam

Casablanca, Casablanca-Settat, Morocco (Remote)
9 Months ago
Quantic Dream - Data Analyst (F/M/NB)

Quantic Dream

Paris, Île-de-France, France (Hybrid)
9 Months ago
luxsoft - Avaloq Software Engineer (Data)

luxsoft

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Match Group - Data Analyst

Match Group

Rio De Janeiro, Brazil (Remote)
2 Months ago
PayPal - Staff Data Scientist

PayPal

San Jose, California, United States (Hybrid)
1 Month ago
Nagarro - Principal Consultant, Business Analyst

Nagarro

New York, New York, United States (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded