Data Engineer (with Databricks)

4 Months ago • 3-4 Years • Data Analysis

Job Summary

Job Description

Enhance a robust data pipeline for a SaaS product, ensuring data contextualization, validation, and ingestion. Collaborate on building data quality solutions and self-service tools for data onboarding. Design, build, and maintain data pipelines using Python; conduct in-depth analysis and debugging; develop smart documentation; set up and configure new tenants; write integration tests; and use GitLab and Databricks. The role requires advanced Python skills, experience with data platforms (Databricks preferred), relational databases, and SQL.
Must have:
  • 3-4 years Data Engineering experience
  • Advanced Python proficiency
  • Data pipeline design & maintenance
  • Databricks experience
  • SQL proficiency
  • Testing frameworks
  • GitLab experience
Good to have:
  • Docker and Kubernetes
  • Document/graph databases
  • Azure familiarity
Perks:
  • Flexible working format
  • Competitive salary
  • Personalized career growth
  • Professional development tools
  • Education reimbursement
  • Corporate events

Job Details

Join our team to work on enhancing a robust data pipeline that powers our SaaS product, ensuring seamless contextualization, validation, and ingestion of customer data. Collabd engineering data and build data quality solutions that inspire customer confidence. Additionally, identify opportunities to develop self-service tools that streamline data onboarding and make it more accessible for our users.

Our Client was established with the mission to fundamentally transform the execution of capital projects and operations. Designed by industry experts for industry experts, Client’s platfororate with product teams to unlock new user experiences by leveraging data insights. Engage with domain experts to analyze real-worlm empowers users to digitally search, visualize, navigate, and collaborate on assets. Drawing on 30 years of software expertise and 180 years of industrial legacy as part of the renowned Scandinavian business group, Client plays an active role in advancing the global energy transition. The company operates from Norway, the UK, and the U.S.

Key Responsibilities:

  • Design, build, and maintain data pipelines using Python
  • Collaborate with an international team to develop scalable data solutions
  • Conduct in-depth analysis and debugging of system bugs (Tier 2) 
  • Develop and maintain smart documentation for process consistency, including the creation and refinement of checklists and workflows
  • Set up and configure new tenants, collaborating closely with team members to ensure smooth onboarding
  • Write integration tests to ensure the quality and reliability of data services
  • Work with Gitlab to manage code and collaborate with team members
  • Utilize Databricks for data processing and management

Requirements:

  • Programming: Minimum of 3-4 years as data engineer, or in a relevant field
  • Python Proficiency: Advanced experience in Python, particularly in delivering production-grade data pipelines and troubleshooting code-based bugs.
  • Data Skills: Structured approach to data insights
  • Cloud: Familiarity with cloud platforms (preferably Azure)
  • Data Platforms: Experience with Databricks, Snowflake, or similar data platforms
  • Database Skills: Knowledge of relational databases, with proficiency in SQL.
  • Big Data: Experience using Apache Spark
  • Documentation: Experience in creating and maintaining structured documentation.
  • Testing: Proficiency in utilizing testing frameworks to ensure code reliability and maintainability
  • Version Control: Experience with Gitlab or equivalent tools.
  • English Proficiency: B2 level or higher.
  • Interpersonal Skills: Strong collaboration abilities, experience in an international team environment, willing to learn new skills and tools, adaptive and exploring mindset 

Nice to have:

  • Experience with Docker and Kubernetes
  • Experience with document and graph databases
  • Ability to travel abroad twice a year for an on-site workshops 

We offer:

  • Flexible working format - remote, office-based or flexible
  • A competitive salary and good compensation package
  • Personalized career growth
  • Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)
  • Active tech communities with regular knowledge sharing
  • Education reimbursement
  • Memorable anniversary presents
  • Corporate events and team buildings
  • Other location-specific benefits

Similar Jobs

SSC Technologies - Sales Executive - Insurance Investment Accounting Solutions

SSC Technologies

Jersey City, New Jersey, United States (Hybrid)
1 Month ago
Ion - Implementation Engineer - 9951

Ion

London, England, United Kingdom (On-Site)
9 Months ago
Varonis  - Payroll Specialist

Varonis

New York, United States (On-Site)
1 Month ago
Poppulo - SDE 2, Analytics

Poppulo

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Zones - Marketing Manager

Zones

Noida, Uttar Pradesh, India (On-Site)
3 Weeks ago
dun bradstreet - Data Scientist

dun bradstreet

Solna, Stockholm County, Sweden (Hybrid)
3 Months ago
Go Fund Me - Staff Data Engineer

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Hybrid)
3 Weeks ago
kaizen gaming  - Senior Data Scientist

kaizen gaming

Thessaloniki, Greece (Hybrid)
1 Month ago
MPOWER Financing - Data Engineer - Data - Bangalore, India

MPOWER Financing

Bengaluru, Karnataka, India (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

deel. - Country Finance Manager, Switzerland

deel.

Switzerland (Remote)
1 Week ago
Saviynt - Client Solutions Manager – Application Access Governance

Saviynt

Singapore (Remote)
1 Month ago
Figma - Manager, Mid-Market Sales

Figma

New York, United States (Hybrid)
6 Days ago
e2 open - Support Engineer

e2 open

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
3 Weeks ago
Netomi - Senior Implementation Consultant

Netomi

Gurugram, India (Remote)
2 Months ago
Postman - Technical Enterprise Customer Success Manager - Spanish Speaking

Postman

San Francisco, California, United States (Hybrid)
1 Month ago
zeta - Sr. Program Manager

zeta

Hyderabad, Telangana, India (On-Site)
6 Days ago
DevRev - Demand Generation Content Marketer

DevRev

Chennai, Tamil Nadu, India (On-Site)
1 Week ago
Agara labs - Senior Enterprise Account Executive

Agara labs

California City, California, United States (Remote)
3 Months ago
Nice - Senior Specialist Automation Engineer, Actimize

Nice

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Jobs in Poland

Techland - Junior Technical Artist

Techland

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
1 Month ago
Lionbridge Games - Games Language AI Specialist (Linguist)

Lionbridge Games

Masovian Voivodeship, Poland (On-Site)
4 Months ago
CD PROJEKT RED - Senior Rendering Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (Remote)
2 Months ago
Joyteractive - Lead UI/UX Designer

Joyteractive

Poland (Remote)
4 Months ago
Aptive - Global Category Leader - Utilities

Aptive

Kraków, Lesser Poland Voivodeship, Poland (Hybrid)
3 Months ago
Techland - Animation Director

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
3 Months ago
Marsh McLennan - Product Support Specialist

Marsh McLennan

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Weeks ago
CD PROJEKT RED - Senior IT Cloud Engineer

CD PROJEKT RED

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Month ago
ten square games - Future opportunities

ten square games

Wrocław, Lower Silesian Voivodeship, Poland (On-Site)
1 Week ago
Playtika - Full Stack Developer

Playtika

Poland (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Bosch Group - Senior Data Analyst Expert in Warehouse Purchasing

Bosch Group

Budapest, Hungary (On-Site)
1 Month ago
Tide - Staff Data Scientist

Tide

Hyderabad, Telangana, India (On-Site)
3 Weeks ago
P99 soft - Senior Data Engineer (Snowflake and Python)

P99 soft

Hyderabad, Telangana, India (On-Site)
3 Months ago
Cequence Security - Data plane Engineer

Cequence Security

Pune, Maharashtra, India (On-Site)
9 Months ago
Tencent - Business & Investment Analyst

Tencent

Palo Alto, California, United States (On-Site)
2 Months ago
dYdX - Growth & Marketing Data Scientist Lead

dYdX

New York, United States (On-Site)
2 Months ago
attentive - Data Scientist II

attentive

San Francisco, California, United States (Hybrid)
3 Months ago
bytedance - Data Analyst - Corporate Information System

bytedance

Singapore (On-Site)
4 Months ago
Patreon - Staff Data Scientist

Patreon

New York, United States (Hybrid)
1 Week ago
CRB workforce  - Senior Business Analyst

CRB workforce

El Segundo, California, United States (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded