Middle/Senior Data Engineer (Social Shopping Platform)

6 Months ago • 3 Years + • Data Analyst

Job Summary

Job Description

This role involves contributing to new technology investigations, designing complex solutions, and supporting a culture of innovation with a focus on building out ETL processes. You'll work with a modern data stack, implement data governance processes, and communicate with the customer's team. Responsibilities include delivering major solution features, participating in requirements gathering, proposing optimal architecture strategies, developing core modules, designing scalable solutions, performing code reviews, and scaling the distributed system and infrastructure.
Must have:
  • 3+ years experience with Python
  • Strong track record of building data platforms
  • Familiarity with distributed data processing with Spark
  • Proven data transformation experience
  • Strong data modeling & warehousing practices
  • Excellent English communication skills
  • Software engineering best practices: testing, PRs, Git, code reviews, code design, releasing
Good to have:
  • Strong Data Domain background
  • Experience with DAGs and orchestration tools
  • Experience in developing event-driven data pipelines

Job Details

Company Description

We are seeking a motivated and self-driven individual to join our dynamic team. Our team highly values employees' freedom, independence in decision-making, and desire to deeply understand clients' requests and identify the root of the problem. We believe that people who embrace this mindset are destined to succeed as acclaimed professionals and driving forces in data development in Ukraine. 

CUSTOMER
Our Client is a community-powered fashion marketplace with over 30 million registered users across more than 150+ countries. It's a platform for discovering and celebrating personal style while promoting sustainable fashion by extending the life of millions of garments. Founded in 2011 and headquartered in London, with offices in Manchester and New York, our Client employs around 400 people.

Job Description

  • Contributing to new technology investigations and complex solution design, supporting a culture of innovation by considering matters of security, scalability, and reliability, with a focus on building out our ETL processes 
  • Working with a modern data stack, coming up with well-designed technical solutions and robust code, and implementing data governance processes 
  • Working and professionally communicating with the customer’s team 
  • Taking responsibility for delivering major solution features 
  • Participating in the requirements gathering and clarification process, proposing optimal architecture strategies, and leading the data architecture implementation 
  • Developing core modules and functions, designing scalable and cost-effective solutions 
  • Performing code reviews, writing unit and integration tests 
  • Scaling the distributed system and infrastructure to the next level 
  • Building data platform using power of AWS cloud provider 

Qualifications

  • 3+ years of strong experience with Python as a programming language for data pipelines and related tools
  • Proven strong track record of building data platforms and managing infrastructure for Airflow and Databricks
  • Familiarity and understanding of distributed data processing with Spark for data pipeline optimization and monitoring workloads
  • Proven strong track record of building data transformations using data build tools 
  • Excellent implementation of data modeling and data warehousing best practices
  • Good written and spoken English communication skills 
  • Familiarity with software engineering best practices: testing, PRs, Git, code reviews, code design, releasing 
  • Proven strong track record of building data platforms and managing infrastructure for Airflow and Databricks 

WOULD BE A PLUS

  • Strong Data Domain background – understanding of how data engineers, data scientists, analytics engineers, and analysts work to be able to work closely with them and understand their needs 
  • Experience with DAGs and orchestration tools 
  • Experience in developing event-driven data pipelines 

 

Similar Jobs

FocalPoint - Principal GNSS Scientist

FocalPoint

England, United Kingdom (Hybrid)
10 Months ago
Nagarro - Java Full Stack Engineer (Staff Engineer)

Nagarro

Port Louis, Port Louis District, Mauritius (On-Site)
6 Months ago
CloudLinux - Senior Go Developer for CloudLinuxOS (worldwide remote, work anywhere)

CloudLinux

Sofia, Sofia City Province, Bulgaria (Remote)
6 Months ago
Morning Star - Software Engineer

Morning Star

Mumbai, Maharashtra, India (Hybrid)
7 Months ago
PwC - Full Stack Developer - Senior Associate

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
PwC - IN-Senior Associate _Java Developer _Data & Analytics _Advisory _PAN India

PwC

Kolkata, West Bengal, India (On-Site)
7 Months ago
PwC - GCP Solution Owner/Scrum Master - Manager

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
seeking alpha - Senior Data Engineer

seeking alpha

Poland (Remote)
7 Months ago
PwC - Data Scientist

PwC

Brno, South Moravian Region, Czechia (On-Site)
6 Months ago
Coinbase - Senior Data Scientist

Coinbase

Hyderabad, Telangana, India (Remote)
7 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nasdaq - QA Test Engineer Senior Specialist - Automation

Nasdaq

Bengaluru, Karnataka, India (On-Site)
7 Months ago
People Can Fly - Senior Backend Programmer (Unreal)

People Can Fly

Poland (Remote)
8 Months ago
Nasdaq - Senior Data Engineer - Python

Nasdaq

Taguig, Metro Manila, Philippines (Hybrid)
6 Months ago
Sony Pictures Animation - Episodic Pipeline Supervisor

Sony Pictures Animation

Culver City, California, United States (On-Site)
8 Months ago
Rebellion - Experienced JavaScript Developer

Rebellion

Oxford, England, United Kingdom (Hybrid)
9 Months ago
ASSIST Software - C++ Developer

ASSIST Software

Suceava, Suceava County, Romania (On-Site)
6 Months ago
Arrow Electronics - Engineer/Senior Engineer/Technical Lead (BSP Yocto)

Arrow Electronics

Karnataka, India (On-Site)
8 Months ago
CloudLinux - Senior Kernel Developer for KernelCare (worldwide remote, work anywhere)

CloudLinux

Warsaw, Masovian Voivodeship, Poland (Remote)
6 Months ago
Hero Gaming - Senior Frontend Developer

Hero Gaming

Malmö, Skåne County, Sweden (Hybrid)
7 Months ago
blitz app - Senior Frontend Engineer

blitz app

Los Angeles, California, United States (Hybrid)
10 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Warsaw, Masovian Voivodeship, Poland

Lucid Reality Labs - ISR (Inside Sales Representative)

Lucid Reality Labs

Poland (Remote)
7 Months ago
Joyteractive - Marketing Analyst

Joyteractive

Poland (Remote)
6 Months ago
Whatnot - Software Engineer, Foundations - Poland

Whatnot

Poland (Remote)
7 Months ago
Aristocrat Gaming - WEB Developer/Release Engineer

Aristocrat Gaming

Poland (Hybrid)
8 Months ago
Google - Client Experience Specialist, Programmatic, gTech (English, Spanish)

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
6 Months ago
Social Discovery Group - Senior Product Analyst (AI product)

Social Discovery Group

Poland (Remote)
7 Months ago
PwC - Senior Workday Talent and Learning Consultant

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
Yggdrasil Gaming Ltd - Game Producer

Yggdrasil Gaming Ltd

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
7 Months ago
Google - Technical Solutions Engineer, Networking, Google Cloud

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
6 Months ago
Social Discovery Group - Senior NLP Engineer

Social Discovery Group

Poland (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Duolingo - Data Scientist, Intern (PhD or Masters)

Duolingo

New York, New York, United States (On-Site)
7 Months ago
paypal - Data Science Manager

paypal

Chicago, Illinois, United States (Hybrid)
7 Months ago
Patreon - Staff Data Engineer, Analytics

Patreon

San Francisco, California, United States (Hybrid)
6 Months ago
Embark Studios - Game Research Analyst - Shared

Embark Studios

Stockholm, Stockholm County, Sweden (On-Site)
8 Months ago
Maersk Careers - Senior Data Architect

Maersk Careers

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Smarsh - Data Scientist

Smarsh

Atlanta, Georgia, United States (Remote)
7 Months ago
ION - Internship - Data Science

ION

Milan, Lombardy, Italy (On-Site)
7 Months ago
umusic - Data Analyst, A&R

umusic

Nashville, Tennessee, United States (On-Site)
7 Months ago
Morning Star - IT Senior Business Analyst

Morning Star

Bucharest, Bucharest, Romania (Hybrid)
7 Months ago
Kyruus Health - Staff Data Scientist

Kyruus Health

United States (Remote)
7 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems we develop deliver benefit to customers in automotive, telecommunications, aviation, advertising, gaming industry, banking, real estate, and healthcare. We have advanced skills and ample resources to create large-scale solutions as well as guide startups from idea to profit.ENGINEERING THE FUTURE
View All Jobs

Get notified when new jobs are added by Sigma Software

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug