Data Engineer

5 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

This role requires a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project. The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources. Responsibilities include laying down the foundation and modeling the data, developing a platform for building and maintaining data pipelines, creating a Data Warehouse, analyzing and preparing domain descriptions in collaboration with Business analytics, designing Data Marts, and designing a permission model for flexible control over data access.
Must have:
  • Conceptual knowledge of data analytics fundamentals
  • Strong SQL knowledge and experience with RDBMS
  • Experience in database development and data modeling
  • Experience with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • BS in Computer Science or related field
Good to have:
  • Experience with a Business Intelligence tool

Job Details

Company Description

Seeking a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project.

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries

It is an Internal Sigma Software project that combines 2 goals: automating reporting and exposing a self-service data analytics system for the company. You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset as well as other roles consuming such data, moving on-premises solutions to the cloud

Job Description

The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

  • Lay down the foundation and model the data
  • Develop a platform for building and maintaining data pipelines that collect data from different sources
  • Create Data Warehouse
  • Analyze and prepare domain descriptions in collaboration with Business analytics
  • Create Data Marts
  • Design a permission model with flexible control over vertical and horizontal access to data

Qualifications

  • Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
  • Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
  • Experience in database development and data modeling, ideally with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • At least an Upper-Intermediate level of English
  • BS in Computer Science or a related field

WOULD BE A PLUS

  • Experience with a Business Intelligence tool

Similar Jobs

Twitch - Data Engineer - Monetization

Twitch

San Francisco, California, United States (On-Site)
1 Week ago
Nexters - Database Administrator

Nexters

Cyprus (Remote)
1 Week ago
Info Stretch - Lead Data Engineer

Info Stretch

Pune, Maharashtra, India (On-Site)
5 Months ago
PwC - Senior Associate_Databricks_Data & Analytics_Advisory_PAN  India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
ByteDance - Site Reliability Engineer - Data Infrastructure (Seattle)

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Next Level Business Services - Insights Architect

Next Level Business Services

Hartford, Connecticut, United States (On-Site)
6 Months ago
Riot Games - Insights Analyst III - VALORANT, Cross VALORANT Experience

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
Romero Games - Data Analyst

Romero Games

Galway, County Galway, Ireland (Remote)
1 Week ago
Canva - Software Engineer (Python) - Data Platform (Open to remote across ANZ)

Canva

Auckland, Auckland, New Zealand (Remote)
3 Months ago
Nielsen Holdings - Senior Data Scientist

Nielsen Holdings

New York, New York, United States (Remote)
6 Days ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Garena - Garena - Data Warehouse Engineer

Garena

Taipei City, Taiwan (On-Site)
3 Months ago
NVIDIA - Senior Site Reliability Engineer, Data Science and ML Platforms

NVIDIA

Shanghai, Shanghai, China (On-Site)
3 Months ago
OKX - Blockchain Security Product Manager, Web3 Platform

OKX

Hong Kong (On-Site)
6 Months ago
Rockstar Games - Senior Data Engineer

Rockstar Games

New York, New York, United States (On-Site)
1 Month ago
Inworld AI - AI Trainer (Contractor) - Writing & Gaming

Inworld AI

Mountain View, California, United States (Remote)
4 Weeks ago
Bally's Interactive - Senior Data Developer

Bally's Interactive

Toronto, Ontario, Canada (Hybrid)
1 Week ago
ByteDance - Data Researcher - Global E-Commerce Supply Chain & Logistics

ByteDance

Seattle, Washington, United States (On-Site)
5 Months ago
Electronic Arts - Data Science Engineer

Electronic Arts

Hyderabad, Telangana, India (On-Site)
1 Week ago
Truecaller - Data Architect

Truecaller

Stockholm, Stockholm County, Sweden (On-Site)
5 Months ago
Egnyte - Senior Build Engineer - Python - Jenkins

Egnyte

India (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Lviv, Lviv Oblast, Ukraine

Gunzilla - Senior Console Programmer

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
1 Month ago
Nordcurrent - QA

Nordcurrent

Dnipro, Dnipropetrovsk Oblast, Ukraine (On-Site)
5 Months ago
Playrix - Lead Technical Designer

Playrix

Ukraine (Remote)
6 Months ago
Magic Media - C++ Mobile Game Developer

Magic Media

Kyiv, Kyiv City, Ukraine (Remote)
4 Weeks ago
Plarium - Unity Developer

Plarium

Lviv, Lviv Oblast, Ukraine (Remote)
2 Months ago
Playrix - Technical Director (Game Project)

Playrix

Ukraine (Remote)
6 Months ago
N-iX - People Experience Specialist

N-iX

Ukraine (Hybrid)
2 Months ago
N-iX - Senior Performance Test Engineer

N-iX

Ukraine (Remote)
1 Week ago
Every matrix - Middle Frontend Developer (JavaScript)

Every matrix

Kyiv, Kyiv City, Ukraine (Hybrid)
4 Weeks ago
Playrix - Senior Unity Software Engineer (Gameplay)

Playrix

Ukraine (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Corsair - Demand Planner, APAC

Corsair

Taipei City, Taiwan (On-Site)
1 Month ago
ByteDance - Senior Data Scientist

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Playtika - Youda - Data Analyst

Playtika

Netherlands (Hybrid)
5 Months ago
Rackspace Technology - Data Science Trainee (US Shift Working)

Rackspace Technology

Vietnam (Remote)
2 Weeks ago
PwC - IN_Manager_Telecom Consulting_TMT_Advisory_Gurugram

PwC

Gurugram, Haryana, India (On-Site)
4 Months ago
Google - Infrastructure Partner Data Engineer

Google

Bengaluru, Karnataka, India (On-Site)
1 Week ago
SmileGate - Data Analyst - CROSSFIRE

SmileGate

Seongnam-si, Gyeonggi-do, South Korea (On-Site)
1 Week ago
ByteDance - Senior Data Scientist

ByteDance

Seattle, Washington, United States (On-Site)
4 Weeks ago
Google - Senior Staff Data Scientist, Product

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Google - Analytical Lead, Apps and Fintech, Large Customer Sales

Google

Shanghai, Shanghai, China (On-Site)
6 Days ago

Get notifed when new similar jobs are uploaded

About The Company

Warsaw, Masovian Voivodeship, Poland (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Ukrainka, Kharkiv Oblast, Ukraine (On-Site)

Lviv, Lviv Oblast, Ukraine (On-Site)

Lviv, Lviv Oblast, Ukraine (On-Site)

Lviv, Lviv Oblast, Ukraine (On-Site)

Kyiv, Kyiv City, Ukraine (Remote)

Brasília, Federal District, Brazil (Remote)

Brasília, Federal District, Brazil (On-Site)

View All Jobs

Get notified when new jobs are added by Sigma Software

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug