Data Engineer

6 Months ago • 3-5 Years • Data Analyst

Job Summary

Job Description

This role requires a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project. The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources. Responsibilities include laying down the foundation and modeling the data, developing a platform for building and maintaining data pipelines, creating a Data Warehouse, analyzing and preparing domain descriptions in collaboration with Business analytics, designing Data Marts, and designing a permission model for flexible control over data access.
Must have:
  • Conceptual knowledge of data analytics fundamentals
  • Strong SQL knowledge and experience with RDBMS
  • Experience in database development and data modeling
  • Experience with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • BS in Computer Science or related field
Good to have:
  • Experience with a Business Intelligence tool

Job Details

Company Description

Seeking a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project.

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries

It is an Internal Sigma Software project that combines 2 goals: automating reporting and exposing a self-service data analytics system for the company. You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset as well as other roles consuming such data, moving on-premises solutions to the cloud

Job Description

The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

  • Lay down the foundation and model the data
  • Develop a platform for building and maintaining data pipelines that collect data from different sources
  • Create Data Warehouse
  • Analyze and prepare domain descriptions in collaboration with Business analytics
  • Create Data Marts
  • Design a permission model with flexible control over vertical and horizontal access to data

Qualifications

  • Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
  • Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
  • Experience in database development and data modeling, ideally with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • At least an Upper-Intermediate level of English
  • BS in Computer Science or a related field

WOULD BE A PLUS

  • Experience with a Business Intelligence tool

Similar Jobs

Rockstar Games - Senior Data Engineer

Rockstar Games

Carlsbad, California, United States (On-Site)
2 Months ago
Trend Micro - Sr. Data Scientist (AI Lab)

Trend Micro

Taipei City, Taiwan (On-Site)
7 Months ago
Dream Sports - Quality Assurance- Engineer

Dream Sports

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Universal Music - Director, Licensing

Universal Music

New York, New York, United States (On-Site)
1 Week ago
Omnissa - Staff Data Scientist

Omnissa

Bengaluru, Karnataka, India (Hybrid)
7 Months ago
DraftKings - Senior Analyst, Digital Marketing

DraftKings

Boston, Massachusetts, United States (On-Site)
4 Weeks ago
Google - Data Engineering Manager, Geo Data Operations

Google

Mountain View, California, United States (On-Site)
1 Week ago
Ubisoft - Senior Analyst, Live Analytics

Ubisoft

Montreal, Quebec, Canada (On-Site)
6 Days ago
The Walt Disney Company - Lead Data Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Days ago
Playtika - Youda - Data Analyst

Playtika

Netherlands (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Canva - Machine Learning Engineer Intern

Canva

Auckland, Auckland, New Zealand (Remote)
3 Weeks ago
OLIVER Agency - E-Commerce Manager

OLIVER Agency

Mumbai, Maharashtra, India (On-Site)
18 Hours ago
PwC - L&D Senior Associate

PwC

Makati, Metro Manila, Philippines (On-Site)
7 Months ago
NVIDIA - Senior Solution Engineer, Mission Control

NVIDIA

Durham, North Carolina, United States (On-Site)
1 Month ago
Netflix - Data Engineering Manager

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Match Group - Data Science II (Marketing Analytics)

Match Group

San Francisco, California, United States (Hybrid)
6 Months ago
Tencent - Data Engineering Intern

Tencent

(On-Site)
2 Months ago
egnyte careers - Account Executive 3 - EMEA

egnyte careers

Reading, England, United Kingdom (On-Site)
4 Months ago
Aerospike - Technical Account Manager

Aerospike

Bengaluru, Karnataka, India (On-Site)
17 Hours ago
NVIDIA - Tegra Software Engineer (RDSS Intern)

NVIDIA

Taipei City, Taiwan (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Lviv, Lviv Oblast, Ukraine

N-iX - Senior Automation (C#) Engineer

N-iX

Ukraine (Remote)
2 Weeks ago
Playrix - Lead VFX Artist

Playrix

Ukraine (Remote)
6 Months ago
N-iX - Senior Frontend Engineer

N-iX

Ukraine (Remote)
2 Weeks ago
Virtuos - PMO Producer

Virtuos

Ukraine (Hybrid)
1 Week ago
N-iX - Middle/Senior Data Engineer (Azure)

N-iX

Ukraine (Remote)
1 Month ago
N-iX - Middle/Senior Data Engineer (Azure)

N-iX

Ukraine (Remote)
2 Weeks ago
N-iX - Mobile Lead Engineer (iOS and Android Team)

N-iX

Ukraine (Hybrid)
2 Weeks ago
N-iX - Senior Full-Stack Engineer (React, Node.js)

N-iX

Ukraine (Remote)
2 Weeks ago
Sigma Software - Sound Producer

Sigma Software

Kyiv, Kyiv City, Ukraine (Remote)
6 Months ago
N-iX - Senior UX Researcher (with German)

N-iX

Ukraine (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

PwC - Senior Associate_GCP Data Engineer_Data and  Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
7 Months ago
Aristocrat Gaming - Director, Advanced Insights

Aristocrat Gaming

Las Vegas, Nevada, United States (Hybrid)
1 Month ago
Antarctica Global - Research & Sustainability Analyst

Antarctica Global

Maharashtra, India (Remote)
1 Month ago
Google - Senior Data Scientist, Research, Storage Analytics

Google

Sunnyvale, California, United States (On-Site)
1 Week ago
Playkot - Data Engineer

Playkot

Belgrade, Serbia (Remote)
3 Months ago
Playrix - Data QA Engineer

Playrix

Montenegro (Remote)
6 Months ago
Wargaming - BI Analyst (World of Tanks)

Wargaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
1 Week ago
ARHS - Intermediate Application Developer

ARHS

Valletta, Malta (On-Site)
6 Months ago
DraftKings - Senior Data Science Engineer

DraftKings

London, England, United Kingdom (On-Site)
1 Week ago
Rackspace Technology - Snowflake Data Architect

Rackspace Technology

India (Remote)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems we develop deliver benefit to customers in automotive, telecommunications, aviation, advertising, gaming industry, banking, real estate, and healthcare. We have advanced skills and ample resources to create large-scale solutions as well as guide startups from idea to profit.ENGINEERING THE FUTURE

Vienna, Vienna, Austria (On-Site)

Brazil (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Ukrainka, Kharkiv Oblast, Ukraine (On-Site)

Lviv, Lviv Oblast, Ukraine (On-Site)

Lviv, Lviv Oblast, Ukraine (On-Site)

Kyiv, Kyiv City, Ukraine (Remote)

View All Jobs

Get notified when new jobs are added by Sigma Software

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug