Data Engineer

8 Months ago • 3-5 Years • Data Analysis

Job Summary

Job Description

This role requires a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project. The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources. Responsibilities include laying down the foundation and modeling the data, developing a platform for building and maintaining data pipelines, creating a Data Warehouse, analyzing and preparing domain descriptions in collaboration with Business analytics, designing Data Marts, and designing a permission model for flexible control over data access.
Must have:
  • Conceptual knowledge of data analytics fundamentals
  • Strong SQL knowledge and experience with RDBMS
  • Experience in database development and data modeling
  • Experience with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • BS in Computer Science or related field
Good to have:
  • Experience with a Business Intelligence tool

Job Details

Company Description

Seeking a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project.

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries

It is an Internal Sigma Software project that combines 2 goals: automating reporting and exposing a self-service data analytics system for the company. You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset as well as other roles consuming such data, moving on-premises solutions to the cloud

Job Description

The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

  • Lay down the foundation and model the data
  • Develop a platform for building and maintaining data pipelines that collect data from different sources
  • Create Data Warehouse
  • Analyze and prepare domain descriptions in collaboration with Business analytics
  • Create Data Marts
  • Design a permission model with flexible control over vertical and horizontal access to data

Qualifications

  • Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
  • Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
  • Experience in database development and data modeling, ideally with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • At least an Upper-Intermediate level of English
  • BS in Computer Science or a related field

WOULD BE A PLUS

  • Experience with a Business Intelligence tool

Similar Jobs

Jumio - Customer Escalation Engineer

Jumio

Bengaluru, Karnataka, India (On-Site)
3 Weeks ago
zoox - Software Engineer - Full Stack, Visualization Tools

zoox

Foster City, California, United States (On-Site)
2 Weeks ago
AI Fund - Curriculum Developer

AI Fund

(Remote)
8 Months ago
Blazesoft - Legal Counsel (Gaming - Malta)

Blazesoft

Malta (Remote)
3 Weeks ago
Illumina - Senior Data Engineer

Illumina

Bengaluru, Karnataka, India (On-Site)
2 Days ago
Paytm - Data Engineer - Technical Lead

Paytm

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
Hitachi - Business Analyst - Costa Rica

Hitachi

San José, San José Province, Costa Rica (On-Site)
8 Months ago
Notion - Software Engineer, Enterprise Data Platform

Notion

San Francisco, California, United States (On-Site)
2 Days ago
Riot Games - Senior Software Engineer - Data Foundations: Data Experiences and Automation

Riot Games

Los Angeles, California, United States (On-Site)
1 Month ago
Game District - Data Engineer

Game District

Lahore, Punjab, Pakistan (On-Site)
1 Week ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nice - Associate Partner Experience Specialist

Nice

Manila, Metro Manila, Philippines (Hybrid)
5 Days ago
Sporty - Social Media Designer

Sporty

Cape Town, Western Cape, South Africa (On-Site)
2 Weeks ago
NVIDIA - Senior System Software Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Playtika - Senior Java Developer

Playtika

Romania (Hybrid)
8 Months ago
oportun - Senior Manager, Data Science

oportun

(Remote)
2 Months ago
Bethesda - Systems Designer

Bethesda

Rockville, Maryland, United States (On-Site)
1 Month ago
Airbyte - Technical Support Engineer

Airbyte

San Francisco, California, United States (On-Site)
2 Months ago
Notion - Notion Consultants Lead

Notion

San Francisco, California, United States (On-Site)
1 Month ago
Telnyx - Business Development Representative

Telnyx

Denver, Colorado, United States (On-Site)
2 Months ago
DevRev - Product Designer, Director

DevRev

(Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Lviv, Lviv Oblast, Ukraine

BetterMe - Motion Designer/Video Editor

BetterMe

Ukraine (Remote)
1 Month ago
plarium - DB QA Engineer

plarium

Lviv, Lviv Oblast, Ukraine (On-Site)
1 Month ago
Sigma Software - DevOps Engineer Intern

Sigma Software

Ukraine (Remote)
1 Month ago
Playtika - IT Infrastructure Engineer

Playtika

Ukraine (On-Site)
7 Months ago
BetterMe - Junior UX Writer

BetterMe

Ukraine (Remote)
3 Weeks ago
BetterMe - Product Manager (Mobile)

BetterMe

Kyiv, Kyiv City, Ukraine (Remote)
1 Month ago
Luxoft - Senior React Developer

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
6 Months ago
Arrible - 3D ANIMATOR (remote)

Arrible

Kyiv, Kyiv City, Ukraine (Remote)
11 Months ago
BetterMe - Senior Backend (Node.js) Engineer (Web)

BetterMe

Kyiv, Kyiv City, Ukraine (Remote)
1 Month ago
Gunzilla - Senior Technical VFX Artist

Gunzilla

Kyiv, Kyiv City, Ukraine (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

PwC - Consultant expérimenté Data analyst | CDI | F/H

PwC

Neuilly-sur-Seine, Île-de-France, France (On-Site)
9 Months ago
Yodlee - Senior Business Analyst

Yodlee

Thiruvananthapuram, Kerala, India (On-Site)
3 Months ago
luxsoft - Senior Business Analyst - Trade Finance

luxsoft

Chennai, Tamil Nadu, India (On-Site)
1 Month ago
PwC - ETIC, Data Solution Architect - Senior Manager

PwC

Cairo, Cairo Governorate, Egypt (On-Site)
8 Months ago
PwC - Manager / Senior Manager - Cloud, Data & AI (CD&AI) – Platform Architect

PwC

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
Autodesk - Data Engineer

Autodesk

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Yahoo - Senior Data Engineer - Consumer Data AI / ML

Yahoo

United States (Hybrid)
1 Month ago
Bede Gaming - Principal Data Engineer

Bede Gaming

Newcastle Upon Tyne, England, United Kingdom (Hybrid)
1 Month ago
bytedance - Data Center Design Engineer (Electrical) - Data Center Development

bytedance

Singapore (On-Site)
7 Months ago
blend - Senior Data Scientist

blend

Montevideo, Montevideo Department, Uruguay (Remote)
1 Week ago

Get notifed when new similar jobs are uploaded

About The Company

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems we develop deliver benefit to customers in automotive, telecommunications, aviation, advertising, gaming industry, banking, real estate, and healthcare. We have advanced skills and ample resources to create large-scale solutions as well as guide startups from idea to profit.
View All Jobs

Get notified when new jobs are added by Sigma Software

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug