Data Engineer

9 Months ago • 3-5 Years • Data Analysis

Job Summary

Job Description

This role requires a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project. The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources. Responsibilities include laying down the foundation and modeling the data, developing a platform for building and maintaining data pipelines, creating a Data Warehouse, analyzing and preparing domain descriptions in collaboration with Business analytics, designing Data Marts, and designing a permission model for flexible control over data access.
Must have:
  • Conceptual knowledge of data analytics fundamentals
  • Strong SQL knowledge and experience with RDBMS
  • Experience in database development and data modeling
  • Experience with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • BS in Computer Science or related field
Good to have:
  • Experience with a Business Intelligence tool

Job Details

Company Description

Seeking a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project.

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries

It is an Internal Sigma Software project that combines 2 goals: automating reporting and exposing a self-service data analytics system for the company. You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset as well as other roles consuming such data, moving on-premises solutions to the cloud

Job Description

The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

  • Lay down the foundation and model the data
  • Develop a platform for building and maintaining data pipelines that collect data from different sources
  • Create Data Warehouse
  • Analyze and prepare domain descriptions in collaboration with Business analytics
  • Create Data Marts
  • Design a permission model with flexible control over vertical and horizontal access to data

Qualifications

  • Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
  • Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
  • Experience in database development and data modeling, ideally with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • At least an Upper-Intermediate level of English
  • BS in Computer Science or a related field

WOULD BE A PLUS

  • Experience with a Business Intelligence tool

Similar Jobs

Tesla - Service Technician

Tesla

Netanya, Center District, Israel (On-Site)
6 Months ago
legion - Director, Quality Assurance

legion

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
WebFX - Remote Copywriter: Finance/Investment/Money/Business

WebFX

Philippines (Remote)
9 Months ago
Next Level Business Services - Sr. Tableau Admin

Next Level Business Services

Cupertino, California, United States (On-Site)
9 Months ago
Tesla - Benefits Partner

Tesla

Bavaria, Germany (On-Site)
5 Months ago
Go Fund Me - Staff Data Engineer

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Hybrid)
1 Month ago
blend - Lead Data Scientist

blend

Hyderabad, Telangana, India (On-Site)
1 Month ago
Super.com - Manager, Data Analytics

Super.com

United States (Remote)
4 Months ago
Epic Games - Data Analyst

Epic Games

(On-Site)
5 Months ago
Unity - Business Strategy Analyst

Unity

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Side - QA Automation Lead (Hybrid)

Side

Braga, Braga, Portugal (Hybrid)
1 Week ago
version 1 - Senior Azure Administrator

version 1

Birmingham, England, United Kingdom (On-Site)
1 Month ago
Toast - Principal Software Engineer

Toast

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Carbon Health - Physician - Urgent Care (Per Diem)

Carbon Health

Kansas City, Missouri, United States (Remote)
1 Week ago
BetterMe - Data Analyst

BetterMe

Kyiv, Kyiv City, Ukraine (Remote)
1 Week ago
Sailpoint - Digital Sales Representative

Sailpoint

Austin, Texas, United States (Hybrid)
2 Months ago
Dexerto - Branded Video Editor - Digital Media

Dexerto

Argentina (Remote)
1 Month ago
FlockSafety - Installation Technician - Charleston, SC

FlockSafety

Charleston, South Carolina, United States (Remote)
1 Week ago
Tesla - Mobile Service Technician

Tesla

Steinkjer, Trøndelag, Norway (On-Site)
5 Months ago
4theplayer - REMOTE JavaScript Developer

4theplayer

(Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Lviv, Lviv Oblast, Ukraine

Wargaming - Senior MLOps/Backend Developer

Wargaming

Kyiv, Kyiv City, Ukraine (Remote)
2 Weeks ago
playrix  - Senior VFX Artist

playrix

Ukraine (Remote)
9 Months ago
PwC - Senior ESG consulting expert

PwC

Kyiv, Kyiv City, Ukraine (On-Site)
10 Months ago
Sigma Software - Compliance Manager

Sigma Software

Ukraine (Remote)
1 Month ago
Playtika - PHP DEVELOPER

Playtika

Kyiv, Kyiv City, Ukraine (On-Site)
2 Weeks ago
N-ix - Middle Compliance Specialist / Data Privacy

N-ix

Ukraine (On-Site)
1 Month ago
GSC Games - Lead VFX Artist (Realtime, UE5)

GSC Games

Kyiv, Kyiv City, Ukraine (Remote)
2 Weeks ago
GT HQ - Network Engineer (NOC)

GT HQ

Ukraine (Remote)
1 Month ago
plarium - IT Support Administrator

plarium

Kharkiv, Kharkiv Oblast, Ukraine (On-Site)
1 Month ago
Room 8 Group - Middle Unity developer

Room 8 Group

Ukraine (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Optiv - Principal Analyst - Threat Hunting

Optiv

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Growe - Data Analyst

Growe

(Remote)
1 Month ago
Global Business Travel - Data Advanced Insight Analyst

Global Business Travel

Chicago, Illinois, United States (Hybrid)
2 Months ago
Moloco - Data Scientist II, Growth Analytics

Moloco

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
1 Month ago
Minecast - Principal, Corporate FP&A Analyst

Minecast

Lexington, Massachusetts, United States (Hybrid)
3 Weeks ago
Adyen - Senior Data Engineer

Adyen

Amsterdam, North Holland, Netherlands (On-Site)
1 Month ago
creative assembly - Senior Data Analyst

creative assembly

Horsham, England, United Kingdom (Hybrid)
1 Week ago
HCL Tech - AWS Senior Data Engineer

HCL Tech

Texas, United States (On-Site)
1 Month ago
Next Level Business Services - Data Architect

Next Level Business Services

Sunnyvale, California, United States (On-Site)
9 Months ago
Brillio - Sr Lead Data Science & AI - R01549776

Brillio

Bengaluru, Karnataka, India (Hybrid)
2 Weeks ago

Get notifed when new similar jobs are uploaded

About The Company

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems we develop deliver benefit to customers in automotive, telecommunications, aviation, advertising, gaming industry, banking, real estate, and healthcare. We have advanced skills and ample resources to create large-scale solutions as well as guide startups from idea to profit.

Warsaw, Masovian Voivodeship, Poland (Remote)

Warsaw, Masovian Voivodeship, Poland (Remote)

Ukraine (Remote)

Ukraine (Remote)

Bulgaria (On-Site)

Warsaw, Masovian Voivodeship, Poland (On-Site)

Ukraine (Remote)

View All Jobs

Get notified when new jobs are added by Sigma Software

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug