Data Engineer

2 Days ago • 3-5 Years

About the job

SummaryBy Outscal

Lead a team to modernize a data platform into a cloud-based self-service analytics project. Design and model data into DWH and Data Marts using Spark and MS SQL. Experience with Databricks/Spark, Python, Azure, and SQL is required.

Company Description

Seeking a Data Engineer to lead a small team and modernize a simple data platform into a cloud-based self-service analytics project.

Sigma Software provides top-quality software development, graphic design, testing, and support services. Systems developed to deliver customer benefits in automotive, telecommunications, aviation, advertising, gaming, banking, real estate, and healthcare industries

It is an Internal Sigma Software project that combines 2 goals: automating reporting and exposing a self-service data analytics system for the company. You will be responsible for designing and modeling data into DWH and Data Marts using Spark and MS SQL, exposing this data to, and collaborating with, BI engineers making reports in Apache Superset as well as other roles consuming such data, moving on-premises solutions to the cloud

Job Description

The goal is to create an efficient system for collecting, processing, analyzing, and visualizing large amounts of data from various sources

  • Lay down the foundation and model the data
  • Develop a platform for building and maintaining data pipelines that collect data from different sources
  • Create Data Warehouse
  • Analyze and prepare domain descriptions in collaboration with Business analytics
  • Create Data Marts
  • Design a permission model with flexible control over vertical and horizontal access to data

Qualifications

  • Conceptual knowledge of data analytics fundamentals, e.g., dimensional modeling, ETL/ELT, reporting tools, data governance, data warehousing, structured and unstructured data
  • Strong SQL knowledge and experience with RDBMS, confident knowledge of database fundamentals
  • Experience in database development and data modeling, ideally with Databricks/Spark
  • Experience with Python
  • Experience with Azure
  • Working knowledge of serialization formats and their trade-offs (columnar vs. row-based)
  • Experience debugging and optimizing Spark jobs
  • Strong written and verbal communication skills
  • At least an Upper-Intermediate level of English
  • BS in Computer Science or a related field

WOULD BE A PLUS

  • Experience with a Business Intelligence tool

Masovian Voivodeship, Poland (Remote)

Masovian Voivodeship, Poland (On-Site)

State Of São Paulo, Brazil (Remote)

Lesser Poland Voivodeship, Poland (Remote)

Federal District, Brazil (Remote)

Masovian Voivodeship, Poland (Remote)

Masovian Voivodeship, Poland (Remote)

Masovian Voivodeship, Poland (Remote)

View All Jobs

Similar Jobs

Warner Bros. Games - Staff Data Engineer- C360, Hyderabad

Telangana, India (Hybrid)

Warner Bros. Games - Data Engineer II - C360, Hyderabad

Telangana, India (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Nasdaq - Senior Data Engineer - Python

Metro Manila, Philippines (Hybrid)

Warner Bros. Games - Senior Data Engineer - MLG, Hyderabad

Telangana, India (Hybrid)

HP - Data Engineer 3

Karnataka, India (On-Site)

workco - Data Engineer (Contract)

United States (Remote)

Riot Games - Data Engineer II - Data & Analytics

California, United States (On-Site)

NBC universal - Staff Data Engineer

New Jersey, United States (Remote)

Similar Skill Jobs

Activision - Senior Manager, Analytics Insights

California, United States (On-Site)

The Walt Disney Company - Senior Compositor

British Columbia, Canada (Hybrid)

umusic - Senior BI Engineer

Pennsylvania, United States (On-Site)

Scientific Games  - Senior Accountant

Karnataka, India (On-Site)

King - Senior Product Analyst (Incident)

Stockholm County, Sweden (On-Site)

Discord - Senior Software Engineer - Activity Feed

San Francisco, Ca & U. (Remote)

Unity - IT Operations Specialist

Karnataka, India (On-Site)

Jobs in Lviv, Lviv Oblast, Ukraine

PwC - Marketing & Communications Specialist

Kyiv City, Ukraine (On-Site)

PwC - Digital Marketing Specialist

Kyiv City, Ukraine (On-Site)

PwC - Business Analyst in Tax

Kyiv City, Ukraine (On-Site)

EveryMatrix - Senior AI/ML Engineer (NLP/LLM)

Lviv Oblast, Ukraine (Hybrid)

Miratech - Intern

Kyiv City, Ukraine (On-Site)

Miratech - Senior Java Developer

Kyiv City, Ukraine (On-Site)

Magic Media - Lead 3D Environment Artist

Kyiv City, Ukraine (Remote)

Software Engineering Jobs

DraftKings - Senior Associate Delivery Manager

United States (Remote)

umusic - Senior BI Engineer

Pennsylvania, United States (On-Site)

Tencent - Senior Staff Researcher

California, United States (On-Site)

Aristocrat Gaming - Technical Lead - Full Stack Development

Uttar Pradesh, India (Hybrid)

Aristocrat Gaming - Front End Developer

Masovian Voivodeship, Poland (Hybrid)

DraftKings - Operations Specialist

Plovdiv Province, Bulgaria (Hybrid)

DraftKings - Senior AML Associate

United States (Remote)

DraftKings - Manager, Fantasy Sports Operations

Massachusetts, United States (On-Site)

Scientific Games  - Senior Accountant

Karnataka, India (On-Site)

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug