Senior Data Engineer

6 Months ago • 3 Years + • Data Analyst

Job Summary

Job Description

Stream Hatchet seeks a Senior Data Engineer to lead migration of data ingestion and aggregation system from Ruby-on-Rails to a scalable, cloud-native architecture. You'll design and implement efficient data pipelines, optimize workflows, and ensure data quality across the process. Strong Python, AWS, and SQL skills are essential.
Must have:
  • Python & AWS
  • Data Pipelines
  • SQL Databases
  • Cloud-Native Dev
Good to have:
  • NoSQL Databases
  • Ruby on Rails
  • Elasticsearch
  • ETL Processes
Perks:
  • Flexible Hours
  • Hybrid Work

Job Details

Description

Stream Hatchet is a leading data analytics company in the esports and gaming streaming industries. We leverage data from social platforms like Twitter, Instagram, TikTok, and live streaming platforms to provide actionable insights for businesses focused on go-to-market strategies, content initiatives, and sponsorship measurement.

As a Senior Data Engineer, you will play a key role in the migration of our current data ingestion and aggregation system from a Ruby-on-Rails monolith to a more scalable, cloud-native architecture. You will work closely with our engineering team to design and implement efficient data pipelines that can scale to ingest, process, and aggregate social media metrics from millions of creators daily.

If you thrive in fast-paced environments, enjoy solving complex technical challenges, and have a passion for building scalable cloud architectures, this is the role for you!


Responsibilities

  • Lead the migration from a Ruby-on-Rails system to a Python-based, cloud-native architecture.
  • Design, build, and maintain scalable data ingestion and aggregation pipelines using cloud services.
  • Optimize existing data workflows to improve reliability, scalability, and performance.
  • Collaborate with cross-functional teams to ensure seamless integration of new data sources and the delivery of data insights.
  • Ensure data quality, accuracy, and reliability across the entire ingestion and aggregation process.
  • Evaluate and implement best practices for monitoring, alerting, and maintaining production-level data systems.

Requirements

  • BS degree in Computer Science, Engineering, or a related technical field.
  • 3+ years of experience in data engineering, including data pipeline development, aggregation, and ingestion.
  • Proficiency in Python and experience with cloud-native development using AWS services.
  • Proficiency with SQL databases and query optimization. Familiarity with NoSQL databases is a plus.
  • Understanding of data architecture patterns, ETL processes, and distributed data systems.
  • Familiarity with Ruby on Rails is a plus.
  • Experience with Elasticsearch for building search and analytics solutions.
  • Excellent communication skills in English.

Benefits

  • Flexible working hours.
  • Hybrid work environment (combining in-office and remote work).
  • Flexible benefits with Cobee.
  • Health insurance.
  • The most amazing co-working space in downtown Barcelona and Madrid, including drinks, snacks, fruit, and coffee.
  • Twice-a-year company-wide events to meet the rest of the team.

Similar Jobs

seeking alpha - Senior Ruby on Rails Developer

seeking alpha

Poland (Remote)
2 Months ago
Maersk Careers - Senior Software Engineer - Python/PySpark/Data Engineer - Energy Transition, Full Remote available for XP

Maersk Careers

Porto, Porto District, Portugal (Remote)
6 Months ago
ByteDance - Software Engineer, Global E-commerce Seller Platform

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
CloudLinux - Senior C Developer (worldwide remote, work anywhere)

CloudLinux

Vojvodina, Serbia (Remote)
5 Months ago
prizepicks - Senior Back End Engineer

prizepicks

(Remote)
1 Month ago
PwC - IGP_CP&F - Data Governance  - Senior Associate - Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Tencent - Data Scientist

Tencent

Singapore (On-Site)
6 Months ago
Voodoo - Senior Data Engineer (Ad networks - Core)

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Months ago
Riot Games - Data Engineer II - Data & Analytics

Riot Games

Dublin, County Dublin, Ireland (On-Site)
5 Months ago
Aristocrat Gaming - Data Scientist

Aristocrat Gaming

Barcelona, Catalonia, Spain (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Arkavis - Game Developer

Arkavis

Bangkok, Bangkok, Thailand (On-Site)
9 Months ago
hostari - Site Reliability Engineer (Remote)

hostari

(Remote)
3 Months ago
Wizcorp - Unreal Engine Programmer

Wizcorp

Tokyo, Japan (Remote)
6 Months ago
Garena - Senior Programmer (Backend / Server)

Garena

Mumbai, Maharashtra, India (On-Site)
6 Months ago
Microsoft - Support Engineer, Developer & Azure Services (DAS)

Microsoft

(Remote)
3 Months ago
Highspot - Sr. Backend Engineer

Highspot

Hyderabad, Telangana, India (Hybrid)
7 Months ago
Sinch - Senior System Engineer

Sinch

Noida, Uttar Pradesh, India (On-Site)
6 Months ago
prizepicks - Engineering Manager

prizepicks

(Remote)
3 Months ago
Onward Search - User Interface Software Engineer

Onward Search

Georgia, United States (Remote)
2 Months ago
Velotio Technologies - Lead Engineer (Ruby On Rails)

Velotio Technologies

Pune, Maharashtra, India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Barcelona, Catalonia, Spain

Electronic Arts - Videogame Tester - Dutch

Electronic Arts

Madrid, Community Of Madrid, Spain (On-Site)
2 Months ago
Canva - Senior Brand Copywriter, EMEA

Canva

Madrid, Community Of Madrid, Spain (Remote)
1 Month ago
PwC - Assurance | Auditor Supervisor Valladolid

PwC

Valladolid, Castile And León, Spain (On-Site)
5 Months ago
Nagarro - Associate Staff Consultant, Support Sales & Marketing

Nagarro

Spain (Remote)
6 Months ago
Statement VFX - Senior 3D Generalist

Statement VFX

Barcelona, Catalonia, Spain (On-Site)
11 Months ago
Socialpoint - ASO Analyst

Socialpoint

Barcelona, Catalonia, Spain (Hybrid)
2 Months ago
Socialpoint - Senior C++ Developer

Socialpoint

Barcelona, Catalonia, Spain (Hybrid)
5 Months ago
PwC - TLS | Senior Associate Tax Payroll

PwC

Madrid, Community Of Madrid, Spain (On-Site)
4 Months ago
Electronic Arts - Senior Experience Designer Technical

Electronic Arts

Madrid, Community Of Madrid, Spain (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Netflix - Data Engineering Manager

Netflix

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Xsolla - Researcher/Analyst

Xsolla

Armenia (Remote)
5 Months ago
ION - Data Engineer, Italy

ION

Italy (Hybrid)
6 Months ago
Skillz - Data Engineer

Skillz

Bengaluru, Karnataka, India (On-Site)
2 Months ago
FanCode - ML Engineer

FanCode

Mumbai, Maharashtra, India (On-Site)
5 Months ago
NinjaVan - Performance Analytics Operations Analyst

NinjaVan

Makati, Metro Manila, Philippines (Hybrid)
6 Months ago
Netflix - Senior Researcher - Studio Insights, Promotional Media

Netflix

Los Angeles, California, United States (On-Site)
1 Month ago
Riot Games - Insights Analyst III - VALORANT, Competitive

Riot Games

Los Angeles, California, United States (On-Site)
3 Months ago
PlayStation Global - Senior Product Analyst, Competitive Intelligence

PlayStation Global

London, England, United Kingdom (Remote)
1 Month ago
RoofStack - Senior Business Analyst (Digital Banking)

RoofStack

İstanbul, İstanbul, Türkiye (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Stream Hatchet was founded in late 2015 out of Barcelona, Spain. What started as a passion project for our founders, Eduard Monsterrat and Albert Alemany, turned into a successful B2B data intelligence company. Originally developed as a streamer tool used to identify one’s own audience, Stream Hatchet has pivoted to become the leading gaming and esports live streaming analytics company empowering data-driven decisions across the industry. Publishers, streaming platforms, marketing and talent agencies, esports organizations, and brands use Stream Hatchet’s data and insights to explore, monitor, and discover live streaming analytics.


Stream Hatchet is a GameSquare Holdings Company.

Get notified when new jobs are added by Stream Hatchet

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug