Senior Data Engineer

1 Month ago • 5 Years + • Data Analyst

Job Summary

Job Description

Seeking Alpha seeks a Senior Data Engineer to design, build, and maintain data infrastructure for analyzing large datasets. Responsibilities include working with business analysts to prioritize projects, optimizing SQL queries, building efficient data pipelines from various sources (APIs, streams, data stores), monitoring infrastructure performance and reliability, and staying current with data engineering trends. The ideal candidate will have strong Python and SQL skills, extensive AWS experience (EC2, S3, RDS, EMR, Athena, Glue, Lambda, ECS/EKS), and expertise in Apache Airflow. Experience with data warehousing and modern solutions (Snowflake, Databricks, etc.) is crucial.
Must have:
  • 5+ years data engineering experience
  • Proficiency in Python & SQL
  • AWS expertise (EC2, S3, RDS, etc.)
  • Apache Airflow experience
  • Data warehousing knowledge
Good to have:
  • AWS Athena expertise
  • AWS Redshift or Vertica experience
  • Spark API (Scala or PySpark) experience
  • Machine learning/data science experience
  • Data governance and security knowledge
Perks:
  • Flexible work environment
  • Remote work options
  • Career advancement opportunities

Job Details

Description

Join a Company That Invests in You

Seeking Alpha is the world's leading community of engaged investors. We’re the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we’re also dedicated to creating a workplace where our team thrives. We’re passionate about fostering a flexible, balanced environment with remote work options and an array of perks that make a real difference.

Here, your growth matters. We prioritize your development through ongoing learning and career advancement opportunities, helping you reach new milestones. Join Seeking Alpha to be part of a company that values your unique journey, supports your success, and champions both your personal well-being and professional goals.

What We're Looking For

We are looking for a Senior Data Engineer to join our Data team. In this role, you will be responsible for design, build, and maintain the infrastructure required to analyze large data sets. As an expert in data management, ETL (extract, transform, load) processes, and data warehousing, you will work with various big data technologies such as Spark, Hadoop, and NoSQL databases. You will work closely with data and analytics team to identify and prioritize data engineering projects, ensuring the data infrastructure aligns with overall business goals and objectives.

What You'll Do

  • Work with business analysts and stakeholders to identify and prioritize data engineering projects, regularly evaluate the data infrastructure, and make necessary changes to meet evolving business needs
  • Help drive data-driven decision-making to improve user engagement and increase subscriptions
  • Handle data engineering tasks in a changing environment, ensuring solutions meet modern standards, remain reusable and maintainable, and are sufficiently documented
  • Design, build, and maintain data pipelines that efficiently and cost-effectively handle data from multiple sources, such as external APIs, streams, and data stores
  • Optimize SQL queries to manage resource consumption and costs, applying performance tuning across various SQL dialects to ensure efficient and consistent results
  • Monitor and improve data infrastructure performance and reliability, addressing scalability, efficiency, and security in line with our engineering standards
  • Keep up with data engineering trends and explore new ideas to help the team improve and innovate
  • Use data privacy and security measures as needed to meet relevant standards and frameworks

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • At least 5 years of professional experience in data-focused roles (Data Engineer, Database Developer, BI Developer/Engineer, or DBA), covering object-oriented, functional, and procedural languages
  • Strong, hands-on proficiency with Python (including data-oriented frameworks and specific libraries such as Pandas, AWS SDK)
  • Strong, hands-on proficiency with SQL across various RDBMS and big-data engines (e.g., Hive, Athena, Spark, Presto, Dremio)
  • Solid experience with AWS services (EC2, S3, RDS, EMR, Athena, Glue, Lambda, ECS/EKS)
  • Deep expertise in Apache Airflow for data pipeline orchestration
  • Advanced understanding of data warehousing, spanning both classic architectures and modern solutions such as Snowflake, Databricks, Redshift, Google BigQuery, Azure Synapse Analytics, ClickHouse, or IBM Db2 Warehouse / IBM Netezza
  • Demonstrated active problem-solving ability, backed by a strong personal software engineering culture
  • Comfortable in team settings and able to work effectively both collaboratively and independently
  • High-level English - a must

Nice To Have:

  • Expertise with AWS Athena
  • Expertise with AWS Redshift or Vertica Analytics Database
  • Expertise with Spark APIs (Scala or PySpark)
  • Experience with machine learning and / or data science projects
  • Knowledge of data governance and security best practices, including data privacy regulations such as GDPR and CCPA

Similar Jobs

Evolution - Backend Developer - Distributed Services

Evolution

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago
Nielsen Holdings - Senior Software Engineer - Bigdata ( Java / Scala / Python  & Spark , SQL , AWS).

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Nielsen Holdings - Senior Software Engineer - Bigdata ( Java / Scala / Python , Spark, SQL , AWS)

Nielsen Holdings

Mumbai, Maharashtra, India (Hybrid)
6 Months ago
UXBERT Labs - Senior Data Engineer

UXBERT Labs

Riyadh, Riyadh Province, Saudi Arabia (Hybrid)
4 Months ago
The Walt Disney Company - Senior Data Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
3 Weeks ago
PwC - IN-Senior Associate_ Data Modeler _D&A_Advisory_Gurgaon

PwC

Gurugram, Haryana, India (On-Site)
7 Months ago
Onward Search - SEO Analyst

Onward Search

Florida, United States (Hybrid)
3 Weeks ago
RoofStack - Mobile Banking Senior Business Analyst

RoofStack

İstanbul, İstanbul, Türkiye (Hybrid)
4 Months ago
Epic Games - User Experience Data Research Director

Epic Games

Cary, North Carolina, United States (On-Site)
1 Month ago
Digital Extremes - Senior Data Scientist

Digital Extremes

Ontario, Canada (Remote)
4 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

CloudHire - Scala API Architect

CloudHire

Bengaluru, Karnataka, India (Remote)
1 Month ago
DICE - Fullstack Software Engineer

DICE

Stockholm, Stockholm County, Sweden (On-Site)
4 Weeks ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

Toronto, Ontario, Canada (On-Site)
4 Months ago
Electronic Arts - Software Engineer - User Generated Experiences

Electronic Arts

British Columbia, Canada (Hybrid)
3 Weeks ago
Playrix - Senior Engineering Manager

Playrix

Ukraine (Remote)
6 Months ago
ByteDance - Backend Software Engineer Intern (Product RD and Infrastructure-Global E-Commerce)- 2025 Summer (BS/MS)

ByteDance

Seattle, Washington, United States (On-Site)
6 Months ago
ION - Data Engineer/Analyst - Graduate Development Program

ION

Pisa, Tuscany, Italy (On-Site)
6 Months ago
PwC - (Senior) Manager Deals Tax (Amsterdam, Rotterdam)

PwC

Amsterdam, North Holland, Netherlands (On-Site)
7 Months ago
The Walt Disney Company - Sr Software Engineer

The Walt Disney Company

Santa Monica, California, United States (On-Site)
3 Months ago
Playrix - Director of Engineering

Playrix

Portugal (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Poland

Futurum Technology  - Młodszy specjalista ds. księgowości i spraw prawnych

Futurum Technology

Wadowice, Lesser Poland Voivodeship, Poland (On-Site)
7 Months ago
Techland - Senior Producer

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
10 Months ago
N-iX - Senior DevOps/SRE Engineer

N-iX

Poland (Remote)
3 Weeks ago
PwC - Microsoft Dynamics 365 F&O Solution Architect

PwC

Warsaw, Masovian Voivodeship, Poland (Hybrid)
7 Months ago
PwC - Menedżer/Menedżerka | Transaction Services (Financial Due Diligence)

PwC

Warsaw, Masovian Voivodeship, Poland (On-Site)
6 Months ago
Reality Games - Mid-Level Manual QA Tester

Reality Games

Kraków, Lesser Poland Voivodeship, Poland (On-Site)
2 Months ago
Netflix - Creative Strategist, Product Discovery & Promotion - Central & Eastern Europe

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Sperasoft - Associate Project Manager

Sperasoft

Lesser Poland Voivodeship, Poland (Hybrid)
1 Month ago
Playtech - Polish Speaking Game Presenter

Playtech

Lesser Poland Voivodeship, Poland (On-Site)
3 Months ago
Wargaming - UX/UI Designer (Unannounced Project)

Wargaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Canva - Senior Full-stack Software Engineer (Java + JavaScript) - Data Platform

Canva

Surry Hills, New South Wales, Australia (Remote)
3 Weeks ago
Nintendo - Sr BI Data Analytics Engineer

Nintendo

Redmond, Washington, United States (On-Site)
3 Weeks ago
InMobiInMobi - Lead Product Analyst

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Coupa Software - Data Quality Engineer

Coupa Software

Pune, Maharashtra, India (Hybrid)
6 Months ago
PwC - Senior Data Engineer

PwC

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
7 Months ago
Techland - Junior Data Analyst

Techland

Warsaw, Masovian Voivodeship, Poland (On-Site)
4 Weeks ago
N-iX - Senior/Lead Data Engineer

N-iX

Ukraine (Remote)
3 Weeks ago
Balbix - Senior/Staff Data Engineer

Balbix

Bengaluru, Karnataka, India (On-Site)
6 Months ago
Epic Games - Data Analyst - CorpTech Analytics

Epic Games

(On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Seeking Alpha is the world’s largest investing community. Powered by the wisdom and diversity of crowdsourcing - millions of passionate investors connect daily to discover and share new investing ideas, discuss the latest news, debate the merits of stocks, utilize the tools we create, and make informed investment decisions. 20 million people use Seeking Alpha every month. Available on mobile, tablet, or desktop,Seeking Alpha provides a work environment that promotes employee growth and development. We are searching for individuals who want to grow with the company and will strive to improve performance.

Get notified when new jobs are added by seeking alpha

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug