Data Engineer

3 Months ago • 2-5 Years • Data Analyst

Job Summary

Job Description

Seeking Alpha is looking for a Senior Data Engineer to join their Data team. You will be responsible for design, build, and maintain the infrastructure required to analyze large data sets. You will work with various big data technologies such as Spark, Hadoop, and NoSQL databases. You will work closely with data and analytics team to identify and prioritize data engineering projects, ensuring the data infrastructure aligns with overall business goals and objectives. You will design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores. You will continuously monitor and optimize the performance and reliability of the data infrastructure, and identify and implement solutions to improve scalability, efficiency, and security. You will stay up-to-date with the latest trends and developments in the field of data engineering, and leverage this knowledge to identify opportunities for improvement and innovation within the organization. You will solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality. You will implement data privacy and security requirements to ensure solutions comply with security standards and frameworks. You will enhance the team's dev-ops capabilities.
Must have:
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 2+ years of proven experience developing large-scale software using an object-oriented or a functional language.
  • 5+ years of professional experience in data engineering, focusing on building and maintaining data pipelines and data warehouses
  • Strong experience with Spark, Scala, and Python, including the ability to write high-performance, maintainable code
  • Experience with AWS services, including EC2, S3, Athena, Lambda and EMR
  • Familiarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and SQL
  • Experience with data pipeline orchestration and scheduling using tools such as Airflow
  • Strong problem-solving skills and the ability to work independently as well as part of a team
  • High-level English
Good to have:
  • Expertise with Vertica or Redshift, including experience with query optimization and performance tuning
  • Experience with machine learning and/or data science projects
  • Knowledge of data governance and security best practices, including data privacy regulations such as GDPR and CCPA.
  • Knowledge of Spark internals (tuning, query optimization)
Perks:
  • Remote work options
  • Ongoing learning and career advancement opportunities

Job Details

Description

Join a Company That Invests in You

Seeking Alpha is the world's leading community of engaged investors. We’re the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we’re also dedicated to creating a workplace where our team thrives. We’re passionate about fostering a flexible, balanced environment with remote work options and an array of perks that make a real difference.

Here, your growth matters. We prioritize your development through ongoing learning and career advancement opportunities, helping you reach new milestones. Join Seeking Alpha to be part of a company that values your unique journey, supports your success, and champions both your personal well-being and professional goals.

What We're Looking For

We are looking for a Senior Data Engineer to join our Data team. In this role, you will be responsible for design, build, and maintain the infrastructure required to analyze large data sets. As an expert in data management, ETL (extract, transform, load) processes, and data warehousing, you will work with various big data technologies such as Spark, Hadoop, and NoSQL databases. You will work closely with data and analytics team to identify and prioritize data engineering projects, ensuring the data infrastructure aligns with overall business goals and objectives.

What You'll Do

  • Work closely with data scientists/analytics and other stakeholders to identify and prioritize data engineering projects and to ensure that the data infrastructure is aligned with business goals and objectives
  • Design, build and maintain optimal data pipeline architecture for extraction, transformation, and loading of data from a wide variety of data sources, including external APIs, data streams, and data stores. 
  • Continuously monitor and optimize the performance and reliability of the data infrastructure, and identify and implement solutions to improve scalability, efficiency, and security
  • Stay up-to-date with the latest trends and developments in the field of data engineering, and leverage this knowledge to identify opportunities for improvement and innovation within the organization
  • Solve challenging problems in a fast-paced and evolving environment while maintaining uncompromising quality.
  • Implement data privacy and security requirements to ensure solutions comply with security standards and frameworks.
  • Enhance the team's dev-ops capabilities.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field
  • 2+ years of proven experience developing large-scale software using an object-oriented or a functional language.
  • 5+ years of professional experience in data engineering, focusing on building and maintaining data pipelines and data warehouses
  • Strong experience with Spark, Scala, and Python, including the ability to write high-performance, maintainable code
  • Experience with AWS services, including EC2, S3, Athena, Lambda and EMR
  • Familiarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and SQL
  • Experience with data pipeline orchestration and scheduling using tools such as Airflow
  • Strong problem-solving skills and the ability to work independently as well as part of a team
  • High-level English - a must
  • A team player with excellent collaboration skills.

         Nice to Have:

  • Expertise with Vertica or Redshift, including experience with query optimization and performance tuning
  • Experience with machine learning and/or data science projects
  • Knowledge of data governance and security best practices, including data privacy regulations such as GDPR and CCPA.
  • Knowledge of Spark internals (tuning, query optimization)

Similar Jobs

The Walt Disney Company - Senior Site Reliability Engineer

The Walt Disney Company

England, United Kingdom (Hybrid)
3 Months ago
Playrix - Technical Director (Game Project)

Playrix

Georgia (Remote)
4 Months ago
Jumar - QA Tester

Jumar

London, England, United Kingdom (Hybrid)
6 Months ago
Luxoft - Senior Big Data Engineer

Luxoft

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ByteDance - Backend Software Engineer Intern (Product RD and Infrastructure-Global E-Commerce)- 2025 Summer (BS/MS)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Extreme Network - Senior Data Analyst – Global Operations

Extreme Network

Shannon, County Clare, Ireland (Hybrid)
4 Months ago
Salesforce - Summer 2025 Intern- Tableau Research

Salesforce

Palo Alto, California, United States (On-Site)
4 Months ago
SKF Group - Data Analytics Engineer

SKF Group

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Meta - Data Engineer, Product Analytics

Meta

Redmond, Washington, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Paypal - Lead Principal ML Engineer, AI Solutions

Paypal

San Jose, California, United States (On-Site)
4 Months ago
PlayStation Global - Machine Learning Engineer II

PlayStation Global

London, England, United Kingdom (On-Site)
3 Months ago
Canva - Staff Backend Engineer - Product Insights Enablement - Java (Remote across ANZ)

Canva

Perth, Western Australia, Australia (Remote)
3 Months ago
Evolution - Scala Engineer

Evolution

Riga, Latvia (Hybrid)
3 Months ago
Evolution - Scala Engineer

Evolution

Warsaw, Masovian Voivodeship, Poland (On-Site)
9 Months ago
Zoox - Data Engineering, Content Internship/Co-op

Zoox

Foster City, California, United States (On-Site)
4 Months ago
Blitz app - Staff Data Engineer II

Blitz app

Los Angeles, California, United States (Hybrid)
3 Months ago
Blis - Senior Software Engineer, C++ - Mumbai

Blis

Maharashtra, India (Hybrid)
5 Months ago
PwC - Senior Associate_Bigdata Engineer_Data & Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
PwC - Deals - Milano - Associate - FS Valuation & Economics [DLS]

PwC

Milan, Lombardy, Italy (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Portugal

PwC - Tax Reporting & Strategy | Associate - Lisboa

PwC

Lisbon, Lisbon, Portugal (On-Site)
4 Months ago
PTW - Polish LQA - Game Tester

PTW

Braga, Braga, Portugal (On-Site)
8 Months ago
Playrix - Lead QA Engineer

Playrix

Portugal (Remote)
4 Months ago
Nagarro - Senior Engineer

Nagarro

Portugal (Remote)
4 Months ago
BigID - Senior Software Engineer

BigID

Lisbon, Lisbon, Portugal (Remote)
3 Months ago
Miniclip - Senior Data Engineer Lead

Miniclip

Lisbon, Lisbon, Portugal (Hybrid)
4 Months ago
PwC - Tax Reporting & Strategy – Senior & Associate (Lisbon)

PwC

Lisbon, Lisbon, Portugal (On-Site)
4 Months ago
Social Discovery Group - Partner Account Manager/Lead (fluent in English and Spanish)

Social Discovery Group

Portugal (Remote)
4 Months ago
ZeptoLab - Senior Artist - Prototyping, Freelance

ZeptoLab

Lisbon, Lisbon, Portugal (Remote)
3 Months ago
Funcom - Senior UI  Programmer - Dune Awakening

Funcom

Portugal (On-Site)
7 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Unity - Senior Data Engineer

Unity

San Francisco, California, United States (On-Site)
3 Months ago
Moon Active - Junior Business Data Analyst

Moon Active

Tel Aviv-Yafo, Tel Aviv District, Israel (On-Site)
6 Months ago
PwC - Senior Associate_ GCP Data Visualization_ Data and  Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Hashlist - Data Scientist

Hashlist

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
PwC - IN_Senior Associate_GCP Data Engineer_Data and  Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
ByteDance - Data Scientist - Finance- San Jose

ByteDance

San Jose, California, United States (Hybrid)
3 Months ago
ByteDance - Graduate Data Engineer, ByteDance, Dubai, 2025

ByteDance

Dubai, Dubai, United Arab Emirates (On-Site)
3 Months ago
LeoVegas - Data Engineer

LeoVegas

Stockholm, Stockholm County, Sweden (Hybrid)
3 Months ago
PlayStation Global - Machine Learning Engineer

PlayStation Global

Zaventem, Flanders, Belgium (On-Site)
3 Months ago
Netflix - Senior Data Scientist, Content Data Science and Engineering

Netflix

Mexico City, Mexico City, Mexico (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded