Data Engineer

8 Months ago • 3-5 Years • Data Analysis

Job Summary

Job Description

Data Engineer role at ION Analytics focused on building and managing data pipelines for production ML models. Requires 3+ years experience in data engineering, Databricks, PySpark, Apache Spark, and strong Python skills. Experience with cloud infrastructure (AWS/Azure), data warehousing, and data lakes is essential.
Must have:
  • Data Engineering
  • Databricks, PySpark
  • Apache Spark
  • Strong Python
Good to have:
  • Apache Airflow
  • Apache Kafka
  • Kubernetes
  • Docker
Perks:
  • Global Footprint
  • Cutting Edge

Job Details

The Role:

As a Data Science - Data Engineer, you will play a crucial role in creating and managing the dataflows used by production machine learning models and data scientists. You will be responsible for collaborating with cross-functional teams, engineers, product managers and data scientists to understand requirements and deliver high-quality solutions. You will be expected to implement best practices in data management, coding, testing, and deployment, ensuring scalability, performance, and security. Strong problem-solving skills, excellent communication, and the ability to adapt to new challenges in a fast-paced environment is essential for this role.

Key Responsibilities

    • Design, build, and maintain large-scale data pipelines to ingest, process, and transform complex financial data
    • Develop data ingestion frameworks to handle high-volume and high-variety data feeds
    • Implement data quality control measures to detect and handle data anomalies, duplicates, and inconsistencies
    • Optimize data pipeline performance for scalability, reliability, and latency
    • Collaborate with data scientists to integrate machine learning models into the data pipeline and ensure seamless data flow
    • Develop and maintain model serving infrastructure to support real-time predictions and batch scoring
    • Implement model monitoring and logging to track performance, data quality, and model drift
    • Manage cloud-based infrastructure to support data pipeline and model serving workloads
    • Troubleshoot data pipeline issues, data quality problems, and model performance degradation
    • Collaborate with cross-functional teams, including data science, product, and engineering teams to ensure alignment and effective communication

Required Skills, Experience, and Qualifications

    • 3+ years of experience in a data engineering or similar role, with a focus on building and deploying data pipelines and machine learning models
    • 2+ years of experience with Databricks, PySpark, and Apache Spark 
    • 1+ year of experience with Apache Airflow, Apache Kafka, and Kubernetes 
    • Strong Python skills, with 3+ years of experience
    • Experience with production machine learning model deployment and management 
    • Knowledge of cloud-based infrastructure and services AWS and Azure
    • Experience with data warehousing, data lakes, and data marts
    • Familiarity with containerization using Docker and orchestration using Kubernetes
    • Understanding of messaging and streaming using Apache Kafka
    • Experience with workflow management using Apache Airflow
    • Strong problem-solving skills, with the ability to troubleshoot complex data pipeline and machine learning model issues
    • Excellent communication and collaboration skills, with the ability to work with data scientists, engineers, and senior stakeholders
    • Degree educated in Computer Science or relevant subject
    • Excellent spoken and written English 
    • Experience of driving innovation within teams
    • Positive, can-do approach to work, delivering on commitments
    • Able to earn respect and build trust through high-quality delivery and by demonstrating value added
    • Act with integrity, with the ability to make decisions, taking accountability for the consequences of these decisions
    • Creative approach to problem solving, can look at existing situations and problems in novel ways and propose innovative solutions
About us

We’re a diverse group of visionary innovators who provide trading and workflow automation software, high-value analytics, and strategic consulting to corporations, central banks, financial institutions, and governments. Founded in 1999, we’ve achieved tremendous growth by bringing together some of the best and most successful financial technology companies in the world.

• Over 2,000 of the world’s leading corporations, including 50% of the Fortune 500 and 30% of the world’s central banks, trust ION solutions to manage their cash, in-house banking, commodity supply chain, trading and risk.
• Over 800 of the world’s leading banks and broker-dealers use our electronic trading platforms to operate the world’s financial market infrastructure.

ION is a rapidly expanding and dynamic group with 13,000 employees and offices in more than 40 cities around the globe. Our ever-expanding global footprint, cutting edge products, and over 40,000 customers worldwide provide an unparalleled career experience for those who share our vision.

ION is committed to maintaining a supportive and inclusive environment for people with diverse backgrounds and experiences. We respect the varied identities, abilities, cultures, and traditions of the individuals who comprise our organization and recognize the value that different backgrounds and points of view bring to our business.
ION adheres to an equal employment opportunity policy that prohibits discriminatory practices or harassment against applicants or employees based on any legally impermissible factor.

Similar Jobs

Diligent Corporation - HR Business Partner

Diligent Corporation

London, England, United Kingdom (On-Site)
1 Month ago
Brillio - Lead Fullstack Engineer

Brillio

Tampa, Florida, United States (On-Site)
1 Month ago
Qualcomm - Physical Design Engineer- Lead/Staff

Qualcomm

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Critical mass - Freelance Senior Copywriter, Platform + Systems Focus

Critical mass

Toronto, Ontario, Canada (On-Site)
16 Hours ago
bytedance - Agency (Enablers) Growth Partner (Philippines, E-commerce)

bytedance

Taguig, Metro Manila, Philippines (On-Site)
2 Months ago
Figma - Software Engineer, Data Infrastructure

Figma

San Francisco, California, United States (Remote)
2 Weeks ago
P99 soft - Data Architect (Snowflake)

P99 soft

Hyderabad, Telangana, India (On-Site)
2 Months ago
undefined - Data Engineer (Azure)

Bogotá, Bogota, Colombia (On-Site)
1 Month ago
ShyftLabs - Lead Data Engineer

ShyftLabs

Noida, Uttar Pradesh, India (Hybrid)
1 Month ago
Apple - Senior Data Scientist - Business Analytics

Apple

Austin, Texas, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Hawkeye Innovations - Programme Manager

Hawkeye Innovations

Basingstoke, England, United Kingdom (On-Site)
3 Months ago
Google - Technical Program Manager III, AI/ML, Cloud AI Systems

Google

Austin, Texas, United States (On-Site)
2 Months ago
zeta - Program Manager / Senior Program Manager

zeta

Bengaluru, Karnataka, India (On-Site)
3 Years ago
Rockstar Games - Director of Security Operations

Rockstar Games

New York, United States (On-Site)
1 Month ago
Patreon - KYC and Sanctions Agent

Patreon

Portugal (Hybrid)
3 Months ago
InMobiInMobi - Manager - Operational Data Sciences

InMobiInMobi

Bengaluru, Karnataka, India (On-Site)
1 Week ago
Dream Sports - Senior Manager - Product (Creator Economy)

Dream Sports

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Hawkeye Innovations - Strategy Associate

Hawkeye Innovations

London, England, United Kingdom (Hybrid)
4 Days ago
Rhino Entertainment Group - Commercial Manager

Rhino Entertainment Group

Sliema, Malta (Hybrid)
1 Month ago
bytedance - Edge Network Engineer

bytedance

Singapore (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Budapest, Hungary

Ion - Java Developer, Budapest

Ion

Budapest, Hungary (Hybrid)
8 Months ago
Bosch Group - HR Trainee

Bosch Group

Vecsés, Hungary (Hybrid)
2 Weeks ago
Diligent Corporation - Test Automation Engineer Intern

Diligent Corporation

Budapest, Hungary (Hybrid)
18 Hours ago
Hawkeye Innovations - Frontend Test Automation Engineer

Hawkeye Innovations

Budapest, Hungary (Hybrid)
3 Months ago
Visual Concepts - Senior Graphics Engineer - NBA 2K

Visual Concepts

Budapest, Hungary (On-Site)
1 Week ago
Hawkeye Innovations - Mid-Level Java Engineer

Hawkeye Innovations

Budapest, Hungary (Hybrid)
3 Months ago
Ion - Project Operations Coordinator

Ion

Budapest, Hungary (On-Site)
5 Months ago
Hawkeye Innovations - Senior Data Test Automation Engineer

Hawkeye Innovations

Budapest, Hungary (Hybrid)
2 Months ago
OKX - Team Lead, Fraud Risk Operations (Remote)

OKX

Budapest, Hungary (Remote)
8 Months ago
Sika Group - Design Consultant

Sika Group

Biatorbágy, Hungary (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

Apexon - Data Engineer

Apexon

Birmingham, England, United Kingdom (On-Site)
4 Months ago
kuda  - Senior Data Analyst

kuda

Lagos, Lagos, Nigeria (Hybrid)
2 Months ago
Tencent - Data Analyst

Tencent

Washington, United States (On-Site)
2 Months ago
Saviynt - Senior Data Analyst, Sales

Saviynt

United States (Remote)
1 Month ago
ShyftLabs - Staff Data Engineer

ShyftLabs

Toronto, Ontario, Canada (Hybrid)
1 Month ago
Epic Games - Principal Data Analyst, Ecosystem Economy & UGC

Epic Games

(On-Site)
6 Months ago
Riot Games - Principal Insights Analyst - Player Platform

Riot Games

Los Angeles, California, United States (On-Site)
7 Months ago
Tesla - HR Business Analyst

Tesla

Brandenburg, Germany (On-Site)
4 Months ago
Hawkeye Innovations - Senior Data Test Automation Engineer

Hawkeye Innovations

Basingstoke, England, United Kingdom (Hybrid)
2 Months ago
Fanatee - Data Analyst

Fanatee

Spain (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

We’re visionary innovators who are delivering mission-critical trading and workflow automation software to financial institutions, corporations, central banks, and governments. By combining our passion for automation with a strategic view on the industries we serve, we design solutions that improve decision-making, simplify complex processes, and empower people. Simply put, we help our customers do more, faster and better than before. We believe our investments in research and development are shaping the future of automation and enabling our customers to transform their business. And we embrace the power of community, working with each other and with our customers to succeed through a positive culture of continuous improvement.

Jersey City, New Jersey, United States (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

London, England, United Kingdom (On-Site)

Budapest, Hungary (Hybrid)

Chicago, Illinois, United States (On-Site)

London, England, United Kingdom (On-Site)

Mexico City, Mexico (Hybrid)

View All Jobs

Get notified when new jobs are added by Ion

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug