Big Data Engineer

2 Months ago • All levels • Data Analysis

Job Summary

Job Description

The ACQA platform is built on Microsoft Azure cloud technology and aims to deliver a scalable, cost-efficient infrastructure using cloud PaaS components. It utilizes a single core platform with open architecture designed for change, itemized cost metrics, and automated data lineage. The platform is shared across Front Office, Finance, and Risk to improve regulatory compliance. ACQA offers a unified platform and experience, facilitating rapid training and ease of operation while retaining talent. The platform is composed of components delivering next-generation valuation and risk management services.
Must have:
  • Development of big data technologies like Apache Spark and Azure Databricks
  • Programming complex production systems in Scala or Java or Python
  • Experience in a platform engineering role on a major cloud provider
  • Development and/or operations of CI/CD pipelines using GitLab
  • Experience with containerisation in development, build and runtime environments
Good to have:
  • Production experience with Terraform on a major public cloud provider
  • Python experience
  • Testing and instrumentation practices, observability and alerting tooling
  • Understanding of information modelling, data structures and algorithms
  • Technical architecture and low-level design
  • Agile development and planning practices
  • Ability to collaborate effectively in a large global team

Job Details

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:
• Scalable cost-efficient infrastructure, using cloud PaaS components.
• Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
• Shared across Front Office, Finance and Risk, improving regulatory compliance.
• One-Platform / One-Experience -fast to train, easy to operate, retaining talent.
The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Responsibilities
bullet icon

Development of big data technologies like Apache Spark and Azure Databricks

bullet icon

Programming complex production systems in Scala or Java or Python

bullet icon

Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)

bullet icon

Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab

bullet icon

Experience with containerisation in development, build and runtime environments including experience of Kubernetes

Skills

Must have

bullet icon

Development of big data technologies like Apache Spark and Azure Databricks

bullet icon

Programming complex production systems in Scala or Java or Python

bullet icon

Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)

bullet icon

Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab

bullet icon

Experience with containerisation in development, build and runtime environments including experience of Kubernetes

Nice to have

bullet icon

Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)

bullet icon

Python experience

bullet icon

Testing and instrumentation practices, observability and alerting tooling

bullet icon

Understanding of information modelling, data structures and algorithms

bullet icon

Technical architecture and low-level design

bullet icon

Agile development and planning practices

bullet icon

Ability to collaborate effectively in a large global team and influence key architectural decisions

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Similar Jobs

Capgemini - HR Business Partner

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago
VGW - People & Culture Service Delivery Team Leader

VGW

Manila, Metro Manila, Philippines (Remote)
5 Days ago
Penumbrainc - Marketing Analytics Intern - Temp

Penumbrainc

Singapore (On-Site)
4 Months ago
Postman - Senior Marketing Data Manager

Postman

San Francisco, California, United States (Hybrid)
2 Months ago
Intel  - LTD Advanced Device Development Engineer

Intel

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Weeks ago
Tesla - Vibration Test & Data Analysis Engineer

Tesla

North Brabant, Netherlands (On-Site)
4 Months ago
Global Business Travel - Data Advanced Insight Analyst

Global Business Travel

London, England, United Kingdom (On-Site)
1 Month ago
Microsoft - Senior Data Scientist

Microsoft

(On-Site)
2 Months ago
Tide - Senior Engineer, Python (Data & AI)

Tide

Sofia, Sofia City Province, Bulgaria (Hybrid)
2 Months ago
Playtika - Senior DATA/AI SRE Engineer

Playtika

Poland (On-Site)
8 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

bytedance - Merchant Ecosystem Special Project and Strategy Lead

bytedance

Taguig, Metro Manila, Philippines (On-Site)
1 Month ago
NVIDIA - Silicon Power Performance Engineer

NVIDIA

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Sagecor - Technical Expert

Sagecor

Saratoga Springs, Utah, United States (On-Site)
5 Months ago
Valeo - VIE Quality Team

Valeo

Munich, Bavaria, Germany (On-Site)
3 Weeks ago
Amanotes - Senior Game Designer (Contractor)

Amanotes

Ho Chi Minh City, Ho Chi Minh City, Vietnam (Remote)
5 Months ago
Tesla - Logistics Financial Analyst Internship

Tesla

Brandenburg, Germany (On-Site)
4 Months ago
OKX - Head of FinCrime, Internal Audit

OKX

New York, United States (On-Site)
1 Month ago
Nahc.io - Sales Manager (AI Search Solution)

Nahc.io

Singapore (Remote)
3 Weeks ago
PwC - Audit Manager

PwC

Santo Domingo, Distrito Nacional, Dominican Republic (On-Site)
2 Weeks ago
bytedance - Data Analyst - BytePlus Recommend

bytedance

Singapore (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Weehawken Township, New Jersey, United States

Microsoft - Member of Technical Staff - Backend Growth Engineer

Microsoft

Mountain View, California, United States (Hybrid)
3 Months ago
The Walt Disney Company - Security Host/Hostess

The Walt Disney Company

Kapolei, Hawaii, United States (On-Site)
2 Months ago
The Walt Disney Company - Senior Game Designer

The Walt Disney Company

San Francisco, California, United States (On-Site)
7 Months ago
UPF Industries  - Truck Driver

UPF Industries

Clearfield, Utah, United States (On-Site)
3 Weeks ago
Inkittt - VP of Operations

Inkittt

San Francisco, California, United States (Hybrid)
6 Months ago
The Walt Disney Company - Senior Structural Engineer

The Walt Disney Company

Anaheim, California, United States (On-Site)
1 Month ago
GameChanger - Staff iOS Software Engineer, Gameday

GameChanger

United States (Remote)
4 Months ago
Pokemon - Sr. Corporate Communications Manager

Pokemon

Bellevue, Washington, United States (Hybrid)
2 Months ago
Interactive Brokers - Digital Forensics/Incident Responder

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
1 Month ago
Universal Music Group - Accounting Manager

Universal Music Group

Los Angeles, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

GoTo Group - Data Scientist

GoTo Group

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Go Fund Me - Staff Data Analyst

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Hybrid)
1 Month ago
Funko - E-Commerce Cash & Data Analyst

Funko

Coventry, England, United Kingdom (On-Site)
2 Weeks ago
PrizePicks - Senior Data Science Engineer

PrizePicks

Atlanta, Georgia, United States (Hybrid)
2 Months ago
Tencent - Game Operation Specialist (Data Analytics) - PUBG Mobile, Latin America

Tencent

Shenzhen, Guangdong Province, China (On-Site)
4 Months ago
Western Digital - Engineer, Data Analyst Equipment Engineering

Western Digital

Bayan Lepas, Penang, Malaysia (On-Site)
1 Month ago
bytedance - Data Engineer, Cloud and System

bytedance

Seattle, Washington, United States (On-Site)
3 Months ago
Euromonitor - Senior Business Analyst

Euromonitor

Bengaluru, Karnataka, India (Hybrid)
1 Month ago
Cerence - Senior Data Scientist

Cerence

United States (Remote)
2 Months ago
Silicon Labs - Senior Data Engineer

Silicon Labs

Budapest, Hungary (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Empower your future with Luxoft: Innovate, thrive and grow in a software-defined world.

Ukrainka, Kyiv Oblast, Ukraine (Remote)

India (Remote)

Germany (Remote)

Egypt (Remote)

Pune, Maharashtra, India (On-Site)

Kraków, Lesser Poland Voivodeship, Poland (On-Site)

Zürich, Zurich, Switzerland (On-Site)

Riyadh, Riyadh Province, Saudi Arabia (On-Site)

Pune, Maharashtra, India (On-Site)

View All Jobs

Get notified when new jobs are added by luxsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug