Big Data Engineer

1 Month ago • All levels

Job Summary

Job Description

The ACQA platform is built on Microsoft Azure cloud computing technology. It aims to deliver scalable cost-efficient infrastructure using cloud PaaS components. The platform offers a single core platform with open architecture designed for change, itemized cost metrics, and automated data lineage. It will be shared across Front Office, Finance, and Risk, improving regulatory compliance. The goal is to create a One-Platform / One-Experience, which is easy to train and operate while retaining talent. The platform consists of components providing next-generation valuation and risk management services. The responsibilities involve developing big data technologies, programming complex production systems, and experience with cloud providers.
Must have:
  • Development of big data technologies like Apache Spark and Azure Databricks
  • Programming complex production systems in Scala or Java or Python
  • Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)
  • Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab
  • Experience with containerisation in development, build and runtime environments including experience of Kubernetes
Good to have:
  • Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)
  • Python experience
  • Testing and instrumentation practices, observability and alerting tooling
  • Understanding of information modelling, data structures and algorithms
  • Technical architecture and low-level design
  • Agile development and planning practices
  • Ability to collaborate effectively in a large global team and influence key architectural decisions

Job Details

Project description

ACQA is built on Microsoft Azure cloud computing technology. It aims to deliver:
• Scalable cost-efficient infrastructure, using cloud PaaS components.
• Single core platform, open architecture, designed for change, itemised $cost metrics, automated data lineage.
• Shared across Front Office, Finance and Risk, improving regulatory compliance.
• One-Platform / One-Experience -fast to train, easy to operate, retaining talent.
The ACQA platform is made up of a series of components providing the next generation valuation and risk management services.

Responsibilities
bullet icon

Development of big data technologies like Apache Spark and Azure Databricks

bullet icon

Programming complex production systems in Scala or Java or Python

bullet icon

Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)

bullet icon

Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab

bullet icon

Experience with containerisation in development, build and runtime environments including experience of Kubernetes

Skills

Must have

bullet icon

Development of big data technologies like Apache Spark and Azure Databricks

bullet icon

Programming complex production systems in Scala or Java or Python

bullet icon

Experience in a platform engineering role on a major cloud provider (ideally Microsoft Azure)

bullet icon

Development and/or operations of CI/CD pipelines using modern cloud-friendly build systems like GitLab

bullet icon

Experience with containerisation in development, build and runtime environments including experience of Kubernetes

Nice to have

bullet icon

Production experience with Terraform on a major public cloud provider (ideally Microsoft Azure)

bullet icon

Python experience

bullet icon

Testing and instrumentation practices, observability and alerting tooling

bullet icon

Understanding of information modelling, data structures and algorithms

bullet icon

Technical architecture and low-level design

bullet icon

Agile development and planning practices

bullet icon

Ability to collaborate effectively in a large global team and influence key architectural decisions

Other
seniority icon

Languages

English: C1 Advanced

seniority icon

Seniority

Senior

Stamford, US, United States of America

Req. VR-114871

BigData Development

BCM Industry

05/06/2025

Req. VR-114871

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Stamford, Connecticut, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Empower your future with Luxoft: Innovate, thrive and grow in a software-defined world.

Mexico (Remote)

Brazil (Remote)

Singapore (On-Site)

Singapore (On-Site)

Hong Kong (On-Site)

Pune, Maharashtra, India (On-Site)

Kolkata, West Bengal, India (On-Site)

Indore, Madhya Pradesh, India (On-Site)

Hyderabad, Telangana, India (On-Site)

View All Jobs

Get notified when new jobs are added by luxsoft

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug