AWS Data Architect (Finance & Capital Markets)

4 Minutes ago • 5 Years + • $150,000 PA - $170,000 PA

Data Analysis

Job Description

This role is for a seasoned AWS Data Architect with deep expertise in cloud-native data platforms, specifically within the Finance and Capital Markets domain. The ideal candidate will design and implement scalable, secure, and high-performance data solutions for trading, risk, compliance, and analytics. Key responsibilities include designing data lakehouse solutions on AWS using Medallion Architecture, building real-time and batch data pipelines with Spark and Kafka, and integrating various AWS data services while ensuring data governance and security compliance.

Good To Have:

Exposure to Delta Lake, DBT, Databricks, or Snowflake.
AWS Certifications (Solutions Architect – Professional, Data Analytics Specialty).

Must Have:

Design and implement data lakehouse solutions on AWS using Medallion Architecture (Bronze/Silver/Gold layers).
Build and optimize real-time and batch data pipelines leveraging Apache Spark, Kafka, and AWS Glue/EMR.
Architect storage and processing layers using Parquet and Iceberg for schema evolution, partitioning, and performance optimization.
Integrate AWS data services (S3, Redshift, Lake Formation, Kinesis, Lambda, DynamoDB) into enterprise solutions.
Ensure data governance, lineage, cataloging, and security compliance in line with financial regulations (Basel III, MiFID II, Dodd-Frank).
Partner with business stakeholders (trading, risk, compliance) to translate requirements into technical architecture.
Provide technical leadership and guidance to engineering teams.
Strong hands-on skills in AWS Data Services (S3, Redshift, Glue, EMR, Kinesis, Lake Formation, DynamoDB).
Expertise in Apache Kafka (event streaming) and Apache Spark (batch and streaming).
Proficiency in Python for data engineering and automation.
Strong knowledge of Parquet, Iceberg, and Medallion Architecture.
Experience with trading systems, market data feeds, risk analytics, and regulatory reporting.
Familiarity with time-series data, reference/master data, and real-time analytics.
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
5+ years in data architecture (3+ years on AWS).
Mandatory exposure to Finance and Capital Markets.

Perks:

Build next-generation financial data platforms on AWS.
Work on high-impact, real-time trading and risk solutions.
Collaborate with global teams of finance and technology leaders.
Opportunity to work on products and platforms for innovative software companies.
Gain knowledge working alongside highly skilled professionals.
Accelerate career progression.
Exciting and challenging projects across a diverse range of industries.
Opportunity to collaborate with a group of forward-thinking, capable partners around the globe.

Add these skills to join the top 1% applicants for this job

team-management

data-analytics

game-texts

aws

apache-kafka

spark

python

Description

Ness is a full lifecycle digital engineering firm offering digital advisory through scaled engineering services. Combining our core competence in engineering with the latest in digital strategy and technology, we seamlessly manage Digital Transformation journeys from strategy through execution to help businesses thrive in the digital economy. As your tech partner, we help engineer your company’s future with cloud and data. For more information, visit www.ness.com

We are problem-solvers, architects, strategists, implementors, and lifelong learners. We collaborate with each other and with our clients to help them meet their short- and long-term technology goals. Our culture is open, transparent, challenging, and fun.

We hire smart, self-starters who thrive in an open-ended environment to figure out what needs to be done and take ownership in delivering quality results

Position Overview:

We are looking for a seasoned AWS Data Architect with deep expertise in cloud-native data platforms and proven experience in the Finance and Capital Markets domain. The ideal candidate will design and implement scalable, secure, and high-performance data solutions that support trading, risk, compliance, and analytics functions.

Key Responsibilities:

Design and implement data lakehouse solutions on AWS using Medallion Architecture (Bronze/Silver/Gold layers).
Build and optimize real-time and batch data pipelines leveraging Apache Spark, Kafka, and AWS Glue/EMR.
Architect storage and processing layers using Parquet and Iceberg for schema evolution, partitioning, and performance optimization.
Integrate AWS data services (S3, Redshift, Lake Formation, Kinesis, Lambda, DynamoDB) into enterprise solutions.
Ensure data governance, lineage, cataloging, and security compliance in line with financial regulations (Basel III, MiFID II, Dodd-Frank).
Partner with business stakeholders (trading, risk, compliance) to translate requirements into technical architecture.
Provide technical leadership and guidance to engineering teams.

Required Skills & Experience:

Core Technical Expertise
Strong hands-on skills in AWS Data Services (S3, Redshift, Glue, EMR, Kinesis, Lake Formation, DynamoDB).
Expertise in Apache Kafka (event streaming) and Apache Spark (batch and streaming).
Proficiency in Python for data engineering and automation.
Strong knowledge of Parquet, Iceberg, and Medallion Architecture.
Finance & Capital Markets Knowledge
Experience with trading systems, market data feeds, risk analytics, and regulatory reporting.
Familiarity with time-series data, reference/master data, and real-time analytics.
Preferred
Exposure to Delta Lake, DBT, Databricks, or Snowflake.
AWS Certifications (Solutions Architect – Professional, Data Analytics Specialty).

Qualifications:

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
10+ years of IT experience with 5+ years in data architecture (3+ years on AWS).
Mandatory exposure to Finance and Capital Markets.

Why Join Us:

Build next-generation financial data platforms on AWS.
Work on high-impact, real-time trading and risk solutions.
Collaborate with global teams of finance and technology leaders.

We know that people are our greatest asset. Our staff’s professionalism, innovation, teamwork, and dedication to excellence have helped us become one of the world’s leading technology companies. It is these qualities that are vital to our continued success. As an employee, you will be working on products and platforms for some of the most innovative software companies in the world.

You’ll gain knowledge working alongside other highly skilled professionals that will help accelerate your career progression. We treat our values of rigor, innovation, and partnership with the highest priority, and they are placed at the very core of our business — to guide us through our daily operations and interactions with our customers.

We offer our employees exciting and challenging projects across a diverse range of industries, as well as the opportunity to collaborate with a group of forward-thinking, capable partners around the globe.

Salary Range: 150K - 170K