Senior Java Developer (Spark, Hadoop)

This role is for a Senior Java Developer with Big Data experience (Hadoop, Spark) to work on a next-generation cross-asset data management platform. The platform provides globally consistent data and innovative tools for trade/sales clients, built on a scalable, cloud-ready big data architecture. Responsibilities include designing and building frameworks for ingesting/modeling complex Risk data and developing low-latency caching for Front Office risk systems. The developer will work with strong development teams and enhance their knowledge in big data within an international bank.

Must Have

• Design and build frameworks for ingesting/modeling the complex Risk data
• Develop Low latency caching to service Front office risk systems

Good to Have

• Experience In-memory databases and caching
• Job Orchestration tools like Autosys or Airflow
• Financial background (where possible)

##### Project description

A next-generation cross-asset data management platform to provide globally consistent data and innovative tools to support business strategy for trade/sales clients that is built on big data architecture, highly scalable, and cloud-ready. The platform enables industry-leading analytics, client reporting, regulatory compliance, surveillance, supervisory reporting, and data science solutions (data flame). The project tech stack: Apache Spark, Hive, Java, Scala, Spring, SQL, Kafka, Hadoop.

We are looking for a strong Senior Java Developer with Big Data experience (Hadoop, Spark) capable of build the design and establish the framework in order to expose and distribute the Risk data to wide variety of consumers including Finance, Front office Risk Systems, Trading Systems, Back office and Account systems. This should cover low latency access and Streaming, Push / Pull mechanisms depending on the type of consumers.

The role of the Senior Java Developer involves working with strong development teams (3 Senior Java Developers), the opportunity to work with big data improving knowledge in this domain utilizing the resources of an international bank.

##### Responsibilities

• Design and build frameworks for ingesting/modeling the complex Risk data
• Develop Low latency caching to service Front office risk systems

##### Skills

Must have

• At least 5 years of experience in software development, including professional backend software development experience;
• Strong Knowledge of Java programming languages
• 1+ year of Big data development with extensive hands-on experience with Spark programming
• Strong knowledge of big data technologies like Hadoop (Hive) and Spark
• Should be familiar with algorithms and design patterns
• Understanding of distributed systems.
• Understanding of CI/CD workflow.
• Familiarity with Linux environment including scripting skills

Nice to have

• Experience In-memory databases and caching
• Job Orchestration tools like Autosys or Airflow
• Financial background (where possible)

##### Other

Languages

English: B2 Upper Intermediate

Seniority

Senior