Jobs

Scholarships

Courses

Companies

Placements

Community

Home >

Jobs >

Senior Big Data Engineer

Karnataka, India (On-site)

Senior Big Data Engineer

1 Month ago • 6 Years + • Data Analyst • Undisclosed

About the job

7 skills required for this role

Add these skills to join the top 1% applicants for this job

scala

spark

data-structures

sql

hadoop

hbase

scalability

Job Description

This Senior Big Data Engineer role involves managing analytics support for key initiatives across a large UK-based investment bank's CCIB portfolio. Responsibilities include ensuring timely and effective service delivery, continuous productivity improvement, managing data support for key initiatives, collaborating with technology teams on production issue resolution, working with business and technology teams on new functionality integration, providing analytics support across various business areas (customer acquisition, portfolio management, new product development), managing analysis and reporting, interacting with metrics owners, and providing development opportunities for staff. The role also requires creating and maintaining optimal data pipeline architecture, assembling large datasets, identifying and implementing process improvements, and working with data transformation, structures, metadata, and workload management. Experience with message queuing, stream processing, and big data stores is essential.

Must have:

6+ years relevant tech experience
Hands-on Hadoop & Big Data tech (Hive, HBase, Kafka, Spark)
Strong analytics with unstructured datasets
Strong SQL experience
Database & Data Warehouse building & management
Data pipeline, architecture & dataset experience
Root cause analysis

Good to have:

Scala
Control-M or other scheduling tool

Project description

We've been engaged by a large UK Based Investment Bank in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .

Responsibilities

Ensuring quality service output, submitted in a timely manner and communicated effectively

Continuous Improvement in Productivity to the standards prescribed from time to time

Manage data & information support for all the key initiatives across Retail Bank supporting countries & group teams.

Work closely with technology on solutions to resolve identified production issues which are impacting existing infrastructure /solution covering data quality, data assurance, refresh timeliness, data security governance

To work closely with Business & Technology to review the integration of new functionality / technology implementation projects initiated

Extend analytics support spanning across entire gamut of business (Customer Acquisition, Portfolio Management, New Product Development)

Manage analysis & reporting across all Retail products/segments

Interact with metrics owners across various functions and get end to end understanding of the metrics and applicability of the same across various MI dashboards

Provide development opportunities through regular engagement, ensuring that all staff is aware of the opportunities available in order to help them succeed within their role

Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements.

Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

Skills

Must have

6+ years of relevant technology experience

Hands on Hadoop and Bigdata tech. , HIVE, HBase, Kafka, Spark

Strong analytic skills related to working with unstructured datasets.

Strong experience on SQL

Good Experience on Data Base & Data Ware house building and management

Exposure to data pipelines, architectures and data sets

Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Build processes supporting data transformation, data structures, metadata, dependency and workload management.

Working knowledge of message queuing, stream processing and highly scalable 'big data' data stores.

Nice to have

Scala

Good to have experience in Control M or any other scheduling tool

Other

Languages

English: C2 Proficient

Seniority

Senior

View Full Job Description

Upload your resume, increase your shortlisting chances by 80%

About The Company

Luxoft

604 Active Jobs

Luxoft, a DXC Technology Company (NYSE: DXC), is a digital strategy and software engineering firm providing bespoke technology solutions that drive business change for customers the world over. Acquired by U.S. company DXC Technology in 2019, Luxoft is a global operation in 44 cities and 21 countries with an international, agile workforce of nearly 18,000 people. It combines a unique blend of engineering excellence and deep industry expertise, helping over 425 global clients innovate in the areas of automotive, financial services, travel and hospitality, healthcare, life sciences, media and telecommunications.

DXC Technology is a leading Fortune 500 IT services company which helps global companies run their mission critical systems. Together, DXC and Luxoft offer a differentiated customer-value proposition for digital transformation by combining Luxoft’s front-end digital capabilities with DXC’s expertise in IT modernization and integration. Follow our profile for regular updates and insights into technology and business needs.