IN-Senior Associate_ ETL Databricks _D&A_Advisory_Bangalore

Line of Service

Advisory

Industry/Sector

Not Applicable

Specialism

Data, Analytics & AI

Management Level

Senior Associate

Job Description & Summary

A career within Data and Analytics services will provide you with the opportunity to help organisations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organisational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organisations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge.

Creating business intelligence from data requires an understanding of the business, the data, and the technology used to store and analyse that data. Using our Rapid Business Intelligence Solutions, data visualisation and integrated reporting dashboards, we can deliver agile, highly interactive reporting and analytics that help our clients to more effectively run their business and understand what business questions can be answered and how to unlock the answers.

Job Description & Summary:  ETL Databricks

Responsibilities:

Years of Experience: 4 – 10 Yrs

• Databricks Engineers with 2-3 years of hand-on experience in Pyspark, Cloud Platform and SQL.
• Proven experience in implementing data solutions on the Databricks platform with hands on experience in setting up Databricks cluster, working in Databricks modules, data pipelines for ingesting and transforming data from various sources into Databricks.
• Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.
• Bachelor’s or Master’s degree with 4-6 years of professional experience.
• Proven experience in implementing data solutions on the Databricks platform.
• Solid understanding of Databricks fundamentals and have hands on experience in setting up Databricks cluster, working in Databricks modules (Data Engineering, ML and SQL warehouse).
• Configure, set up, and manage Databricks clusters, workspaces, and notebooks to ensure optimal performance, scalability, and resource allocation.
• Implement data pipelines for ingesting, cleansing, and transforming data from various sources into Databricks, ensuring data quality, consistency, and reliability. Develop ETL (Extract, Transform, Load) processes as needed.
• Develop, optimize, and maintain Spark-based ETL workflows and data pipelines for data preparation and transformation within Databricks.
• Knowledge of Performance Optimization, Monitoring and Automation would be a plus.
• Understanding of data governance, compliance, and security best practices.
• Strong Proficiency in Pyspark, Databricks Notebooks, SQL, Python, Scala, or Java.
• Proficiency in SQL for data querying and manipulation.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Strong problem-solving and troubleshooting skills.

Mandatory skill sets:

ETL Databricks

Preferred skill sets:

ETL Databricks

Years of experience required:

4+

Education qualification:

BTech/MBA/MCA

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Bachelor of Engineering, Master of Business Administration

Degrees/Field of Study preferred:

Certifications (if blank, certifications not specified)

Required Skills

Extract Transform Load (ETL)

Optional Skills

Accepting Feedback, Accepting Feedback, Active Listening, Analytical Reasoning, Analytical Thinking, Application Software, Business Data Analytics, Business Management, Business Technology, Business Transformation, Communication, Creativity, Documentation Development, Embracing Change, Emotional Regulation, Empathy, Implementation Research, Implementation Support, Implementing Technology, Inclusion, Intellectual Curiosity, Learning Agility, Optimism, Performance Assessment, Performance Management Software {+ 16 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Not Specified

Available for Work Visa Sponsorship?

No

Government Clearance Required?

No

Job Posting End Date