Data Engineering Senior Specialist (SQL/Databricks)
Job Summary
Job Description
- Use the Databricks Lakehouse Platform.
- Implement ETL tasks using Apache Spark SQL and Python.
- Proficiency in SQL and Python.
- Knowledge of Modern Data technologies.
- Worked on cloud computing platforms like AWS.
- Knowledge on Terraform.
- Any certification in relevant field.
- Annual monetary bonus.
- Opportunity to become a Nasdaq shareholder.
- Employee Stock Purchase Program.
- Health Insurance Program.
- Flexible working schedule and hybrid way of work.
- Flex day program (up to 6 paid days off a year).
- Internal mentorship program.
- Wide selection of online learning resources.
8 skills required
Job Details
Nasdaq is continuously revolutionizing markets and undergoing transformations while we adopt new technologies to develop innovative solutions, constantly aiming to rewrite tomorrow.
With this position we offer :
You will be primarily responsible for taking the defined business requirements and provides analytical, modelling, dimensional modeling and testing to provide best outcomes for design against these customer’s requirements.
Also perform analysis, concentrates on understanding the business needs for data and information. The data engineer translates business information needs into data structures that are adaptable, extensible and sustainable.
Your role and responsibilities:
As a Databricks Data Engineer, you will play a crucial role in designing, building, and maintaining data pipelines within the Databricks Lakehouse Platform. Your expertise will contribute to the success of data-driven initiatives, enabling efficient data processing, analysis, and reporting.
Furthermore, you will:
- Use the Databricks Lakehouse Platform to perform data engineering tasks.
- Understand the Lakehouse Platform, its workspace, architecture, and capabilities.
- Implement multi-hop architecture ETL tasks using Apache Spark™ SQL and Python in both batch and incremental paradigms.
- Develop and maintain ETL pipelines using the Medallion Architecture.
- Be able to add new Sources to the Lakehouse platform independently.
- Reviews development of technology platform on AWS cloud and where vital in house.
- Supervises the design and implementation of the methods to extract data’s from different sources.
- Is responsible for identifying, analyzing and resolving technical problems with Nasdaq Data Platforms and related ecosystems.
- Actively works towards and advises others to ensure the project is being delivered within the assigned timeline and budget
- Leads all aspects of the administrative tasks and make sure the team performs them in a timely manner and that information given is detailed and complete. Ensure that the administration is done according to regulations, in order to keep the administration accurate anddetailede.
We expect you to have :
- 8-10 years of overall experience. At least 5-6 years of Data Engineering experience specifically working on Databricks.
- Proficiency in SQL and Python for Data Manipulation and transformation.
- Knowledge of Modern Data technologies such as Spark, Informatica, Parquet and Delta Tables.
- Good to have worked on cloud computing platforms like AWS.
- Understanding of data modeling, architecture, and best practices.
- Familiarity with AI/ML Ops in Databricks.
- Education Qualification: Bachelor/Master degree in relevant field or equivalent qualification.
It would be great if you :
- Knowledge on Terraform.
- Any certification in relevant field.
Does it sound like you? What happens now?
As the selection process is ongoing, please submit your application in English as soon as possible. We will get back to you in 2-3 weeks.
What will it be like working here?
Nasdaq is a vibrant and entrepreneurial company where everyone is encouraged to take initiative, challenge status quo, and take intelligent risks. We want everyone to feel welcome and bring their authentic self to work. Every day, we are building a culture where we all feel connected, supported and empowered. We are a Hybrid-first environment that embraces work-life balance and fosters well-being.
What do we offer you?
- Annual monetary bonus.
- An opportunity to become a Nasdaq shareholder
- Employee Stock Purchase Program Nasdaq stocks with a discount
- Health Insurance Program
- Flexible working schedule and hybrid way of work
- Flex day program (up to 6 paid days off a year)
- Internal mentorship program – get a mentor or become one
- Wide selection of online learning resources, e.g., Udemy
Come as You Are
Nasdaq is an equal opportunity employer. We positively encourage applications from suitably qualified and eligible candidates regardless of age, color, disability, national origin, ancestry, race, religion, gender, sexual orientation, gender identity and/or expression, veteran status, genetic information, or any other status protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.
Similar Jobs
Redhorse Corp
Veeam Software
Autodesk
Get notifed when new similar jobs are uploaded
Similar Skill Jobs
Penumbrainc
PwC
Critical mass
Rackspace Technology
Get notifed when new similar jobs are uploaded
Jobs in Bengaluru, Karnataka, India
Nagarro
Netflix
Game Mode One
Zscaler
Get notifed when new similar jobs are uploaded
Programming Jobs
Get notifed when new similar jobs are uploaded
About The Company
Get notified when new jobs are added by Nasdaq
