Staff Data Engineer

2 Months ago • 10 Years +

Job Summary

Job Description

As the hands-on Staff Database Engineer, you will design, develop, and maintain data systems and architectures to collect, store, process, and analyze large volumes of data. You will be building data pipelines, optimizing data models, and ensuring data quality and security. This role involves collaborating with cross-functional teams to meet business objectives and stay updated with emerging technologies and industry best practices. Responsibilities include expertise in Snowflake, data modeling, ELT processes, DBT CLI, and complex SQL processes.
Must have:
  • Extensive experience with Snowflake, including Snow SQL CLI.
  • In-depth expertise in Snowflake data modeling and ELT processes.
  • Strong background in DBT CLI, DBT Cloud, and GitHub.
  • Hands-on approach in designing and supporting data pipelines.
  • Advance SQL knowledge and experience in complex query writing.
  • Collaborate closely with cross-functional teams.
  • Hands-on role in conducting data modeling and ETL development.
  • Develop and implement comprehensive data governance policies.
  • Independently conceptualize and develop ETL and reporting solutions.
  • Create comprehensive documentation for database objects.
  • Troubleshoot and resolve production support issues.
Good to have:
  • Familiarity with big data, data warehouse architecture.
  • Strong understanding of database management systems.
  • Expertise in Snowflake architecture, administration, and performance tuning.
  • Experience with Snowflake security configurations and access controls.
  • Knowledge of Snowflake's data sharing and replication features.
  • Experience with ETL (Extract, Transform, Load) tools and processes.
  • Ability to translate business requirements into EDW solutions.
  • Streaming Technologies like AWS Kinesis
  • Experience in the Finance industry

Job Details

As the hands-on Staff Database Engineer for Clearwater Analytics, you will play a crucial role in designs, develops, and maintains data systems and architectures to collect, store, process, and analyse large volumes of data. You will be building data pipelines, optimize data models, and ensure data quality and security. You will be collaborating with cross-functional teams to meet business objectives and stay updated with emerging technologies and industry best practices.

 

Responsibilities and Duties:

  • Extensive experience with Snowflake, including proficiency in Snow SQL CLI, Snowpipe, creating custom functions, developing Snowflake stored procedures, schema modeling, and performance tuning.

  • In-depth expertise in Snowflake data modeling and ELT processes using Snowflake SQL, as well as implementing complex stored procedures and leveraging Snowflake Task Orchestration for advanced data workflows.

  • Strong background in DBT CLI, DBT Cloud, and GitHub version control, with the ability to design and develop complex SQL processes and ELT pipelines.

  • Take a hands-on approach in designing, developing, and supporting low-latency data pipelines, prioritizing data quality, accuracy, reliability, and efficiency

  • Advance SQL knowledge and hands-on experience in complex query writing using Analytical functions, Troubleshooting, problem-solving, and performance tuning of SQL queries accessing data warehouse as well as Strong knowledge of stored procedures.

  • Collaborate closely with cross-functional teams including, Enterprise Architects, Business Analysts, Product Owners, Solution Architects actively engaging in gathering comprehensive business requirements and translate these requirements into scalable data cloud and Enterprise Data Warehouse (EDW) solutions that precisely align with organizational needs

  • Play a hands-on role in conducting data modeling, ETL (Extract, Transform, Load) development, and data integration processes across all Snowflake environments.

  • Develop and implement comprehensive data governance policies and procedures to fortify the accuracy, security, and compliance of Snowflake data assets across all environments.

  • Capable of independently conceptualizing and developing innovative ETL and reporting solutions, driving them through to successful completion.

  • Create comprehensive documentation for database objects and structures to ensure clarity and consistency.

  • Troubleshoot and resolve production support issues post-deployment, providing effective solutions as needed.

  • Devise and sustain comprehensive data dictionaries, metadata repositories, and documentation to bolster governance and facilitate usage across all Snowflake environments.

  • Remain abreast of the latest industry trends and best practices, actively sharing knowledge and encouraging the team to continuously enhance their skills.

  • Continuously monitor the performance and usage metrics of Snowflake database and Enterprise Data Warehouse (EDW), conducting frequent performance reviews and implementing targeted optimization efforts

 

Skills Required:

  • Familiarity with big data, data warehouse architecture and design principles

  • Strong understanding of database management systems, data modeling techniques, data profiling and data cleansing techniques

  • Expertise in Snowflake architecture, administration, and performance tuning.

  • Experience with Snowflake security configurations and access controls.

  • Knowledge of Snowflake's data sharing and replication features.

  • Proficiency in SQL for data querying, manipulation, and analysis.

  • Experience with ETL (Extract, Transform, Load) tools and processes.

  • Ability to translate business requirements into scalable EDW solutions.

  • Streaming Technologies like AWS Kinesis

 

Qualifications:

  • Bachelor's degree in Computer Science, Information Systems, or a related field. 

  • 10 years of hands-on experience in data warehousing, ETL development, and data modeling, with a strong track record of designing and implementing scalable Enterprise Data Warehouse (EDW) solutions.

  • 3+ years of extensive hands-on experience with Snowflake, demonstrating expertise in leveraging its capabilities.

  • Proficiency in SQL and deep knowledge of various database management systems (e.g., Snowflake, Azure, Redshift, Teradata, Oracle, SQL Server).

  • Experience utilizing ETL tools and technologies such as DBT, Informatica ,SSIS, Talend

  • Expertise in data modeling techniques, with a focus on dimensional modeling and star schema design.

  • Familiarity with data governance principles and adeptness in implementing security best practices.

  • Excellent problem-solving and troubleshooting abilities, coupled with a proven track record of diagnosing and resolving complex database issues.

  • Demonstrated leadership and team management skills, with the ability to lead by example and inspire others to strive for excellence.

  • Experience in the Finance industry will be a significant advantage

Similar Jobs

Corsair - eCommerce Full Stack Developer (React / Shopify)

Corsair

Milpitas, California, United States (On-Site)
2 Months ago
Gather AI - Senior Applications Engineer, Embedded Systems

Gather AI

Hyderabad, Telangana, India (On-Site)
1 Month ago
Thunder cloud studio - UE4 GAME DEVELOPER

Thunder cloud studio

Hanoi, Vietnam (On-Site)
1 Year ago
hogarth - Graphic Production Artist

hogarth

Sunnyvale, California, United States (Hybrid)
1 Month ago
Macrometa - IT Administrator

Macrometa

(Remote)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Cubic corporation - Test Automation Leader

Cubic corporation

Hyderabad, Telangana, India (On-Site)
1 Month ago
Riot Games - Manager, Software Engineering - Infrastructure / Cloud Foundations

Riot Games

Los Angeles, California, United States (On-Site)
5 Months ago
Barracuda Networks Inc - Senior Software Engineer

Barracuda Networks Inc

Bengaluru, Karnataka, India (Hybrid)
5 Months ago
shyft labs - Full Stack Engineer

shyft labs

Atlanta, Georgia, United States (Hybrid)
1 Month ago
SingleStore - SDET

SingleStore

Pune, Maharashtra, India (Remote)
1 Month ago
nyan heroes - Senior Gameplay Engineer

nyan heroes

(Remote)
2 Months ago
bazzar voice  - Senior Talent Acquisition (TA) Partner

bazzar voice

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Nagarro - Associate Staff Engineer, Frontend React

Nagarro

Bengaluru, Karnataka, India (On-Site)
8 Months ago
Tide - Senior Engineer, Python (Data & AI)

Tide

Romania (Hybrid)
2 Months ago
Epic Games - Senior Data Analyst, Unreal Engine & Creator Products

Epic Games

Cary, North Carolina, United States (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Noida, Uttar Pradesh, India

PhonePe - Manager, Payments Compliance

PhonePe

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Comscore - Software Engineer

Comscore

Pune, Maharashtra, India (Hybrid)
1 Month ago
Alp Consulting  - Application Developer Content & Courseware Design

Alp Consulting

Bengaluru, Karnataka, India (On-Site)
1 Year ago
Assystems - BIM 4D/5D & Digital Twin Specialist

Assystems

Gurugram, Haryana, India (On-Site)
8 Months ago
Definitive HC India - Software Engineer-C#

Definitive HC India

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Adobe - Campaign Manager

Adobe

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Ubisoft - 3D Programmer

Ubisoft

Pune, Maharashtra, India (Hybrid)
1 Month ago
NopAdvance LLP - : Software Tester

NopAdvance LLP

Surat, Gujarat, India (On-Site)
8 Months ago
AeroSpike - Principal Product Manager, Kubernetes

AeroSpike

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - IN_Senior Associate _Data  Migration_Enterprise_Apps_SAP_Kolkata

PwC

Kolkata, West Bengal, India (On-Site)
9 Months ago

Get notifed when new similar jobs are uploaded

Similar Category Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Clearwater Analytics (NYSE: CWAN) is the leading provider of web-based investment portfolio accounting, reporting, and reconciliation services for institutional investors at thousands of organizations.


Clearwater aggregates, reconciles, and reports on more than $6.4 trillion in assets across thousands of accounts daily. Our clients include corporate treasuries, insurance companies, investment managers, banks, governments, and other institutional investors both in the United States and worldwide.


For more than a decade, we have leveraged web-based software and world-class client service to help clients such as American Family Insurance, Arch Capital, C.V. Starr & Co., Cisco, Facebook, Oracle, Selective Insurance, Sirius Group, Sompo International, Starbucks, WellCare Health Plans, Wilton Re, and many others, streamline their investment and accounting operations. Clearwater also works with hundreds of custodians, investment managers, dealers/brokers, and electronic trading portals who offer Clearwater to their many clients.


With global headquarters in Boise, Idaho, and offices in Edinburgh, Frankfurt, London, New Delhi, New York, Paris, Seattle, Singapore, and Washington D.C., Clearwater sets the new global standard for investment portfolio reporting.

New York, United States (On-Site)

Chicago, Illinois, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

New York, United States (On-Site)

Boise, Idaho, United States (On-Site)

Boise, Idaho, United States (On-Site)

Mumbai, Maharashtra, India (On-Site)

Bengaluru, Karnataka, India (On-Site)

New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Clearwater Analytics

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug