Lead Data Engineer

undefined ago • 8-12 Years • Data Analysis

Job Summary

Job Description

The Data engineer is responsible for managing and operating upon Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI. The engineer will work closely with the customer and team to manage and operate cloud data platform.
Must have:
  • Manage and operate Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI.
  • Resolve pipeline issues and proactively monitor sensitive batches.
  • Perform RCA and retrospection of issues, documenting defects.
  • Design, build, test, and deploy fixes to non-production environments.
  • Work with customers to deploy fixes on production.
  • Perform cost/performance optimization, audit, and security.
  • Create and update Knowledgebase/runbooks.
  • Watch configuration changes to batches and infrastructure.
  • Lead communication and act as POC for customers.
  • Handle communication, escalation, and issue isolation.
  • Coordinate with off-site resources and level set expectations.
  • Align resources for on-demand changes.
  • Handle user requests and update runbooks.
  • Manage incidents and problems, perform root cause analysis.
  • Develop preventive measures and recommendations.
  • Read and write SQL and stored procedures.
  • Configure, manage, and troubleshoot data analytics solutions.
  • Possess general analytical and problem-solving skills.
  • Exhibit excellent written and verbal communication skills.
  • Communicate technical information clearly.
  • Work successfully and promote inclusiveness in groups.
  • Research issues, determine root cause, and implement resolution.
  • Prioritize issues and multi-task effectively.
  • Bachelor’s degree in computer science or related field.
  • 8-12 years of hands-on experience in configuring and managing Azure data analytics solutions.
Good to have:
  • Experience with Azure environment is desired.
Perks:
  • Schedule flexibility to include working a weekend day regularly and holidays as required by the business for 24/7 operations.
  • Occasional travel, less than 10%.

Job Details

Work Timings - Rotational Shifts (IST)

Work Location - Remote

Job Description Summary

The Data engineer is responsible for managing and operating upon Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI. The engineer will work closely with the customer and team to manage and operate cloud data platform.

Job Description

Leads operational coverage:

  • Resolving pipeline issues / Proactive monitoring for sensitive batches / RCA and retrospection of issues and documenting defects.
  • Design, build, test and deploy fixes to non-production environment for Customer testing. Work with Customer to deploy fixes on production upon receiving Customer acceptance of fix.
  • Cost / Performance optimization and Audit / Security including any associated infrastructure changes
  • Knowledge Management: Create/update Knopwledgebase/ runbooks as needed.
  • Governance: Watch all the configuration changes to batches and infrastructure (cloud platform) along with mapping it with proper documentation and aligning resources.
  • Communication: Lead and act as a POC for customer from on-site, handling communication, escalation, isolating issues and coordinating with off-site resources while level setting expectation across stakeholders
  • Change Management: Align resources for on-demand changes and coordinate with stakeholders as required
  • Request Management: Handle user requests – if the request is not runbook-based create a new KB or update runbook accordingly
  • Incident Management and Problem Management, Root cause Analysis, coming up with preventive measures and recommendations such as enhancing monitoring or systematic changes as needed.
  • KNOWLEDGE/SKILLS/ABILITY: Good hands on Tableau, Tableau bridge server, Databricks, Dbt, SSRS, SSIS, AWS DWS, AWS APP Flow, PowerBI. Ability to read and write sql and stored procedures. Good hands on experience in configuring, managing and troubleshooting along with general analytical and problem solving skills. Excellent written and verbal communication skills. Ability to communicate technical info and ideas so others will understand. Ability to successfully work and promote inclusiveness in small groups.
  • JOB COMPLEXITY: This role requires extensive problem solving skills and the ability to research an issue, determine the root cause, and implement the resolution; research of various sources such as microsoft documentation that may be required to identify and resolve issues. Must have the ability to prioritize issues and multi-task.
  • SUPERVISION: Works under moderate supervision.
  • EXPERIENCE/EDUCATION: Requires a Bachelor’s degree in computer science or other related field plus 8-12 years of hands-on experience in configuring and mangaing azure data analytics solution. Experience with Azure environment is desired.
  • PHYSICAL DEMANDS: General office environment. No special physical demands required. Schedule flexibility to include working a weekend day regularly and holidays as required by the business for 24/7 operations. Occasional travel, less than 10%.
  • POLICY COMPLIANCE: Responsible for adhering to company security policies and procedures and any other relevant policies and standards

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in India

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!