Senior Lead Data Engineer - R01554949

13 Minutes ago • All levels • Data Analysis

Job Summary

Job Description

We are seeking a skilled Senior Lead Data Engineer to support the migration of existing Python applications and scripts from an external vendor’s environment into an internal platform. The role involves analyzing, refactoring, enhancing, and optimizing code for maintainability, ensuring compatibility and performance. Responsibilities include developing automated tests, collaborating with stakeholders, documenting processes, and troubleshooting issues, focusing on data engineering, ETL, and microservices.
Must have:
  • Analyze, migrate, refactor, and integrate Python codebases.
  • Enhance and extend existing code functionality.
  • Re-architect components to align with internal standards.
  • Develop automated tests for migrated and enhanced code.
  • Collaborate with engineers, analysts, and stakeholders.
  • Document migration processes and system changes.
  • Troubleshoot, debug, and resolve issues.
  • Proficiency in Python (3.x) and data manipulation libraries like pandas.
  • Strong knowledge of data engineering, ETL, microservices, APIs, and databases.
  • Experience with code migration, integration, and re-platforming projects.
  • Familiarity with software design patterns, modularization, and refactoring.
  • Experience with Git, CI/CD pipelines, and testing frameworks.
  • Strong debugging, problem-solving, and analytical skills.
  • Excellent communication and documentation abilities.
Good to have:
  • Experience with cloud platforms (AWS, Azure, or GCP).
  • Familiarity with containerization (Docker, Kubernetes).
  • Prior experience collaborating with external vendors or in a migration/enhancement-focused role.

Job Details

About:

is one of the fastest growing digital technology service providers and a partner of choice for many Fortune 1000 companies seeking to turn disruption into a competitive advantage through innovative digital adoption. , renowned for its world-class professionals, referred to as "Brillians", distinguishes itself through their capacity to seamlessly integrate cutting-edge digital and design thinking skills with an unwavering dedication to client satisfaction.

takes pride in its status as an employer of choice, consistently attracting the most exceptional and talented individuals due to its unwavering emphasis on contemporary, groundbreaking technologies, and exclusive digital projects. 's relentless commitment to providing an exceptional experience to its Brillians and nurturing their full potential consistently garners them the Great Place to Work® certification year after year.

Primary Skills

  • CI/CD Pipeline, React (React Context / Redux), Django / Flask / FastAPI, Docker, CSS/SCSS/LESS, PyTest, PostgreSQL / MongoDB / Redis, Kubernetes, REST API / GraphQL

Specialization

  • Python Fullstack with Microservices: Software Development Lead

Job requirements

  • Onsite: 5 days

Overview

  • We are seeking a skilled Python Developer to support the migration of existing applications and scripts from an external vendor’s environment into our internal platform. The ideal candidate will have strong Python development experience, a solid understanding of software architecture, and the ability to refactor, enhance, and optimize code for long-term maintainability.

Responsibilities

  • Analyze existing vendor-provided Python codebases and related assets.
  • Migrate, refactor, and integrate code into the internal platform while ensuring compatibility and performance.
  • Enhance and extend existing code functionality based on evolving business user requirements.
  • Re-architect components as needed to align with internal coding standards, best practices, and infrastructure.
  • Develop automated tests to validate migrated and enhanced code functionality.
  • Collaborate with platform engineers, business analysts, and stakeholders to capture requirements and deliver solutions.
  • Document migration processes, enhancements, system changes, and updated workflows.
  • Troubleshoot, debug, and resolve issues during migration, enhancement, and post-deployment.
  • Identify opportunities for automation, performance improvements, and process efficiency.

Qualifications

  • Strong proficiency in Python (3.x) and related frameworks/libraries.
  • Strong proficiency in pandas, nympy, sqlalchemy, tenacity, polars, dask, pyspark, etc.
  • Strong knowledge of data engineering, ETL processes, or microservices.
  • Strong knowledge of APIs, databases (SQL/NoSQL), and data pipelines.
  • Experience with code migration, integration, or re-platforming projects.
  • Proven ability to enhance and extend existing code to meet business requirements.
  • Familiarity with software design patterns, modularization, and refactoring best practices.
  • Experience with version control (Git), CI/CD pipelines, and testing frameworks (pytest/unittest).
  • Strong debugging, problem-solving, and analytical skills.
  • Excellent communication and documentation abilities.
  • Preferred Skills
  • Experience with cloud platforms (AWS, Azure, or GCP).
  • Familiarity with containerization (Docker, Kubernetes).
  • Prior experience collaborating with external vendors or in a migration/enhancement-focused role.

Similar Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Similar Skill Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Jobs in Santa Ana, California, United States

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

About The Company

Santa Ana, California, United States (On-Site)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Princeton, New Jersey, United States (On-Site)

San Ramon, California, United States (Hybrid)

Arlington, Texas, United States (Hybrid)

New York, New York, United States (On-Site)

Phoenix, Arizona, United States (Remote)

Hyderabad, Telangana, India (Hybrid)

View All Jobs

Get notified when new jobs are added by Brillio

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug
Contact Us
hello@outscal.com
Made in INDIA 💛💙