Tech Lead Data Engineer

2 Weeks ago • 6-9 Years • Data Analyst • $233,958 PA - $410,000 PA

Job Summary

Job Description

ByteDance seeks Tech Lead Data Engineers to guide the design, implementation, and maintenance of scalable big data systems. Responsibilities include crafting optimal data processing architectures, analyzing and improving real-time data pipelines, building efficient data transformations, integrating new technologies, enhancing data reliability, and establishing engineering best practices. The role involves defining technical roadmaps, setting tech stacks and standards, and collaborating with product and business teams to define data strategies. Candidates must have significant experience with ETL applications (SQL, C#, Python), big data technologies (Spark, Hadoop, Hive), version control (Git), and automation (Shell scripting).
Must have:
  • ETL application development (SQL, C#, Python)
  • Big data processing (Spark, Hadoop, Hive)
  • Data pipeline building
  • Git & JIRA experience
  • Shell scripting for automation
Perks:
  • Medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Paid time off
  • Wellbeing benefits

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey! Responsibilities Provide technical guidance to Data Engineering team in designing, implementing, and maintaining reliable, scalable, robust, and extensible big data systems that will be used to make smarter business decisions to support business growth. Craft optimal data processing architecture and systems for new data and ETL pipelines. Analyze and improve real-time communication data pipeline quality, such as data optimize, service stabilities, and high availability. Design, build, and maintain data transformations efficiently and reliably for designated purposes (e.g. reporting, growth analysis, multi-dimensional analysis). Investigate and integrate emerging big data technologies into existing requirements. Recommend different ways to constantly improve data reliability and quality. Establish solid design and best engineering practice for engineers as well as non-technical people. Define and drive mid/long term technical roadmap based on the key opportunities in business growth and industry technology trends. Define and establish team's tech stack and standards, drive for engineering excellence and best practices. Work with product and business to define data strategy and drive for product based and scalable data solutions to empower business.
Qualifications
Qualifications Must have a Master's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 3 years of related work experience; OR a Bachelor's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 6 years of post-bachelor's, progressive related work experience. Of the required experience, must have 3 years of experience in each of the following: Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, or Python; Transforming big data using Spark and M/R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop; Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports; Performing code changes and reviews using Git version control and performing workflow management using JIRA; and Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script. Travel Requirement: Domestic and/or international travel up to 15% required. Type: Full time, 40 hours/week Location: San Jose, CA Salary Range: $233958 - $410000 per year To Apply, click the apply button below. Contact lpresumes@bytedance.com if you have difficulty submitting resume through the website. ByteDance Inc. is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Bytedance, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at lpresumes@bytedance.com. #LI-DNI #IND-DNI
Job Information
【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $233958 - $410000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Similar Jobs

NVIDIA - Verification Engineer

NVIDIA

Bengaluru, Karnataka, India (On-Site)
1 Month ago
NVIDIA - Senior SWQA Test Development Engineer, LLM Benchmarking

NVIDIA

Shanghai, Shanghai, China (Hybrid)
1 Month ago
ByteDance - Software Engineer Intern (Doubao (Seed) - Machine Learning System) - 2025 Summer (MS)

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Take-Two Interactive - Senior Systems Engineer

Take-Two Interactive

Bengaluru, Karnataka, India (On-Site)
1 Month ago
The Embassy - Pipeline Developer

The Embassy

Vancouver, British Columbia, Canada (Hybrid)
17 Hours ago
Illumina - Staff Data Engineer

Illumina

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
PwC - Guidewire DataHub Senior Associate (Sr. Analyst)

PwC

Bengaluru, Karnataka, India (Remote)
1 Month ago
Plarium - Data Engineer

Plarium

Herzliya, Tel Aviv District, Israel (Hybrid)
6 Months ago
Zeta - Senior Business Intelligence Engineer

Zeta

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Samsung Semiconductor - Intern, Foundry Market Intelligence

Samsung Semiconductor

San Jose, California, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Enphase Energy - DevOps Engineer

Enphase Energy

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Axon - Senior Security Engineer

Axon

Scottsdale, Arizona, United States (Hybrid)
2 Months ago
Google - Technical Solutions Engineer, Google Distributed Cloud (Airgapped)

Google

Berlin, Berlin, Germany (On-Site)
3 Months ago
Feld Entertainment - Monster Jam Truck Body Technician

Feld Entertainment

Ellenton, Florida, United States (On-Site)
4 Months ago
Cold Symmetry - Character Animator

Cold Symmetry

(Remote)
1 Month ago
Warner Bros Discovery - Sr. Manager, Integrations

Warner Bros Discovery

Mexico City, Mexico City, Mexico (On-Site)
2 Months ago
Samsung Semiconductor - NVMe Test Engineer (Contractor)

Samsung Semiconductor

San Jose, California, United States (Hybrid)
2 Weeks ago
NVIDIA - GenAI and MLOps Intern - Spring 2025

NVIDIA

Taipei City, Taiwan (On-Site)
3 Weeks ago
Interactive Brokers - Automation Database Developer

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
4 Months ago
HiLabs - Sr. DevOps Engineer

HiLabs

Pune, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Alconost - Talents Pool

Alconost

United States (Remote)
1 Month ago
Riot Games - Senior Software Engineer, VALORANT - Store

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
PlayStation Global - QA Lead (Contract)

PlayStation Global

Los Angeles, California, United States (On-Site)
1 Month ago
Scanline VFX - Creative Editor

Scanline VFX

Los Angeles, California, United States (Hybrid)
4 Months ago
Next Level Business Services - JavaScript Developer with Full stack Experience

Next Level Business Services

Dallas, Texas, United States (On-Site)
4 Months ago
Tencent - Security Software Engineer I

Tencent

Palo Alto, California, United States (On-Site)
2 Months ago
Singularity 6 - QA Application Drop Box

Singularity 6

United States (Hybrid)
3 Months ago
Logitech - Sr.Test Engineer

Logitech

Washington, District Of Columbia, United States (Hybrid)
4 Months ago
Nagarro - Associate Staff Engineer, Python

Nagarro

New York, New York, United States (On-Site)
4 Months ago
Google - Account Strategist, Mid-Market Sales, Google Customer Solutions

Google

San Francisco, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Go Fund Me - Staff Data Scientist

Go Fund Me

San Francisco, California, United States (Hybrid)
3 Months ago
VGW - Head of Data Engineering

VGW

Sydney, New South Wales, Australia (On-Site)
3 Weeks ago
Netflix - Data Scientist (L4) - Content DSE

Netflix

Los Angeles, California, United States (On-Site)
3 Months ago
N-iX - Senior Manual QA Engineer (Big Data)

N-iX

Ukraine (Remote)
12 Hours ago
Warner Bros Discovery - Corporate Data Architect

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
3 Months ago
Tangelo Games - Data & Analytics Engineer

Tangelo Games

Barcelona, Catalonia, Spain (Hybrid)
2 Weeks ago
Demonware - Data Engineering Co-op

Demonware

Vancouver, British Columbia, Canada (Hybrid)
3 Weeks ago
Trek - Business Analyst

Trek

Haryana, India (On-Site)
2 Months ago
Warner Bros Discovery - Business Lead in Customer Data Project

Warner Bros Discovery

Masovian Voivodeship, Poland (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Taguig, Metro Manila, Philippines (On-Site)

Singapore (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

State Of São Paulo, Brazil (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug