Tech Lead Data Engineer

2 Days ago • 6-9 Years • Data Analyst • $233,958 PA - $410,000 PA

Job Summary

Job Description

ByteDance seeks Tech Lead Data Engineers to guide the design, implementation, and maintenance of scalable big data systems. Responsibilities include crafting optimal data processing architectures, analyzing and improving real-time data pipelines, building efficient data transformations, integrating new technologies, enhancing data reliability, and establishing engineering best practices. The role involves defining technical roadmaps, setting tech stacks and standards, and collaborating with product and business teams to define data strategies. Candidates must have significant experience with ETL applications (SQL, C#, Python), big data technologies (Spark, Hadoop, Hive), version control (Git), and automation (Shell scripting).
Must have:
  • ETL application development (SQL, C#, Python)
  • Big data processing (Spark, Hadoop, Hive)
  • Data pipeline building
  • Git & JIRA experience
  • Shell scripting for automation
Perks:
  • Medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Paid time off
  • Wellbeing benefits

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey! Responsibilities Provide technical guidance to Data Engineering team in designing, implementing, and maintaining reliable, scalable, robust, and extensible big data systems that will be used to make smarter business decisions to support business growth. Craft optimal data processing architecture and systems for new data and ETL pipelines. Analyze and improve real-time communication data pipeline quality, such as data optimize, service stabilities, and high availability. Design, build, and maintain data transformations efficiently and reliably for designated purposes (e.g. reporting, growth analysis, multi-dimensional analysis). Investigate and integrate emerging big data technologies into existing requirements. Recommend different ways to constantly improve data reliability and quality. Establish solid design and best engineering practice for engineers as well as non-technical people. Define and drive mid/long term technical roadmap based on the key opportunities in business growth and industry technology trends. Define and establish team's tech stack and standards, drive for engineering excellence and best practices. Work with product and business to define data strategy and drive for product based and scalable data solutions to empower business.
Qualifications
Qualifications Must have a Master's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 3 years of related work experience; OR a Bachelor's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 6 years of post-bachelor's, progressive related work experience. Of the required experience, must have 3 years of experience in each of the following: Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, or Python; Transforming big data using Spark and M/R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop; Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports; Performing code changes and reviews using Git version control and performing workflow management using JIRA; and Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script. Travel Requirement: Domestic and/or international travel up to 15% required. Type: Full time, 40 hours/week Location: San Jose, CA Salary Range: $233958 - $410000 per year To Apply, click the apply button below. Contact lpresumes@bytedance.com if you have difficulty submitting resume through the website. ByteDance Inc. is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Bytedance, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at lpresumes@bytedance.com. #LI-DNI #IND-DNI
Job Information
【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $233958 - $410000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Similar Jobs

Autodesk - Principal Site Reliability Engineer - Database Administration

Autodesk

San Francisco, California, United States (On-Site)
4 Months ago
Stonewall Collision & Auto Painting - Sr. Software Engineer

Stonewall Collision & Auto Painting

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
CloudLinux - Lead SDET/QA Automation Engineer at CloudLinux (worldwide remote, work anywhere)

CloudLinux

Ljubljana, Ljubljana, Slovenia (Remote)
3 Months ago
Steer Studios - Senior IT Administrator

Steer Studios

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
7 Months ago
Aristocrat Gaming - Class 2 Business Analyst

Aristocrat Gaming

Franklin, Tennessee, United States (Hybrid)
1 Week ago
N-iX - Senior/Lead Product Owner

N-iX

Ukraine (Remote)
3 Days ago
The Walt Disney Company - Walt Disney World Environmental Science/Engineering Intern

The Walt Disney Company

Kissimmee, Florida, United States (On-Site)
2 Days ago
PwC - Senior Associate_GCP Data Engineer_Data and  Analytics_Advisory_Bengaluru

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Saama Technologies,  Inc  - Data Engineer

Saama Technologies, Inc

Pune, Maharashtra, India (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Riot Games - Principal Software Engineer - VALORANT, Foundations, Build Platforms

Riot Games

Los Angeles, California, United States (On-Site)
4 Months ago
Luxoft - Murex Datamart Reporting Consultant

Luxoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Witzeal Technologies - DevOps Engineer

Witzeal Technologies

Gurugram, Haryana, India (On-Site)
5 Months ago
ByteDance - Site Reliability Engineer (Traffic), Infrastructure Engineering

ByteDance

Singapore (On-Site)
3 Months ago
Dezerv - DevOps Engineer

Dezerv

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Luxoft - Orchestrade - Azure infrastructure cloud Senior engineer

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago
Meta - Software Engineer, Machine Learning

Meta

London, England, United Kingdom (On-Site)
2 Months ago
Normalyze - Lead DevOps Engineer - Enterprise Cybersecurity - SaaS - Bay Area, CA

Normalyze

California, United States (Remote)
3 Months ago
Streamhub - Senior Data Quality Automation Engineer

Streamhub

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

Meta - Research Scientist Intern, Language and Multimodal Research for GenAI (PhD)

Meta

Menlo Park, California, United States (On-Site)
2 Months ago
Mattel  Inc  - American Girl Retail Security (Part-Time)

Mattel Inc

Illinois, United States (On-Site)
1 Month ago
Life church - Associate LifeGroups/LifeMissions Pastor

Life church

United States (On-Site)
3 Months ago
Unity - Gestionnaire sénior, Paie Amérique | Senior Manager, Payroll Americas

Unity

Bellevue, Washington, United States (On-Site)
2 Months ago
Netflix - Distributed Systems Engineer (L6) - Data Discovery & Governance

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
PTW - Video Game Tester

PTW

Charleston, South Carolina, United States (On-Site)
2 Months ago
Lionsgate Games - Manager, Programming & Operations, International SVOD Channels

Lionsgate Games

Santa Monica, California, United States (On-Site)
1 Month ago
Luxoft - Audio Drivers Developer

Luxoft

Poland, Ohio, United States (Remote)
2 Months ago
Paypal - Software Engineer- AI Data Governance

Paypal

San Jose, California, United States (Hybrid)
4 Months ago
Microsoft - Research Intern - Data Systems

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Attentive - Engineering Manager, Data Engineering

Attentive

United States (Remote)
3 Months ago
CloudHire - Senior Data Analyst

CloudHire

Mumbai, Maharashtra, India (Remote)
3 Months ago
Matific - Senior Data Engineer

Matific

Colombo, Western Province, Sri Lanka (On-Site)
4 Days ago
RoofStack - Business Intelligence Engineer

RoofStack

İstanbul, İstanbul, Türkiye (Hybrid)
3 Weeks ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

Toronto, Ontario, Canada (On-Site)
4 Weeks ago
Epic Games - Senior Marketing Performance Manager

Epic Games

United States (On-Site)
4 Weeks ago
Gameplay Galaxy - Game Data Analyst

Gameplay Galaxy

British Virgin Islands (Remote)
4 Months ago
Dream Sports - SDE 2 - ML & Data Platform

Dream Sports

Mumbai, Maharashtra, India (On-Site)
4 Months ago
PlayStation Global - Finance Data Analyst (Contract)

PlayStation Global

United States (Remote)
1 Month ago
Hitachi - Lead Analytics Consultant

Hitachi

London, England, United Kingdom (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug