Tech Lead Data Engineer

2 Months ago • 6-9 Years • Data Analyst • $233,958 PA - $410,000 PA

Job Summary

Job Description

ByteDance seeks Tech Lead Data Engineers to guide the design, implementation, and maintenance of scalable big data systems. Responsibilities include crafting optimal data processing architectures, analyzing and improving real-time data pipelines, building efficient data transformations, integrating new technologies, enhancing data reliability, and establishing engineering best practices. The role involves defining technical roadmaps, setting tech stacks and standards, and collaborating with product and business teams to define data strategies. Candidates must have significant experience with ETL applications (SQL, C#, Python), big data technologies (Spark, Hadoop, Hive), version control (Git), and automation (Shell scripting).
Must have:
  • ETL application development (SQL, C#, Python)
  • Big data processing (Spark, Hadoop, Hive)
  • Data pipeline building
  • Git & JIRA experience
  • Shell scripting for automation
Perks:
  • Medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Paid time off
  • Wellbeing benefits

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey! Responsibilities Provide technical guidance to Data Engineering team in designing, implementing, and maintaining reliable, scalable, robust, and extensible big data systems that will be used to make smarter business decisions to support business growth. Craft optimal data processing architecture and systems for new data and ETL pipelines. Analyze and improve real-time communication data pipeline quality, such as data optimize, service stabilities, and high availability. Design, build, and maintain data transformations efficiently and reliably for designated purposes (e.g. reporting, growth analysis, multi-dimensional analysis). Investigate and integrate emerging big data technologies into existing requirements. Recommend different ways to constantly improve data reliability and quality. Establish solid design and best engineering practice for engineers as well as non-technical people. Define and drive mid/long term technical roadmap based on the key opportunities in business growth and industry technology trends. Define and establish team's tech stack and standards, drive for engineering excellence and best practices. Work with product and business to define data strategy and drive for product based and scalable data solutions to empower business.
Qualifications
Qualifications Must have a Master's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 3 years of related work experience; OR a Bachelor's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 6 years of post-bachelor's, progressive related work experience. Of the required experience, must have 3 years of experience in each of the following: Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, or Python; Transforming big data using Spark and M/R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop; Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports; Performing code changes and reviews using Git version control and performing workflow management using JIRA; and Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script. Travel Requirement: Domestic and/or international travel up to 15% required. Type: Full time, 40 hours/week Location: San Jose, CA Salary Range: $233958 - $410000 per year To Apply, click the apply button below. Contact lpresumes@bytedance.com if you have difficulty submitting resume through the website. ByteDance Inc. is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Bytedance, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at lpresumes@bytedance.com. #LI-DNI #IND-DNI
Job Information
【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $233958 - $410000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Similar Jobs

Epic Games - Senior DevOps Programmer

Epic Games

United States (On-Site)
2 Months ago
Playtech - Release Engineer

Playtech

Kyiv, Kyiv City, Ukraine (On-Site)
1 Month ago
NVIDIA - Senior HPC Technical Support Engineer – Ethernet

NVIDIA

Westford, Massachusetts, United States (On-Site)
1 Month ago
Rivos - DFT Engineer

Rivos

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Offworld - DevOps Engineer

Offworld

New Westminster, British Columbia, Canada (On-Site)
2 Months ago
PwC - Senior Associate_Snowflake Developer_Data & Analytics_Advisory_PAN  India

PwC

Kolkata, West Bengal, India (On-Site)
6 Months ago
Easygo - Lead Data Analyst - Kick

Easygo

Melbourne, Victoria, Australia (On-Site)
1 Month ago
Ubisoft - Legal Counsel Data Protection Assistant - Internship

Ubisoft

Paris, Île-de-France, France (On-Site)
1 Month ago
Scientific Games  - Business Intelligence Analyst

Scientific Games

Solon, Ohio, United States (On-Site)
2 Months ago
PwC - Senior Associate_Azure Data Enginer_Advisory Corporate_Advisory_Bangalore Millenia

PwC

Bengaluru, Karnataka, India (On-Site)
6 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Nielsen Holdings - Senior Software Engineer - Bigdata ( Java / Scala / Python  & Spark , SQL , AWS).

Nielsen Holdings

Bengaluru, Karnataka, India (Hybrid)
6 Months ago
Offworld - DevOps Engineer

Offworld

New Westminster, British Columbia, Canada (On-Site)
1 Month ago
Astek - BSP Audio Engineer

Astek

Guangzhou, Guangdong Province, China (On-Site)
9 Months ago
ByteDance - Site Reliability Engineer (Cloud Native Platform) - Traffic Infrastructure

ByteDance

San Jose, California, United States (On-Site)
2 Months ago
Samsung Semiconductor - Staff DevOps Engineer

Samsung Semiconductor

San Jose, California, United States (Hybrid)
3 Months ago
Fluence - Controls Software Engineer-II(m/f/d)

Fluence

Erlangen, Bavaria, Germany (Hybrid)
6 Months ago
ByteDance - Site Reliability Engineer, Traffic Platform

ByteDance

Singapore (On-Site)
3 Months ago
Aviatrix - Staff QA Test Engineer - Routing, Performance, Scalability

Aviatrix

Bengaluru, Karnataka, India (Hybrid)
8 Months ago
Tencent - Backend Developer

Tencent

(On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

The Walt Disney Company - Business Analyst

The Walt Disney Company

Bay Lake, Florida, United States (On-Site)
1 Month ago
Patreon - Staff Product Designer, Podcast Tools

Patreon

San Francisco, California, United States (Hybrid)
1 Month ago
Samsung Semiconductor - Senior Engineer, AI

Samsung Semiconductor

San Jose, California, United States (Hybrid)
6 Months ago
VX Media - Social Media Intern

VX Media

New York, New York, United States (On-Site)
1 Month ago
ION - Principal Business Consultant - Endur

ION

Houston, Texas, United States (On-Site)
6 Months ago
The Walt Disney Company - Decision Science Undergraduate Intern

The Walt Disney Company

Lake Buena Vista, Florida, United States (On-Site)
1 Month ago
Nintendo - UI Artist III

Nintendo

Redmond, Washington, United States (Hybrid)
3 Months ago
The Walt Disney Company - Linear Associate Account Manager

The Walt Disney Company

New York, New York, United States (On-Site)
1 Month ago
Epic Games - Principal Programmer, Horde

Epic Games

United States (On-Site)
2 Months ago
Fluence - Sales Engineer/Senior Sales Engineer - Battery Energy Storage

Fluence

Houston, Texas, United States (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

QUANTIC DREAM - Data Analyst (F/M/NB)

QUANTIC DREAM

Paris, Île-de-France, France (Hybrid)
5 Months ago
JustPlay - Senior Marketing Data Analyst

JustPlay

(Remote)
1 Month ago
Internkaksha IT Solutions - Data Analyst

Internkaksha IT Solutions

India (Remote)
7 Months ago
PlayStation Global - Senior Manager, Data Product Management

PlayStation Global

San Diego, California, United States (On-Site)
1 Month ago
Voodoo - Senior Data Scientist - Freelance (3 months renewable)

Voodoo

Paris, Île-de-France, France (Hybrid)
2 Months ago
Onward Search - Data Analyst II

Onward Search

San Jose, California, United States (On-Site)
3 Months ago
Tencent - Fund Investment Analyst/Sr. Analyst

Tencent

Beijing, Beijing, China (On-Site)
5 Months ago
Hashlist - Principal Data Engineer

Hashlist

Chennai, Tamil Nadu, India (Hybrid)
5 Months ago
Sandsoft Games - Game Data Analyst

Sandsoft Games

Riyadh, Riyadh Province, Saudi Arabia (On-Site)
2 Months ago
Framestore - Lead DataOps and Render-Support

Framestore

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Dublin, County Dublin, Ireland (On-Site)

London, England, United Kingdom (On-Site)

Bangkok, Bangkok, Thailand (On-Site)

San Jose, California, United States (On-Site)

State Of São Paulo, Brazil (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug