Data Engineer, Data Engineering

3 Months ago • All levels • Monetization

Job Summary

Job Description

Video Infrastructure is a world-leading video platform that provides multi-media storage, delivery, transcoding, and streaming services. We are building the next generation video processing platform and the largest live streaming network, which provides excellent experiences for billions of users around the world. Popular video products of TikTok and its affiliates are all empowered by our cutting-edge cloud technologies. Working in this team, you will have the opportunity to tackle challenges of large-scale networks all over the world, while leveraging your expertise in coding, algorithms, complexity analysis, and large-scale system design. **Responsibilities:** 1. Craft optimal data processing architecture and systems for new data and ETL pipelines. 2. Design, build, and maintain efficient and reliable data pipelines to move and transform data (both large and small amounts). 3. Drive internal process improvements and automate manual processes for data quality and SLA management. 4. Work with different cross-functional partners including CDN, Video Understanding, Video Transcoding, Live Streaming, and Real-Time Communication.
Must have:
  • Bachelor's degree in Computer Science or a related technical background involving software/system engineering
  • Good programming experience with at least one of the following languages: C, C++, Java, Python, or Go.
  • Experience in custom ETL/data pipeline design, implementation, and maintenance.
  • Experience with data processing software (Hadoop, Spark, Pig, Hive) and algorithms (MapReduce, Flume).
  • Experience in troubleshooting in large scale distributed systems.

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. Team Introduction Video Infrastructure is a world-leading video platform that provides multi-media storage, delivery, transcoding, and streaming services. We are building the next generation video processing platform and the largest live streaming network, which provides excellent experiences for billions of users around the world. Popular video products of TikTok and its affiliates are all empowered by our cutting-edge cloud technologies. Working in this team, you will have the opportunity to tackle challenges of large-scale networks all over the world, while leveraging your expertise in coding, algorithms, complexity analysis, and large-scale system design. What you will be doing: 1. Craft optimal data processing architecture and systems for new data and ETL pipelines. 2. Design, build, and maintain efficient and reliable data pipelines to move and transform data (both large and small amounts). 3. Drive internal process improvements and automate manual processes for data quality and SLA management. 4. Work with different cross-functional partners including CDN, Video Understanding, Video Transcoding, Live Streaming, and Real-Time Communication.
Qualifications
Minimum Qualifications 1. Bachelor's degree in Computer Science or a related technical background involving software/system engineering, or equivalent working experience. 2. Good programming experience with at least one of the following languages: C, C++, Java, Python, or Go. 3. Experience in custom ETL/data pipeline design, implementation, and maintenance. 4. Experience with data processing software (Hadoop, Spark, Pig, Hive) and algorithms (MapReduce, Flume). 5. Experience in troubleshooting in large scale distributed systems. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. #LI-IL2

Similar Jobs

PwC - Senior Associate | Devops SRE

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
paypal - Senior Software Engineer

paypal

Scottsdale, Arizona, United States (Hybrid)
4 Months ago
Trek - Aerodynamics Engineer

Trek

Waterloo, Wisconsin, United States (Hybrid)
4 Months ago
PhonePe - Architect - Data Platform

PhonePe

Bengaluru, Karnataka, India (On-Site)
3 Months ago
ness - Software Testing Engineer

ness

Slovakia (Hybrid)
3 Months ago
ByteDance - Quality Assurance Engineer Graduate (Global E-commerce-US) - 2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Software Development Engineer Intern in Test (Global E-commerce-Quality Assurance) - 2025 Start (BS/MS)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Research Scientist Intern (Responsible AI) - 2025 Summer/Fall (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Sales Intern: SMB/CA Agency - 2024 Start - Japan

ByteDance

Tokyo, Japan (On-Site)
3 Months ago
ByteDance - Software Engineer, Cross Platform

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Passive Logic - Autonomous Systems Software Engineer

Passive Logic

Salt Lake City, Utah, United States (On-Site)
4 Months ago
Google - Software Engineering Manager II, Serverless Container Management

Google

San Francisco, California, United States (On-Site)
3 Months ago
Jam Studio - Minecraft Java Developer

Jam Studio

(Remote)
3 Months ago
Google - Engineering Manager, AI Innovation and Research

Google

Bengaluru, Karnataka, India (On-Site)
3 Months ago
myGwork - LGBTQ+ Business Community - Senior Data Engineer - (Data pipelines, Payload design) Java, Apache Beam/Flink, Kafka, and SQL

myGwork - LGBTQ+ Business Community

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Google - Cloud Engineer, AI/ML, Professional Services, Google Cloud

Google

Atlanta, Georgia, United States (On-Site)
3 Months ago
Sumo Logic - Senior Site Reliability Engineer - Core

Sumo Logic

Bengaluru, Karnataka, India (On-Site)
5 Months ago
ION - Senior Java Developer - Italy

ION

Turin, Piedmont, Italy (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

Razer - Product Management Intern

Razer

Singapore (On-Site)
4 Months ago
Razer - Digital Marketing Manager

Razer

Singapore (On-Site)
4 Months ago
ByteDance - Backend Engineer (Model Inference) Intern - 2025 Start

ByteDance

Singapore (On-Site)
4 Months ago
Appier - SEA HR Business Parnter (part-time)

Appier

Singapore (On-Site)
3 Months ago
ByteDance - Software Engineer, Video-On-Demand

ByteDance

Singapore (On-Site)
3 Months ago
PwC - Risk Services - AI Strategy Lead

PwC

Singapore (On-Site)
4 Months ago
Interactive Brokers - Fraud Prevention Analyst

Interactive Brokers

Singapore (Hybrid)
4 Months ago
PwC - Corporate Tax Advisory - Senior Manager

PwC

Singapore (On-Site)
4 Months ago
Razer - Senior Manager, Information Security

Razer

Singapore (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Monetization Jobs

ByteDance - Machine Learning Scientist Graduate, Scaling AI for Biology (AML - AI-for-Science) - 2025 Start (PhD)

ByteDance

Seattle, Washington, United States (On-Site)
4 Months ago
Netflix - Product Manager, Ads Platform (Revenue Planning & Inventory Management)

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
ByteDance - Software Engineer, UI Framework

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Content Marketing Manager - CapCut

ByteDance

Los Angeles, California, United States (On-Site)
3 Months ago
ByteDance - Technology Strategy Expert

ByteDance

Singapore (On-Site)
3 Months ago
Xsolla - VP of Engineering

Xsolla

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)
6 Months ago
Unity - Growth Partnerships Manager (Supply/Unified)

Unity

Beijing, Beijing, China (On-Site)
3 Months ago
ByteDance - Student Researcher (Doubao (Seed) - Music Foundation Model) - 2024 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
ByteDance - Product Leader - Product Strategy - Singapore

ByteDance

Singapore (On-Site)
3 Months ago
ByteDance - AI Research Engineer, Large Language Model (Applied Machine Learning)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

Taguig, Metro Manila, Philippines (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug