Tech Lead Data Engineer

1 Week ago • 6-9 Years • Data Analyst • $233,958 PA - $410,000 PA

Job Summary

Job Description

ByteDance seeks Tech Lead Data Engineers to guide the design, implementation, and maintenance of scalable big data systems. Responsibilities include crafting optimal data processing architectures, analyzing and improving real-time data pipelines, building efficient data transformations, integrating new technologies, enhancing data reliability, and establishing engineering best practices. The role involves defining technical roadmaps, setting tech stacks and standards, and collaborating with product and business teams to define data strategies. Candidates must have significant experience with ETL applications (SQL, C#, Python), big data technologies (Spark, Hadoop, Hive), version control (Git), and automation (Shell scripting).
Must have:
  • ETL application development (SQL, C#, Python)
  • Big data processing (Spark, Hadoop, Hive)
  • Data pipeline building
  • Git & JIRA experience
  • Shell scripting for automation
Perks:
  • Medical, dental, and vision insurance
  • 401(k) savings plan with company match
  • Paid parental leave
  • Paid time off
  • Wellbeing benefits

Job Details

Responsibilities
About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team Our team plays a crucial role in ensuring the company’s success. We seek people who are willing to learn and put in the effort to solve problems. Our challenges are not your regular day-to-day problems - you’ll be part of a team that’s developing new solutions to new challenges. It’s working fast, at scale, and we’re making a difference. We are looking for talents to join us on this exciting journey! Responsibilities Provide technical guidance to Data Engineering team in designing, implementing, and maintaining reliable, scalable, robust, and extensible big data systems that will be used to make smarter business decisions to support business growth. Craft optimal data processing architecture and systems for new data and ETL pipelines. Analyze and improve real-time communication data pipeline quality, such as data optimize, service stabilities, and high availability. Design, build, and maintain data transformations efficiently and reliably for designated purposes (e.g. reporting, growth analysis, multi-dimensional analysis). Investigate and integrate emerging big data technologies into existing requirements. Recommend different ways to constantly improve data reliability and quality. Establish solid design and best engineering practice for engineers as well as non-technical people. Define and drive mid/long term technical roadmap based on the key opportunities in business growth and industry technology trends. Define and establish team's tech stack and standards, drive for engineering excellence and best practices. Work with product and business to define data strategy and drive for product based and scalable data solutions to empower business.
Qualifications
Qualifications Must have a Master's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 3 years of related work experience; OR a Bachelor's degree in Computer Science, Engineering (any), Information Technology, Machine Learning, Data Science, Business Analytics, Operations Research, Statistics, Mathematics, or a related quantitative field, and 6 years of post-bachelor's, progressive related work experience. Of the required experience, must have 3 years of experience in each of the following: Performing data analysis, design, and development of highly efficient, reliable, and scalable ETL applications using SQL, C#, or Python; Transforming big data using Spark and M/R (map reduce) for data insights, reporting, and analytics, and transferring data to Hadoop Distributed File System (HDFS) using Sqoop; Building data pipelines and implementing partitioning and bucketing in hive to organize and query data, and performing query tuning to improve the speed of daily user analytics and reports; Performing code changes and reviews using Git version control and performing workflow management using JIRA; and Automating system maintenance and deployment tasks by creating and scheduling cron jobs using Shell script. Travel Requirement: Domestic and/or international travel up to 15% required. Type: Full time, 40 hours/week Location: San Jose, CA Salary Range: $233958 - $410000 per year To Apply, click the apply button below. Contact lpresumes@bytedance.com if you have difficulty submitting resume through the website. ByteDance Inc. is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At Bytedance, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too. ByteDance Inc. is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at lpresumes@bytedance.com. #LI-DNI #IND-DNI
Job Information
【For Pay Transparency】Compensation Description (Annually)

The base salary range for this position in the selected city is $233958 - $410000 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and

3. Exercising sound judgment.

Similar Jobs

Interactive Brokers - Technical Operations Specialist (TOPS)

Interactive Brokers

Greenwich, Connecticut, United States (Hybrid)
4 Months ago
LeoVegas - Infrastructure Lead

LeoVegas

Stockholm, Stockholm County, Sweden (Hybrid)
1 Month ago
ByteDance - Senior Site Reliability Engineer, ML System

ByteDance

Seattle, Washington, United States (On-Site)
3 Months ago
Plume Design,  Inc  - Senior Security Engineer

Plume Design, Inc

Hyderabad, Telangana, India (On-Site)
3 Months ago
Take-Two Interactive - Senior Systems Engineer

Take-Two Interactive

Bengaluru, Karnataka, India (On-Site)
1 Month ago
PwC - Senior Auditors for Data and  Business Intelligence Analyst

PwC

Phnom Penh, Phnom Penh, Cambodia (On-Site)
4 Months ago
Sinch - Manager, Mediation Data Engineering

Sinch

Chicago, Illinois, United States (Hybrid)
2 Months ago
Epic Games - Analytics Lead (Gameplay)

Epic Games

Toronto, Ontario, Canada (On-Site)
1 Month ago
Blazesoft - System Economy Manager (Gaming)

Blazesoft

Vaughan, Ontario, Canada (On-Site)
3 Weeks ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Fractal - DevOps - Lead

Fractal

Mumbai, Maharashtra, India (On-Site)
3 Months ago
Global Payments  Inc  - Senior Site Reliability Engineer

Global Payments Inc

Pune, Maharashtra, India (On-Site)
4 Months ago
ION - Senior Linux Systems Administrator - Somerset, NJ

ION

Clifton, New Jersey, United States (Hybrid)
4 Months ago
ByteDance - Site Reliability Engineer, Traffic Platform

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Paytm - DevOps - Lead DevOps

Paytm

Noida, Uttar Pradesh, India (Hybrid)
3 Months ago
ION - Technical Support Analyst, Jersey City - 9781

ION

Jersey City, New Jersey, United States (On-Site)
4 Months ago
Tencent - Senior Backend Developer

Tencent

Shenzhen, Guangdong Province, China (On-Site)
1 Month ago
PhonePe - PSE - Data Engineering

PhonePe

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Hogarth - Comp Artist - Buenos Aires Based

Hogarth

Buenos Aires, Buenos Aires, Argentina (On-Site)
5 Months ago
Paypal - Principal Machine Learning Engineer - AI

Paypal

San Jose, California, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Jobs in San Jose, California, United States

ION - Debtwire Latin America Primary Bond Market Reporter

ION

New York, New York, United States (On-Site)
3 Weeks ago
Trek - Future Store Manager - Washington State

Trek

Tacoma, Washington, United States (On-Site)
4 Months ago
PTW - 3D Environment Artist - Talent Pool

PTW

United States (Remote)
3 Weeks ago
Meta - Software Engineer, Product

Meta

San Francisco, California, United States (Remote)
3 Months ago
Games For Love - Project Manager for League of Pros Cause Jam

Games For Love

Washington, United States (Remote)
2 Months ago
Epic Games - Animation Lead

Epic Games

Cary, North Carolina, United States (On-Site)
7 Months ago
The Walt Disney Company - Sr. Hulu Strategic Operations Manager

The Walt Disney Company

Glendale, California, United States (On-Site)
2 Months ago
Ziff Davis - Senior Software Engineer, Backend - Lose It!

Ziff Davis

United States (On-Site)
3 Months ago
ByteDance - Server System Performance Engineer (Multiple Positions)

ByteDance

San Jose, California, United States (On-Site)
1 Month ago
Microsoft - Research Intern - Model Inference

Microsoft

Redmond, Washington, United States (On-Site)
4 Weeks ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Twitch - Senior Data Scientist - ML

Twitch

New York, New York, United States (On-Site)
1 Month ago
ByteDance - LLM Coding Trainer - Specialist

ByteDance

Singapore (On-Site)
3 Months ago
Baldor Technologies  - RevOps Analyst

Baldor Technologies

Mumbai, Maharashtra, India (On-Site)
4 Months ago
Plummy games - Data Analyst

Plummy games

Tallinn, Harju County, Estonia (Remote)
3 Months ago
DEVOTEAM - SAP DATA Migration (w/m/d)

DEVOTEAM

Frankfurt, Hessen, Germany (Remote)
3 Months ago
Revolgy - Data Engineer

Revolgy

(Remote)
3 Weeks ago
SLAY - Marketing Data Analyst

SLAY

Berlin, Berlin, Germany (On-Site)
2 Months ago
Netradyne - Staff Data Scientist

Netradyne

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Microsoft - Sr. Solution Area Specialist - Data & AI

Microsoft

Gurugram, Haryana, India (On-Site)
1 Month ago
GoTo Group - FP&A - Data Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Kuala Lumpur, Federal Territory Of Kuala Lumpur, Malaysia (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

Seattle, Washington, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug