Algorithm Engineer - Audio Understanding

3 Months ago • All levels • Research & Development

Job Summary

Job Description

ByteDance is seeking an Algorithm Engineer - Audio Understanding to join its speech team. The ideal candidate will be a highly skilled individual with experience in machine learning and deep learning, particularly in areas like speech recognition, speech translation, and multimodal understanding. The role involves conducting cutting-edge research and development in speech/audio foundation models, contributing to the advancement of audio understanding, and driving the practical application of these technologies in various ByteDance products, including TikTok. Responsibilities include developing and implementing speech/audio models for closed-captions, voice dubbing, and video understanding.
Must have:
  • Master's or PhD in CS, Math, Engineering or related field
  • Experience in ML/DL, including speech recognition, translation, and self-supervised learning
  • Strong coding skills in C/C++ and Python
  • Ability to work collaboratively in a fast-paced environment
Good to have:
  • Publications in top-tier ML/DL venues
  • Deep understanding of Large Language models
  • Familiar with distributed computing and large-scale model training
  • Familiar with deep learning frameworks like TensorFlow and PyTorch
  • Familiar with engineering principles and best practices

Job Details

Responsibilities
ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About the Team The speech team's mission is to empower content understanding, interaction and creation across TikTok and other products using speech & audio related technologies. We focus on cutting-edge R&D in areas like speech & audio, music processing, natural language understanding and multimodal deep learning. We are looking for top talents to work on these exciting technologies, integrate them into various TikTok and other products and ultimately bring joy to our global user base! Responsibilities • Conduct cutting-edge research and development in speech/audio foundation models • Contribute to the advancement of audio understanding, including multilingual speech recognition, speech translation, multimodal understanding and etc. • Focus on and drive the practical application of relevant technologies in business scenarios, including but not limited to closed-captions, voice dubbing, video understanding.
Qualifications
Qualifications • Master's or PhD in computer science, mathematics, engineering or related field • Experience in one or more areas of machine learning and deep learning, including but not limited to: - Automatic Speech Recognition - Automatic Speech Translation - Speech/audio self-supervised learning and foundation models - Speaker recognition and verification - Speech emotion recognition - Multimodal foundation models - Large Language Model pretraining and finetuning Preferred Qualifications • Publications in top-tier ML/DL venues such as NeurIPS, ICLR, ICML, AAAI and speech venues such as ICASSP, ASRU, Interspeech • Deep understanding of Large Language models • Familiar with distributed computing and large scale model training • Familiar with deep learning frameworks such as Tensorflow and Pytorch. • Familiar with engineering principles and best practices. • Highly competent in algorithms and programming; Strong coding skills in C/C++ and Python. • Ability to work collaboratively in a fast-paced, multi-functional environments ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Similar Jobs

ByteDance - Research Scientist, Foundation Model, Speech Understanding

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Paypal - Sr. Staff Machine Learning Scientist

Paypal

San Jose, California, United States (Hybrid)
4 Months ago
Microsoft - Research Intern - AI Frontiers - Foundation Model Evaluation and Understanding

Microsoft

Redmond, Washington, United States (On-Site)
1 Month ago
Microsoft - Senior Software Engineer - AI/ML

Microsoft

Dublin, County Dublin, Ireland (On-Site)
1 Month ago
Krafton  - [Finance Div.] IR Specialist (5년 ~ 10년)

Krafton

Seoul, South Korea (On-Site)
2 Months ago
NVIDIA - System Software Engineering Intern - 2025

NVIDIA

Taipei City, Taiwan (On-Site)
1 Month ago
ARF Design   - RTL Design Verification

ARF Design

Hyderabad, Telangana, India (On-Site)
8 Months ago
NVIDIA - Senior Mixed Signal Circuit Design Engineer

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
1 Month ago
Evolution - C++ Developer (Video)

Evolution

Riga, Latvia (On-Site)
1 Month ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

NVIDIA - Senior Developer Relations Manager - Manufacturing

NVIDIA

Tokyo, Japan (On-Site)
1 Month ago
Match Group - Sr. Software Engineer, Generative AI

Match Group

Palo Alto, California, United States (Hybrid)
4 Months ago
Netflix - Research Engineer L4/L5 -LLMs for Search, Recommendations, and Personalization

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
Google - Software Engineer III, Machine Learning, Google Ads

Google

Mountain View, California, United States (On-Site)
3 Months ago
Ubisoft - Senior Machine Learning Engineer H/F/NB

Ubisoft

Paris, Île-de-France, France (On-Site)
8 Months ago
ION - Data Engineer, Italy

ION

Italy (Hybrid)
4 Months ago
Attentive - Senior Machine Learning Engineer

Attentive

New York, New York, United States (Hybrid)
4 Months ago
ByteDance - Software Engineer, ML System Scheduling

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Tango Eye - Sr. Computer Vision Developer

Tango Eye

Chennai, Tamil Nadu, India (On-Site)
6 Months ago
Stylumia - Senior Machine Learning Engineer - Time Series & Computer Vision

Stylumia

Bengaluru, Karnataka, India (Hybrid)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Singapore

OKX - Senior Product Manager, Trading Bot

OKX

Singapore, Singapore (On-Site)
4 Months ago
ByteDance - Site Reliability Engineer, Traffic Platform - 2025 Start

ByteDance

Singapore (On-Site)
3 Months ago
ByteDance - LLM Red-teaming Operation, Analyst

ByteDance

Singapore (On-Site)
3 Months ago
PwC - Risk Services - Communication and Marketing Specialist

PwC

Singapore (On-Site)
4 Months ago
PwC - General Assurance – Senior Associate

PwC

Singapore (On-Site)
4 Months ago
ByteDance - Tech Lead Manager - Fullstack-Customer Service Platform-SG

ByteDance

Singapore (On-Site)
3 Months ago
ByteDance - Experienced Enterprise Internal Control Partner

ByteDance

Singapore (On-Site)
3 Months ago
ByteDance - Tech Lead Manager - Global Payment - Singapore

ByteDance

Singapore (On-Site)
1 Month ago
ByteDance - Software Engineer (Compliance) - Global Payment - Singapore

ByteDance

Singapore (On-Site)
3 Months ago
PwC - Oracle ERP Senior Associate

PwC

Singapore (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Research & Development Jobs

Krafton  - Compensation Specialist

Krafton

Seoul, South Korea (On-Site)
1 Week ago
ByteDance - Student Researcher (Foundation Models - Reasoning, Planning & Agent - Doubao (Seed)) - 2025 Start (PhD)

ByteDance

San Jose, California, United States (On-Site)
3 Months ago
Mulya Technologies - Logic MicroArchitect:

Mulya Technologies

Bengaluru, Karnataka, India (Hybrid)
4 Months ago
Hologate gmbh - R&D Software Engineer (f/d/m)

Hologate gmbh

Munich, Bavaria, Germany (On-Site)
3 Months ago
Corsair - Sr. Mechanical Engineer

Corsair

Taipei City, Taiwan (On-Site)
1 Day ago
ByteDance - Research Scientist/Engineer - Multimodal Interaction & World Model

ByteDance

Singapore (On-Site)
3 Months ago
Riot Games - Influencer Strategist III - 2XKO

Riot Games

Los Angeles, California, United States (On-Site)
2 Months ago
NXP - Software Engineering Intern, Linux Kernel/BSP

NXP

Bucharest, Bucharest, Romania (On-Site)
5 Months ago
Cirrus Logic - Summer Intern, Design Verification

Cirrus Logic

Chandler, Arizona, United States (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

About The Company

Where imagination meets innovation, delivering limitless gaming experiences.

Taguig, Metro Manila, Philippines (On-Site)

Singapore (On-Site)

Dubai, Dubai, United Arab Emirates (On-Site)

State Of São Paulo, Brazil (On-Site)

Seattle, Washington, United States (On-Site)

San Jose, California, United States (On-Site)

San Jose, California, United States (On-Site)

View All Jobs

Get notified when new jobs are added by ByteDance

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug