Machine Learning Engineering, Training Data Infrastructure

2 Months ago • 3 Years + • Data Analyst • Undisclosed

Job Summary

Job Description

Captions seeks a Machine Learning Engineer to build and optimize training data infrastructure for massive video and multimodal datasets. Responsibilities include developing performant pipelines, designing distributed systems, creating efficient data loading systems, and implementing comprehensive telemetry. The role also involves building core data processing systems, robust validation systems, and efficient storage patterns for high-dimensional data. This is an early-stage role with significant impact on model training for millions of users, requiring strong Python, distributed computing, and video/image data processing skills.
Must have:
  • 3+ years ML infrastructure or large-scale data engineering experience
  • Strong Python and distributed computing skills
  • Video/image data pre-processing and feature engineering expertise
  • Knowledge of ML workflows, model training, and data loading systems
  • Performance optimization and system scaling experience
Good to have:
  • Experience with cluster management and distributed computing
  • MLOps and infrastructure monitoring background
  • Experience building reliable, large-scale data processing systems
Perks:
  • Comprehensive medical, dental, and vision plans
  • 401K with employer match
  • Commuter Benefits
  • Catered lunch
  • Dinner stipend
  • Doordash DashPass subscription
  • Health & Wellness Perks
  • Team offsites
  • Generous PTO policy and flexible WFH days

Job Details

Captions is the leading video AI company, building the future of video creation. Over 10 million creators and businesses have used Captions to create videos for social media, marketing, sales, and more. We're on a mission to serve the next billion.

We are a rapidly growing team of ambitious, experienced, and devoted engineers, researchers, designers, marketers, and operators based in NYC. You'll join an early team and have an outsized impact on the product and the company's culture.

We’re very fortunate to have some the best investors and entrepreneurs backing us, including Index Ventures (Series C lead), Kleiner Perkins (Series B lead), Sequoia Capital (Series A and Seed co-lead), Andreessen Horowitz (Series A and Seed co-lead), Uncommon Projects, Kevin Systrom, Mike Krieger, Lenny Rachitsky, Antoine Martin, Julie Zhuo, Ben Rubin, Jaren Glover, SVAngel, 20VC, Ludlow Ventures, Chapter One, and more.

Check out our latest financing milestone and some other coverage:

The Information: 50 Most Promising Startups

Fast Company: Next Big Things in Tech

The New York Times: When A.I. Bridged a Language Gap, They Fell in Love

Business Insider: 34 most promising AI startups

Time: The Best Inventions of 2024

** Please note that all of our roles will require you to be in-person at our NYC HQ (located in Union Square) **

Overview

Captions seeks an exceptional Machine Learning Engineer to drive innovation in training data infrastructure. You'll conduct research on and develop sophisticated distributed training workflows and optimized data processing systems for massive video and multimodal datasets. Beyond pure performance, you'll develop deep insight into our data to maximize training effectiveness. As an early member of our ML Research team, you'll build foundational systems that directly impact our ability to train models powering video and multimodal creation for millions of users.

Key Responsibilities

Infrastructure Development:

  • Build performant pipelines for processing video and multimodal training data at scale

  • Design distributed systems that scale seamlessly with our rapidly growing video and multimodal datasets

  • Create efficient data loading systems optimized for GPU training throughput

  • Implement comprehensive telemetry for video processing and training pipelines

Core Systems Development:

  • Create foundation data processing systems that intelligently cache and reuse expensive computations across the training pipeline

  • Build robust data validation and quality measurement systems for video and multimodal content

  • Design systems for data versioning and reproducing complex multimodal training runs

  • Develop efficient storage and compute patterns for high-dimensional data and learned representations

System Optimization:

  • Own and improve end-to-end training pipeline performance

  • Build systems for efficient storage and retrieval of video training data

  • Build frameworks for systematic data and model quality improvement

  • Develop infrastructure supporting fast research iteration cycles

  • Build tools and systems for deep understanding of our training data characteristics

Research & Product Impact:

  • Build infrastructure enabling rapid testing of research hypotheses

  • Create systems for incorporating user feedback into training workflows

  • Design measurement frameworks that connect model improvements to user outcomes

  • Enable systematic experimentation with direct user feedback loops

Preferred Qualifications:

Technical Background:

  • Bachelor's or Master's degree in Computer Science, Machine Learning, or related field

  • 3+ years experience in ML infrastructure development or large-scale data engineering

  • Strong programming skills, particularly in Python and distributed computing frameworks

  • Expertise in building and optimizing high-throughput data pipelines

  • Proven experience with video/image data pre-processing and feature engineering

  • Deep knowledge of machine learning workflows, including model training and data loading systems

System Development:

  • Track record in performance optimization and system scaling

  • Experience with cluster management and distributed computing

  • Background in MLOps and infrastructure monitoring

  • Demonstrated ability to build reliable, large-scale data processing systems

Engineering Approach:

  • Love tackling hard technical problems head-on

  • Take ownership while knowing when to loop in teammates

  • Get excited about improving system performance

  • Want to work directly with researchers and engineers who are equally passionate about building great systems

Team Culture

You'll work directly alongside our research and engineering teams in our NYC office. We've intentionally built a culture where infrastructure and data work is highly valued - your success will be measured by the reliability and performance of our systems, not by your ability to navigate politics. We're a team that loves diving deep into technical problems and emerging with practical solutions.

Our team values:

  • Quick iteration and practical solutions

  • Open discussion of technical approaches

  • Direct access to decision makers

  • Regular sharing of learnings, results, and iterative work

Benefits:

  • Comprehensive medical, dental, and vision plans

  • 401K with employer match

  • Commuter Benefits

  • Catered lunch multiple days per week

  • Dinner stipend every night if you're working late and want a bite!

  • Doordash DashPass subscription

  • Health & Wellness Perks (Talkspace, Kindbody, One Medical subscription, HealthAdvocate, Teladoc)

  • Multiple team offsites per year with team events every month

  • Generous PTO policy and flexible WFH days

Captions provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Please note benefits apply to full time employees only.

Compensation Range: $170K - $250K

Similar Jobs

WEKA - Data Scientist

WEKA

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
ByteDance - Senior Algorithm Engineer, Trust and Safety

ByteDance

Singapore (On-Site)
3 Months ago
Luxoft - Senior/Technical Lead Automated testing Python + Manual

Luxoft

Ukrainka, Kyiv Oblast, Ukraine (Remote)
2 Months ago
Fabric - Applied Researcher, Cryptography Proof Systems

Fabric

Los Angeles, California, United States (Remote)
3 Months ago
Google - Backend Software Engineer, Insights, Benchmarks, and Narratives

Google

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
Fortis Games - Market Intelligence Specialist

Fortis Games

Canada (On-Site)
2 Months ago
PwC - IN-Senior Associate_ Control Testing _Internal Audit Services _Advisory_Pune

PwC

Pune, Maharashtra, India (On-Site)
3 Months ago
PwC - IN-Senior Associate_Full Stack Developer_Data and Analytics_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Interactive Brokers - Data Engineer

Interactive Brokers

Budapest, Hungary (Hybrid)
3 Months ago
Swiss Re - Associate Credit PTF Data Scientist

Swiss Re

Bengaluru, Karnataka, India (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Zoox - Backend Software Engineering Internship/Co-op

Zoox

Foster City, California, United States (On-Site)
3 Months ago
Luxoft - Junior Axiom Developer

Luxoft

New Delhi, Delhi, India (Remote)
2 Months ago
Rivos - CPU Physical Design - Full Time

Rivos

Hsinchu, Hsinchu City, Taiwan (Hybrid)
3 Months ago
Sporty Group - Software Engineering Team Lead- LatAm

Sporty Group

(Remote)
2 Months ago
Keywords Studios (Player Support) - Test Specialist

Keywords Studios (Player Support)

Fort Collins, Colorado, United States (On-Site)
5 Months ago
BlackBerry QNX - BlackBerry QNX- Embedded Technical Writer (Automotive/General Embedded)

BlackBerry QNX

Telangana, India (On-Site)
3 Months ago
Dream Game Studios - SDE - 1 - DevOps

Dream Game Studios

Mumbai, Maharashtra, India (On-Site)
3 Months ago
ByteDance - Software Engineer (Payment Network) - Global Payment - Singapore

ByteDance

Singapore (On-Site)
2 Months ago
Britive - SENIOR QA ENGINEER

Britive

Bengaluru, Karnataka, India (Remote)
2 Months ago
Interactive Brokers - Senior Python Developer – Compliance Technology

Interactive Brokers

Mumbai, Maharashtra, India (Hybrid)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in New York, New York, United States

Matic Robots - Electrical Design Engineer

Matic Robots

Mountain View, California, United States (On-Site)
3 Months ago
Intel Corporation - Manufacturing and Process Development - Intern, Bachelors

Intel Corporation

Folsom, California, United States (On-Site)
2 Months ago
LeoVegas - Business Data Analyst - Sportsbook

LeoVegas

Denver, Colorado, United States (On-Site)
3 Months ago
Alpha Sense - Global Payroll Manager

Alpha Sense

United States (Remote)
2 Months ago
Buckman - Solutions Engineer - Pulp

Buckman

Memphis, Tennessee, United States (On-Site)
2 Months ago
Penumbra - Sr. Manager SAP Operations

Penumbra

Alameda, California, United States (Hybrid)
3 Months ago
The Walt Disney Company - Disney Store Stock Associate (Seasonal)

The Walt Disney Company

Grapevine, Texas, United States (On-Site)
2 Months ago
Wolters Kluwer - Manager, Product Software Engineering | AI

Wolters Kluwer

Coppell, Texas, United States (Hybrid)
3 Months ago
Brillio - Client Partner

Brillio

San Ramon, California, United States (Hybrid)
3 Months ago
Axinous - Director, Technology Alliances

Axinous

San Jose, California, United States (Hybrid)
2 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

Publicis Groupe - Integrated Data Specialist

Publicis Groupe

Makati, Metro Manila, Philippines (On_site)
1 Month ago
GoTo Group - Senior Data Analyst

GoTo Group

Jakarta, Jakarta, Indonesia (On-Site)
2 Months ago
Starkflow - MIS Executive

Starkflow

Gurugram, Haryana, India (On-Site)
2 Months ago
Riot Games - Insights Analyst III

Riot Games

Singapore (On-Site)
4 Months ago
ByteDance - Data Analyst - AI Innovation Business

ByteDance

Singapore (On-Site)
2 Months ago
Luxoft - Experienced Technical BI/DWH Business Investigator (Main Hub)

Luxoft

Bucharest, Bucharest, Romania (On-Site)
2 Months ago
Playrix - Senior Data Analyst (Game)

Playrix

Almaty, Almaty Region, Kazakhstan (Remote)
3 Months ago
PwC - Senior Associate _Senior Azure Data Engineer_D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Aristocrat Gaming - Business Analyst

Aristocrat Gaming

Sofia, Sofia City Province, Bulgaria (Hybrid)
2 Months ago
DraftKings - Senior Data Engineer, Snowflake

DraftKings

Boston, Massachusetts, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

New York, New York, United States (On-Site)

San Francisco, California, United States (On-Site)

New York, New York, United States (On-Site)

View All Jobs

Get notified when new jobs are added by Captions

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug