LLM Performance Operation, Specialist

About ByteDance Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content. Why Join Us Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us. About The Team: Join our LLM Global Data Team as a core member and be at the heart of our innovative operations. You'll gain invaluable experience in deciphering and enhancing the performance of LLMs across various metrics. Your Role Will Involve: 1. Acquire hands-on experience in measuring the performance of LLM and related products, including the design and execution of tests. 2. Assist in the development of automated evaluation and testing processes. 3. Work closely with product managers and analysts, engaging with external experts and partners to bolster our performance analysis initiatives.

Minimum Qualifications: - Strong command of English, with outstanding writing and analytical skills. - Proficiency in critical thinking and establishing frameworks for performance assessment. - Intelligent and meticulous individuals adept at content comparison and analysis within set frameworks. - Ability to meet tight deadlines while maintaining a keen eye for detail. - A profound interest in the world of Large Language Models (LLMs). Preferred Qualifications: - Prior experience in evaluating NLP models and search product performance is highly desirable. Please note: Candidates will be required to complete a written assessment before proceeding to the interview stage. ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.