Generative AI Labeling and Quality Lead

Job Description

A problem isn't truly solved until it's solved for all. That's why Googlers build products that help create opportunities for everyone, whether down the street or across the globe. As a Program Manager at Google, you'll lead complex, multi-disciplinary projects from start to finish - working with stakeholders to plan requirements, manage project schedules, identify risks, and communicate clearly with cross-functional partners across the company. Your projects will often span offices, time zones, and hemispheres. It's your job to coordinate the players and keep them up to date on progress and deadlines.

As the GenAI Labeling and Quality Lead, you will partner with cross-functional stakeholders to help build up the GenAI based capabilities for the various internal and externally facing tools. You will partner closely with Product and Engineering teams to identify and define requirements for efficient tooling and automation to streamline labeling and Quality Assurance processes. You will develop GenAI capabilities and processes within YouTube's Global vendor operations team.

At YouTube, we believe that everyone deserves to have a voice, and that the world is a better place when we listen, share, and build community through our stories. We work together to give everyone the power to share their story, explore what they love, and connect with one another in the process. Working at the intersection of cutting-edge technology and boundless creativity, we move at the speed of culture with a shared goal to show people the world. We explore new ideas, solve real problems, and have fun - and we do it all together.

Resonsibilities:
• Partner closely with Tech teams to develop frameworks for collecting high quality labels for training and testing GenAI models for various use cases within the creator, consumer organizations.
• Oversee extended workforce for labeling operations team in the global vendor organization.
• Ensure efficient workflows and policies are in place that result in the delivery of a high volume of quality labels meeting customer needs on a continuous basis.
• Oversee all aspects of vendor relationships and partner organizations responsible for ground truth labeling including training, and policy.
• Utilize data and analysis to identify opportunities for improvement in operational workflows and processes.

Qualifications:

Minimum qualifications:
• Bachelor's degree in Business or related field, or equivalent practical experience.
• 10 years of experience developing operational process solutions, and working with cross-functional teams.
• 10 years of experience analyzing data and generating business insights.

Preferred qualifications:
• 10 years of experience in operations management, management consulting or related fields.
• Experience leading teams responsible for data annotation or related functions.
• Experience managing globally distributed workforce vendors, and ability to define and implement complex operational workflows that are data driven.
• Experience building and reporting on meaningful business metrics, with excellent data analysis and influencing skills.
• Understanding of ML training of Perception models and associated inputs (e.g., calibration), data infrastructure, and visualization tooling.

Jobcode: Reference SBJ-j65em2-13-58-216-183-42 in your application.