Technical Program Manager

What you’ll do

Program and project execution

• Gather requirements from internal stakeholders, collaboratively propose solutions, and coordinate with internal and external resources on execution.
• Communicate project and program timelines, progress, cost, risks, and dependencies.

Data Annotation / Labeling

• Strategically partner with cross-functional stakeholders to understand objectives and requirements and translate that into specifications for data annotation.
• Layout a roadmap for annotation timelines, including feedback on what’s realistic and what’s aspirational.
• Develop an annotation program to meet our capability requirements, including but not limited to clear instructions to a team of annotators, identify where the gaps in the instructions may be, and perform quality checks on annotated data to ensure accuracy and consistency, making necessary corrections and improvements.
• Maintain transcription and annotation guidelines for internal and / or external labelers.
• Implement annotation quality assurance methods
• Supervise the data labeling process with internal or external resources as needed—ensuring accuracy and consistency.
• Manage, train, and evaluate labellers, providing feedback and ensuring high-quality annotations.
• Build and maintain relationships with data vendors
• Meet deadlines and productivity targets while maintaining high accuracy rates.
• Identify opportunities for process improvement and automation in data annotation workflows to increase productivity and quality.

What we are looking for

• 2+ years of experience as a Technical Program Manager, Data or equivalent role
• 5+ years combined experience in Project Management or Technical roles
• Strong understanding of AI/ML training data concepts, requirements & lifecycle
• Strong project management skills with the ability to prioritize competing demands
• Experience working closely with the business & internal engineering teams
• Experience working with vendors and negotiating engagement terms
• Experience with Jira is a plus
• Experience with spreadsheets and SQL.
• Experience in a remote environment a plus
• Experience in data annotation or related roles, with a strong understanding of annotation techniques and best practices.
• Familiarity with annotation tools/software. Bonus if you have built and designed custom annotation tools.
• Strong analytical and problem-solving skills with an eye for detail.
• Strong communication and collaboration skills, with the ability to work effectively in a team environment.
• Deeply wants to understand the task, capabilities of the model, and success criteria of the task, partnering closely with Research and Product to understand end-user needs.
• Should be able to take a higher-level description of the dataset and convert that into specific requirements.