Senior Technical Program Manager Data Labeling, Data and Machine Learning

Remote, USA Full-time
About the position As a Senior Technical Program Manager: Data Labeling at Material Security, you'll be part of a team of experienced, world-class engineers, working to protect our users and their privacy (e.g., inboxes from breaches, targeted phishing, fraud, and lateral account takeover). Your mission is to develop high quality data sets that will be used to create ML/AI models that detect security relevant data and behavior (phishing emails, sensitive data in email and drive). Responsibilities You will lead cross-functional initiatives to build, scale, and optimize data annotation programs critical to AI model performance. You'll own program delivery across internal teams, vendor partners, and ML stakeholders to ensure high-quality labeled datasets are delivered on time and at scale. This role is both strategic and execution-driven: you'll define roadmaps, manage SLAs, create scalable processes, and resolve bottlenecks to ensure the labeling engine is efficient, quality-controlled, and model-aligned. Responsibilities • Define and drive end-to-end execution of large-scale annotation programs across multiple data types. • Collaborate with ML, product, and data operations teams to scope and prioritize labeling needs. • Own vendor engagement: onboarding, SLA management, training, and quality reviews. • Build feedback loops between annotators and model performance to inform labeling strategies. • Create dashboards and reporting mechanisms to track labeling velocity, quality, and cost. • Lead initiatives to improve labeling efficiency through tooling enhancements and process automation. • Be the voice of labeling in cross-functional forums-translating model needs into operational plans. • Manage and mentor a team of trained threat analysts who conduct our labeling. • Conduct analysis of the quality of the labeling and for insights into how our detections can be improved. • Hire and train new or replacement threat analysts Requirements • 5+ years of program management experience, ideally in ML ops, data labeling, or AI infrastructure. • Proven track record building and managing remote labeling teams. • Strong understanding of ML lifecycle stages and the importance of annotated data quality. • Experience defining SOPs, audit mechanisms, and workflows for scalable data labeling. • Proficient in project management tools such as Jira, Asana, or Linear for program tracking • A deep understanding on ML Operations labelling tools and experience building or maintaining an annotation tool. • Strong analytical and communication skills; ability to synthesise feedback from ML, ops, and product stakeholders and also analyzed data to spot trends in our labeling or detection quality. • Understanding of data privacy and security standards and how they can be followed in a labeling program. Nice-to-haves • Exposure to LLMs, foundation models, or active learning-based data curation. • Familiarity with annotation for multimodal inputs (e.g., Image, Text, Documents, OCR based forms etc) • Knowledge of quality scoring frameworks, inter-annotator agreement (IAA), or QA loop design. • The ability to develop and maintain labeling quality metrics and analytic insights and report on those to senior management • Technical background (e.g., in ML, data science, or engineering) is a plus. Apply tot his job
Apply Now

Similar Jobs

Director / Sr Program Manager, AI Accelerator

Remote, USA Full-time

Computer Vision/Deep Learning Scientist fully remote

Remote, USA Full-time

Malware Analyst San Antonio, TX

Remote, USA Full-time

Senior Analyst, Mandiant Threat Intelligence Services

Remote, USA Full-time

Workforce Management Analyst

Remote, USA Full-time

Senior Workforce Management Analyst

Remote, USA Full-time

Content Management Analyst - Medical Education and Practice

Remote, USA Full-time

Case Management Analyst

Remote, USA Full-time

Remote Management Consultant; Port St. Lucie

Remote, USA Full-time

[Remote] Managing Consultant - Oracle Cloud Payroll (Remote)

Remote, USA Full-time

Leasing Appointment Scheduler

Remote, USA Full-time

Field Marketing Manager - Tennessee - Remote in Nashville, TN in SuperBook

Remote, USA Full-time

Experienced Live Chat Customer Service Representative - Remote Customer Support and Sales for Blithequark's Growing Customer Base

Remote, USA Full-time

Experienced Part-Time Customer Service Executive – Flexible Hours & Comprehensive Benefits at Blithequark

Remote, USA Full-time

**Experienced Customer Service Representative – Inbound Pharmacy Service Team – San Juan, Puerto Rico**

Remote, USA Full-time

Experienced Retail Customer Advisor – Delivering Exceptional Customer Experiences through Product Knowledge and Personalized Support

Remote, USA Full-time

Data Warehouse Expert

Remote, USA Full-time

Experienced Remote Chat Support Agent for blithequark - $35/hour, Flexible Hours, Career Growth Opportunities

Remote, USA Full-time

Medical Assistant

Remote, USA Full-time

Senior Data QA Engineer

Remote, USA Full-time
Back to Home