Lead Data Annotation Analyst

Job Category

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

Salesforce AI Research is seeking a skilled and detail-oriented Lead Data Annotation Analyst to support the creation of high-quality datasets that train and evaluate our large-scale generative models. We are at the forefront of Enterprise AI, and this role offers a unique opportunity to contribute directly to foundational model development through expert annotation and review work.

The Lead Data Annotation Analyst will serve as an individual contributor, responsible for performing complex annotation tasks, reviewing labeling quality, and helping improve task clarity and accuracy. You’ll work closely with managers, research and engineering teams to ensure annotation output meets technical standards and contributes meaningfully to model performance.

Key Responsibilities 

• Execute complex, high-accuracy data annotation tasks across a variety of modalities (e.g., language, image, multimodal)

• Review and audit labeled data for consistency, correctness, and adherence to task instructions; flag quality issues and edge case inconsistencies.

• Participate in calibration sessions and pilot reviews to ensure alignment across annotators and uphold task-level quality standards.

• Track annotation quality using metrics such as inter-annotator agreement, golden set accuracy, or error categorization.

• Identify recurring labeling issues, conduct task-level root cause analysis (RCA), and escalate quality risks to manager. 

Qualifications:

• 3+ years of hands-on annotation experience, including tasks in language, vision, or multimodal AI projects.

• Strong attention to detail and the capacity to work both independently and collaboratively.

• Excellent interpersonal and communication skills.
  Experience in content moderation, content quality, content safety, or labeling is advantageous.

• Exposure to AI projects such as AI chatbots, automated speech recognition, AI customer service

• Bachelor’s degree or equivalent experience in a relevant field such as Linguistics, Cognitive Science, Computer Science, or related disciplines

Preferred Qualifications:

• Proficiency in Python and data manipulation tools like Hadoop, Spark, or Kafka. 

• Proficiency in data engineering, data science, or related roles in a leadership capacity. Experience building and optimizing large-scale data pipelines and datasets. 

In office expectations are 10 days/a quarter to support customers and/or collaborate with their teams.

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.