Lead Data Annotation Analyst

4 Months ago • 3 Years + • $117,100 PA - $161,100 PA

Data Analysis

Job Description

The Lead Data Annotation Analyst role involves performing complex data annotation tasks across various modalities, reviewing data for accuracy, and contributing to model performance. The analyst will work with research and engineering teams, track annotation quality, and identify recurring labeling issues. This individual contributor role requires strong attention to detail and excellent communication skills to support the creation of high-quality datasets for training and evaluating large-scale generative models, ensuring that annotation output meets technical standards. This role requires 10 days a quarter in the office.

Good To Have:

Experience in content moderation, content quality, or safety.
Exposure to AI chatbots and customer service.
Proficiency in Python and data manipulation tools.
Experience in data engineering, data science, or related roles.

Must Have:

3+ years of hands-on annotation experience in AI projects.
Strong attention to detail and ability to work independently.
Excellent interpersonal and communication skills.

Add these skills to join the top 1% applicants for this job

communication

game-texts

salesforce

hadoop

spark

data-science

mean

python

To get the best candidate experience, please consider applying for a maximum of 3 roles within 12 months to ensure you are not duplicating efforts.

Job Category

Data

Job Details

About Salesforce

We’re Salesforce, the Customer Company, inspiring the future of business with AI+ Data +CRM. Leading with our core values, we help companies across every industry blaze new trails and connect with customers in a whole new way. And, we empower you to be a Trailblazer, too — driving your performance and career growth, charting new paths, and improving the state of the world. If you believe in business as the greatest platform for change and in companies doing well and doing good – you’ve come to the right place.

Salesforce AI Research is seeking a skilled and detail-oriented Lead Data Annotation Analyst to support the creation of high-quality datasets that train and evaluate our large-scale generative models. We are at the forefront of Enterprise AI, and this role offers a unique opportunity to contribute directly to foundational model development through expert annotation and review work.

The Lead Data Annotation Analyst will serve as an individual contributor, responsible for performing complex annotation tasks, reviewing labeling quality, and helping improve task clarity and accuracy. You’ll work closely with managers, research and engineering teams to ensure annotation output meets technical standards and contributes meaningfully to model performance.

Key Responsibilities

Execute complex, high-accuracy data annotation tasks across a variety of modalities (e.g., language, image, multimodal)
Review and audit labeled data for consistency, correctness, and adherence to task instructions; flag quality issues and edge case inconsistencies.
Participate in calibration sessions and pilot reviews to ensure alignment across annotators and uphold task-level quality standards.
Track annotation quality using metrics such as inter-annotator agreement, golden set accuracy, or error categorization.
Identify recurring labeling issues, conduct task-level root cause analysis (RCA), and escalate quality risks to manager.

Qualifications:

3+ years of hands-on annotation experience, including tasks in language, vision, or multimodal AI projects.
Strong attention to detail and the capacity to work both independently and collaboratively.
Excellent interpersonal and communication skills.
Experience in content moderation, content quality, content safety, or labeling is advantageous.
Exposure to AI projects such as AI chatbots, automated speech recognition, AI customer service
Bachelor’s degree or equivalent experience in a relevant field such as Linguistics, Cognitive Science, Computer Science, or related disciplines

Preferred Qualifications:

Proficiency in Python and data manipulation tools like Hadoop, Spark, or Kafka.
Proficiency in data engineering, data science, or related roles in a leadership capacity. Experience building and optimizing large-scale data pipelines and datasets.

In office expectations are 10 days/a quarter to support customers and/or collaborate with their teams.

Accommodations

If you require assistance due to a disability applying for open positions please submit a request via this Accommodations Request Form.

Posting Statement

Salesforce is an equal opportunity employer and maintains a policy of non-discrimination with all employees and applicants for employment. What does that mean exactly? It means that at Salesforce, we believe in equality for all. And we believe we can lead the path to equality in part by creating a workplace that’s inclusive, and free from discrimination. Know your rights: workplace discrimination is illegal. Any employee or potential employee will be assessed on the basis of merit, competence and qualifications – without regard to race, religion, color, national origin, sex, sexual orientation, gender expression or identity, transgender status, age, disability, veteran or marital status, political viewpoint, or other classifications protected by law. This policy applies to current and prospective employees, no matter where they are in their Salesforce employment journey. It also applies to recruiting, hiring, job assignment, compensation, promotion, benefits, training, assessment of job performance, discipline, termination, and everything in between. Recruiting, hiring, and promotion decisions at Salesforce are fair and based on merit. The same goes for compensation, benefits, promotions, transfers, reduction in workforce, recall, training, and education.