Senior Data Engineer

2 Months ago • 3-5 Years • Data Analysis

Job Summary

Job Description

Progress is seeking a Senior Data Engineer to join their AI First team. The role involves transforming unstructured content like documentation and knowledge-base articles into high-quality, AI-ready data for their products. Responsibilities include designing and maintaining scalable data pipelines, processing and analyzing large datasets for AI model embedding and fine-tuning, validating and cleaning data, preparing data for Retrieval-Augmented Generation (RAG) workflows, building and optimizing database pipeline architectures, implementing data governance and security, collaborating with cross-functional teams, and contributing to ground-truth datasets for Gen-AI features.
Must have:
  • Bachelor's or Master's degree in Computer Science, Data Science, or related field.
  • 3-5 years of experience as a Data Engineer or Data Scientist.
  • Proficiency with big data systems (Spark, Kafka, VectorDB).
  • Strong SQL and Python skills.
  • Hands-on experience with MS Azure.
  • Solid understanding of machine learning fundamentals.
Good to have:
  • Experience in a cloud environment.
  • Knowledge of data science workflows and libraries.
  • Familiarity with text-processing/ML libraries (pandas, PySpark, Hugging Face).
  • Exposure to vector search technologies (pgvector, Pinecone, Milvus, Azure AI Search).
  • Effective communication and collaboration abilities.
Perks:
  • Generous remuneration package
  • Employee Stock Purchase Plan
  • 30 days paid annual vacation
  • Extra day off for birthday
  • 2 additional days off for volunteering
  • Premium healthcare and dental care coverage
  • Additional pension insurance
  • Well-equipped gym on-site with CrossFit equipment and a climbing wall
  • Co-funded Multisport card
  • Daycare Center onsite
  • Flexible working hours
  • Opportunity to work from home
  • Free underground parking with designated space for bikes and electric scooters

Job Details

We are Progress (Nasdaq: PRGS) - an experienced, trusted provider of products designed with customers in mind so they can develop the applications they need, deploy where and how they want, and manage it all safely and securely.   
We’re proud to have a diverse, global team where we value the individual and enrich our culture by considering varied perspectives because we believe people power progress. Join us as a Senior Data Engineer and help us do what we do best: propelling business forward. 
 
We are seeking an experienced and driven Data Engineer to join our AI First team, part of Web Components and Tools division. In this role, you will turn large volumes of unstructured content - documentation, knowledge-base articles, API references, etc. into high-quality, AI-ready data that powers our products. 
 
In this role, you will:
  • Design, develop, and maintain scalable data pipelines for collecting, ingesting, transforming and monitoring text data from multiple sources.
  • Process and analyze large datasets to support AI model embedding and fine-1922574463tuning.
  • Validate, clean and categorize data to ensure quality, security and usability; surface anomalies and gaps through automated checks.
  • Prepare data for RAG (Retrieval-Augmented Generation) workflows by splitting and chunking documents, managing metadata, and ensuring smooth integration with vector stores.
  • Build and optimize database pipeline architectures for performance and reliability
  • Implement data governance and security best practices.
  • Collaborate with cross-functional teams to deliver data solutions aligned with business goals.
  • Contribute to the creation of ground-truth datasets and evaluation harnesses for future Gen-AI features.
  • Stay current with emerging AI tools and trends to drive innovation.
Your background:
  • Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
  • 3–5 years of experience as a Data Engineer or Data Scientist, preferably in a cloud environment.
  • Proficiency with big data systems and tools (e.g., Apache Spark, Kafka, VectorDB).
  • Knowledge of data science workflows and libraries
  • Strong SQL and Python skills; familiarity with text-processing/ML libraries (pandas, PySpark, Hugging Face).
  • Hands-on experience with cloud platform, especially MS Azure.
  • Exposure to vector search technologies (e.g., pgvector, Pinecone, Milvus, Azure AI Search).
  • Solid understanding of machine learning fundamentals
  • Strong analytical and problem-solving skills.
  • Effective communication and collaboration abilities.
If this sounds like you and fits your experience and career goals, we’d be happy to chat.  
 
What we offer in return is the opportunity to experience a great company culture with wonderful colleagues to learn from and collaborate with and also to enjoy:  
 
Compensation
  • Generous remuneration package
  • Employee Stock Purchase Plan Enrollment 
Family, and Health 
  • 30 days paid annual vacation
  • An extra day off for your birthday
  • 2 additional days off for volunteering
  • Premium healthcare and dental care coverage
  • Additional pension insurance
  • Well-equipped gym on-site with CrossFit equipment and a climbing wall
  • Co-funded Multisport card
  • Daycare Center for your little ones onsite
  • Flexible working hours and the opportunity to work from home.
  • Free underground parking with a designated space for bikes and electric scooters 

Apply now!

#LI-DG1
#LI-Hybrid

Similar Jobs

Fortra - Cloud Security Operations Lead

Fortra

Canada (On-Site)
1 Month ago
King - Staff Platform Solutions Engineer

King

New York, United States (On-Site)
2 Months ago
Playtika - Site Reliability Engineer

Playtika

Vinnytsia, Vinnytsia Oblast, Ukraine (On-Site)
4 Weeks ago
Square - Cost Manager

Square

Bristol, England, United Kingdom (On-Site)
1 Month ago
appier - Global Talent Acquisition Intern

appier

Taipei City, Taiwan (On-Site)
3 Weeks ago
Springer Nature - Senior Data Engineer

Springer Nature

Pune, Maharashtra, India (Hybrid)
9 Months ago
endava - GCP Data Architect

endava

Berlin, Berlin, Germany (Hybrid)
2 Months ago
Revenera - Senior Data Analyst

Revenera

Bengaluru, Karnataka, India (Hybrid)
3 Months ago
Tesla - Data Scientist

Tesla

Brandenburg, Germany (On-Site)
6 Months ago
Bethesda - Senior Data Analyst

Bethesda

Rockville, Maryland, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

onwards Search - SEO Analyst

onwards Search

Orlando, Florida, United States (Hybrid)
3 Weeks ago
CharacterAI - Lead Growth Product Manager

CharacterAI

Menlo Park, California, United States (On-Site)
4 Months ago
cirrus logic - Product Marketing Manager

cirrus logic

Austin, Texas, United States (Hybrid)
3 Months ago
Bluevine India - Manager, Customer Success

Bluevine India

Bengaluru, Karnataka, India (On-Site)
3 Months ago
Electronic Arts - Advanced Data Analyst, UGX

Electronic Arts

Vancouver, British Columbia, Canada (Hybrid)
4 Months ago
Grammarly - Finance Analytics Lead

Grammarly

San Francisco, California, United States (Hybrid)
1 Month ago
Integrant - Power Platform Lead

Integrant

Cairo, Cairo Governorate, Egypt (Hybrid)
1 Month ago
Peak Games - Data Scientist

Peak Games

(On-Site)
11 Months ago
WaveApps - Manager, Data Engineering

WaveApps

Canada (Remote)
1 Month ago
Zones - Regional Manager West

Zones

Mumbai, Maharashtra, India (On-Site)
5 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Sofia, Sofia City Province, Bulgaria

room8 - Realistic 3D Environment & Props Artist, Middle / Senior

room8

Bulgaria (On-Site)
8 Months ago
Sega (UK) - Senior Engine Programmer

Sega (UK)

Sofia, Sofia City Province, Bulgaria (On-Site)
3 Months ago
Progress - Data Scientist

Progress

Sofia, Sofia City Province, Bulgaria (Hybrid)
2 Months ago
Open Systems Technologies - Data Analyst

Open Systems Technologies

Sofia, Sofia City Province, Bulgaria (Hybrid)
3 Weeks ago
Tide - Customer Support Agent with French

Tide

Sofia, Sofia City Province, Bulgaria (Remote)
2 Months ago
kaizen gaming  - Principal Engineer (Backend)

kaizen gaming

Sofia, Sofia City Province, Bulgaria (Hybrid)
2 Months ago
Aristocrat - .NET Team Lead

Aristocrat

Sofia, Sofia City Province, Bulgaria (Hybrid)
5 Months ago
Tide - Sales Representative

Tide

Bulgaria (Hybrid)
3 Months ago
mamore games - Escalations Support Associate

mamore games

Bulgaria (Hybrid)
1 Month ago
Tide - Social Media Associate

Tide

Bulgaria (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analysis Jobs

ShyftLabs - Data Scientist

ShyftLabs

Atlanta, Georgia, United States (Hybrid)
3 Months ago
Western Digital - Internship - Data Analytics Engineering

Western Digital

Bayan Lepas, Penang, Malaysia (On-Site)
2 Months ago
Adyen - Staff Software Engineer - Distributed Data Systems

Adyen

Amsterdam, North Holland, Netherlands (On-Site)
3 Months ago
oportun - Senior Data Engineer - DBA

oportun

Mexico (Remote)
2 Months ago
luxsoft - Senior Business Analyst - Trade Finance

luxsoft

Chennai, Tamil Nadu, India (On-Site)
2 Months ago
Roblox - Senior Software Engineer - Data Engineering - Search & Discovery

Roblox

San Mateo, California, United States (On-Site)
1 Month ago
Epic Games - Senior Data Analyst

Epic Games

Cary, North Carolina, United States (On-Site)
6 Months ago
Antarctica Global - Data Analyst

Antarctica Global

Mumbai, Maharashtra, India (Hybrid)
1 Year ago
Riot Games - Senior Software Engineer - Data Foundation

Riot Games

Los Angeles, California, United States (On-Site)
4 Months ago
Hawkeye Innovations - Senior Data Test Automation Engineer

Hawkeye Innovations

Basingstoke, England, United Kingdom (Hybrid)
1 Month ago

Get notifed when new similar jobs are uploaded

About The Company

Progress (Nasdaq: PRGS) empowers organizations to achieve transformational success in the face of disruptive change. Our software enables our customers to develop, deploy and manage responsible AI-powered applications and experiences with agility and ease. Customers get a trusted provider in

Progress, with the products, expertise and vision they need to succeed. Over 4 million developers and technologists at hundreds of thousands of enterprises depend on Progress. Learn more at www.progress.com.

Bengaluru, Karnataka, India (Hybrid)

Burlington, Massachusetts, United States (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Rotterdam, South Holland, Netherlands (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Bengaluru, Karnataka, India (Hybrid)

Sofia, Sofia City Province, Bulgaria (Hybrid)

Sofia, Sofia City Province, Bulgaria (Hybrid)

Sofia, Sofia City Province, Bulgaria (Hybrid)

View All Jobs

Get notified when new jobs are added by progress

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug