Data Engineer

3 Months ago • 3 Years + • Data Analyst

Job Summary

Job Description

We are seeking a highly skilled Mediation Data Engineer to design, develop, and maintain data processing systems that collect, transform, and deliver usage data for billing and analytics platforms. In this role, you will focus on building robust data mediation pipelines that process large volumes of transactional data, ensuring accurate and real-time integration into billing systems. You will collaborate with teams across product, engineering, and finance to ensure smooth data flow, data quality, and compliance with industry standards. **Responsibilities:** * **Data Mediation Development:** Design and implement mediation systems to collect, transform, and process raw usage data (e.g., call data records, messaging transactions) into standardized formats for billing and analytics platforms. * **ETL Pipeline Creation:** Build and maintain efficient ETL processes to process high volumes of usage data, ensuring data accuracy, consistency, and readiness for billing calculations. * **Real-Time Event Processing:** Develop and manage near real-time data pipelines using tools such as Kafka, Flink, or Spark Streaming, ensuring minimal latency between data ingestion and processing. * **Data Transformation:** Implement data transformation rules to normalize and enrich data from multiple sources, preparing it for accurate billing, invoicing, and reporting. * **Automation and Efficiency:** Automate mediation processes, minimizing manual intervention and improving the efficiency of data flows. Utilize orchestration tools like Apache Airflow or NiFi to manage workflows. * **Data Integrity and Quality:** Ensure data quality by implementing checks, monitoring systems, and error-handling mechanisms to prevent inconsistencies, duplicates, or data loss. * **Collaboration with Stakeholders:** Work closely with billing, product, and engineering teams to understand data requirements and ensure that mediation pipelines align with business needs. * **Compliance and Governance:** Ensure that all mediation processes adhere to data governance, security, and regulatory requirements, particularly in relation to billing data.
Must have:
  • Bachelor’s degree in Computer Science, Engineering, or a related field.
  • 3+ years of experience in building and maintaining mediation systems or data processing pipelines in a billing or transaction-heavy environment.
  • Hands-on experience with ETL tools (e.g., Apache NiFi, Airflow) and strong understanding of data transformation and enrichment processes.
  • Proficiency in event-driven processing technologies such as Apache Kafka, Flink, or Spark Streaming.
  • Strong programming skills in Python, Scala, or Java for developing data pipelines and processing logic.
  • Experience with cloud platforms such as AWS, GCP, or Azure for building scalable mediation systems (e.g., S3, Lambda, Glue).
  • Proficiency in SQL and experience with both relational and NoSQL databases for managing and querying large datasets.
Good to have:
  • Familiarity with billing systems and mediation engines used in industries like telecommunications, messaging, SaaS, or utilities.
  • Experience with high-throughput data processing and handling large volumes of transactional data (e.g., call records, message records, service usage).
  • Knowledge of data privacy regulations (e.g., GDPR, CCPA) and their impact on mediation and billing processes.
  • Experience working with containerization and orchestration tools such as Docker and Kubernetes.

Job Details

Description

We are seeking a highly skilled Mediation Data Engineer to design, develop, and maintain data processing systems that collect, transform, and deliver usage data for billing and analytics platforms. In this role, you will focus on building robust data mediation pipelines that process large volumes of transactional data, ensuring accurate and real-time integration into billing systems. You will collaborate with teams across product, engineering, and finance to ensure smooth data flow, data quality, and compliance with industry standards. 

Responsibilities: 

  • Data Mediation Development: Design and implement mediation systems to collect, transform, and process raw usage data (e.g., call data records, messaging transactions) into standardized formats for billing and analytics platforms. 
  • ETL Pipeline Creation: Build and maintain efficient ETL processes to process high volumes of usage data, ensuring data accuracy, consistency, and readiness for billing calculations. 
  • Real-Time Event Processing: Develop and manage near real-time data pipelines using tools such as Kafka, Flink, or Spark Streaming, ensuring minimal latency between data ingestion and processing. 
  • Data Transformation: Implement data transformation rules to normalize and enrich data from multiple sources, preparing it for accurate billing, invoicing, and reporting. 
  • Automation and Efficiency: Automate mediation processes, minimizing manual intervention and improving the efficiency of data flows. Utilize orchestration tools like Apache Airflow or NiFi to manage workflows. 
  • Data Integrity and Quality: Ensure data quality by implementing checks, monitoring systems, and error-handling mechanisms to prevent inconsistencies, duplicates, or data loss. 
  • Collaboration with Stakeholders: Work closely with billing, product, and engineering teams to understand data requirements and ensure that mediation pipelines align with business needs. 
  • Compliance and Governance: Ensure that all mediation processes adhere to data governance, security, and regulatory requirements, particularly in relation to billing data. 

Requirements

  • Bachelor’s degree in Computer Science, Engineering, or a related field. 
  • 3+ years of experience in building and maintaining mediation systems or data processing pipelines in a billing or transaction-heavy environment. 
  • Hands-on experience with ETL tools (e.g., Apache NiFi, Airflow) and strong understanding of data transformation and enrichment processes. 
  • Proficiency in event-driven processing technologies such as Apache Kafka, Flink, or Spark Streaming. 
  • Strong programming skills in Python, Scala, or Java for developing data pipelines and processing logic. 
  • Experience with cloud platforms such as AWS, GCP, or Azure for building scalable mediation systems (e.g., S3, Lambda, Glue). 
  • Proficiency in SQL and experience with both relational and NoSQL databases for managing and querying large datasets. 

Preferred: 

  • Familiarity with billing systems and mediation engines used in industries like telecommunications, messaging, SaaS, or utilities. 
  • Experience with high-throughput data processing and handling large volumes of transactional data (e.g., call records, message records, service usage). 
  • Knowledge of data privacy regulations (e.g., GDPR, CCPA) and their impact on mediation and billing processes. 
  • Experience working with containerization and orchestration tools such as Docker and Kubernetes. 

Soft Skills: 

  • Strong analytical and problem-solving skills, with a focus on data accuracy and integrity. 
  • Effective communication skills for collaborating with cross-functional teams, including technical and non-technical stakeholders. 
  • Self-motivated, detail-oriented, and able to prioritize tasks in a fast-paced environment. 
  • Strong organizational skills and ability to manage multiple mediation pipelines simultaneously. 

Benefits

Our Values

At Sinch we “Dream Big”, “Win Together”, “Keep it simple” and “Make it Happen”. These values are our foundation for fostering an environment where diversity of thinking, skills and experiences are embraced, delivering innovation and better business results.

Bring your authentic self to Sinch

Here at Sinch we embrace diversity and work to create an inclusive workplace where everyone can thrive. No matter who you are, you'll be able to explore new career and growth options - sharing your voice, building your path and making it happen with us.

We’re proud to be an equal opportunity employer, and all qualified applicants will be considered to join our team regardless of race, color, religion, creed, gender, national origin, age, disability, veteran status, marital status, pregnancy, sex, gender expression or identity, sexual orientation, citizenship, or any other legally protected class.

Our Hiring Process 

At Sinch, we are committed to following a recruitment process that is fair, objective, consistent, and non-discriminatory. We use pre-employment assessment to create an inclusive application experience to help foster diverse and high performing teams.

Even if you do not meet all job requirements, don't let that stop you from considering Sinch for the next step in your career. We are always looking for people that could help us pioneer the way the world communicates.

If this role isn't what you're looking for, please consider other open roles on our career page: https://www.sinch.com/careers/

Similar Jobs

Trendyol - Data Engineer

Trendyol

Ankara, Ankara, Türkiye (Hybrid)
3 Months ago
Netflix - Software Engineer (L6) - Revenue Finance Infrastructure

Netflix

Los Gatos, California, United States (On-Site)
3 Months ago
PublicisGroupe - Publicis Groupe Internship Talent Programme 2024

PublicisGroupe

(On-Site)
3 Months ago
Netflix - Distributed Systems Engineer, Membership Engineering - L5

Netflix

New York, New York, United States (On-Site)
3 Months ago
PwC - IN_Senior Associate_ AWS Data Engineer_D&A_Advisory_Bangalore

PwC

Bengaluru, Karnataka, India (On-Site)
4 Months ago
Google - Data Analyst, Trust and Safety, Ads

Google

Kirkland, Washington, United States (On-Site)
3 Months ago
Huuuge Games - BUSINESS ANALYST

Huuuge Games

Bydgoszcz, Kuyavian-Pomeranian Voivodeship, Poland (Hybrid)
6 Months ago
Aristocrat Gaming - Game Performance Analyst

Aristocrat Gaming

Tulsa, Oklahoma, United States (Remote)
3 Months ago
The Walt Disney Company - Sr. Machine Learning Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
The Walt Disney Company - Sr. Manager, DEI Insights

The Walt Disney Company

Burbank, California, United States (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Highspot - Sr. Backend Engineer, Meeting Intelligence

Highspot

Vancouver, British Columbia, Canada (Hybrid)
4 Months ago
Infoblox - Staff Software Engineer - Backend

Infoblox

Burnaby, British Columbia, Canada (On-Site)
3 Months ago
The Walt Disney Company - Manager, Machine Learning - Ad Platforms

The Walt Disney Company

Santa Monica, California, United States (On-Site)
2 Months ago
PwC - Senior AI Developer - MILANO [DIG]

PwC

Milan, Lombardy, Italy (On-Site)
4 Months ago
MatchGroup - Manager, Communications, APAC

MatchGroup

Singapore (Hybrid)
3 Months ago
Ness Digital - Big Data Engineers (T5&6)

Ness Digital

Timișoara, Timiș, Romania (Remote)
3 Months ago
The Walt Disney Company - Senior Software Engineer - Data Capture Team

The Walt Disney Company

Seattle, Washington, United States (On-Site)
3 Months ago
Worldpay - IT Architect Manager Senior (Data Engineering Chapter Lead)

Worldpay

Pune, Maharashtra, India (On-Site)
3 Months ago
Netflix - Data Engineer (L5) - Customer Service

Netflix

United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Malmö, Skåne County, Sweden

Section 9 Interactive - Environment Artist

Section 9 Interactive

Malmö, Skåne County, Sweden (On-Site)
8 Months ago
EveryMatrix - Slots Game Mathematician

EveryMatrix

Stockholm, Stockholm County, Sweden (On-Site)
3 Months ago
Technicon Design - Technical Visualisation Artist

Technicon Design

Västra Götaland County, Sweden (On-Site)
6 Months ago
Rennsport.gg - Senior Backend Engineer (f/m/x)

Rennsport.gg

Sweden (Remote)
6 Months ago
Arrowhead Game Studios - Art Manager

Arrowhead Game Studios

Stockholm, Stockholm County, Sweden (Hybrid)
4 Months ago
Chief Rebel - VFX Artist

Chief Rebel

Stockholm, Stockholm County, Sweden (On-Site)
5 Months ago
undefined - Senior CRM Manager - Sweden

Stockholm, Stockholm County, Sweden (Hybrid)
3 Months ago
undefined - Game developer

Stockholm, Stockholm County, Sweden (On-Site)
6 Months ago
Evolution - Game Mathematician Evolution Live

Evolution

Stockholm, Stockholm County, Sweden (On-Site)
3 Months ago
dentsu - Project Manager

dentsu

Stockholm, Stockholm County, Sweden (On-Site)
4 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

SLAY - Marketing Data Analyst

SLAY

Berlin, Berlin, Germany (On-Site)
3 Months ago
Embark Studios - Game Data Analyst - Games

Embark Studios

Stockholm, Stockholm County, Sweden (On-Site)
3 Months ago
Scopely - Product Analyst

Scopely

Spain (On-Site)
3 Months ago
blitz app - Staff Data Engineer II

blitz app

Los Angeles, California, United States (Hybrid)
3 Months ago
Luxoft - Snowflake Engineer

Luxoft

Bengaluru, Karnataka, India (On-Site)
2 Months ago
ByteDance - Data Analyst - Global Payment - Singapore

ByteDance

Singapore (On-Site)
3 Months ago
Attentive - Senior Software Engineer, Platform

Attentive

United States (Remote)
3 Months ago
CloudHire - Data Curator/ entry operator

CloudHire

India (Remote)
3 Months ago
Super.com - Senior Analytics Engineer

Super.com

United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

About The Company

United States (Remote)

Mexico City, Mexico City, Mexico (Remote)

United States (Remote)

Georgia, United States (Remote)

United States (Remote)

United States (Remote)

Mandaluyong, Metro Manila, Philippines (Remote)

View All Jobs

Get notified when new jobs are added by Sinch

Level Up Your Career in Game Development!

Transform Your Passion into Profession with Our Comprehensive Courses for Aspiring Game Developers.

Job Common Plug