Manager, Mediation Data Engineering

5 Months ago • 7 Years + • Data Analyst • $145,000 PA - $170,000 PA

Job Summary

Job Description

The Manager, Mediation Data Engineering will lead a team in designing and managing data mediation systems supporting billing, usage tracking, and real-time event processing. Responsibilities include team leadership, strategic roadmap execution for scalable data pipelines, providing architectural guidance, ensuring operational excellence and SLAs, collaborating with cross-functional teams, automating processes (Airflow or NiFi), overseeing data governance and compliance (GDPR, CCPA), and managing projects. The role requires strong technical expertise in event-driven architectures, ETL processes, tools like Apache Kafka, Flink, Spark, Airflow, or NiFi, cloud platforms (AWS, GCP, Azure), and programming (Python, Java, or Scala).
Must have:
  • Lead & mentor data engineers
  • Design & manage mediation systems
  • Build scalable data pipelines
  • Ensure data integrity & performance
  • Collaborate with cross-functional teams
  • Automate processes
  • Oversee data governance & compliance
Good to have:
  • Experience in telecom, messaging, utilities, or SaaS
  • Knowledge of mediation engines
  • Experience with CI/CD pipelines
Perks:
  • Comprehensive medical, dental, and vision plans
  • Employee Assistance Program
  • 401(k) options with employer match
  • Paid time off
  • Paid parental leave
  • Flexible remote work
  • Paid time off for volunteer work

Job Details

Description

We are seeking an experienced and dynamic Manager of Software Engineering to lead a team of engineers responsible for designing and managing data mediation systems that support billing, usage tracking, and real-time event processing. In this role, you will oversee the development of data pipelines, ensure high performance and data integrity, and drive innovation in the automation and efficiency of mediation processes. You will collaborate with cross-functional teams, including product, billing, and engineering, to align technical solutions with business goals. 

Responsibilities: 

  • Team Leadership: Lead, mentor, and develop a team of Mediation Data Engineers, fostering a culture of innovation, accountability, and technical excellence. 
  • Strategic Oversight: Define and execute the roadmap for mediation systems, ensuring that the team builds scalable, reliable, and efficient data pipelines for real-time and batch data processing. 
  • Technical Direction: Provide architectural guidance for the design and implementation of mediation systems, including data collection, transformation, and delivery to billing platforms. Ensure that solutions meet the performance and scalability requirements of high-throughput environments. 
  • Operational Excellence: Ensure that mediation systems are running smoothly and efficiently, meeting service-level agreements (SLAs) for data processing and uptime. Implement monitoring, logging, and alerting systems to maintain data flow and catch potential issues early. 
  • Cross-Team Collaboration: Collaborate closely with billing, product management, and other engineering teams to understand requirements, align mediation systems with business objectives, and drive initiatives to improve the billing process. 
  • Process Automation: Drive automation of manual processes related to mediation and billing data pipelines, reducing errors and improving operational efficiency using tools like Airflow or NiFi. 
  • Data Governance and Compliance: Oversee the implementation of data governance best practices, ensuring that mediation systems comply with industry standards, including data privacy regulations (e.g., GDPR, CCPA). 
  • Project and Resource Management: Manage multiple projects related to mediation and billing, ensuring timely delivery within scope and budget. Allocate resources effectively and prioritize team efforts to meet business needs. 
  • Continuous Improvement: Encourage continuous learning and improvement within the team by staying current with emerging technologies and promoting the adoption of best practices in data engineering and event processing. 

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field. 
  • 7+ years of experience in data engineering, with at least 3 years in a managerial or team leadership role. 
  • Proven experience managing teams that develop mediation systems or data pipelines for billing, usage tracking, or high-transaction environments. 
  • Strong technical background in event-driven architectures and ETL processes, with hands-on experience in tools such as Apache Kafka, Flink, Spark Streaming, Airflow, or NiFi. 
  • Expertise in managing large-scale data processing pipelines for real-time and batch data. 
  • Strong programming skills in Python, Java, or Scala, with the ability to guide and review the technical work of team members. 
  • Experience with cloud platforms like AWS, GCP, or Azure, and hands-on familiarity with their data processing services (e.g., Lambda, Glue, Dataflow). 
  • Solid understanding of data governance, including data security and privacy regulations impacting mediation and billing systems. 

Preferred: 

  • Experience in industries with complex mediation needs such as telecommunications, messaging, utilities, or SaaS platforms, particularly with billing and usage-based models. 
  • Knowledge of mediation engines and practices used in high-transaction industries. 
  • Experience with CI/CD pipelines, version control, and infrastructure automation. 
  • Knowledge of data privacy regulations (e.g., GDPR, CCPA) and how they apply to large-scale data mediation and billing processes. 

Soft Skills: 

  • Strong leadership and communication skills, with the ability to build and inspire high-performing teams. 
  • Strategic thinker with a focus on innovation and long-term planning, balancing business needs with technical capabilities. 
  • Strong problem-solving skills and ability to troubleshoot complex systems and resolve technical issues. 
  • Ability to manage competing priorities and effectively allocate resources to meet business needs. 

Benefits

  • STAY HEALTHY: We offer comprehensive market competitive medical, dental, and vision plans. A variety of supplemental plans are also provided to meet your individual needs including access to telehealth for all participants.
  • CARE FOR YOURSELF: Take advantage of our free virtual counseling resources through our global Employee Assistance Program. Your mental health is as important as your physical health.
  • SECURE YOUR FUTURE: Plan for your future with our Roth and Pre-tax 401(k) options including an employer match for all participants.
  • TAKE A BREAK: Enjoy a generous paid time off program. We value balance and understand that performance at work requires time to rest at home and/or rejuvenate on vacation.
  • PUT FAMILY FIRST: We know that families can be built in a variety of ways; therefore, we offer paid parental leave and family planning support.
  • WORK WHEREVER: Our flexible remote work offerings allow you to work wherever you’re the most productive and successful. It’s what you do, not where you work, that matters.
  • MAKE AN IMPACT: Support betterment in your community and beyond by taking paid time off to support a volunteer program of your choice.

Our expert teams are built from some of the most experienced in the industry. We employ people from all over the world, from all walks of life and from all backgrounds. We work together, feeding on our diversity to make us stronger, and we encourage each other to be the best we can be. Innovation drives us, and we challenge ourselves every day. Get in touch and join us on our journey!

The annual starting salary for this position is between $145,000.00 - $170,000.00 per year. Factors which may affect starting pay within this range may include geography/market, skills, education, experience, and other qualifications.

This role will be accepting applications until 11/13/2024 at a minimum. Please note that the application timeline may be flexible to accommodate a comprehensive candidate evaluation.

Similar Jobs

Onward Search - Senior Software Engineer

Onward Search

Irvine, California, United States (Remote)
2 Months ago
ByteDance - Network Software Engineer Intern (Network Engineering) - 2025 Summer (PhD)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Next Level Business Services - IBM Initiate Developer

Next Level Business Services

Richardson, Texas, United States (On-Site)
6 Months ago
Twitch - Software Engineer - Memberships

Twitch

San Francisco, California, United States (On-Site)
1 Month ago
Velotio Technologies - Data Engineer

Velotio Technologies

Maharashtra, India (Remote)
2 Months ago
Tencent - Senior Big Data Solution Architect

Tencent

(On-Site)
5 Months ago
NVIDIA - Data Systems Analyst (RDSS Intern)

NVIDIA

Hsinchu, Hsinchu City, Taiwan (On-Site)
3 Months ago
Electronic Arts - Senior Data Engineer

Electronic Arts

Hyderabad, Telangana, India (On-Site)
1 Month ago
Rackspace Technology - Data Engineer III

Rackspace Technology

Vietnam (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

Aristocrat Gaming - QA Automation Engineer (C# or Java)

Aristocrat Gaming

Warsaw, Masovian Voivodeship, Poland (Hybrid)
2 Months ago
Playtika - Java Technical Lead

Playtika

Romania (Hybrid)
5 Months ago
Luxoft - Senior Angular Developer

Luxoft

Mississauga, Ontario, Canada (On-Site)
4 Months ago
Nagarro - Staff Engineer, Java Fullstack

Nagarro

(On-Site)
5 Months ago
Netflix - Senior Data Engineer, Commerce Product

Netflix

Mexico City, Mexico City, Mexico (On-Site)
1 Month ago
Tesla - Senior Trading Engineer, Autobidder

Tesla

North Holland, Netherlands (On-Site)
2 Months ago
Netflix - Engineering Manager - Revenue Infrastructure Engineering

Netflix

Warsaw, Masovian Voivodeship, Poland (On-Site)
2 Months ago
ByteDance - Site Reliability Engineer - Data Infrastructure (San Jose)

ByteDance

San Jose, California, United States (On-Site)
5 Months ago
Epic Games - Senior Gameplay Systems Programmer

Epic Games

Porto Alegre, State Of Rio Grande Do Sul, Brazil (On-Site)
2 Months ago
NinjaVan - Senior Software Engineer

NinjaVan

Ho Chi Minh City, Ho Chi Minh City, Vietnam (Hybrid)
6 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Chicago, Illinois, United States

PENN Interactive - Regional Director of Player Development - Northeast

PENN Interactive

Philadelphia, Pennsylvania, United States (Hybrid)
2 Months ago
100 Thieves - Backend Sales Support

100 Thieves

United States (On-Site)
10 Months ago
Scientific Games  - Warehouse Support

Scientific Games

La Vergne, Tennessee, United States (On-Site)
2 Months ago
Sony Pictures Animation - Story Artist - Series

Sony Pictures Animation

Culver City, California, United States (On-Site)
5 Months ago
Riot Games - Architect User Experience Designer - League of Legends

Riot Games

Los Angeles, California, United States (On-Site)
5 Months ago
The Walt Disney Company - Senior Product Manager II, Commerce Product Insights

The Walt Disney Company

New York, New York, United States (On-Site)
4 Months ago
Varonis  - Cloud Security Architect - SME Azure

Varonis

United States (Remote)
2 Months ago
Netflix - Network Engineer (L4) Open Connect

Netflix

United States (Remote)
3 Months ago
Valve corporation - Level Designer

Valve corporation

Bellevue, Washington, United States (On-Site)
5 Months ago
Onward Search - UX/UI Designer (Native Mobile App)

Onward Search

North Andover, Massachusetts, United States (Remote)
3 Months ago

Get notifed when new similar jobs are uploaded

Data Analyst Jobs

The Walt Disney Company - Lead Data Engineer

The Walt Disney Company

Seattle, Washington, United States (On-Site)
2 Months ago
Fanatee - BI Engineer

Fanatee

(Hybrid)
7 Months ago
Voodoo - Data Analyst - Wizz

Voodoo

Paris, Île-de-France, France (Hybrid)
1 Month ago
The Walt Disney Company - Lead Data Scientist

The Walt Disney Company

Burbank, California, United States (On-Site)
5 Months ago
Tesla - Data Engineer

Tesla

North Holland, Netherlands (On-Site)
2 Months ago
NVIDIA - Data Engineer

NVIDIA

Taipei City, Taiwan (On-Site)
2 Months ago
Go Fund Me - Senior Data Engineer

Go Fund Me

Buenos Aires, Buenos Aires, Argentina (Remote)
5 Months ago
Epic Games - Senior Data Scientist - Product Analytics

Epic Games

Vancouver, British Columbia, Canada (On-Site)
3 Months ago
Rank group - Senior Insight Analyst

Rank group

London, England, United Kingdom (On-Site)
4 Months ago
CloudHire - Database Solution Architect

CloudHire

Mumbai, Maharashtra, India (Remote)
6 Months ago

Get notifed when new similar jobs are uploaded