Data Engineer

We are seeking a highly skilled Mediation Data Engineer to design, develop, and maintain data processing systems that collect, transform, and deliver usage data for billing and analytics platforms. In this role, you will focus on building robust data mediation pipelines that process large volumes of transactional data, ensuring accurate and real-time integration into billing systems. You will collaborate with teams across product, engineering, and finance to ensure smooth data flow, data quality, and compliance with industry standards. 

Responsibilities: 

• Data Mediation Development: Design and implement mediation systems to collect, transform, and process raw usage data (e.g., call data records, messaging transactions) into standardized formats for billing and analytics platforms. 

• ETL Pipeline Creation: Build and maintain efficient ETL processes to process high volumes of usage data, ensuring data accuracy, consistency, and readiness for billing calculations. 

• Real-Time Event Processing: Develop and manage near real-time data pipelines using tools such as Kafka, Flink, or Spark Streaming, ensuring minimal latency between data ingestion and processing. 

• Data Transformation: Implement data transformation rules to normalize and enrich data from multiple sources, preparing it for accurate billing, invoicing, and reporting. 

• Automation and Efficiency: Automate mediation processes, minimizing manual intervention and improving the efficiency of data flows. Utilize orchestration tools like Apache Airflow or NiFi to manage workflows. 

• Data Integrity and Quality: Ensure data quality by implementing checks, monitoring systems, and error-handling mechanisms to prevent inconsistencies, duplicates, or data loss. 

• Collaboration with Stakeholders: Work closely with billing, product, and engineering teams to understand data requirements and ensure that mediation pipelines align with business needs. 

• Compliance and Governance: Ensure that all mediation processes adhere to data governance, security, and regulatory requirements, particularly in relation to billing data. 

• Bachelor’s degree in Computer Science, Engineering, or a related field. 

• 3+ years of experience in building and maintaining mediation systems or data processing pipelines in a billing or transaction-heavy environment. 

• Hands-on experience with ETL tools (e.g., Apache NiFi, Airflow) and strong understanding of data transformation and enrichment processes. 

• Proficiency in event-driven processing technologies such as Apache Kafka, Flink, or Spark Streaming. 

• Strong programming skills in Python, Scala, or Java for developing data pipelines and processing logic. 

• Experience with cloud platforms such as AWS, GCP, or Azure for building scalable mediation systems (e.g., S3, Lambda, Glue). 

• Proficiency in SQL and experience with both relational and NoSQL databases for managing and querying large datasets. 

Preferred: 

• Familiarity with billing systems and mediation engines used in industries like telecommunications, messaging, SaaS, or utilities. 

• Experience with high-throughput data processing and handling large volumes of transactional data (e.g., call records, message records, service usage). 

• Knowledge of data privacy regulations (e.g., GDPR, CCPA) and their impact on mediation and billing processes. 

• Experience working with containerization and orchestration tools such as Docker and Kubernetes. 

Soft Skills: 

• Strong analytical and problem-solving skills, with a focus on data accuracy and integrity. 

• Effective communication skills for collaborating with cross-functional teams, including technical and non-technical stakeholders. 

• Self-motivated, detail-oriented, and able to prioritize tasks in a fast-paced environment. 

• Strong organizational skills and ability to manage multiple mediation pipelines simultaneously. 

• STAY HEALTHY: We offer comprehensive market competitive medical, dental, and vision plans. A variety of supplemental plans are also provided to meet your individual needs including access to telehealth for all participants.
• CARE FOR YOURSELF: Take advantage of our free virtual counseling resources through our global Employee Assistance Program. Your mental health is as important as your physical health.
• SECURE YOUR FUTURE: Plan for your future with our Roth and Pre-tax 401(k) options including an employer match for all participants.
• TAKE A BREAK: Enjoy a generous paid time off program. We value balance and understand that performance at work requires time to rest at home and/or rejuvenate on vacation.
• PUT FAMILY FIRST: We know that families can be built in a variety of ways; therefore, we offer paid parental leave and family planning support.
• WORK WHEREVER: Our flexible remote work offerings allow you to work wherever you’re the most productive and successful. It’s what you do, not where you work, that matters.
• MAKE AN IMPACT: Support betterment in your community and beyond by taking paid time off to support a volunteer program of your choice.

Our expert teams are built from some of the most experienced in the industry. We employ people from all over the world, from all walks of life and from all backgrounds. We work together, feeding on our diversity to make us stronger, and we encourage each other to be the best we can be. Innovation drives us, and we challenge ourselves every day. Get in touch and join us on our journey!

The annual starting salary for this position is between $120,786.00 - $140,179.00 per year. Factors which may affect starting pay within this range may include geography/market, skills, education, experience, and other qualifications.

This role will be accepting applications until 11/13/2024 at a minimum. Please note that the application timeline may be flexible to accommodate a comprehensive candidate evaluation.