Senior Scala Engineer

Duties:

Responsible for designing, building, and maintaining Demandbase's integration platform, which powers seamless ingestion, transformation and synchronization of customer data across various marketing, sales, and advertising platforms. This platform connects with key third-party services, including CRM systems (Salesforce, Microsoft Dynamics 365), marketing automation platforms (HubSpot, Marketo), intent data providers (G2, TrustRadius), and ad networks (Google Ads, Facebook Ads). It enables businesses to unify and act on their data, ensuring consistency and efficiency across their martech, adtech, and salestech operations. Design and develop a unified data integration framework using Scala, ZIO, and Cats, applying the functional programming paradigm to ensure composability and type safety. Build and maintain scalable, high-performance data processing pipelines leveraging cloud-based infrastructure such as Kubernetes, AWS, along with scalable storage solutions like S3. Utilize data streaming technologies including Apache Pulsar, Kafka, and SQS to handle large-scale data processing efficiently. Ensure referential transparency, immutability, and type safety in data transformations to enhance reliability and maintainability. Develop and optimize REST/GRPC based integrations with martech, adtech, and salestech solutions, enabling seamless interoperability within the Demandbase integration platform. Write clear documentation to convey plans and technical design. Develop unit, integration, and load tests to ensure system reliability and performance. Improve engineering standards, tooling, and processes, including GitLab CI/CD pipelines, monitoring frameworks using tools like Prometheus, Grafana and Datadog. Develop efficient rate-limiting strategies to handle high-throughput integrations. Ensure high reliability of all maintained product offerings by building real-time reporting dashboards and proactive monitoring mechanisms into the infrastructure. Own and operate the integrations and serve as a front-line responder for issues reported by customers, ensuring timely resolution and continuous improvements.

Education:

Master’s or foreign equivalent in Computer Engineering or related fields (e,g. Automation Engineering).

Experience:

3 years of experience in job offered or related occupation

Special Requirements:

Must have at least 2 years of prior work experience in each of the following:

1. Modern software design patterns, asynchronous programming, multithreading, functional programming paradigms, with experience in languages such as Scala or other functional languages, to write clean, maintainable, and efficient code for complex data processing tasks.

2. Scala and ZIO framework, JVM ecosystem tools for profiling, analyzing, and optimizing code performance. Designing and implementing CI/CD pipelines with GitLab CI and scripting with Python, Bash, jsonnet.

3. Both SQL(Postgres) and NoSQL (Redis) databases, encompassing database design, schema modeling, and management, and indexing strategies.

4. Utilizing Docker and Kubernetes for containerization and orchestration, and deployment processes.

5. Integration with different third-party systems including CRMs, advertising and marketing systems (e.g. Microsoft Dynamics, Salesforce, LinkedIn, Oracle Eloqua, Google, Meta, X, Liveramp etc.)

6. Event streaming platforms such as Kafka, Pulsar, SQS or similar technologies for real-time data processing and pipeline management.

7. Monitoring, alerting, and observability using Grafana, Datadog, and Prometheus, including setting up dashboards, defining key system metrics, and configuring alerts for performance and reliability.

Telecommuting allowed for this position

Salary:

$200,000 - $245,000 per year

Worksite:

222 2nd Street, 24th Floor, San Francisco, CA 94105

Applicant Instructions:

Must specify job code 93412 in reply. EOE.

Personal information that you submit will be used by Demandbase for recruiting and other business purposes. Our Privacy Policy explains how we collect and use personal information.