Software Engineer II

In this role, you'll contribute to a Scala-based data processing platform, helping to design, develop, and maintain robust, scalable services that manage large volumes of data. The ideal candidate has experience with distributed systems, functional programming, and cloud infrastructure. This is a great opportunity to work with a modern Scala stack and integrate with AWS and GCP to build resilient, observable services for large-scale data operations.

There is no application deadline for this role.

Software Engineer II Responsibilities:

• Design, develop, and maintain services for data ingestion, transformation, and analytics.
• Build scalable and reliable distributed systems using Scala and modern cloud platforms.
• Integrate with AWS and GCP services for storage, authentication, and data processing.
• Implement asynchronous and concurrent programming patterns for high-performance applications.
• Write unit, component, and integration tests to ensure code quality and reliability.
• Troubleshoot and resolve issues in distributed, cloud-based environments.
• Collaborate with team members using Git-based workflows and code reviews.

Software Engineer II Qualifications:

• Scala proficiency, including build management with sbt.
• Strong understanding of functional programming concepts.
• Experience with JSON serialization/deserialization (e.g., Circe).
• Familiarity with AWS and/or GCP authentication/authorization (IAM, STS, AssumeRole, WebIdentity).
• Integration with AWS SDKs (e.g., S3, STS).
• Experience with Google BigQuery and Dataflow.
• Strong knowledge of SQL and PostgreSQL.
• Experience with asynchronous and concurrent programming (e.g., FS2, cats-effect).
• Familiarity with distributed messaging systems (e.g., Google Pub/Sub).
• Strong testing background: unit, component, and integration.
• Experience with Git and collaborative development workflows.
• Experience with Finagle or similar RPC frameworks (preferred).
• Familiarity with data pipeline orchestration and workflow management (preferred).
• Knowledge of containerization and deployment in Kubernetes environments (preferred).
• Strong problem-solving and debugging abilities.
• Effective written and verbal communication.
• Collaborative team player with the ability to mentor peers.
• Commitment to writing clear, maintainable, and well-documented code.
• Bachelor’s degree in Computer Science or related field, or equivalent experience.
• 3+ years of professional software engineering experience, preferably in data engineering or backend systems.