Senior Software Engineer - Core Ingest
Job Description
- Experience in big data and/or 24x7 commercial service.
- Happy working with Unix (Linux, OS X).
- Agile software development experience (test-driven development, iterative and incremental development).
- Design and implement extremely high-volume, fault-tolerant, scalable backend systems that process and manage petabytes of customer data.
- Improve algorithms built to schedule load on clusters of thousands of machines elastically at runtime.
- Improve systems to provide performance guarantees to customers in a shared-everything multi-tenant architecture.
- Lead and contribute to the re-architecting of internal message processing technology to petabyte per day scale.
- Help manage exabytes of data using technologies such as Kafka, Kubernetes and Docker.
- Work across Sumo interfacing with multiple teams including Search, Security and Metrics & Tracing to identify requirements and architect solutions to meet their data core ingest needs.
- B.S. or higher in Computer Sciences or related discipline.
- 5+ years of industry experience with a proven track record of ownership and delivery.
- Experience developing scalable distributed data processing solutions.
- Experience in multi-threaded programming.
- Experience in running large scalable distributed services following a microservice architecture.
- Hands-on object-oriented programming experience (e.g., Java, Scala).
- Excellent verbal and written communication skills.
- Willingness and experience with occasional on-call availability.
- Bonus or commission plans
- Benefits offerings
- Equity awards
Senior Software Engineer - Core Ingest
------------------------------------------
As a Senior Software Engineer - Core Ingest, you will actively contribute to the design and development of new distributed data processing capabilities. You will be instrumental in helping us solve complex low-latency, distributed systems challenges to handle our ever-increasing scale. Our system is a highly distributed, fault tolerant, multi-tenant platform that includes bleeding edge components related to storage, messaging, search, and analytics. This system ingests and analyzes petabytes of data a day, while making exabytes of data available for search and forensic analysis.
Responsibilities
- Designing and implementing extremely high-volume, fault-tolerant, scalable backend systems that process and manage petabytes of customer data.
- Work to improve algorithms built to schedule load on clusters of thousands of machines elastically at runtime.
- Improve systems to provide performance guarantees to customers in a shared-everything multi-tenant architecture.
- Lead and contribute to the re-architecting of our internal message processing technology to petabyte per day scale.
- Help manage exabytes of data using the latest and greatest technologies such as Kafka, Kubernetes and Docker.
- Work across Sumo interfacing with multiple teams including Search, Security and Metrics & Tracing to identify requirements and architect solutions to meet their data core ingest needs.
Required Qualifications and Skills
- B.S. or higher in Computer Sciences or related discipline (M.S. a plus)
- 5+ years of industry experience with a proven track record of ownership and delivery
- Experience developing scalable distributed data processing solutions
- Experience in multi-threaded programming
- Experience in running large scalable distributed services following a microservice architecture
- Hands-on object-oriented programming experience (e.g., Java, Scala)
- Excellent verbal and written communication skills
- Willingness and experience with occasional on-call availability. Rotations scheduled approximately every 6-8 weeks for a 12 hour timeline, duration 1 week primary, 1 week to assist primary only if needed, starting 9-11am PDT/MDT/CDT and ending 12 hours later.
Desired Qualifications and Skills
- Experience in big data and/or 24x7 commercial service is highly desirable.
- You should be happy working with Unix (Linux, OS X).
- Agile software development experience (test-driven development, iterative and incremental development) is a plus.
The expected annual base salary range for this position is $165,000 - $193,000. Compensation varies based on a variety of factors which include (but aren’t limited to) role level, skills and competencies, qualifications, knowledge, location, and experience. In addition to base pay, certain roles are eligible to participate in our bonus or commission plans, as well as our benefits offerings, and equity awards.
Must be authorized to work in the United States at time of hire and for duration of employment. At this time, we are not able to offer nonimmigrant visa sponsorship for this position.
