Senior Software Engineer - Content Platform
About AlphaSense:
AlphaSense provides an AI-based search engine for market intelligence, used by the largest and fastest-growing firms globally. Our mission is to curate and semantically index the world’s market and company information, including the vast high-value content sets that traditional web search engines cannot reach. With 3500+ enterprise clients, AlphaSense helps knowledge professionals become dramatically more productive, and gain an information edge by discovering critical data points and trends that others miss.
Check out what we’ve built so far: https://vimeo.com/360622663/fa460b394e
weAlphaSense culture: https://www.youtube.com/watch?v=OvkCzvolyaY
The Role:
You will join our team of world-class experts developing the AlphaSense platform. The team is right at the very core of what we do and responsible for implementing cutting-edge technology for scalable, distributed processing of millions of documents.
We are seeking a highly skilled Senior Software Engineer to join our dynamic team responsible for building and maintaining data ingestion systems at scale. As a key member of our team, you will play a crucial role in designing, implementing, and optimizing robust solutions for ingesting millions of documents per month, including the addition of multimedia content such as audio and video from the public web. You are a good fit if you're a proactive problem-solver with a “go-getter” attitude, startup experience, and a readiness to learn whatever comes your way!
What You’ll Do:
- Design, develop, and maintain scalable data ingestion pipelines to process large volumes of documents efficiently and reliably.
- Collaborate with cross-functional teams to understand requirements and translate them into technical specifications and system designs.
- Implement best practices for data ingestion, storage, and processing to ensure high performance, scalability, and reliability.
- Integrate multimedia content ingestion capabilities into existing data pipelines, leveraging appropriate technologies and APIs to retrieve and process audio and video files from the public web.
- Optimize data ingestion workflows to improve throughput, reduce latency, and minimize resource utilization.
- Monitor system performance, troubleshoot issues, and implement solutions to address bottlenecks and ensure smooth operation.
- Stay up-to-date with emerging technologies and industry trends related to data ingestion and multimedia processing, and propose innovative solutions to enhance our capabilities.
- Work closely with Product Management to translate product requirements into software architectures
- Follow the engineering processes, DevOps practices, and trends inside the company (monitoring, alerting, performance optimization, integration testing, design documentation) and make sure the teams improve related knowledge as well
Responsibilities:
- Design, develop, and maintain high-performance, scalable applications using Python.
- Solve complex technical challenges with innovative solutions that enhance product features and operational efficiencies.
- Collaborate across teams to integrate applications, optimize system performance, and streamline data flows.
- Take full ownership of projects from inception to deployment, delivering high-quality solutions that improve user experience.
- Lead or support data ingestion processes, ensuring seamless data flow and management.
- Continuously learn and adapt to new tools, frameworks, and technologies as they arise, embracing a growth mindset.
- Mentor and guide junior developers, fostering a collaborative, innovative culture.
Requirements:
- 4+ years of professional Python development experience, with a strong understanding of Python frameworks (Django, Flask, FastAPI, etc.).
- Proven success working in a startup environment, demonstrating adaptability and flexibility in fast-changing conditions.
- Proactive problem-solver with a keen eye for tackling challenging technical issues.
- A willingness to learn and adapt to new technologies and challenges as they arise.
- Strong team player with a go-getter attitude, comfortable working both independently and within cross-functional teams.
Nice-to-Have:
- Experience with any cloud platforms (AWS, Azure, GCP).
- Knowledge of data processing, microservices architecture, or DevOps practices.
- Experience with media processing is a major plus.
