Job Description
Brahma is seeking a Data Engineer to architect and maintain data pipelines for their AI-native products. The role involves working at the intersection of Machine Learning, media processing, and infrastructure, owning the data tooling and automation layer for scalable training and inference. Responsibilities include designing and maintaining data ingestion and processing pipelines, developing automation tools, writing and maintaining pipeline tests, building observability tooling, collaborating with cross-functional teams, debugging data issues, optimizing storage and retrieval strategies for media assets, deploying scalable data infrastructure on cloud and on-premise environments, and staying current with industry trends.
Good To Have:
- Experience with Kubernetes (k8s)
- Knowledge of machine learning or AI concepts
- Familiarity with ETL tools or big data frameworks
- Familiarity with cloud platforms (AWS, GCP, Azure)
Must Have:
- 3+ years in data engineering or related backend/infrastructure
- Strong programming skills in Python or similar
- Experience with SDLC and CI/CD pipelines
- Proven experience building and testing data pipelines
- Proficiency in Linux
- Solid SQL knowledge
- Experience with Docker or other containerization
- Proactive problem-solving for technical challenges
- Passion for system optimization and learning
- Ability to adapt solutions for multimedia data
Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale. Brahma enables teams to break creative bottlenecks, accelerate storytelling, and deliver standout content with speed and efficiency. Part of the DNEG Group, Brahma brings together Hollywood’s leading creative technologists, innovators in AI and Generative AI, and thought leaders in the ethical creation of AI content.
Job Description
As a Data Engineer, you’ll architect and maintain the pipelines that power our products and services. You’ll work at the intersection of ML, media processing, and infrastructure; owning the data tooling and automation layer that enables scalable, high-quality training and inference. If you’re a developer who loves solving tough problems and building efficient systems, we want you on our team.
Key Responsibilities
- Design and maintain scalable pipelines for ingesting, processing, and validating datasets with main focus visual and voice data.
- Work with other teams to identify workflow optimisation potential, design and develop automation tools, using AI-driven tools and custom model integrations and scripts.
- Write and maintain tests for pipeline reliability.
- Build and maintain observability tooling in collaboration with other engineers to track data pipeline health and system performance.
- Collaborate with data scientists, operators, and product teams to deliver data solutions.
- Debug and resolve complex data issues to ensure system performance.
- Optimise storage, retrieval, and caching strategies for large media assets across environments.
- Deploy scalable data infrastructure using cloud platforms as well as on-premise and containerization.
- Deepen your knowledge of machine learning workflows to support AI projects.
- Stay current with industry trends and integrate modern tools into our stack.
Must Haves
- 3+ years in data engineering or related backend/infrastructure role.
- Strong programming skills in Python or similar languages.
- Experience with software development lifecycle (SDLC) and CI/CD pipelines.
- Proven experience building and testing data pipelines in production.
- Proficiency in Linux.
- Solid SQL knowledge.
- Experience with Docker or other containerisation technologies.
- Proactive approach to solving complex technical challenges.
- Passion for system optimisation and continuous learning.
- Ability to adapt solutions for multimedia data workflows.
Nice to Have
- Experience with Kubernetes (k8s).
- Knowledge of machine learning or AI concepts.
- Familiarity with ETL tools or big data frameworks.
- Familiarity with cloud platforms (e.g., AWS, GCP, Azure).
About You
- Innovative
- Like challenges
- Adaptable
- Calm under pressure
- Strong communication abilities
About Us
We are DNEG, one of the world’s leading visual effects and animation companies for the creation of award-winning feature film, television, and multiplatform content. We employ more than 9,000 people with worldwide offices and studios across North America (Los Angeles, Montréal, Toronto, Vancouver), Europe (London), Asia (Bangalore, Mohali, Chennai, Mumbai) and Australia (Sydney).
At DNEG, we fundamentally believe that embracing our differences is a vital component of our collective success. We are committed to creating an equitable, diverse and inclusive work environment for our global teams, where everyone feels they matter and belong. We welcome and encourage applications from all, regardless of background, experience or disability. Please let us know if you need any adjustments or support during the application process, we will do our best to accommodate your needs. We look forward to meeting you!
Set alerts for more jobs like Data Engineer
Set alerts for new jobs by DNEG
Set alerts for new Data Analysis jobs in United Kingdom
Set alerts for new jobs in United Kingdom
Set alerts for Data Analysis (Remote) jobs
.png%3F1676067498&w=96&q=75){kind=small}
