Software Engineer - Data Infrastructure - Kafka

2 Months ago • All levels • Data Analysis

Job Summary

Job Description

The data platform team at Canonical is seeking a Software Engineer to automate multi-cloud and on-premise data solutions. The role involves developing managed solutions for various data stores and technologies, including big data, NoSQL, and SQL engines. The engineer will be responsible for creating and automating infrastructure features of data platforms, collaborating with a distributed team, writing Python code, and debugging issues. The position requires hands-on experience with distributed systems like Kafka and Spark. The engineer will also work with a team of engineers to find solutions and contribute to the open-source community. The work is fully remote, but travel for events may be required.
Must have:
  • Hands-on experience in software development using Python
  • Proven hands-on experience in distributed systems like Kafka and Spark
  • Bachelor’s or equivalent in Computer Science or STEM
  • Willingness to travel up to 4 times a year for internal events
Good to have:
  • Experience operating and managing data platform technologies like SQL or NoSQL
  • Experience with Linux systems administration and infrastructure operations
  • Experience with public or private cloud solutions like OpenStack
  • Experience with operating Kubernetes clusters
Perks:
  • Fully remote working environment
  • Personal learning and development budget of 2,000 USD per annum
  • Annual compensation review
  • Recognition rewards
  • Annual holiday leave
  • Parental Leave
  • Employee Assistance Programme
  • Opportunity to travel to new locations twice a year
  • Priority Pass for travel and travel upgrades for long haul company events

Job Details

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative team that develops a managed solutions for a full range of data stores and data technologies, spanning from big data, through NoSQL,  cache-layer capabilities, and analytics; all the way to structured SQL engines (similar to Amazon RDS approach). 

We are facing the interesting problem of fault-tolerant mission-critical distributed systems and intend to deliver the world's best automation solution for delivering managed data platforms. 

We are looking for candidates from junior to senior level with interests, experience and willingness to learn around Big Data technologies, such as distributed event-stores (Kafka) and parallel computing frameworks (Spark). Engineers who thrive at Canonical are mindful of open-source community dynamics and equally aware of the needs of large, innovative organisations.

Location: This is a Globally remote role

What your day will look like

The data platform team is responsible for the automation of data platform operations, with the mission of managing and integrating Big Data platforms at scale. This includes ensuring fault-tolerant replication, TLS, installation, backups and much more; but also provides domain-specific expertise on the actual data system to other teams within Canonical. This role is focused on the creation and automation of infrastructure features of data platforms, not analysing and/or processing the data in them.

  • Collaborate proactively with a distributed team
  • Write high-quality, idiomatic Python code to create new features
  • Debug issues and interact with upstream communities publicly
  • Work with helpful and talented engineers including experts in many fields
  • Discuss ideas and collaborate on finding good solutions
  • Work from home with global travel for 2 to 4 weeks per year for internal and external events

What we are looking for in you

  • Proven hands-on experience in software development using Python
  • Proven hands-on experience in distributed systems, such as Kafka and Spark
  • Have a Bachelor’s or equivalent in Computer Science, STEM, or a similar degree
  • Willingness to travel up to 4 times a year for internal events

Additional skills that you might also bring

You might also bring a subset of experience from the followings that can help Data Platform to achieve its challenging goals and determine the level we will consider you for:

  • Experience operating and managing other data platform technologies, SQL (MySQL, PostgreSQL, Oracle, etc) and/or NoSQL (MongoDB, Redis, ElasticSearch, etc), similar to DBA level expertise
  • Experience with Linux systems administration, package management, and infrastructure operations
  • Experience with the public cloud or a private cloud solution like OpenStack
  • Experience with operating Kubernetes clusters and a belief that it can be used for serious persistent data services

What we offer you

Your base pay will depend on various factors including your geographical location, level of experience, knowledge and skills. In addition to the benefits above, certain roles are also eligible for additional benefits and rewards including annual bonuses and sales incentives based on revenue or utilisation. Our compensation philosophy is to ensure equity right across our global workforce.  

In addition to a competitive base pay, we provide all team members with additional benefits, which reflect our values and ideals. Please note that additional benefits may apply depending on the work location and, for more information on these, please ask your Talent Partner.

  • Fully remote working environment - we’ve been working remotely since 2004!
  • Personal learning and development budget of 2,000USD per annum
  • Annual compensation review
  • Recognition rewards
  • Annual holiday leave
  • Parental Leave
  • Employee Assistance Programme
  • Opportunity to travel to new locations to meet colleagues twice a year
  • Priority Pass for travel and travel upgrades for long haul company events

About Canonical

Canonical is a pioneering tech firm that is at the forefront of the global move to open source. As the company that publishes Ubuntu, one of the most important open source projects and the platform for AI, IoT and the cloud, we are changing the world on a daily basis. We recruit on a global basis and set a very high standard for people joining the company. We expect excellence - in order to succeed, we need to be the best at what we do.

Canonical has been a remote-first company since its inception in 2004.​ Work at Canonical is a step into the future, and will challenge you to think differently, work smarter, learn new skills, and raise your game. Canonical provides a unique window into the world of 21st-century digital business.

Canonical is an equal-opportunity employer

We are proud to foster a workplace free from discrimination. Diversity of experience, perspectives, and background create a better work environment and better products. Whatever your identity, we will give your application fair consideration.

#li-remote

Similar Jobs

Inveniolsi - SAP Technical CDS BIS Associate Managing Consultant

Inveniolsi

India (On-Site)
2 Months ago
Sprinkler - Technical Success Manager - Core (Ads, Social, Marketing)

Sprinkler

Zürich, Zurich, Switzerland (On-Site)
1 Month ago
NVIDIA - GPU Power Architect - New College Grad 2025

NVIDIA

Canada (On-Site)
4 Months ago
Evil eye pictures - Affiliate Sr. Marketing Manager

Evil eye pictures

El Segundo, California, United States (On-Site)
3 Months ago
Ajmera Infotech - Accountant (US Books of Accounts)

Ajmera Infotech

Ahmedabad, Gujarat, India (On-Site)
4 Months ago
HCL Tech - Data scientist

HCL Tech

California, United States (On-Site)
2 Months ago
Quentus - Senior Data Engineer

Quentus

Argentina (Remote)
3 Weeks ago
luxsoft - Senior Business Analyst - Trade Finance

luxsoft

Bengaluru, Karnataka, India (On-Site)
1 Month ago
Dynamis Inc - Data Scientist/Knowledge Management Engineer

Dynamis Inc

Huntsville, Alabama, United States (On-Site)
2 Weeks ago
WebFX - Junior Customer Success Analyst (Data Focus)

WebFX

Harrisburg, Pennsylvania, United States (On-Site)
3 Months ago

Get notifed when new similar jobs are uploaded

Similar Skill Jobs

SSC Technologies - Client Experience Account Manager

SSC Technologies

Melbourne, Victoria, Australia (Hybrid)
1 Month ago
Sword Health - Senior Backend Engineer

Sword Health

Portugal (Remote)
5 Months ago
Crunchyroll - Customer Experience Operations Analyst

Crunchyroll

Culver City, California, United States (On-Site)
5 Months ago
Diligent Corporation - Staff Software Engineer in Test

Diligent Corporation

Budapest, Hungary (Hybrid)
2 Weeks ago
zeta - Manager, Data Engineering

zeta

Bengaluru, Karnataka, India (On-Site)
2 Months ago
Sailpoint - Senior Director, Regional Field Marketing - Americas Region

Sailpoint

United States (On-Site)
5 Days ago
Airlab Inc  - Artificial Intelligence Researcher

Airlab Inc

Montreal, Quebec, Canada (On-Site)
1 Year ago
Riot Games - Senior Data Scientist

Riot Games

Singapore (On-Site)
2 Months ago
Apple - Operations Test Engineer - Camera

Apple

Cupertino, California, United States (On-Site)
1 Month ago
Mindstorm studios - Software Engineer (AI/ML)

Mindstorm studios

Lahore, Punjab, Pakistan (On-Site)
2 Months ago

Get notifed when new similar jobs are uploaded

Jobs in Worldwide

Looks like we're out of matches

Set up an alert and we'll send you similar jobs the moment they appear!

Data Analysis Jobs

Capgemini - Data Business Analyst

Capgemini

Pune, Maharashtra, India (On-Site)
1 Month ago
Tide - Lead Data Engineer(Snowflake/DBT)

Tide

Bengaluru, Karnataka, India (Hybrid)
2 Months ago
Dynamis Inc - Data Scientist/Knowledge Management Engineer

Dynamis Inc

Huntsville, Alabama, United States (On-Site)
2 Weeks ago
Silicon Labs - Senior Data Engineer

Silicon Labs

Budapest, Hungary (On-Site)
1 Month ago
Rackspace Technology - R-19462 Data Engineer III - VN

Rackspace Technology

Vietnam (Remote)
6 Months ago
Nagarro - Senior Staff Consultant, Business Analyst

Nagarro

New York, New York, United States (On-Site)
9 Months ago
vertigoo games - Data Analyst

vertigoo games

Istanbul, İstanbul, Türkiye (On-Site)
2 Weeks ago
fortis games - Sr. QA Automation Engineer (Analytics-Data)

fortis games

Romania (Remote)
1 Month ago
Cubic corporation - Principal Data Analyst

Cubic corporation

Hyderabad, Telangana, India (On-Site)
1 Year ago
luxsoft - Senior/Lead Data Engineer

luxsoft

Türkiye (Remote)
2 Months ago

Get notifed when new similar jobs are uploaded