Canonical Circular Logo

Software Engineer - Data Infrastructure - Kafka

Canonical Dubai, United Arab Emirates Posted: 22 Nov 2024

Financial

  • Estimate: $60k - $90k*
  • Zero income tax location

Accessibility

  • Fully Remote
  • Apply from abroad
  • Visa Provided

Requirements

  • Experience: Unspecified
  • English: Professional

Position

Canonical is building a comprehensive automation suite to provide multi-cloud and on-premise data solutions for the enterprise. The data platform team is a collaborative group focused on developing managed solutions for a full range of data stores and technologies, including big data, NoSQL, cache-layer capabilities, analytics, and SQL engines.

The team faces the challenges of building fault-tolerant, mission-critical distributed systems and aims to deliver the world's best automation solution for managed data platforms. We are seeking candidates at all levels who have interests and experience with Big Data technologies, particularly distributed event-stores (Kafka) and parallel computing frameworks (Spark).

What Your Day Will Look Like:

  • Responsible for automating data platform operations and integrating Big Data platforms at scale.
  • Activities include ensuring fault-tolerant replication, TLS, installation, backups, and providing expertise to other teams.
  • Focus on the creation and automation of infrastructure features of data platforms rather than data analysis.
  • Collaborate proactively with a distributed team and write high-quality, idiomatic Python code.
  • Debrief and debug issues, interacting with upstream communities.
  • Engage with talented engineers and participate in finding solutions collaboratively.
  • Opportunity to work from home with global travel for internal and external events (2 to 4 weeks per year).

Requirements:

  • Proven hands-on experience in software development using Python.
  • Proven experience in distributed systems, particularly Kafka and Spark.
  • Bachelor's degree or equivalent in Computer Science, STEM, or a similar field.
  • Willingness to travel up to 4 times a year for internal events.

Additional Skills (Preferred, but not required):

  • Experience with data platform technologies (SQL: MySQL, PostgreSQL, Oracle, etc. and NoSQL: MongoDB, Redis, ElasticSearch, etc.).
  • Familiarity with Linux systems administration, package management, and infrastructure operations.
  • Experience with public cloud or private cloud solutions (e.g., OpenStack).
  • Knowledge of operating Kubernetes clusters for persistent data services.

What We Offer:

  • Competitive base pay influenced by geographical location, experience, knowledge, and skills.
  • Benefits including a personal learning and development budget ($2,000 per annum), annual compensation review, parental leave, employee assistance program, and more.
  • Fully remote working environment with opportunities for travel to meet colleagues twice a year.

About Canonical:
Canonical is a pioneering tech firm at the forefront of the global move to open source, known for publishing Ubuntu. As a remote-first company since 2004, we recruit globally, expecting excellence in our workforce. We foster a diverse and inclusive workplace, valuing the unique experiences and perspectives of every individual.

Apply now

Jobs you might like   View all jobs

About Canonical

We deliver open source to the world faster, more securely and more cost effectively than any other company. We're also the publishers of Ubuntu, the worldโ€™s most popular enterprise Linux from cloud to edge, together with a passionate global community of 200,000+ contributors.