Staff Software Engineer - Kora Orchestration

Confluent • United States, United States • 2w ago

Location: CA Remote Ontario

Employment Type: FullTime

Department Engineering

Overview

We're not just building better tech. We're rewriting how data moves and what the world can do with it. With Confluent, data doesn't sit still. Our platform puts information in motion, streaming in near real-time so companies can react faster, build smarter, and deliver experiences as dynamic as the world around them.

It takes a certain kind of person to join this team. Those who ask hard questions, give honest feedback, and show up for each other. No egos, no solo acts. Just smart, curious humans pushing toward something bigger, together.

One Confluent. One Team. One Data Streaming Platform.

About the Role:

Our team is responsible for managing the metadata that makes Kafka a reliable, fault-tolerant, and high-performance distributed streaming platform. This includes coordinating the election of leaders, monitoring broker availability, persisting and distributing metadata, coordinating cluster-wide actions, and more. In this role, you will be working on building a highly available, reliable, secure, scalable, and multi-tenant metadata layer. You will be instrumental in driving the technical solutions end-to-end, working closely with the team and key stakeholders to design, architect, and develop top-notch solutions. The team recently completed a major initiative to implement its own consensus protocol based on the Raft protocol. This new protocol, named Kraft, has allowed the team to remove the dependency on Zookeeper which allows for more scalable and robust metadata management as well as a more simple deployment model for Kafka. Here are examples of some of the challenges we've taken on in recent years:

Kora: A Cloud-Native Event Streaming Platform For Kafka (https://www.vldb.org/pvldb/vol16/p3822-povzner.pdf) KRaft: Apache Kafka Without ZooKeeper

Why ZooKeeper Was Replaced with KRaft - The Log of All Logs (https://www.confluent.io/blog/why-replace-zookeeper-with-kafka-raft-the-log-of-all-logs/) KIP-866: ZooKeeper to KRaft Migration

KIP-853: KRaft Controller Membership Changes (https://cwiki.apache.org/confluence/display/KAFKA/KIP-853%3A+KRaft+Controller+Membership+Changes)

What You Will Do:

As a Staff Software Engineer, you will be a technical leader whose work significantly impacts the product, engineering organization, and customer success.

Drive the end-to-end delivery of complex, multi-quarter technical projects and critical infrastructure components from concept to production, setting a high bar for operational excellence, scalability, reliability, and security.

Act as a primary technical escalation point for complex, elusive production issues and architectural challenges. Proactively identify systemic weaknesses and drive large-scale refactoring or architectural changes to prevent future recurrence.

Exert influence across multiple teams and organizational boundaries (e.g., product, support, engineering) to align technical direction, mitigate cross-cutting risks, and ensure cohesive, high-quality solution delivery.

Serve as a technical voice of the customer, anticipating future needs and translating ambiguous, high-level business problems into clear, executable technical strategies and architectures that drive significant customer value and product adoption.

Act as a force multiplier by actively mentoring and coaching engineers and elevating the overall technical acumen and best practices across the organization.

What You Will Bring:

BS, MS, or PhD in computer science or a related field, or equivalent work experience.

8+ years of progressive experience in designing, building, and operating large-scale, mission-critical distributed systems (or equivalent expertise).

Deep, expert-level understanding of distributed systems fundamentals, including consensus protocols (e.g., Raft/Paxos), consistency models (e.g., strong, eventual), fault-tolerance, and high-availability architecture.

Experience building and operating large-scale systems in the Cloud.

Solid understanding of basic systems operations (disk, network, operating systems, etc.).

Demonstrated history of mentoring engineers and driving significant improvement in engineering practices and operational rigor across multiple teams.

Proficiency in Java, Scala, C/C++, Go or other statically @typed languages.

What Gives You an Edge:

Expert-level proficiency in Java and the JVM ecosystem, including threading, performance tuning, and diagnostics.

Hands-on experience with consensus algorithms (Raft, Paxos, etc.), or experience operating large-scale coordination services (ZooKeeper, etcd, Consul).

A strong background in distributed storage systems or databases.

Experience/knowledge with public clouds (AWS, Azure or GCP).

Interest in evangelism (giving talks at tech conferences, writing blog posts evangelizing Kafka).

Ready to build what's next? Let's get in motion.

Come As You Are

Belonging isn't a perk here. It's the baseline. We work across time zones and backgrounds, knowing the best ideas come from different perspectives. And we make space for everyone to lead, grow, and challenge what's possible.

We're proud to be an equal opportunity workplace. Employment decisions are based on job-related criteria, without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other classification protected by law.

Similar Jobs

Class 1 Engineer- Refrigeration Mechanics.

Omni Hotels • Orlando, FL • 36min ago

IT & Engineering

Location Orlando Resort at Championsgate The Omni Orlando Resort at ChampionsGate is surrounded by 36 holes of championship Orlando golf and 15 acres of recreation, this four-diamond resort is one of the nation's premier...

36min ago

Go to Apply

Research Engineering/Scientist Associate I

UNIVERSITY OF TEXAS AT AUSTIN • Austin, TX • 43min ago

IT & Engineering

span technical, experimental, and administrative tasks across biomechanics, materials, and engineering applications.PurposeContribute to laboratory research and operations by supporting experimental biomechanics studies,...

43min ago

Go to Apply

Quality Assurance Specialist_Shift_2

Neovia Logistics • Indianapolis, IN • 45min ago

IT & Engineering

JOB SUMMARY The Quality Assurance Specialist position will perform and prioritize a multitude of complex duties in the areas of operations, including forecast analysis, grief resolution, slotting and product movement, co...

45min ago

Go to Apply

Technician III - VMWare (149927)

COMPUTER CONSULTANTS INTERNATIONAL • Madison, WI • 46min ago

IT & Engineering

JOB REQUIREMENTS: The Universities of Wisconsin-Systems Administration seeks a contractor to help augment our Systems and Engineering team that oversees our IT infrastructure and server systems. The current team members...

46min ago

Go to Apply

Lead Network Engineer

Nightwing • Sterling, VA • 50min ago

IT & Engineering

Nightwing provides technically advanced full-spectrum cyber, data operations, systems integration and intelligence mission support services to meet our customers' most demanding challenges. Our capabilities include cyber...

50min ago

Go to Apply

Engineer 3 - Engineering - Embassy Suites Tampa Downtown Convention Center

Hilton • Tampa, FL • 54min ago

IT & Engineering

An Engineer is responsible for maintaining the physical functionality and safety of the facility in the hotel's continuing effort to deliver outstanding guest service and financial profitability. What will I be doing? As...

54min ago

Go to Apply

Diag Rad Tech (Compt Tom)

Veterans Affairs, Veterans Health Administration • Durham, NC • 1h ago

IT & Engineering

Summary The incumbent's primary responsibilities are in the performance of Computerized Tomographic (CT) examinations. Independently performs computerized tomography of the head, neck spine, chest, body and extremities....

1h ago

Go to Apply

Rad Tech Full Time Nights

Baptist Health Systems • Elizabethtown, KY • 1h ago

IT & Engineering

SummaryJob Description:Rad Tech - Diagnostic ImagingFull-time, third shift Job Description:- At the administrative direction of the Radiology Director, Manager, and the clinical Direction of the Radiologist/Team Leader,...

1h ago

Go to Apply

Associate Municipal Engineer

Pennoni Associates Inc • King Of Prussia, PA • 1h ago

IT & Engineering

Job Description Pennoni is hiring! In particular, we are looking for an Associate Engineer to contribute to our water & wastewater projects on a full-time, direct basis at our office in King of Prussia, PA. Primary R...

1h ago

Go to Apply

C ++ Programmer

KBR • Beavercreek, OH • 1h ago

IT & Engineering

Title: C ++ Programmer Belong, Connect, Grow, with KBR! Program Summary KBR is searching for an experienced C++ Programmer to study, design, prepare specifications, and perform services related to electrical and electron...

1h ago

Go to Apply

Subscribe to get new jobs sent directly to you
(no charge, cancel anytime)

This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.