Korvet

Korvet is a Kafka-compatible streaming service backed by Redis Streams.

This documentation is for Korvet version 0.1.1.

Korvet is developed by Redis Field Engineering. To report bugs, request features, or receive assistance, please file an issue.

Overview

Korvet provides a Kafka-compatible API backed by Redis Streams:

  • Kafka compatibility: Use existing Kafka clients and tools

  • Redis Streams: High-performance, durable message storage

  • Consumer groups: Coordinated consumption with offset tracking

  • Low latency: Sub-millisecond read/write performance

Key Features

  • Kafka Protocol Support: Compatible with Kafka clients (produce, consume, consumer groups)

  • Redis Streams: High-performance storage with built-in persistence

  • Consumer Groups: Full support for coordinated consumption and offset management

  • Admin API: Create/delete topics, configure retention, describe cluster

  • Spring Boot: Production-ready with metrics, health checks, and observability

Architecture

Korvet consists of several modules:

  • korvet-common: Shared utilities and common functionality

  • korvet-core: Kafka protocol implementation, message mapping, and topic management

  • korvet-storage: Flink integration for archival to Delta Lake (separate job)

  • korvet-server: Spring Boot application module

Use Cases

  • Kafka alternative: Lightweight Kafka-compatible streaming on Redis

  • Kafka migration: Gradual migration from Kafka to Redis-based streaming

  • Low-latency streaming: Sub-millisecond message delivery

  • Simplified operations: Single Redis instance instead of Kafka cluster