KCM Documentation

Your guide to installing, configuring, and operating Kafka Cluster Manager.

Community: 1 cluster free
Kubernetes / Helm OCI
Ingress: /api/v1 • /ws/v1
Screenshots + workflows

0. Quickstart

Pick your deployment path. Start with Community (free, 1 cluster) and upgrade to Pro whenever you’re ready.

Community (Free): 1 Kafka cluster • 1 Kafka Connect • 1 Schema Registry
Pro: multi-cluster • unlimited users • advanced diagnostics • enterprise integrations

Option A — Docker Compose (fastest)

  1. Clone the repository and open the Docker Compose example:
    git clone https://github.com/kcmhub/KCM.git
    cd KCM/00_kcm_with_docker_compose
  2. Create the shared Docker network:
    docker network create kcm-net
  3. Start the stack:
    docker compose up -d

This brings KCM online at http://localhost.

Option B — Kubernetes / Helm (OCI)

Licensed customers only: Helm chart is distributed as an OCI artifact via GHCR.
# Login to GHCR
helm registry login ghcr.io -u <GITHUB_USERNAME> -p <GITHUB_PAT>

# Install from OCI
helm upgrade --install kcm oci://ghcr.io/kcmhub/helm/kcm --version 0.1.0 \
  -n kcm --create-namespace -f values.yaml
Ingress routing
UI: / • API: /api/v1/ • WebSocket: /ws/v1/

1. Install KCM

Start for free in minutes. Upgrade to a licensed deployment whenever you’re ready.

Install free version

The Community build unlocks topic management, consumer monitoring, Kafka Connect, Schema Registry, and ACL tooling at no cost. For the fastest start, use Docker Compose (see Quickstart).

Docker Compose (recommended)

  1. Clone the repository and enter the Docker example directory:
    git clone https://github.com/kcmhub/KCM.git
    cd KCM/00_kcm_with_docker_compose
  2. Create the shared Docker network:
    docker network create kcm-net
  3. Start the services:
    docker compose up -d

This brings the full demo environment online at http://localhost.

Kubernetes / Helm: Licensed deployments can be installed via OCI Helm chart on GHCR. See Quickstart for the exact commands.

Pay & install license

Upgrade to Pro to unlock multi-cluster management, unlimited users, advanced diagnostics, and enterprise integrations.

  1. Go to the pricing page and click Subscribe.
  2. Once payment is confirmed, you’ll receive an email with your license key (and customer portal details).
  3. In the KCM web console, open Settings > License, then go to the Update tab.
  4. Select your preferred input method:
    • File: choose the license file and press Upload.
    • Copy / Paste: paste the raw license token if file uploads are blocked.
  5. KCM validates the signature and enables premium modules automatically. Confirm the status shows “Pro”.
KCM license upload dialog showing file selection
Upload your license file or paste the key directly in the Update tab.
Offline installs: If your cluster cannot reach the internet, contact support@kcmhub.io for an offline activation bundle.

After installing KCM, sign in with your administrator credentials to continue configuration.

KCM login page
The login screen is accessible at your deployed URL. Use your admin account to continue.

2. Connect your Kafka clusters

Create a group

Organize environments into groups (prod/stage/regions). This keeps operational contexts separated while using a single control plane.

  1. Open the Groups page.
  2. Click ADD to create a new group.
  3. Provide a name (e.g. cloud_prod) and select a color.
  4. Confirm, then press ENTER on the new card to open the group workspace.
KCM groups page listing existing environments
Start from the Groups page to review existing environments and create a new one.
Modal for creating a new KCM group with name and color
Choose a descriptive name and a clear environment color.
Group detail page showing colored banner
The header adopts the group color so you always know which environment you’re working in.

Register Kafka clusters

Register the Kafka clusters you want to manage inside the group.

  1. Inside the group, click ADD to open the wizard.
  2. In General, give the cluster a name and set bootstrap servers.
  3. In Security, select your protocol (PLAINTEXT/SASL/TLS) and provide credentials/certificates.
  4. Click Create, then use Test Connection to validate connectivity.
Add Kafka Cluster dialog showing cluster name, bootstrap servers, and metrics toggle
Fill in name, bootstrap servers, and optional metrics settings.
Security tab showing protocol, SASL mechanism, and credential inputs
Select the security protocol and provide the required credentials/certificates.
Edit Kafka Cluster dialog with Test Connection button
Use Test Connection to confirm the configuration is valid.
Green success toast after testing the connection
A green toast confirms the brokers responded successfully.

Pro supports up to five clusters. Enterprise supports unlimited Kafka clusters.

3. Explore the web console

Overview

The Overview tab provides an instant cluster snapshot: controller status, brokers, topics, partitions and Kafka version.

KCM overview dashboard showing broker health cards
Overview highlights broker health and key metrics to spot issues quickly.

Topics

Browse topics, review configs, inspect partitions and ISR, and tail messages without touching the CLI.

Topics list simple view
Topics list with core details like partitions and replication.
Topics list advanced view
Toggle advanced configs to reveal deeper metrics.
Topic row action menu
Edit, produce messages, delete or purge topics from the list.
  • Create, edit, delete topics
  • Purge accumulated data safely
  • Export tables to CSV
  • Inspect partitions and reassignments
Create topic modal
Create topics with partitions, replication and retention settings.
Advanced topic config screen
Advanced configs help tune retention, compression, and more.
Partitions assignment and reassignment
Visualize leaders/replicas and plan reassignment.

Consumer Groups

Monitor lag, reset offsets safely, and inspect partition-level progress without CLI operations.

Consumer groups list simple view
Essential consumer group state at a glance.
Consumer groups list advanced view
Advanced view adds coordinator and export controls.
Create consumer group dialog
Create a group and choose offset reset strategy.
Consumer group recap validation
Confirm exactly what will be applied before creation.
Lag by topic chart
Lag dashboards reveal back-pressure by topic.
Lag by partition view
Drill down by partition to find slow followers.

Kafka Connect

Deploy, pause, resume, and delete connectors. View connector configs with syntax highlighting and change history.

ACL Management

Create, modify, and audit ACL entries with rollback support. Exporting ACL sets as YAML for GitOps pipelines is on the roadmap.

Cluster Diagnostics

Run health checks, broker config diffs, and scans with remediation guidance.

4. Common workflows

Create a new topic

  1. Open Topics and click Create Topic.
  2. Fill in partitions, replication factor, and optional configs.
  3. Review the summary and confirm. KCM applies settings via the Kafka Admin API.

Produce a Kafka message

  1. In Topics, open the action menu for your target topic and choose Produce.
  2. Fill in headers (optional), the message key, and the payload value.
  3. If Schema Registry is connected, enable schema-aware validation for key/value as needed.
  4. Click Produce. A green toast confirms partition and offset.
  5. Use Save as Template to reuse the message later.
Produce message dialog
Produce messages with headers, keys, and schema-aware payloads.
Success toast after producing a message
Success toast confirms the exact partition and offset.
Save as template dialog
Save messages as templates for fast regression testing.

Apply a saved template

  1. In the Produce dialog, open Paste from template.
  2. Select a template and click Use this template.
  3. Confirm topic switching if the template belongs to a different topic.
Template dropdown in produce dialog
Pick templates scoped to this topic or from your full library.
Apply template confirmation
Apply the template to preload the message form instantly.
Template topic mismatch confirmation
Confirm whether to keep the current topic or switch to the template’s topic.

Consume Kafka messages

Use Data Consumer to tail records live, filter, replay and export results.

  1. Open Data Consumer, pick cluster and topic.
  2. Click Start to stream messages and Stop to pause.
  3. Apply filters by key/value/headers while consuming.
  4. Replay interesting messages or copy them as templates.
  5. Export captured data with Export to CSV.
Data Consumer topic selection
Select topic, partitions, and starting position before consuming.
Data Consumer filters dialog
Use filters to focus on the records you care about.
Consumed messages table
Stream, stop, and export at any time.
Headers view for a message
Inspect header key/value pairs on each message.
Replay or copy as template options
Replay messages or convert them into templates.

Deploy a Kafka Connect connector

  1. Go to Kafka Connect > New Connector.
  2. Choose the connector class.
  3. Paste/compose the JSON configuration.
  4. Validate and launch.

Audit changes

Browse the Audit section to view who changed what. Export audits to CSV or stream them to your SIEM.

5. CLI & automation

A lightweight CLI for scripting routine operations is on the product roadmap. The commands below preview the planned experience.

# List clusters
kcmctl clusters list

# Trigger diagnostics on a specific cluster
kcmctl diagnostics run --cluster prod-eu-1

# Export ACLs to YAML
kcmctl acls export --cluster prod-eu-1 --out acls.yaml

Authenticate with an API token via kcmctl login --token <your-token>. Tokens can be generated in the console under Profile > API Tokens.

6. Troubleshooting

Health checks fail

Verify broker reachability from the KCM host and confirm TLS certificates are trusted.

# Basic network check (example)
telnet <broker-host> 9092

WebSocket (/ws/v1) disconnects

Ensure your Ingress supports WebSocket upgrade and has sufficient timeouts.

# Inspect ingress annotations
kubectl -n <ns> describe ingress kcm

Connectors not visible

Ensure the Kafka Connect REST endpoint is reachable and your service account has the right permissions.

“Unauthorized” errors

Review RBAC assignments under Admin > Access Control. Each module has granular permissions.

Log locations: Application logs are available via container stdout (Docker/Kubernetes). Enable debug mode with KCM_LOG_LEVEL=debug for deeper tracing.

7. Need help?

We’re here to help you succeed with Kafka.

When contacting support, include:
Kubernetes version/distribution (if applicable), Ingress class/controller, KCM version, and relevant logs.