Apache Kafka
Overview
Apache Kafka is a distributed event streaming platform for high-throughput, fault-tolerant real-time data pipelines. It organizes data into topics with partitioned, replicated logs. Kafka is used for event sourcing, log aggregation, and stream processing, and is available as a managed service on Confluent Cloud, Amazon MSK, Aiven, and Redpanda.
Driver
- Crate:
rdkafka - Version:
0.39
Connection fields
| Field | Description |
|---|---|
| Host | Hostname or IP address of a Kafka broker. |
| Port | Broker port for the Kafka protocol. |
| User | SASL authentication username. |
| Password | SASL authentication password. Stored in the macOS Keychain. |
| Schema Reg | URL of the Confluent Schema Registry (e.g. http://localhost:8081). |
| SASL | SASL mechanism: None, PLAIN, SCRAM-SHA-256, or SCRAM-SHA-512. |
| Options | Additional connection parameters as key1=val1&key2=val2. |
All connections also support an optional SSH tunnel. Configure the bastion host, port, user, and private key file under the SSH section of the connection form. See SSH tunnels for details.
Schema browser
Once connected, Arris fetches the cluster metadata and organizes it into groups.
The schema tree displays the following object types, grouped by category:
- Topics — Kafka topics
- Consumer Groups — consumer groups and their offsets
Double-click any topic to open it in a new tab with browse mode.
Supported SQL commands
| Command | Notes |
|---|---|
SELECT | Read messages from a topic, with WHERE filters and aggregates. |
Unsupported SQL commands
| Command | Notes |
|---|---|
INSERT | Topics are append-only streams; Arris reads but does not produce. |
UPDATE | Topics are append-only streams; Arris reads but does not produce. |
DELETE | Topics are append-only streams; Arris reads but does not produce. |
CREATE / DROP | Topic management is not available through Arris. |