Kafka catalog
Introduction
Kafka catalog is a messaging catalog that offers the ability to manage Apache Kafka topics' metadata. One Kafka catalog corresponds to one Kafka cluster.
Catalog
Catalog properties
Besides the common catalog properties, the Kafka catalog has the following properties:
| Property Name | Description | Default Value | Required | Since Version |
|---|---|---|---|---|
bootstrap.servers | The Kafka broker(s) to connect to, allowing for multiple brokers by comma-separating them. | (none) | Yes | 0.5.0 |
gravitino.bypass. | Property name with this prefix passed down to the underlying Kafka Admin client for use. (refer to Kafka Admin Configs for more details) | (none) | No | 0.5.0 |
Catalog operations
Refer to Catalog operations for more details.
Schema
A "default" schema, which includes all the topics in the Kafka cluster, will be automatically created when catalog is created.
Schema capabilities
- Since the "default" schema is read-only, it only supports loading and listing schema.
Schema properties
None.
Schema operations
Refer to Schema operation for more details.
Topic
Topic capabilities
- The Kafka catalog supports creating, updating, deleting, and listing topics.
Topic properties
| Property name | Description | Default value | Required | Since Version |
|---|---|---|---|---|
partition-count | The number of partitions for the topic. | if not specified, will use the num.partition property in the broker. | No | 0.5.0 |
replication-factor | The number of replications for the topic | if not specified, will use the default.replication.factor property in the broker. | No | 0.5.0 |
You can pass other topic configurations to the topic properties. Refer to Topic Configs for more details.
Topic operations
Refer to Topic operation for more details.