diff --git a/docs/upgrade.html b/docs/upgrade.html index 56efaffbd04a0..d5bc8c47f1cf9 100644 --- a/docs/upgrade.html +++ b/docs/upgrade.html @@ -38,6 +38,12 @@
The following are some of the updates in Kafka 4.0 release:
++ The password encoder-related configurations have been removed. These configurations were used in + ZooKeeper mode to define the key and backup key for encrypting sensitive data (e.g., passwords), + specify the algorithm and key generation method for password encryption (e.g., AES, RSA), and control + the key length and encryption strength. +
+password.encoder.secret
password.encoder.old.secret
password.encoder.keyfactory.algorithm
password.encoder.cipher.algorithm
password.encoder.key.length
password.encoder.iterations
+ In Kraft mode, Kafka stores sensitive data in records, and the data is not encrypted in Kafka. +
+
+ Removed control.plane.listener.name
. Kafka relies on ZooKeeper to manage metadata, but some
+ internal operations (e.g., communication between controllers (a.k.a., broker controller) and brokers)
+ still require Kafka’s internal control plane for coordination.
+
+ In KRaft mode, Kafka eliminates its dependency on ZooKeeper, and the control plane functionality is + fully integrated into Kafka itself. The process roles are clearly separated: brokers handle data-related + requests, while the controllers (a.k.a., quorum controller) manages metadata-related requests. The controllers + use the Raft protocol for internal communication, which operates differently from the ZooKeeper model. Use the + following parameters to configure the control plane listener: +
+controller.listener.names
listeners
listener.security.protocol.map
+ Removed graceful broker shutdowns-related configurations. These configurations were used in ZooKeeper mode + to define the maximum number of retries and the retry backoff time for controlled shutdowns. It can + reduce the risk of unplanned leader changes and data inconsistencies. +
+controlled.shutdown.max.retries
controlled.shutdown.retry.backoff.ms
+ In KRaft mode, Kafka uses the Raft protocol to manage metadata. The broker shutdown process differs from + ZooKeeper mode as it is managed by the quorum-based controller. The shutdown process is more reliable + and efficient due to automated leader transfers and metadata updates handled by the controller. +
++ Remove the broker id generation-related configurations. These configurations were used in ZooKeeper mode + to define the broker id, specify the broker id auto generation, and control the broker id generation process. +
+reserved.broker.max.id
broker.id.generation.enable
broker.id
+ Kafka use the node id in Kraft mode to identify servers. +
+node.id
+ Removed Zookeeper related configurations. +
+zookeeper.connect
zookeeper.session.timeout.ms
zookeeper.connection.timeout.ms
zookeeper.set.acl
zookeeper.max.in.flight.requests
zookeeper.ssl.client.enable
zookeeper.clientCnxnSocket
zookeeper.ssl.keystore.location
zookeeper.ssl.keystore.password
zookeeper.ssl.keystore.type
zookeeper.ssl.truststore.location
zookeeper.ssl.truststore.password
zookeeper.ssl.truststore.type
zookeeper.ssl.protocol
zookeeper.ssl.enabled.protocols
zookeeper.ssl.cipher.suites
zookeeper.ssl.endpoint.identification.algorithm
zookeeper.ssl.crl.enable
zookeeper.ssl.ocsp.enable
+ Remove the following metrics related to ZooKeeper.
+ ControlPlaneNetworkProcessorAvgIdlePercent
+ is to monitor the average fraction of time the network processors are idle. The other ControlPlaneExpiredConnectionsKilledCount
+ is to monitor the total number of connections disconnected, across all processors.
+
ControlPlaneNetworkProcessorAvgIdlePercent
ControlPlaneExpiredConnectionsKilledCount
+ In Kraft mode, Kafka also provides metrics to monitor the network processors and expired connections. + Use the following metrics to monitor the network processors and expired connections: +
+NetworkProcessorAvgIdlePercent
ExpiredConnectionsKilledCount
+ Remove the metrics which is monitoring the latency in milliseconds for ZooKeeper requests from broker. +
+kafka.server:type=ZooKeeperClientMetrics,name=ZooKeeperRequestLatencyMs
+ In Kraft mode, Zookeeper is not used, so the metrics is removed. +
+