package one10
- Alphabetic
- Public
- All
Type Members
- trait BaseKey extends AnyRef
-
case class
CommitRecordMetadataAndOffset(appendedBatchOffset: Option[Long], offsetAndMetadata: OffsetAndMetadata) extends Product with Serializable
We cache offset commits along with their commit record offset.
We cache offset commits along with their commit record offset. This enables us to ensure that the latest offset commit is always materialized when we have a mix of transactional and regular offset commits. Without preserving information of the commit record offset, compaction of the offsets topic it self may result in the wrong offset commit being materialized.
-
class
GroupMetadata extends Logging
Group contains the following metadata:
Group contains the following metadata:
Membership metadata:
- Members registered in this group 2. Current protocol assigned to the group (e.g. partition assignment strategy for consumers) 3. Protocol metadata associated with group members
State metadata:
- group state 2. generation id 3. leader id
- Annotations
- @nonthreadsafe()
- case class GroupMetadataKey(version: Short, key: String) extends BaseKey with Product with Serializable
-
case class
GroupOverview(groupId: String, protocolType: String) extends Product with Serializable
Case class used to represent group metadata for the ListGroups API
- case class GroupTopicPartition(group: String, topicPartition: TopicPartition) extends Product with Serializable
- case class LogConfig(props: Map[_, _], overriddenConfigs: Set[String] = Set.empty) extends AbstractConfig with Product with Serializable
-
case class
MemberMetadata(memberId: String, groupId: String, clientId: String, clientHost: String, protocolType: String, supportedProtocols: List[(String, Set[String])], assignment: Set[(String, Int)]) extends Product with Serializable
Member metadata contains the following metadata:
Member metadata contains the following metadata:
Heartbeat metadata: 1. negotiated heartbeat session timeout 2. timestamp of the latest heartbeat
Protocol metadata: 1. the list of supported protocols (ordered by preference) 2. the metadata associated with each protocol
In addition, it also contains the following state information:
1. Awaiting rebalance callback: when the group is in the prepare-rebalance state, its rebalance callback will be kept in the metadata if the member has sent the join group request 2. Awaiting sync callback: when the group is in the awaiting-sync state, its sync callback is kept in metadata until the leader provides the group assignment and the group transitions to stable
- case class OffsetKey(version: Short, key: GroupTopicPartition) extends BaseKey with Product with Serializable
Value Members
- object Defaults
- object GroupMetadata
-
object
GroupMetadataManager
Messages stored for the group topic has versions for both the key and value fields.
Messages stored for the group topic has versions for both the key and value fields. Key version is used to indicate the type of the message (also to differentiate different types of messages from being compacted together if they have the same field values); and value version is used to evolve the messages within their data types:
key version 0: group consumption offset -> value version 0: [offset, metadata, timestamp]
key version 1: group consumption offset -> value version 1: [offset, metadata, commit_timestamp, expire_timestamp]
key version 2: group metadata -> value version 0: [protocol_type, generation, protocol, leader, members]
- object LogConfig extends TopicConfigs with Serializable
- object MemberMetadata extends Serializable