59 Pull requests merged by 29 people

• KAFKA-18648: Add back support for metadata version 0-3

  #18716 merged Jan 29, 2025

• Mark Flaky tests for Jan 27

  #18719 merged Jan 28, 2025

• KAFKA-17951: Share parition rotate strategy

  #18651 merged Jan 28, 2025

• KAFKA-18629: Delete share group state impl [1/N]

  #18712 merged Jan 28, 2025

• MINOR: clean up zk comment

  #18646 merged Jan 28, 2025

• KAFKA-18657: Fixing SharePartitionManager flaky test

  #18710 merged Jan 28, 2025

• KAFKA-17162: join() started thread in DefaultTaskManagerTest

  #18570 merged Jan 28, 2025

• KAFKA-18528: MultipleListenersWithSameSecurityProtocolBaseTest and GssapiAuthenticationTest should run for async consumer

  #18555 merged Jan 27, 2025

• KAFKA-18597 Fix max-buffer-utilization-percent is always 0 for 3.9

  #18690 merged Jan 27, 2025

• KAFKA-18541: fix flaky KafkaStreamsTelemetryIntegrationTest

  #18569 merged Jan 27, 2025

• Kafka 17792 header parsing times out processing and using large quantities of memory if the string looks like a number

  #17510 merged Jan 27, 2025

• KAFKA-18632: Added few share consumer multibroker tests.

  #18679 merged Jan 27, 2025

• Minor: Cherry pick Streams's State directory lock back off retry to 3.8

  #18660 merged Jan 27, 2025

• KAFKA-18631: Remove ZkConfigs

  #18693 merged Jan 25, 2025

• MINOR: Remove EMPTY_NODE_ID

  #18707 merged Jan 25, 2025

• KAFKA-18642: Increased the timeouts in share_consumer_test.py system tests

  #18699 merged Jan 25, 2025

• KAFKA-18555: Avoid casting MetadataCache to KRaftMetadataCache

  #18632 merged Jan 25, 2025

• MINOR: add removed controller metrics to zk2kraft

  #18654 merged Jan 25, 2025

• KAFKA-18533: Remove KafkaConfig zookeeper related logic

  #18547 merged Jan 25, 2025

• KAFKA-18639: Enable the @Flaky annotation for some flaky tests

  #18701 merged Jan 25, 2025

• KAFKA-18499 Clean up zookeeper from LogConfig

  #18583 merged Jan 25, 2025

• KAFKA-18529: ConsumerRebootstrapTest should run for async consumer

  #18554 merged Jan 24, 2025

• Kafka-16540: Update partitions if min isr config is changed.

  #18148 merged Jan 24, 2025

• KAFKA-13722: remove usage of old ProcessorContext

  #18292 merged Jan 24, 2025

• KAFKA-17894: Implemented broker topic metrics for Share Group 1/N (KIP-1103)

  #18444 merged Jan 24, 2025

• KAFKA-18630: Clean ReplicaManagerBuilder

  #18687 merged Jan 24, 2025

• KAFKA-17587 Refactor test infrastructure

  #18602 merged Jan 24, 2025

• KAFKA-18474: Remove zkBroker listener

  #18477 merged Jan 24, 2025

• KAFKA-18616; Refactor DumpLogSegments's MessageParsers

  #18688 merged Jan 24, 2025

• KAFKA-16372 Fix producer doc discrepancy with the exception behavior

  #15574 merged Jan 24, 2025

• KAFKA-18590: Cleanup DelegationTokenManager

  #18618 merged Jan 24, 2025

• KAFKA-18559: Cleanup FinalizedFeatures

  #18593 merged Jan 24, 2025

• KAFKA-18597 Fix max-buffer-utilization-percent is always 0

  #18627 merged Jan 24, 2025

• KAFKA-18620: Remove UnifiedLog#legacyFetchOffsetsBefore

  #18686 merged Jan 24, 2025

• MINOR: cleanup ProcessorContextImplTest

  #18682 merged Jan 24, 2025

• KAFKA-18592: Cleanup ReplicaManager

  #18621 merged Jan 23, 2025

• MINOR: restore testGetAllTopicMetadataShouldNotCreateTopicOrReturnUnknownTopicPartition

  #18633 merged Jan 23, 2025

• MINOR: Refactor ShareConsumerTest to use ClusterTestExtensions.

  #18656 merged Jan 23, 2025

• KAFKA-18324: Add CurrentAssignmentBuilder

  #18476 merged Jan 23, 2025

• MINOR: Update the Outdated method name

  #18645 merged Jan 23, 2025

• KAFKA-13810 Document behavior of KafkaProducer.flush() w.r.t callbacks

  #12042 merged Jan 23, 2025

• KAFKA-18484 [2/2]; Handle exceptions during coordinator unload

  #18667 merged Jan 23, 2025

• KAFKA-18488: Additional protocol tests for share consumption

  #18601 merged Jan 23, 2025

• MINOR: Cleanup zk condition in TransactionsTest, QuorumTestHarness and PlaintextConsumerAssignorsTest

  #18639 merged Jan 23, 2025

• MINOR: use toList api

  #18655 merged Jan 23, 2025

• MINOR: Make forceUnmap protected since the only test class that references it is in the same package now.

  #18638 merged Jan 23, 2025

• KAFKA-18486; [1/2] Update LocalLeaderEndPointTest

  #18666 merged Jan 23, 2025

• Implement kafka-streams-groups.sh --describe

  #18231 merged Jan 23, 2025

• MINOR: add the removed topic metrics to zk2kraft

  #18658 merged Jan 23, 2025

• KAFKA-18575: Transaction Version 2 doesn't correctly handle race condition with completing and new transaction

  #18604 merged Jan 22, 2025

• KAFKA-18517: Enable ConsumerBounceTest to run for new async consumer

  #18532 merged Jan 22, 2025

• MINOR: fix LogCleanerManagerTest.testLogsUnderCleanupIneligibleForCompaction() for Defaults.LogMessageTimestampType = "LogAppendTime"

  #12333 merged Jan 22, 2025

• KAFKA-18519: Remove Json.scala, cleanup AclEntry.scala

  #18614 merged Jan 22, 2025

• KAFKA-18599: Remove Optional wrapping for forwardingManager in ApiVersionManager

  #18630 merged Jan 22, 2025

• KAFKA-18229: Move configs out of "kraft" directory

  #18389 merged Jan 22, 2025

• KAFKA-18484 [1/N]; Handle exceptions from deferred events in coordinator

  #18661 merged Jan 22, 2025

• KAFKA-18392: Ensure client sets member ID for share group

  #18649 merged Jan 22, 2025

• Cherry-pick KAFKA-18583 fix (#18635) to 3.9

  #18657 merged Jan 22, 2025

• KAFKA-18518: Add processor to handle rebalance events

  #18527 merged Jan 22, 2025

50 Pull requests opened by 29 people

• KAFKA-18619: New consumer topic metadata events should set requireMetadata flag

  #18668 opened Jan 22, 2025

• KAFKA-18621: Add StreamsCoordinatorRecordHelpers

  #18669 opened Jan 22, 2025

• [KAFKA-15579] Create GetReplicaLogInfo* handlers

  #18670 opened Jan 22, 2025

• [KAFKA-16720] AdminClient Support for ListShareGroupOffsets (2/2)

  #18671 opened Jan 22, 2025

• KAFKA-18618: Improve leader change handling of acknowledgements

  #18672 opened Jan 22, 2025

• KAFKA-18572: Update Kafka Streams metric documenation

  #18673 opened Jan 22, 2025

• MINOR: prevent exception from HdrHistogram

  #18674 opened Jan 22, 2025

• [WIP] KAFKA-16717 Add AdminClient.alterShareGroupOffsets

  #18675 opened Jan 23, 2025

• KAFKA-18325: Add TargetAssignmentBuilder

  #18676 opened Jan 23, 2025

• MINOR: KafkaProducerTest - Fix resource leakage and replace explicit invocation of close() method with try with resources

  #18678 opened Jan 23, 2025

• KAFKA-18634: Fix ELR metadata version issues

  #18680 opened Jan 23, 2025

• KAFKA-18636 Fix how we handle Gradle exits in CI

  #18681 opened Jan 23, 2025

• KAFKA-18627:add allowed modules to JaasUtils

  #18683 opened Jan 24, 2025

• KAFKA-18461; Fix potential NPE in setDelta after map is erased

  #18684 opened Jan 24, 2025

• KAFKA-18602: Incorrect FinalizedVersionLevel reported for dynamic KRaft quorum (wip)

  #18685 opened Jan 24, 2025

• KAFKA-18638 fix flasky testThrottledProducerConsumer.testThrottledProducerConsumer

  #18689 opened Jan 24, 2025

• MINOR: add MirrorMaker2 missing metrics and mbean filters

  #18691 opened Jan 24, 2025

• KAFKA-18633: Remove errorUnavailableEndpoints from handleTopicMetadataRequest

  #18692 opened Jan 24, 2025

• (WIP) KAFKA-18616; Refactor Tools's ApiMessageFormatter

  #18695 opened Jan 24, 2025

• KAFKA-18494-3: solution for the bug relating to gaps in the share partition cachedStates post initialization

  #18696 opened Jan 24, 2025

• DRAFT Extract an api interface from ClusterInstance

  #18697 opened Jan 24, 2025

• KAFKA-13722: remove internal usage of old ProcessorContext

  #18698 opened Jan 24, 2025

• KAFKA-18644: improve generic type names for internal FK-join classes

  #18700 opened Jan 24, 2025

• KAFKA-18645: New consumer should align close timeout handling with classic consumer

  #18702 opened Jan 25, 2025

• MINOR: cleanup KStream JavaDocs (1/N) - filter[Not]/selectKey

  #18703 opened Jan 25, 2025

• MINOR: cleanup KStream JavaDocs (2/N) - print/foreach/peek/split/merge

  #18704 opened Jan 25, 2025

• MINOR: cleanup KStream JavaDocs (3/N) - groupBy[Key]

  #18705 opened Jan 25, 2025

• KAFKA-18171: Unexpected Change in bootstrap.servers Behavior After Upgrade to 3.8.0

  #18706 opened Jan 25, 2025

• KAFKA-18649: complete ClearElrRecord handling

  #18708 opened Jan 26, 2025

• Add Integration tests for the the KIP-966

  #18709 opened Jan 26, 2025

• KAFKA-18576: Convert ConfigType to Enum

  #18711 opened Jan 27, 2025

• MINOR: Fix the CLIENT_QUOTA_CALLBACK_CLASS_CONFIG document

  #18713 opened Jan 27, 2025

• Only real topics are output in exceptions

  #18714 opened Jan 27, 2025

• KAFKA-18647: Clarify Windows support in Quick Start Guide

  #18715 opened Jan 27, 2025

• KAFKA-18655: Implement the consumer group size counter with scheduled task

  #18717 opened Jan 27, 2025

• KAFKA-18632: Multibroker test improvements.

  #18718 opened Jan 27, 2025

• KAFKA-18654: Transaction Version 2 performance regression due to early return

  #18720 opened Jan 28, 2025

• MINOR: cleanup KStream JavaDocs (4/N) - stream-table-inner-join

  #18721 opened Jan 28, 2025

• KAFKA-18644: improve generic type names for KStreamImpl and KTableImpl

  #18722 opened Jan 28, 2025

• KAFKA-18653: Fix mocks and potential thread leak issues causing silent RejectedExecutionException in share group broker tests

  #18725 opened Jan 28, 2025

• KAFKA-18646: Null records in fetch response breaks librdkafka

  #18726 opened Jan 28, 2025

• KAFKA-18659: librdkafka compressed produce fails unless api versions returns produce v0

  #18727 opened Jan 28, 2025

• KAFKA-18488: Improve KafkaShareConsumerTest

  #18728 opened Jan 28, 2025

• KAFKA-18323: Add StreamsGroup class

  #18729 opened Jan 28, 2025

• KAFKA-18660: Transactions Version 2 doesn't handle epoch overflow correctly

  #18730 opened Jan 28, 2025

• KAFKA-18570: Update documentation to add remainingLogsToRecover and remainingSegmentsToRecover metrics

  #18731 opened Jan 28, 2025

• KAFKA-18498: Update lock ownership from main thread

  #18732 opened Jan 28, 2025

• KAFKA-18662: Return CONCURRENT_TRANSACTIONS on produce request in TV2

  #18733 opened Jan 29, 2025

• MINOR: Session windows should accept zero as session gap

  #18734 opened Jan 29, 2025

• KAFKA-18441: Fix flaky KafkaAdminClientTest#testAdminClientApisAuthenticationFailure

  #18735 opened Jan 29, 2025

67 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• KAFKA-16339: [Docs] Add migrating from transform to process

  #18314 commented on Jan 29, 2025 • 37 new comments

• KAFKA-16524: Metrics for KIP-853

  #18304 commented on Jan 24, 2025 • 30 new comments

• KAFKA-17125: Streams Sticky Task Assignor

  #18652 commented on Jan 28, 2025 • 28 new comments

• KAFKA-17182: Consumer fetch sessions are evicted too quickly with AsyncKafkaConsumer

  #17700 commented on Jan 29, 2025 • 20 new comments

• KAFKA-18298;KAFKA-18297: Fix flaky testConsumerGroupsDeprecatedConsumerGroupState and testConsumerGroups in PlaintextAdminIntegrationTest

  #18513 commented on Jan 28, 2025 • 20 new comments

• KAFKA-18483: Disable `Log4jController` and `Loggers` if Log4j Core absent

  #18496 commented on Jan 28, 2025 • 16 new comments

• KAFKA-18360: Remove zookeeper configurations

  #18566 commented on Jan 25, 2025 • 8 new comments

• KAFKA-18600 Cleanup NetworkClient zk related logging

  #18644 commented on Jan 25, 2025 • 7 new comments

• KAFKA-18225: ClientQuotaCallback#updateClusterMetadata is unsupported by kraft

  #18196 commented on Jan 26, 2025 • 4 new comments

• KAFKA-18569: New consumer close may wait on unneeded FindCoordinator

  #18590 commented on Jan 29, 2025 • 4 new comments

• KAFKA-10532: Handle state updater failed tasks

  #17761 commented on Jan 24, 2025 • 3 new comments

• Kafka-16505: Adding dead letter queue in Kafka Streams

  #17942 commented on Jan 24, 2025 • 3 new comments

• KAFKA-18538: Add Streams membership manager

  #18551 commented on Jan 28, 2025 • 3 new comments

• MINOR: clean up for sasl endpoints

  #18519 commented on Jan 24, 2025 • 3 new comments

• KAFKA-18530 Rename ZooKeeperInternals

  #18641 commented on Jan 25, 2025 • 2 new comments

• KAFKA-18383: Remove reserved.broker.max.id and broker.id.generation.enable

  #18478 commented on Jan 29, 2025 • 1 new comment

• KAFKA-18034: CommitRequestManager should fail pending requests on fatal coordinator errors

  #18548 commented on Jan 28, 2025 • 1 new comment

• KAFKA-10840: Propagating Authentication errors when client setup fails with AuthenticationException

  #16418 commented on Jan 25, 2025 • 1 new comment

• KAFKA-18337: KafkaProducer Memory Leak in JmxReporter Class

  #18332 commented on Jan 27, 2025 • 0 new comments

• KAFKA-18356 Explicitly setting up instrumentation for inline mocking (Java 21+)

  #18339 commented on Jan 28, 2025 • 0 new comments

• KAFKA-17631: Convert SaslApiVersionsRequestTest to kraft

  #18330 commented on Jan 29, 2025 • 0 new comments

• KAFKA-17607: Add CI step to verify LICENSE-binary

  #18299 commented on Jan 28, 2025 • 0 new comments

• KAFKA-18635: reenable the unclean shutdown detection

  #18277 commented on Jan 28, 2025 • 0 new comments

• KAFKA-17833: Convert DescribeAuthorizedOperationsTest to use kraft

  #18252 commented on Jan 28, 2025 • 0 new comments

• KAFKA-10730: KafkaApis#handleProduceRequest should use auto-generated protocol

  #18216 commented on Jan 28, 2025 • 0 new comments

• Use switch expressions introduced in Java 14 to simplify code

  #18371 commented on Jan 24, 2025 • 0 new comments

• KAFKA-14484: Decouple UnifiedLog and RemoteLogManager

  #18460 commented on Jan 27, 2025 • 0 new comments

• KAFKA-17171: Add test cases for `STATIC_BROKER_CONFIG`in kraft mode

  #18463 commented on Jan 29, 2025 • 0 new comments

• (WIP) KAFKA-18409: ShareGroupStateMessageFormatter should use ApiMessageFormatter

  #18510 commented on Jan 26, 2025 • 0 new comments

• reuse LoginCallbackHandler on kerberos re-login

  #18589 commented on Jan 25, 2025 • 0 new comments

• KAFKA-18545 Remove Zookeeper logic from LogManager

  #18592 commented on Jan 25, 2025 • 0 new comments

• KAFKA-18561: Remove withKip853Rpc and replace it with withRaftProtocol

  #18600 commented on Jan 29, 2025 • 0 new comments

• KAFKA 10409: Refactor Kakfa Streams RocksDB Iterators

  #18610 commented on Jan 26, 2025 • 0 new comments

• MINOR: Update dependencies

  #18648 commented on Jan 23, 2025 • 0 new comments

• KAFKA-18617 Allow use of ClusterInstance inside BeforeEach

  #18662 commented on Jan 24, 2025 • 0 new comments

• KAFKA-18310: Flaky AbstractCoordinatorTest

  #18665 commented on Jan 29, 2025 • 0 new comments

• Use ByteBuffers for LZ4 OutputStream

  #11052 commented on Jan 24, 2025 • 0 new comments

• MINOR: call the serialize method including headers from the MockProducer

  #11144 commented on Jan 29, 2025 • 0 new comments

• MINOR: doc change for minisr to clarify replicas in Kafka Config

  #11163 commented on Jan 23, 2025 • 0 new comments

• MINOR: Delete temporary directories after using them in RaftManagerTest

  #11193 commented on Jan 23, 2025 • 0 new comments

• MINOR: Test ReplicaManager MBean names

  #11222 commented on Jan 23, 2025 • 0 new comments

• Code optimization: Supplement the missing Override tag on the override method

  #11399 commented on Jan 24, 2025 • 0 new comments

• KAFKA-13468: Consumers may hang because IOException in Log#<init> does not trigger KafkaStorageException

  #11520 commented on Jan 24, 2025 • 0 new comments

• MINOR: Add __cluster_metadata topic to list of internal topics

  #12305 commented on Jan 25, 2025 • 0 new comments

• KAFKA-15845: Detect leaked Kafka clients and servers with LeakTestingExtension

  #14783 commented on Jan 25, 2025 • 0 new comments

• Kafka-16355: Fix ConcurrentModificationException in evictWhile Method

  #16554 commented on Jan 28, 2025 • 0 new comments

• KAFKA-13154 : Changes for the OffsetSpec.latest() to correctly represent the latest offset per partition

  #16729 commented on Jan 25, 2025 • 0 new comments

• KAFKA-17316: Standard authorizer refactor

  #16779 commented on Jan 29, 2025 • 0 new comments

• KAFKA-16907: Fix RaftUtil's type complexity

  #16831 commented on Jan 29, 2025 • 0 new comments

• KAFKA-17348: Add custom produce request parsers

  #17324 commented on Jan 29, 2025 • 0 new comments

• KIP-1097 POC: error record reporter API

  #17493 commented on Jan 29, 2025 • 0 new comments

• KAFKA-15995: Initial API + make Producer/Consumer plugins Monitorable

  #17511 commented on Jan 27, 2025 • 0 new comments

• Support keystore with multiple alias entries

  #17560 commented on Jan 24, 2025 • 0 new comments

• KAFKA-17798 : Adding forbiddenApi check

  #17565 commented on Jan 25, 2025 • 0 new comments

• KAFKA-17828: Reverse Checkpointing in MM2

  #17593 commented on Jan 25, 2025 • 0 new comments

• KAFKA-17625: Removing ZK from ducktape

  #17596 commented on Jan 23, 2025 • 0 new comments

• KAFKA-16758: Extend Consumer#close with an option to leave the group or not

  #17614 commented on Jan 29, 2025 • 0 new comments

• KAFKA-17627: ConfigProvider TTLs do not restart Tasks

  #17643 commented on Jan 29, 2025 • 0 new comments

• [WIP] KIP-891: Connect Multiversion Support (Versioned Connector Creation and related changes)

  #17743 commented on Jan 23, 2025 • 0 new comments

• KAFKA-12622: Automate LICENSE file validation

  #17888 commented on Jan 24, 2025 • 0 new comments

• KAFKA-16505: Add source raw bytes in processorContex

  #17960 commented on Jan 29, 2025 • 0 new comments

• KAFKA-14484: Move UnifiedLog static methods to storage

  #18039 commented on Jan 27, 2025 • 0 new comments

• KAFKA-18157:Consider UnsupportedVersionException child class to represent the case of unsupported fields

  #18072 commented on Jan 29, 2025 • 0 new comments

• KAFKA-18230: handle not controller or not leader error in admin client

  #18165 commented on Jan 24, 2025 • 0 new comments

• KAFKA-18231: fix e2e reassign_partitions_test

  #18171 commented on Jan 24, 2025 • 0 new comments

• (WIP) KAFKA-18206: EmbeddedKafkaCluster must set features

  #18189 commented on Jan 27, 2025 • 0 new comments

• KAFKA-18201: testGroupMetadataMessageFormatter fails for new consumer protocol

  #18198 commented on Jan 28, 2025 • 0 new comments