2024-01-02
PIPs
- PIP-318: Support not retaining null-key message during topic compaction by @coderzc in #21578
Broker
- Fixed ServiceUnitStateChannel monitor to tombstone only inactive bundle states by @heesung-sn in #21721
- Fix typo in the config key by @coderzc in #21690
- Record GeoPersistentReplicator.msgOut before producer#sendAsync by @nodece in #21673
- Print recoverBucketSnapshot log if cursorProperties are empty by @coderzc in #21651
- Support not retaining null-key message during topic compaction by @coderzc in #21601
- Delete topic timeout due to NPE by @poorbarcode in #21595
- Duplicate LedgerOffloader creation when namespace/topic policies are updated by @shibd in #21591
- Fix issue with consumer read uncommitted messages from compacted topic by @coderzc in #21571
- Fix create topic with different auto creation strategies causes race condition by @mattisonchao in #21545
- Fix orphan scheduled task for ledger create timeout check by @poorbarcode in #21542
- Fix thousands orphan PersistentTopic caused OOM by @poorbarcode in #21540
- Fix unfinished callback when deleting managed ledger by @mattisonchao in #21530
- Fix setReplicatedSubscriptionStatus incorrect behavior by @liudezhi2098 in #21510
- Fix failure while creating non-durable cursor with inactive managed-ledger by @rdhabalia in #21508
- Fix PulsarService/BrokerService shutdown when brokerShutdownTimeoutMs=0 by @lhotari in #21496
- Do not write replicated snapshot marker when the topic which is not enable replication by @liangyepianzhou in #21495
- Avoid pass null role in MultiRolesTokenAuthorizationProvider by @mattisonchao in #21486
- Fix the deadlock when using BookieRackAffinityMapping with rackaware policy by @erobot in #21481
- Fix issue with consumer read uncommitted messages from compacted topic by @coderzc in #21465
- Fix resource_quota_zpath by @AnonHxy in #21461
- Fix namespace bundle stuck in unloading status by @mattisonchao in #21445
- Ignore individual acknowledgment for CompactorSubscription when an entry has been filtered. by @coderzc in #21434
- Fix MultiRoles token provider NPE when using anonymous clients by @Technoboy- in #21429
- Fix heartbeat namespace create event topic and cannot delete heartbeat topic by @TakaHiR07 in #21360
- Fix heartbeat namespace create transaction internal topic by @TakaHiR07 in #21348
- Fix unload operation stuck when use ExtensibleLoadManager by @Demogorgon314 in #21332
- Fix lookup heartbeat and sla namespace bundle when using extensible load manager(#21213) by @Demogorgon314 in #21314
- Fix thread safe issue with RangeCache.put and RangeCache.clear by @lhotari in #21302
- use ConcurrentHashMap in ServiceUnitStateChannel and avoid recursive update error by @heesung-sn in #21282
- Fix inconsistent topic policy by @mattisonchao in #21255
- Let the producer request success at the first time if the previous one is inactive by @poorbarcode in #21220
- Fix lookup heartbeat and sla namespace bundle when using extensible load manager by @Demogorgon314 in #21213
- Avoid record inactiveproducers when deduplication is disable by @lifepuzzlefun in #21193
- Make specified producer could override the previous one by @poorbarcode in #21155
- Rackaware policy is ineffective when delete zk rack info after bkclient initialize by @TakaHiR07 in #20944
- Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin by @tuteng in #20939
Transaction
- OpRequestSend reuse problem cause tbClient commitTxnOnTopic timeout unexpectedly by @TakaHiR07 in #21505
- Ack all message ids when ack chunk messages with transaction by @liangyepianzhou in #21268
CI and Test
- Fix LocalBookkeeperEnsemble resource leak in tests by @lhotari in #21407
- Add new CI unit test group "Broker Group 4" with cluster migration tests by @lhotari in #21391
- Fix resource leaks with Pulsar Functions tests by @lhotari in #21378
- Fix some resource leaks in compaction tests by @lhotari in #21374
- Fix a resource leak in ClusterMigrationTest by @lhotari in #21366
- Fix docker image building by releasing more disk space before building by @lhotari in #21365
- Fix flaky CompactionTest.testDispatcherMaxReadSizeBytes by @lhotari in #21329
- Fix flaky test NarUnpackerTest by @lhotari in #21328
- Fix zookeeper related flacky test by @horizonzy in #21310
- fix flaky test PatternTopicsConsumerImplTest by @poorbarcode in #21222
Security
- Upgrade rabbitmq client to address CVE-2023-46120 by @liangyepianzhou in #21619
- Upgrade Zookeeper to 3.8.3 to address CVE-2023-44981 by @lhotari in #21398
- Upgrade Netty to 4.1.100 to address CVE-2023-44487 by @lhotari in #21397
- Upgrade Jetty to 9.4.53 to address CVE-2023-44487 by @lhotari in #21395
- Fix MultiRoles token provider when using anonymous clients by @merlimat in #21338
- Add OWASP Dependency Check suppressions by @lhotari in #21281
- Upgrade snappy-java to 1.1.10.5 by @lhotari in #21280
Build
- Fix Stage Docker images fail on M1 Mac by @AnonHxy in #21659
- Fix apt download issue in building the docker image by @lhotari in #21489
- Rename schema_example.conf to schema_example.json by @poorbarcode in #21447
- Upgrade Lombok to 1.18.30 to support compiling with JDK21 by @lhotari in #21278
Others
- [offload] Don't cleanup data when offload met MetaStore exception by @zymap in #21686
- [proxy] Move status endpoint out of auth coverage by @mattisonchao in #21428
- [auto-recovery] Migrate the replication testing from BookKeeper to Pulsar by @horizonzy in #21340
- [bk-client] Fix bk client MinNumRacksPerWriteQuorum and EnforceMinNumRacksPerWriteQuorum not work problem by @horizonzy in #21327
- [sql] Support UUID for json and avro by @liangyepianzhou in #21267
- [log] fix the vague response if topic not found by @poorbarcode in #20932