Skip to main content

Apache Pulsar 3.1.1

2023-10-24

Broker

  • Fix incorrect number of read compacted entries #20978
  • Fix message loss during topic compaction #20980
  • Fix get outdated compactedTopicContext after compactionHorizon has been updated #20984
  • Fix compaction subscription delete by inactive subscription check #20983
  • Fix incorrect unack msk count when dup ack a message #20990
  • Fix ModularLoadManagerImpl always delete active bundle-data #20620
  • Use MessageDigest.isEqual when comparing digests #21061
  • Fix can't stop phase-two of compaction even though messageId read reaches lastReadId #20988
  • Make sure all inflight writes have finished before completion of compaction #21067
  • Fix chunked messages will be filtered by duplicating #20948
  • Fix potential case cause retention policy not working on topic level #21041
  • Make read compacted entries support maxReadSizeBytes limitation #21065
  • Remove bundle-data in local metadata store #21078
  • Fix write duplicate entries into the compacted ledger after RawReader reconnects #21081
  • Cleanup correctly heartbeat bundle ownership when handling broker deletion event #21083
  • Avoid splitting one batch message into two entries in StrategicTwoPhaseCompactor #21091
  • Fix unsubscribe non-durable subscription error #21099
  • Fix isolated group not work problem #21096
  • Consider iowait as idle #19110
  • Fix deleting topic not delete the related topic policy and schema #21093
  • Revert remove duplicate topics name when deleteNamespace #21087
  • Improve logs for troubleshooting #21141
  • Fix web tls url null cause NPE #21137
  • Fix unack count when mixing non batch index and batch index acks #21126
  • Backport fix UniformLoadShedder selecet wrong overloadbroker and underloadbroker #21180
  • Fix bug caused by optimistic locking #18390
  • Disable balancing based on DirectMemory #21168
  • Fix replicator leak when removeReplicator in NonPersistentTopic #21205
  • Fixed reset for AggregatedNamespaceStats #21225
  • Fixed produce and consume when anonymousUserRole enabled #21237

Pulsar IO and Pulsar Functions

  • [FN] Fix ProducerConfig cannot update error #21037
  • [FN] Fix the --batch-builder not working error for functions #21023
  • [FN] Fix functions_log4j2.xml delete strategy config #21215
  • [IO] Fix --retain[-key]-ordering not working error for sink #21060

CLI

  • [Admin] Fix get topic stats fail if a subscription catch up concurrently #20971

Others

  • [META] Fix deadlock in AutoRecovery #21010
  • [META] Improve fault tolerance of blocking calls by supporting timeout #21028
  • [META] Improve to the ReplicaitonWorker performance by deleting invalid underreplication nodes #21059
  • [META] Fix metadata store deadlock due to BookkeeperInternalCallbacks.Processor #21159
  • [META] Fix PulsarLedgerUnderreplicationManager notify problem #21161
  • [META] Fix pulsar ledger auditor dead lock problem #21181
  • [ML] Persist mark deleted ops to ZK if create cursor ledger was failed #20935
  • [BK] Improve getIsolationGroup by avoid creating arrayList #20952
  • [BK] Fix RocksDB configuration #21157
  • [Proxy] Support disabling metrics endpoint #21031
  • [Proxy] Fix Proxy 502 gateway error when it is configured with Keystore TLS and admin API is called #21077
  • [TXN] Fix the consumer stuck due to deduplicated messages in pending ack state #21177

Library updates

  • Bump GRPC version to 1.55.3 to fix CVE #21057
  • Bump broker okio version to 3.4.0 #21064
  • Upgrade bookkeeper to 4.16.3 #21146

A special thanks to the following contributors who contributed to Pulsar 3.1.1: mattisonchao, tuteng, poorbarcode, asafm, hanmz, horizonzy, aloyszhang, hrzzzz, thetumbled, hangc0276, zymap, Technoboy-, erobot, liangyepianzhou, Shawyeok, Demogorgon314, TakaHiR07, coderzc, Apurva007, RobertIndie, Crispy-fried-chicken, jiangpengcheng, michaeljmarshall, lifepuzzlefun, AnonHxy, codelipenghui