librdkafka: Global error: NotImplemented (Local: Not implemented): Decompression (codec 0x4) of message at 22964260 of 117 bytes failed: Local: Not implemented

[seilerre]

Greetings from Hamburg! :) I am checking whether or not restate could be a replacement for a use-case we currently use Flink for. I implemented a Kafka subscription, which fails with:

2026-04-15T12:15:39.971385Z ERROR log
  librdkafka: Global error: NotImplemented (Local: Not implemented): Decompression (codec 0x4) of message at 22964260 of 117 bytes failed: Local: Not implemented
    log.target: "rdkafka::client"
    log.module_path: "rdkafka::client"
    log.file: "/usr/local/cargo/git/checkouts/rust-rdkafka-db9ad0fec1f6f7e9/e92cad9/src/client.rs"
    log.line: 116
on rs:worker-1
2026-04-15T12:15:40.082585Z WARN restate_ingress_kafka::legacy::subscription_controller::task_orchestrator
  Consumer task for subscription sub_122BdcnO7alQhofV0oxoeoF unexpectedly returned error: Message consumption error: NotImplemented (Local: Not implemented)
on rs:worker-1

Seems like zstd my topic is compressed with is a problem. This seems like a rather standard thing to support. Am I overlooking something?

[tillrohrmann]

Hi @seilerre, I think we missed compiling the Kafka ingress with the zstd feature. I will fix this so that with the next Restate release this should be supported. Thanks a lot for reporting this problem and helping us to improve Restate :-)