Message passing to kafka fails with zstd compression codec

[RamHaridas]

I am trying to send messages from fluentd to kafka using compression codec zstd

<source>
  @type exec
  tag kafka.message
  command echo '{"message":"Hello Everyone! zstd works!"}'
  run_interval 10s
  keys none
  <parse>
    @type json
  </parse>
</source>

<match kafka.message>
  @type rdkafka2
  brokers kf-test-kafka-0.kf-test-kafka-headless.preeti-krb-system.svc.cluster.local:9092
  topic_key topic
  default_topic fluentd-zstd
  
  use_event_time true
  
  principal [email protected]
  keytab /etc/kerberos/secret/keytab

  ssl_ca_cert /etc/kerberos/kafka/tls.crt
  ssl_client_cert /etc/kerberos/kafka/tls.crt
  ssl_client_cert_key /etc/kerberos/kafka/tls.key
  ssl_client_cert_key_password test1234
  ssl_verify_hostname false

  # gzip, snappy, lz4, zstd
  compression_codec zstd

  # Format settings
  <format>
    @type json
  </format>
  
  # Buffer settings for reliability
  <buffer topic>
    @type file
    path /var/log/fluentd-buffers/kafka
    flush_mode interval
    flush_interval 5s
    chunk_limit_size 1m
    queue_limit_length 32
    retry_max_interval 30
    retry_forever true
  </buffer>
  
  # Enable debug logging
  log_level debug
</match>

The above config works well for gzip, snappy and lz4 compressions. but it fails for zstd with below error 😟

2025-09-23 06:51:22 +0000 [warn]: #0 Send exception occurred: Unsupported value "zstd" for configuration property "compression.codec": libzstd not available at build time at /opt/fluent/lib/ruby/gems/3.2.0/gems/rdkafka-0.12.0/lib/rdkafka/config.rb:226:in `block (2 levels) in native_config'
2025-09-23 06:51:22 +0000 [debug]: #0 taking back chunk for errors. chunk="63f64970b5013b4429f286b7c707c085"
2025-09-23 06:51:22 +0000 [warn]: #0 failed to flush the buffer. retry_times=1501 next_retry_time=2025-09-23 06:51:50 +0000 chunk="63f64970b5013b4429f286b7c707c085" error_class=Rdkafka::Config::ConfigError error="Unsupported value \"zstd\" for configuration property \"compression.codec\": libzstd not available at build time"

Fluentd version: 1.16.9 (tried with 1.19.0 as well)
gem Rdkafka version: 0.12.1 (tried with 0.21.2 as well)
gem fluent-plugin-kafka: 0.19.3

I wanted to confirm that whether the rdkafka gem by default supports zstd compression or not ?