2.5.0-2.1.0

In this release we have updated the base tech version of Apache Kafka to 2.1.0 and we have accomodated the new features that came along. Please pay attention the important notes.

Important Notes

• The inter_broker_protocol_version now defaults to the newer, 2.1. This has a few implications, as described below:

  • Kafka 1.1.0 supports inter_broker_protocol_version: 1.1 maximum, and by default it is set to 1.0.
  • Kafka 2.1.0 supports inter_broker_protocol_versions up to 2.1.
  • If you haven't specified a inter_broker_protocol_version in your options file, the new default will be used and changed to 2.1.

  The problem with this is that it will cause downtime - during the upgrade, some Kafka nodes will be on Kafka 1.1.0 using inter_broker_protocol_version 1.0 and others will be on Kafka 2.1.0 using protocol 2.1.

  To avoid any potential downtime caused by this, change the protocol version used when upgrading Kafka.

  • Set up CLI to connect to a soak cluster

  • Update your options_file.json with the following contents:

    {
        ...
        "kafka": {
            ...
            "inter_broker_protocol_version": "1.0"
            ...
        }
        ...
    }
    

  • And update your service like so:

    ~$ dcos package install --cli --yes kafka
    ~$ dcos kafka --name=data-services/kafka update start \
        --package-version=2.5.0-2.1.0 \
        --options=options_file.json
    

Updates

• Upgrade kafka base tech to version 2.1.0. See Kafka's Release Notes for 2.0 and for 2.1 more for details.
• Upgrade Zookeeper Client version to 3.4.13