[Bug][Docker][2.11] Docker build fails on Python Client Wheel Since Ubuntu Upgrade

[dave2wave]

Search before asking

• I searched in the issues and found nothing similar.

Version

Docker build of Pulsar 2.11 creating an all image.

Minimal reproduce step

Perform a build of the all docker image.

What did you expect to see?

Success

What did you see instead?

Failure:

20:49:37  [INFO] Step 27/28 : RUN /pulsar/bin/install-pulsar-client.sh
20:49:37  [INFO] 
20:49:37  [INFO]  ---> Running in d98fec0c96bd
20:49:37  [INFO] ++ python3 -V
20:49:37  [INFO] ++ sed -E 's/.* ([[:digit:]]+)\.([[:digit:]]+).*/\1\2/'
20:49:37  [INFO] 
20:49:37  [INFO] + PYTHON_MAJOR_MINOR=310
20:49:37  [INFO] 
20:49:37  [INFO] ++ ls /pulsar/pulsar-client
20:49:37  [INFO] ++ grep cp310
20:49:37  [INFO] 
20:49:37  [INFO] + WHEEL_FILE=
20:49:37  [INFO] 
20:49:37  [INFO] + pip3 install '/pulsar/pulsar-client/[all]'
20:49:37  [INFO] 
20:49:38  [INFO] ERROR: Directory '/pulsar/pulsar-client/[all]' is not installable. Neither 'setup.py' nor 'pyproject.toml' found.
20:49:38  [INFO] 
20:49:38  [ERROR] The command '/bin/sh -c /pulsar/bin/install-pulsar-client.sh' returned a non-zero code: 1

This error started happening after #20475

Anything else?

Either update the wheel creation to Python 3.10 (it's creating 3.8), or revert back to Ubuntu 20.04.

Are you willing to submit a PR?

• I'm willing to submit a PR! to do the reversion.

[dave2wave]

Maybe what's needed is to update these:

./pulsar-client-cpp/docker-format.sh:30:BUILD_IMAGE_VERSION="${BUILD_IMAGE_VERSION:-ubuntu-20.04}"
./pulsar-client-cpp/docker-tests.sh:37:BUILD_IMAGE_VERSION="${BUILD_IMAGE_VERSION:-ubuntu-20.04}"
./pulsar-client-cpp/docker-build.sh:30:BUILD_IMAGE_VERSION="${BUILD_IMAGE_VERSION:-ubuntu-20.04}"

[dave2wave]

It could be that the wheel business is somewhat conflicted with

1. https://github.com/apache/pulsar/blob/branch-2.11/docker/pulsar/Dockerfile#L91
2. https://github.com/apache/pulsar/blob/branch-2.11/docker/pulsar/scripts/install-pulsar-client.sh#L23-L25 - This one wants to find a 3.10 wheel on Ubuntu 22.04
3. https://github.com/apache/pulsar/blob/branch-2.11/docker/pulsar/pom.xml#L78 - This one creates a 3.8 wheel
4. https://github.com/apache/pulsar/blob/branch-2.11/pulsar-client-cpp/docker/build-wheels.sh