bug: OpenLLM has incompatibilities with Ubuntu 24.04, python 3.11, setuptools 79.0.1

[c16661]

Describe the bug

I have an Ubuntu 24.04 distribution, Nvidia RTX4090, and get the following failure when running openllm hello. Please see the attached file for all the details.

Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in _run_code
File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml/main.py", line 2, in
from bentoml_cli.cli import cli
File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml_cli/cli.py", line 63, in
cli = create_bentoml_cli()
^^^^^^^^^^^^^^^^^^^^
File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml_cli/cli.py", line 9, in create_bentoml_cli
from bentoml._internal.context import server_context
File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml/_internal/context.py", line 15, in
from .utils.filesystem import TempfilePool
File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml/_internal/utils/filesystem.py", line 14, in
import fs
File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/fs/init.py", line 4, in
import("pkg_resources").declare_namespace(name) # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^
ModuleNotFoundError: No module named 'pkg_resources'

To reproduce

chris@chris-MS-7C56:$ python -m venv OpenLLM_P311
chris@chris-MS-7C56:$ source OpenLLM_P311/bin/activate
(OpenLLM_P311) chris@chris-MS-7C56:$ pip install openllm
(OpenLLM_P311) chris@chris-MS-7C56:$ openllm hello

Logs

Environment

(OpenLLM_P311) chris@chris-MS-7C56:~$ bentoml env
Using Python 3.11.14 environment at: OpenLLM_P311

Environment variable

BENTOML_DEBUG=''
BENTOML_QUIET=''
BENTOML_BUNDLE_LOCAL_BUILD=''
BENTOML_DO_NOT_TRACK=''
BENTOML_CONFIG=''
BENTOML_CONFIG_OPTIONS=''
BENTOML_PORT=''
BENTOML_HOST=''
BENTOML_API_WORKERS=''

System information

bentoml: 1.4.8
python: 3.11.14
platform: Linux-6.17.0-14-generic-x86_64-with-glibc2.39
uid_gid: 1000:1000

pip_packages

a2wsgi==1.10.10
aiohappyeyeballs==2.6.1
aiohttp==3.13.3
aiosignal==1.4.0
aiosqlite==0.22.1
annotated-doc==0.0.4
annotated-types==0.7.0
anyio==4.12.1
appdirs==1.4.4
asgiref==3.11.1
attrs==25.4.0
bentoml==1.4.8
cattrs==23.1.2
certifi==2026.1.4
click==8.3.1
click-option-group==0.5.9
cloudpickle==3.1.2
distro==1.9.0
dulwich==1.1.0
filelock==3.24.2
frozenlist==1.8.0
fs==2.4.16
fsspec==2026.2.0
h11==0.16.0
hf-xet==1.2.0
httpcore==1.0.9
httpx==0.28.1
httpx-ws==0.8.2
huggingface-hub==1.4.1
idna==3.11
importlib-metadata==8.7.1
jinja2==3.1.6
jiter==0.13.0
kantoku==0.18.3
markdown-it-py==4.0.0
markupsafe==3.0.3
mdurl==0.1.2
multidict==6.7.1
numpy==2.4.2
nvidia-ml-py==13.590.48
openai==1.73.0
openllm==0.6.30
opentelemetry-api==1.39.1
opentelemetry-instrumentation==0.60b1
opentelemetry-instrumentation-aiohttp-client==0.60b1
opentelemetry-instrumentation-asgi==0.60b1
opentelemetry-sdk==1.39.1
opentelemetry-semantic-conventions==0.60b1
opentelemetry-util-http==0.60b1
packaging==26.0
pathspec==1.0.4
pip==24.0
pip-requirements-parser==32.0.1
prometheus-client==0.24.1
prompt-toolkit==3.0.52
propcache==0.4.1
psutil==7.2.2
pyaml==26.2.1
pydantic==2.12.5
pydantic-core==2.41.5
pygments==2.19.2
pyparsing==3.3.2
python-dateutil==2.9.0.post0
python-dotenv==1.2.1
python-json-logger==4.0.0
python-multipart==0.0.22
pyyaml==6.0.3
pyzmq==27.1.0
questionary==2.1.1
rich==14.3.2
schema==0.7.8
setuptools==79.0.1
shellingham==1.5.4
simple-di==0.1.5
six==1.17.0
sniffio==1.3.1
starlette==0.52.1
tabulate==0.9.0
tomli-w==1.2.0
tornado==6.5.4
tqdm==4.67.3
typer==0.24.0
typer-slim==0.24.0
typing-extensions==4.15.0
typing-inspection==0.4.2
urllib3==2.6.3
uv==0.10.4
uvicorn==0.41.0
watchfiles==1.1.1
wcwidth==0.6.0
wrapt==1.17.3
wsproto==1.3.2
yarl==1.22.0
zipp==3.23.0

==========================================================================
(OpenLLM_P311) chris@chris-MS-7C56:~$ transformers-cli env
transformers-cli: command not found

System information (Optional)

Operating System: Ubuntu 24.04.4 LTS
Kernel: Linux 6.17.0-14-generic
Architecture: x86-64

memory 64GiB System Memory
processor AMD Ryzen 7 5700X 8-Core Processor
storage NVMe disk (ADATA LEGEND 700)
GPU:
chris@chris-MS-7C56:~$ nvidia-smi
Wed Feb 18 13:46:02 2026
+-----------------------------------------------------------------------------------------+
| NVIDIA-SMI 590.48.01 Driver Version: 590.48.01 CUDA Version: 13.1 |
+-----------------------------------------+------------------------+----------------------+
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC |
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. |
| | | MIG M. |
|=========================================+========================+======================|
| 0 NVIDIA GeForce RTX 4090 Off | 00000000:2B:00.0 On | Off |
| 0% 41C P8 30W / 450W | 641MiB / 24564MiB | 0% Default |
| | | N/A |
+-----------------------------------------+------------------------+----------------------+

+-----------------------------------------------------------------------------------------+
| Processes: |
| GPU GI CI PID Type Process name GPU Memory |
| ID ID Usage |
|=========================================================================================|
| 0 N/A N/A 1551 G /usr/lib/xorg/Xorg 248MiB |
| 0 N/A N/A 1769 G /usr/bin/gnome-shell 61MiB |
| 0 N/A N/A 6222 G .../7836/usr/lib/firefox/firefox 267MiB |
+-----------------------------------------------------------------------------------------+

I have the following pythons installed, using deadsnake.

$ ls -l /usr/bin | grep python
lrwxrwxrwx 1 root root 24 Oct 10 04:52 pdb3.10 -> ../lib/python3.10/pdb.py
lrwxrwxrwx 1 root root 24 Oct 10 04:54 pdb3.11 -> ../lib/python3.11/pdb.py
lrwxrwxrwx 1 root root 24 Jan 22 15:57 pdb3.12 -> ../lib/python3.12/pdb.py
lrwxrwxrwx 1 root root 31 Nov 12 07:15 py3versions -> ../share/python3/py3versions.py
-rwxr-xr-x 1 root root 956 Nov 24 2023 pybabel-python3
lrwxrwxrwx 1 root root 10 Nov 12 07:15 python3 -> python3.12
-rwxr-xr-x 1 root root 5232024 Oct 10 04:52 python3.10
-rwxr-xr-x 1 root root 6637240 Oct 10 04:54 python3.11
-rwxr-xr-x 1 root root 8020928 Jan 22 15:57 python3.12
lrwxrwxrwx 1 root root 34 Jan 22 15:57 python3.12-config -> x86_64-linux-gnu-python3.12-config
lrwxrwxrwx 1 root root 17 Nov 12 07:15 python3-config -> python3.12-config
-rwxr-xr-x 1 root root 3027 Jan 22 15:57 x86_64-linux-gnu-python3.12-config
lrwxrwxrwx 1 root root 34 Nov 12 07:15 x86_64-linux-gnu-python3-config -> x86_64-linux-gnu-python3.12-config

I set aliases in my bashrc for python 3.11.14

alias python=/usr/bin/python3.11
alias python3=/usr/bin/python3.11

openllmsetuplog_python3.11_pip24.0_setuptools79.0.1.txt