Skip to content

kubernetes: suppress tqdm progress bars in all container pods #278

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
morgan-wowk wants to merge 1 commit into from
+14 −0
Closed

kubernetes: suppress tqdm progress bars in all container pods #278

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions cloud_pipelines_backend/launchers/kubernetes_launchers.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -69,6 +69,16 @@
# Environment variables for multi-node execution.
_MULTI_NODE_NODE_INDEX_ENV_VAR_NAME = "_TANGLE_MULTI_NODE_NODE_INDEX"

# Environment variables injected into every container to suppress tqdm progress
# bar output. High-volume block-glyph writes (3-byte UTF-8: █▉▊▋▌▍▎▏) from
# concurrent worker processes interleave at the OS level, producing torn
# multi-byte sequences in the pod log stream that cause UnicodeDecodeError.
# Components may override these by setting the same keys in their own env.
_TQDM_SUPPRESS_ENV_VARS: dict[str, str] = {
"TQDM_DISABLE": "1",
"HF_DATASETS_DISABLE_PROGRESS_BARS": "1",
}


_T = typing.TypeVar("_T")

Expand Down Expand Up @@ -352,6 +362,10 @@ def get_output_path(output_name: str) -> str:
k8s_client_lib.V1EnvVar(name=name, value=value)
for name, value in (container_spec.env or {}).items()
]
user_env_names = {env.name for env in container_env}
for name, value in _TQDM_SUPPRESS_ENV_VARS.items():
if name not in user_env_names:
container_env.append(k8s_client_lib.V1EnvVar(name=name, value=value))
main_container_spec = k8s_client_lib.V1Container(
name=_MAIN_CONTAINER_NAME,
image=container_spec.image,
Expand Down