Skip to content

feat(vllm): add GPU container image build pipeline - #693

Draft
nathan-weinberg wants to merge 2 commits into
mainfrom
vllm-gpu
Draft

feat(vllm): add GPU container image build pipeline#693
nathan-weinberg wants to merge 2 commits into
mainfrom
vllm-gpu

Conversation

@nathan-weinberg

@nathan-weinberg nathan-weinberg commented Aug 10, 2026

Copy link
Copy Markdown

Summary

Add Containerfile, GitHub Actions workflow, and Dependabot config for building CUDA-based vLLM GPU inference images with models baked in at build time

Related issue

Closes #692

Validation

N/A

Checklist

  • I reviewed every changed line and can explain the change.
  • New capabilities include an example config and functional example test.
  • User-facing behavior and generated documentation are updated.
  • Performance-sensitive changes include appropriate benchmark or load-test evidence.
  • Commits are signed and include a Signed-off-by trailer.

Breaking changes

N/A

@praxis-bot-app

Copy link
Copy Markdown

Unsigned commits: 9c71dba. Please sign your commits.

@nathan-weinberg

Copy link
Copy Markdown
Author

Currently blocked by ongoing work to determine how we will get our GPU runners for GHA - this is denoted in the PR code by TODO-GPU-RUNNER-LABEL

Once that is resolved, I will update that label and move this out of draft state

Add Containerfile, GitHub Actions workflow, and Dependabot config for
building CUDA-based vLLM GPU inference images with models baked in at
build time

Signed-off-by: Nathan Weinberg <nweinber@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Introduce automation to build vLLM GPU images with pre-loaded models

1 participant