Skip to content

Document --use-cog-base-image #1820

Description

@zeke

There's a new flag for cog push that lets you use prebuilt base images designed specifically for Cog.

Using this flag when pushing your models can significantly reduce their cold boot time:

cog push --use-cog-base-image r8.im/my-name/my-model

For more details, see #1778

Tasks

  • Add a new doc that explains what prebuilt Cog images are, what's on them, etc.
  • Clarify relationship between use-cog-base-image and use-cuda-base-image. Are they related? Do they override each other?
    $ cog push --help | grep base-image
      --use-cog-base-image           Use pre-built Cog base image for faster cold boots (default true)
      --use-cuda-base-image string   Use Nvidia CUDA base image, 'true' (default) or 'false' (use python base image). False results in a smaller image but may cause problems for non-torch projects (default "auto")
      ```
    
  • Update getting started docs with correct cog push incantations.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions