There's a new flag for cog push that lets you use prebuilt base images designed specifically for Cog.
Using this flag when pushing your models can significantly reduce their cold boot time:
cog push --use-cog-base-image r8.im/my-name/my-model
For more details, see #1778
Tasks
There's a new flag for
cog pushthat lets you use prebuilt base images designed specifically for Cog.Using this flag when pushing your models can significantly reduce their cold boot time:
For more details, see #1778
Tasks
use-cog-base-imageanduse-cuda-base-image. Are they related? Do they override each other?cog pushincantations.