Skip to content

Petals #53

@nsosio

Description

@nsosio

Test with a private swarm (refer to premAI-io/dev-portal#69)

Questions

  • Where are the bottlenecks?
  • There are no advantages to build_gpu? there's no way to force using both the local GPU and the swarm (without connecting the local GPU to the swarm)?
  • Compare Petals with Deepspeed in a centralized scenario.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions