Skip to content

WIP Masoud/George multi-shard exps#12

Draft
justheuristic wants to merge 33 commits intomainfrom
async_input_multishard_235b
Draft

WIP Masoud/George multi-shard exps#12
justheuristic wants to merge 33 commits intomainfrom
async_input_multishard_235b

Conversation

@justheuristic
Copy link
Collaborator

TODO:

  • check the fate of self.input_block - do we need it? why not append to input_prompt?
  • test-run random non-sharded benchmarks before merging, check no degradation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants