Memory requirements and MPS Coverage

[AlphaMoury]

This repo is awesome and I would like to contribute to it constantly.

Have two questions:

1. For training hope model, can I use the same kmccleary3301's requirements posted? Or there is any changes in order to train a base model?

2. Did you include MPS coverage to optimize Mac performance in the training loop?

Thank you and we will be helping this repo to become famous, I have no doubt this new paradigm will change the scenario in actual generative AI.

[weipeilun]

Thank you for the support. Means a lot to me.

1. I've never tested but I guess yes you can.
2. I didn't run on Mac, you can try it. But I don't think there is anything fancy that don't support Mac as long as you have a right pytorch installed. Mine is 2.6.0, I think all versions > 2.0 work well.
   This repo is in a very basic stage now. Any contributions welcome. Let's work together to change the entire paradigm of generative AI.