Hello Egor,
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work on Arxiv regarding weight drift and activation sparsity and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.
The paper page lets people discuss about your paper and lets them find artifacts about it (your models for instance), you can also claim the paper as yours which will show up on your public profile at HF, and add Github and project page URLs.
I noticed that your GitHub repository (https://github.com/On-Point-RND/BugOrFeature) is currently listed as "To be done". When you are ready to release the code, would you like to host the pre-trained model checkpoints (such as the GPT-nano and ResNet-18 variants with $\text{GELU}^2$ and clipped $\text{ReLU}^2$ mentioned in the paper) on https://huggingface.co/models?
Hosting on Hugging Face will give your research more visibility and enable better discoverability. We can add tags in the model cards so that people find the models easier, link them to the paper page, etc.
If you're interested, you can use the PyTorchModelHubMixin class which adds from_pretrained and push_to_hub to any custom PyTorch model, making it very easy for the community to download and use your models right away.
Let me know if you're interested or need any guidance!
Kind regards,
Niels
ML Engineer @ HF 🤗
Hello Egor,
I'm Niels and work as part of the open-source team at Hugging Face. I discovered your work on Arxiv regarding weight drift and activation sparsity and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability. If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.
The paper page lets people discuss about your paper and lets them find artifacts about it (your models for instance), you can also claim the paper as yours which will show up on your public profile at HF, and add Github and project page URLs.
I noticed that your GitHub repository (https://github.com/On-Point-RND/BugOrFeature) is currently listed as "To be done". When you are ready to release the code, would you like to host the pre-trained model checkpoints (such as the GPT-nano and ResNet-18 variants with$\text{GELU}^2$ and clipped $\text{ReLU}^2$ mentioned in the paper) on https://huggingface.co/models?
Hosting on Hugging Face will give your research more visibility and enable better discoverability. We can add tags in the model cards so that people find the models easier, link them to the paper page, etc.
If you're interested, you can use the PyTorchModelHubMixin class which adds
from_pretrainedandpush_to_hubto any custom PyTorch model, making it very easy for the community to download and use your models right away.Let me know if you're interested or need any guidance!
Kind regards,
Niels
ML Engineer @ HF 🤗