Skip to content
View pradyGn's full-sized avatar
12 followers · 2 following

Achievements

Achievement: StarstruckAchievement: YOLOAchievement: Pull Sharkx2

Achievements

Achievement: StarstruckAchievement: YOLOAchievement: Pull Sharkx2

Block or report pradyGn

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
PradyGn/README.md

About Me

I am an Applied Scientist focused on building Small Language Models from scratch (pre-training, instruction-tuning, distillation, dataset curation, etc). I also enjoy designing efficient software architecture and data pipelines.

Core Stack: Python, PyTorch, Transformers, PEFT, Boosting Models, AWS, GCP, dbt, SQL.

Pinned Loading

  1. zoof zoof Public

    Zoof is a high-efficiency Small Language Model (SLM) engineered from scratch. It demonstrates how modern architectural choices and high-quality data can yield competitive performance in the sub-400…

    Python 43 2

  2. are-SLMs-performant are-SLMs-performant Public

    Can Small Language Models (SMLs) display a comparable performance to LLMs in extracting information from HTML?

    Jupyter Notebook 1

  3. Unlearning-the-bias-of-a-dataset Unlearning-the-bias-of-a-dataset Public

    The objective of this work is to help BERT generalize better and improve it's performance even in presence of bias causing features.

    Python 1 1

  4. Weight-Initialization_Dead-Neurons_Leaky-ReLU Weight-Initialization_Dead-Neurons_Leaky-ReLU Public

    Playing with vanishing and exploding gradients problem.

    Jupyter Notebook 1

  5. cyclic-learing-rate cyclic-learing-rate Public

    Playing with the cyclic learning rate technique

    Jupyter Notebook