Skip to content

Support unsupervised dataset and local peft checkpoint.#2

Open
yanzhoupan wants to merge 2 commits into
huawei-lin:masterfrom
yanzhoupan:support-unsupervised-dataset
Open

Support unsupervised dataset and local peft checkpoint.#2
yanzhoupan wants to merge 2 commits into
huawei-lin:masterfrom
yanzhoupan:support-unsupervised-dataset

Conversation

@yanzhoupan
Copy link
Copy Markdown

  1. Support unsupervised datasets such as Wikitext.
  2. Support loading model from local PEFT checkpoint.
  3. Added some comments.
  4. Did some code refacors and cleanup.

The code is tested and is backward compatible.

@yanzhoupan yanzhoupan changed the title Support unsupervised dataset and local lora checkpoint. Support unsupervised dataset and local peft checkpoint. Jul 20, 2024
},
"model": {
"model_path": "openai-community/gpt2",
"checkpoint": "./checkpoints/gpt2-wiki-2-checkpoint360/",
Copy link
Copy Markdown
Owner

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you please put the training data and the checkpoint into the huggingface so that we can access them?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants