Instructions to use xtuner/internlm-7b-qlora-msagent-react with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- PEFT
How to use xtuner/internlm-7b-qlora-msagent-react with PEFT:
from peft import PeftModel from transformers import AutoModelForCausalLM base_model = AutoModelForCausalLM.from_pretrained("internlm/internlm-7b") model = PeftModel.from_pretrained(base_model, "xtuner/internlm-7b-qlora-msagent-react") - Notebooks
- Google Colab
- Kaggle
| library_name: peft | |
| pipeline_tag: conversational | |
| base_model: internlm/internlm-7b | |
| <div align="center"> | |
| <img src="https://github.com/InternLM/lmdeploy/assets/36994684/0cf8d00f-e86b-40ba-9b54-dc8f1bc6c8d8" width="600"/> | |
| [](https://github.com/InternLM/xtuner) | |
| </div> | |
| ## Model | |
| internlm-7b-qlora-msagent-react is fine-tuned from [InternLM-7B](https://huggingface.co/internlm/internlm-7b) with [MSAgent-Bench](https://modelscope.cn/datasets/damo/MSAgent-Bench) dataset by [XTuner](https://github.com/InternLM/xtuner). | |
| ## Quickstart | |
| ### Usage with XTuner CLI | |
| #### Installation | |
| ```shell | |
| pip install xtuner | |
| ``` | |
| #### Chat | |
| ```shell | |
| xtuner chat internlm/internlm-7b --adapter xtuner/internlm-7b-qlora-msagent-react --lagent | |
| ``` | |
| #### Fine-tune | |
| Use the following command to quickly reproduce the fine-tuning results. | |
| ```shell | |
| NPROC_PER_NODE=8 xtuner train internlm_7b_qlora_msagent_react_e3_gpu8 | |
| ``` | |