Merge pull request #126 from yogeshhk/patch-1

Fixed typo in open_source_language_model_example.ipynb
This commit is contained in:
Qingyun Wu 2023-10-07 00:38:14 -04:00 committed by GitHub
commit 1dd77d8b81
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions

View File

@ -20,7 +20,7 @@
"source": [
"## Instructions\n",
"\n",
"1. First, install the modelz-llm and replated packages using the command: ```modelz-llm huggingface_hub transformers accelerate```\n",
"1. First, install the modelz-llm and related packages using the command: ```modelz-llm huggingface_hub transformers accelerate```\n",
"2. Next, initiate the serving of the model; for instance, executing ```modelz-llm -m bigscience/bloomz-560m --device auto``` will locally serve the bloomz-560m small model.\n",
"3. Lastly, you will need to modify the `OAI_CONFIG_LIST` file or the `config_list` variable to point to the local model. In this scenario, we are using the default port 8000.\n",
"\n",