mirror of https://github.com/microsoft/autogen.git
Merge pull request #126 from yogeshhk/patch-1
Fixed typo in open_source_language_model_example.ipynb
This commit is contained in:
commit
1dd77d8b81
|
@ -20,7 +20,7 @@
|
|||
"source": [
|
||||
"## Instructions\n",
|
||||
"\n",
|
||||
"1. First, install the modelz-llm and replated packages using the command: ```modelz-llm huggingface_hub transformers accelerate```\n",
|
||||
"1. First, install the modelz-llm and related packages using the command: ```modelz-llm huggingface_hub transformers accelerate```\n",
|
||||
"2. Next, initiate the serving of the model; for instance, executing ```modelz-llm -m bigscience/bloomz-560m --device auto``` will locally serve the bloomz-560m small model.\n",
|
||||
"3. Lastly, you will need to modify the `OAI_CONFIG_LIST` file or the `config_list` variable to point to the local model. In this scenario, we are using the default port 8000.\n",
|
||||
"\n",
|
||||
|
|
Loading…
Reference in New Issue