server: use port 9931 by default (#30159)
* server: use port 9931 by default * revert unrelated changes
This commit is contained in:
1 parent
b013e56a71
commit
b42b7e6d30
40 files changed
+68
-66
No files matched your search
@@ -10,11 +10,11 @@ Recommended way to run this model:
|
||||
llama-server -hf {namespace}/{model_name}-GGUF --embeddings
|
||||
```
|
||||
|
||||
Then the endpoint can be accessed at http://localhost:8080/embedding, for
|
||||
Then the endpoint can be accessed at http://localhost:9931/embedding, for
|
||||
example using `curl`:
|
||||
```console
|
||||
curl --request POST \
|
||||
--url http://localhost:8080/embedding \
|
||||
--url http://localhost:9931/embedding \
|
||||
--header "Content-Type: application/json" \
|
||||
--data '{{"input": "Hello embeddings"}}' \
|
||||
--silent
|
||||
|
||||
Reference in new issue
Block a user