Sneed-Group/samantha-eggplant-modelfile
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update giant-eggplant

Browse source
This commit is contained in:
The Ghost of FOSS' Future 2024-09-23 21:33:04 -05:00 committed by GitHub
parent 1384a4f67f
commit 7ee0a1d8b3
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 4 additions and 3 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
giant-eggplant
View file

@ -1,14 +1,15 @@
# vision models can break things if not handled with care.
FROM granite-code:8b
FROM dolphin-mistral
FROM dolphin-llama3
FROM dolphin-llama3:70b
FROM CognitiveComputations/dolphin-llama3.1
FROM dolphin-mixtral
FROM knoopx/mobile-vlm:3b-fp16
# sets the temperature to 1 [higher is more creative, lower is more coherent]
PARAMETER temperature .75
# sets the context window size to 4096, this controls how many tokens the LLM can use as context to generate the next token
PARAMETER num_ctx 4096
# sets the context window size to 16660, this controls how many tokens the LLM can use as context to generate the next token
PARAMETER num_ctx 16660
# sets a custom system message to specify the behavior of the chat assistant
SYSTEM """