Skip to content

Commit

Permalink
add config examples for groq
Browse files Browse the repository at this point in the history
  • Loading branch information
geekan committed Apr 20, 2024
1 parent 9ede1fb commit ed1b310
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions config/examples/groq-llama3-70b.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,5 @@
llm:
# Visit https://console.groq.com/keys to create api key
base_url: "https://api.groq.com/openai/v1"
api_key: "YOUR_API_KEY"
model: "llama3-70b-8192" # llama3-8b-8192,llama3-70b-8192,llama2-70b-4096 ,mixtral-8x7b-32768,gemma-7b-it

0 comments on commit ed1b310

Please sign in to comment.