Skip to content

Commit

Permalink
Merge pull request #5824 from balajialg/ollama
Browse files Browse the repository at this point in the history
Install ollama models tinyllama and phi3:mini in dev hub for experimentation
  • Loading branch information
balajialg authored Jul 3, 2024
2 parents 59b37ff + 24295db commit 9e4e3f1
Showing 1 changed file with 19 additions and 0 deletions.
19 changes: 19 additions & 0 deletions deployments/dev/images/default/postBuild
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
#!/bin/bash

# Define the directory for persistent storage
OLLAMA_DATA_DIR="/persistent/ollama"

# Create the directory if it doesn't exist
mkdir -p $OLLAMA_DATA_DIR

# Download the Ollama executable
wget https://github.com/ollama/ollama/releases/download/v0.1.48/ollama-linux-amd64 -O /usr/local/bin/ollama

# Make the Ollama executable runnable
chmod +x /usr/local/bin/ollama

# Run the phi3:mini model with the specified data directory
/usr/local/bin/ollama run phi3:mini --data-dir $OLLAMA_DATA_DIR

# Run the tinyllama model with the specified data directory
/usr/local/bin/ollama run tinyllama --data-dir $OLLAMA_DATA_DIR

0 comments on commit 9e4e3f1

Please sign in to comment.