Recipes for Granite RAG 3.0 8b LoRA adapter

Includes Ollama version and HF version.

Signed-off-by: BJ Hargrave <[email protected]>

.github/actions/ollama-setup/action.yml

@@ -0,0 +1,15 @@
+name: 'Additional Test Setup'
+description: 'Additional Test Setup for Ollama'
+runs:
+  using: "composite"
+  steps:
+    - name: Install Ollama and start server
+      shell: bash
+      run: |
+        curl -fsSL https://ollama.com/install.sh | sudo -E sh
+
+    - name: Wait for Ollama server
+      shell: bash
+      run: |
+        sleep 10
+        time curl -i http://localhost:11434

.github/dependabot.yml

@@ -7,5 +7,6 @@ updates:
   - package-ecosystem: "github-actions"
     directories:
     - "/"
+    - ".github/actions/ollama-setup"
     schedule:
       interval: "daily"

.github/notebook_lists/ollama_notebooks.txt

@@ -0,0 +1 @@
+recipes/Intrinsics/Granite_RAG_LoRA.ipynb

.github/workflows/notebooks.yaml

@@ -113,11 +113,27 @@ jobs:
       ref: ${{ needs.test_workflow_ready.outputs.ref }}
       all: ${{ fromJSON(needs.test_workflow_ready.outputs.all) }}
 
+  ollama:
+    needs:
+      - test_workflow_ready
+    permissions:
+      contents: read
+    uses: ibm-granite-community/utils/.github/workflows/test_notebook.yaml@main
+    with:
+      notebook-lists: |
+        .github/notebook_lists/ollama_notebooks.txt
+      python-versions: >-
+        3.11
+      ref: ${{ needs.test_workflow_ready.outputs.ref }}
+      all: ${{ fromJSON(needs.test_workflow_ready.outputs.all) }}
+      action: .github/actions/ollama-setup
+
   test_workflow_complete:
     needs:
       - test_workflow_ready
       - vanilla
       - pdl
+      - ollama
     permissions:
       pull-requests: write
       statuses: write

.pre-commit-config.yaml

@@ -3,7 +3,7 @@
 # Run `pre-commit install` to activate pre-commit hooks
 repos:
   - repo: https://github.com/kynan/nbstripout
-    rev: 0.7.1
+    rev: 0.8.1
     hooks:
       - id: nbstripout
         args: [

README.md

@@ -40,6 +40,12 @@ The "Recipes" in the Granite Snack Cookbook showcase the essential capabilities
       <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
       </a> --> (Not yet available in Colab, because the latter uses Python 3.10)
 
+### Intrinsic Functions
+
+1. Retrieval Augmented Generation (RAG) with Granite RAG 3.0 8b
+   1. [Notebook that uses Ollama](recipes/Intrinsics/Granite_RAG_LoRA.ipynb) (Not available in Colab, because it requires a local Ollama server.)
+   1. [Notebook that uses Hugging Face Transformers and PEFT Libraries](recipes/Intrinsics/Granite_RAG_LoRA_HF.ipynb) (Not available in Colab, because it requires a >16GB memory)
+
 ### Tuning
 
 1. [Fine Tuning Granite](recipes/Fine_Tuning/Finetuning_Granite_Pirate_Style.ipynb)
@@ -89,4 +95,4 @@ All content in these repositories including code has been provided by IBM under
 [CoC]: https://github.com/ibm-granite-cookbooks/community/blob/main/CODE_OF_CONDUCT.md
 [CG]: https://github.com/ibm-granite-cookbooks/community/blob/main/CONTRIBUTING.md
 [CG-legal]: https://github.com/ibm-granite-cookbooks/community/blob/main/CONTRIBUTING.md#legal
-[CG-signing]: https://github.com/ibm-granite-cookbooks/community/blob/main/CONTRIBUTING.md#signing-commits
+[CG-signing]: https://github.com/ibm-granite-cookbooks/community/blob/main/CONTRIBUTING.md#signing-commits

recipes/Intrinsics/.gitignore

@@ -0,0 +1,3 @@
+llama.cpp/
+*.gguf
+Modelfile