Skip to content

Commit

Permalink
ci: adding github workflow for Snowflake (#1097)
Browse files Browse the repository at this point in the history
* Adding github workflow for Snowflake

* Fix docs configs

---------

Co-authored-by: Silvano Cerza <[email protected]>
  • Loading branch information
2 people authored and Amnah199 committed Oct 2, 2024
1 parent ee6b7d3 commit 159f690
Show file tree
Hide file tree
Showing 2 changed files with 76 additions and 2 deletions.
74 changes: 74 additions & 0 deletions .github/workflows/snowflake.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,74 @@
# This workflow comes from https://github.com/ofek/hatch-mypyc
# https://github.com/ofek/hatch-mypyc/blob/5a198c0ba8660494d02716cfc9d79ce4adfb1442/.github/workflows/test.yml
name: Test / snowflake

on:
schedule:
- cron: "0 0 * * *"
pull_request:
paths:
- "integrations/snowflake/**"
- ".github/workflows/snowflake.yml"

defaults:
run:
working-directory: integrations/snowflake

concurrency:
group: snowflake-${{ github.head_ref }}
cancel-in-progress: true

env:
PYTHONUNBUFFERED: "1"
FORCE_COLOR: "1"

jobs:
run:
name: Python ${{ matrix.python-version }} on ${{ startsWith(matrix.os, 'macos-') && 'macOS' || startsWith(matrix.os, 'windows-') && 'Windows' || 'Linux' }}
runs-on: ${{ matrix.os }}
strategy:
fail-fast: false
matrix:
os: [ubuntu-latest, windows-latest, macos-latest]
python-version: ["3.9", "3.10"]

steps:
- name: Support longpaths
if: matrix.os == 'windows-latest'
working-directory: .
run: git config --system core.longpaths true

- uses: actions/checkout@v4

- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v5
with:
python-version: ${{ matrix.python-version }}

- name: Install Hatch
run: pip install --upgrade hatch

- name: Lint
if: matrix.python-version == '3.9' && runner.os == 'Linux'
run: hatch run lint:all

- name: Generate docs
if: matrix.python-version == '3.9' && runner.os == 'Linux'
run: hatch run docs

- name: Run tests
run: hatch run cov-retry

- name: Nightly - run unit tests with Haystack main branch
if: github.event_name == 'schedule'
run: |
hatch run pip install git+https://github.com/deepset-ai/haystack.git
hatch run cov-retry -m "not integration"
- name: Send event to Datadog for nightly failures
if: failure() && github.event_name == 'schedule'
uses: ./.github/actions/send_failure
with:
title: |
Core integrations nightly tests failure: ${{ github.workflow }}
api-key: ${{ secrets.CORE_DATADOG_API_KEY }}
4 changes: 2 additions & 2 deletions integrations/snowflake/pydoc/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -3,7 +3,7 @@ loaders:
search_path: [../src]
modules:
[
"haystack_integrations.components.retrievers.snowflake.snowflake_retriever"
"haystack_integrations.components.retrievers.snowflake.snowflake_table_retriever",
]
ignore_when_discovered: ["__init__"]
processors:
Expand All @@ -27,4 +27,4 @@ renderer:
descriptive_module_title: true
add_method_class_prefix: true
add_member_class_prefix: false
filename: _readme_snowflake.md
filename: _readme_snowflake.md

0 comments on commit 159f690

Please sign in to comment.