Skip to content

Commit

Permalink
Merge branch 'sparse-checkout-for-git-pulls' of https://github.com/te…
Browse files Browse the repository at this point in the history
…tracionist/prefect into sparse-checkout-for-git-pulls
  • Loading branch information
tetracionist committed Oct 28, 2024
2 parents 8bf3be5 + 2ec3d96 commit 066d387
Show file tree
Hide file tree
Showing 1,477 changed files with 41,176 additions and 55,008 deletions.
2 changes: 1 addition & 1 deletion .codespellrc
Original file line number Diff line number Diff line change
@@ -1,5 +1,5 @@
[codespell]
skip = .git,*.pdf,*.svg,versioneer.py,package-lock.json,_vendor,*.css,.codespellrc
skip = .git,*.pdf,*.svg,versioneer.py,package-lock.json,_vendor,*.css,.codespellrc,tests/utilities/test_text.py
# from https://github.com/PrefectHQ/prefect/pull/10813#issuecomment-1732676130
ignore-regex = .*lazy=\"selectin\"|.*e import Bloc$|America/Nome

Expand Down
12 changes: 4 additions & 8 deletions .github/CODEOWNERS
Validating CODEOWNERS rules …
Original file line number Diff line number Diff line change
@@ -1,15 +1,11 @@
# global
* @cicdw
* @cicdw @desertaxle @zzstoatzz

# ui
/ui @znicholasbrown

# documentation
/docs @discdiver @daniel-prefect

/docs @discdiver @cicdw @desertaxle @zzstoatzz
# imports
/src/prefect/__init__.py @aaazzam @chrisguidry
/src/prefect/main.py @aaazzam @chrisguidry

# integrations
/src/integrations @desertaxle @zzstoatzz
/src/prefect/__init__.py @aaazzam @chrisguidry @cicdw @desertaxle @zzstoatzz
/src/prefect/main.py @aaazzam @chrisguidry @cicdw @desertaxle @zzstoatzz
28 changes: 23 additions & 5 deletions .github/ISSUE_TEMPLATE/1_bug_report.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@ body:
4. Additional details that may help us reproduce your issue.
For usage questions, please check out Prefect's [Community Slack](https://www.prefect.io/slack/).
For usage questions, please open a [discussion](https://github.com/PrefectHQ/prefect/discussions).
- type: textarea
attributes:
Expand All @@ -41,10 +41,28 @@ body:

- type: textarea
attributes:
label: Version info (`prefect version` output)
description: >
Provide information about your Prefect version and environment. The easiest way to retrieve all of this information is by running the `prefect version` command.
placeholder: "# Copy output of the `prefect version` command here. Do not just include your Prefect version number."
label: Version info
description: |
Provide information about your Prefect version and environment.
Please run `prefect version` and paste the output below.
placeholder: |
Provide the output of `prefect version` here.
Should look something like this:
Version: 3.0.10
API version: 0.8.4
Python version: 3.12.5
Git commit: 3aa2d893
Built: Tue, Oct 15, 2024 1:31 PM
OS/Arch: darwin/arm64
Profile: local
Server type: server
Pydantic version: 2.9.2
Integrations:
prefect-kubernetes: 0.5.2
render: Text
validations:
required: true
Expand Down
2 changes: 2 additions & 0 deletions .github/ISSUE_TEMPLATE/2_feature_enhancement.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,8 @@ body:
3. I searched the Prefect documentation for this feature.
**Note:** Enhancements are only considered for Prefect 3.x. Prefect 2.x only receives bug fixes.
- type: textarea
attributes:
label: Describe the current behavior
Expand Down
14 changes: 14 additions & 0 deletions .github/labeler.yml
Original file line number Diff line number Diff line change
@@ -1,3 +1,17 @@
docs:
- changed-files:
- any-glob-to-any-file: docs/**

migration:
- changed-files:
- any-glob-to-any-file: src/**/migrations/**/*.py

upstream dependency:
- changed-files:
- any-glob-to-any-file:
- requirements.txt
- requirements-client.txt
- requirements-dev.txt

2.x:
- base-branch: '2.x'
2 changes: 2 additions & 0 deletions .github/release.yml
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,8 @@ changelog:
- title: New Features 🎉
labels:
- feature
- title: Enhancements ➕➕
labels:
- enhancement
- title: Bug Fixes 🐞
labels:
Expand Down
2 changes: 2 additions & 0 deletions .github/workflows/api-compatibility-tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,8 @@ concurrency:
jobs:
compatibility-tests:

if: false # temporarily pausing compat tests on OSS

timeout-minutes: 10

runs-on: ubuntu-latest
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/benchmarks.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,7 @@ jobs:
- name: Start server
run: |
prefect server start&
PREFECT_HOME=$(pwd) prefect server start&
PREFECT_API_URL="http://127.0.0.1:4200/api" ./scripts/wait-for-server.py
# TODO: Replace `wait-for-server` with dedicated command
Expand All @@ -105,8 +105,8 @@ jobs:
# characters with an underscore
sanitized_uniquename="${uniquename//[^a-zA-Z0-9_\-]/_}"
PREFECT_API_URL="http://127.0.0.1:4200/api"
python benches \
PREFECT_API_URL="http://127.0.0.1:4200/api" \
python -m benches \
--ignore=benches/bench_import.py \
--timeout=180 \
--benchmark-save="${sanitized_uniquename}" \
Expand Down
6 changes: 3 additions & 3 deletions .github/workflows/codspeed-benchmarks.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -61,18 +61,18 @@ jobs:
- name: Install packages
run: |
python -m pip install -U uv
uv pip install --upgrade --system -e .[dev]
uv pip install --upgrade --system .[dev]
- name: Start server
run: |
prefect server start&
PREFECT_HOME=$(pwd) prefect server start&
PREFECT_API_URL="http://127.0.0.1:4200/api" ./scripts/wait-for-server.py
# TODO: Replace `wait-for-server` with dedicated command
# https://github.com/PrefectHQ/prefect/issues/6990
- name: Run benchmarks
uses: CodSpeedHQ/action@v2
uses: CodSpeedHQ/action@v3
env:
PREFECT_API_URL: "http://127.0.0.1:4200/api"
with:
Expand Down
8 changes: 8 additions & 0 deletions .github/workflows/copy-linked-issue-labels.yml
Original file line number Diff line number Diff line change
Expand Up @@ -11,4 +11,12 @@ jobs:
- name: copy-labels
uses: michalvankodev/[email protected]
with:
custom-keywords: |
in
references
reference
to
labels-to-exclude: |
great writeup
good first issue
repo-token: ${{ secrets.GITHUB_TOKEN }}
24 changes: 3 additions & 21 deletions .github/workflows/docker-images.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -4,24 +4,6 @@ on:
# On release events (also when a published release is converted from/to prerelease), push all patterns
release:
types: [released, prereleased]
# On each commit merged into main, push sha and branch patterns to prefect-dev
push:
branches: [main]
paths:
- "Dockerfile"
- ".dockerignore"
- "setup.py"
- "src/**"
- "tests/**"
- "requirements.txt"
- "requirements-client.txt"
- "MANIFEST.in"
- "setup.cfg"
- "versioneer.py"
- ".gitingore"
- ".gitattributes"
- ".github/workflows/docker-images.yaml"
- "ui/**"

# On workflow_dispatch, allow publishing 3-latest images
workflow_dispatch:
Expand Down Expand Up @@ -54,7 +36,7 @@ jobs:
if: ${{ github.event_name == 'release' && github.event.release.prerelease == true }}
run: |
TAG_NAME=${{ github.ref }}
if [[ ! "$TAG_NAME" =~ ^refs/tags/[0-9]+\.[0-9]+\.[0-9]+[a-zA-Z0-9]+$ ]]; then
if [[ ! "$TAG_NAME" =~ ^refs/tags/[0-9]+\.[0-9]+\.[0-9]+([a-zA-Z0-9]+|\.dev[0-9]+)$ ]]; then
echo "Error: Tag $TAG_NAME does not match prerelease version pattern."
exit 1
fi
Expand All @@ -80,8 +62,8 @@ jobs:
- name: Generate tags for prefecthq/prefect-dev
id: metadata-dev
uses: docker/metadata-action@v5
# do not generate the development tags on release events
if: ${{ github.event_name != 'release' }}
# do not generate the development tags on true release events, only pre-releases
if: ${{ github.event_name == 'release' && github.event.release.prerelease == true }}
with:
images: prefecthq/prefect-dev
tags: |
Expand Down
1 change: 1 addition & 0 deletions .github/workflows/helm-chart-release.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ on:

jobs:
create_helm_release:
if: startsWith(github.ref, 'refs/tags/3.')
runs-on: ubuntu-latest
steps:
- name: Create prefect-helm release
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/integration-package-release.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -23,7 +23,7 @@ jobs:
id: package_name
run: |
TAG_NAME=${{ github.ref_name }}
PACKAGE_NAME=$(echo $TAG_NAME | sed 's/-[0-9][.0-9]*rc.*$//')
PACKAGE_NAME=$(echo $TAG_NAME | sed 's/-[0-9][.0-9]*$//')
echo "PACKAGE_NAME=$PACKAGE_NAME" >> $GITHUB_OUTPUT
- name: Set up Python
Expand Down
11 changes: 10 additions & 1 deletion .github/workflows/integration-package-tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -90,6 +90,15 @@ jobs:
if: matrix.package == 'prefect-docker'
run : prefect dev build-image

- name: Start redis
if: matrix.package == 'prefect-redis'
run: >
docker run
--name "redis"
--detach
--publish 6379:6379
redis:latest
- name: Run tests
if: matrix.package != 'prefect-ray'
env:
Expand All @@ -98,7 +107,7 @@ jobs:
run: >
pytest tests
--numprocesses auto
--maxprocesses 6
--maxprocesses 4
--dist worksteal
# Run prefect-ray tests sequentially to avoid Ray cluster issues
Expand Down
18 changes: 8 additions & 10 deletions .github/workflows/integration-tests.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -34,12 +34,11 @@ jobs:
fail-fast: false
matrix:
server-version: [
# These versions correspond to Prefect image tags, the patch version is
# excluded to always pull the latest patch of each minor version. The ref
# should generally be set to the latest patch release for that version.
{version: "2.19", ref: "2.19.2", image: "prefecthq/prefect:2.19-python3.10"},
{version: "main", ref: "main"},
]
# These versions correspond to Prefect image tags, the patch version is
# excluded to always pull the latest patch of each minor version. The ref
# should generally be set to the latest patch release for that version.
{ version: "main", ref: "main" },
]

steps:
- uses: actions/checkout@v4
Expand Down Expand Up @@ -72,16 +71,15 @@ jobs:
if: ${{ matrix.server-version.version != 'main' }}
env:
PREFECT_API_URL: http://127.0.0.1:4200/api
PREFECT_LOGGING_SERVER_LEVEL: DEBUG
PREFECT_SERVER_LOGGING_LEVEL: DEBUG
PREFECT_EXPERIMENTAL_EVENTS: "true"
run: >
docker run \
--name "prefect-server" \
-d \
-p 4200:4200 \
-e PREFECT_API_URL=${{ env.PREFECT_API_URL }} \
-e PREFECT_LOGGING_SERVER_LEVEL=${{ env.PREFECT_LOGGING_SERVER_LEVEL }} \
-e PREFECT_EXPERIMENTAL_EVENTS=${{ env.PREFECT_EXPERIMENTAL_EVENTS }} \
-e PREFECT_SERVER_LOGGING_LEVEL=${{ env.PREFECT_SERVER_LOGGING_LEVEL }} \
${{ matrix.server-version.image }} \
prefect server start --analytics-off --host 0.0.0.0
Expand All @@ -94,7 +92,7 @@ jobs:
if: ${{ matrix.server-version.version == 'main' }}
env:
PREFECT_API_URL: http://127.0.0.1:4200/api
PREFECT_LOGGING_SERVER_LEVEL: DEBUG
PREFECT_SERVER_LOGGING_LEVEL: DEBUG
run: >
prefect server start --analytics-off --host 0.0.0.0 2>&1 > server.log &
Expand Down
7 changes: 6 additions & 1 deletion .github/workflows/labeler.yml
Original file line number Diff line number Diff line change
@@ -1,6 +1,7 @@
name: Labeler

on: [pull_request]
# see https://github.com/actions/labeler/issues/136#issuecomment-1357839196
on: [pull_request_target]

permissions:
contents: read
Expand All @@ -12,6 +13,10 @@ jobs:
contents: read
pull-requests: write
steps:
- uses: actions/checkout@v4
with:
persist-credentials: false
fetch-depth: 0
- uses: actions/labeler@v5
with:
repo-token: "${{ github.token }}"
Loading

0 comments on commit 066d387

Please sign in to comment.