Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Delete files which were removed in source dir #41

Open
wants to merge 28 commits into
base: main
Choose a base branch
from
Open
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
4837b47
Delete files which were removed in source dir
eepifanova Feb 26, 2025
9f7c0c3
Update docs-build-push.yml AZCOPY_AUTO_LOGIN_TYPE
eepifanova Feb 27, 2025
b948bc5
Tenant ID
eepifanova Feb 27, 2025
686b445
Update docs-build-push.yml
eepifanova Feb 27, 2025
7600643
env
eepifanova Feb 27, 2025
0b58ced
Update docs-build-push.yml
eepifanova Feb 27, 2025
620f87a
Update docs-build-push.yml
eepifanova Feb 27, 2025
aa7e4f1
Update docs-build-push.yml
eepifanova Feb 27, 2025
0a06bbd
Update docs-build-push.yml
eepifanova Feb 27, 2025
a3f03ba
Update docs-build-push.yml
eepifanova Feb 27, 2025
d14f145
Update docs-build-push.yml
eepifanova Feb 27, 2025
67e6510
Update docs-build-push.yml
eepifanova Feb 27, 2025
fac110e
Update docs-build-push.yml
eepifanova Feb 27, 2025
5b80d75
Update docs-build-push.yml
eepifanova Feb 27, 2025
12d0f0b
Update docs-build-push.yml
eepifanova Feb 27, 2025
bed07dc
Update docs-build-push.yml
eepifanova Feb 27, 2025
5d06e22
Update docs-build-push.yml
eepifanova Mar 12, 2025
76a2d34
Update docs-build-push.yml
eepifanova Mar 12, 2025
2718fe2
Update docs-build-push.yml
eepifanova Mar 12, 2025
f1d5756
Update docs-build-push.yml
eepifanova Mar 12, 2025
b9aa10f
Update docs-build-push.yml. List of existing blobs
eepifanova Mar 13, 2025
5c5adf4
Update docs-build-push.yml the the full list of blobs
eepifanova Mar 13, 2025
17f7200
Update docs-build-push.yml remove function preview
eepifanova Mar 13, 2025
915e9fe
Update docs-build-push.yml
eepifanova Mar 13, 2025
42a5849
Update docs-build-push.yml
eepifanova Mar 13, 2025
2a7e476
Update docs-build-push.yml test
eepifanova Mar 13, 2025
3c6ab86
Update docs-build-push.yml
eepifanova Mar 13, 2025
58e1b16
Update docs-build-push.yml typo
eepifanova Mar 13, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
48 changes: 48 additions & 0 deletions .github/workflows/docs-build-push.yml
Original file line number Diff line number Diff line change
Expand Up @@ -248,6 +248,54 @@ jobs:
make deploy

### Azure upload
- name: TEST UPLOAD EXCESSIVE FILES
uses: azure/cli@089eac9d8cc39f5d003e94f8b65efc51076c9cbd # v2.1.0
if: github.event.action == 'synchronize' || github.event.action == 'opened' || env.DEPLOYMENT_ENV == 'preview'
with:
inlineScript: |
mkdir test
for i in 1 3 4 5 6 ; do echo file$i > test/file$i; done
az storage blob upload-batch \
-s test \
-d '$web' \
--destination-path "dev/${{github.repository}}/previews/${PR_NUMBER}" \
--account-name ${{steps.keyvault.outputs.accountName}} \
--overwrite \
--content-cache-control "max-age=3600" \
--auth-mode login

- name: Remove excessive files
uses: azure/cli@089eac9d8cc39f5d003e94f8b65efc51076c9cbd # v2.1.0
if: github.event.action == 'synchronize' || github.event.action == 'opened' || env.DEPLOYMENT_ENV == 'preview'
with:
inlineScript: |
dstprefix="dev/${{github.repository}}/previews/${PR_NUMBER}"
srcprefix="$DOCS_SOURCE_PATH"
az storage blob list \
--container-name '$web' \
--account-name ${{steps.keyvault.outputs.accountName}} \
--auth-mode login \
--prefix "dev/${{github.repository}}/previews/${PR_NUMBER}/" > blobs.txt
cat blobs.txt | grep name | cut -d: -f 2 | cut -d'"' -f2 > blobs_paths.txt
echo "Files in storage: `wc -l blobs_paths.txt`"
cat blobs_paths.txt | sed -e "s#${dstprefix}/##g" > blobs_names.txt
echo "Names in storage: `wc -l blobs_names.txt`"
find ${srcprefix} -type f > local_paths.txt
echo "Files local: `wc -l local_paths.txt`"
cat local_paths.txt | sed -e "s#${srcprefix}/##g" > local_names.txt
echo "Names local: `wc -l local_names.txt`"
grep -Fxv -f local_names.txt blobs_names.txt > delete.txt || true
echo "Files to delete: `wc -l delete.txt`"
cat delete.txt
for file in `cat delete.txt` ; do
# we have to remove the file
az storage blob delete \
--container-name '$web' \
--name ${dstprefix}/${file} \
--account-name ${{steps.keyvault.outputs.accountName}} \
--auth-mode login
echo "${dstprefix}/${file} should be removed"
done

- name: Azure upload PR preview
uses: azure/cli@089eac9d8cc39f5d003e94f8b65efc51076c9cbd # v2.1.0
Expand Down