Skip to content

Commit

Permalink
Merge pull request #13 from google/fixing-new-deploy-location
Browse files Browse the repository at this point in the history
Fixing new deploy location
  • Loading branch information
caiotomazelli authored Apr 30, 2021
2 parents 378c018 + d6acb45 commit f115c7e
Show file tree
Hide file tree
Showing 2 changed files with 6 additions and 3 deletions.
7 changes: 5 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -111,8 +111,11 @@ python3 megalist_dataflow/main.py \
```

### Deploying Pipeline
To deploy, use the following command:
`./deploy_cloud.sh project_id bucket_name region_name`
To deploy, use the following commands from the root folder:
```
cd terraform
./scripts/deploy_cloud.sh project_id bucket_name region_name
```

#### Manually executing pipeline using Dataflow UI
To execute the pipeline, use the following steps:
Expand Down
2 changes: 1 addition & 1 deletion terraform/scripts/deploy_cloud.sh
Original file line number Diff line number Diff line change
Expand Up @@ -26,7 +26,7 @@ echo "Configuration GCP project in gcloud"
gcloud config set project "$1"
echo "Build Dataflow metadata"
python3 -m pip install --user -q -r requirements.txt
python3 -m main --runner DataflowRunner --project "$1" --gcp_project_id "$1" --temp_location"gs://$2/tmp/" --region "$3" --setup_file ./setup.py --template_location "gs://$2/templates/megalista" --num_workers 1 --autoscaling_algorithm=NONE
python3 -m main --runner DataflowRunner --project "$1" --gcp_project_id "$1" --temp_location "gs://$2/tmp/" --region "$3" --setup_file ./setup.py --template_location "gs://$2/templates/megalista" --num_workers 1 --autoscaling_algorithm=NONE
echo "Copy megalista_medata to bucket $2"
gsutil cp megalist_metadata "gs://$2/templates/megalista_metadata"
cd ..

0 comments on commit f115c7e

Please sign in to comment.