Unable to download taxi data from chapter 3

[ajcastany]

Running the provided Chapter 3 (page 59) taxi_data_prep.sh in WSL gives 403, access denied error, as the URL https://s3.amazonaws.com/nyc-tlc/trip+data/ also gives 403 access denied when accessing from browser.

How can i get access to the data?

--2023-07-21 15:42:25-- https://s3.amazonaws.com/nyc-tlc/trip+data/yellow_tripdata_2020-04.csv Resolving s3.amazonaws.com (s3.amazonaws.com)... 52.217.202.160, 54.231.233.40, 52.217.133.64, ... Connecting to s3.amazonaws.com (s3.amazonaws.com)|52.217.202.160|:443... connected. HTTP request sent, awaiting response... 403 Forbidden 2023-07-21 15:42:26 ERROR 403: Forbidden.

[MertHoc]

Hello. Thanks for brining this to our attention. It looks like the NYC Taxi public dataset changed their directory structure. We have updated the scripts to reflect the new structure. Please pull and try again now and let us know if you are still having trouble.

[ajcastany]

I tried running the script and i get:

Downloading yellow_tripdata_2018-01.csv from nyc-tlc fatal error: An error occurred (403) when calling the HeadObject operation: Forbidden Performing gzip on yellow_tripdata_2018-01.csv gzip: yellow_tripdata_2018-01.csv: No such file or directory

i cannot list the bucket with aws s3 ls nyc-tlc i get:

An error occurred (AccessDenied) when calling the ListObjectsV2 operation: Access Denied

[ajcastany]

I managed to get access to the S3 Bucket, in the Iam policy for Chapter_3 i had to add the bucket arn to s3:getObject, etc:

arn:aws:s3:::nyc-tlc and arn:aws:s3:::nyc-tlc/*

in this section: `https://github.com/PacktPublishing/Serverless-Analytics-with-Amazon-Athena/blob/main/chapter_3/iam_policy_chapter_3.json#L45