-
Notifications
You must be signed in to change notification settings - Fork 705
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
- Loading branch information
1 parent
ab13cf6
commit 30f0193
Showing
19 changed files
with
101 additions
and
101 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
|
@@ -11,7 +11,7 @@ Easy integration with Athena, Glue, Redshift, Timestream, OpenSearch, Neptune, Q | |
|
||
> An [AWS Professional Service](https://aws.amazon.com/professional-services/) open source initiative | [email protected] | ||
[](https://pypi.org/project/awswrangler/) | ||
[](https://pypi.org/project/awswrangler/) | ||
[](https://anaconda.org/conda-forge/awswrangler) | ||
[](https://github.com/psf/black) | ||
[](https://opensource.org/licenses/Apache-2.0) | ||
|
@@ -99,27 +99,27 @@ FROM "sampleDB"."sampleTable" ORDER BY time DESC LIMIT 3 | |
## At scale | ||
AWS SDK for pandas can also run your workflows at scale by leveraging [Modin](https://modin.readthedocs.io/en/stable/) and [Ray](https://www.ray.io/). Both projects aim to speed up data workloads by distributing processing over a cluster of workers. | ||
|
||
The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/scale.html), our blogs ([1](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/)/[2](https://aws.amazon.com/blogs/big-data/advanced-patterns-with-aws-sdk-for-pandas-on-aws-glue-for-ray/)), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features. | ||
The quickest way to get started is to use AWS Glue with Ray. Read our [docs](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/scale.html), our blogs ([1](https://aws.amazon.com/blogs/big-data/scale-aws-sdk-for-pandas-workloads-with-aws-glue-for-ray/)/[2](https://aws.amazon.com/blogs/big-data/advanced-patterns-with-aws-sdk-for-pandas-on-aws-glue-for-ray/)), or head to our latest [tutorials](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) to discover even more features. | ||
|
||
> ⚠️ **Ray is currently not available for Python 3.12. While AWS SDK for pandas supports Python 3.12, it cannot be used at scale.** | ||
## [Read The Docs](https://aws-sdk-pandas.readthedocs.io/) | ||
|
||
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/about.html) | ||
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html) | ||
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#pypi-pip) | ||
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#conda) | ||
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#aws-lambda-layer) | ||
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#aws-glue-python-shell-jobs) | ||
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#aws-glue-pyspark-jobs) | ||
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#amazon-sagemaker-notebook) | ||
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#amazon-sagemaker-notebook-lifecycle) | ||
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#emr) | ||
- [From source](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/install.html#from-source) | ||
- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/scale.html) | ||
- [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/scale.html#getting-started) | ||
- [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/scale.html#supported-apis) | ||
- [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/scale.html#resources) | ||
- [**What is AWS SDK for pandas?**](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/about.html) | ||
- [**Install**](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html) | ||
- [PyPi (pip)](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#pypi-pip) | ||
- [Conda](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#conda) | ||
- [AWS Lambda Layer](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#aws-lambda-layer) | ||
- [AWS Glue Python Shell Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#aws-glue-python-shell-jobs) | ||
- [AWS Glue PySpark Jobs](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#aws-glue-pyspark-jobs) | ||
- [Amazon SageMaker Notebook](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#amazon-sagemaker-notebook) | ||
- [Amazon SageMaker Notebook Lifecycle](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#amazon-sagemaker-notebook-lifecycle) | ||
- [EMR](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#emr) | ||
- [From source](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/install.html#from-source) | ||
- [**At scale**](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/scale.html) | ||
- [Getting Started](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/scale.html#getting-started) | ||
- [Supported APIs](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/scale.html#supported-apis) | ||
- [Resources](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/scale.html#resources) | ||
- [**Tutorials**](https://github.com/aws/aws-sdk-pandas/tree/main/tutorials) | ||
- [001 - Introduction](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/001%20-%20Introduction.ipynb) | ||
- [002 - Sessions](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/002%20-%20Sessions.ipynb) | ||
|
@@ -162,31 +162,31 @@ The quickest way to get started is to use AWS Glue with Ray. Read our [docs](htt | |
- [039 - Athena Iceberg](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/039%20-%20Athena%20Iceberg.ipynb) | ||
- [040 - EMR Serverless](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/040%20-%20EMR%20Serverless.ipynb) | ||
- [041 - Apache Spark on Amazon Athena](https://github.com/aws/aws-sdk-pandas/blob/main/tutorials/041%20-%20Apache%20Spark%20on%20Amazon%20Athena.ipynb) | ||
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html) | ||
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-s3) | ||
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#aws-glue-catalog) | ||
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-athena) | ||
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#aws-lake-formation) | ||
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-redshift) | ||
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#postgresql) | ||
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#mysql) | ||
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#sqlserver) | ||
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#oracle) | ||
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#data-api-redshift) | ||
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#data-api-rds) | ||
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#opensearch) | ||
- [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#aws-glue-data-quality) | ||
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-neptune) | ||
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#dynamodb) | ||
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-timestream) | ||
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-emr) | ||
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-cloudwatch-logs) | ||
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-chime) | ||
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#amazon-quicksight) | ||
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#aws-sts) | ||
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#aws-secrets-manager) | ||
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#global-configurations) | ||
- [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.5.0/api.html#distributed-ray) | ||
- [**API Reference**](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html) | ||
- [Amazon S3](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-s3) | ||
- [AWS Glue Catalog](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#aws-glue-catalog) | ||
- [Amazon Athena](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-athena) | ||
- [AWS Lake Formation](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#aws-lake-formation) | ||
- [Amazon Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-redshift) | ||
- [PostgreSQL](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#postgresql) | ||
- [MySQL](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#mysql) | ||
- [SQL Server](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#sqlserver) | ||
- [Oracle](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#oracle) | ||
- [Data API Redshift](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#data-api-redshift) | ||
- [Data API RDS](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#data-api-rds) | ||
- [OpenSearch](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#opensearch) | ||
- [AWS Glue Data Quality](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#aws-glue-data-quality) | ||
- [Amazon Neptune](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-neptune) | ||
- [DynamoDB](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#dynamodb) | ||
- [Amazon Timestream](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-timestream) | ||
- [Amazon EMR](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-emr) | ||
- [Amazon CloudWatch Logs](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-cloudwatch-logs) | ||
- [Amazon Chime](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-chime) | ||
- [Amazon QuickSight](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#amazon-quicksight) | ||
- [AWS STS](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#aws-sts) | ||
- [AWS Secrets Manager](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#aws-secrets-manager) | ||
- [Global Configurations](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#global-configurations) | ||
- [Distributed - Ray](https://aws-sdk-pandas.readthedocs.io/en/3.5.1/api.html#distributed-ray) | ||
- [**License**](https://github.com/aws/aws-sdk-pandas/blob/main/LICENSE.txt) | ||
- [**Contributing**](https://github.com/aws/aws-sdk-pandas/blob/main/CONTRIBUTING.md) | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1 +1 @@ | ||
3.5.0 | ||
3.5.1 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Oops, something went wrong.