Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Data Pipelines course material #56

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
60 changes: 60 additions & 0 deletions 2-advanced-topics/data-pipelines/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,60 @@
# DEC-foundations-of-python

This repository contains all the material for the DEC Python training.
This training is developed by DIME Analytics and DECID.

## Course content

This training is structured into three parts.
Part 0 is a single-session introduction for people with no coding background.
Part 1 is a course that covers the foundations of Python
used in almost any type of Python data science project.
Part 2 is a collection of stand-alone sessions that
assumes knowledge in the foundations of Python
and each session dives deeper into the advanced topic.

#### Links to content
* **Part 0 - Intro to Programming**
* [Slides](https://github.com/worldbank/dec-python-course/blob/main/0-intro-to-programming/0-intro-to-programming.pdf)
* **Part 1 - Foundations of Data Science in Python**
* Session 1 - Variable types and Python syntax
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/1-types-and-syntax/foundations-s1.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/1-types-and-syntax/foundations-s1.ipynb)
* [Suggested solutions](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/1-types-and-syntax/solutions-s1.ipynb)
* Session 2 - Control flow and functions
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/2-control-flows-and-functions/foundations-s2.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/2-control-flows-and-functions/foundations-s2.ipynb)
* [Suggested solutions](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/2-control-flows-and-functions/solutions-s2.ipynb)
* Session 3 - NumPy and Pandas
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/3-numpy-and-pandas/foundations-s3.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/3-numpy-and-pandas/foundations-s3.ipynb)
* [Suggested solutions](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/3-numpy-and-pandas/solutions-s3.ipynb)
* Session 4 - APIs and introduction to data visualization in Python
* APIs
* [Slides](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/4-api-and-dataviz/Introduction%20to%20APIs.pdf)
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/4-api-and-dataviz/foundations-s4-api.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/4-api-and-dataviz/foundations-s4-api.ipynb)
* [Suggested solutions](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/4-api-and-dataviz/foundations-s4-api-solutions.ipynb)
* Data visualization
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/4-api-and-dataviz/foundations-s4-dataviz.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/4-api-and-dataviz/foundations-s4-dataviz.ipynb)
* Project 1 - Schelling model
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/project-1-schelling-model/project-1-schelling-model-of-segregation.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/project-1-schelling-model/project-1-schelling-model-of-segregation.ipynb)
* [Suggested solutions](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/project-1-schelling-model/project1-solutions.ipynb)
* Project 2 - Raster data analysis and ML inference
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/project-2-rasters_and_functions/Project%202.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/1-foundations/project-2-rasters_and_functions/Project%202.ipynb)
* [Suggested solutions](https://github.com/worldbank/dec-python-course/blob/main/1-foundations/project-2-rasters_and_functions/Project%202_Solutions.ipynb)
* **Part 2 - Advanced topics of Data Science of Python**
* Geospatial analysis
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/2-advanced-topics/geospatial-analysis/geospatial-analysis.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/2-advanced-topics/geospatial-analysis/geospatial-analysis.ipynb)
* Introduction to text analysis
* [Jupyter notebook](https://github.com/worldbank/dec-python-course/blob/main/2-advanced-topics/text-analysis/intro-text-analysis.ipynb)
* [Colab notebook](https://colab.research.google.com/github/worldbank/dec-python-course/blob/main/2-advanced-topics/text-analysis/intro-text-analysis.ipynb)

## Contact

If you have any questions you can contact one of the teams behind this training
on [email protected].
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@bhupatiraju this README seems identical to what's currently at the root of this repo. Did you mean to copy and modify?

87,965 changes: 87,965 additions & 0 deletions 2-advanced-topics/data-pipelines/bronze.ipynb

Large diffs are not rendered by default.

140,231 changes: 140,231 additions & 0 deletions 2-advanced-topics/data-pipelines/gold.ipynb

Large diffs are not rendered by default.

Loading