-
Notifications
You must be signed in to change notification settings - Fork 3
feat: prepare data script + pull data into google spreadsheet #7
base: master
Are you sure you want to change the base?
Conversation
Per discussion with @carlfredl: it would be nice to have google/transit + MobilityData/transit data aggregated all together. |
@carlfredl updated this PR following your suggestions. @maximearmstrong: the PR in question @heidiguenin according to this PR description, what other indicators could be relevant? |
Please note that nice to have items from https://github.com/MobilityData/Tasks/issues/1170 are not implemented yet. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Overall great job! Just be careful with the style consistency and when possible create constants for the keys/strings that often appear in the code.
- declare symbolic constants - leverage Standard JS
Thanks @maximearmstrong for the review! In addition to local installation of Standard JS, what do you think about adding a CI step to check the code syntax? Found this tool that could help us with that. |
This PR provides changes to fetch and prepare data for visualization.
Data
The rest api provided by Github is heavily leveraged to get data from Github repositories
What do we get from there?
This data is gathered for each of the following repositories:
How is the data transformed into information?
Item from here are counted then classified by quarter of the year.
Technical
Octokit
is the library used to proceed: it has been developed by Github, has great documentation and mechanisms to automatically paginate over HTTP responses.metrics.json
filesGCP
This PR comes along with the implementation of a pipeline using Google Cloud Platform that enables automation of data crunching.
View data