Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Transition scrapers to rebuilding one source at a time #579

Open
1 task
chrismytton opened this issue Feb 6, 2017 · 0 comments
Open
1 task

Transition scrapers to rebuilding one source at a time #579

chrismytton opened this issue Feb 6, 2017 · 0 comments

Comments

@chrismytton
Copy link
Contributor

Problem

It can be tricky to isolate problems in incoming pull requests because they usually rebuild all sources for a legislature, which means you can be faced with problems from multiple different sources interacting with each other.

Proposed Solution

Only rebuild a single source at a time. This will probably force us to solve everypolitician/rebuilder#60 due to the sheer volume of PRs that will be queued up.

  • Update the webhook url that scrapers call to include the source

Acceptance Criteria

There should be no regular PRs being generated for a whole legislature.

Not Required

We don't need to change how the rebuilds are done for this issue, just change the webhook url.

Prerequisites

Due Date

ASAP!

Design?

No.

Text?

No.

Bloggable?

No.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants