-
Notifications
You must be signed in to change notification settings - Fork 52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
support jamie oliver scraping (and fix the entire project) #44
Conversation
Hey there! Thanks for all this work in getting the package up to date, adding a new prop, and scrape. I'll take a look at it ASAP, hopefully by this weekend. I see you're still debugging, so let me know if you make any headway. |
@jadkins89 Hi 🙋♀️ I still don't know why the request to |
@shaniqwa That solution will work for now. Certain websites seem to have occasional issues with being scraped from TravisCI. We may get some false positives but I don't know if there is a perfect solution here. One thing I'd like removed before merging is the dependency to moment. It is only being used in one scrape, so the added bloat doesn't seem worth it. Thank you so much your time and effort bringing the scrapes back up to par! |
@jadkins89 done :) |
Hi there,
very cool project. I wanted to explore scraping and adding a new website, did Jamie Oliver as suggested here: #32
but when I opened a PR I have found out that many of the tests fail... for a good reason - there have been quite a few changes out there. Hopefully, things will work better now..!
In this PR:
For some reason, I'm still getting 1 fail test on Travis. it failed to fetchDOMModel: response status 503
but on my local machine all test pass:
178 passing (4m)
would appreciate help getting this last one to pass as well :)
cheers
UPDATE: I have added a validation, skipping the test in case the server is not responding. let me know what you think