Skip to content

0.4.0

Compare
Choose a tag to compare
@myfreeer myfreeer released this 17 Jul 04:23
· 735 commits to master since this release
npm: release version 0.4.0

BREAKING
------------
* worker-pool: load based worker pool (#11)
* cheerio: adapt for version 1.0.0-rc.10 (#271)
* test: adapt for URI.js v1.19.7 (#301)

Fix
------------
* downloader: correctly transfer resource body
* correctly convent ArrayBufferView to Buffer
* worker-pool: fix ready

Enhancement
------------
* npm: update
* life-cycle: add init and dispose life cycle
* resource: optionally redirected savePath
* resource: take a log on replacing long search string
* save-to-disk: optionally use remote date
* worker-pool: log worker errors
* worker-pool: custom initializer of worker

Test
------------
* worker-pool: basic unit test
* save-html-to-disk: initial unit tests with mocked fs
* save-to-disk: refactor tests

Close https://github.com/website-local/website-scrap-engine/issues/281