0.7.2

0.7.2

Note

• This would be the last version before updating minimal supported node version

Misc

• npm: update dependencies

0.7.1

0.7.1

Enhancement

• sources: add video poster
• process-html: handle meta refresh redirect (#897)

Test

• npm: upgrade jest to 28

Misc

• npm: update dependencies
• npm: initial npm provenance support (#898)

0.7.0

0.7.0

BREAKING

• build(deps): bump mkdirp from 2.1.6 to 3.0.0
• build(deps-dev): bump typescript from 4.9.5 to 5.0.4

0.6.0

npm: prepare for 0.6.0 release

Close https://github.com/website-local/website-scrap-engine/issues/720

BREAKING
------------
* resource: custom callback for rewriting savePath
* life-cycle: custom callback for rewriting savePath (<https://github.com/website-local/website-scrap-engine/issues/383>)

Fix
------------
* cheerio: replace deprecated api

Test
------------
* test: migrating to eslint v8 and typescript-eslint v5
* cheerio: fix a test
* resource: add a test
* ci: run tests on node.js 18.x (<https://github.com/website-local/website-scrap-engine/issues/610>)

Misc
------------
* package-lock-resolved: process registry.npmmirror.com
* logger: fix type conflict
* util: fix compatibility with typescript 4.8
* npm: drop @types/mkdirp
* update deps

0.5.0

infra: add changelog for release 0.5.0

BREAKING
------------
* typescript 4.4 support
  * WorkerMessage: `error` can be `unknown`
  * StreamingDownloadErrorHook: `e` can be `unknown`
* pipeline-executor-impl fix keepSearch param
* resource: redirectedSavePath not set after redirect

Test
------------
* test: adapt for jest 27 and ts-jest 27

0.4.0

npm: release version 0.4.0

BREAKING
------------
* worker-pool: load based worker pool (#11)
* cheerio: adapt for version 1.0.0-rc.10 (#271)
* test: adapt for URI.js v1.19.7 (#301)

Fix
------------
* downloader: correctly transfer resource body
* correctly convent ArrayBufferView to Buffer
* worker-pool: fix ready

Enhancement
------------
* npm: update
* life-cycle: add init and dispose life cycle
* resource: optionally redirected savePath
* resource: take a log on replacing long search string
* save-to-disk: optionally use remote date
* worker-pool: log worker errors
* worker-pool: custom initializer of worker

Test
------------
* worker-pool: basic unit test
* save-html-to-disk: initial unit tests with mocked fs
* save-to-disk: refactor tests

Close https://github.com/website-local/website-scrap-engine/issues/281

0.3.2

npm: release version 0.3.2

Changes
----------
* resource: fix redirected path processing (#157)
* downloader: optional wait for this.init in method onIdle (#152)
* typescript: prefer type only import

0.3.1

npm: release version 0.3.1

Changes
----------
* resource: use correct file scheme for windows (#145)

0.3.0

npm: bump version to 0.3.0

New Feature
-------------
* life-cycle: extract and process source maps (#123)
* adapters: async processHtml
* life-cycle: add read-or-copy-local-resource
* resource: support file protocol (#126)

Misc
-------------
* types: export type CheerioElement
* resource: optional skip replacePath processing in case of parser error (#107)
* resource: fix new type of Buffer.from (#116)
* build(deps): bump cheerio from 1.0.0-rc.3 to 1.0.0-rc.5
* io: mkdirRetry returns no string
* life-cycle: add download-streaming-resource to default
* skip-links: skip unix scheme
* skip-links: allow file protocol
* download: skip non-http url
* (BREAKING) resource: refactor createResource (#139)

0.2.0

npm: bump version to 0.2.0

BREAKING RELEASE 0.2.0
---------------------
* life-cycle: streaming download and save binary resource to disk
* build(deps-dev): bump @types/cheerio from 0.22.21 to 0.22.22