Code

switch to async streaming download:#1982

Code

Merged

ikreymer merged 9 commits intomainwebrecorder/browsertrix:mainfrom async-streaming-downloadwebrecorder/browsertrix:async-streaming-downloadCopy head branch name to clipboardOct 3, 2024

+69-56

Commits

Commits on Oct 3, 2024

• switch to async streaming download:

  Show description for 9df816b
  ikreymer

  committed
  9df816b

  Copy full SHA for 9df816b

• fix path == name in datapackage.json, to match previous behavior

  Show description for 6036319
  ikreymer

  committed
  6036319

  Copy full SHA for 6036319

• fix multi-wacz datapackage.json:

  Show description for 68deb3f
  ikreymer

  committed
  68deb3f

  Copy full SHA for 68deb3f

• update test

  ikreymer

  committed
  62dd80b

  Copy full SHA for 62dd80b

• fix missing import

  ikreymer

  committed
  cf6b7b0

  Copy full SHA for cf6b7b0

• switch back to mostly sync download with requests, but simplified to not require boto

  ikreymer

  committed
  c7babf9

  Copy full SHA for c7babf9

• add additional metadata for multi-wacz to be conformant with datapackage v1:

  Show description for 4e5c5ed
  ikreymer

  committed
  4e5c5ed

  Copy full SHA for 4e5c5ed

• add 'software' to metadata

  ikreymer

  committed
  124f4c1

  Copy full SHA for 124f4c1

• qa_run -> qaRun

  ikreymer

  committed
  fceafdc

  Copy full SHA for fceafdc