Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"archive file" support #28

Open
ghost opened this issue Jun 8, 2023 · 0 comments
Open

"archive file" support #28

ghost opened this issue Jun 8, 2023 · 0 comments

Comments

@ghost
Copy link

ghost commented Jun 8, 2023

As an example yt-dlp has an option to record all successful downloads in an 'archive 'file'. When the file is used, matching videos won't be redownloaded.

--download-archive FILE
Download only videos not listed in the archive file. Record the IDs of all downloaded videos in it

Is there any similar functionality in the script? I have a list of URLs (with around 10,000 lines, one URL per line) and there's no immediate benefit in saving them again to Wayback Machine. I do keep actively adding new URLs` — frequently reprocessing this much pages would be detrimental.

I know that the script operations are logged.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

0 participants