Feature request: check with Internet Archive for media that can't be downloaded

[cooljeanius]

Some media just isn't going to be on Twitter anymore, due to getting deleted or whatever, so trying to fetch it again with a longer sleep time isn't going to help at all. Instead, I think a better solution might be to check with the Internet Archive to see if they already have the missing media? All that ought to be necessary would be to prepend http://web.archive.org/ to the URL, and then if it's got a copy, it should find it...

[cooljeanius]

see also tweetback/tweetback#35 and tweetback/tweetback#69

[halkeye]

archive.org's api is super simple

curl 'https://archive.org/wayback/available?url=https://pbs.twimg.com/media/AfmQuh2CEAELssj.jpg'
{"url": "https://pbs.twimg.com/media/AfmQuh2CEAELssj.jpg", "archived_snapshots": {"closest": {"status": "200", "available": true, "url": "http://web.archive.org/web/20230802080432/https://pbs.twimg.com/media/AfmQuh2CEAELssj.jpg", "timestamp": "20230802080432"}}}

I'm not sure how it affects tweetback as thats javascript and this is python

[cooljeanius]

archive.org's api is super simple

curl 'https://archive.org/wayback/available?url=https://pbs.twimg.com/media/AfmQuh2CEAELssj.jpg'
{"url": "https://pbs.twimg.com/media/AfmQuh2CEAELssj.jpg", "archived_snapshots": {"closest": {"status": "200", "available": true, "url": "http://web.archive.org/web/20230802080432/https://pbs.twimg.com/media/AfmQuh2CEAELssj.jpg", "timestamp": "20230802080432"}}}

I'm not sure how it affects tweetback as thats javascript and this is python

I mean, curl ought to be callable from both, right?