Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

some URLs can't be archived #3

Open
yakticus opened this issue Feb 18, 2017 · 0 comments
Open

some URLs can't be archived #3

yakticus opened this issue Feb 18, 2017 · 0 comments
Labels

Comments

@yakticus
Copy link
Contributor

It seems like certain URLs with query params can't be archived. Here's a recent list of examples. It might be worth cleaning up some of the bookmarks to remove unnecessary query params.

WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/17/opinion/a-party-to-the-russian-connection.html?smid=tw-share
WARNING:__main__:unable to archive url http://www.thestranger.com/slog/2017/01/20/24814797/why-neoliberalism-died-today-and-why-seattle-might-be-the-future-of-the-left
WARNING:__main__:unable to archive url http://www.politico.eu/article/sergei-lavrov-and-rex-tillerson-to-meet-thursday-russia-united-states/?wpisrc=nl_daily202&wpmm=1
WARNING:__main__:unable to archive url http://www.azcentral.com/story/news/arizona/politics/2015/07/12/donald-trump-talks-immigration-phoenix-visit/30041667/
WARNING:__main__:unable to archive url https://risestronger.org/resist
WARNING:__main__:unable to archive url https://thinkprogress.org/the-president-just-elevated-a-dangerous-anti-vaxxer-talking-point-d9eb18358e2e#.yzqn0xp3o
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/14/us/politics/Kellyanne-Conway-ivanka-trump-ethics.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=b-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/14/us/politics/flynn-russia-trump-resignation.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/13/us/politics/mar-a-lago-north-korea-trump.html?mabReward=A1&recp=2&version=readinglist&action=click&pgtype=Homepage&clickSource=story-heading&module=c-column-middle-span-region&region=c-column-middle-span-region&WT.nav=c-column-middle-span-region&_r=0
WARNING:__main__:unable to archive url https://www.apnews.com/418d4c32d280412aba4f64711950b4e3
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/13/business/the-gateway-pundit-trump.html?partner=rss&emc=rss&smid=tw-nytpolitics&smtyp=cur
WARNING:__main__:unable to archive url http://nymag.com/thecut/2017/02/all-the-stores-that-have-dropped-trump-lines.html?mid=twitter_nymag
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/09/us/politics/consumer-financial-protection-bureau-republicans.html?smid=tw-nytpolitics&smtyp=cur
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/12/us/politics/national-security-council-turmoil.html?_r=0&wpisrc=nl_daily202&wpmm=1
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/10/world/europe/bannon-vatican-julius-evola-fascism.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url https://apnews.com/1a21e67ad4a94bd59235f11460b42298/Trump-attacks-on-judiciary-raise-safety-concerns-for-judges
WARNING:__main__:unable to archive url https://www.nytimes.com/interactive/2017/02/11/us/politics/sean-spicer-white-house-press-briefing.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=b-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://web.archive.org/web/20161218160738/https://fop.net/CmsDocument/Doc/TrumpFirst100Days.pdf
WARNING:__main__:unable to archive url http://www.franken.senate.gov/files/letter/170117AlexanderLetter.pdf
WARNING:__main__:unable to archive url http://www.fiercebiotech.com/node/471731
WARNING:__main__:unable to archive url http://www.smithsonianmag.com/science-nature/vast-geological-challenges-building-border-wall-180962072/
WARNING:__main__:unable to archive url http://www.cleveland.com/court-justice/index.ssf/2017/02/cleveland_federal_judge_says_t.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/08/business/ivanka-trump-nordstrom-tj-maxx.html?smid=fb-nytimes&smtyp=cur&_r=5
WARNING:__main__:unable to archive url http://www.oregonlive.com/politics/index.ssf/2017/02/jeff_merkley_reads_coretta_scott_king_letter_about_jeff_sessions.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/04/us/politics/republicans-oil-gas-regulations.html?smprod=nytcore-iphone&smid=nytcore-iphone-share&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/upshot/one-third-dont-know-obamacare-and-affordable-care-act-are-the-same.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/world/middleeast/yemen-special-operations-missions.html?smid=tw-nytimes&smtyp=cur&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/us/politics/betsy-devos-education-secretary-confirmed.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url http://www.huffingtonpost.com/entry/republicans-are-about-to-erase-one-of-obamas-major-workplace-protections_us_5894caf8e4b09bd304bb359c?section=politics
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/05/health/with-fda-vacancy-trump-sees-chance-to-speed-drugs-to-the-market.html?smid=tw-nythealth&smtyp=cur
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/07/us/politics/melania-trump-libel-suit-daily-mail.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/interactive/2017/02/06/us/politics/why-trump-chose-the-seven-countries.html?_r=0
WARNING:__main__:unable to archive url http://assets.law360news.com/0473000/473998/carls.PDF
WARNING:__main__:unable to archive url http://www.washingtonexaminer.com/trump-tells-top-lawmakers-3-5-million-illegals-voted-in-election/article/2612762
WARNING:__main__:unable to archive url https://theshriverbrief.org/five-reasons-why-workers-deserve-a-labor-secretary-better-than-andrew-puzder-be1c903ff39f#.nthy3xcgs
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/05/us/politics/trump-white-house-aides-strategy.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://apnews.com/dff5863268a846bb9c8efea1523f249b/Trump's-nominee-for-Army-secretary-withdraws-his-name
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/03/us/visa-ban-legal-challenge.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=first-column-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.washingtonpost.com/news/business/wp/2017/02/03/trump-to-sign-executive-order-calling-for-rollback-of-wall-street-reform/?hpid=hp_hp-top-table-main_mm-doddfrank-435am%3Ahomepage%2Fstory&utm_term=.c1ca209729f4
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/02/world/europe/trump-european-union.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/02/us/politics/trump-johnson-amendment-political-activity-churches.html?ribbon-ad-idx=3&rref=homepage&module=Ribbon&version=origin&region=Header&action=click&contentCollection=Home%20Page&pgtype=article
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/02/01/us/politics/neil-gorsuch-supreme-court-trump.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/29/world/europe/trump-executive-order-europe-merkel.html?smid=tw-share&_r=0
WARNING:__main__:unable to archive url http://web.archive.org/web/20060514175300/http://www.computerworld.com/securitytopics/security/privacy/story/0,10801,110983,00.html
WARNING:__main__:unable to archive url http://www.enquirer.com/editions/2004/10/22/loc_blackwell22.html
WARNING:__main__:unable to archive url https://web.archive.org/web/20060821104145/http://www.wcpo.com/news/2006/local/03/29/blackwell.html
WARNING:__main__:unable to archive url https://web.archive.org/web/20070927192653/http://www.cantonrep.com/index.php?ID=285016&Category=13
WARNING:__main__:unable to archive url https://web.archive.org/web/20090326043320/http://auohio.org/assets/April%2017,%202006%20Evidence_FCC%20email.pdf
WARNING:__main__:unable to archive url http://web.archive.org/web/20150711234359/http://articles.philly.com/1996-03-08/news/25635573_1_shah-jahan-trump-palace-favorite-wife
WARNING:__main__:unable to archive url https://apnews.com/80497cfb5f054c9b8c9e0f8f5ca30a62?utm_campaign=SocialFlow&utm_source=Twitter&utm_medium=AP
WARNING:__main__:unable to archive url http://www.oregonlive.com/politics/index.ssf/2016/07/mike_pence_claims_donald_trump_will_overturn_roe_v_wade.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/29/world/middleeast/donald-trump-muslims-reaction.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url http://www.nytimes.com/aponline/2017/01/29/us/politics/ap-us-uber-trump-immigration.html?smid=fb-share
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/28/us/politics/annotating-trump-immigration-refugee-order.html?smid=fb-nytimes&smtyp=cur&_r=0
WARNING:__main__:unable to archive url https://www.washingtonpost.com/powerpost/paul-ryan-trumps-refugee-ban-does-not-target-muslims/2017/01/28/e0cf1fe4-e56e-11e6-a547-5fb9411d332c_story.html?utm_term=.87ccc04c88ac
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/29/world/europe/trump-executive-order-europe-merkel.html?smid=fb-nytimes&smtyp=cur
WARNING:__main__:unable to archive url http://www.nationallawjournal.com/home/id=1202777272340/12-Jones-Day-Lawyers-Take-Key-Posts-in-Trump-Administration?mcode=1202615432600&curindex=1&slreturn=20170028145244
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/28/us/refugees-detained-at-us-airports-prompting-legal-challenges-to-trumps-immigration-order.html?smprod=nytcore-iphone&smid=nytcore-iphone-share
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/26/us/politics/mexico-wall-tax-trump.html?action=Click&contentCollection=BreakingNews&contentID=64842749&pgtype=article
WARNING:__main__:unable to archive url https://www.washingtonpost.com/politics/whitehouse/several-senior-diplomats-resign-as-trump-admin-takes-shape/2017/01/25/8ac4ae28-e368-11e6-a419-eefe8eff0835_story.html?utm_term=.739243d28553
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/25/us/politics/trump-bernhard-langer-voting-fraud.html?_r=1&referer=https://t.co/MU5TAHryYL
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/09/16/us/politics/donald-trump-economy-speech.html?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/23/opinion/donald-trump-and-a-sea-of-empty-desks.html?_r=0
WARNING:__main__:unable to archive url http://www.vulture.com/2017/01/sean-spicer-inauguration-ratings-claims-fact-checked.html?mid=full-rss-vulture
WARNING:__main__:unable to archive url http://jezebel.com/republicans-introduce-bill-proposing-withdrawal-from-un-1791494159?utm_source=recirculation&utm_medium=recirculation&utm_campaign=mondayAM
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/19/us/politics/trump-russia-associates-investigation.html?action=click&contentCollection=Politics&module=RelatedCoverage&region=Marginalia&pgtype=article
WARNING:__main__:unable to archive url http://www.weeklystandard.com/trumpism-corrupts-spicer-edition/article/2006432
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/11/us/politics/trumps-press-conference-highlights-russia.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/20/us/politics/trump-executive-order-obamacare.html?action=Click&contentCollection=BreakingNews&contentID=64820933&pgtype=Multimedia
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/19/us/politics/trump-international-hotel-ethics.html?action=click&pgtype=Homepage&clickSource=story-heading&module=span-abc-region&region=span-abc-region&WT.nav=span-abc-region
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/20/us/politics/trump-white-house-website.html?action=click&pgtype=Homepage&clickSource=story-heading&module=span-abc-region&region=span-abc-region&WT.nav=span-abc-region&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/19/us/politics/trump-russia-associates-investigation.html?smid=tw-share&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/11/us/abortion-foes-donald-trump-restrictions-politics.html?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/06/us/politics/trump-wall-mexico.html?_r=0
WARNING:__main__:unable to archive url http://www.medialaw.org/index.php?option=com_k2&view=item&id=3470
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/17/us/politics/reince-priebus-chief-of-staff.html?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/17/us/politics/donald-trump-transition-tom-price.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=b-lede-package-region&region=top-news&WT.nav=top-news&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/15/world/asia/trump-taiwan-china.html?_r=0
WARNING:__main__:unable to archive url http://www.thetimes.co.uk/article/full-transcript-of-interview-with-donald-trump-5d39sr09d
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/16/us/politics/donald-trump-russia-business.html?emc=edit_ta_20170116&nlid=43636183&ref=cta
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/11/28/us/politics/tom-price-secretary-health-and-human-services.html?_r=0t
WARNING:__main__:unable to archive url http://www.nytimes.com/aponline/2017/01/09/us/politics/ap-us-trump-epa-pruitt.html
WARNING:__main__:unable to archive url http://www.nytimes.com/reuters/2017/01/06/us/politics/06reuters-usa-trump-epa.html
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/07/us/politics/jared-kushner-trump-business.html?ref=todayspaper&_r=0
WARNING:__main__:unable to archive url http://www.huffingtonpost.com/entry/trump-advisor-potential-obamacare-conflict-interest_us_582efabde4b030997bbeda96?1s4p12jhdx8j2lnmi
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/09/us/jared-kushner-assets-conflict-of-interest.html?smid=tw-share&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/10/us/politics/trump-confirmation-hearings.html?emc=edit_na_20170110&nlid=29624742&ref=headline&_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/02/us/illegal-immigrants-raids-deportation.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=second-column-region&region=top-news&WT.nav=top-news
WARNING:__main__:unable to archive url https://www.opensecrets.org/news/2017/01/fec-after-trump-and-his-jfcs-for-violations/
WARNING:__main__:unable to archive url https://thecaucus.blogs.nytimes.com/2011/04/28/rand-paul-questions-trumps-republican-credentials/?_r=0
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/12/us/politics/mcconnell-supports-inquiry-of-russian-hacking-during-election.html?rref=collection%2Fnewseventcollection%2Frussian-election-hacking&action=click&contentCollection=politics&region=stream&module=stream_unit&version=latest&contentPlacement=10&pgtype=collection
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/06/us/politics/donald-trump-wall-hack-russia.html?smid=tw-nytimes&smtyp=cur
WARNING:__main__:unable to archive url http://www.nytimes.com/interactive/2016/07/27/us/politics/trail-of-dnc-emails-russia-hacking.html?rref=collection%2Fnewseventcollection%2Frussian-election-hacking&action=click&contentCollection=politics&region=rank&module=package&version=highlights&contentPlacement=3&pgtype=collection
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/10/27/us/politics/donald-trump-black-voters.html?_r=1
WARNING:__main__:unable to archive url https://www.nytimes.com/2016/12/22/us/politics/state-department-gender-equality-trump-transition.html?_r=1
WARNING:__main__:unable to archive url http://www.inc.com/bartie-scott/silicon-valley-calls-for-thiels-dismisall-from-facebook.html
WARNING:__main__:unable to archive url https://webcache.googleusercontent.com/search?q=cache:ahgj-_Wg6TsJ:https://www.ft.com/content/2702da46-ae92-11e6-a37c-f4a01f1b0fa1+&cd=1&hl=en&ct=clnk&gl=us
WARNING:__main__:unable to archive url https://www.nytimes.com/2017/01/11/us/politics/trumps-press-conference-highlights-russia.html?hp&action=click&pgtype=Homepage&clickSource=story-heading&module=a-lede-package-region&region=top-news&WT.nav=top-news&_r=0
@yakticus yakticus added the bug label Feb 21, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants
@yakticus and others