Help please! port 443 #291

Irenik515 · 2024-05-13T06:57:53Z

Help me please. I looked through it but I can’t understand anything. I downloaded it two months ago, everything worked. Now after the request it shows the following error: What should I do to download the site? I've been trying for a week now.

Getting snapshot pages.C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in initialize': Failed to open TCP connection to web.archive.org:443 (No connection could be made because the target machine actively refused it. - connect(2) for "web.archive.org" port 443) (Errno::ECONNREFUSED) from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in open'
from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in block in connect' from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:186:in block in timeout'
from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:193:in timeout' from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1601:in connect'
from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1580:in do_start' from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1569:in start'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:334:in open_http' from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:770:in buffer_open'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:220:in block in open_loop' from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in catch'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in open_loop' from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:158:in open_uri'
from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:750:in open' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from <internal:numeric>:237:in times'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp'
from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from C:/Users/User/.local/share/gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>'
from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in load' from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in

'

The text was updated successfully, but these errors were encountered:

rezinkin · 2024-05-14T22:27:27Z

Same error

`Getting snapshot pages................../usr/lib/ruby/3.1.0/socket.rb:1214:in __connect_nonblock': Failed to open TCP connection to web.archive.org:443 (Connection refused - connect(2) for 207.241.237.3:443) (Errno::ECONNREFUSED) from /usr/lib/ruby/3.1.0/socket.rb:1214:in connect_nonblock'
from /usr/lib/ruby/3.1.0/socket.rb:56:in connect_internal' from /usr/lib/ruby/3.1.0/socket.rb:137:in connect'
from /usr/lib/ruby/3.1.0/socket.rb:642:in block in tcp' from /usr/lib/ruby/3.1.0/socket.rb:227:in each'
from /usr/lib/ruby/3.1.0/socket.rb:227:in foreach' from /usr/lib/ruby/3.1.0/socket.rb:632:in tcp'
from /usr/lib/ruby/3.1.0/net/http.rb:998:in connect' from /usr/lib/ruby/3.1.0/net/http.rb:976:in do_start'
from /usr/lib/ruby/3.1.0/net/http.rb:965:in start' from /usr/lib/ruby/3.1.0/open-uri.rb:323:in open_http'
from /usr/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open' from /usr/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop'
from /usr/lib/ruby/3.1.0/open-uri.rb:210:in catch' from /usr/lib/ruby/3.1.0/open-uri.rb:210:in open_loop'
from /usr/lib/ruby/3.1.0/open-uri.rb:151:in open_uri' from /usr/lib/ruby/3.1.0/open-uri.rb:721:in open'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>' from /usr/local/bin/wayback_machine_downloader:25:in load'
from /usr/local/bin/wayback_machine_downloader:25:in

' /usr/lib/ruby/3.1.0/socket.rb:1214:in __connect_nonblock': Connection refused - connect(2) for 207.241.237.3:443 (Errno::ECONNREFUSED)
from /usr/lib/ruby/3.1.0/socket.rb:1214:in connect_nonblock' from /usr/lib/ruby/3.1.0/socket.rb:56:in connect_internal'
from /usr/lib/ruby/3.1.0/socket.rb:137:in connect' from /usr/lib/ruby/3.1.0/socket.rb:642:in block in tcp'
from /usr/lib/ruby/3.1.0/socket.rb:227:in each' from /usr/lib/ruby/3.1.0/socket.rb:227:in foreach'
from /usr/lib/ruby/3.1.0/socket.rb:632:in tcp' from /usr/lib/ruby/3.1.0/net/http.rb:998:in connect'
from /usr/lib/ruby/3.1.0/net/http.rb:976:in do_start' from /usr/lib/ruby/3.1.0/net/http.rb:965:in start'
from /usr/lib/ruby/3.1.0/open-uri.rb:323:in open_http' from /usr/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open'
from /usr/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop' from /usr/lib/ruby/3.1.0/open-uri.rb:210:in catch'
from /usr/lib/ruby/3.1.0/open-uri.rb:210:in open_loop' from /usr/lib/ruby/3.1.0/open-uri.rb:151:in open_uri'
from /usr/lib/ruby/3.1.0/open-uri.rb:721:in open' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp'
from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from /var/lib/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>'
from /usr/local/bin/wayback_machine_downloader:25:in load' from /usr/local/bin/wayback_machine_downloader:25:in

'`

invest63 · 2024-05-15T11:48:50Z

Same error.

adops-qvant · 2024-05-15T19:16:08Z

.C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:1001:in rescue in connect': Failed to open TCP connection to web.archive.org:443 (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. - user specified timeout) (Net::OpenTimeout) from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:997:in connect'
from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:976:in do_start' from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:965:in start'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:323:in open_http' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in catch'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in open_loop' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:151:in open_uri'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:721:in open' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in get_raw_list_from_api'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in block in get_all_snapshots_to_consider' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in times'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in get_all_snapshots_to_consider' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in get_file_list_curated'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in get_file_list_by_timestamp' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in file_list_by_timestamp'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in download_files' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>'
from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in load' from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in

'
C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:61:in

connect_internal': A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond. - user specified timeout (Errno::ETIMEDOUT) from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:137:in

connect'
from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:642:in block in tcp' from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:227:in each'
from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:227:in foreach' from C:/Ruby31-x64/lib/ruby/3.1.0/socket.rb:632:in tcp'
from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:998:in connect' from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:976:in do_start'
from C:/Ruby31-x64/lib/ruby/3.1.0/net/http.rb:965:in start' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:323:in open_http'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:741:in buffer_open' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:212:in block in open_loop'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in catch' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:210:in open_loop'
from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:151:in open_uri' from C:/Ruby31-x64/lib/ruby/3.1.0/open-uri.rb:721:in open'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in

get_raw_list_from_api' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:92:in

block in get_all_snapshots_to_consider'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in

times' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:91:in

get_all_snapshots_to_consider'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in

get_file_list_curated' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in

get_file_list_by_timestamp'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in

file_list_by_timestamp' from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in

download_files'
from C:/Ruby31-x64/lib/ruby/gems/3.1.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in <top (required)>' from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in load'
from C:/Ruby31-x64/bin/wayback_machine_downloader:32:in `'

ckought · 2024-05-16T01:27:12Z

I was having this problem. I fought with it for several days before getting to a combo of things that worked.

I added the sleep line that's mentioned in an earlier thread, but I had to make it 10 instead of 3. Also, I couldn't use the switch to download multiple pages at the same time. And, finally, I had to wait about 12 hours so that whatever blocks archive.org was doing was reset and allowed me to connect again.

Since doing those things, I've been pulling pages from a large site for more than 12 hours with no errors.

adops-qvant · 2024-05-16T10:51:10Z

Looks like I've solved the problem.
The solution from here worked for me:

gingerbeardman · 2024-05-16T15:12:17Z

See #280

NoEffinIdea · 2024-05-23T08:32:03Z

Thankyou thankyou thankyou to everyone who's worked on this.

I finally got the downloader working again, so I'll try to explain it for non-ruby people like me who were totally lost.

Download ShiftaDeband's zip file unzip it to where your existing gems are (that's the directory you'll use below).
I then entered (in Power Shell) >gem build --local C:\Ruby30-x64\lib\ruby\gems\3.0.0\gems\wayback-machine-downloader-feature-httpGet\wayback_machine_downloader.gemspec to create the gem file
I then entered >gem install --local C:\Ruby30-x64\lib\ruby\gems\3.0.0\gems\wayback-machine-downloader-feature-httpGet\wayback_machine_downloader-2.3.2.gem
and it installed version 2.3.2. This then ran fine. I'm so relieved. I don't use it too often, but I don't want to not use it ever again...

There are possibly other ways to do this but I have no idea. (see my username).

gingerbeardman · 2024-05-23T18:54:15Z

My method of repair is perhaps much easier as it only requires easy file download/copy/paste:

follow the Installation instructions in the README
install wayback_machine_downloader the recommended way
replace the local versions of the following two files with updated copies from #280
right click the links below and save as, then replace the existing files at the paths shown
1. wayback_machine_downloader.rb
  at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/
2. archive_api.rb
  at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/
don't update wayback_machine_downloader using gem or it will break again

Notes:

the version of ruby you have installed might be 3.3.0, or 3.3.1, etc.
these instructions are for macOS, you'll need to adapt for Linux/Windows

YGA1990 · 2024-07-03T18:00:24Z

My method, perhaps much easier as it only requires easy file download/copy/paste:

install wayback_machine_downloader the recommended way

replace the local versions of the following two files at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/
with these updated copies, from #280

wayback_machine_downloader.rb

archive_api.rb

don't update wayback_machine_downloader using gem

I've followed these instruction and now i receive the following error:

Getting snapshot pagesC:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:6:in `get_raw_list_from_api': wrong number of arguments (given 3, expected 2) (ArgumentError)

I'm new to ruby as well, dunno how to processed.

gingerbeardman · 2024-07-03T20:01:02Z

Simply download and copy the files again, there's no need to edit them at all.

For the error you have posted, it seems the downloaded files have been changed or reformatted in some way.

Right click the i. and ii. links above, they are direct links to the files that need saving.

JezausTevas · 2024-07-04T07:35:41Z

My method, perhaps much easier as it only requires easy file download/copy/paste:

install wayback_machine_downloader the recommended way

replace the local versions of the following two files at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/
with these updated copies, from #280

wayback_machine_downloader.rb

archive_api.rb

don't update wayback_machine_downloader using gem

I've followed these instruction and now i receive the following error:

Getting snapshot pagesC:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:6:in `get_raw_list_from_api': wrong number of arguments (given 3, expected 2) (ArgumentError)

I'm new to ruby as well, dunno how to processed.

can confirm having the same issue after downloading i. and ii. as of 2024-07-04

JezausTevas · 2024-07-04T07:48:25Z

The issue is that the ii. file has to be uploaded to gems\wayback_machine_downloader-2.3.1\lib\wayback_machine_downloader\ rather than gems\wayback_machine_downloader-2.3.1\lib\. After placing the file there it now works.

YGA1990 · 2024-07-04T11:21:38Z

The issue is that the ii. file has to be uploaded to gems\wayback_machine_downloader-2.3.1\lib\wayback_machine_downloader\ rather than gems\wayback_machine_downloader-2.3.1\lib\. After placing the file there it now works.

Answere was in front of my eyes all the time. The path where "archive_api.rb" mus be replaced is in the very error message.

Getting snapshot pages ----> C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/ <----- archive_api.rb:6:in `get_raw_list_from_api': wrong number of arguments (given 3, expected 2) (ArgumentError)

so i just went to "C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader" and replaced the "archive_api.rb" with the one gingerbeardman provided above.

Problem solved. Thanks for the help.

Bissnet · 2024-07-04T14:02:14Z

Hi everyone,
I'll start by saying that I'm new and that I don't speak Ruby's language but I was constantly using it to download information from now dead sites via wayback machine until a few months ago. I learned about this method through the following guide: https://pianoweb.eu/scaricare-copie-siti-scaduti-wayback-machine/.

For a few months now I haven't been able to make it work anymore and my limited knowledge doesn't help me.
Obviously I tried to implement your instructions above but without success.

Can I kindly ask you to detail the steps to be taken so that I can go back to working with ruby and wayback and machine? A thousand thanks

gingerbeardman · 2024-07-04T17:53:37Z

I've clarified my instructions in this comment: #291 (comment)

It involves downloading and replacing two files, very easy. If you get stuck you need to tell us where you are getting stuck or we cannot help. But at this point it is as easy as can be @Bissnet

Bissnet · 2024-07-05T07:52:57Z

@gingerbeardman
I installed Ruby+Devkit 3.3.3-1 (x64) from the site shown in the image. I then tried to replace your files but I can't find the last folder you indicate... I only have this situation C:\Ruby33-x64\lib\ruby\gems\3.3.0\gems....

gingerbeardman · 2024-07-05T11:26:03Z

If you haven't got the two files to replace then you haven't installed wayback-machine-downloader!

First you need to follow the Installation section of the readme https://github.com/hartator/wayback-machine-downloader/blob/master/README.md
Then once you have everything (ruby and wayback-machine-downloader) installed, add it's giving you the 443 error, do the replacement of the two files.

Bissnet · 2024-07-05T13:35:55Z

@gingerbeardman

Thank you. Now I have followed all the steps but it still doesn't work as shown in the image below...

gingerbeardman · 2024-07-05T14:44:43Z

@Bissnet did your system ask you to confirm that you were replacing/overwriting each of the two files?

it seems you have them two copies of each file side-by-side? you should replace the existing files

Bissnet · 2024-07-05T15:21:41Z

@gingerbeardman
I followed all the steps (overwriting the files) and now I have single files but it still doesn't work.

gingerbeardman · 2024-07-05T15:44:55Z

@Bissnet these still seem to be the errors for the old files?

new files should be as follows:

wayback_machine_downloader.rb = 323 lines (10,761 bytes )
archive_api.rb = 40 lines (1,028 bytes)

I just tried it as follows

% wayback_machine_downloader www.photonsolar.be
Downloading www.photonsolar.be to websites/www.photonsolar.be/ from Wayback Machine archives.

Getting snapshot pages..................................................................................................... found 88999 snaphots to consider.

508 files to download:
https://www.photonsolar.be/img/favicon.ico?1643288163 # websites/www.photonsolar.be/img/favicon.ico?1643288163 already exists. (1/508)
...
http://www.photonsolar.be:80/ondul.html -> websites/www.photonsolar.be/ondul.html (508/508)

Download completed in 740.43s, saved in websites/www.photonsolar.be/ (508 files)

sorry I can't really be of more help here

Bissnet · 2024-07-08T08:00:09Z

Ruby works....thank's @gingerbeardman! It's slow to start and sometimes it doesn't start at first try, but after trying again it seems to work for the moment!

Now, I would like to move the download folder to the desktop to avoid problems with files with long names. I read the description "-d, --directory PATH Directory to save the downloaded files into Default is ./websites/ plus the domain name" but it didn't work and in fact I lost the previous destination folder:

how should I write the string?
do I have to write it every time, or once set do I go back to writing the classic string to be able to download the material?

Crawk95 · 2024-07-09T08:26:43Z

My method of repair is perhaps much easier as it only requires easy file download/copy/paste:

follow the Installation instructions in the README

install wayback_machine_downloader the recommended way

replace the local versions of the following two files with updated copies from #280
right click the links below and save as, then replace the existing files at the paths shown

wayback_machine_downloader.rb
at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/

archive_api.rb
at ~/.gem/ruby/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/

don't update wayback_machine_downloader using gem or it will break again

Notes:

the version of ruby you have installed might be 3.3.0, or 3.3.1, etc.

these instructions are for macOS, you'll need to adapt for Linux/Windows

I receive the same issue after 10min of parsing. Can I increase time?

gingerbeardman · 2024-07-09T10:28:06Z

IA are throttling indiscriminately. Including sue of their own tool.

The only thing you can do is retry, already downloaded files should be skipped.

Or you can add delays into the script but this will mean the download process takes much much longer

Crawk95 · 2024-07-09T10:32:05Z

IA are throttling indiscriminately. Including sue of their own tool.

The only thing you can do is retry, already downloaded files should be skipped.

Or you can add delays into the script but this will mean the download process takes much much longer

Anything was downloaded. But can you provide, where in code I can increase delays?
thanks

gingerbeardman · 2024-07-09T10:43:15Z

See https://github.com/hartator/wayback-machine-downloader/pull/268/files

including extra config settings, a proper rate limit, and a logger. Fixes: hartator#307 hartator#291 hartator#281 hartator#269 and probably others too

milens0141 · 2024-12-21T15:03:52Z

Failed to open TCP connection to web.archive.org:443 (Blocking operation timed out!) (IO::TimeoutError)

from : china. Am I blocked by a firewall? How can I fix this?

C:\Users\admin>wayback_machine_downloader http://example.com
Downloading http://example.com to websites/example.com/ from Wayback Machine archives.

Getting snapshot pagesC:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in `initialize': Failed to open TCP connection to web.archive.org:443 (Blocking operation timed out!) (IO::TimeoutError)
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in `open'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in `block in connect'
        from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:186:in `block in timeout'
        from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:193:in `timeout'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1601:in `connect'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1580:in `do_start'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1569:in `start'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:334:in `open_http'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:770:in `buffer_open'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:220:in `block in open_loop'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in `catch'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in `open_loop'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:158:in `open_uri'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:750:in `open'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in `get_raw_list_from_api'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:88:in `get_all_snapshots_to_consider'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in `get_file_list_curated'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in `get_file_list_by_timestamp'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in `file_list_by_timestamp'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in `download_files'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in `<top (required)>'
        from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in `load'
        from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in `<main>'
C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in `initialize': Blocking operation timed out! (IO::TimeoutError)
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in `open'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1603:in `block in connect'
        from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:186:in `block in timeout'
        from C:/Ruby33-x64/lib/ruby/3.3.0/timeout.rb:193:in `timeout'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1601:in `connect'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1580:in `do_start'
        from C:/Ruby33-x64/lib/ruby/3.3.0/net/http.rb:1569:in `start'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:334:in `open_http'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:770:in `buffer_open'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:220:in `block in open_loop'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in `catch'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:218:in `open_loop'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:158:in `open_uri'
        from C:/Ruby33-x64/lib/ruby/3.3.0/open-uri.rb:750:in `open'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader/archive_api.rb:13:in `get_raw_list_from_api'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:88:in `get_all_snapshots_to_consider'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:105:in `get_file_list_curated'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:164:in `get_file_list_by_timestamp'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:309:in `file_list_by_timestamp'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/lib/wayback_machine_downloader.rb:192:in `download_files'
        from C:/Ruby33-x64/lib/ruby/gems/3.3.0/gems/wayback_machine_downloader-2.3.1/bin/wayback_machine_downloader:72:in `<top (required)>'
        from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in `load'
        from C:/Ruby33-x64/bin/wayback_machine_downloader:32:in `<main>'

gingerbeardman · 2024-12-21T17:43:36Z

See the solutions earlier in the thread!

milens0141 mentioned this issue Dec 23, 2024

Need Help: Getting this Error: `open_http': 400 BAD REQUEST #307

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Help please! port 443 #291

Help please! port 443 #291

Irenik515 commented May 13, 2024

rezinkin commented May 14, 2024

invest63 commented May 15, 2024

adops-qvant commented May 15, 2024 •

edited

Loading

ckought commented May 16, 2024

adops-qvant commented May 16, 2024

gingerbeardman commented May 16, 2024

NoEffinIdea commented May 23, 2024

gingerbeardman commented May 23, 2024 •

edited

Loading

YGA1990 commented Jul 3, 2024

gingerbeardman commented Jul 3, 2024

JezausTevas commented Jul 4, 2024

JezausTevas commented Jul 4, 2024 •

edited

Loading

YGA1990 commented Jul 4, 2024 •

edited

Loading

Bissnet commented Jul 4, 2024 •

edited

Loading

gingerbeardman commented Jul 4, 2024 •

edited

Loading

Bissnet commented Jul 5, 2024

gingerbeardman commented Jul 5, 2024 •

edited

Loading

Bissnet commented Jul 5, 2024

gingerbeardman commented Jul 5, 2024 •

edited

Loading

Bissnet commented Jul 5, 2024

gingerbeardman commented Jul 5, 2024 •

edited

Loading

Bissnet commented Jul 8, 2024

Crawk95 commented Jul 9, 2024 •

edited

Loading

gingerbeardman commented Jul 9, 2024

Crawk95 commented Jul 9, 2024

gingerbeardman commented Jul 9, 2024

milens0141 commented Dec 21, 2024

gingerbeardman commented Dec 21, 2024

Help please! port 443 #291

Help please! port 443 #291

Comments

Irenik515 commented May 13, 2024

rezinkin commented May 14, 2024

invest63 commented May 15, 2024

adops-qvant commented May 15, 2024 • edited Loading

ckought commented May 16, 2024

adops-qvant commented May 16, 2024

gingerbeardman commented May 16, 2024

NoEffinIdea commented May 23, 2024

gingerbeardman commented May 23, 2024 • edited Loading

YGA1990 commented Jul 3, 2024

gingerbeardman commented Jul 3, 2024

JezausTevas commented Jul 4, 2024

JezausTevas commented Jul 4, 2024 • edited Loading

YGA1990 commented Jul 4, 2024 • edited Loading

Bissnet commented Jul 4, 2024 • edited Loading

gingerbeardman commented Jul 4, 2024 • edited Loading

Bissnet commented Jul 5, 2024

gingerbeardman commented Jul 5, 2024 • edited Loading

Bissnet commented Jul 5, 2024

gingerbeardman commented Jul 5, 2024 • edited Loading

Bissnet commented Jul 5, 2024

gingerbeardman commented Jul 5, 2024 • edited Loading

Bissnet commented Jul 8, 2024

Crawk95 commented Jul 9, 2024 • edited Loading

gingerbeardman commented Jul 9, 2024

Crawk95 commented Jul 9, 2024

gingerbeardman commented Jul 9, 2024

milens0141 commented Dec 21, 2024

Failed to open TCP connection to web.archive.org:443 (Blocking operation timed out!) (IO::TimeoutError)

gingerbeardman commented Dec 21, 2024

adops-qvant commented May 15, 2024 •

edited

Loading

gingerbeardman commented May 23, 2024 •

edited

Loading

JezausTevas commented Jul 4, 2024 •

edited

Loading

YGA1990 commented Jul 4, 2024 •

edited

Loading

Bissnet commented Jul 4, 2024 •

edited

Loading

gingerbeardman commented Jul 4, 2024 •

edited

Loading

gingerbeardman commented Jul 5, 2024 •

edited

Loading

gingerbeardman commented Jul 5, 2024 •

edited

Loading

gingerbeardman commented Jul 5, 2024 •

edited

Loading

Crawk95 commented Jul 9, 2024 •

edited

Loading