Since now I used:
Code: Select all
wget --random-wait -r -p -e robots=off -U --mirror -p --html-extension --convert-links mozilla -c http://www.cia.org
I know wget uses wildcards only for ftp, not for http, but maybe if I run the same task in 10 consoles, each console will know that another console downloaded something successfully?
Another thing is, in my language there are some foreign signs in http like "ś" or "ó", but the downloaded file has been replaced by some %82 etc.
Can I replace it somehow before I download it in the command line, cause there will be about 90.000 files ...
Thanks for help!!