GNU Wget

GNU Wget is a utility for downloading files from the Internet via HTTP and FTP. The program is managed through the console. Wget supports proxy work, it is possible to compile a program to work through SOCKS. Most of the application options can be configured through both the initialization files and the command line. Wget works well even if the Internet connection is slow and unstable, downloading documents until they are completely saved on the hard drive. The program can also check for new versions of already downloaded files and update them locally. There is support for recursion and search templates, which allows you to download sites and directories as a whole, and Wget understands the syntax of the robots.txt file and can behave like a search bot.