I'm looking for a substitute for WGET (which is extremely slow [taking over 30 secs to download something ~19kb])...it doesn't need ALL the FEATURES, it just needs to work from command-line, and accept wildcards.

I REALLY don't know why WGET is so slow, even though the download is complete and the file exists, it is still working away at SOMETHING (I tried setting the quota to 1, so it should only look for one file).curl or aria2c MAYBE?

But can you describe the problem you are having with wget a bit more fully?


I am trying to download a webpage and look at the source and display certain values in the source. WGET just seems to go unresponsive...or at least doing something not required to bring the file to my computer.

The actual WGET command looks like this:
     wget http://services.runescape.com/m=itemdb_rs/*/viewitem.ws?obj=%%a (%%a being a number already known to exist)


When I got the output, this is what it is:

--17:53:25--  http://services.runescape.com:80/m=itemdb_rs/%2A/viewitem.ws?obj=532
           => `[email protected]=532'
Connecting to services.runescape.com:80... CONNECTED!
HTTP request sent, awaiting response... 200 OK
Length: 18,622 [text/html]

    0K -> .......... ........ << This is where it freezes for about 20+ seconds

This is the debug output:
DEBUG output created by Wget 1.5.3.1 on Windows.

parseurl ("http://services.runescape.com/m=itemdb_rs/*/viewitem.ws?obj=1436") -> host services.runescape.com -> opath m=itemdb_rs/*/viewitem.ws?obj=1436 -> dir m=itemdb_rs/* -> file viewitem.ws?obj=1436 -> ndir m=itemdb_rs/*
--17:57:15--  http://services.runescape.com:80/m=itemdb_rs/%2A/viewitem.ws?obj=1436
           => `[email protected]=1436'
Connecting to services.runescape.com:80... Created fd 1908.
connected!
---request begin---
GET /m=itemdb_rs/%2A/viewitem.ws?obj=1436 HTTP/1.0

User-Agent: Wget/1.5.3.1

Host: services.runescape.com:80

Accept: */*



---request end---
HTTP request sent, awaiting response... HTTP/1.1 200 OK
Date: Sun, 18-Apr-2010 21:57:17 GMT
Server: JAGeX/3.1
Content-type: text/html; charset=ISO-8859-1
Cache-control: no-cache
Pragma: no-cache
Expires: Thu, 01-Jan-1970 00:00:00 GMT
Set-Cookie: settings=wwGlrZHF5gKN6D3mDdihco3oPeYN2KFybL9hUUFqOvk; version=1; path=/; domain=.runescape.com; Expires=Wed, 17-Apr-2013 21:57:17 GMT; Max-Age=94608000
Connection: Close
Content-length: 18649


Length: 18,649 [text/html]

    0K -> .......... ........

So, I really don't know why this isn't working. I'll try curl and arai2c soon.I tried curl and it works PERFECTLY! Thanks ST!