yada - Yet Another Download Accelerator CLI wrapper
yada [options] URLs_file yada [options] < URLs_file
This module isn't using Any::Moose anymore due to the announced deprecation status of that module. The switch to the Moo is known to break modules that do
extend 'AnyEvent::Net::Curl::Queued::Easy' /
extend 'YADA::Worker'! To keep the compatibility, make sure that you are using MooseX::NonMoose:
package YourSubclassingModule; use Moose; use MooseX::NonMoose; extends 'AnyEvent::Net::Curl::Queued::Easy'; ...
package YourSubclassingModule; use Mouse; use MouseX::NonMoose; extends 'AnyEvent::Net::Curl::Queued::Easy'; ...
Or the Any::Moose equivalent:
package YourSubclassingModule; use Any::Moose; use Any::Moose qw(X::NonMoose); extends 'AnyEvent::Net::Curl::Queued::Easy'; ...
package YourSubclassingModule; use Moo; use MooX::late; extends 'AnyEvent::Net::Curl::Queued::Easy'; ...
Employs AnyEvent::Net::Curl::Queued to download a set of URLs in batch mode (parallelizing connections).
Downloading the same file in the same directory will result in the original copy of file being preserved and the second copy being named file.1. If that file is downloaded yet again, the third copy will be named file.2, and so on. (behavior/description copied from wget)
Allow repeated requests to the same URLs (default: true).
Sets the contents of the
Accept-Encoding: header sent in a HTTP request, and enables decoding of a response when a
Content-Encoding: header is received. Three encodings are supported: identity, which does nothing, deflate which requests the server to compress its response using the zlib algorithm, and gzip which requests the gzip algorithm. If a zero-length string is set, then an
Accept-Encoding: header containing all supported encodings is sent (default).
A parameter set to 1 (default) tells the utility to follow any
Location: header that the server sends as part of a HTTP header.
This means that the utility will re-send the same request on the new location and follow new
Location: headers all the way until no more such headers are returned.
--maxredirs can be used to limit the number of redirects utility will follow.
Download that many files in parallel (default: 4).
Redirection limit (default: 5). If that many redirections have been followed, the next redirect will cause an error. This option only makes sense if the
--followlocation is used at the same time.
Set HTTP proxy to use. The proxy string may be specified with a
protocol:// prefix to specify alternative proxy protocols. Use
socks5h:// (the last one to enable socks5 and asking the proxy to do the resolving) to request the specific SOCKS version to be used. No protocol specified,
http:// and all others will be treated as HTTP proxies.
Turn off progress output.
Used to set the
Referer: header in the http request sent to the remote server.
Setting this option will disable TCP's Nagle algorithm. The purpose of this algorithm is to try to minimize the number of small packets on the network (where "small packets" means TCP segments less than the Maximum Segment Size (MSS) for the network).
The maximum time in seconds that you allow the transfer operation to take (default: 600 seconds).
Used to set the
User-Agent: header in the http request sent to the remote server.
Set the parameter to 1 to get the utility to display a lot of verbose information about its operations. Very useful for libcurl and/or protocol debugging and understanding. The verbose information will be sent to
Stanislaw Pusep <firstname.lastname@example.org>
This software is copyright (c) 2013 by Stanislaw Pusep.
This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.