The Perl Toolchain Summit needs more sponsors. If your company depends on Perl, please support this very important event.

NAME

yada - Yet Another Download Accelerator CLI wrapper

VERSION

version 0.049

SYNOPSIS

    yada [options] URLs_file
    yada [options] < URLs_file

WARNING: GONE MOO!

This module isn't using Any::Moose anymore due to the announced deprecation status of that module. The switch to the Moo is known to break modules that do extend 'AnyEvent::Net::Curl::Queued::Easy' / extend 'YADA::Worker'! To keep the compatibility, make sure that you are using MooseX::NonMoose:

    package YourSubclassingModule;
    use Moose;
    use MooseX::NonMoose;
    extends 'AnyEvent::Net::Curl::Queued::Easy';
    ...

Or MouseX::NonMoose:

    package YourSubclassingModule;
    use Mouse;
    use MouseX::NonMoose;
    extends 'AnyEvent::Net::Curl::Queued::Easy';
    ...

Or the Any::Moose equivalent:

    package YourSubclassingModule;
    use Any::Moose;
    use Any::Moose qw(X::NonMoose);
    extends 'AnyEvent::Net::Curl::Queued::Easy';
    ...

However, the recommended approach is to switch your subclassing module to Moo altogether (you can use MooX::late to smoothen the transition):

    package YourSubclassingModule;
    use Moo;
    use MooX::late;
    extends 'AnyEvent::Net::Curl::Queued::Easy';
    ...

DESCRIPTION

Employs AnyEvent::Net::Curl::Queued to download a set of URLs in batch mode (parallelizing connections).

Downloading the same file in the same directory will result in the original copy of file being preserved and the second copy being named file.1. If that file is downloaded yet again, the third copy will be named file.2, and so on. (behavior/description copied from wget)

OPTIONS

--help

This.

--[no]dups

Allow repeated requests to the same URLs (default: true).

--encoding

Sets the contents of the Accept-Encoding: header sent in a HTTP request, and enables decoding of a response when a Content-Encoding: header is received. Three encodings are supported: identity, which does nothing, deflate which requests the server to compress its response using the zlib algorithm, and gzip which requests the gzip algorithm. If a zero-length string is set, then an Accept-Encoding: header containing all supported encodings is sent (default).

--max

Download that many files in parallel (default: 4).

--maxredirs

Redirection limit (default: 5). If that many redirections have been followed, the next redirect will cause an error.

--proxy

Set HTTP proxy to use. The proxy string may be specified with a protocol:// prefix to specify alternative proxy protocols. Use socks4://, socks4a://, socks5:// or socks5h:// (the last one to enable socks5 and asking the proxy to do the resolving) to request the specific SOCKS version to be used. No protocol specified, http:// and all others will be treated as HTTP proxies.

--[no]quiet

Turn off progress output.

--referer

Used to set the Referer: header in the http request sent to the remote server.

--shuffle

Shuffle the list of URLs before putting them in the queue.

--skip_existing

Do not download existing files. Only works if the filename inferred from the URL matches the local filename.

--tcp_nodelay

Setting this option will disable TCP's Nagle algorithm. The purpose of this algorithm is to try to minimize the number of small packets on the network (where "small packets" means TCP segments less than the Maximum Segment Size (MSS) for the network).

--timeout

The maximum time in seconds that you allow the transfer operation to take (default: 600 seconds).

--useragent

Used to set the User-Agent: header in the http request sent to the remote server.

--verbose

Set the parameter to 1 to get the utility to display a lot of verbose information about its operations. Very useful for libcurl and/or protocol debugging and understanding. The verbose information will be sent to STDERR.

SEE ALSO

AUTHOR

Stanislaw Pusep <stas@sysd.org>

COPYRIGHT AND LICENSE

This software is copyright (c) 2021 by Stanislaw Pusep.

This is free software; you can redistribute it and/or modify it under the same terms as the Perl 5 programming language system itself.