Description:

asyncdownload 1.4.0

Async download

Uses coroutines to download urls
Note: Greedy and built for speed. [10K cdn hosted urls; 0.5GB Total data; <5 minutes; M1 laptop]
Usage
Usage: async_download [COMMAND] <OPTIONS>
Commands:
headers - hit urls with the head request
download - download urls

`headers` Options:
--header TEXT Headers to extract (default: Content-Length, Server)
--batch-size INTEGER number of concurrent requests (default: 1000)
--help Show this message and exit.

`download` Options:
--batch-size INTEGER number of concurrent requests (default: 1000)
--execute required to do something
--help Show this message and exit.


Free software: MIT license
Documentation: https://async-download.readthedocs.io.

Install & Run
pipx install async-download
async_download --help

Development
python -mvenv .venv --prompt .
. ./.venv/bin/activate
pip install --editable .[testing]
make test

Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

Cookiecutter
audreyr/cookiecutter-pypackage

The main loop was taken from

A Twilio tuitorial

History
1.2.0 (2022-08-29)

better progress bars.

1.1.0 (2022-08-29)

add a validate option.

1.0.0 (2022-08-29)

First release on PyPI.

License

For personal and professional use. You cannot resell or redistribute these repositories in their original state.

Share

• Share on Facebook
• Share on Twitter