async-download 1.4.0
Last updated:
0 purchases
Description:
asyncdownload 1.4.0
Async download
Uses coroutines to download urls
Note: Greedy and built for speed. [10K cdn hosted urls; 0.5GB Total data; <5 minutes; M1 laptop]
Usage
Usage: async_download [COMMAND] <OPTIONS>
Commands:
headers - hit urls with the head request
download - download urls
`headers` Options:
--header TEXT Headers to extract (default: Content-Length, Server)
--batch-size INTEGER number of concurrent requests (default: 1000)
--help Show this message and exit.
`download` Options:
--batch-size INTEGER number of concurrent requests (default: 1000)
--execute required to do something
--help Show this message and exit.
Free software: MIT license
Documentation: https://async-download.readthedocs.io.
Install & Run
pipx install async-download
async_download --help
Development
python -mvenv .venv --prompt .
. ./.venv/bin/activate
pip install --editable .[testing]
make test
Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
Cookiecutter
audreyr/cookiecutter-pypackage
The main loop was taken from
A Twilio tuitorial
History
1.2.0 (2022-08-29)
better progress bars.
1.1.0 (2022-08-29)
add a validate option.
1.0.0 (2022-08-29)
First release on PyPI.
License:
For personal and professional use. You cannot resell or redistribute these repositories in their original state.
Customer Reviews
There are no reviews.
