Description:
mucri 0.0.9
Mucri
Quickly fetch a lot of pages/apis using python asyncio.
Installation
Only python 3.6+
pip isntall mucri
Usage
fetch_pages takes two args:
links : list of links to be fetched (example below)
concurrency: how many requests to be send at a time (default 20)
from mucri import fetch_pages
# links can be a single string or a dict with specific instructions
links = [
"http://meain.github.io", # Can be just a url
{ "url": "http://somelink" }, # or a dict with url key
{ # for more complex stuff
"url": "http://fakelink",
"action": "get", # get | post
"data": {},
"headers": {},
"resp_type": "text", # text | json | image
}
]
results = fetch_pages(links) # fetches all of them asynchronously
License
For personal and professional use. You cannot resell or redistribute these repositories in their original state.
Files:
Customer Reviews
There are no reviews.
