proxy-parse 1.0.1
Last updated:
0 purchases
Description:
proxyparse 1.0.1
Proxy Parser
About
Synchronous library, for convenient and fast parsing of proxies from different sources.
Uses Scrapy as a parser.
At the moment the library does not support automatic proxy check, this option will be added in the asynchronous version of the library.
Installation
Installing the latest version of the library:
pip install proxy-parse
Example
from proxy_parse import ProxyParser
proxy_parser = ProxyParser()
proxies_list = proxy_parser.parse()
If you need, you can add some parameters to the ProxyParser class:
path_to_file - optional str parameter, the proxies will be saved to a file at the path
proxy_limit - optional int parameter, the ProxyParser.parse function will return as many proxies as you need
scrapy_spiders - optional scrapy.Spider list parameter, you can add your own spiders, which will work together with the others
scrapy_settings - optional dict parameter, you can replace the library rules with your own
Contribution
Any changes from you will be good for the life of the library
License:
For personal and professional use. You cannot resell or redistribute these repositories in their original state.
Customer Reviews
There are no reviews.
