Description:

periodicalrequestsrecorder 0.3.0

periodical_requests_recorder


Usage
periodical_recorder example.yaml
yaml data format example.
gmail_address: example@gmail.com
gmail_oauth: "~/yagmail_secret.json"
tasks:
-
name: "some_data"
url: "https://example.com/somedata.csv"
record_dir: "~/hist_data/"
output_file_format: "{name}/{name}_%Y-%m-%d.csv"
cron_expr: "0 * * * * * *"
encoding: "ms932"
-
name: "some_data_2"
url: "https://www.google.com/"
record_dir: "~/hist_data/"
output_file_format: "{name}/{name}_%Y-%m-%d.txt"
cron_expr: "@reboot"
target_elements:
-
element: "#gws-output-pages-elements-homepage_additional_languages__als"
index: 3
Request result will be stored in the record_dir with your output_file_format.
If you set up yagmail, error messages will be sent to your address.
cron_expr format is the same as Crython.


Installation
You can install this with pip.

Requirements



Compatibility


Licence


Authors



periodical_requests_recorder was written by fx-kirin.

License

For personal and professional use. You cannot resell or redistribute these repositories in their original state.

Share

• Share on Facebook
• Share on Twitter