Description:
googledriver 0.1.7
Google-Driver
The Google-Driver Python package simplifies downloading files and folders from Google Drive, with some constraints for model management through Hugging-Face and Git-Lfs. Issues may arise due to too many files, access permissions, or large file sizes. Be cautious with large files as they may contain viruses. The gdown package offers better exception handling and compatibility.
Installation
pip install googledriver
Features
1. File Download
Download to specific path
To save a file from a shared Google Drive URL to local storage, use the following code.
from googledriver import download
URL = 'https://drive.google.com/file/d/xxxxxxxxx/view?usp=share_link'
download(URL, './model/tf_gpt2_model')
Download to cached folder
To download a cached file (or directory) from a URL and return its path, you can use the following method.
from googledriver import download
URL = 'https://drive.google.com/file/d/xxxxxxxxx/view?usp=share_link'
cached_path = download(URL, None, 'tf_model')
Basically, torch cached is used, and the huggingface hub module is used as a reference and wrapped.
2. Folder Download
The return value returns the path of the saved files. However, it is different when using it as a cache folder.
Download to current working directory
from googledriver import download_folder
URL = 'https://drive.google.com/file/d/xxxxxxxxx/view?usp=share_link'
download_folder(URL)
Download to specific directory
from googledriver import download_folder
URL = 'https://drive.google.com/file/d/xxxxxxxxx/view?usp=share_link'
save_folder = './any/path/to/save/'
download_folder(URL, save_folder)
Download to cached directory
from googledriver import download_folder
URL = 'https://drive.google.com/file/d/xxxxxxxxx/view?usp=share_link'
download_folder(URL, cached=True)
In the case of the cache folder, the return value is the cache folder path of Google Drive. Therefore, it may be difficult to cache and use multiple folders.
References
[1] https://github.com/huggingface/transformers
[2] https://github.com/wkentaro/gdown
License
For personal and professional use. You cannot resell or redistribute these repositories in their original state.
Customer Reviews
There are no reviews.
