Description:
annexdataproxy 1.0.0rc3
annex_dataproxy
This git annex external remote extension uses
AnnexRemote to
talk to EBRAINS Data Proxy
so that you can use EBRAINS Collaboratory buckets as
Datalad siblings.
Install
pip install annex_dataproxy.
Usage
create a dataset
$ datalad create pdfdata
[INFO ] Creating a new annex repo at /tmp/pdfdata
[INFO ] scanning for unlocked files (this may take some time)
create(ok): /tmp/pdfdata (dataset)
$ cd pdfdata/
$ rsync -ra $HOME/PDFs/ ./
$ datalad save
add(ok): 1107.0903 Montbrio Pazo - Stuart Landau.pdf (file)
[199 similar messages have been suppressed; disable with datalad.ui.suppress-similar-results=off]
save(ok): . (dataset)
action summary:
add (ok: 209)
save (ok: 1)
tell the dataproxy remote our token and what bucket & prefix to use
$ export EBRAINS_TOKEN=$EBRAINS_TOKEN
$ export DATAPROXY_PATH=insference/pdfs
create the annex remote and datalad push --to it
$ git annex initremote pdfs type=external externaltype=dataproxy encryption=none
initremote pdfs ok
(recording state in git...)
$ datalad push --to pdfs
copy(ok): 15009.full.pdf (file) [to pdfs...]
[193 similar messages have been suppressed; disable with datalad.ui.suppress-similar-results=off]
action summary:
copy (notneeded: 6, ok: 203)
Status
sloppy proof of concept
git annex testremote passes
PyPI package for easier install
better mechanism for specifying bucket & prefix
License
For personal and professional use. You cannot resell or redistribute these repositories in their original state.
Customer Reviews
There are no reviews.
