Description:
pickleslicer 0.1.0
pickleslicer: Automatic slicer and unslicer of pickle files
The pickleslicer package provides a convenient way to create and load pickle files
in scenarios where storing many small files is preferable to storing a single large file.
The pickleslicer package wraps Python's built-in pickle package and has a very similar usage pattern.
Installation
The package distribution is hosted on PyPI and can be installed via pip:
pip install pickleslicer
Creating sliced pickle files
To create sliced pickle files, call pickleslicer.dump():
import pickleslicer
obj = {} # obj can be any Python object
pickleslicer.dump(obj, "myfilename.pickle")
This will create sliced pickle files named myfilename.pickle.1, myfilename.pickle.2, etc., with each file having a maximum size of 10 MB.
To customize the maximum file size, specify the max_size parameter:
pickleslicer.dump(obj, "myfilename.pickle", max_size=50*1024*1024) # 50 MB
Loading sliced pickle files
To load sliced pickle files that have previously been created, call pickleslicer.load():
import pickleslicer
obj = pickleslicer.load("myfilename.pickle")
This will load sliced pickle files named myfilename.pickle.1, myfilename.pickle.2, etc. The unpickled Python object is returned.
License
For personal and professional use. You cannot resell or redistribute these repositories in their original state.
Customer Reviews
There are no reviews.
