porridge 1.0.0

Description:

porridge 1.0.0

# porridge [](https://pypi.org/project/porridge) [](https://travis-ci.org/thusoy/porridge) [](https://ci.appveyor.com/project/thusoy/porridge/branch/master)Simple, strong and standardized keyed password storage.Keyed password storage utilizes server-side secrets to ensure passwords cannot be brute-forced offline if your database is leaked. A leak could happen through a SQL injection or a compromised backup, or a host of other sadly quite common webapp vulnerabilities.While many password storage schemes like PBKDF2, bcrypt, scrypt and the likes will make recovering the passwords offline slow, a resourceful and patient attacker will eventually be able to recover most of them. Porridge makes this entirely impossible unless your secret is also leaked, which is often not the case for many common vulnerabilities.Note that utilizing porridge is not magical solution to passwords on the internet, a complete solution should still enforce at least a password policy, secure password resets, rate-limiting and U2F/2FA. Have experienced security engineers set up something for you, or use high-level libraries that take care of it for you.Installing---------- pipinstallporridgePre−builtwheelsisavailableforWindows,LinuxandmacOS.Buildingfromsourcerequirescffi>=1.0.0,whichinturnrequireslibffiandpythonheaderstocompile.Usage−−−−−‘‘‘pythonfromporridgeimportPorridgeporridge=Porridge(′myfirstkey:myfirstsecret′)boiledpassword=porridge.boil(′password′)ifporridge.verify(′password′,boiledpassword):print(′Success!′)else:print(′Fail!′)‘‘‘Thissetupensuresthatevenifyourdatabaseisleaked,yourusers′passwordsareirrecoverablebyanattackerthatdoesnotalsopossessthe‘myfirstsecret‘value.LoaditsecurelylikeyouwouldothercredentialslikeAPIkeys,databasepasswords,sessiontokensandsimilar.Thisshellsnippetishandytocreatestrongsecrets:‘‘‘bash echo "(date+(openssl rand -base64 30)"```This string will thus grow regularly. After some time, it'll look something like keyid3:key3,keyid2:key2,keyid1:key1The first key in the list (in this case, keyid3) will be used to boil new passwords.Old keys are necessary to verify the passwords of users who haven't logged in since the secret was rotated. Secrets can be dropped from the config when no users have passwords using that id anymore, which you can tell from the `keyid` field in the boiled password.**Note**: Create a `Porridge` instance once and re-use it across your application, it does some parameter validation and stuff on startup you'd rather not want to redo for every passord you process.Local development----------------- ./configure ./testContinually running tests whenever source changes: $ ./tools/watch_and_run_tests.shMotivation----------I couldn't find any existing solutions that utilizes argon2's server-side secret feature, as most libraries only wrap the high-level interfaces, which sadly don't enable setting secrets.Some guiding principles for this project:- People should not have to configure cryptographic parameters- UX is a security feature- The database is not trusted, neither to keep things secret, nor to keep things sane- Following nothing more than the quickstart should result in a very secure implementation- Migrating from existing solutions should be easyMaintenance-----------Keeping this running over an extended period requires two things: - Adding new secrets regularly (twice a year is probably fine), and whenever you suspect a breach - Using `needs_update()` to store new boils where the password was stored with old parametersThe first is to ensure that if your servers at one point is compromised, future passwords are not impacted. The second point ensures that every time one of your users log in, the parameters their existing boiled password is stored under are still strong and the secret current, otherwise it'll be re-stored.The only thing you need to do this is to check `needs_update()` after a password has been verified, and to store the updated one if that's the case:```pythonfrom porridge import Porridgeporridge = Porridge('keyid2:key2,keyid1:key1')password = ... # get this from the userold_boiled_password = ... # Get this from your databaseif porridge.verify(password, old_boiled_password): print('Success!') if porridge.needs_update(old_boiled_password): # update the password in the database new_boiled_password = porridge.boil(password) print('Storing new boiled password to database')else: print('Fail!')```The default parameters will be bumped regularly with new releases of porridge, thus as long as you install updates this should keep everything fresh.Note that to avoid DDoS itself, a Porridge instance will refuse to verify passwords boiled with parameters that are stronger than a given threshold of it's own parameters. This is to ensure that if you by accident try to verify a password with a time cost or memory cost in the millions, you will not have to wait for the heat death of the universe to regain control of your computer. But we also want to ensure that we can upgrade parameters gradually across a fleet of instances without some suddenly starting to fail, thus when you're increasing the cost parameters you should ensure you increase them with less than the `parameter_threshold`. The default threshold is 4, thus you'll be fine if you double parameters, but if you want to bump parameters with more than 4x you should increase `default_threshold` across your fleet first.FAQ---*Q: I notice the word "hash" isn't used much by porridge, why?*A: Because it's too easy to get stuff wrong when communicated to people who are not cryptographers, which include most of us. Experienced cryptographers do a mental translation of "hash" to "memory-hard key stretching" whenever they're in a password context, but the rest of us don't. Thus it's too easy for non-cryptographers to write password storage solutions that either store passwords in plaintext, or just use an actual "hash", leading to puppies dying left and right. Thus for porridge, passwords are "boiled". If non-cryptographers hear that they're supposed to boil passwords, any decent search engine will ensure they end up with a very robust solution. This project is named porridge, as it's one dish that requires salt and a long boil, but also avoids squatting a "password-boiler" package that makes it hard for other packages to attempt to solve the same problem. Eran Hammer has some [more thoughts on this](https://hueniverse.com/the-myth-of-descriptive-module-names-d34d5feaa273).*Q: How do I migrate to porridge from pbkdf2/bcrypt/scrypt/plain argon2?*A: Add a new column in your database to store the boiled passwords, add porridge and boil passwords with it in addition to your existing scheme and store them to the new column. When verifying, verify with both your existing scheme and porridge if there's anything in the new column. When you deem that few enough users haven't gotten their passwords boiled by porridge yet, drop the old password column and stop using the old scheme. The users who hasn't gotten new boiled passwords will be forced through password reset, but otherwise no one will notice any difference. If you are already using argon2 but without server-side secrets, porridge can dropped in directly. Note that the max length of a boiled password is *265* characters, but that requires using the associated data feature that is not exposed through porridge, so you're probably fine if your existing columns only allows 255 characters.*Q: Why "porridge"?*A: Because good porridge requires more than just salt, takes a long time to boil, and you cannot separate its ingredients after they've been boiled. And I was hungry when starting writing this. And we need better terminology for password storage, see the first question.*Q: Could you release wheels for platform X?*A: All releases of Porridge use wheels built by Travis CI and AppVeyor (see `./tools/release.py` for how it's done). If you need another platform supported, like a specific version of PyPy on some platform, open a PR adding it to the build matrix, and it'll automatically be part of the next release.Security--------Porridge wraps the reference implementation of [argon2](https://github.com/P-H-C/phc-winner-argon2), the winner of the Password Hashing Competition, which means it has been studied in detail by very experienced cryptanalysts.The default parameters aims for ~1ms boiling time with 512kB memory usage, adjust these to suit your environment and your requirements. If you run on very performant hardware you should be able to sustain higher costs:```pythonporridge = Porridge('key1:secret1', time_cost=8, memory_cost=1024, parallelism=16)````time_cost` gives the number of iterations of the core algorithm, measure to see the impact in your environment.`memory_cost` is how many kibibytes of memory to use for each password boiled.`parallelism` is how many threads to use for each password boiled.If you find a security-critical bug that you'd rather not disclose openly in the issues, shoot an email to hello at thusoy.com. This project does not have a bug bounty, but you will be credited (if you wish) here in the README and in the changelog.Alternatives------------If you can't apply server-side secrets, plain [argon2](https://github.com/hynek/argon2_cffi) is the recommended way to store your passwords as of best practices in 2017. To utilize server-side secrets with other schemes you can HMAC the password with your secret before passing it to your key stretching function, but it'll be very hard to rotate this secret without invalidating all your passwords.Credits-------Many thanks to [argon2_cffi](https://github.com/hynek/argon2_cffi) for a great starting point for wrapping argon2.Troubleshooting---------------### Import fails with libpython shared object not foundIf you get a traceback similar to this when trying to import the module:``` from ._ffi import ffi, libImportError: libpython2.7.so.1.0: cannot open shared object file: No such file or directory```You are probably missing the `python-dev` package. On ubuntu/debian: `sudo apt-get install python-dev`.### Installation fails with 'compilation terminated'If installing the module fails with a traceback like```c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory #include <ffi.h> ^compilation terminated.error: command 'x86_64-linux-gnu-gcc' failed with exit status 1```You are trying to install from source (might happen if using an older pip which doesn't install manylinux1 wheels) and the compiler can't find the libraries it needs. On ubuntu/debian: `sudo apt-get install libffi-dev python-dev`. Updating your pip should also work and might not require root if you're running in a virtualenv.