pyallel 1.2.3

Description:

pyallel 1.2.3

Pyallel
Run and handle the output of multiple executables in pyallel (as in parallel)
https://github.com/Danthewaann/pyallel/assets/22531177/8685eb92-aac5-440a-9170-30fd1460c53f
Tested on Linux and MacOS only
Installation
Pre-built executables are available on the Releases page.
pyallel can also be installed using pip (requires Python >=3.8):
pip install pyallel

Quick start
Once installed, you can run pyallel to see usage information, like so:
usage: pyallel [-h] [-t] [-n] [-V] [--colour {yes,no,auto}] [commands ...]

Run and handle the output of multiple executables in pyallel (as in parallel)

positional arguments:
commands list of quoted commands to run in parallel e.g "mypy ." "black ."

each command is executed inside a shell, so shell syntax is supported as
if you were running the command directly in a shell, some examples are below

"MYPY_FORCE_COLOR=1 mypy ." <- provide environment variables
"mypy | tee -a mypy.log" <- use pipes to redirect output
"cat > test.log < other.log" <- use input and output redirection
"mypy .; pytest ." <- run commands one at a time in sequence
"echo \$SHELL" or "\$(echo mypy .)" <- expand variables and commands to evaluate (must be escaped)
"pytest . && mypy . || echo failed!" <- use AND (&&) and OR (||) to run commands conditionally

commands can be grouped using the group separator symbol (:::)

"echo boil kettle" "sleep 1" ::: "echo make coffee"

the above will print "boil kettle" and sleep for 1 second first before printing "make coffee"

command groups are ran in the sequence you provide them, and if a command group fails
(if a command fails inside the command group) the rest of the command groups in the sequence are not run

options:
-h, --help show this help message and exit
-t, --no-timer don't time how long each command is taking
-n, --non-interactive
run in non-interactive mode
-V, --version print version and exit
--colour {yes,no,auto}
colour terminal output, defaults to "auto"

Currently you can provide a variable number of commands to run to pyallel, like so:

[!IMPORTANT]
If you need to provide arguments to a command, you must surround the command and it's arguments in quotes!

pyallel "MYPY_FORCE_COLOR=1 mypy ." \
"black --check --diff ." \
"pytest ."

Build
You can also build an executable with the following (executables will be written to ./dist):

[!NOTE]
The arch=x86_64 values in the following code blocks can be replaced with arch=aarch64 and
any other architecture that is supported by docker to build an executable for that given architecture


[!NOTE]
To build aarch64 binaries on an x86_64 host machine, you will need to run the following
commands to setup qemu to allow this to work

sudo apt-get install qemu binfmt-support qemu-user-static && \
docker run --rm --privileged multiarch/qemu-user-static --reset -p yes

Build for generic linux
docker build --tag pyallel --build-arg 'arch=x86_64' --build-arg "uid=$(id -u)" . && \
docker run -e 'arch=x86_64' --rm --volume "$(pwd):/src" pyallel

Build for alpine linux
docker build --tag pyallel-alpine --build-arg 'arch=x86_64' --build-arg "uid=$(id -u)" --file Dockerfile.alpine . && \
docker run -e 'arch=x86_64' --rm --volume "$(pwd):/src" pyallel-alpine

Build locally
python -m venv .venv && \
source .venv/bin/activate && \
pip install . -r requirements_build.txt && \
./build.sh

Build all
./build_all.sh

TODOs

Add support to have commands depend on other commands (some commands must complete
before a given command can start)
Add a debug mode that logs debug information to a log file
Add support to state how many lines a command can use for it's output in interactive mode
Maybe add support to allow the user to provide stdin for commands that request it
(such as a REPL)
Add custom parsing of command output to support filtering for errors (like vim's
errorformat)
Allow list of files to be provided to supply as input arguments to each command
Allow input to be piped into pyallel via stdin to supply as standard input to each
command