parallel

parallel

TLDR

Gzip several files at once, using all cores

>_ parallel gzip ::: [file1] [file2] [file3]
copy

Read arguments from stdin, run 4 jobs at once

>_ ls *.txt | parallel -j4 gzip
copy

Convert JPG images to PNG using replacement strings

>_ parallel convert {} {.}.png ::: *.jpg
copy

Parallel xargs, cram as many args as possible onto one command

>_ [args] | parallel -X [command]
copy

Break stdin into ~1M blocks, feed each block to stdin of new command

>_ cat [big_file.txt] | parallel --pipe --block 1M [command]
copy

Run on multiple machines via SSH

>_ parallel -S [machine1],[machine2] [command] ::: [arg1] [arg2]
copy

Copied to clipboard
free 100$ digital ocean credit