sh5util

Merge HDF5 files for a job

$ sh5util -j [job_id]

$ sh5util -j [job_id.step_id]

$ sh5util -j [job_id] -E -i [path/to/file.h5] -s [Energy|Filesystem|Network|Task]

$ sh5util -j [job_id] -I -s [series] -d [data_item]

$ sh5util -j [job_id] -I -s [series] -L

$ sh5util -j [job_id] -S

sh5util [-j job[.step]] [-E|-I] [OPTIONS]

sh5util merges HDF5 profiling files produced by Slurm's acct_gather_profile plugin across compute nodes into a single consolidated file for analysis. It supports three modes: merging node files, extracting data series to CSV, and extracting specific metrics from time series.
The tool works with Slurm job profiling data that tracks energy consumption, filesystem I/O, network activity, and task-level metrics. Output files can be analyzed with HDF5 tools or converted to CSV for use with standard data analysis applications.

-j, --jobs job[.step]

Merge HDF5 files for the specified job or job step

Directory containing node-step HDF5 files

Output file path (default: ./job_$jobid.h5)

Keep node-step files after merging

User who ran the profiled job

Extract data series to CSV format

Input merged HDF5 file for extraction

Extract data for specific node only

Data level: Node:Totals or Node:TimeSeries

Data series: Energy, Filesystem, Network, Task, or Task_#

Extract single data item from all samples

Specific data item name to extract

List available data items in a series

Display usage information

Requires HDF5 profiling to be enabled in Slurm configuration. Node files must exist in the profile directory. Large jobs with many nodes and long runtimes can produce substantial HDF5 files. The acct_gather_profile plugin must be configured on the cluster.

sh5util is part of the Slurm (Simple Linux Utility for Resource Management) workload manager, developed at Lawrence Livermore National Laboratory. Slurm was first released in 2002 and has become one of the most widely used HPC job schedulers. HDF5 profiling support was added to provide detailed job performance analysis capabilities.

sacct(1), sstat(1), srun(1), sbatch(1)