SIONlib: Scalable I/O library for parallel access to task-local files

SIONlib: Utilities for the Management of SION-files

siondump Dumping the meta data of a sion file
sionsplit Splitting one sion file in separate files
siondefrag De-fragmenting a sion file
sioncat Extracts all data or data of one tasks
sionconfig Wrapper for compile and link options
partest Parallel test of sionlib

  1. siondump - Dumping the meta data of a sion file
    Usage:
    siondump [options] <sionfile>
    Options:
    -a
    print also information about chunksizes
    -v
    verbose mode, show sion debug messages
    Description:
    siondump prints on stdout all information from the first meta data block. With -a there will be also printed a table containing the chunksizes for all tasks and chunks.

  2. sionsplit - splitting one sion file in separate files
    Usage:
    sionsplit [options] <sionfile> <prefix>
    Options:
    -d <digits>
    number of digits used for generating filenames (default: 5)
    -v
    verbose mode, show sion debug messages
    Description:
    sionsplit extracts task related files from a sion file. For each task there will be generated a file in the path described with <prefix>. The task number will be appended to the <prefix>.
    Example:
    sionsplit data.sion data/file_ -> data/file_00000, data/file_00001, ...
    If the data of a task is distributed over several chunks in the sion file, these chunks are concatenated in the output file without gaps inbetween.

  3. sioncat - extracts data from a sion file
    Usage:
    sioncat [options]
    Options:
    -t <tasknum>
    write only data of task <tasknum>
    -b <blknum>
    write only data of block <blknum>
    -o <outfile>
    file data will be written to, if not specified stdout will used
    -v
    verbose mode, show sion debug messages
    Description:
    sioncat extracts data from a sion file. Depending on option data of all tasksand all blocks or only a one task/block will be extracted. sioncat extracts the data without any sion metadata and gaps. Multiple blocks will be concatenated. Warning: Without -o option data will printed to stdout.

  4. siondefrag - de-fragmenting a sion file
    Usage:
    siondefrag [options]
    Options:
    -Q <fsblksize>
    filessystem blocksize for new sion file in MB
    -q <fsblksize>
    filessystem blocksize for new sion file in bytes (default is fsblocksize of inputfile)
    -S <localsize>
    requested chunksize for new file in MB
    -s <localsize>
    requested chunksize for new file in bytes (default is a )
    -v
    verbose mode, show sion debug messages
    Description:
    siondefrag generates a new sion file from an existing sion file. The new file will have only one chunk per task which contains the data of all chunks of this task in the old sion file.

  5. sionconfig - generation of use-case specific compile- and linking-options
    Usage:
    LDFLAGS += `../../bin/sionconfig --libs [options]`
    CFLAGS += `../../bin/sionconfig --cflags [options]`
    Options:
    (--com|--ser|--omp|--mpi|--ompi|--gen)
    selects SIONlib API
    (--cflags|--libs|--path)
    select output of sionconfig (for compile, linking or installation path)
    [--32|--64]
    Precision
    [--be] [--fe] [--mic]
    Cross compile
    [--c|--f77|--f90|--cxx]
    Language selection
    [-V|--version|-h]
    Version, Help
    [-gcc]
    output options for gcc compiler family
    Description:
    This script called sionconfig which output for each combination of option correct option for compiling (--cflags) or linking (--libs):

  6. partest - parallel MPI test program for sionlib
    Usage:
    partest [options]
    Options:
    [-f filename]
    filename of direct access file
    [-F <factor>]
    factor for random size (0.0 to 1.0, def: 0.0)
    [-b <fileblksize>]
    size of blocks written in one fwrite in bytes
    [-B <fileblksize>]
    size of blocks written in one fwrite in MBytes
    [-s <localsize>]
    size of data written by each processor in bytes
    [-S <localsize>]
    size of data written by each processor in MBytes
    [-r <chunksize>]
    sion chunk size in bytes
    [-R <chunksize>]
    sion chunk size in MBytes
    [-Q <fsblksize>]
    size of filesystem blocks in MBytes
    [-T <type>]
    type of test (0)
    [-v]
    verbose print info for each task
    [-d]
    debug task 0
    [-D]
    debug task n
    Blue Gene/L, Blue Gene/P:
    [-P]
    order tasks by BG I/O-node
    [-p <numtasks>]
    number of tasks per BG I/O-node
    Description:
    partest performs a parallel write and a parallel read to/from a sionfile