JUWELS user documentation Logo

Contents:

  • Access
    • Prerequisites
    • SSH Login
      • Restrictions
      • OpenSSH
        • OpenSSH Installation
        • OpenSSH Key Generation
        • Key Upload, Key Restriction
        • Logging in to JUWELS
        • Key Agent
        • OpenSSH Persistent Configuration
          • X Forwarding
        • Troubleshooting
        • Further Reading
      • PuTTY
        • PuTTY Installation
        • PuTTY Key Generation
        • PuTTY Persistent Configuration
    • MFA with TOTP
    • Login Nodes
      • Example
    • Alternative Login Methods
  • Configuration
    • Hardware Configuration of the JUWELS Cluster Module
    • Hardware Configuration of the JUWELS Booster Module
    • Software Overview
  • Environment
    • Shell
    • Active project
    • Available file systems
      • File systems for compute projects
        • Home directory ($HOME)
        • Project directory ($PROJECT)
        • Working directory ($SCRATCH)
      • File systems for data projects
        • Data directory ($FASTDATA)
        • Data directory ($DATA)
        • Archive directory ($ARCHIVE)
    • Machine identification file
    • Transferring files with scp, rsync, etc.
    • Using Git on JUWELS
  • Software Modules
    • Basic module usage
    • Available compilers
    • MPI runtimes
    • GPUs and modules
    • Finding software packages
    • Stages
    • Stages Changelog
    • Scientific software at JSC
    • Requesting new software
    • Installing your own software with EasyBuild
  • Building Software
    • Compiled Languages
      • Compilers
      • MPI Compiler Wrappers
      • CUDA
      • Build Systems
      • Exotic Languages
    • Interpreted Languages
      • Python
      • Julia
    • Pre-Compiled Binaries
      • Conda/Mamba
  • Batch system
    • Slurm Partitions
      • Hardware Overview
      • Available Partitions
    • Internet Access
    • Allocations, Jobs and Job Steps
    • Writing a Batch Script
      • Job Script Examples
    • Generic Resources, Features and Topology-aware Allocations
    • Job Steps
    • Dependency Chains
    • Interactive Sessions
    • Hold and Release Batch Jobs
    • Slurm commands
    • Summary of sbatch and srun Options
    • Frequency Scaling Performance Reliability
  • Processor Affinity
    • Slurm options
      • Terminology
      • --cpu-bind
        • Implicit types
        • Explicit types
      • --distribution
        • First part (node_level)
        • Second part (socket_level)
        • Third part (core_level)
        • Fourth part
      • --hint
    • Affinity visualization tool
    • Affinity examples
      • Default processor affinity
      • Further examples
  • MPMD: Multiple Program Multiple Data Execution Model
  • GPU Computing
    • JUWELS GPU Nodes
    • GPU Visibility/Affinity
    • Nvidia Profiling Tools and Clock Speed
    • CUDA MPS: Multiple MPI Ranks per GPU
    • Job Script Examples
  • JUWELS Booster Overview
    • Node Configuration
    • System Network Topology
    • Affinity
      • Slurm
        • GPU Devices
        • NUMA Domains
        • InfiniBand Adapters (HCAs)
      • Overriding Defaults
  • Visualization on JUWELS
    • JUWELS Visualization Nodes
    • How to Use the Visualization Nodes
    • Additional Documentation
  • GPFS File Systems in the Jülich Environment
    • Best practice notes
  • Data Transfer to and from JUWELS
  • JUWELS Rocky 9 Migration
    • Prepare in advance for the migration
    • Known Issues with the migration
  • Known Issues on JUWELS
    • Open Issues
    • Recently Resolved and Closed Issues
  • FAQ
    • FAQ about JUWELS
      • When are large jobs scheduled?
      • How can I load an older software stage not currently listed?
    • General FAQ
      • How to generate and upload ssh keys?
      • My job failed with “Transport retry count exceeded”
      • My job failed/was killed for no apparent reason
    • FAQ about Data Management
      • How to access largedata on a limited number of computes within your jobs?
      • What file system to use for different data?
      • What data quotas do exist and how to list usage?
      • How to modify the users’s environment.
      • How to make the currently enabled budget visible:
      • How can I recall migrated data?
      • How can I see which data is migrated?
      • How to restore files?
        • Linux commands to manage ACLs
        • Which files have an access control list?
      • How to avoid multiple SSH connections on data transfer?
      • How to ensure correct group ID for Your project data?
      • Information about Maintenance JUNE 10-12, 2024
  • Maintenance
  • Heterogeneous and Cross-Module Jobs
    • Heterogeneous Jobs
      • Specifying Individual Job Options
      • Running Job Components Side by Side
    • Loading Software in a Heterogeneous Environment
      • Uniform Architecture and Dependencies
      • Non Uniform Architectures and Mutual Exclusive Dependencies
    • MPI Traffic Across Modules
  • Accounting
    • Accounting Mode
    • Command description
  • JSC Tools
    • JuDoor
    • Status Page
      • Notifications
        • Mail
        • Browser
      • Message of the Day (MOTD)
    • LLview Job Reporting
    • Pinning Tool
    • JUBE Benchmarking Environment
    • User tool jutil
      • Usage
        • Available subcommands
        • Available actions
        • Available options
      • Allowed user interfaces
    • UNICORE access
  • Container Runtime on JUWELS
    • What Containers Provide
    • Getting Access
    • Apptainer on JUWELS
      • Backwards compatibility to Singularity
      • Apptainer Images
      • Launching Containers via Slurm
      • Interfacing with the System Environment
        • The two Models
        • Containerized Applications
        • User-Defined Software Stack
    • Container Build System
      • Building Container Images via CLI
      • Container Build System REST API
    • Apptainer image building
      • Converting Dockerfiles to Apptainer recipes
      • Rootless builds
      • Rootfull builds
  • Jacamar CI Runners
    • Getting Access
    • Runners Tags on JUWELS
    • Jacamar Example .gitlab-ci.yml File
  • Parallel Debugging and Performance Analysis
    • Debugging with TotalView on JUWELS
    • Using TotalView
    • Memory Debugging with TotalView
  • Support
JUWELS user documentation
  • »
  • Search

  • © Copyright 2024, JUWELS administrators.
  • Legal Notice
  • Data Protection
  • Accessibility

Built with Sphinx using a theme provided by Read the Docs.