JUDAC user documentation
Contents:
Access
Prerequisites
SSH Login
Restrictions
OpenSSH
OpenSSH Installation
OpenSSH Key Generation
Key Upload, Key Restriction
Logging in to JUDAC
Key Agent
OpenSSH Persistent Configuration
X Forwarding
Troubleshooting
Further Reading
PuTTY
PuTTY Installation
PuTTY Key Generation
PuTTY Persistent Configuration
MFA with TOTP
Login Nodes
Example
Alternative Login Methods
Configuration
Hardware Characteristics of JUDAC
Software Characteristics
Environment
Shell
Active project
Available file systems
File systems for compute projects
Home directory ($HOME)
Project directory ($PROJECT)
Working directory ($SCRATCH)
File systems for data projects
Data directory ($FASTDATA)
Data directory ($DATA)
Archive directory ($ARCHIVE)
Machine identification file
Transferring files with
scp
,
rsync
, etc.
Using Git on JUDAC
Container Runtime on JUDAC
What Containers Provide
Getting Access
Apptainer on JUDAC
Backwards compatibility to Singularity
Apptainer Images
Launching Containers via Slurm
Interfacing with the System Environment
The two Models
Containerized Applications
User-Defined Software Stack
Container Build System
Building Container Images via CLI
Container Build System REST API
Apptainer image building
Converting Dockerfiles to Apptainer recipes
Rootless builds
Rootfull builds
Object Storage on JUDAC
User Environment Preparation
OpenStackClient CLI
Useful Examples
SWIFT Protocol - Manage objects and containers
S3 Protocol - Manage objects and containers
S3 Environment Preparation
S3 Object Examples
S3 boto3 API
UFTP Service
Client setup
Key management
Usage and examples
Data sharing
GridFTP Service
Examples
Problems
GRID Software
Globus
LCG and VOMS
gfal2
dCache
Certificates
Data Mover Service
Technical Concept
Data Mover Command Line Interface (CLI)
The Nodeum Tool
Task Handling
List all created tasks
Execute a new task
Types of Data Transfer Tasks
Run copy task and display task status
Miscellaneous
Use
--working-dir
to adjust destination tree structure
Use relative path
-working-dir
GPFS File Systems in the Jülich Environment
Best practice notes
Known Issues on JUDAC
Open Issues
Recently Resolved and Closed Issues
FAQ
FAQ about Data Management
How to access largedata on a limited number of computes within your jobs?
What file system to use for different data?
What data quotas do exist and how to list usage?
How to modify the users’s environment.
How to make the currently enabled budget visible:
How can I recall migrated data?
How can I see which data is migrated?
How to restore files?
Linux commands to manage ACLs
Which files have an access control list?
How to avoid multiple SSH connections on data transfer?
How to ensure correct group ID for Your project data?
Information about Maintenance JUNE 10-12, 2024
Maintenance
JUDAC user documentation
»
Index
Index
O
O
overview