JUST user documentation
Contents:
Configuration for Jülich Storage Cluster (JUST)
JUST numbers
JUST Tiered Storage
JUST Architecture
JUST Hardware Characteristics
JUST-LCST: Cluster JUSTGSS
JUST-DATA: Extended Capacity Storage TIER (XCST) for community data sharing
JUST-COM: Storage Cluster for Communities (HDFCloud VMs)
JUST-TSM: Server and Storage
JUST-HPST: Server and Storage
JUST Tape Libraries (Automated Cartridge Systems)
Total Numbers
Hardware Characteristics of the Tape Libraries Complex
JUST History and Roadmap (for disk based part)
GPFS File Systems in the Jülich Environment
Best practice notes
HPC Data Rules for GPFS
Structure
File system and group/project-directories
User $HOME Directory
User data
High Performance Storage Tier CSCRATCH
Usage Concept
Read
Write
Read-Modify-Write
General Information
Technical overview
Using CSCRATCH
Get state of a file
Stage file in the cache (prestage)
Write file into the cache
Stage data out (sync)
Delete synced data from the cache (purge)
IME native Interface
Compile the code
Execute job
Job submission when using $CSCRATCH
Object Storage on JUDAC
User Environment Preparation
OpenStackClient CLI
Useful Examples
SWIFT Protocol - Manage objects and containers
S3 Protocol - Manage objects and containers
S3 Environment Preparation
S3 Object Examples
S3 boto3 API
FAQ
How to access largedata on a limited number of computes within your jobs?
What file system to use for different data?
What data quotas do exist and how to list usage?
How to modify the users’s environment.
How to make the currently enabled budget visible:
How can I recall migrated data?
How can I see which data is migrated?
How to restore files?
$HOME - Users personal data
$PROJECT - Compute project repository
$FASTDATA - Data project repository (bandwidth optimized)
$DATA - Data project repository (large capacity)
$ARCHIVE - The Archive data repository
How to share files by using ACLs?
Linux commands to manage ACLs
Which files have an access control list?
How to avoid multiple SSH connections on data transfer?
How to ensure correct group ID for Your project data?
Information about $DATA incident from January 2021
JUST user documentation
»
Index
Index
O
O
overview