How can I see which data is migrated?
There are two file systems which hold migrated data: /arch and /arch2
- These are so called archive file systems.
- In principle all data in the file systems will be migrated to TSM-HSM tape storage in tape libraries.
- Data is copied to TSM backup storage prior to migration.
- Every user owns a personal archive directory that can be specified by the $ARCH resp. $GPFSARCH variable.
- Data are not quoted by storage but by the number of files per group/project. This is done because UNIX is still not able to handle millions of files in a file system with an acceptable performance.
The TSM-HSM native command dsmls, which shows if a file is migrated, is not available on any HPC system (JUQUEEN, JUDGE, JUROPA, JUROPATEST, DEEP). This command is only supported on the TSM-HSM node of the storage cluster JUST, that hosts the file systems for the HPC systems. However JUST is not open for user access.
ls -ls [mask | filename]
to list the files. Migrated files can be identified by a block count of 0 in the first column (-s option) and an arbitrary number of bytes in the sixth column (-l option).
0 -rw-r----- 1 user group 513307 Jan 22 2008 log1
0 -rw-r----- 1 user group 114 Jan 22 2008 log2
0 -rw-r----- 1 user group 273 Jan 22 2008 log3
0 -rw-r----- 1 user group 22893504 Jan 23 2008 log4