Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

To provide more robust and reliable storage, HMS IT will deploy a new has deployed a new storage cluster, designated as /n/scratch, to replace the current /n/scratch3

Info

The /n/scratch3 filesystem is bring retired on Jan 15, 2024

The timeline for this update is:  

  1. November 13 – Beta access to new /n/scratch for preliminary testing. 

  2. December 8 – Full access to /n/scratch for all users. The existing /n/scratch3 will temporarily remain available. 

  3. January 8 /n/scratch3 becomes read-only. 

  4. January 15 /n/scratch3 is retired. The path /n/scratch3 will no longer exist on O2 and no data will be recoverable from the old /n/scratch3

...

Info
  • The /n/scratch3 filesystem is bring retired on Jan 15, 2024 (see above).

  • Please use the new storage at /n/scratch . Documentation is available at: Scratch Storage

Scratch3 Configuration

Scratch3 is a storage location on O2 for temporary data. In summary:

  • THE SCRATCH SPACE IS NOT BACKED UP!

  • Files are AUTOMATICALLY DELETED 30 days after they are last accessed.

  • There are NO SNAPSHOTS available SNAPSHOTS available for scratch3 folders.

  • O2 users can have up to 10 TiB and 1 million files/directories in their scratch folder.

  • Use this space for intermediate files in a longer workflow, or for extra output that doesn't matter much.

To reiterate, if you delete a file on purpose or by accident, or just leave it sitting for 30 days, it is GONE. You can't get it back, and Research Computing can't get it back for you. Using this model lets us provide cost-effective, high-end storage to many more users than would be possible with permanent and backed-up files. But it is important that you understand the risks of using it.

Important - Artificially modifying file access times is against policy and may result in losing your access to scratch3.

Scratch3 Directories: Users

On scratch3, user directories are found under:

  • /n/scratch3/users/<first_hms_id_char>/<HMSID>

Where "<first_hms_id_char>" is the first character of your HMS ID (formerly eCommons ID) and  "<HMSID>" is is your HMS ID.

For example, the scratch3 directory for a user with the username "abc123" would be located at:

  • /n/scratch3/users/a/abc123

For an HMS ID of zz999 the scratch3 directory will be at:

  • /n/scratch3/users/z/zz999

Scratch3 Storage Usage

The storage usage is on a user basis rather than a group. To check your personal and group storage utilization and limits, please run the following command:

quota-v2

More information about the O2 quota-v2 command can be found on this wiki page.

...