Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: update number of GPUs.

Table of Contents

GPU Resources in O2

There are 31 34 GPU nodes with a total of 147 GPU cards available on the O2 cluster. The nodes are accessible in three gpu partitions: gpu, gpu_quad, gpu_requeue.

The gpu partition includes 32 double precision GPU cards: 16 Tesla K80 with 12GB of VRAM, 8 Tesla M40 with 12GB and 24GB of VRAM  and , and 8 Tesla V100 with 16GB of VRAM

The gpu_quad partition includes 71 GPUs: 47 single precision RTX 8000 cards with 48GB of VRAM, 8 A40 single precisions cards 48GB of VRAM and , 24 double precision Tesla V100s cards with 32GB of VRAM, and 4 double precision A100 cards with 80G of VRAM.

The gpu_requeue partition includes 44 GPUs: 28 single precision RTX 6000 cards with 24GB of VRAM, 2 double precision Tesla M40 cards, 2 A100 cards with 40GB of VRAM and 12 A100 cards with 80GB of VRAM.

...

Code Block
languagetext
login02:~ sinfo  --Format=nodehost,available,memory,statelong,gres:40 -p gpu,gpu_quad,gpu_requeue
HOSTNAMES           AVAIL               MEMORY              STATE               GRES
compute-g-16-254175    up                  257548    373760          mixed    draining@           gpu:teslaV100teslaM40:4,vram:16G24G                 
compute-g-16-175176    up                  257548              mixed               gpu:teslaM40:4,vram:24G
compute-g-16-17612G     up            
 compute-g-16-177    up                  257548              idle mixed               gpu:teslaM40teslaK80:48,vram:12G                 
compute-g-16-194    up                  257548              mixed               gpu:teslaK80:8,vram:12G                 
compute-g-16-255197    up                  373760257548              idle mixed               gpu:teslaV100teslaM40:42,vram:16G
compute-g-16-17712G                 
compute-g-16-254    up                  373760              mixed               gpu:teslaV100:4,vram:16G                
compute-g-16-255    up                  373760              mixed               gpu:teslaV100:4,vram:16G                
compute-g-17-145    up                  770000              mixed               gpu:rtx8000:10,vram:48G                 
compute-g-17-146    up                  770000              mixed               gpu:rtx8000:10,vram:48G                 
compute-g-17-147    up                  257548383000              idlemixed                gpu:teslaK80teslaV100s:84,vram:12G32G               
compute-g-17-145148    up                  770000383000              mixed               gpu:rtx8000teslaV100s:104,vram:48G32G               
compute-g-17-146149    up                  770000383000              mixed               gpu:rtx8000teslaV100s:104,vram:48G:32G               
compute-g-17-147150    up                  383000              mixed               gpu:teslaV100s:4,vram:32G               
compute-g-17-148151    up                  383000              mixed               gpu:teslaV100s:4,vram:32G               
compute-g-17-149152    up                  383000              mixed               gpu:teslaV100s:4,vram:32G               
compute-g-17-150153    up                  383000              mixed               gpu:teslaV100srtx8000:4,vram:32G3,vram:48G                  
compute-g-17-151154    up                  383000              mixed               gpu:teslaV100srtx8000:43,vram:32G48G                  
compute-g-17-152155    up                  383000              mixed               gpu:teslaV100srtx8000:43,vram:32G48G                  
compute-g-17-153156    up                  383000              mixed               gpu:rtx8000:3,vram:48G                  
compute-g-17-154157    up                  383000              mixed               gpu:rtx8000:3,vram:48G                  
compute-g-17-156158    up                  383000              mixed               gpu:rtx8000:3,vram:48G                  
compute-g-17-157159    up                  383000              mixed               gpu:rtx8000:3,vram:48G                  
compute-g-17-158160    up                  383000              mixed               gpu:rtx8000:3,vram:48G:48G                  
compute-g-17-159161    up                  383000              mixed               gpu:rtx8000:3,vram:48G                  
compute-g-17-160162    up                  383000500000              mixed               gpu:rtx8000a40:34,vram:48G
compute-g-17-155    up                  383000
compute-g-17-163    up         idle            500000    gpu:rtx8000:3,vram:48G
compute-g-17-161    up           mixed       383000        gpu:a40:4,vram:48G      idle                gpu:rtx8000:3,vram:48G
compute-gcg-17-245164    up                  383000500000              mixed               gpu:rtx6000a100:104,vram:24G80G                     
compute-gc-17-246245   up                  383000              mixedidle                gpu:rtx6000:10,vram:24G                 
compute-ggc-1617-197 246   up                  257548383000              idle                gpu:teslaM40rtx6000:210,vram:12G24G                 
compute-gc-17-247   up                  383000              idle                gpu:rtx6000:8,vram:24G                  
compute-gc-17-249   up                  1000000             idle    allocated            gpu:a100:2,vram:40Gvram:40G                     
compute-gc-17-252   up                  1000000             idle                gpu:a100:4,vram:80G                     
compute-gc-17-253   up                  1000000             idleallocated                gpu:a100:4,vram:80G                     
compute-gc-17-254   up                  1000000             idlemixed                gpu:a100:4,vram:80G                     

GPU Partition

The gpu partition is open to all O2 users; to run jobs on the gpu partition use the flag -p gpu

...

The gpu_quad partition is open to any users working for a PI with a primary or secondary appointment in a pre-clinical department; to run jobs on the gpu_quad partition use the flag -p gpu_quad. If you work at an affiliate institution but are collaborating with an on-Quad PI, please contact Research Computing to gain access.

...