Versions Compared

Old Version 17

changes.mady.by.user Amir Karger

Saved on

compared with

New Version 18

changes.mady.by.user Cox, Calvin D.

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Code Block
login04:~ O2_jobs_report --report

JOBS STATES COUNT FROM 2023-03-16 TO 2023-03-18
==========  ===========
  USERNAME    COMPLETED
==========  ===========
        rc            5
==========  ===========

JOBS PARTITIONS COUNT FROM 2023-03-16 TO 2023-03-18
==========  ==========
  USERNAME    transfer
==========  ==========
        rc           5
==========  ==========

JOBS STATISTICS FROM 2023-03-16 TO 2023-03-18
======  ============  =========================  ===========================  ======================  ==================  ============================  ===================
  User    Total Jobs    Median Pending Time(hr)    Average Allocated RAM(GB)    Average Used RAM(GB)    Max Used RAM(GB)    Jobs Using > 1/2 Alloc RAM    RAM Efficiency(%)
======  ============  =========================  ===========================  ======================  ==================  ============================  ===================
    rc             5                       0.01                            2                       0                   0                             0                 0.03
======  ============  =========================  ===========================  ======================  ==================  ============================  ===================

======  =======================  ===================  =====================  ========================  ===========================
  User    Average Allocated CPU    CPU Efficiency(%)    Average Runtime(hr)    WallTime Efficiency(%)    Jobs Using > 1/2 WallTime
======  =======================  ===================  =====================  ========================  ===========================
    rc                        1                 34.4                   0.01                         0                            0
======  =======================  ===================  =====================  ========================  ===========================

O2 Resource Utilization

We created a simplified script called O2usage, which runs sreportin the background and requires minimal arguments.

The script can be executed from everywhere in O2 and requires two inputs, the starting and ending dates for the desired time interval, both dates should be in the format of YYYY-MM-DD.

For example:

Code Block
login05:~ O2usage 2021-03-15 2021-04-15
 
--------------------------------------------------------------------------------
Cluster/Account/User Utilization 2021-03-15 - 2021-04-15
Usage reported in Hours, memory is in MiB hours
--------------------------------------------------------------------------------
 
Cluster|Account|User|Name|Resource|Usage
o2|rccg|rp189|Potami|cpu|315
o2|rccg|rp189|Potami|mem|423467
o2|rccg|rp189|Potami|gres/gpu|12

The usage is reported in CPU hours, MiB hours, and GPU hours. 

If the User executing the query is the PI responsible for the Slurm Account (Lab), then the O2usage script will report the utilization for the entire Lab.