UCT HPC cluster

		UCT High Performance Computing Facility
Home About us Documentation Support and Capabilities Policies Apply for account

Thu Jul 7 19:30:01 SAST 2022

CLUSTER LOAD Hold mouse over bars and indicators for more info. Lamp status

Partitions
ada swan

100

101

102

103

104

105

106

107

108

Partitions
ada swan

109

110

111

112

113

114

115

116

117

Partitions
ada swan

118

119

120

121

122

125

126

127

128

Partitions
sadacc-short
sadacc-long

129

130

131

132

133

134

Partitions
gpuo gpumk
gpumka

srvcntgpu001
16&2048x2000MHz cores and 65.7 GB RAM total

srvcntgpu002
12&2048x2000MHz cores and 65.7 GB RAM total

srvcntgpu003
12&2048x2000MHz cores and 0 GB RAM total Free memory<10%

srvcntgpu004
20&2880x2200MHz cores and 131.7 GB RAM total

srvcntgpu005
32&3584x2100MHz cores and 131.4 GB RAM total

srvcntgpu006
32&3584x2100MHz cores and 131.4 GB RAM total

srvcntgpu007
32&3584x2100MHz cores and 131.4 GB RAM total

srvcntgpu008
32&3584x2100MHz cores and 131.4 GB RAM total

Partitions
a100

srvcntgpu009
56&3584x2000MHz cores and 527.6 GB RAM total

srvcntgpu010
56&3584x2000MHz cores and 527.6 GB RAM total

Partitions
curie

600

601

602

603

604

Partitions
curie

605

606

607

Partitions
grace

801

24x2400MHz cores and 1056.5 GB RAM total

802

Disk space:

 / = 22% of 924G
 home = 27% of 8.0T
 scratch = 57% of 345T
 exp_soft = 31% of 4.0T

Users logged in: abdnoh001 ahmad.desai alewis hnkmah001 reshma t0079876 wlstay001

Head Node load: 2.41     Head Node RAM free: 96%
Currently computing: 34673 hours     Jobs running: 72     Jobs queued: 21
Efficiency: 61%    System overview    Summary    Queue accounting    Graphs     Issues

JOBS RUNNING

#   JOBID  PARTITION               NAME     USER  ACCOUNT      STATE       TIME  CPUS  NODES     NODELIST(REASON)      QOS PRIORITY     CPU TIME
-----------------------------------------------------------------------------------------------------------------------------------------------
1   1407630       ada     LTB_stool_meta oknjav00     cbio    RUNNING 6-08:09:23    40      1         srvcnthpc119   normal     6762     253-14:15:20
2   1407645       ada     sim_stool_meta oknjav00     cbio    RUNNING 3-06:50:20    40      1         srvcnthpc120   normal     7840     131-09:34:00
3   1407648       ada     rtb_stool_meta oknjav00     cbio    RUNNING 1-14:35:46    40      1         srvcnthpc104   normal     8437     64-07:51:20
4   1407809       ada       DetectModels rtyfra00 economic    RUNNING 5-16:31:56    24      1         srvcnthpc101   normal     7136     136-12:46:48
5   1407926       ada        1g Peturbed wrgmic01  mecheng    RUNNING 4-10:24:51    60      2   srvcnthpc[110-111]   normal     6815     266-00:52:00
6   1408106       ada           cdhit-80 khnfar02      mcb    RUNNING 3-08:30:35    40      1         srvcnthpc114   normal     6780     134-04:24:00
7   1408107       ada           cdhit-85 khnfar02      mcb    RUNNING 3-08:30:35    40      1         srvcnthpc125   normal     6780     134-04:24:00
8   1408136       ada            TS3D202 tvanheer  chemeng    RUNNING      53:16   120      3 srvcnthpc[107-108,112]   normal     8126     4-10:34:00
9   1408221       ada       feacalProtDB oknjav00     cbio    PENDING       0:00    40      1   (AssocGrpCpuLimit)   normal     7877     
10  1408272      a100           vpe_real hnkmah00      aru    RUNNING 2-20:34:40     8      1         srvcntgpu009      aru     8325     22-20:37:36
11  1408277       ada           Srd.b7e2 ngmpac00  physics    RUNNING   19:13:56   120      3 srvcnthpc[102,113,117]   normal     7511     96-03:56:00
12  1408278       ada           Srd.b7e3 ngmpac00  physics    PENDING       0:00    39      3   (AssocGrpCpuLimit)   normal     7798     
13  1408279       ada           Srd.b7e4 ngmpac00  physics    PENDING       0:00    39      3   (AssocGrpCpuLimit)   normal     7798     
14  1408550       ada                cyl iklray00  mecheng    RUNNING   22:49:08    40      1         srvcnthpc103   normal     6842     38-00:46:40
15  1408551      gpuo             vpe_r2 hnkmah00     gpuo    RUNNING 1-04:11:50     3      1         srvcntgpu004   normal     7000     3-12:35:39
16  1408553      gpuo         b1_syn_5e4 hnkmah00     gpuo    RUNNING 1-03:47:04     3      1         srvcntgpu004   normal     7000     3-11:21:21
17  1408554      gpuo             b2_syn hnkmah00     gpuo    PENDING       0:00     3      1           (Priority)   normal     7414     
18  1408555      gpuo             b3_syn hnkmah00     gpuo    PENDING       0:00     3      1           (Priority)   normal     7414     
19  1408556      gpuo             b4_syn hnkmah00     gpuo    PENDING       0:00     3      1           (Priority)   normal     7414     
20  1408561      gpuo       KFold-Brains mssric00  eleceng    PENDING       0:00    12      1          (Resources)   normal     7648     
21  1408562      gpuo  BrainTraining NEO mssric00  eleceng    PENDING       0:00    12      1           (Priority)   normal     7648     
22  1408592       ada      DA_Test_VIGPM nbnnic00   humbio    RUNNING 1-00:19:26    31      1         srvcnthpc122   normal     6740     31-10:04:30
23  1408618       ada     Coregistration ymbale00 geomatic    RUNNING   16:02:03    40      1         srvcnthpc115   normal     7203     26-17:24:40
24  1408620       ada                cyl iklray00  mecheng    RUNNING    9:08:05    40      1         srvcnthpc109   normal     6908     15-05:26:00
25  1408638       ada     4g UnPreturbed omrmuh00  mecheng    RUNNING    8:50:53    60      2   srvcnthpc[100,106]   normal     6838     22-02:57:00
26  1408642       ada          28pyr-fsi wlstay00 chemistr    RUNNING    4:56:40    40      2   srvcnthpc[106,116]   normal     6851     8-05:49:20
27  1408643       ada          29pyr-fsi wlstay00 chemistr    RUNNING    3:14:56    40      2   srvcnthpc[105,121]   normal     6876     5-10:00:00
28  1408674     grace Allen_subclusters_ stychr00   humbio    RUNNING    8:58:36    24      1         srvcnthpc801   normal     7671     8-23:28:24
29  1408692       ada    opt_HCO_brg_brg rgxyat00  chemeng    RUNNING    1:30:37    40      1         srvcnthpc118   normal     6863     2-12:28:00
30  1408697      a100                nmt ahmkha00 nlpgroup    RUNNING    8:06:54     4      1         srvcntgpu009 nlpgroup     7391     1-08:27:56
31  1408742       ada             blvm04 fmlmar00   civeng    RUNNING    2:54:49     1      1         srvcnthpc126   normal     6717     02:54:54
32  1408790       ada             blvm62 fmlmar00   civeng    RUNNING    1:39:44     1      1         srvcnthpc101   normal     6693     01:39:49
33  1408791       ada             blvm07 fmlmar00   civeng    PENDING       0:00    20      1           (Priority)   normal     6759     
34  1408796       ada            blvm411 fmlmar00   civeng    RUNNING    1:39:44     1      1         srvcnthpc126   normal     6688     01:39:49
35  1408800       ada          30pyr-fsi wlstay00 chemistr    PENDING       0:00    40      2           (Priority)   normal     6798     
36  1408803       ada          35pyr-fsi wlstay00 chemistr    PENDING       0:00    40      2           (Priority)   normal     6797     
37  1408806       ada VMSI_GNSS_POD_2002 ahmad.de architec    RUNNING      46:28    30      4 srvcnthpc[101,105,116,122]   normal     7603     23:17:00
38  1408807       ada            execute t0079876 clinphar    RUNNING    1:10:13     1      1         srvcnthpc126   normal     6678     01:10:19
39  1408808       ada            execute t0079876 clinphar    RUNNING    1:10:13     1      1         srvcnthpc126   normal     6678     01:10:19
40  1408809       ada            execute t0079876 clinphar    RUNNING    1:10:13     1      1         srvcnthpc126   normal     6678     01:10:19
41  1408810       ada            execute t0079876 clinphar    RUNNING    1:09:43     1      1         srvcnthpc126   normal     6678     01:09:49
42  1408811       ada         run11b.mod t0079876 clinphar    RUNNING    1:09:43     1      1         srvcnthpc126   normal     6678     01:09:50
43  1408812       ada          run15.mod t0079876 clinphar    RUNNING    1:09:43     1      1         srvcnthpc126   normal     6678     01:09:50
44  1408813       ada         run11c.mod t0079876 clinphar    RUNNING    1:09:43     1      1         srvcnthpc126   normal     6678     01:09:50
45  1408814       ada            execute t0079876 clinphar    RUNNING    1:09:43     1      1         srvcnthpc126   normal     6678     01:09:50
46  1408815       ada          run16.mod t0079876 clinphar    RUNNING      46:11     1      1         srvcnthpc101   normal     6683     00:46:18
47  1408816       ada          run17.mod t0079876 clinphar    RUNNING      46:11     1      1         srvcnthpc101   normal     6683     00:46:18
48  1408817       ada   run15.mod_SBATCH t0079876 clinphar    PENDING       0:00    24      1           (Priority)   normal     6745     
49  1408818       ada  run11b.mod_SBATCH t0079876 clinphar    PENDING       0:00    24      1           (Priority)   normal     6745     
50  1408819       ada  run11c.mod_SBATCH t0079876 clinphar    PENDING       0:00    24      1           (Priority)   normal     6745     
51  1408820       ada        MoCo111_Hfc gmbtho00  chemeng    PENDING       0:00    40      1           (Priority)   normal     6776     
52  1408821       ada       MoCo111_OHfm gmbtho00  chemeng    PENDING       0:00    40      1           (Priority)   normal     6774     
53  1408822       ada       MoCo111_OHfc gmbtho00  chemeng    PENDING       0:00    40      1           (Priority)   normal     6774     
54  1408823       ada       MoCo111_OHtm gmbtho00  chemeng    PENDING       0:00    40      1           (Priority)   normal     6774     
55  1408824       ada   run17.mod_SBATCH t0079876 clinphar    PENDING       0:00    24      1           (Priority)   normal     6739     
56  1408825       ada   run16.mod_SBATCH t0079876 clinphar    PENDING       0:00    24      1           (Priority)   normal     6739     
57  1408827       ada   LEO_GPS_POD_2008 ahmad.de architec    PENDING       0:00    30      4          (Resources)   normal     7600     
58  1408464_5       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:20
59  1408464_6       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:20
60  1408464_7       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:20
61  1408464_8       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:20
62  1408464_9       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:21
63  1408464_10       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:21
64  1408464_11       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:21
65  1408464_12       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:21
66  1408464_13       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:21
67  1408464_14       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:21
68  1408464_15       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:22
69  1408464_16       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:22
70  1408464_17       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:22
71  1408464_18       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:22
72  1408464_19       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:22
73  1408464_20       ada   BiModelMixRTVSCZ wttoli00 psychiat    RUNNING 1-09:26:11     1      1         srvcnthpc110   normal     6681     1-09:26:22
74  1408658_312       ada           halfpipe    freda psychiat    RUNNING    3:43:04     4      1         srvcnthpc126   normal     6761     14:53:00
75  1408658_313       ada           halfpipe    freda psychiat    RUNNING    3:37:52     4      1         srvcnthpc126   normal     6762     14:32:16
76  1408658_314       ada           halfpipe    freda psychiat    RUNNING    3:35:22     4      1         srvcnthpc122   normal     6762     14:22:16
77  1408658_315       ada           halfpipe    freda psychiat    RUNNING    3:32:52     4      1         srvcnthpc122   normal     6764     14:12:16
78  1408658_316       ada           halfpipe    freda psychiat    RUNNING    3:27:22     4      1         srvcnthpc126   normal     6765     13:50:16
79  1408658_317       ada           halfpipe    freda psychiat    RUNNING    3:19:21     4      1         srvcnthpc101   normal     6767     13:18:12
80  1408658_318       ada           halfpipe    freda psychiat    RUNNING    3:17:51     4      1         srvcnthpc126   normal     6767     13:12:12
81  1408658_319       ada           halfpipe    freda psychiat    RUNNING    3:14:20     4      1         srvcnthpc105   normal     6769     12:58:12
82  1408658_320       ada           halfpipe    freda psychiat    RUNNING    3:14:20     4      1         srvcnthpc105   normal     6769     12:58:12
83  1408658_321       ada           halfpipe    freda psychiat    RUNNING    3:13:20     4      1         srvcnthpc101   normal     6769     12:54:12
84  1408658_322       ada           halfpipe    freda psychiat    RUNNING    3:10:50     4      1         srvcnthpc126   normal     6769     12:44:12
85  1408658_323       ada           halfpipe    freda psychiat    RUNNING    2:54:49     4      1         srvcnthpc121   normal     6773     11:40:08
86  1408658_324       ada           halfpipe    freda psychiat    RUNNING    2:54:49     4      1         srvcnthpc121   normal     6773     11:40:08
87  1408658_325       ada           halfpipe    freda psychiat    RUNNING    2:54:49     4      1         srvcnthpc121   normal     6773     11:40:08
88  1408658_326       ada           halfpipe    freda psychiat    RUNNING    2:54:49     4      1         srvcnthpc121   normal     6773     11:40:12
89  1408658_327       ada           halfpipe    freda psychiat    RUNNING    2:54:49     4      1         srvcnthpc121   normal     6773     11:40:12
90  1408658_328       ada           halfpipe    freda psychiat    RUNNING    2:50:49     4      1         srvcnthpc101   normal     6773     11:24:12
91  1408658_329       ada           halfpipe    freda psychiat    RUNNING    2:47:18     4      1         srvcnthpc110   normal     6775     11:10:08
92  1408658_330       ada           halfpipe    freda psychiat    RUNNING    2:43:18     4      1         srvcnthpc126   normal     6776     10:54:08
93  1408658_331       ada           halfpipe    freda psychiat    RUNNING    2:43:18     4      1         srvcnthpc126   normal     6776     10:54:08

CLUSTER STATUS

PARTITION    AVAIL  TIMELIMIT  NODES  STATE NODELIST
 ada*            up 29-04:00:0      2    mix srvcnthpc[105,126]
 ada*            up 29-04:00:0     23  alloc srvcnthpc[100-104,106-122,125]
 swan            up 1-00:00:00      2  alloc srvcnthpc[121-122]
 sadacc-short    up   12:00:00      8   idle srvcnthpc[127-134]
 sadacc-long     up 32-02:00:0      8   idle srvcnthpc[127-134]
 gpuo            up 41-16:00:0      1  down* srvcntgpu003
 gpuo            up 41-16:00:0      1    mix srvcntgpu004
 gpuo            up 41-16:00:0      2   idle srvcntgpu[001-002]
 gpumk           up 41-16:00:0      4   idle srvcntgpu[005-008]
 gpumka          up 41-16:00:0      4   idle srvcntgpu[005-008]
 curie           up 31-06:00:0      8   idle srvcnthpc[600-607]
 grace           up 31-06:00:0      1  alloc srvcnthpc801
 grace           up 31-06:00:0      1   idle srvcnthpc802
 a100            up 12-12:00:0      1    mix srvcntgpu009
 a100            up 12-12:00:0      1   idle srvcntgpu010

PartitionName=ada
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=YES QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=29-04:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[100-122,125,126]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=1000 TotalNodes=25 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9000 MaxMemPerCPU=9000
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=swan
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=1-00:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[121-122]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=80 TotalNodes=2 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9000 MaxMemPerCPU=9000
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=sadacc-short
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=12:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[127-134]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=352 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=sadacc-long
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=32-02:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[127-134]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=352 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=8000 MaxMemPerCPU=8000
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=gpuo
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=41-16:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcntgpu[001-004]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=60 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=4000 MaxMemPerCPU=8000
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 
 PartitionName=gpumk
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=41-16:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcntgpu[005-008]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=128 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=4000 MaxMemPerCPU=4000
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 
 PartitionName=gpumka
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=41-16:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcntgpu[005-008]
    PriorityJobFactor=30 PriorityTier=30 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=128 TotalNodes=4 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=4000 MaxMemPerCPU=4000
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0
 
 PartitionName=curie
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=31-06:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[600-607]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=512 TotalNodes=8 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=2000 MaxMemPerCPU=2000
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=grace
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=31-06:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcnthpc[801,802]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=48 TotalNodes=2 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=42000 MaxMemPerCPU=42000
    TRESBillingWeights=CPU=1.0,Mem=0.1G
 
 PartitionName=a100
    AllowGroups=ALL AllowAccounts=ALL AllowQos=ALL
    AllocNodes=ALL Default=NO QoS=N/A
    DefaultTime=NONE DisableRootJobs=NO ExclusiveUser=NO GraceTime=0 Hidden=NO
    MaxNodes=UNLIMITED MaxTime=12-12:00:00 MinNodes=0 LLN=NO MaxCPUsPerNode=UNLIMITED
    Nodes=srvcntgpu[009,010]
    PriorityJobFactor=20 PriorityTier=20 RootOnly=NO ReqResv=NO OverSubscribe=NO
    OverTimeLimit=NONE PreemptMode=OFF
    State=UP TotalCPUs=112 TotalNodes=2 SelectTypeParameters=NONE
    JobDefaults=(null)
    DefMemPerCPU=9142 MaxMemPerCPU=9142
    TRESBillingWeights=CPU=1.0,Mem=0.1G,GRES/gpu=1.0

WORKER NODE STATUS

NodeName=srvcnthpc100 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc100 NodeHostName=srvcnthpc100 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=358478 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-09T14:39:46 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408638 ada 4g UnPre omrmuh00 R 

NodeName=srvcnthpc101 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=8.15
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc101 NodeHostName=srvcnthpc101 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=326304 FreeMem=274925 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-02-03T11:17:45 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=326304M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408806 ada VMSI_GNS ahmad.de R 46:43 srvcnthpc[101,105,116,122]
      1407809 ada DetectMo rtyfra00 R 5-16:32:11 srvcnthpc101
      1408658_328 ada halfpipe freda R 2:51:04 srvcnthpc101
      1408658_321 ada halfpipe freda R 3:13:35 srvcnthpc101
      1408658_317 ada halfpipe freda R 3:19:36 srvcnthpc101
      1408790 ada blvm62 fmlmar00 R 1:39:59 srvcnthpc101
      1408815 ada run16.mo t0079876 R 46:26 srvcnthpc101
      1408816 ada run17.mo t0079876 R 46:26 srvcnthpc101

NodeName=srvcnthpc102 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=17.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc102 NodeHostName=srvcnthpc102 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=362176 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-26T12:46:16 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408277 ada Srd.b7e2 ngmpac00 R 19:14:11 srvcnthpc[102,113,117]

NodeName=srvcnthpc103 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.58
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc103 NodeHostName=srvcnthpc103 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=359746 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-07-27T09:41:16 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408550 ada cyl iklray00 R 22:49:23 srvcnthpc103

NodeName=srvcnthpc104 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=9.80
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc104 NodeHostName=srvcnthpc104 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=353418 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-07-26T10:35:49 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1407648 ada rtb_stoo oknjav00 R 1-14:36:01 srvcnthpc104

NodeName=srvcnthpc105 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=36 CPUTot=40 CPULoad=24.61
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc105 NodeHostName=srvcnthpc105 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=301536 FreeMem=358333 Sockets=2 Boards=1
   State=MIXED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-28T11:50:30 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=36,mem=301536M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408806 ada VMSI_GNS ahmad.de R 46:43 srvcnthpc[101,105,116,122]
      1408643 ada 29pyr-fs wlstay00 R 3:15:11 srvcnthpc[105,121]
      1408658_319 ada halfpipe freda R 3:14:35 srvcnthpc105
      1408658_320 ada halfpipe freda R 3:14:35 srvcnthpc105

NodeName=srvcnthpc106 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.11
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc106 NodeHostName=srvcnthpc106 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=364736 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-12T22:05:28 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408642 ada 28pyr-fs wlstay00 R 4:56:55 srvcnthpc[106,116]
      1408638 ada 4g UnPre omrmuh00 R 

NodeName=srvcnthpc107 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.15
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc107 NodeHostName=srvcnthpc107 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=347753 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-12T22:13:02 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408136 ada TS3D202 tvanheer R 53:31 srvcnthpc[107-108,112]

NodeName=srvcnthpc108 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.05
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc108 NodeHostName=srvcnthpc108 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=347419 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-26T22:47:12 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408136 ada TS3D202 tvanheer R 53:31 srvcnthpc[107-108,112]

NodeName=srvcnthpc109 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.61
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc109 NodeHostName=srvcnthpc109 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=364481 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-27T12:29:08 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408620 ada cyl iklray00 R 9:08:20 srvcnthpc109

NodeName=srvcnthpc110 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=52.20
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc110 NodeHostName=srvcnthpc110 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=348768 FreeMem=224494 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-27T12:29:57 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=348768M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1407926 ada 1g Petur wrgmic01 R 
      1408658_329 ada halfpipe freda R 2:47:33 srvcnthpc110
      1408464_5 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_6 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_7 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_8 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_9 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_10 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_11 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_12 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_13 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_14 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_15 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_16 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_17 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_18 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_19 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110
      1408464_20 ada BiModelM wttoli00 R 1-09:26:26 srvcnthpc110

NodeName=srvcnthpc111 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=74.39
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc111 NodeHostName=srvcnthpc111 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=365468 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-02-20T14:11:21 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1407926 ada 1g Petur wrgmic01 R 

NodeName=srvcnthpc112 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.14
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc112 NodeHostName=srvcnthpc112 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=345712 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-12T22:13:43 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408136 ada TS3D202 tvanheer R 53:31 srvcnthpc[107-108,112]

NodeName=srvcnthpc113 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=20.26
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc113 NodeHostName=srvcnthpc113 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=360458 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-28T15:08:32 SlurmdStartTime=2022-06-26T14:01:47
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408277 ada Srd.b7e2 ngmpac00 R 19:14:11 srvcnthpc[102,113,117]

NodeName=srvcnthpc114 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=1.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc114 NodeHostName=srvcnthpc114 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=371213 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-15T12:02:33 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408106 ada cdhit-80 khnfar02 R 3-08:30:50 srvcnthpc114

NodeName=srvcnthpc115 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=10.34
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc115 NodeHostName=srvcnthpc115 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=290816 FreeMem=371910 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-11-03T11:43:19 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=284G
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408618 ada Coregist ymbale00 R 16:02:18 srvcnthpc115

NodeName=srvcnthpc116 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=24.26
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc116 NodeHostName=srvcnthpc116 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=368079 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-30T16:43:30 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408806 ada VMSI_GNS ahmad.de R 46:43 srvcnthpc[101,105,116,122]
      1408642 ada 28pyr-fs wlstay00 R 4:56:55 srvcnthpc[106,116]

NodeName=srvcnthpc117 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=18.05
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc117 NodeHostName=srvcnthpc117 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=357661 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-15T12:01:39 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408277 ada Srd.b7e2 ngmpac00 R 19:14:11 srvcnthpc[102,113,117]

NodeName=srvcnthpc118 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=40.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc118 NodeHostName=srvcnthpc118 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=342645 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-26T15:26:20 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408692 ada opt_HCO_ rgxyat00 R 1:30:52 srvcnthpc118

NodeName=srvcnthpc119 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=18.33
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc119 NodeHostName=srvcnthpc119 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=229232 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-06-27T00:27:32 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1407630 ada LTB_stoo oknjav00 R 6-08:09:38 srvcnthpc119

NodeName=srvcnthpc120 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=11.57
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc120 NodeHostName=srvcnthpc120 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=114487 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-03-14T21:20:56 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1407645 ada sim_stoo oknjav00 R 3-06:50:35 srvcnthpc120

NodeName=srvcnthpc121 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=29.85
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc121 NodeHostName=srvcnthpc121 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=303840 FreeMem=347785 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2021-06-26T14:35:00 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=303840M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408643 ada 29pyr-fs wlstay00 R 3:15:11 srvcnthpc[105,121]
      1408658_323 ada halfpipe freda R 2:55:04 srvcnthpc121
      1408658_324 ada halfpipe freda R 2:55:04 srvcnthpc121
      1408658_325 ada halfpipe freda R 2:55:04 srvcnthpc121
      1408658_326 ada halfpipe freda R 2:55:04 srvcnthpc121
      1408658_327 ada halfpipe freda R 2:55:04 srvcnthpc121

NodeName=srvcnthpc122 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=3.42
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc122 NodeHostName=srvcnthpc122 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=58826 FreeMem=303456 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada,swan 
   BootTime=2021-06-26T13:14:04 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=58826M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408806 ada VMSI_GNS ahmad.de R 46:43 srvcnthpc[101,105,116,122]
      1408658_315 ada halfpipe freda R 3:33:07 srvcnthpc122
      1408658_314 ada halfpipe freda R 3:35:37 srvcnthpc122
      1408592 ada DA_Test_ nbnnic00 R 1-00:19:41 srvcnthpc122

NodeName=srvcnthpc125 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=40 CPUTot=40 CPULoad=1.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc125 NodeHostName=srvcnthpc125 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=360000 FreeMem=370331 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2021-08-07T00:11:40 SlurmdStartTime=2022-07-01T15:35:39
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=40,mem=360000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408107 ada cdhit-85 khnfar02 R 3-08:30:50 srvcnthpc125

NodeName=srvcnthpc126 Arch=x86_64 CoresPerSocket=20 
   CPUAlloc=38 CPUTot=40 CPULoad=11.54
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc126 NodeHostName=srvcnthpc126 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=384000 AllocMem=263376 FreeMem=276007 Sockets=2 Boards=1
   State=MIXED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=ada 
   BootTime=2022-04-28T10:28:13 SlurmdStartTime=2022-06-26T14:08:34
   CfgTRES=cpu=40,mem=375G,billing=77
   AllocTRES=cpu=38,mem=263376M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408658_330 ada halfpipe freda R 2:43:34 srvcnthpc126
      1408658_331 ada halfpipe freda R 2:43:34 srvcnthpc126
      1408658_322 ada halfpipe freda R 3:11:06 srvcnthpc126
      1408658_318 ada halfpipe freda R 3:18:07 srvcnthpc126
      1408658_316 ada halfpipe freda R 3:27:38 srvcnthpc126
      1408658_313 ada halfpipe freda R 3:38:08 srvcnthpc126
      1408658_312 ada halfpipe freda R 3:43:20 srvcnthpc126
      1408742 ada blvm04 fmlmar00 R 2:55:05 srvcnthpc126
      1408796 ada blvm411 fmlmar00 R 1:40:00 srvcnthpc126
      1408810 ada execute t0079876 R 1:09:59 srvcnthpc126
      1408811 ada run11b.m t0079876 R 1:09:59 srvcnthpc126
      1408812 ada run15.mo t0079876 R 1:09:59 srvcnthpc126
      1408813 ada run11c.m t0079876 R 1:09:59 srvcnthpc126
      1408814 ada execute t0079876 R 1:09:59 srvcnthpc126
      1408807 ada execute t0079876 R 1:10:29 srvcnthpc126
      1408808 ada execute t0079876 R 1:10:29 srvcnthpc126
      1408809 ada execute t0079876 R 1:10:29 srvcnthpc126

NodeName=srvcnthpc127 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc127 NodeHostName=srvcnthpc127 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=378138 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-06-21T10:22:38 SlurmdStartTime=2022-06-26T14:28:18
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc128 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc128 NodeHostName=srvcnthpc128 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=378300 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-06-21T10:22:55 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc129 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc129 NodeHostName=srvcnthpc129 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=378316 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-06-21T10:22:37 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc130 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc130 NodeHostName=srvcnthpc130 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=378334 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-06-21T10:23:54 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc131 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc131 NodeHostName=srvcnthpc131 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=378322 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-06-21T10:21:54 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc132 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc132 NodeHostName=srvcnthpc132 Version=18.08
   OS=Linux 3.10.0-1160.24.1.el7.x86_64 #1 SMP Thu Apr 8 19:51:47 UTC 2021 
   RealMemory=384000 AllocMem=0 FreeMem=369958 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-06-21T10:23:59 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc133 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc133 NodeHostName=srvcnthpc133 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=375805 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-05-30T10:26:44 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc134 Arch=x86_64 CoresPerSocket=22 
   CPUAlloc=0 CPUTot=44 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc134 NodeHostName=srvcnthpc134 Version=18.08
   OS=Linux 3.10.0-1127.19.1.el7.x86_64 #1 SMP Tue Aug 25 17:23:54 UTC 2020 
   RealMemory=384000 AllocMem=0 FreeMem=375812 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=sadacc-short,sadacc-long 
   BootTime=2022-05-30T10:24:24 SlurmdStartTime=2022-06-26T14:17:15
   CfgTRES=cpu=44,mem=375G,billing=81
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu001 Arch=x86_64 CoresPerSocket=8 
   CPUAlloc=0 CPUTot=16 CPULoad=0.06
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:fermi:4
   NodeAddr=srvcntgpu001 NodeHostName=srvcntgpu001 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=64000 AllocMem=0 FreeMem=57036 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpuo 
   BootTime=2021-10-08T10:27:20 SlurmdStartTime=2022-06-26T14:22:24
   CfgTRES=cpu=16,mem=62.50G,billing=26,gres/gpu=4,gres/gpu:fermi=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu002 Arch=x86_64 CoresPerSocket=6 
   CPUAlloc=0 CPUTot=12 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:fermi:4
   NodeAddr=srvcntgpu002 NodeHostName=srvcntgpu002 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=64000 AllocMem=0 FreeMem=57760 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpuo 
   BootTime=2021-10-08T10:27:26 SlurmdStartTime=2022-06-26T14:22:24
   CfgTRES=cpu=12,mem=62.50G,billing=22,gres/gpu=4,gres/gpu:fermi=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu003 Arch=x86_64 CoresPerSocket=6 
   CPUAlloc=0 CPUTot=12 CPULoad=0.80
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:kepler:4
   NodeAddr=srvcntgpu003 NodeHostName=srvcntgpu003 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=114431 Sockets=2 Boards=1
   State=DOWN* ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpuo 
   BootTime=2022-06-30T20:08:49 SlurmdStartTime=2022-06-30T22:03:26
   CfgTRES=cpu=12,mem=125G,billing=28,gres/gpu=4,gres/gpu:kepler=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
   Reason=Not responding [slurm@2022-07-01T23:23:01]

NodeName=srvcntgpu004 Arch=x86_64 CoresPerSocket=10 
   CPUAlloc=6 CPUTot=20 CPULoad=1.82
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:kepler:2
   NodeAddr=srvcntgpu004 NodeHostName=srvcntgpu004 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=24000 FreeMem=88879 Sockets=2 Boards=1
   State=MIXED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpuo 
   BootTime=2021-10-08T10:32:57 SlurmdStartTime=2022-06-26T14:22:24
   CfgTRES=cpu=20,mem=125G,billing=34,gres/gpu=2,gres/gpu:kepler=2
   AllocTRES=cpu=6,mem=24000M,gres/gpu=2,gres/gpu:kepler=2
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408553 gpuo b1_syn_5 hnkmah00 R 1-03:47:20 srvcntgpu004
      1408551 gpuo vpe_r2 hnkmah00 R 1-04:12:06 srvcntgpu004

NodeName=srvcntgpu005 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=32 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvcntgpu005 NodeHostName=srvcntgpu005 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=128000 AllocMem=0 FreeMem=119901 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk,gpumka 
   BootTime=2021-07-02T10:23:48 SlurmdStartTime=2022-06-26T14:18:18
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu006 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=32 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvcntgpu006 NodeHostName=srvcntgpu006 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=128000 AllocMem=0 FreeMem=117493 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk,gpumka 
   BootTime=2021-07-02T18:11:33 SlurmdStartTime=2022-06-26T14:18:18
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu007 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=32 CPULoad=0.05
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvcntgpu007 NodeHostName=srvcntgpu007 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=128000 AllocMem=0 FreeMem=119805 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk,gpumka 
   BootTime=2021-06-29T00:48:50 SlurmdStartTime=2022-06-26T14:18:18
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu008 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=32 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:pascal:4
   NodeAddr=srvcntgpu008 NodeHostName=srvcntgpu008 Version=18.08
   OS=Linux 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 
   RealMemory=128000 AllocMem=0 FreeMem=119876 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=gpumk,gpumka 
   BootTime=2021-06-28T21:14:04 SlurmdStartTime=2022-06-26T14:18:18
   CfgTRES=cpu=32,mem=125G,billing=48,gres/gpu=4,gres/gpu:pascal=4
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcntgpu009 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=12 CPUTot=56 CPULoad=8.16
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:a100-4g-20gb:1,gpu:a100-2g-10gb:1,gpu:a100-1g-5gb:1,gpu:a100-3g-20gb:2,gpu:ampere:2
   NodeAddr=srvcntgpu009 NodeHostName=srvcntgpu009 Version=18.08
   OS=Linux 3.10.0-1160.36.2.el7.x86_64 #1 SMP Wed Jul 21 11:57:15 UTC 2021 
   RealMemory=512000 AllocMem=109704 FreeMem=373844 Sockets=2 Boards=1
   State=MIXED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2021-08-13T10:19:11 SlurmdStartTime=2022-06-26T14:18:18
   CfgTRES=cpu=56,mem=500G,billing=113,gres/gpu=7,gres/gpu:a100-1g-5gb=1,gres/gpu:a100-2g-10gb=1,gres/gpu:a100-3g-20gb=2,gres/gpu:a100-4g-20gb=1,gres/gpu:ampere=2
   AllocTRES=cpu=12,mem=109704M,gres/gpu=3,gres/gpu:a100-2g-10gb=1,gres/gpu:ampere=2
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408272 a100 vpe_real hnkmah00 R 2-20:34:56 srvcntgpu009
      1408697 a100 nmt ahmkha00 R 8:07:10 srvcntgpu009

NodeName=srvcntgpu010 Arch=x86_64 CoresPerSocket=28 
   CPUAlloc=0 CPUTot=56 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=gpu:a100-4g-20gb:1,gpu:a100-2g-10gb:1,gpu:a100-1g-5gb:1,gpu:a100-3g-20gb:2,gpu:ampere:2
   NodeAddr=srvcntgpu010 NodeHostName=srvcntgpu010 Version=18.08
   OS=Linux 3.10.0-1160.36.2.el7.x86_64 #1 SMP Wed Jul 21 11:57:15 UTC 2021 
   RealMemory=512000 AllocMem=0 FreeMem=453809 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=a100 
   BootTime=2021-08-02T12:24:30 SlurmdStartTime=2022-06-26T14:18:18
   CfgTRES=cpu=56,mem=500G,billing=113,gres/gpu=7,gres/gpu:a100-1g-5gb=1,gres/gpu:a100-2g-10gb=1,gres/gpu:a100-3g-20gb=2,gres/gpu:a100-4g-20gb=1,gres/gpu:ampere=2
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc600 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc600 NodeHostName=srvcnthpc600 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=120682 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-08T10:18:29 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc601 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc601 NodeHostName=srvcnthpc601 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=120586 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-11-19T14:54:12 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc602 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc602 NodeHostName=srvcnthpc602 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=115057 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-08T10:18:33 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc603 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.03
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc603 NodeHostName=srvcnthpc603 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=120157 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-27T12:15:11 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc604 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc604 NodeHostName=srvcnthpc604 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=118472 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-08T08:13:00 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc605 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.01
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc605 NodeHostName=srvcnthpc605 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=120427 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-08T10:18:37 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc606 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc606 NodeHostName=srvcnthpc606 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=120431 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-08T08:11:08 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc607 Arch=x86_64 CoresPerSocket=16 
   CPUAlloc=0 CPUTot=64 CPULoad=0.02
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc607 NodeHostName=srvcnthpc607 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=128000 AllocMem=0 FreeMem=120471 Sockets=4 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=curie 
   BootTime=2021-10-08T08:10:22 SlurmdStartTime=2022-06-26T14:16:45
   CfgTRES=cpu=64,mem=125G,billing=76
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s

NodeName=srvcnthpc801 Arch=x86_64 CoresPerSocket=12 
   CPUAlloc=24 CPUTot=24 CPULoad=24.04
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc801 NodeHostName=srvcnthpc801 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=1030000 AllocMem=1008000 FreeMem=940076 Sockets=2 Boards=1
   State=ALLOCATED ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=grace 
   BootTime=2021-10-08T08:38:33 SlurmdStartTime=2022-06-26T14:22:24
   CfgTRES=cpu=24,mem=1030000M,billing=124
   AllocTRES=cpu=24,mem=1008000M
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s
      1408674 grace Allen_su stychr00 R 8:58:52 srvcnthpc801

NodeName=srvcnthpc802 Arch=x86_64 CoresPerSocket=12 
   CPUAlloc=0 CPUTot=24 CPULoad=0.52
   AvailableFeatures=(null)
   ActiveFeatures=(null)
   Gres=(null)
   NodeAddr=srvcnthpc802 NodeHostName=srvcnthpc802 Version=18.08
   OS=Linux 3.10.0-514.el7.x86_64 #1 SMP Tue Nov 22 16:42:41 UTC 2016 
   RealMemory=1030000 AllocMem=0 FreeMem=1018994 Sockets=2 Boards=1
   State=IDLE ThreadsPerCore=1 TmpDisk=0 Weight=1 Owner=N/A MCS_label=N/A
   Partitions=grace 
   BootTime=2021-10-08T08:39:43 SlurmdStartTime=2022-06-26T14:22:24
   CfgTRES=cpu=24,mem=1030000M,billing=124
   AllocTRES=
   CapWatts=n/a
   CurrentWatts=0 LowestJoules=0 ConsumedJoules=0
   ExtSensorsJoules=n/s ExtSensorsWatts=0 ExtSensorsTemp=n/s