slurm_report

CS SLURM Cluster Report

Report generated for jobs run on the CS SLURM cluster from 2024-11-03 through 2024-11-09.

Jobs this week: 1,980

Job Total (since Aug. 1st): 607,152

SLURM Scheduler System Output

--------------------------------------------------------------------------------
Cluster Utilization 2024-11-03T00:00:00 - 2024-11-09T23:59:59
Usage reported in TRES Hours/Percentage of Total
--------------------------------------------------------------------------------
  Cluster      TRES Name              Allocated                 Down         PLND Down                    Idle           Planned                Reported 
--------- -------------- ---------------------- -------------------- ----------------- ----------------------- ----------------- ----------------------- 
       cs            cpu         121581(16.09%)          8079(1.07%)          0(0.00%)          606447(80.25%)      19557(2.59%)          755664(99.41%) 
       cs            mem      802193555(13.57%)      16735467(0.28%)          0(0.00%)      5090638979(86.14%)          0(0.00%)      5909568000(99.41%) 
       cs       gres/gpu          15306(44.01%)             0(0.00%)          0(0.00%)           19470(55.99%)          0(0.00%)           34776(99.41%) 

* Total Cluster Resources Avaialble by Partition
 (Note, TRES is short for Trackable RESources)
PartitionName=cpu
   TRES=cpu=1494,mem=12594000M,node=41
PartitionName=gpu
   TRES=cpu=2226,mem=19710000M,node=37,gres/gpu=159
PartitionName=nolim
   TRES=cpu=354,mem=864000M,node=7
PartitionName=gnolim
   TRES=cpu=424,mem=2008000M,node=16,gres/gpu=48

SLURM Usage by Partition

PartitionName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory
gpu	1081	84938:58:44	428	213	10	410	5	15
cpu	312	11508:28:23	242	24	0	38	0	8
gnolim	572	5753:01:44	154	156	2	259	0	1
nolim	15	39:43:26	10	1	0	3	0	1

SLURM Usage by Advisor Group

slurm-cs-undefined, users that have CS accounts but are not CS students
slurm-cs-unassigned, users that are CS students but do not have a listed CS advisor

GroupName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory
slurm-cs-tianhao-wang	99	34177:01:00	21	36	6	36	0	0
slurm-cs-zezhou-cheng	48	24789:24:46	8	16	0	24	0	0
slurm-cs-yu-meng	3	14529:56:32	1	0	2	0	0	0
slurm-cs-chen-yu-wei	191	10091:36:32	171	0	0	20	0	0
slurm-cs-lu-feng	672	6818:40:14	259	132	0	281	0	0
slurm-cs-hongning-wang	3	4145:15:44	1	0	1	0	1	0
slurm-cs-madhur-behl	23	1720:43:08	14	6	2	1	0	0
slurm-cs-farzad-farnoud	9	1651:31:12	4	3	0	1	0	1
slurm-cs-kevin-skadron	280	1343:53:56	189	31	0	56	3	1
slurm-cs-daniel-graham	43	995:10:34	29	7	0	7	0	0
slurm-cs-adwait-jog	41	542:39:39	12	7	0	6	0	16
slurm-cs-yen-ling-kuo	9	407:11:02	4	1	0	3	0	1
slurm-cs-shangtong-zhang	6	305:54:24	2	1	0	3	0	0
slurm-cs-ferdinando-fioretto	7	282:06:04	0	0	1	4	1	1
slurm-cs-sebastian-elbaum	92	207:30:38	29	0	0	61	0	2
slurm-cs-undefined	390	174:20:54	87	142	0	161	0	0
slurm-cs-geoffrey-fox	6	45:08:00	3	1	0	2	0	0
slurm-cs-mary-lou-soffa	58	12:07:58	0	11	0	44	0	3

SLURM Usage by NodeName

Nodename	total_jobs	cputime(HH:MM:SS)	completed	cancelled	running	failed	timeout	out_of_memory
cheetah06	48	24789:24:46	8	16	0	24	0	0
serval01	6	18675:12:16	2	0	3	0	1	0
jaguar01	7	5678:23:28	0	6	1	0	0	0
jaguar04	7	5463:36:00	0	6	1	0	0	0
cortado08	70	3895:28:58	61	0	0	9	0	0
cortado01	72	3849:43:02	65	0	0	7	0	0
jaguar03	44	3673:40:14	18	4	1	21	0	0
sds01	20	3084:40:54	4	8	0	8	0	0
sds02	24	2999:10:04	0	13	0	11	0	0
lotus	73	2987:49:14	21	18	1	30	0	3
puma02	25	2702:33:04	5	6	1	11	1	1
cheetah04	29	2535:29:24	19	6	1	2	0	1
bigcat01	39	1417:38:36	31	1	0	7	0	0
lynx08	37	1135:57:38	32	0	0	5	0	0
ai01	11	1083:12:16	1	6	0	4	0	0
lynx02	13	969:18:52	0	0	0	12	0	1
ai02	5	967:56:32	0	1	0	4	0	0
ai04	5	966:10:08	0	1	0	4	0	0
ai03	5	955:02:00	0	1	0	4	0	0
lynx01	6	915:53:10	1	0	0	5	0	0
jaguar02	60	913:35:44	19	9	0	31	1	0
jaguar05	44	905:53:36	25	6	0	12	0	1
cheetah02	36	841:26:28	11	4	0	19	0	2
cheetah01	31	822:46:24	13	8	0	10	0	0
lynx03	5	741:35:20	0	1	0	3	0	1
lynx04	5	721:55:58	0	0	0	3	0	2
ai05	71	681:21:48	21	25	0	25	0	0
affogato13	39	533:25:42	9	10	0	20	0	0
affogato11	40	520:59:00	8	10	0	21	0	1
affogato14	32	518:24:52	8	10	0	14	0	0
puma01	16	469:43:28	13	3	0	0	0	0
affogato15	28	466:06:38	8	8	0	12	0	0
lynx05	8	420:58:38	1	2	1	4	0	0
jaguar06	47	420:44:08	10	6	0	31	0	0
adriatic01	32	363:50:12	21	4	0	7	0	0
ai06	57	355:36:50	17	17	0	23	0	0
adriatic03	28	306:53:22	20	4	0	4	0	0
panther01	39	299:05:38	28	7	0	3	0	1
adriatic02	29	293:01:14	21	4	0	4	0	0
ai07	28	290:41:06	12	0	1	15	0	0
ai08	19	289:41:40	10	2	1	6	0	0
affogato04	2	243:10:30	1	1	0	0	0	0
cheetah05	167	225:03:10	135	15	0	15	2	0
cheetah03	24	201:44:58	10	3	0	11	0	0
adriatic04	20	194:05:42	13	4	0	3	0	0
lynx12	17	189:01:48	0	4	0	13	0	0
lynx11	17	188:26:00	0	4	0	13	0	0
lynx10	17	187:30:50	0	4	0	13	0	0
lynx06	11	148:16:36	1	5	0	4	0	1
lynx07	9	140:55:32	0	4	0	4	0	1
adriatic05	10	103:12:22	9	1	0	0	0	0
adriatic06	13	93:53:04	8	0	0	5	0	0
slurm1	4	75:59:29	1	1	0	0	0	2
ai09	46	58:46:42	14	16	0	16	0	0
slurm4	2	45:32:44	0	1	0	0	0	1
titanx04	26	28:07:46	11	8	0	7	0	0
affogato10	2	26:21:56	0	1	0	0	0	1
heartpiece	4	23:08:30	2	1	0	0	0	1
titanx03	38	19:02:40	8	8	0	22	0	0
slurm2	9	18:51:50	3	5	0	0	0	1
titanx05	36	16:51:08	10	8	0	18	0	0
doppio03	1	16:30:48	1	0	0	0	0	0
hydro	3	14:28:16	3	0	0	0	0	0
jinx01	60	11:37:28	13	19	0	28	0	0
jinx02	60	11:09:02	13	16	0	31	0	0
ai10	49	10:52:52	16	16	0	17	0	0
titanx02	47	06:51:46	8	8	0	30	0	1
cortado09	2	05:18:58	2	0	0	0	0	0
struct08	3	05:15:30	0	3	0	0	0	0
cortado10	2	03:10:36	0	1	0	0	0	1
slurm5	1	02:41:12	0	0	0	0	0	1
doppio04	1	00:03:36	0	0	0	1	0	0
epona	6	00:00:30	6	0	0	0	0	0
affogato02	1	00:00:02	1	0	0	0	0	0
doppio05	1	00:00:02	1	0	0	0	0	0
struct02	1	00:00:00	1	0	0	0	0	0
cortado03	1	00:00:00	0	0	0	1	0	0
cortado05	1	00:00:00	0	0	0	1	0	0
cortado07	1	00:00:00	0	0	0	1	0	0
affogato01	0	00:00:00	0	0	0	0	0	0
affogato03	0	00:00:00	0	0	0	0	0	0
affogato05	0	00:00:00	0	0	0	0	0	0
affogato06	0	00:00:00	0	0	0	0	0	0
affogato07	0	00:00:00	0	0	0	0	0	0
affogato08	0	00:00:00	0	0	0	0	0	0
affogato09	0	00:00:00	0	0	0	0	0	0
cortado02	0	00:00:00	0	0	0	0	0	0
cortado04	0	00:00:00	0	0	0	0	0	0
cortado06	0	00:00:00	0	0	0	0	0	0
doppio01	0	00:00:00	0	0	0	0	0	0
doppio02	0	00:00:00	0	0	0	0	0	0
lynx09	0	00:00:00	0	0	0	0	0	0
slurm3	0	00:00:00	0	0	0	0	0	0
struct01	0	00:00:00	0	0	0	0	0	0
struct03	0	00:00:00	0	0	0	0	0	0
struct04	0	00:00:00	0	0	0	0	0	0
struct05	0	00:00:00	0	0	0	0	0	0
struct06	0	00:00:00	0	0	0	0	0	0
struct07	0	00:00:00	0	0	0	0	0	0
struct09	0	00:00:00	0	0	0	0	0	0
struct10	0	00:00:00	0	0	0	0	0	0

Table of Contents

CS SLURM Cluster Report

SLURM Scheduler System Output

SLURM Usage by Partition

SLURM Usage by Advisor Group

SLURM Usage by NodeName