slurm_report_eight

−Table of Contents

CS SLURM Cluster Report - 8 weeks

CS SLURM Cluster Report - 8 weeks

Report generated for jobs run on the CS SLURM cluster from 2025-03-09 through 2025-05-03.

Job total during this query range: 395,302

Job total since August 1st 2024: 2,071,767

This page is updated every Sunday at 5:00pm EST.

SLURM Scheduler System Output

--------------------------------------------------------------------------------
Cluster Utilization 2025-03-09T00:00:00 - 2025-05-03T23:59:59
Usage reported in TRES Hours/Percentage of Total
--------------------------------------------------------------------------------
  Cluster      TRES Name               Allocated                  Down         PLND Down                     Idle             Planned                 Reported 
--------- -------------- ----------------------- --------------------- ----------------- ------------------------ ------------------- ------------------------ 
       cs            cpu          781844(14.62%)          39773(0.74%)          0(0.00%)          3322370(62.12%)     1204719(22.52%)         5348705(100.02%) 
       cs            mem      6594580344(12.81%)      270052078(0.52%)          0(0.00%)      44600645427(86.66%)            0(0.00%)     51465277849(100.00%) 
       cs       gres/gpu           61773(24.75%)           2413(0.97%)          0(0.00%)           185371(74.28%)            0(0.00%)          249557(100.44%) 

* Total Cluster Resources Avaialble by Partition
 (Note, TRES is short for Trackable RESources)
PartitionName=cpu
   TRES=cpu=1778,mem=19966000M,node=45
   TRESBillingWeights=CPU=2.0,Mem=0.15
PartitionName=gpu
   TRES=cpu=1708,mem=16062000M,node=33,gres/gpu=134
   TRESBillingWeights=CPU=1.0,Mem=0.15,GRES/gpu=2.0
PartitionName=nolim
   TRES=cpu=44,mem=224000M,node=2
   TRESBillingWeights=CPU=2.0,Mem=0.15
PartitionName=gnolim
   TRES=cpu=424,mem=2008000M,node=16,gres/gpu=48
   TRESBillingWeights=CPU=1.0,Mem=0.15,GRES/gpu=2.0

SLURM Usage by Partition

PartitionName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	failed	requeued	timeout	out_of_memory	node_fail
cpu	360435	501053:42:16	321487	15061	20768	0	1277	1666	176
gpu	30931	242348:32:04	15378	6101	8592	1	788	57	14
gnolim	3751	23878:22:50	2032	1144	532	0	13	26	4
nolim	185	3389:35:26	138	42	5	0	0	0	0

SLURM Usage by Advisor Group

slurm-cs-undefined, users that have CS accounts but are not CS students
slurm-cs-unassigned, users that are CS students but do not have a listed CS advisor

GroupName	total_jobs	cputime(HH:MM:SS)	cpu	gpu	nolim	gnolim	completed	cancelled	failed	requeued	timeout	out_of_memory	node_fail
slurm-cs-chen-yu-wei	184934	225721:15:12	179689	5245	0	0	179215	336	5125	0	68	0	190
slurm-cs-kevin-skadron	4519	104489:11:15	2607	1912	0	0	2468	482	1483	0	66	20	0
slurm-cs-undefined	166868	99574:08:55	166780	85	0	3	133348	13419	17308	0	1139	1654	0
slurm-cs-madhur-behl	7871	75580:57:32	266	6477	179	949	2347	4725	659	1	139	0	0
slurm-cs-ashish-venkat	89	64547:56:50	65	24	0	0	45	7	36	0	1	0	0
slurm-cs-haiying-shen	6639	57338:43:48	2891	3748	0	0	6295	296	46	0	2	0	0
slurm-cs-lu-feng	15030	46250:38:42	1361	11275	0	2394	8095	2143	4267	0	525	0	0
slurm-cs-tianhao-wang	228	26435:02:40	0	228	0	0	112	80	35	0	0	1	0
slurm-cs-shangtong-zhang	656	15327:04:36	635	15	0	6	593	40	21	0	2	0	0
slurm-cs-yen-ling-kuo	5787	13038:15:18	5454	333	0	0	5134	490	135	0	26	2	0
slurm-cs-yixin-sun	43	7770:46:20	1	42	0	0	5	22	8	0	6	2	0
slurm-cs-derrick-stone	99	6745:12:58	22	77	0	0	36	27	34	0	0	2	0
slurm-cs-panagiotis-apostolellis	19	5951:34:02	19	0	0	0	14	2	1	0	1	1	0
slurm-cs-sebastian-elbaum	852	4685:02:12	510	332	0	10	593	35	192	0	16	16	0
slurm-cs-charles-reiss	75	4556:03:58	65	4	6	0	30	2	7	0	36	0	0
slurm-cs-adwait-jog	354	3204:27:14	0	0	0	354	140	71	103	0	10	26	4
slurm-cs-unassigned	17	2738:41:10	0	17	0	0	9	4	4	0	0	0	0
slurm-cs-farzad-farnoud	493	2189:43:38	38	455	0	0	240	26	196	0	9	22	0
slurm-cs-mary-lou-soffa	326	1287:36:04	0	326	0	0	128	122	74	0	2	0	0
slurm-cs-wajih-hassan	47	1215:34:28	0	47	0	0	11	5	30	0	1	0	0
slurm-cs-aidong-zhang	120	746:49:34	4	116	0	0	73	9	32	0	6	0	0
slurm-cs-hongning-wang	2	537:01:20	0	2	0	0	2	0	0	0	0	0	0
slurm-cs-yangfeng-ji	8	215:04:28	0	8	0	0	2	0	3	0	2	1	0
slurm-cs-xiaozhu-lin	120	208:57:50	0	120	0	0	58	1	57	0	4	0	0
slurm-cs-rich-nguyen	35	156:40:18	0	0	0	35	15	2	18	0	0	0	0
slurm-cs-chen-chen	29	66:22:32	0	29	0	0	10	1	6	0	11	1	0
slurm-cs-daniel-graham	12	42:46:34	8	4	0	0	7	1	1	0	3	0	0
slurm-cs-john-hott	5	20:52:10	5	0	0	0	0	0	5	0	0	0	0
slurm-cs-zezhou-cheng	2	12:41:40	1	1	0	0	1	0	0	0	1	0	0
slurm-cs-briana-morrison	13	09:00:26	13	0	0	0	9	0	4	0	0	0	0
slurm-cs-judy-fox	7	05:58:40	1	6	0	0	0	0	4	0	2	1	0
slurm-cs-ferdinando-fioretto	3	00:00:12	0	3	0	0	0	0	3	0	0	0	0

SLURM Usage by NodeName

Nodename	total_jobs	cputime(HH:MM:SS)	completed	cancelled	failed	requeued	timeout	out_of_memory	node_fail
puma01	111	53160:09:02	58	25	14	0	14	0	0
cheetah04	656	52541:01:58	324	107	184	0	30	11	0
affogato02	20286	25424:58:10	20061	73	104	0	17	0	31
cortado01	18033	25418:22:32	17440	195	337	0	34	13	14
cortado02	28463	25416:04:34	22294	2586	3423	0	68	73	19
cortado03	27732	24701:43:06	22128	2306	3120	0	58	99	21
affogato04	19572	23525:00:42	19270	29	237	0	22	0	14
lynx08	21940	23298:00:00	21631	72	203	0	18	1	15
bigcat01	3870	22409:48:24	3193	188	441	0	14	34	0
lynx09	21240	22216:55:20	20992	61	154	0	19	0	14
jaguar03	1813	18579:37:16	1178	244	357	0	15	19	0
affogato01	17844	16674:57:14	17605	46	171	0	8	0	14
bigcat02	3107	14854:02:28	2695	195	175	0	19	23	0
hydro	6001	14693:11:42	5090	105	784	0	17	5	0
slurm3	15217	14682:34:38	12516	433	2136	0	64	68	0
slurm4	10424	13227:49:16	9205	188	919	0	63	49	0
cortado05	7092	12731:23:08	6373	305	277	0	57	80	0
lotus	1014	12440:16:40	595	265	141	0	11	2	0
affogato08	9401	11071:31:24	9305	24	48	0	16	1	7
affogato09	9438	10953:48:06	9289	25	108	0	8	1	7
affogato06	9370	10936:19:48	9272	25	55	0	10	1	7
affogato10	9398	10931:44:38	9277	17	90	0	7	1	6
slurm2	10770	10890:32:08	7583	1268	1799	0	62	58	0
affogato07	9431	10819:57:38	9260	38	111	0	14	1	7
lynx11	1447	9935:56:18	547	172	719	0	5	0	4
bigcat03	6858	9870:01:12	5420	716	532	0	60	130	0
cortado06	5056	9849:59:48	4278	306	347	0	42	83	0
cortado08	3752	9272:06:28	3121	296	223	0	47	65	0
jaguar01	465	9074:27:34	258	155	45	0	3	4	0
cortado07	4257	8821:25:48	3700	266	160	0	44	87	0
affogato11	1416	8511:18:04	644	366	378	0	25	0	3
cheetah01	717	8232:34:16	430	95	178	0	13	1	0
affogato13	1177	8046:14:32	617	352	181	0	26	0	1
cortado09	4230	7895:53:52	3738	296	112	0	33	51	0
lynx10	695	7735:46:58	438	125	123	0	6	0	3
jaguar04	131	7418:26:52	67	41	22	1	0	0	0
adriatic01	1466	7416:32:00	867	274	260	0	65	0	0
bigcat06	6814	7273:20:18	5227	889	469	0	64	165	0
cortado10	5712	7203:58:40	5043	306	263	0	38	62	0
bigcat04	7785	7011:46:34	6006	731	790	0	69	189	0
affogato14	1363	6954:12:56	591	320	425	0	22	5	0
bigcat05	6419	6718:05:06	5241	513	401	0	64	200	0
affogato15	1568	6684:35:40	580	311	643	0	30	4	0
cortado04	156	6638:44:40	129	24	1	0	2	0	0
adriatic02	1384	5836:57:10	822	303	199	0	60	0	0
slurm1	14599	5812:45:28	10367	2095	2016	0	71	50	0
panther01	3963	5303:40:24	3461	112	363	0	15	12	0
adriatic03	969	5260:55:40	501	251	147	0	70	0	0
sds01	1092	5233:41:46	642	140	249	0	61	0	0
jaguar02	2006	5175:45:12	1386	353	249	0	15	3	0
adriatic04	920	5107:20:06	485	236	133	0	66	0	0
sds02	1015	4984:24:48	607	140	221	0	47	0	0
jaguar05	1195	4853:20:40	718	213	222	0	39	3	0
adriatic05	758	4385:02:52	401	201	97	0	59	0	0
jaguar06	774	4268:09:24	413	136	185	0	38	2	0
adriatic06	772	4096:49:56	417	237	78	0	40	0	0
cheetah02	684	4072:40:40	367	139	172	0	6	0	0
jinx01	335	3792:44:50	92	191	47	0	1	3	1
jinx02	423	3749:39:18	161	199	53	0	5	4	1
cheetah03	548	3318:23:06	290	158	97	0	3	0	0
ai01	521	3018:58:48	269	198	54	0	0	0	0
heartpiece	179	2614:38:24	138	36	5	0	0	0	0
titanx02	295	2519:23:44	134	107	39	0	4	10	1
lynx01	1146	2505:29:58	121	123	897	0	5	0	0
affogato05	2180	2188:20:18	2030	36	81	0	27	6	0
titanx03	279	2088:46:04	128	102	43	0	0	5	1
lynx02	215	1995:44:56	85	107	18	0	5	0	0
lynx03	892	1968:44:26	77	93	720	0	2	0	0
lynx04	580	1893:46:00	64	83	430	0	3	0	0
titanx04	244	1627:39:38	118	93	32	0	1	0	0
lynx05	189	1611:58:22	55	68	64	0	2	0	0
ai05	352	1590:40:02	248	34	66	0	2	2	0
serval03	433	1585:29:32	213	33	178	0	7	2	0
ai02	363	1572:15:28	243	87	33	0	0	0	0
slurm5	1216	1479:08:42	1108	15	91	0	2	0	0
lynx07	169	1470:27:10	50	60	57	0	2	0	0
lynx06	166	1408:54:02	52	52	60	0	2	0	0
struct01	1338	1354:52:46	1280	39	8	0	5	6	0
ai03	309	1099:22:06	227	44	38	0	0	0	0
struct02	1198	1061:50:24	1092	40	45	0	10	11	0
affogato03	1086	885:40:34	994	25	54	0	12	1	0
ai04	292	823:05:32	213	37	42	0	0	0	0
struct03	943	815:38:30	884	37	7	0	8	7	0
struct04	873	784:09:12	802	37	6	0	13	15	0
epona	6	774:57:02	0	6	0	0	0	0	0
struct05	954	774:35:30	835	34	58	0	9	18	0
ai09	42	633:53:08	27	4	11	0	0	0	0
ai10	66	607:41:56	38	3	25	0	0	0	0
struct08	583	548:28:46	560	12	5	0	6	0	0
struct07	577	520:40:36	554	11	5	0	7	0	0
struct06	593	515:38:38	568	12	5	0	8	0	0
struct09	542	467:58:44	516	9	5	0	12	0	0
ai07	28	238:00:20	9	13	5	0	0	1	0
ai08	57	220:58:48	26	11	19	0	0	1	0
titanx05	130	213:42:36	94	11	25	0	0	0	0
ai06	11	81:30:32	5	6	0	0	0	0	0