slurm_report_eight_weeks

−Table of Contents

CS SLURM Cluster Report - 8 weeks

CS SLURM Cluster Report - 8 weeks

Report generated for jobs run on the CS SLURM cluster from 2025-05-18 through 2025-07-12.

Job total during this query range: 712,064

Job total since August 1st 2024: 2,895,003

This page is updated every Sunday at 5:00pm EST.

SLURM Scheduler System Output

--------------------------------------------------------------------------------
Cluster Utilization 2025-05-18T00:00:00 - 2025-07-12T23:59:59
Usage reported in TRES Hours/Percentage of Total
--------------------------------------------------------------------------------
  Cluster      TRES Name              Allocated                  Down         PLND Down                     Idle            Planned                 Reported 
--------- -------------- ---------------------- --------------------- ----------------- ------------------------ ------------------ ------------------------ 
       cs            cpu          511775(9.49%)          25037(0.46%)          0(0.00%)          4598708(85.30%)      255855(4.75%)          5391376(99.94%) 
       cs            mem      2238850105(4.21%)      193913897(0.36%)         36(0.00%)      50758055508(95.43%)           0(0.00%)      53190819544(99.86%) 
       cs       gres/gpu          26726(10.83%)           1436(0.58%)          0(0.00%)           218562(88.59%)           0(0.00%)          246724(100.31%) 

* Total Cluster Resources Avaialble by Partition
 (Note, TRES is short for Trackable RESources)
PartitionName=cpu
   TRES=cpu=1626,mem=17790000M,node=41
   TRESBillingWeights=CPU=2.0,Mem=0.15
PartitionName=gpu
   TRES=cpu=1956,mem=22062000M,node=37,gres/gpu=142
   TRESBillingWeights=CPU=1.0,Mem=0.15,GRES/gpu=2.0
PartitionName=nolim
   TRES=cpu=226,mem=2528000M,node=7
   TRESBillingWeights=CPU=2.0,Mem=0.15
PartitionName=gnolim
   TRES=cpu=424,mem=2008000M,node=16,gres/gpu=48
   TRESBillingWeights=CPU=1.0,Mem=0.15,GRES/gpu=2.0

SLURM Usage by Partition

PartitionName	total_jobs	cputime(HH:MM:SS)	completed	cancelled	failed	timeout	out_of_memory	node_fail
cpu	704061	382032:56:29	425560	2441	275432	160	238	230
gpu	7067	124119:41:46	2315	1897	2732	80	41	2
gnolim	934	5556:13:40	102	386	437	0	9	0
nolim	2	00:00:00	2	0	0	0	0	0

SLURM Usage by Advisor Group

slurm-cs-undefined, users that have CS accounts but are not CS students
slurm-cs-unassigned, users that are CS students but do not have a listed CS advisor

GroupName	total_jobs	cputime(HH:MM:SS)	cpu	gpu	nolim	gnolim	completed	cancelled	failed	timeout	out_of_memory	node_fail
slurm-cs-hadi-daneshmand	670355	294201:12:52	670063	291	1	0	396065	1192	272710	28	131	229
slurm-cs-lu-feng	4644	68918:23:56	154	3634	0	856	516	1856	2198	33	41	0
slurm-cs-kevin-skadron	3202	34906:41:22	1989	1212	1	0	1407	95	1588	48	63	1
slurm-cs-ashish-venkat	21385	32528:45:33	21376	0	0	9	18880	990	1372	110	33	0
slurm-cs-tianhao-wang	274	31236:18:56	0	274	0	0	161	70	42	1	0	0
slurm-cs-unassigned	259	27132:53:00	168	91	0	0	182	21	41	1	14	0
slurm-cs-undefined	137	7676:11:40	0	137	0	0	57	22	54	1	1	2
slurm-cs-madhur-behl	897	6811:06:16	206	623	0	68	445	168	281	3	0	0
slurm-cs-yenling-kuo	9768	5688:27:54	9749	19	0	0	9531	152	85	0	0	0
slurm-cs-yangfeng-ji	383	853:23:54	0	383	0	0	136	117	118	7	5	0
slurm-cs-aidong-zhang	91	783:25:28	0	91	0	0	54	10	25	2	0	0
slurm-cs-sebastian-elbaum	295	764:36:56	0	294	0	1	199	26	68	2	0	0
slurm-cs-shangtong-zhang	342	133:45:04	334	8	0	0	329	2	8	3	0	0
slurm-cs-wajih-hassan	21	46:39:20	21	0	0	0	15	1	5	0	0	0
slurm-cs-zezhou-cheng	3	14:14:40	0	3	0	0	1	0	2	0	0	0
slurm-cs-xiaozhu-lin	1	07:01:14	0	1	0	0	0	0	1	0	0	0
slurm-cs-miaomiao-zhang	2	05:01:02	0	2	0	0	0	0	1	1	0	0
slurm-cs-yu-meng	2	00:41:04	0	2	0	0	0	1	1	0	0	0
slurm-cs-charles-reiss	1	00:00:54	1	0	0	0	0	1	0	0	0	0
slurm-cs-yue-cheng	1	00:00:50	0	1	0	0	1	0	0	0	0	0
slurm-cs-adwait-jog	1	00:00:00	0	1	0	0	0	0	1	0	0	0

SLURM Usage by NodeName

Nodename	total_jobs	cputime(HH:MM:SS)	completed	cancelled	failed	timeout	out_of_memory	node_fail
puma01	262798	98045:49:26	157040	381	105277	11	10	79
jaguar03	637	27777:56:22	101	244	288	3	1	0
cheetah04	330	26299:19:44	115	132	78	1	2	2
affogato04	58137	24805:21:24	25624	138	32331	3	26	15
affogato01	60948	24619:39:44	32968	123	27816	5	21	15
lynx08	51457	23803:00:12	30325	121	20958	3	20	30
lynx09	51510	23707:54:46	30294	114	21055	5	12	30
hydro	160	23010:28:02	75	28	40	16	0	1
affogato02	12860	15694:58:26	12175	121	541	3	20	0
affogato09	19778	11493:31:36	11646	56	8060	4	5	7
affogato10	19020	11475:52:06	11246	53	7711	3	0	7
affogato07	20602	11347:13:08	11807	62	8706	5	15	7
affogato06	20917	11315:56:04	11996	62	8846	0	6	7
affogato08	20009	11275:05:52	11704	56	8240	0	3	6
slurm3	8883	9146:48:36	6707	60	2090	8	18	0
bigcat01	8457	9004:55:40	5734	187	2494	15	17	10
lotus	237	8962:39:00	164	43	24	3	3	0
jaguar01	390	8172:36:54	194	104	89	2	1	0
jaguar04	252	7807:58:46	117	85	48	2	0	0
bigcat02	6875	7574:00:20	5018	135	1716	2	4	0
slurm5	12822	7372:39:50	8432	28	4357	0	4	1
cheetah01	488	6846:52:36	200	132	152	3	1	0
slurm4	6500	5613:57:28	4780	53	1659	3	5	0
panther01	1733	5121:02:06	1381	116	218	8	10	0
bigcat03	5511	5083:14:50	3623	90	1798	0	0	0
sds01	383	3969:45:40	85	146	150	1	1	0
cortado04	65	3873:26:00	57	2	1	5	0	0
bigcat04	3784	3856:58:42	2637	21	1125	0	1	0
slurm2	1896	3699:15:36	1545	70	262	13	6	0
lynx10	268	3579:02:52	102	72	90	0	4	0
sds02	354	3495:40:42	65	135	150	4	0	0
sdscpu01	9039	3466:10:12	5391	0	3633	0	0	15
serval07	86	3243:11:34	20	18	46	2	0	0
affogato11	335	3135:06:10	109	89	133	1	3	0
lynx11	312	3083:23:02	126	64	119	0	3	0
serval06	110	2659:54:10	24	24	55	5	2	0
bigcat05	2437	2651:09:48	1568	20	848	0	1	0
cortado01	3500	2619:46:16	3204	17	278	0	1	0
serval08	68	2400:41:50	21	23	24	0	0	0
jaguar02	660	2302:08:22	383	83	180	9	5	0
slurm1	1777	2030:49:13	1471	60	220	14	12	0
bigcat06	4423	1945:15:42	2428	16	1979	0	0	0
cortado02	3466	1890:29:08	3169	17	280	0	0	0
struct01	2435	1830:49:48	1806	14	610	3	2	0
affogato13	235	1761:41:58	24	82	122	4	3	0
cortado03	3031	1724:04:40	2786	13	232	0	0	0
serval09	144	1615:03:50	72	33	38	1	0	0
struct02	2003	1558:16:28	1503	10	487	3	0	0
affogato05	888	1513:23:44	738	43	92	5	10	0
affogato14	204	1461:47:22	17	68	114	1	4	0
affogato15	176	1399:23:48	21	53	100	1	1	0
struct03	1516	1353:49:52	1224	12	277	3	0	0
adriatic01	160	1183:12:12	17	50	89	4	0	0
jaguar05	176	1162:11:58	30	36	108	0	2	0
cortado07	16	1119:43:30	10	4	1	1	0	0
cortado08	3486	996:45:22	3431	1	53	0	1	0
adriatic02	135	970:13:30	6	46	79	4	0	0
ai01	164	966:37:34	12	75	75	0	2	0
jaguar06	191	958:37:24	67	31	80	11	2	0
cortado09	3262	951:49:52	3218	7	37	0	0	0
struct04	1052	946:26:22	853	12	181	3	3	0
cortado10	2780	917:28:40	2736	16	28	0	0	0
ai02	123	889:19:00	11	58	53	0	1	0
struct07	1134	861:34:44	759	14	359	2	0	0
struct05	840	815:33:40	695	10	132	3	0	0
jinx02	133	796:14:42	16	55	60	0	2	0
jinx01	138	782:16:26	20	55	61	0	2	0
affogato03	690	685:54:48	543	30	110	2	5	0
adriatic03	118	554:30:34	25	31	58	4	0	0
struct06	472	432:30:48	386	10	73	3	0	0
titanx04	66	420:03:02	7	29	30	0	0	0
titanx05	63	417:02:34	7	27	29	0	0	0
titanx03	61	411:17:38	7	26	27	0	1	0
titanx02	64	403:52:14	8	28	27	0	1	0
struct08	491	400:07:32	377	12	99	3	0	0
struct09	479	381:25:00	368	11	97	3	0	0
serval03	114	312:11:24	56	20	33	2	3	0
ai05	55	215:56:28	6	13	36	0	0	0
ai03	34	158:23:10	5	10	19	0	0	0
adriatic04	85	115:54:28	30	15	36	4	0	0
ai04	32	95:10:52	3	10	19	0	0	0
adriatic05	78	49:18:40	30	10	34	4	0	0
cheetah02	70	33:57:32	37	12	21	0	0	0
cheetah03	57	29:29:36	29	11	17	0	0	0
adriatic06	67	24:56:04	30	9	24	4	0	0
cortado05	74	09:14:58	70	4	0	0	0	0
cortado06	21	06:51:48	17	4	0	0	0	0
lynx01	34	04:29:44	0	3	30	0	1	0
lynx02	31	01:30:32	0	3	28	0	0	0
lynx03	30	01:28:40	0	3	27	0	0	0
lynx04	29	01:25:20	0	3	26	0	0	0
lynx05	23	01:10:24	0	3	20	0	0	0
lynx06	24	01:07:44	0	3	21	0	0	0
lynx07	15	00:46:48	0	3	12	0	0	0
epona	1	00:00:00	1	0	0	0	0	0
heartpiece	1	00:00:00	1	0	0	0	0	0
ai06	0	00:00:00	0	0	0	0	0	0
ai07	0	00:00:00	0	0	0	0	0	0
ai08	0	00:00:00	0	0	0	0	0	0
ai09	0	00:00:00	0	0	0	0	0	0
ai10	0	00:00:00	0	0	0	0	0	0