Reply To: mysterious high CPU usage in HPC cluster

[Amine Ben Hadj Ali]

First of all running this kind of runs with single precision is a bad idea.
Second: you should keep track of memory usage of the case every couple of iterations using (proc-stats) and watch for excessive memory loading over time.
Third: Rough estimation for your case: you require a minimum of 75 GB RAM and even more for single precision: do all your 120 CPUS together offer that?