{"id":308054,"date":"2023-09-22T09:57:59","date_gmt":"2023-09-22T09:57:59","guid":{"rendered":"\/forum\/forums\/topic\/information-on-parallelization-performance\/"},"modified":"2023-09-22T09:57:59","modified_gmt":"2023-09-22T09:57:59","slug":"information-on-parallelization-performance","status":"closed","type":"topic","link":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/information-on-parallelization-performance\/","title":{"rendered":"Information on parallelization performance"},"content":{"rendered":"
Good morning,<\/div>\n
 <\/div>\n
I am running ANSYS Fluent CFD simulations on an HPC cluster.<\/div>\n
I am trying to simulate particle dispersion around a urban area, with a domain size of 10x10km, and 8M cells.<\/div>\n
This week I was ready to launch my final simulation in the cluster, but I have found an unexpected issue. <\/div>\n
For all the testing that I have been doing, I have been running my simulation on 4 nodes with 20 tasks per node.
Now, in order to obtain faster results for the real simulation, I wanted to increase the number of nodes to 8-12, but I just realised that when I increase this number, my simulation diverges and crashes after a few minutes.<\/div>\n
 <\/div>\n
I first thought that it could be a problem with the mesh of my simulation, but then I do not understand why the simulation with 4(x20) runs without problems (currently running for 10h, see attached residuals evolution). On the other hand, I have tried launching exactly the same simulation (copy-paste) with 5, 6, 7, 8, 10, 12 and 16(x20) nodes, and they all crash after ~ 200 iterations (see also attached a typical profile). Does this make sense? Am I missing something?<\/div>\n
 <\/div>\n
I tried finding some information online about such an issue but I didn’t manage to finde any explanation.<\/div>\n
Do you think it could be a parallelization issue? In that case, do you have any advice for me? Should I use more or less tasks per node when increasing my number of nodes?<\/div>\n
 <\/div>\n
Thank you very much in advance.<\/div>\n
 <\/div>\n
Details of my simulation: Transient, LES, double precision, PISO P-V coupling, Second Order Upwind mom, Second order pressure.<\/div>\n","protected":false},"template":"","class_list":["post-308054","topic","type-topic","status-closed","hentry","topic-tag-divergence-detected","topic-tag-dpm-model","topic-tag-dpm-tracking","topic-tag-DPMUDFParallel-1","topic-tag-performance-issues-2"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t