{"id":286174,"date":"2023-05-29T14:47:16","date_gmt":"2023-05-29T14:47:16","guid":{"rendered":"\/forum\/forums\/topic\/parallelization-issues-for-fsi-simulations-using-slurm\/"},"modified":"2023-05-29T14:47:16","modified_gmt":"2023-05-29T14:47:16","slug":"parallelization-issues-for-fsi-simulations-using-slurm","status":"closed","type":"topic","link":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/parallelization-issues-for-fsi-simulations-using-slurm\/","title":{"rendered":"Parallelization issues for FSI simulations using Slurm"},"content":{"rendered":"

Dear all, <\/p>\n

I’ve been doing FSI simulations using Ansys SystemCoupling for quite some time now. Currently, I am using Surf Snellius supercomputer for my heavy duties with Ansys version 2021\/R2.  Although my simulations require extensive computational power, I am suspicious about my actual computational runtime and believe I can reduce it further. An example concerns a two-way strongly coupled simulation of a microfluidic valve interacting with a soft incompressible membrane to allow\/block the flow. <\/p>\n

Typically, I restrict myself to +\/- 1Million PUMA-type cells from Fluent perspective and ~50K SOLID285 elements for transient Mechanical. The problems also include contact, gap modeling and require careful attention to avoid floating point exceptions and divergence events. <\/p>\n

Now, I encountered an issue while trying to run the simulation using multiple nodes, and I am sharing the error I get from the SyC log for your consideration: While trying to sbatch on multiple nodes, the Slurm job does not fail, but the simulation gets stalled instead.<\/p>\n

<\/p>\n

I am not an expert on parallelization, but I think it has something to do with the MPI. In fact, I remember I had to export a command to enable FSI simulations using one node and multiple cores as follows: <\/p>\n

export LD_PRELOAD=$EBROOTANSYS\/v212\/commonfiles\/MPI\/Intel\/2018.3.222\/linx64\/lib\/libstrtok.so<\/p>\n

The Slurm batch file is fine and consistent with the one proposed in the ALH SyC course. The issue emerges as soon as I run on multiple nodes. <\/p>\n

Although I tried some suggestions from different discussions, such as this one: \/forum\/forums\/topic\/fluent-2021-r1-running-on-a-linux-server-has-issues-with-intel-mpi-2018\/, the problem persists, and I could not find a way to solve. it. <\/p>\n

I am looking forward to your suggestions.<\/p>\n

Thanks a lot, <\/p>\n

Best regards,<\/p>\n

Ahmed, <\/p>\n","protected":false},"template":"","class_list":["post-286174","topic","type-topic","status-closed","hentry"],"aioseo_notices":[],"aioseo_head":"\n\t\t\n\t\n\t\n\t\n\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t\n\t\t