{"id":395970,"date":"2024-12-02T15:04:14","date_gmt":"2024-12-02T15:04:14","guid":{"rendered":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/unable-to-run-lsrun-on-hpc-cluster\/"},"modified":"2024-12-02T15:04:14","modified_gmt":"2024-12-02T15:04:14","slug":"unable-to-run-lsrun-on-hpc-cluster","status":"publish","type":"topic","link":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/unable-to-run-lsrun-on-hpc-cluster\/","title":{"rendered":"Unable to run lsrun on HPC cluster"},"content":{"rendered":"

<div>HI,<\/div><div> <\/div><div>I am trying to perform simulation of my .k file in HPC cluster. my .k file has a total of 240952 elements. And i have following softwares available in my HPC.<\/div><div> <\/div><div>ansyscl<\/div><div>easybuild<\/div><div>libmppdyna_d__avx2_ifort190_intelmpi.so<\/div><div>libmppdyna_s__avx2_ifort190_intelmpi.so<\/div><div>ls-dyna_mpp_d_R14_1_0_x64_centos79_ifort190_avx2_intelmpi-2018.l2a<\/div><div>ls-dyna_mpp_d_R14_1_0_x64_centos79_ifort190_avx2_intelmpi-2018_sharelib<\/div><div>ls-dyna_mpp_d_R14_1_0_x64_centos79_ifort190_avx2_intelmpi-2018_sharelib.tgz<\/div><div>ls-dyna_mpp_s_R14_1_0_x64_centos79_ifort190_avx2_intelmpi-2018.l2a<\/div><div>ls-dyna_mpp_s_R14_1_0_x64_centos79_ifort190_avx2_intelmpi-2018_sharelib<\/div><div>ls-dyna_mpp_s_R14_1_0_x64_centos79_ifort190_avx2_intelmpi-2018_sharelib.tgz<\/div><div>ls-dyna_smp_d_R14_1_0_x64_centos79_ifort190_sse2<\/div><div>ls-dyna_smp_d_R14_1_0_x64_centos79_ifort190_sse2.l2a<\/div><div>ls-dyna_smp_d_R14_1_0_x64_centos79_ifort190_sse2.tgz<\/div><div>ls-dyna_smp_s_R14_1_0_x64_centos79_ifort190_sse2<\/div><div>ls-dyna_smp_s_R14_1_0_x64_centos79_ifort190_sse2.l2a<\/div><div>mpp-dyna<\/div><div>mpp-dyna-d<\/div><div>mpp-dyna-s<\/div><div>smp-dyna<\/div><div>smp-dyna-d<\/div><div>smp-dyna-s<\/div><div> <\/div><div>I am trying to submit a sbatch job like in the manner in the command line,<\/div><div> <\/div><div>#!\/bin\/bash<\/div><div>#SBATCH –time=01:00:00       # walltime<\/div><div>#SBATCH –nodes=1             # use 1 node<\/div><div>#SBATCH –ntasks=32          # number of processor cores (i.e. tasks)<\/div><div>#SBATCH –mem-per-cpu=4000M   # memory per CPU core<\/div><div>#SBATCH –output=output.log<\/div><div>#SBATCH –error=error.log<\/div><div> <\/div><div>module load GCC\/13.2.0 OpenMPI\/4.1.6 intel-compilers\/2023.2.1 impi\/2021.10.0 Python\/3.11.5 SciPy-bundle\/2023.11 matplotlib\/3.8.2 LS-DYNA\/14.1.0<\/div><div> <\/div><div>export I_MPI_PIN_DOMAIN=core<\/div><div> <\/div><div>srun mpp-dyna i=\/home\/pro\/main.k memory=120000000<\/div><div> <\/div><div> <\/div><div>but with the above settings with ntasks =32, i have got a status.out file stating it will take 285hrs to complete. If i take only 1 node and like 60 tasks, it saying simulation will complete in 206 hrs. If i take the value of nodes, more than 2, after sometime, the simulation is getting struck but i am not getting any errors #no errors. (more nodes, more tasks, simulation is getting struck) at a message. i have tried a lot with different settings and different options, but i couldnt find the right tuning parameters for fast simulation.       sometimes my d3hsp file is struck at <\/div><div> <\/div><div>S t o r a g e   a l l o c a t i o n   <\/div><div> <\/div><div> Memory required to begin solution (memory=   5235K memory2=   2850K)<\/div><div>          Minimum   2425K on processor    31<\/div><div>          Maximum   2850K on processor    24<\/div><div>          Average   2495K<\/div><div> <\/div><div> Matrix Assembly dynamically allocated memory<\/div><div>          Maximum     88M<\/div><div> <\/div><div> Additional dynamically allocated memory<\/div><div>          Minimum     26M on processor    31<\/div><div>          Maximum     42M on processor     0<\/div><div>          Average     28M<\/div><div> <\/div><div> Total allocated memory<\/div><div>          Minimum    116M on processor    31<\/div><div>          Maximum    132M on processor     0<\/div><div>          Average    117M<\/div><div> <\/div><div>After the above info<\/div><div> *********************************<\/div><div>THE ELECTROMAGNETISM SOLVER IS ON<\/div><div>*********************************       this has to start , but its failing to start<\/div><div> <\/div><div> <\/div><div> <\/div><div>\"\"<\/div><div> <\/div><div>can you please help me with this?<\/div><\/p>\n","protected":false},"template":"","class_list":["post-395970","topic","type-topic","status-publish","hentry","topic-tag-LS-DYNAruntime-1","topic-tag-electromagnetism-2","topic-tag-hpc","topic-tag-mpp"],"aioseo_notices":[],"acf":[],"custom_fields":[{"0":{"_bbp_forum_id":["27796"],"_bbp_topic_id":["395970"],"_bbp_subscription":["475646","13694"],"_bbp_author_ip":["141.76.183.79"],"_bbp_reply_count":["5"],"_bbp_reply_count_hidden":["0"],"_bbp_voice_count":["2"],"_bbp_engagement":["475646","13694"],"_btv_view_count":["328"],"_bbp_topic_status":["unanswered"],"_bbp_last_reply_id":["403221"],"_bbp_last_active_id":["403221"],"_bbp_last_active_time":["2025-01-02 10:57:15"]},"test":"rajesh-pamarthi2711gmail-com"}],"_links":{"self":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/395970","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics"}],"about":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/types\/topic"}],"version-history":[{"count":0,"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/395970\/revisions"}],"wp:attachment":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/media?parent=395970"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}