{"id":320611,"date":"2023-12-03T16:46:31","date_gmt":"2023-12-03T16:46:31","guid":{"rendered":"\/forum\/?post_type=topic&p=320611"},"modified":"2024-02-17T08:34:14","modified_gmt":"2024-02-17T08:34:14","slug":"restarting-a-system-coupling-fsi-simulation-using-command-line-cli-error","status":"closed","type":"topic","link":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/restarting-a-system-coupling-fsi-simulation-using-command-line-cli-error\/","title":{"rendered":"Restarting a System Coupling FSI simulation using command line (CLI) error"},"content":{"rendered":"

Hi all, <\/p>\n

I am doing a system coupling FSI simulation (Transient Mechanical + Fluent) on cluster. Due to the limit available time of computational resources, each job can run up to 3 days. Therefore, I need to restart my simulation after the it is killed by the cluster. <\/p>\n

However, I met problems when restarting. For example, I run 10 steps, and I used following python code to resubmit my job from step 6, where restart file for step 6 is available:<\/p>\n

# load current steps\nOpen(CouplingStep = 6)\n\n# Solve the co-simulation. \nSolve()<\/pre>\n
I found that, if I successfully finished previous simulation<\/strong>. That is, if previous simulation ends successfully. I can restart with any restart step I want. On the other hand, if my previous run got killed by the cluster<\/strong>, such as only finished 9 steps. I am unable to restart from any steps even the restart files are available. The reason is System Coupling cannot successfully detect all participants, with following output:<\/p>\n
Awaiting connections from coupling participants...Abort(100) on node 0 (rank 0 in comm 0): application called MPI_Abort(MPI_COMM_WORLD, 100) - process 0\n\nElapsed time: 5 min. Still awaiting connection from: MAPDL-1. If you feel the participant(s) should already have connected, check participant logs and\/or abort the run.\nElapsed time: 10 min. Still awaiting connection from: MAPDL-1. If you feel the participant(s) should already have connected, check participant logs and\/or abort the run.<\/pre>\n
My question is: what might cause this issue? the main difference between above two cases are some temporary files generated since previous simulation is not done, such as sysSolve.lock, which I removed before restarting. I really need to restart my simulation properly and genuinely hope anyone offer a solution.<\/p>\n
 <\/p>\n
Thank you!<\/p>\n
Eric<\/p>\n
 <\/p>\n
 <\/p>\n","protected":false},"template":"","class_list":["post-320611","topic","type-topic","status-closed","hentry","topic-tag-fsi-transient-1","topic-tag-fluent","topic-tag-restart","topic-tag-restart-points","topic-tag-systemcoupling"],"aioseo_notices":[],"acf":[],"custom_fields":[{"0":{"_bbp_author_ip":["23.206.193.59"],"_bbp_subscription":["21343","805"],"_btv_view_count":["1812"],"_bbp_topic_status":["answered"],"_edit_lock":["1701622285:228887"],"_bbp_status":["publish"],"_bbp_topic_id":["320611"],"_bbp_forum_id":["27792"],"_bbp_engagement":["805","21343"],"_bbp_voice_count":["2"],"_bbp_reply_count":["5"],"_bbp_last_reply_id":["352114"],"_bbp_last_active_id":["352114"],"_bbp_last_active_time":["2024-02-17 08:39:36"]},"test":"yu272umn-edu"}],"_links":{"self":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/320611","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics"}],"about":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/types\/topic"}],"version-history":[{"count":0,"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/320611\/revisions"}],"wp:attachment":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/media?parent=320611"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}