![\"\"](\"\/content\/images\/emoticons\/unsure-emoticon.png\")
RSMStaging\/aokqqj0p.5k1 message it’s weird as folder actually exists and accessible by solvers. Not sure why it has wrong slashes here.<\/p>\nYesterday I was playing with Intel MPI as previously I’ve seen some load on solvers with it. The screenshot with Solve Process Settings and Advanced tab is below.<\/p>\n
<\/p>\n
So I’ve tried with -mpi intelmpi argument and without. The result was the same, i.e. the solving process started on all machines, CPU load was 100% but only for a couple of minutes, then I got MPI_Abort error (full error message is also below).<\/p>\n
<\/p>\n
Note: Regarding that Invalid working directory value= CRSMStaging\/aokqqj0p.5k1 message it’s weird as folder actually exists and accessible by solvers. Not sure why it has wrong slashes here.<\/p>\n
<\/p>\n
Also, I do have NVidia Quadro GPU in each machine. Is it reasonable to enable GPU Acceleration to improve performance?<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n
Error message (omitted):<\/p>\n
<\/p>\n
send of 20 bytes failed.<\/p>\n
<\/p>\n
Command Exit Code: 99<\/p>\n
<\/p>\n
application called MPI_Abort(MPI_COMM_WORLD, 99) – process 0<\/p>\n
<\/p>\n
[mpiexec@Maincad] ..hydrautilssocksock.c (420): write error (Unknown error)<\/p>\n
<\/p>\n
[mpiexec@Maincad] ..hydrautilslaunchlaunch.c (121): shutdown failed, sock 648, error 10093<\/p>\n
<\/p>\n
ClusterJobs Command Exit Code: 99<\/p>\n
<\/p>\n
Saving exit code file: C:RSMStagingaokqqj0p.5k1exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
Exit code file: C:RSMStagingaokqqj0p.5k1exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.<\/p>\n
<\/p>\n
Saving exit code file: C:RSMStagingaokqqj0p.5k1exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
Exit code file: C:RSMStagingaokqqj0p.5k1exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.<\/p>\n
<\/p>\n
=======SOLVE.OUT FILE======<\/p>\n
<\/p>\n
solve –> *** FATAL ***<\/p>\n
<\/p>\n
solve –> Attempt to run ANSYS in a distributed mode failed.<\/p>\n
<\/p>\n
solve –> The Distributed ANSYS process with MPI Rank ID = 4 is not responding.<\/p>\n
<\/p>\n
solve –> Please refer to the Distributed ANSYS Guide for detailed setup and configuration information.<\/p>\n
<\/p>\n
ClusterJobs Exiting with code: 99<\/p>\n
<\/p>\n
Individual Command Exit Codes are: [99]<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n
![\"\"](\"https:\/\/us.v-cdn.net\/6032193\/uploads\/attachments\/dd873e08-e314-496c-b4ec-aad600330eb4\/ae705b67-9c6a-46df-91b4-aae100565fe5_ansys-solver-process-settings.jpg?width=690&upscale=false\")
<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n
Full error log:<\/p>\n
<\/p>\n
RSM Version: 19.5.420.0, Build Date: 30\/07\/2019 5![\"\"](\"\/content\/images\/emoticons\/curly-lips-emoticon.png\")
7:06 am<\/p>\n
<\/p>\n
RSM File Version: 19.5.0-beta.3+Branch.release-19.5.Sha.9c15e0a3e0a608e8efe8c568e494d2160788d025<\/p>\n
<\/p>\n
RSM Library Version: 19.5.0.0<\/p>\n
<\/p>\n
Job Name: Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)<\/p>\n
<\/p>\n
Type: Mechanical_ANSYS<\/p>\n
<\/p>\n
Client Directory: C:TestProject_ProjectScratchScr6531<\/p>\n
<\/p>\n
Client Machine: Maincad<\/p>\n
<\/p>\n
Queue: Default [localhost, default]<\/p>\n
<\/p>\n
Template: Mechanical_ANSYSJob.xml<\/p>\n
<\/p>\n
Cluster Configuration: localhost [localhost]<\/p>\n
<\/p>\n
Cluster Type: ARC<\/p>\n
<\/p>\n
Custom Keyword: blank<\/p>\n
<\/p>\n
Transfer Option: NativeOS<\/p>\n
<\/p>\n
Staging Directory: C:RSMStaging<\/p>\n
<\/p>\n
Delete Staging Directory: True<\/p>\n
<\/p>\n
Local Scratch Directory: blank<\/p>\n
<\/p>\n
Platform: Windows<\/p>\n
<\/p>\n
Cluster Submit Options: blank<\/p>\n
<\/p>\n
Normal Inputs: [*.dat,file*.*,*.mac,thermal.build,commands.xml,SecInput.txt]<\/p>\n
<\/p>\n
Cancel Inputs: [file.abt,sec.interrupt]<\/p>\n
<\/p>\n
Excluded Inputs: [-]<\/p>\n
<\/p>\n
Normal Outputs: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,top![\"\"](\"\/content\/images\/emoticons\/confused-emoticon-wtf-symbol-for-facebook.png\")
ut,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]<\/p>\n
<\/p>\n
Failure Outputs: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]<\/p>\n
<\/p>\n
Cancel Outputs: [file*.err,solve.out,secStart.log,SecDebugLog.txt]<\/p>\n
<\/p>\n
Excluded Outputs: [-]<\/p>\n
<\/p>\n
Inquire Files:<\/p>\n
<\/p>\n
normal: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,secStart.log,sec.validation.executed,sec.envvarvalidation.executed,sec.failure]<\/p>\n
<\/p>\n
cancel: [file*.err,solve.out,secStart.log,SecDebugLog.txt]<\/p>\n
<\/p>\n
failure: [*.xml,*.NR*,CAERepOutput.xml,cyclic_map.json,exit.topo,file*.dsub,file*.ldhi,file*.png,file*.r0*,file*.r1*,file*.r2*,file*.r3*,file*.r4*,file*.r5*,file*.r6*,file*.r7*,file*.r8*,file*.r9*,file*.rd*,file*.rst,file.BCS,file.ce,file.cm,file.cnd,file.cnm,file.DSP,file.err,file.gst,file.json,file.nd*,file.nlh,file.nr*,file.PCS,file.rdb,file.rfl,file.spm,file0.BCS,file0.ce,file0.cnd,file0.err,file0.gst,file0.nd*,file0.nlh,file0.nr*,file0.PCS,frequencies_*.out,input.x17,intermediate*.topo,Mode_mapping_*.txt,NotSupportedElems.dat,ObjectiveHistory.out,post.out,PostImage*.png,record.txt,solve*.out,topo.err,toput,vars.topo,SecDebugLog.txt,sec.solverexitcode,secStart.log,sec.failure,sec.envvarvalidation.executed]<\/p>\n
<\/p>\n
RemotePostInformation: [RemotePostInformation.txt]<\/p>\n
<\/p>\n
SolutionInformation: [solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]<\/p>\n
<\/p>\n
PostDuringSolve: [file.rcn,file.redm,file.rfl,file.rfrq,file.rmg,file.rdsp,file.rsx,file.rst,file.rth,solve.out,file.gst,file.nlh,file0.gst,file0.nlh,file.cnd]<\/p>\n
<\/p>\n
transcript: [solve.out,monitor.json]<\/p>\n
<\/p>\n
Submission in progress…<\/p>\n
<\/p>\n
Created storage directory C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
Runtime Settings:<\/p>\n
<\/p>\n
Job Owner: MAINCADUser<\/p>\n
<\/p>\n
Submit Time: Tuesday, 8 October 2019 11:40 pm<\/p>\n
<\/p>\n
Directory: C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
Uploading file: C:TestProject_ProjectScratchScr6531ds.dat<\/p>\n
<\/p>\n
Uploading file: C:TestProject_ProjectScratchScr6531remote.dat<\/p>\n
<\/p>\n
Uploading file: C:TestProject_ProjectScratchScr6531commands.xml<\/p>\n
<\/p>\n
Uploading file: C:TestProject_ProjectScratchScr6531SecInput.txt<\/p>\n
<\/p>\n
39898.74 KB, .08 sec (498807.21 KB\/sec)<\/p>\n
<\/p>\n
Submission in progress…<\/p>\n
<\/p>\n
JobType is: Mechanical_ANSYS<\/p>\n
<\/p>\n
Final command platform: Windows<\/p>\n
<\/p>\n
RSM_PYTHON_HOME=C:Program FilesANSYS Incv195commonfilesCPython2_7_15winx64Releasepython<\/p>\n
<\/p>\n
RSM_HPC_JOBNAME=Mechanical<\/p>\n
<\/p>\n
Distributed mode requested: True<\/p>\n
<\/p>\n
RSM_HPC_DISTRIBUTED=TRUE<\/p>\n
<\/p>\n
Running 1 commands<\/p>\n
<\/p>\n
Job working directory: C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
Number of CPU requested: 12<\/p>\n
<\/p>\n
AWP_ROOT195=C:Program FilesANSYS Incv195<\/p>\n
<\/p>\n
Checking queue default exists …<\/p>\n
<\/p>\n
JobId was parsed as: 4<\/p>\n
<\/p>\n
Job submission was successful.<\/p>\n
<\/p>\n
Job is running on hostname Maincad<\/p>\n
<\/p>\n
Job user from this host: User<\/p>\n
<\/p>\n
Starting directory: C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
Reading control file C:RSMStagingaokqqj0p.5k1control_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsm ….<\/p>\n
<\/p>\n
Correct Cluster verified<\/p>\n
<\/p>\n
Cluster Type: ARC<\/p>\n
<\/p>\n
Underlying Cluster: ARC<\/p>\n
<\/p>\n
RSM_CLUSTER_TYPE = ARC<\/p>\n
<\/p>\n
Compute Server is running on MAINCAD<\/p>\n
<\/p>\n
Reading commands and arguments…<\/p>\n
<\/p>\n
Command 1: %AWP_ROOT195%SECSolverExecutionControllerrunsec.bat, arguments: , redirectFile: None<\/p>\n
<\/p>\n
Running from shared staging directory …<\/p>\n
<\/p>\n
RSM_USE_LOCAL_SCRATCH = False<\/p>\n
<\/p>\n
RSM_LOCAL_SCRATCH_DIRECTORY =<\/p>\n
<\/p>\n
RSM_LOCAL_SCRATCH_PARTIAL_UNC_PATH =<\/p>\n
<\/p>\n
Cluster Shared Directory: C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
RSM_SHARE_STAGING_DIRECTORY = C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
Job file clean up: True<\/p>\n
<\/p>\n
Use SSH on Linux cluster nodes: False<\/p>\n
<\/p>\n
RSM_USE_SSH_LINUX = False<\/p>\n
<\/p>\n
LivelogFile: NOLIVELOGFILE<\/p>\n
<\/p>\n
StdoutLiveLogFile: stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live<\/p>\n
<\/p>\n
StderrLiveLogFile: stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live<\/p>\n
<\/p>\n
Reading input files…<\/p>\n
<\/p>\n
*.dat<\/p>\n
<\/p>\n
file*.*<\/p>\n
<\/p>\n
*.mac<\/p>\n
<\/p>\n
thermal.build<\/p>\n
<\/p>\n
commands.xml<\/p>\n
<\/p>\n
SecInput.txt<\/p>\n
<\/p>\n
Reading cancel files…<\/p>\n
<\/p>\n
file.abt<\/p>\n
<\/p>\n
sec.interrupt<\/p>\n
<\/p>\n
Reading output files…<\/p>\n
<\/p>\n
*.xml<\/p>\n
<\/p>\n
*.NR*<\/p>\n
<\/p>\n
CAERepOutput.xml<\/p>\n
<\/p>\n
cyclic_map.json<\/p>\n
<\/p>\n
exit.topo<\/p>\n
<\/p>\n
file*.dsub<\/p>\n
<\/p>\n
file*.ldhi<\/p>\n
<\/p>\n
file*.png<\/p>\n
<\/p>\n
file*.r0*<\/p>\n
<\/p>\n
file*.r1*<\/p>\n
<\/p>\n
file*.r2*<\/p>\n
<\/p>\n
file*.r3*<\/p>\n
<\/p>\n
file*.r4*<\/p>\n
<\/p>\n
file*.r5*<\/p>\n
<\/p>\n
file*.r6*<\/p>\n
<\/p>\n
file*.r7*<\/p>\n
<\/p>\n
file*.r8*<\/p>\n
<\/p>\n
file*.r9*<\/p>\n
<\/p>\n
file*.rd*<\/p>\n
<\/p>\n
file*.rst<\/p>\n
<\/p>\n
file.BCS<\/p>\n
<\/p>\n
file.ce<\/p>\n
<\/p>\n
file.cm<\/p>\n
<\/p>\n
file.cnd<\/p>\n
<\/p>\n
file.cnm<\/p>\n
<\/p>\n
file.DSP<\/p>\n
<\/p>\n
file.err<\/p>\n
<\/p>\n
file.gst<\/p>\n
<\/p>\n
file.json<\/p>\n
<\/p>\n
file.nd*<\/p>\n
<\/p>\n
file.nlh<\/p>\n
<\/p>\n
file.nr*<\/p>\n
<\/p>\n
file.PCS<\/p>\n
<\/p>\n
file.rdb<\/p>\n
<\/p>\n
file.rfl<\/p>\n
<\/p>\n
file.spm<\/p>\n
<\/p>\n
file0.BCS<\/p>\n
<\/p>\n
file0.ce<\/p>\n
<\/p>\n
file0.cnd<\/p>\n
<\/p>\n
file0.err<\/p>\n
<\/p>\n
file0.gst<\/p>\n
<\/p>\n
file0.nd*<\/p>\n
<\/p>\n
file0.nlh<\/p>\n
<\/p>\n
file0.nr*<\/p>\n
<\/p>\n
file0.PCS<\/p>\n
<\/p>\n
frequencies_*.out<\/p>\n
<\/p>\n
input.x17<\/p>\n
<\/p>\n
intermediate*.topo<\/p>\n
<\/p>\n
Mode_mapping_*.txt<\/p>\n
<\/p>\n
NotSupportedElems.dat<\/p>\n
<\/p>\n
ObjectiveHistory.out<\/p>\n
<\/p>\n
post.out<\/p>\n
<\/p>\n
PostImage*.png<\/p>\n
<\/p>\n
record.txt<\/p>\n
<\/p>\n
solve*.out<\/p>\n
<\/p>\n
topo.err<\/p>\n
<\/p>\n
toput<\/p>\n
<\/p>\n
vars.topo<\/p>\n
<\/p>\n
SecDebugLog.txt<\/p>\n
<\/p>\n
secStart.log<\/p>\n
<\/p>\n
sec.validation.executed<\/p>\n
<\/p>\n
sec.envvarvalidation.executed<\/p>\n
<\/p>\n
sec.failure<\/p>\n
<\/p>\n
*.xml<\/p>\n
<\/p>\n
*.NR*<\/p>\n
<\/p>\n
CAERepOutput.xml<\/p>\n
<\/p>\n
cyclic_map.json<\/p>\n
<\/p>\n
exit.topo<\/p>\n
<\/p>\n
file*.dsub<\/p>\n
<\/p>\n
file*.ldhi<\/p>\n
<\/p>\n
file*.png<\/p>\n
<\/p>\n
file*.r0*<\/p>\n
<\/p>\n
file*.r1*<\/p>\n
<\/p>\n
file*.r2*<\/p>\n
<\/p>\n
file*.r3*<\/p>\n
<\/p>\n
file*.r4*<\/p>\n
<\/p>\n
file*.r5*<\/p>\n
<\/p>\n
file*.r6*<\/p>\n
<\/p>\n
file*.r7*<\/p>\n
<\/p>\n
file*.r8*<\/p>\n
<\/p>\n
file*.r9*<\/p>\n
<\/p>\n
file*.rd*<\/p>\n
<\/p>\n
file*.rst<\/p>\n
<\/p>\n
file.BCS<\/p>\n
<\/p>\n
file.ce<\/p>\n
<\/p>\n
file.cm<\/p>\n
<\/p>\n
file.cnd<\/p>\n
<\/p>\n
file.cnm<\/p>\n
<\/p>\n
file.DSP<\/p>\n
<\/p>\n
file.err<\/p>\n
<\/p>\n
file.gst<\/p>\n
<\/p>\n
file.json<\/p>\n
<\/p>\n
file.nd*<\/p>\n
<\/p>\n
file.nlh<\/p>\n
<\/p>\n
file.nr*<\/p>\n
<\/p>\n
file.PCS<\/p>\n
<\/p>\n
file.rdb<\/p>\n
<\/p>\n
file.rfl<\/p>\n
<\/p>\n
file.spm<\/p>\n
<\/p>\n
file0.BCS<\/p>\n
<\/p>\n
file0.ce<\/p>\n
<\/p>\n
file0.cnd<\/p>\n
<\/p>\n
file0.err<\/p>\n
<\/p>\n
file0.gst<\/p>\n
<\/p>\n
file0.nd*<\/p>\n
<\/p>\n
file0.nlh<\/p>\n
<\/p>\n
file0.nr*<\/p>\n
<\/p>\n
file0.PCS<\/p>\n
<\/p>\n
frequencies_*.out<\/p>\n
<\/p>\n
input.x17<\/p>\n
<\/p>\n
intermediate*.topo<\/p>\n
<\/p>\n
Mode_mapping_*.txt<\/p>\n
<\/p>\n
NotSupportedElems.dat<\/p>\n
<\/p>\n
ObjectiveHistory.out<\/p>\n
<\/p>\n
post.out<\/p>\n
<\/p>\n
PostImage*.png<\/p>\n
<\/p>\n
record.txt<\/p>\n
<\/p>\n
solve*.out<\/p>\n
<\/p>\n
topo.err<\/p>\n
<\/p>\n
toput<\/p>\n
<\/p>\n
vars.topo<\/p>\n
<\/p>\n
SecDebugLog.txt<\/p>\n
<\/p>\n
sec.solverexitcode<\/p>\n
<\/p>\n
secStart.log<\/p>\n
<\/p>\n
sec.failure<\/p>\n
<\/p>\n
sec.envvarvalidation.executed<\/p>\n
<\/p>\n
Reading exclude files…<\/p>\n
<\/p>\n
stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
control_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsm<\/p>\n
<\/p>\n
hosts.dat<\/p>\n
<\/p>\n
exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live<\/p>\n
<\/p>\n
stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live<\/p>\n
<\/p>\n
ClusterJobCustomization.xml<\/p>\n
<\/p>\n
ClusterJobs.py<\/p>\n
<\/p>\n
clusterjob_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.sh<\/p>\n
<\/p>\n
clusterjob_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.bat<\/p>\n
<\/p>\n
inquire.request<\/p>\n
<\/p>\n
inquire.confirm<\/p>\n
<\/p>\n
request.upload.rsm<\/p>\n
<\/p>\n
request.download.rsm<\/p>\n
<\/p>\n
wait.download.rsm<\/p>\n
<\/p>\n
scratch.job.rsm<\/p>\n
<\/p>\n
volatile.job.rsm<\/p>\n
<\/p>\n
restart.xml<\/p>\n
<\/p>\n
cancel_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
liveLogLastPositions_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsm<\/p>\n
<\/p>\n
stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_kill.rsmout<\/p>\n
<\/p>\n
stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_kill.rsmout<\/p>\n
<\/p>\n
sec.interrupt<\/p>\n
<\/p>\n
stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_*.rsmout<\/p>\n
<\/p>\n
stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf_*.rsmout<\/p>\n
<\/p>\n
stdout_task_*.live<\/p>\n
<\/p>\n
stderr_task_*.live<\/p>\n
<\/p>\n
control_task_*.rsm<\/p>\n
<\/p>\n
stdout_task_*.rsmout<\/p>\n
<\/p>\n
stderr_task_*.rsmout<\/p>\n
<\/p>\n
exitcode_task_*.rsmout<\/p>\n
<\/p>\n
exitcodeCommands_task_*.rsmout<\/p>\n
<\/p>\n
file.abt<\/p>\n
<\/p>\n
Reading environment variables…<\/p>\n
<\/p>\n
RSM_IRON_PYTHON_HOME = C:Program FilesANSYS Incv195commonfilesIronPython<\/p>\n
<\/p>\n
RSM_TASK_WORKING_DIRECTORY = C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
RSM_USE_SSH_LINUX = False<\/p>\n
<\/p>\n
RSM_QUEUE_NAME = default<\/p>\n
<\/p>\n
RSM_CONFIGUREDQUEUE_NAME = Default<\/p>\n
<\/p>\n
RSM_COMPUTE_SERVER_MACHINE_NAME = Maincad<\/p>\n
<\/p>\n
RSM_HPC_JOBNAME = Mechanical<\/p>\n
<\/p>\n
RSM_HPC_DISPLAYNAME = Annulus_Thread_MAX_Sludge-SidWalls=No Separation,rhoSludge=2,3,t=0-DP0-Model (B4)-Static Structural (B5)-Solution (B6)<\/p>\n
<\/p>\n
RSM_HPC_CORES = 12<\/p>\n
<\/p>\n
RSM_HPC_DISTRIBUTED = TRUE<\/p>\n
<\/p>\n
RSM_HPC_NODE_EXCLUSIVE = FALSE<\/p>\n
<\/p>\n
RSM_HPC_QUEUE = default<\/p>\n
<\/p>\n
RSM_HPC_USER = MAINCADUser<\/p>\n
<\/p>\n
RSM_HPC_WORKDIR = C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
RSM_HPC_JOBTYPE = Mechanical_ANSYS<\/p>\n
<\/p>\n
RSM_HPC_ANSYS_LOCAL_INSTALL_DIRECTORY = C:Program FilesANSYS Incv195<\/p>\n
<\/p>\n
RSM_HPC_VERSION = 195<\/p>\n
<\/p>\n
RSM_HPC_STAGING = C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
RSM_HPC_LOCAL_PLATFORM = Windows<\/p>\n
<\/p>\n
RSM_HPC_CLUSTER_TARGET_PLATFORM = Windows<\/p>\n
<\/p>\n
RSM_HPC_STDOUTFILE = stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
RSM_HPC_STDERRFILE = stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
RSM_HPC_STDOUTLIVE = stdout_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live<\/p>\n
<\/p>\n
RSM_HPC_STDERRLIVE = stderr_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.live<\/p>\n
<\/p>\n
RSM_HPC_SCRIPTS_DIRECTORY_LOCAL = C:Program FilesANSYS Incv195RSMConfigscripts<\/p>\n
<\/p>\n
RSM_HPC_SCRIPTS_DIRECTORY = C:Program FilesANSYS Incv195RSMConfigscripts<\/p>\n
<\/p>\n
RSM_HPC_SUBMITHOST = localhost<\/p>\n
<\/p>\n
RSM_HPC_STORAGEID = <JobId> <id>a7ab7b67-dc3d-44cb-a665-813ffa216eee<\/id> <nativeId>Mechanical=LocalOS#localhost$C:RSMStagingaokqqj0p.5k1<\/nativeId> <timestamp>Tuesday, October 08, 2019 10:40:05.011 AM<\/timestamp> <fullyDefined>True<\/fullyDefined><\/JobId><\/p>\n
<\/p>\n
RSM_HPC_PLATFORMSTORAGEID = C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
RSM_HPC_NATIVEOPTIONS =<\/p>\n
<\/p>\n
ARC_ROOT = C:Program FilesANSYS Incv195RSMConfigscripts….ARC<\/p>\n
<\/p>\n
RSM_HPC_KEYWORD = ARC<\/p>\n
<\/p>\n
RSM_PYTHON_LOCALE = en-us<\/p>\n
<\/p>\n
Reading AWP_ROOT environment variable name …<\/p>\n
<\/p>\n
AWP_ROOT environment variable name is: AWP_ROOT195<\/p>\n
<\/p>\n
Reading Low Disk Space Warning Limit …<\/p>\n
<\/p>\n
Low disk space warning threshold set at: 2.0GiB<\/p>\n
<\/p>\n
Reading File identifier …<\/p>\n
<\/p>\n
File identifier found as: 782e78b5-2c00-45fa-b7ac-6976aa49c2cf<\/p>\n
<\/p>\n
Done reading control file.<\/p>\n
<\/p>\n
RSM_AWP_ROOT_NAME = AWP_ROOT195<\/p>\n
<\/p>\n
AWP_ROOT195 install directory: C:Program FilesANSYS Incv195<\/p>\n
<\/p>\n
RSM_MACHINES = maincad:4:cluster01:4:cluster02:4<\/p>\n
<\/p>\n
Number of nodes assigned for current job = 3<\/p>\n
<\/p>\n
Machine list: <\/p>\n
<\/p>\n
Checking DisableUNCCheck …<\/p>\n
<\/p>\n
Unable to read registry for HKEY_CURRENT_USERSoftwareMicrosoftCommand Processor<\/p>\n
<\/p>\n
Ignore verifying DisableUNCCheck, you may check it manually if not already done so.<\/p>\n
<\/p>\n
Start running job commands …<\/p>\n
<\/p>\n
Running on machine : Maincad<\/p>\n
<\/p>\n
Current Directory: C:RSMStagingaokqqj0p.5k1<\/p>\n
<\/p>\n
Running command: C:Program FilesANSYS Incv195SECSolverExecutionControllerrunsec.bat<\/p>\n
<\/p>\n
Redirecting output to None<\/p>\n
<\/p>\n
Final command arg list : <\/p>\n
<\/p>\n
Running Process<\/p>\n
<\/p>\n
Running Solver : C:Program FilesANSYS Incv195ansysbinwinx64ANSYS195.exe -b nolist -s noread -acc nvidia -na 1 -p ansys -mpi intelmpi -i remote.dat -o solve.out -dis -machines maincad:4:cluster01:4:cluster02:4 -dir “CRSMStaging\/aokqqj0p.5k1″<\/p>\n
<\/p>\n
*** The AWP_ROOT195 environment variable is set to: C:Program FilesANSYS Incv195<\/p>\n
<\/p>\n
*** The AWP_LOCALE195 environment variable is set to: en-us<\/p>\n
<\/p>\n
*** The ANSYS195_DIR environment variable is set to: C:Program FilesANSYS Incv195ANSYS<\/p>\n
<\/p>\n
*** The ANSYS_SYSDIR environment variable is set to: winx64<\/p>\n
<\/p>\n
*** The ANSYS_SYSDIR32 environment variable is set to: intel<\/p>\n
<\/p>\n
*** The CADOE_DOCDIR195 environment variable is set to: C:Program FilesANSYS Incv195CommonFileshelpen-ussolviewer<\/p>\n
<\/p>\n
*** The CADOE_LIBDIR195 environment variable is set to: C:Program FilesANSYS Incv195CommonFilesLanguageen-us<\/p>\n
<\/p>\n
*** The LSTC_LICENSE environment variable is set to: ANSYS<\/p>\n
<\/p>\n
*** The P_SCHEMA environment variable is set to: C:Program FilesANSYS Incv195AISOLCADIntegrationParasolidPSchema<\/p>\n
<\/p>\n
*** The TEMP environment variable is set to: C:UsersUserAppDataLocalTemp<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
*** FATAL ***<\/p>\n
<\/p>\n
Invalid working directory value= CRSMStaging\/aokqqj0p.5k1<\/p>\n
<\/p>\n
(specified working directory does not exist)<\/p>\n
<\/p>\n
*** NOTE ***<\/p>\n
<\/p>\n
USAGE: C:Program FilesANSYS Incv195ANSYSbinwinx64ANSYS.EXE<\/p>\n
<\/p>\n
[-d device name] [-j job name]<\/p>\n
<\/p>\n
[-b list|nolist] [-m scratch memory(mb)]<\/p>\n
<\/p>\n
[-s read|noread] [-g] [-db database(mb)]<\/p>\n
<\/p>\n
[-p product] [-l language]<\/p>\n
<\/p>\n
[-dyn] [-np #] [-mfm]<\/p>\n
<\/p>\n
[-dvt] [-dis] [-machines list]<\/p>\n
<\/p>\n
[-i inputfile] [-o outputfile]<\/p>\n
<\/p>\n
[-ser port] [-scport port]<\/p>\n
<\/p>\n
[-scname couplingname] [-schost hostname]<\/p>\n
<\/p>\n
[-smp] [-mpi intelmpi|ibmmpi|msmpi]<\/p>\n
<\/p>\n
[-dir working_directory ]<\/p>\n
<\/p>\n
[-acc nvidia] [-na #]<\/p>\n
<\/p>\n
send of 20 bytes failed.<\/p>\n
<\/p>\n
Command Exit Code: 99<\/p>\n
<\/p>\n
application called MPI_Abort(MPI_COMM_WORLD, 99) – process 0<\/p>\n
<\/p>\n
[mpiexec@Maincad] ..hydrautilssocksock.c (420): write error (Unknown error)<\/p>\n
<\/p>\n
[mpiexec@Maincad] ..hydrautilslaunchlaunch.c (121): shutdown failed, sock 648, error 10093<\/p>\n
<\/p>\n
ClusterJobs Command Exit Code: 99<\/p>\n
<\/p>\n
Saving exit code file: C:RSMStagingaokqqj0p.5k1exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
Exit code file: C:RSMStagingaokqqj0p.5k1exitcode_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.<\/p>\n
<\/p>\n
Saving exit code file: C:RSMStagingaokqqj0p.5k1exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout<\/p>\n
<\/p>\n
Exit code file: C:RSMStagingaokqqj0p.5k1exitcodeCommands_782e78b5-2c00-45fa-b7ac-6976aa49c2cf.rsmout has been created.<\/p>\n
<\/p>\n
=======SOLVE.OUT FILE======<\/p>\n
<\/p>\n
solve –> *** FATAL ***<\/p>\n
<\/p>\n
solve –> Attempt to run ANSYS in a distributed mode failed.<\/p>\n
<\/p>\n
solve –> The Distributed ANSYS process with MPI Rank ID = 4 is not responding.<\/p>\n
<\/p>\n
solve –> Please refer to the Distributed ANSYS Guide for detailed setup and configuration information.<\/p>\n
<\/p>\n
ClusterJobs Exiting with code: 99<\/p>\n
<\/p>\n
Individual Command Exit Codes are: [99]<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n
<\/p>\n","protected":false},"template":"","class_list":["post-95710","reply","type-reply","status-publish","hentry"],"aioseo_notices":[],"acf":[],"_links":{"self":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/replies\/95710","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/replies"}],"about":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/types\/reply"}],"version-history":[{"count":0,"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/replies\/95710\/revisions"}],"wp:attachment":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/media?parent=95710"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}