Learning Forum

[kiran.purushothamakeshavan]

Hi,

Like the title reads, I was executing a CFD-DEM simulation on EDEM coupled with fluent. The simulation was half way through, then all of  a sudden the simulation on Fluent crashed. I have attached the transcript file for your reference. 

I have a few questions regarding this situation.

1. I need to know why Fluent crashed, and what I could hav done to avoid it.

2. Is there a way I can use the .cxa files that have been saved to generate an animation.

3. Even though I see the .cxa files for animation, why did ansys not save the animation as a .avi movie?

I see error files which mention ''Error [node 4] [time 3/22/24 8:25:0] Abnormal Exit!"
Is it because of a network issue or the hardware resource or memory allocation?
I changed the network from my mobile hotspot to the wifi approximately at this time. Coluld it be the reason?

Regards,

Kiran

 

[Rob]

If the solver crashed you might be able to recover the .cxa by opening the last case & data. Otherwise, possibly not. I tend to save images when running jobs and then stitch them together later; I also use them to monitor the run so they serve a dual use. 

I can't see anything linked to a crash in the image, and I'm not permitted to open/download files on here because of the various rules. If you post the section of the .trn at the point of the failure I may be able to see something. Changing network shouldn't cause a problem with Fluent as the licence should pause the run in the event of a disconnect and resume once it's available; I can't comment on EDEM as it's not ours! 

[kiran.purushothamakeshavan]

This is the following .trn text from the simulation:

1. I do not understand why fluent crashed after the simulation converged messege as seen in the .trn file
This simulation took a long time to run and I'm trying to avoid the same from happening next time.

2. How do I save images automatically while running the job?

 

 Computing forces on EDEM particles... Done.

 

Updating EDEM solution ... 

  Sending forces to EDEM...

Host receiving injections from compute nodes.

  Done.

  EDEM solution updated to time 4.329670e-01.

  Done.

 

Getting EDEM solution data...

1 particle type sent.

  Getting 4292 particles from EDEM solution.

  4236 particles in injection 'edem-injection'.

  56 particles could not be located in Fluent.

Done.

Done.

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  8000  9.5556e-04  2.4241e-07  1.9166e-07  1.6514e-07  3.6868e-04  5.5771e-04  0:05:18   40

  8001  1.0147e-03  2.7097e-07  2.1275e-07  1.8274e-07  4.0459e-04  6.1345e-04  0:05:18   39

  8002  2.2788e-03  2.6629e-07  2.0805e-07  1.7882e-07  4.0713e-04  6.2513e-04  0:05:16   38

  8003  2.1414e-03  2.6102e-07  2.0393e-07  1.7547e-07  4.0448e-04  6.2104e-04  0:05:13   37

  8004  1.9595e-03  2.5775e-07  2.0174e-07  1.7404e-07  4.0095e-04  6.1451e-04  0:05:08   36

  8005  1.7896e-03  2.5557e-07  2.0045e-07  1.7336e-07  3.9714e-04  6.0732e-04  0:05:17   35

  8006  1.6351e-03  2.5388e-07  1.9951e-07  1.7287e-07  3.9326e-04  6.0007e-04  0:05:01   34

  8007  1.4972e-03  2.5233e-07  1.9863e-07  1.7231e-07  3.8932e-04  5.9281e-04  0:04:59   33

  8008  1.3736e-03  2.5077e-07  1.9768e-07  1.7159e-07  3.8538e-04  5.8558e-04  0:04:50   32

  8009  1.2617e-03  2.4910e-07  1.9664e-07  1.7066e-07  3.8143e-04  5.7838e-04  0:04:47   31

  8010  1.1620e-03  2.4729e-07  1.9547e-07  1.6952e-07  3.7751e-04  5.7131e-04  0:04:42   30

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  8011  1.0735e-03  2.4533e-07  1.9414e-07  1.6818e-07  3.7364e-04  5.6439e-04  0:04:24   29

  8012  9.9597e-04  2.4322e-07  1.9266e-07  1.6666e-07  3.6982e-04  5.5767e-04  0:04:09   28

! 8012 solution is converged

(update-animation-object "animation-1-velocity-plane")

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-1-velocity-plane.cxa

()

(update-animation-object "animation-2-pressure-plane")

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-2-pressure-plane.cxa

()

(update-animation-object "animation-2-legs-plane-pressure")

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-2-legs-plane-pressure.cxa

()

(update-animation-object "animation-velocity")

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-velocity.cxa

()

(update-animation-object "animation-particle-tracks")

DPM Iteration ....

 

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-particle-tracks.cxa

()

 

 

This is what I found in the fluent-error saved in multiple notepad files:
Error [node 0] [time 3/22/24 8:25:0] Abnormal Exit!

 

Error [node 1] [time 3/22/24 8:25:0] Abnormal Exit!

 

Error [node 2] [time 3/22/24 8:25:0] Abnormal Exit!

 

Error [node 3] [time 3/22/24 8:25:0] Abnormal Exit!

 

Error [node 4] [time 3/22/24 8:25:0] Abnormal Exit!

 

Error [node 999999] [time 3/22/24 8:25:0] Abnormal Exit!

 

 This is the excrept from the debug file:
[0321/025150.881:WARNING:resource_bundle_qt.cpp(115)] locale_file_path.empty() for locale 
[0321/025151.782:WARNING:resource_bundle_qt.cpp(115)] locale_file_path.empty() for locale 

[Rob]

Thanks, that's suggesting the solver run was aborted, was there anything above that? 

[kiran.purushothamakeshavan]

 

Here is another detailed excrept from the .trn file

If the solver was aborted, why does the .trn say that the solution converged?
Are  you refering to the error-files?
If yes then there is nothing above that error messege in the .txt file

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  7976  9.5440e-04  2.4252e-07  1.9119e-07  1.6544e-07  3.6679e-04  5.5195e-04  0:05:51   40

  7977  1.0127e-03  2.7070e-07  2.1197e-07  1.8304e-07  4.0245e-04  6.0717e-04  0:05:36   39

  7978  2.1538e-03  2.6598e-07  2.0725e-07  1.7912e-07  4.0493e-04  6.1909e-04  0:05:23   38

  7979  2.0234e-03  2.6087e-07  2.0331e-07  1.7582e-07  4.0219e-04  6.1531e-04  0:05:03   37

  7980  1.8547e-03  2.5767e-07  2.0123e-07  1.7433e-07  3.9866e-04  6.0934e-04  0:04:54   36

  7981  1.6949e-03  2.5547e-07  1.9996e-07  1.7351e-07  3.9487e-04  6.0266e-04  0:04:37   35

  7982  1.5516e-03  2.5369e-07  1.9895e-07  1.7286e-07  3.9099e-04  5.9575e-04  0:04:23   34

  7983  1.4228e-03  2.5207e-07  1.9795e-07  1.7214e-07  3.8707e-04  5.8874e-04  0:04:24   33

  7984  1.3087e-03  2.5042e-07  1.9687e-07  1.7124e-07  3.8314e-04  5.8170e-04  0:04:29   32

  7985  1.2056e-03  2.4868e-07  1.9566e-07  1.7013e-07  3.7923e-04  5.7476e-04  0:04:18   31

  7986  1.1136e-03  2.4681e-07  1.9430e-07  1.6882e-07  3.7535e-04  5.6787e-04  0:04:08   30

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  7987  1.0320e-03  2.4479e-07  1.9281e-07  1.6732e-07  3.7151e-04  5.6109e-04  0:03:52   29

  7988  9.5956e-04  2.4263e-07  1.9119e-07  1.6566e-07  3.6771e-04  5.5438e-04  0:03:44   28

! 7988 solution is converged

(update-animation-object “animation-2-pressure-plane”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-2-pressure-plane.cxa

()

(update-animation-object “animation-velocity”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-velocity.cxa

()

Flow time = 0.432304s, time step = 1318

1732 more time steps

 

Advancing DPM injections ….

 

  Setting forces and torques on 4230 (of 4286) EDEM particles… 

  Done.

 

Getting particle data from EDEM…

Host sending injections to compute nodes.

 

Updating solution at time levels N and N-1.

 done.

number tracked = 0

Tracking edem injections… 

Particle timestep is the same as Flow timestep : 3.2800000000e-04[s]

 

 Computing forces on EDEM particles… Done.

 

Updating EDEM solution … 

  Sending forces to EDEM…

Host receiving injections from compute nodes.

  Done.

  EDEM solution updated to time 4.326391e-01.

  Done.

 

Getting EDEM solution data…

1 particle type sent.

  Getting 4289 particles from EDEM solution.

  4233 particles in injection ‘edem-injection’.

  56 particles could not be located in Fluent.

Done.

Done.

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  7988  9.5956e-04  2.4263e-07  1.9119e-07  1.6566e-07  3.6771e-04  5.5438e-04  0:05:20   40

  7989  1.0031e-03  2.7128e-07  2.1235e-07  1.8353e-07  4.0351e-04  6.0987e-04  0:05:20   39

  7990  2.1150e-03  2.6667e-07  2.0776e-07  1.7965e-07  4.0626e-04  6.2338e-04  0:05:03   38

  7991  1.9881e-03  2.6159e-07  2.0389e-07  1.7629e-07  4.0360e-04  6.1962e-04  0:04:47   37

  7992  1.8252e-03  2.5829e-07  2.0181e-07  1.7469e-07  4.0004e-04  6.1346e-04  0:04:41   36

  7993  1.6722e-03  2.5590e-07  2.0046e-07  1.7370e-07  3.9619e-04  6.0655e-04  0:04:28   35

  7994  1.5343e-03  2.5400e-07  1.9939e-07  1.7288e-07  3.9225e-04  5.9941e-04  0:04:23   34

  7995  1.4099e-03  2.5225e-07  1.9838e-07  1.7201e-07  3.8825e-04  5.9221e-04  0:04:17   33

  7996  1.2980e-03  2.5049e-07  1.9730e-07  1.7098e-07  3.8425e-04  5.8508e-04  0:04:04   32

  7997  1.1972e-03  2.4866e-07  1.9608e-07  1.6978e-07  3.8029e-04  5.7810e-04  0:04:05   31

  7998  1.1079e-03  2.4671e-07  1.9474e-07  1.6839e-07  3.7637e-04  5.7119e-04  0:03:58   30

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  7999  1.0270e-03  2.4462e-07  1.9326e-07  1.6684e-07  3.7249e-04  5.6437e-04  0:03:50   29

  8000  9.5556e-04  2.4241e-07  1.9166e-07  1.6514e-07  3.6868e-04  5.5771e-04  0:03:43   28

! 8000 solution is converged

(update-animation-object “animation-2-pressure-plane”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-2-pressure-plane.cxa

()

(update-animation-object “animation-velocity”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-velocity.cxa

()

Flow time = 0.432632s, time step = 1319

1731 more time steps

 

Advancing DPM injections ….

 

  Setting forces and torques on 4233 (of 4289) EDEM particles… 

  Done.

 

Getting particle data from EDEM…

Host sending injections to compute nodes.

 

Updating solution at time levels N and N-1.

 done.

number tracked = 0

Tracking edem injections… 

Particle timestep is the same as Flow timestep : 3.2800000000e-04[s]

 

 Computing forces on EDEM particles… Done.

 

Updating EDEM solution … 

  Sending forces to EDEM…

Host receiving injections from compute nodes.

  Done.

  EDEM solution updated to time 4.329670e-01.

  Done.

 

Getting EDEM solution data…

1 particle type sent.

  Getting 4292 particles from EDEM solution.

  4236 particles in injection ‘edem-injection’.

  56 particles could not be located in Fluent.

Done.

Done.

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  8000  9.5556e-04  2.4241e-07  1.9166e-07  1.6514e-07  3.6868e-04  5.5771e-04  0:05:18   40

  8001  1.0147e-03  2.7097e-07  2.1275e-07  1.8274e-07  4.0459e-04  6.1345e-04  0:05:18   39

  8002  2.2788e-03  2.6629e-07  2.0805e-07  1.7882e-07  4.0713e-04  6.2513e-04  0:05:16   38

  8003  2.1414e-03  2.6102e-07  2.0393e-07  1.7547e-07  4.0448e-04  6.2104e-04  0:05:13   37

  8004  1.9595e-03  2.5775e-07  2.0174e-07  1.7404e-07  4.0095e-04  6.1451e-04  0:05:08   36

  8005  1.7896e-03  2.5557e-07  2.0045e-07  1.7336e-07  3.9714e-04  6.0732e-04  0:05:17   35

  8006  1.6351e-03  2.5388e-07  1.9951e-07  1.7287e-07  3.9326e-04  6.0007e-04  0:05:01   34

  8007  1.4972e-03  2.5233e-07  1.9863e-07  1.7231e-07  3.8932e-04  5.9281e-04  0:04:59   33

  8008  1.3736e-03  2.5077e-07  1.9768e-07  1.7159e-07  3.8538e-04  5.8558e-04  0:04:50   32

  8009  1.2617e-03  2.4910e-07  1.9664e-07  1.7066e-07  3.8143e-04  5.7838e-04  0:04:47   31

  8010  1.1620e-03  2.4729e-07  1.9547e-07  1.6952e-07  3.7751e-04  5.7131e-04  0:04:42   30

 

  iter  continuity   u-phase-1   v-phase-1   w-phase-1           k     epsilon     time/iter

  8011  1.0735e-03  2.4533e-07  1.9414e-07  1.6818e-07  3.7364e-04  5.6439e-04  0:04:24   29

  8012  9.9597e-04  2.4322e-07  1.9266e-07  1.6666e-07  3.6982e-04  5.5767e-04  0:04:09   28

! 8012 solution is converged

(update-animation-object “animation-1-velocity-plane”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-1-velocity-plane.cxa

()

(update-animation-object “animation-2-pressure-plane”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-2-pressure-plane.cxa

()

(update-animation-object “animation-2-legs-plane-pressure”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-2-legs-plane-pressure.cxa

()

(update-animation-object “animation-velocity”)

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-velocity.cxa

()

(update-animation-object “animation-particle-tracks”)

DPM Iteration ….

 

Creating animation sequence file: C:/Users/kiran/Desktop/ahmedbody 11/.//animation-particle-tracks.cxa

()

 

 

[Rob]

The solver time step has converged, and the last part of what you've posted is related to the animation sequence. Does that move straight onto the nodes crashing, or is there something else reported? 

[kiran.purushothamakeshavan]

I don't see anything else being reported. I'm puzzled about why it crashed

[Rob]

Is the crash repeatable? If not, could be the coupling or hardware. 

[kiran.purushothamakeshavan]

Ohk got it, the coupling itself could not have caused the issue because I've never experienced it before.

I have no way of telling if the simulation crashes again because the sim took more than 24 hours to execute, I'll comment on the thread if the issue repeats.

[Rob]

Thanks. A one off failure can be down to something as simple as a virus scan trying to scan an open transcript so always retry.