Learning Forum

[weakliem]

We've been running Lumerical on several clusters, but with the new licensing we've had to update them all to the 2021 version, and while the MPI versions works on most of our clusters, there's one where it's not and throwing the following types of errors. Note that the test with " /sw/lumerical/v212/mpich2/nemesis/bin/mpiexec -n 12 /sw/lumerical/v212/mpitest/cpi-mpich2nem " runs fine. We've tried several 'fsp' files, which run on our other clusters. Since it worked on the other clusters without any trouble, we're not sure what's going on with this one. Any ideas/suggestions to help debug this appreciated.

:~/pavel/pavel_tests$ /sw/lumerical/v212/mpich2/nemesis/bin/mpiexec -n 12 /sw/lumerical/v212/bin/fdtd-engine-mpich2nem -t 1 /home/bushnell/pavel/pavel_tests/AuBase_newLAM.fsp

[proxy:0:[email protected]] HYDT_dmxu_poll_wait_for_event (./tools/demux/demux_poll.c:70): assert (!(pollfds[i].revents & ~POLLIN & ~POLLOUT & ~POLLHUP)) failed

[proxy:0:[email protected]] main (./pm/pmiserv/pmip.c:225): demux engine error waiting for event

[[email protected]] HYDT_bscu_wait_for_completion (./tools/bootstrap/utils/bscu_wait.c:99): one of the processes terminated badly; aborting

[[email protected]] HYDT_bsci_wait_for_completion (./tools/bootstrap/src/bsci_wait.c:18): bootstrap device returned error waiting for completion

[[email protected]] HYD_pmci_wait_for_completion (./pm/pmiserv/pmiserv_pmci.c:352): bootstrap server returned error waiting for completion

[[email protected]] main (./ui/mpich/mpiexec.c:302): process manager error waiting for completion

[Lito]

@pweakliem Do you have a graphical connection/interface on the cluster or you are running this directly from the Terminal/CLI? Which version of Lumerical is having this issue?
/sw/lumerical/v212/bin/fdtd-engine-mpich2nem -v

[weakliem]

and we're running this all from the command line.

[Lito]

Can you paste the image into your post - we are not allowed to download any files from the forum. Thank you.

[weakliem]

sorry, it says
Ansys Lumerical 2021 R2.3 FDTD Solver Version 8.26.2834 (Linux 64bit)

[Lito]

This is an issue with the 2021 R2.3 version when running from the terminal without a GUI connection/interface. Please download and install the 2021 R1.4 (previous release) from our downloads page until we fix this issue.