{"id":381229,"date":"2024-08-30T19:07:45","date_gmt":"2024-08-30T19:07:45","guid":{"rendered":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/running-lumerical-fdtd-files-on-a-campus-cluster-using-sun-grid-engine-sge\/"},"modified":"2024-10-03T22:20:01","modified_gmt":"2024-10-03T22:20:01","slug":"running-lumerical-fdtd-files-on-a-campus-cluster-using-sun-grid-engine-sge","status":"closed","type":"topic","link":"https:\/\/innovationspace.ansys.com\/forum\/forums\/topic\/running-lumerical-fdtd-files-on-a-campus-cluster-using-sun-grid-engine-sge\/","title":{"rendered":"Running Lumerical FDTD files on a Campus cluster using Sun Grid Engine (SGE)"},"content":{"rendered":"<p>&lt;p&gt;I want to use the Campus cluster (Sun Grid Engine) to run FDTD files.&nbsp;&lt;br&gt;https:\/\/answers.uillinois.edu\/scs\/page.php?id=104365&lt;br&gt;&lt;br&gt;I followed the following instructions to install Lumerical (2024-R1.3) in my cluster folder.&lt;br&gt;https:\/\/optics.ansys.com\/hc\/en-us\/articles\/360035201613-Configuring-your-cluster-for-Ansys-Lumerical&lt;br&gt;&lt;br&gt;Next, based on another article (https:\/\/optics.ansys.com\/hc\/en-us\/articles\/360039028654-Job-scheduler-submission-scripts-SGE-Slurm-Torque), I created the following shell script as &#8220;fdtd_test.sh&#8221;.&nbsp;&lt;br&gt;&lt;br&gt;&#8212;&lt;\/p&gt;&lt;p&gt;#!\/bin\/csh&lt;br&gt;#$ -N fdtd_test&lt;br&gt;#$ -cwd&lt;br&gt;#$ -o run.out&lt;br&gt;#$ -e run.err&lt;br&gt;#$ -q intel24&lt;br&gt;#$ -pe orte 4&lt;\/p&gt;&lt;p&gt;&lt;br&gt;module load mpi\/openmpi-x86_64&lt;\/p&gt;&lt;p&gt;echo &#8220;Running on nodes:&#8221;&lt;br&gt;cat $PE_HOSTFILE&lt;\/p&gt;&lt;p&gt;\/home\/katsuya2\/tools\/lumerical\/v241\/bin\/fdtd-mpi-status.sh&lt;br&gt;\/home\/katsuya2\/tools\/lumerical\/v241\/bin\/fdtd-run-pbs.sh&lt;\/p&gt;&lt;p&gt;ls -l \/home\/katsuya2\/tools\/lumerical\/v241\/bin\/fdtd-engine-ompi-lcl&lt;br&gt;ls -l rod_ctab_1.fsp&lt;\/p&gt;&lt;p&gt;export PATH=\/home\/katsuya2\/tools\/lumerical\/v241\/bin:$PATH&lt;br&gt;export LD_LIBRARY_PATH=\/home\/katsuya2\/tools\/lumerical\/v241\/lib:$LD_LIBRARY_PATHulimit -c unlimited&lt;\/p&gt;&lt;p&gt;mpirun \/home\/katsuya2\/tools\/lumerical\/v241\/bin\/fdtd-engine-ompi-lcl -logall -fullinfo rod_ctab_1.fsp&lt;\/p&gt;&lt;p&gt;&#8212;&nbsp;&lt;br&gt;&lt;br&gt;However, it didn&#8217;t work and I got the error &lt;br&gt;saying &#8220;TERM environment variable not set.&lt;br&gt;\/home\/katsuya2\/tools\/lumerical\/v241\/bin\/fdtd-engine-ompi-lcl: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory&lt;br&gt;\/home\/katsuya2\/tools\/lumerical\/v241\/bin\/fdtd-engine-ompi-lcl: error while loading shared libraries: libmpi.so.40: cannot open shared object file: No such file or directory&lt;br&gt;&#8221;&lt;br&gt;This looks like I&#8217;m missing libmpi.so.40, but I&#8217;m not sure how I can install this.&nbsp;&lt;br&gt;Could you give me some advice to run this file on the cluster?&nbsp;&lt;\/p&gt;<\/p>\n","protected":false},"template":"","class_list":["post-381229","topic","type-topic","status-closed","hentry","topic-tag-cluster"],"aioseo_notices":[],"acf":[],"custom_fields":[{"0":{"_bbp_subscription":["34966","4274"],"_bbp_author_ip":["192.17.85.193"],"_btv_view_count":["230"],"_bbp_topic_status":["answered"],"_bbp_status":["answered"],"_bbp_topic_id":["381229"],"_bbp_forum_id":["27833"],"_bbp_engagement":["4274","34966"],"_bbp_voice_count":["2"],"_bbp_reply_count":["9"],"_bbp_last_reply_id":["388060"],"_bbp_last_active_id":["388060"],"_bbp_last_active_time":["2024-10-03 21:14:55"]},"test":"katsuya2illinois-edu"}],"_links":{"self":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/381229","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics"}],"about":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/types\/topic"}],"version-history":[{"count":1,"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/381229\/revisions"}],"predecessor-version":[{"id":388064,"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/topics\/381229\/revisions\/388064"}],"wp:attachment":[{"href":"https:\/\/innovationspace.ansys.com\/forum\/wp-json\/wp\/v2\/media?parent=381229"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}