Ansys Assistant will be unavailable on the Learning Forum starting January 30. An upgraded version is coming soon. We apologize for any inconvenience and appreciate your patience. Stay tuned for updates.
Ansys Products

Ansys Products

Discuss installation & licensing of our Ansys Teaching and Research products.

Running Fluent simulations using multiple nodes in HPC cluster

    • Jayachandran Narayanan
      Subscriber

      Hi,

      I am trying to run my Fluent simulations in our university HPC cluster and each node of the cluster is limited to 40 processors. So, I have requested 2 nodes and 80 processors to run Fluent cases. The HPC allocated me the resources whereas when I am opening Fluent, it's just loading 80 partitions in the 40 processors of the same node. Fluent console displays 80/40 and not 80/80 at the core column at the starting. 

      Please help me in setting up the simulations in multiple nodes. 

    • Rahul
      Ansys Employee

      Hello 
      Could you please share your job submission script?

    • Jayachandran Narayanan
      Subscriber

      Hi,

      Thanks for your response. 

      I am trying to open Fluent using the GUI. Here are settings in Fluent Launcher.

      • Solver processors - 80
      • Parallel settings: interconnects and MPI types - default, Run type - shared memory on a local machine.
    • Rahul
      Ansys Employee
    • Jayachandran Narayanan
      Subscriber

      Hi, 

      I tried different launcher options as in the shared section, but none of them seems to work. Instead, I created a slurm jobscript file as,

      #!/bin/sh
      #SBATCH --time=300:00:00
      #SBATCH -N 2 -n 20
      #SBATCH --mem=100gb
      module load ansys/22.2
      cp 3d_sim.in SYS-3.cas.h5 SYS-3.dat.h5 $PFSDIR
      cd $PFSDIR
      FLUENTNODES="$(scontrol show hostnames)"
      FLUENTNODES=$(echo $FLUENTNODES | tr ' ' ',')
      fluent 3ddp -t$SLURM_NTASKS -mpi=openmpi -p -g -t40 -cnf=$FLUENTNODES -i 3d_sim.in
      cp * $SLURM_SUBMIT_DIR

      It seems like its able to access multiple nodes, but threw this error as,

       
      /usr/local/ansys_inc/v222/fluent/fluent22.2.0/bin/fluent -r22.2.0 3ddp -t20 -mpi=openmpi -p -g -t40 -cnf=compt326,compt327 -i 3d_sim.in
      /usr/local/ansys_inc/v222/fluent/fluent22.2.0/cortex/lnamd64/cortex.22.2.0 -f fluent -g -i 3d_sim.in (fluent "3ddp -pethernet  -host -r22.2.0 -t40 -mpi=openmpi -cnf=compt326,compt327 -path/usr/local/ansys_inc/v222/fluent -ssh")
       
      Opening input/output transcript to file "/scratch/pbsjobs/job.871158.hpc/fluent-20240221-095031-932314.trn".
      Auto-Transcript Start Time:  09:50:31, 21 Feb 2024 
      /usr/local/ansys_inc/v222/fluent/fluent22.2.0/bin/fluent -r22.2.0 3ddp -pethernet -host -t40 -mpi=openmpi -cnf=compt326,compt327 -path/usr/local/ansys_inc/v222/fluent -ssh -cx compt326:41759:34939
      Starting /usr/local/ansys_inc/v222/fluent/fluent22.2.0/lnamd64/3ddp_host/fluent.22.2.0 host -cx compt326:41759:34939 "(list (rpsetvar (QUOTE parallel/function) "fluent 3ddp -flux -node -r22.2.0 -t40 -pethernet -mpi=openmpi -cnf=compt326,compt327 -ssh") (rpsetvar (QUOTE parallel/rhost) "") (rpsetvar (QUOTE parallel/ruser) "") (rpsetvar (QUOTE parallel/nprocs_string) "40") (rpsetvar (QUOTE parallel/auto-spawn?) #t) (rpsetvar (QUOTE parallel/trace-level) 0) (rpsetvar (QUOTE parallel/remote-shell) 1) (rpsetvar (QUOTE parallel/path) "/usr/local/ansys_inc/v222/fluent") (rpsetvar (QUOTE parallel/hostsfile) "compt326,compt327") (rpsetvar (QUOTE gpuapp/devices) ""))"
      /usr/local/ansys_inc/v222/fluent/fluent22.2.0/lnamd64/3ddp_host/fluent.22.2.0: error while loading shared libraries: libnsl.so.1: cannot open shared object file: No such file or directory
       The fluent process could not be started.
       
      version> 
      version> 
      version> 
      version> 

      Can you help us in resolving this?

       

      Thanks!

       

Viewing 4 reply threads
  • The topic ‘Running Fluent simulations using multiple nodes in HPC cluster’ is closed to new replies.
[bingo_chatbox]