problem when coupling roms and swan

[zhaoqian]

Hi all:
I want to run the couple ROMS and SWAN, and I run the INLET_TEST case at first, but I encounter some problem when executing oceanM. The following is the related informations with the errors marked in red, would you please help me resolve it?

qzhao@altix450:~/trunk> /opt/mpich2-ifort/bin/mpirun -np 2 ./oceanM ROMS/External/coupling_inlet_test.in
Coupled Input File name = ROMS/External/coupling_inlet_test.in

Model Coupling Parallel Threads:

Ocean Model MPI nodes: 000 - 000
Waves Model MPI nodes: 001 - 001


Ocean Export: bath:SSH:Ubar:Vbar:ZO
Waves Export: Wdir:Wamp:Wlen:Wptop:Wpbot:Wubot


Process Information:

Node # 0 (pid= 68371) is active.

Model Input Parameters: ROMS/TOMS version 3.2
Monday - March 15, 2010 - 7:16:48 PM
-----------------------------------------------------------------------------

SWAN is preparing computation ...


Inlet Test Case

Operating system : Linux
CPU/hardware : ia64
Compiler system : ifort
Compiler command : /opt/mpich2-ifort/bin/mpif90
Compiler flags : -ip -O3 -I/opt/mct/include -free

Input Script : ROMS/External/ocean_inlet_test.in

SVN Root URL : https://www.myroms.org/svn/src/trunk
SVN Revision :

Local Root : /data1/qzhao/trunk
Header Dir : /data1/qzhao/trunk/ROMS/Include
Header file : inlet_test.h
Analytical Dir: /data1/qzhao/trunk/ROMS/Functionals

Resolution, Grid 01: 0075x0070x008, Parallel Nodes: 1, Tiling: 001x001


Physical Parameters, Grid: 01
=============================

34560 ntimes Number of timesteps for 3-D equations.
5.000 dt Timestep size (s) for 3-D equations.
20 ndtfast Number of timesteps for 2-D equations between
each 3D timestep.
1 ERstr Starting ensemble/perturbation run number.
1 ERend Ending ensemble/perturbation run number.
0 nrrec Number of restart records to read from disk.
T LcycleRST Switch to recycle time-records in restart file.
720 nRST Number of timesteps between the writing of data
into restart fields.
1 ninfo Number of timesteps between print of information
to standard output.
T ldefout Switch to create a new output NetCDF file(s).
720 nHIS Number of timesteps between the writing fields
into history file.
1.0000E-03 visc2 Horizontal, harmonic mixing coefficient (m2/s)
for momentum.
5.0000E-06 Akt_bak(01) Background vertical mixing coefficient (m2/s)
for tracer 01: temp
5.0000E-06 Akt_bak(02) Background vertical mixing coefficient (m2/s)
for tracer 02: salt
5.0000E-05 Akv_bak Background vertical mixing coefficient (m2/s)
for momentum.
5.0000E-06 Akk_bak Background vertical mixing coefficient (m2/s)
for turbulent energy.
5.0000E-06 Akp_bak Background vertical mixing coefficient (m2/s)
for turbulent generic statistical field.
3.000 gls_p GLS stability exponent.
1.500 gls_m GLS turbulent kinetic energy exponent.
-1.000 gls_n GLS turbulent length scale exponent.
7.6000E-06 gls_Kmin GLS minimum value of turbulent kinetic energy.
1.0000E-12 gls_Pmin GLS minimum value of dissipation.
5.4770E-01 gls_cmu0 GLS stability coefficient.
1.4400E+00 gls_c1 GLS shear production coefficient.
1.9200E+00 gls_c2 GLS dissipation coefficient.
-4.0000E-01 gls_c3m GLS stable buoyancy production coefficient.
1.0000E+00 gls_c3p GLS unstable buoyancy production coefficient.
1.0000E+00 gls_sigk GLS constant Schmidt number for TKE.
1.3000E+00 gls_sigp GLS constant Schmidt number for PSI.
1400.000 charnok_alpha Charnok factor for Zos calculation.
0.500 zos_hsig_alpha Factor for Zos calculation using Hsig(Awave).
0.250 sz_alpha Factor for Wave dissipation surface tke flux .
100.000 crgban_cw Factor for Craig/Banner surface tke flux.
3.0000E-04 rdrg Linear bottom drag coefficient (m/s).
2.5000E-02 rdrg2 Quadratic bottom drag coefficient.
1.5000E-02 Zob Bottom roughness (m).
5.0000E-01 Zos Surface roughness (m).
1 Vtransform S-coordinate transformation equation.
1 Vstretching S-coordinate stretching function.
1.0000E+00 theta_s S-coordinate surface control parameter.
1.0000E+00 theta_b S-coordinate bottom control parameter.
0.000 Tcline S-coordinate surface/bottom layer width (m) used
in vertical coordinate stretching.
1025.000 rho0 Mean density (kg/m3) for Boussinesq approximation.
0.000 dstart Time-stamp assigned to model initialization (days).
0.00 time_ref Reference time for units attribute (yyyymmdd.dd)
0.0000E+00 Tnudg(01) Nudging/relaxation time scale (days)
for tracer 01: temp
0.0000E+00 Tnudg(02) Nudging/relaxation time scale (days)
for tracer 02: salt
0.0000E+00 Znudg Nudging/relaxation time scale (days)
for free-surface.
0.0000E+00 M2nudg Nudging/relaxation time scale (days)
for 2D momentum.
0.0000E+00 M3nudg Nudging/relaxation time scale (days)
for 3D momentum.
0.0000E+00 obcfac Factor between passive and active
open boundary conditions.
10.000 T0 Background potential temperature (C) constant.
30.000 S0 Background salinity (PSU) constant.
1027.000 R0 Background density (kg/m3) used in linear Equation
of State.
1.7000E-04 Tcoef Thermal expansion coefficient (1/Celsius).
7.6000E-04 Scoef Saline contraction coefficient (1/PSU).
1.000 gamma2 Slipperiness variable: free-slip (1.0) or
no-slip (-1.0).
T Hout(idBath) Write out time-dependent bathymetry.
T Hout(idFsur) Write out free-surface.
T Hout(idUbar) Write out 2D U-momentum component.
T Hout(idVbar) Write out 2D V-momentum component.
T Hout(idUvel) Write out 3D U-momentum component.
T Hout(idVvel) Write out 3D V-momentum component.
T Hout(idWvel) Write out W-momentum component.
T Hout(idOvel) Write out omega vertical velocity.
T Hout(idTvar) Write out tracer 01: temp
T Hout(idTvar) Write out tracer 02: salt
T Hout(idUbrs) Write out bottom U-current stress.
T Hout(idVbrs) Write out bottom V-current stress.
T Hout(idUbws) Write out wind-induced, bottom U-wave stress.
T Hout(idVbws) Write out wind-induced, bottom V-wave stress.
T Hout(idUbcs) Write out max wind + current, bottom U-wave stress.
T Hout(idVbcs) Write out max wind + current, bottom V-wave stress.
T Hout(idW2xx) Write out 2D radiation stress, Sxx.
T Hout(idW2xy) Write out 2D radiation stress, Sxy.
T Hout(idW2yy) Write out 2D radiation stress, Syy.
T Hout(idWamp) Write out wave height.
T Hout(idWlen) Write out wave length.
T Hout(idWdir) Write out wave direction.
T Hout(idBott) Write out bottom property 01: grain_diameter
T Hout(idBott) Write out bottom property 02: grain_density
T Hout(idBott) Write out bottom property 03: settling_vel
T Hout(idBott) Write out bottom property 04: erosion_stress
T Hout(idBott) Write out bottom property 05: ripple_length
T Hout(idBott) Write out bottom property 06: ripple_height
T Hout(idBott) Write out bottom property 07: bed_wave_amp
T Hout(idBott) Write out bottom property 08: Zo_def
T Hout(idBott) Write out bottom property 09: Zo_app

Output/Input Files:

Output Restart File: ocean_rst.nc
Output History File: ocean_his.nc
Physical parameters File: ROMS/External/ocean_inlet_test.in
Input Grid File: Data/ROMS/Grid/inlet_test_grid.nc

Tile partition information for Grid 01: 0075x0070x0008 tiling: 001x001

tile Istr Iend Jstr Jend Npts

0 1 75 1 70 42000

Tile minimum and maximum fractional grid coordinates:
(interior points only)

tile Xmin Xmax Ymin Ymax grid

0 0.50 75.50 0.50 70.50 RHO-points

0 1.00 75.00 0.50 70.50 U-points

0 0.50 75.50 1.00 70.00 V-points

Maximum halo size in XI and ETA directions:

HaloSizeI(1) = 255
HaloSizeJ(1) = 243
TileSide(1) = 79
TileSize(1) = 5925



Sediment Parameters, Grid: 01
=============================


Size Sd50 Csed Srho Wsed Erate poros
Class (mm) (kg/m3) (kg/m3) (mm/s) (kg/m2/s) (nondim)

1 1.0000E-01 0.0000E+00 2.6500E+03 1.0000E+01 5.0000E-03 0.0000E+00

tau_ce tau_cd tnu2 tnu4 Akt_bak Tnudg
(N/m2) (N/m2) (m2/s) (m4/s) (m2/s) (day)

1 1.0000E-01 1.0000E-02 0.0000E+00 0.0000E+00 5.0000E-06 0.0000E+00

morph_fac
(nondim)

1 1.0000E+01

New bed layer formed when deposition exceeds 0.10000E-01 (m).
Two first layers are combined when 2nd layer smaller than 0.00000E+00 (m).
Rate coefficient for bed load transport = 0.15000E+00

T Hout(idTvar) Write out sediment01: mud_01
T Hout(idfrac) Write out bed fraction, sediment 01: mudfrac_01
T Hout(idfrac) Write out mass, sediment 01: mudmass_01
T Hout(idSbed) Write out BED property 01: bed_thickness
T Hout(idSbed) Write out BED property 02: bed_age
T Hout(idSbed) Write out BED propFatal error in MPI_Irecv: Invalid datatype, error stack:
MPI_Irecv(144): MPI_Irecv(buf=0x60000000003a9790, count=1, INVALID DATATYPE, src=MPI_ANY_SOURCE, tag=1, MPI_COMM_WORLD, request=0x60000000003a9730) failed
MPI_Irecv(110): Null Datatype pointer
rank 0 in job 194 altix450_57952 caused collective abort of all ranks
exit status of rank 0: killed by signal 9
erty 03: bed_porosity
Activated C-preprocessing Options:

INLET_TEST Inlet Test Case
ANA_BPFLUX Analytical bottom passive tracers fluxes.
ANA_BSFLUX Analytical kinematic bottom salinity flux.
ANA_BTFLUX Analytical kinematic bottom temperature flux.
ANA_FSOBC Analytical free-surface boundary conditions.
ANA_INITIAL Analytical initial conditions.
ANA_M2OBC Analytical 2D momentum boundary conditions.
ANA_SEDIMENT Analytical sediment initial conditions.
ANA_SMFLUX Analytical kinematic surface momentum flux.
ANA_SPFLUX Analytical surface passive tracer fluxes.
ANA_SSFLUX Analytical kinematic surface salinity flux.
ANA_STFLUX Analytical kinematic surface temperature flux.
ASSUMED_SHAPE Using assumed-shape arrays.
DJ_GRADPS Parabolic Splines density Jacobian (Shchepetkin, 2002).
DOUBLE_PRECISION Double precision arithmetic.
EAST_FSGRADIENT Eastern edge, free-surface, gradient condition.
EAST_M2GRADIENT Eastern edge, 2D momentum, gradient condition.
EAST_M3GRADIENT Eastern edge, 3D momentum, gradient condition.
FSOBC_REDUCED Using free-surface data in reduced physics condtions
GLS_MIXING Generic Length-Scale turbulence closure.
KANTHA_CLAYSON Kantha and Clayson stability function formulation.
MASKING Land/Sea masking.
MCT_LIB Using Model Coupling Toolkit library.
MIX_S_UV Mixing of momentum along constant S-surfaces.
MPI MPI distributed-memory configuration.
NEARSHORE_MELLOR Nearshore RAdiation Stress Terms.
NONLINEAR Nonlinear Model.
!NONLIN_EOS Linear Equation of State for seawater.
NORTH_FSGRADIENT Northern edge, free-surface, gradient condition.
NORTH_M2REDUCED Northern edge, 2D momentum, reduced-physics condition.
NORTH_M3GRADIENT Northern edge, 3D momentum, gradient condition.
N2S2_HORAVG Horizontal smoothing of buoyancy and shear.
POWER_LAW Power-law shape time-averaging barotropic filter.
PROFILE Time profiling activated .
K_GSCHEME Third-order upstream advection of TKE fields.
!RST_SINGLE Double precision fields in restart NetCDF file.
SEDIMENT Cohesive and noncohesive sediments.
SED_MORPH Allow bottom model elevation to evolve.
SUSPLOAD Activate suspended sediment transport.
SOLVE3D Solving 3D Primitive Equations.
SOUTHERN_WALL Wall boundary at Southern edge.
SPLINES Conservative parabolic spline reconstruction.
SSW_BBL Styles and Glenn Bottom Boundary Layer - modified.
SSW_CALC_ZNOT Internal computation of bottom roughness.
SWAN_COUPLING Two-way SWAN/ROMS coupling.
THREE_GHOST Using three Ghost Points in halo regions.
TS_MPDATA Recursive flux corrected MPDATA 3D advection of tracers.
UV_ADV Advection of momentum.
UV_U3HADVECTION Third-order upstream horizontal advection of 3D momentum.
UV_C4VADVECTION Fourth-order centered vertical advection of momentum.
UV_VIS2 Harmonic mixing of momentum.
VAR_RHO_2D Variable density barotropic mode.
WAVES_OCEAN Two-way wave-ocean models coupling.
WEST_FSGRADIENT Western edge, free-surface, gradient condition.
WEST_M2GRADIENT Western edge, 2D momentum, gradient condition.
WEST_M3GRADIENT Western edge, 3D momentum, gradient condition.

[drews]

I was getting the same error messages shown in red above. The problem went away (and Inlet Test ran correctly) when I switched from

/usr/local/mpich2-1.3.1-pgf90/bin/mpirun

to

/usr/pgi/linux86/8.0/mpi/mpich/bin/mpirun

I suspect the problem came from a mismatch between the compilers used for building the MPI library, the MCT library, and oceanM (ROMS and SWAN).