Ocean Modeling Discussion

Hi Koushik, great study, and thank you for the research that you continue doing about ROMS parallel I/O :!: Let me digest the information and come up with a strategy for more efficient parallel I/O. Are you aware that ROMS has the CPP option NO_WRITE_GRID , which suppresses the definition and ...

Hello All, I have investigated the imbalance further within nf_fwrite2d.F and here are the results --- Imbalance in parallel NetCDF define phase.png Figure 1: Further Parallel writing Imbalance analysis Observations and Conclusion: 1.The imbalance is flowing as below... -- The imbalance is found in ...

Hello All, I am facing the below issue -- My ROMS code is failing sometimes in the middle while defining the NetCDF files phase. It is completing successfully sometimes and sometimes its failing while defining new quick write files after some time steps (different timesteps in different runs ...

Hello Arango, Thanks for your suggestions. 1.I was not aware of NO_WRITE_GRID flag. I think the imbalance is in writing the GRID arrays. I will perform the analysis with this flag ON and let you know the results. 2.I am doing the analysis for the serial NetCDF writing to compare with the parallel ...

Hello All, Questions are at the last part of this post:(I have explained my oberservations first) I have done IO analysis of writing data into NetCDF files. I have found load imbalance while writing the data. The configuration I have used is as below... 40*36 PEs = 1440 PEs used for simulation in ...

I am using Cray PAT prfiling tool to find the bottlenecks in ROMS application . I have used NetCDF4-HDF5 parallel with 1440 PEs for this experiment and writing 5 Quick files. ! Time-Stepping parameters ---- NTIMES == 1080 DT == 240.0d0 NDTFAST == 54 I have added these 2 flags in the header file to ...

robertson wrote: ↑Fri Dec 06, 2019 9:27 pm Please attach your gbplume.h file where your chosen CPP Definitions are set.

Please find attachec the gbplum.h file
Please let me know if something need to be added as I am new to ROMS.
I think my PARALLEL_IO is not turned on properly although I have turned on USE_PARALLEL_IO in build script.

Where did you get your ROMS code from? That's what I was asking. Hernan's code has PARALLEL_IO, but you say turning that on isn't doing anything. My code does not recognize PARALLEL_IO but instead recognizes PARALLEL_IN and PARALLEL_OUT. A quick check of cppdefs.h should tell you what the options ...

Many years ago our supercomputer center bought a Cray and an IBM. The timings I did without I/O led me to believe that the Cray was the machine for me. However, my real jobs have I/O and that meant that the IBM was actually faster for my problems. At that time, I didn't have a vectorized netCDF ...

I'm using CRAY XC40 and must admit, quite happy with performance (dragonfly net topology), 24 core nodes. Made some benchmarking and it really depends on your application and grid size. Note that depending on users load on scratch you can have totally different results (and you can tweak parallel ...

Great study. We are missing important information about your simulations. We need the grid size and the parallel domain decomposition. I have mentioned frequently in this forum that ROMS scalability is a function of the application and depends on the domain size and parallel partition. There is ...

Hello All, I am working on IO scalability for ROMS model in Cray XC40 machine. I have some observations and some questions as below - 1. When I am not writing any netcdf output file , I observed the model is scaling upto 960 processors(PEs) only.Any reason for that? (Strong Scaling Results -- Varing ...