Size limitation for simple domain grid?Size limitation for simple domain grid?https://oss.deltares.nl/c/message_boards/find_thread?p_l_id=1806765&threadId=2441662021-03-09T11:24:42Z2021-03-09T11:24:42ZRE: Size limitation for simple domain grid?Qinghua Yehttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=13359282017-09-25T09:36:50Z2017-09-25T09:36:50ZHi Kyssyanne,<br /><br />If you used the latest release in the service package or compiled a 64-bits version binary by yourself, the problem should be solved.<br /><br />Greetings,<br /><br />QinghuaQinghua Ye2017-09-25T09:36:50ZRE: Size limitation for simple domain grid?Kyssyanne Oliveirahttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=13334492017-09-22T01:39:07Z2017-09-22T01:39:07ZHi Qinghua,<br /><br />I recently set up a model with over 132,864 grid points (grid resolution 300 meters) and plus 14 layers. My time step is 0.4 minute.<br />I had a memory issue when the sediment process was activated. The error below appeared:<br />*** MESSAGE Executable for 32-bits platform. <br />*** MESSAGE Double precision computation using reals of kind 8 <br />*** ERROR in double array allocation of wrkc3 <br />Contact Deltares<br />*** ERROR Flow exited abnormally <br /><br />I switched to single-precision following the instruction you provided in the forum. <br />After this, I am getting vertical wiggle warning "“*** WARNING Vertical wiggle for l, m, n, nst:", since the first time step. The warning appears near the "continental shelf break", where the bottom has a steep gradient.<br />In my model, I have waves (stationary model + wind), tidal, salinity and now sediment process (two sediment fractions - 1 non-cohesive and 1 cohesive).Kyssyanne Oliveira2017-09-22T01:39:07ZRE: Size limitation for simple domain grid?Edwin Wanghttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7443402015-10-09T19:55:25Z2015-10-09T19:55:25ZThanks.Edwin Wang2015-10-09T19:55:25ZRE: Size limitation for simple domain grid?Adri Mouritshttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7404512015-10-05T11:16:50Z2015-10-05T11:16:50ZHi Edwin,<br /><br />The number of Forester filter iterations is hard coded. Search for parameter "maxfil" in ".../src/engines_gpl/flow2d3d/packages/kernel/src/compute/forfil.f90" and/or "z_forfil.f90". When changing it, recompilation is needed.<br /><br />Regards,<br /><br />AdriAdri Mourits2015-10-05T11:16:50ZRE: Size limitation for simple domain grid?Edwin Wanghttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7267182015-09-14T16:45:08Z2015-09-14T16:45:08ZHi Adri,<br /><br />Thanks. One last question with respect to this subject - Is there a keyword to modify the number of iterations or is this hard coded and would require recompiling the program?<br /><br />EdwinEdwin Wang2015-09-14T16:45:08ZRE: Size limitation for simple domain grid?Adri Mouritshttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7246712015-09-10T10:16:35Z2015-09-10T10:16:35ZHi Edwin,<br /><br />It seems that the vertical Forester filter is doing its work. The maximum number of iterations is 1000. The warning occurs when there are still wiggles after 1000 iterations. It's a notification that if instabilities occur in that area it will probably have a numerical reason. (You should decrease the timestep size if that happens.) But if the wiggles are acceptably small, you shouldn't be worried.<br /><br />If the warning only occurs in single precision, the values of the related parameters are probably in the range of "single precision" machine precision (1e-6, 1e-8). The resulting wiggles in the order of 1e-4 also point in that direction. The additional precision in "double precision" mode might just be enough to need less Forester filter iterations and avoid the generation of the related warning.<br /><br />To summarize: If the results are fine, don't bother about this warning.<br /><br />Regards,<br /><br />AdriAdri Mourits2015-09-10T10:16:35ZRE: Size limitation for simple domain grid?Edwin Wanghttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7207052015-09-03T16:31:06Z2015-09-03T16:31:06ZHi Adri,<br /><br />Thanks for the response.<br /><br />As part of the debugging process, I set up a simple model instead of DD models.<br /><br />Here is what I did:<br />- model domain: a rectangular basin with no open boundaries.<br />- number of layers: 15<br />- initial condition: uniform value of 31.0<br />- Forrester filter = YES for horizontal and vertical.<br /><br />When I ran the model using the single precision dll file (flow2d3d_sp.dll) and received the vertical wiggle warning. I looked at the output and salinity profile is wiggled as one would expect... but the salinity difference between layers is really small, like in the order of 1e-4 or so.<br /><br />When I ran the model using the original double precision dll file, no warning message and the salinity profile looks uniform. This was why I think single precision is the cause to the problem.<br /><br />EdwinEdwin Wang2015-09-03T16:31:06ZRE: Size limitation for simple domain grid?Adri Mouritshttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7205112015-09-03T12:11:45Z2015-09-03T12:11:45ZHi Edwin,<br /><br />I don't expect a relation between "single precision" and "salinity induced verticle wiggles". Did you switch on salinity in all subdomains? Is your initial salinity condition stable enough? Are your open boundary conditions correct? Can you analyse the ponts/cells where the instability occur? Are they close to an open boundary, or DD boundary?<br /><br />Regards,<br /><br />AdriAdri Mourits2015-09-03T12:11:45ZRE: Size limitation for simple domain grid?Edwin Wanghttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=7182322015-08-31T23:34:07Z2015-08-31T23:34:07ZHi Qinghua,<br /><br />I recently set up a model with over 150,000 grid points and plus 20 layers. I ran into the memory issue. I switched to single-precision following the instruction you provided in this thread. The model works fine. However, when I activated "Salinity" and set initial salinity to 31, I am getting vertical wiggle warning "“*** WARNING Vertical wiggle for l, m ,n, nst: 1 81 10 737" within a few time steps. I have already turned on Forrester Filter. Any thought on why this happened?<br /><br />EdwinEdwin Wang2015-08-31T23:34:07ZRE: Size limitation for simple domain grid?Qinghua Yehttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=2447702013-02-25T08:36:38Z2013-02-25T08:36:38ZHi Ernesto,<br /><br />It is possible because the model is too big and windows cannot handle such big heap size. You can check how much memory is used by Delft3D-FLOW, using the task manager (Windows) or the "top"-command (Linux).<br /><br />There are 3 options:<br /><br />1) Simplify your model; decrease the number of cells in a dimension, or the number of processes/constituents<br />2) Use the single precision executable of Delft3D-FLOW (see information below)<br />3) Using Linux 64-bit version.<br /><br />2. Use the single precision Delft3D-FLOW executable<br />===================================================<br />With the following steps, the single precision binary is used instead of the double precision binary:<br />a) Go to the directory where Delft3D is installed. Go to subdirectory "delft3d/w32/flow/bin"<br />b) Disable the double precision binary:<br /> Rename "flow2d3d.dll" into "flow2d3d_dp.dll"<br />c) Enable the single precision binary:<br /> Rename "flow2d3d_sp.dll" into "flow2d3d.dll"<br />d) Check what version is used when running your model:<br /> A file is created each time a calculation is started named "tri-diag.<runid>", containing one of the following lines:<br /> *** MESSAGE Double precision computation using reals of kind 8<br /> *** MESSAGE Single precision computation using reals of kind 4<br /><br />Regards,<br /><br />QinghuaQinghua Ye2013-02-25T08:36:38ZSize limitation for simple domain grid?Ernesto Molinashttps://oss.deltares.nl/c/message_boards/find_message?p_l_id=1806765&messageId=2441652013-02-22T20:21:48Z2013-02-22T20:21:48ZI'm trying to figure if there is a size limitation for simple domain grids. The model i tried to run was quite large (about 61.000 cells) and i found the following errors: <br /><br />*** MESSAGE Executable for 32-bits platform. <br />*** MESSAGE Double precision computation using reals of kind 8 <br /> *** ERROR in double array allocation of wrkc3 <br /> Contact Deltares<br />*** ERROR Flow exited abnormally <br /><br />After this,I derefined the grid and it worked. does it make sense? Is there any limitation for grid size?<br />Could Domain Decomposition be a good solution for this issue?<br /><br />thanks,Ernesto Molinas2013-02-22T20:21:48Z