Forum

RE: NetCDF3 export capacity

MM
Mason Marchildon, modified 1 Month ago.

NetCDF3 export capacity

Rookie Crystal gazer Posts: 15 Join Date: 5/1/17 Recent Posts
I'm trying to export time-series data using export type NETCDF-CF_TIMESERIES for 100 years of daily data at 3000 locations and I'm getting an error: "Illegal argument Variable starting pos=2297032636 may not exceed 2147483647 passed at ucar.nc2.iosp.netcdf3.N3header.create:602"

looking online, it appears that I've exceeded the netCDF-3 Classic Format file size limit. Apparently, there's an argument "-isLargeFile" that can be added to the netCDF call (e.g., "java -classpath netcdfAll-4.6.13.jar ucar.nc2.dataset.NetcdfDataset -in <path> -out <path> -isLargeFile") that allows for the writing of a 64-bit Offset netCDF-3 format file.  Can arguments such as "-isLargeFile" be added to the NETCDF-CF_TIMESERIES call? If not, is there another suggested means of exporting large time-series data?

Thanks
IM
Ivo Miltenburg, modified 26 Days ago.

RE: NetCDF3 export capacity

Rookie Crystal gazer Posts: 10 Join Date: 3/12/13 Recent Posts
Hi Mason,
If you try and export the timeseries through a general adapter run, in stead of through the timeseries Export module, you have the possibility to define the NetCDF write format of "netcdf4" in the timeSeriesExportRun as a property, e.g.:

</general>
<properties>
            <string key="netCDFWriteFormat" value=" netcdf4"/>
</properties> 
<timeSeriesSet>

This might allow you to export the timeseries in one file. Take a look at: https://publicwiki.deltares.nl/display/FEWSDOC/05+General+Adapter+Module#id-05GeneralAdapterModule-exportNetcdfActivity
MM
Mason Marchildon, modified 26 Days ago.

RE: NetCDF3 export capacity

Rookie Crystal gazer Posts: 15 Join Date: 5/1/17 Recent Posts
That did it! thanks.  (It was about time that I started working general adapters.)