[GRASS-user] Temporal framework: calculating annual 5-day extremes

[Moritz Lennert]

On 07/04/17 12:45, RichardCooper wrote:
> Many thanks for the suggestions.
>
> I'd really like to use the voxel approach but am getting the following error
> on running t.rast.to.rast3 to create a voxel.
>
> I've increased the hard and soft limits for open files to 40000 on my
> system, but I still am unable to convert a space time raster dataset  into a
> 3D raster map with only 5000 raster layers (note: I have 50K daily raster
> layers that I need to analyse i voxel)
>
> $ cat /proc/sys/fs/file-max
> 800532
> $ ulimit -Sn
> 400000
> $ ulimit -Hn
> 400000
>

AFAICT, the issue is not with the number of open files, but with a list 
of map names (arguments) that is too long for the run_command call that 
calls r.to.rast3. A solution to this could be to allow as input to 
r.to.rast3 a file with map names (such as for r.series).

You should create a bug report for this.

Moritz



> Thanks,
> Richard
>
>
> Creation of STRDS and error on trying to convert to 3D data set:
> t.create output=capha_test_5 temporaltype=relative semantictype=max
> title=cahpa_test_5 description=cahpa_test_5
>
> t.register --overwrite --verbose input=capha_test_5 at cahpa
> file=/home/rcooper/grassdatacl/climdata/cahpa/.tmp/rcooper-dell/3528.4
> start=1 unit=day increment=1
> Gathering map information...
> Registering maps in the temporal database...
> Registering maps in the space time dataset...
> Updating space time dataset...
> Update metadata, spatial and temporal extent from all registered maps of
> <capha_test_5 at cahpa>
> Update metadata, spatial and temporal extent from all registered maps of
> <capha_test at cahpa>
> Update metadata, spatial and temporal extent from all registered maps of
> <capha_test_50 at cahpa>
> Update metadata, spatial and temporal extent from all registered maps of
> <capha_test_25 at cahpa>
> Update metadata, spatial and temporal extent from all registered maps of
> <capha_test_10 at cahpa>
>
> t.rast.to.rast3 --overwrite --verbose input=capha_test_5 at cahpa
> output=cahpa_test_5_3d
> Traceback (most recent call last):
>   File "/usr/local/grass-7.2.0/scripts/t.rast.to.rast3",
> line 194, in <module>
>     main()
>   File "/usr/local/grass-7.2.0/scripts/t.rast.to.rast3",
> line 152, in main
>     output=output, overwrite=grass.overwrite())
>   File
> "/usr/local/grass-7.2.0/etc/python/grass/script/core.py",
> line 408, in run_command
>     ps = start_command(*args, **kwargs)
>   File
> "/usr/local/grass-7.2.0/etc/python/grass/script/core.py",
> line 377, in start_command
>     return Popen(args, **popts)
>   File
> "/usr/local/grass-7.2.0/etc/python/grass/script/core.py",
> line 74, in __init__
>     subprocess.Popen.__init__(self, args, **kwargs)
>   File "/usr/lib/python2.7/subprocess.py", line 710, in
> __init__
>     errread, errwrite)
>   File "/usr/lib/python2.7/subprocess.py", line 1327, in
> _execute_child
>     raise child_exception
> OSError: [Errno 7] Argument list too long
> (Fri Apr  7 17:30:33 2017) Command finished (2 sec)
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> --
> View this message in context: http://osgeo-org.1560.x6.nabble.com/Temporal-framework-calculating-annual-5-day-extremes-tp5316014p5316291.html
> Sent from the Grass - Users mailing list archive at Nabble.com.
> _______________________________________________
> grass-user mailing list
> grass-user at lists.osgeo.org
> https://lists.osgeo.org/mailman/listinfo/grass-user
>