Hi,<br>I have added the GeoServer mailing list to the CC since that type of issue could have been already encountered by the GeoServer people.<br><br>Being the number of datasets composing your coverage, very high, making a pyramid could be an option.<br>
(Simone Giannecchini is working on some improvements on the Pyramid plugin, I will work on a tutorial on it).<br>By this way, when accessing data at "lower zoom levels/wort resolution" geoserver will access to a reduced number of files.<br>
<br>Some quick questions on your test case:<br>- which geoserver version?<br>- what is the values of the properties USE_JAI_IMAGEREAD and the ALLOW/USE_MULTITHREADING on your coverage configuration?<br><br>Best Regards,<br>
Daniele<br><br><br><div class="gmail_quote">On Fri, Sep 18, 2009 at 7:15 AM, Boyd, David W. <span dir="ltr"><<a href="mailto:DAVID.W.BOYD@saic.com">DAVID.W.BOYD@saic.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<div>
<p><font size="2">All:<br>
First, I apologize if this is too much a newbie post, but I need to<br>
know if I can make this work or need to find another tact.<br>
<br>
I have some NGA Raster Product Format (RPF) data. I have ~45K NITF<br>
files in this data set. All use the NGA standard compression for RPF.<br>
I have set these up as a coverage in Geoserver using the<br>
ImageMosaic plugin and things work fine<br>
with the demo openlayers app in the single image mode. However if I<br>
change the demo openlayers app to use tiled mode or try and access<br>
this coverage through geowebcache (which uses tiled mode) Java crashes.<br>
I have been able to repeat this steadily. However from the log files<br>
it does not appear to be a specific file.<br>
<br>
I guess my question is if this is a known issue and if there<br>
is any work around?<br>
<br>
Any suggestions for large RPF data sets and using them with Geoserver?<br>
<br>
I am running under Red Hat Linux 5.4.<br>
The gdal share lib version is 1.11.4 and came from the prebuilt<br>
versions for Geoserver.<br>
<br>
<br>
The following is the output from my latest jboss crash:<br>
> 04:33:27,021 INFO [STDOUT] 18 Sep 04:33:27 DEBUG [org.geotools.gce.imagemosai]<br>
> - reading file: /geodata/data/AFGHANISTAN/CB01NI423I2/RPF/NI423I2/02813V2B.I42<br>
> 04:33:27,029 INFO [STDOUT] 18 Sep 04:33:27 DEBUG [org.geotools.gce.imagemosai]<br>
> - Adding to mosaic image number 46<br>
> 04:33:27,030 INFO [STDOUT] 18 Sep 04:33:27 DEBUG [org.geotools.gce.imagemosai]<br>
> - Loading raster data for granule org.geotools.gce.imagemosaic.Granule@9b675b<br>
> 04:33:27,040 INFO [STDOUT] 18 Sep 04:33:27 DEBUG [org.geotools.gce.imagemosai]<br>
> - Loading level 0 with source region java.awt.Rectangle[x=85,y=0,width=1451,hei<br>
> ght=1536]<br>
> *** glibc detected *** /usr/java/jre1.5.0_19/bin/java: corrupted double-linked l<br>
> ist: 0x24422c40 ***<br>
> ======= Backtrace: =========<br>
> /lib/libc.so.6[0xb7e1b9f8]<br>
> /lib/libc.so.6[0xb7e1d4d2]<br>
> /lib/libc.so.6(cfree+0x59)[0xb7e1d9d9]<br>
> /opt/gdallibs/libgdal.so.1(VSIFree+0x21)[0x21ec5be1]<br>
> /opt/gdallibs/libgdal.so.1(_ZN15GDALRasterBlockD0Ev+0x43)[0x21eb5083]<br>
> /opt/gdallibs/libgdal.so.1(_ZN14GDALRasterBand10FlushBlockEii+0xf3)[0x21eb3483]<br>
> /opt/gdallibs/libgdal.so.1(_ZN14GDALRasterBand10FlushCacheEv+0x5d)[0x21eb351d]<br>
> /opt/gdallibs/libgdal.so.1(_ZN11GDALDataset10FlushCacheEv+0x32)[0x21ea5212]<br>
> /opt/gdallibs/libgdal.so.1(_ZN14GDALPamDataset10FlushCacheEv+0x22)[0x21eaea62]<br>
> /opt/gdallibs/libgdal.so.1(_ZN11NITFDataset10FlushCacheEv+0x30)[0x21e0a160]<br>
> /opt/gdallibs/libgdal.so.1(_ZN11NITFDatasetD0Ev+0x2a)[0x21e0b31a]<br>
> /opt/gdallibs/libgdal.so.1(GDALClose+0x9a)[0x21ea591a]<br>
> /opt/gdallibs/libgdaljni.so(Java_org_gdal_gdal_gdalJNI_delete_1Dataset+0x37)[0x2<br>
> 29177ff]<br>
> [0xb1875731]<br>
> ======= Memory map: ========<br>
> 08048000-08057000 r-xp 00000000 08:04 356249 /usr/java/jre1.5.0_19/bin/java<br>
> 08057000-08059000 rwxp 0000e000 08:04 356249 /usr/java/jre1.5.0_19/bin/java<br>
> 095ce000-0be75000 rwxp 095ce000 00:00 0 [heap]<br>
> 1fadc000-1fadf000 --xp 1fadc000 00:00 0<br>
> 1fadf000-1fb5d000 rwxp 1fadf000 00:00 0<br>
> 1fb5d000-1fb60000 --xp 1fb5d000 00:00 0<br>
> 1fb60000-1fbde000 rwxp 1fb60000 00:00 0<br>
> 1fbde000-1fbe1000 --xp 1fbde000 00:00 0<br>
> 1fbe1000-1fc5f000 rwxp 1fbe1000 00:00 0<br>
> 1fc5f000-1fc62000 --xp 1fc5f000 00:00 0<br>
> 1fc62000-1fce0000 rwxp 1fc62000 00:00 0<br>
> 1fce0000-1fce3000 --xp 1fce0000 00:00 0<br>
> 1fce3000-1fd61000 rwxp 1fce3000 00:00 0<br>
> 1fd61000-200de000 r-xp 00000000 08:04 356982 /usr/java/jre1.5.0_19/lib/i386/<br>
> libmlib_jai.so<br>
> 200de000-200e0000 rwxp 0037d000 08:04 356982 /usr/java/jre1.5.0_19/lib/i386/<br>
> libmlib_jai.so<br>
> 200e0000-200e3000 --xp 200e0000 00:00 0<br>
> 200e3000-20161000 rwxp 200e3000 00:00 0<br>
> 20161000-201db000 r-xp 00000000 08:04 356336 /usr/java/jre1.5.0_19/lib/i386/<br>
> libfontmanager.so<br>
> 201db000-201e5000 rwxp 0007a000 08:04 356336 /usr/java/jre1.5.0_19/lib/i386/<br>
> libfontmanager.so<br>
> 201e5000-201e9000 rwxp 201e5000 00:00 0<br>
> 201e9000-20253000 r-xs 00000000 08:04 940150 /opt/<a href="http://jboss-4.2.3.GA/server/defa" target="_blank">jboss-4.2.3.GA/server/defa</a><br>
> ult/deploy/geoserver.war/WEB-INF/lib/xstream-1.3.1.jar<br>
> 20253000-20300000 r-xs 00000000 08:04 940090 /opt/<a href="http://jboss-4.2.3.GA/server/defa" target="_blank">jboss-4.2.3.GA/server/defa</a><br>
> ult/deploy/geoserver.war/WEB-INF/lib/xsd-2.2.2.jar<br>
> 20300000-203fa000 rwxp 20300000 00:00 0<br>
> 203fa000-20400000 --xp 203fa000 00:00 0<br>
> 20400000-2047c000 rwxp 20400000 00:00 0<br>
> 2047c000-20500000 --xp 2047c000 00:00 0<br>
> 20500000-205d1000 rwxp 20500000 00:00 0<br>
> 205d1000-20600000 --xp 205d1000 00:00 0<br>
> 20600000-20700000 rwxp 20600000 00:00 0<br>
> 20725000-20800000 r-xs 00000000 08:04 940116 /opt/<a href="http://jboss-4.2.3.GA/server/defa" target="_blank">jboss-4.2.3.GA/server/defa</a><br>
> ult/deploy/geoserver.war/WEB-INF/lib/xercesImpl-2.4.0.jar<br>
> 20800000-208fa000 rwxp 20800000 00:00 0<br>
> 208fa000-20900000 --xp 208fa000 00:00 0<br>
> 20900000-209de000 rwxp 20900000 00:00 0<br>
> 209de000-20a00000 --xp 209de000 00:00 0<br>
> 20a00000-20af2000 rwxp 20a00000 00:00 0<br>
> 20af2000-20b00000 --xp 20af2000 00:00 0<br>
> 20b7f000-20b82000 --xp 20b7f000 00:00 0<br>
> 20b82000-20d00000 rwxp 20b82000 00:00 0<br>
> 20d00000-20de2000 rwxp 20d00000 00:00 0<br>
> 20de2000-20e00000 --xp 20de2000 00:00 0<br>
> 20e7f000-20e82000 --xp 20e7f000 00:00 0<br>
> 20e82000-20f00000 rwxp 20e82000 00:00 0<br>
> 20f00000-21700000 r-xs 00000000 08:04 810257 /tmp/Geotools/Databases/HSQL/EP<br>
> SG.data<br>
> 21700000-217f6000 rwxp 21700000 00:00 0<br>
> 217f6000-21800000 --xp 217f6000 00:00 0<br>
> 21800000-21900000 rwxp 21800000 00:00 0<br>
> 2197f000-21982000 --xp 2197f000 00:00 0<br>
> 21982000-21aff000 rwxp 21982000 00:00 0<br>
> 21aff000-21b00000 --xp 21aff000 00:00 0<br>
> 21b07000-21b1c000 r-xp 00000000 08:04 356333 /usr/java/jre1.5.0_19/lib/i386/<br>
> libdcpr.so<br>
> 21b1c000-21b2f000 rwxp 00014000 08:04 356333 /usr/java/jre1.5.0_19/lib/i386/<br>
> libdcpr.so<br>
> 21b2f000-21b32000 --xp 21b2f000 00:00 0<br>
> 21b32000-21bb0000 rwxp 21b32000 00:00 0<br>
> 21bb0000-2217b000 r-xp 00000000 08:04 712532 /opt/gdallibs/libgdal.so.1.11.4<br>
><br>
> 2217b000-221e3000 rwxp 005cb000 08:04 71./run.sh: line 255: 11993 Aborted<br>
> "$JAVA" $JAVA_OPTS -Djava.endorsed.dirs="$JBOSS_ENDORSED_DIRS" -classp<br>
> ath "$JBOSS_CLASSPATH" org.jboss.Main "$@"<br>
<br>
<br>
<br>
--<br>
========= <a href="mailto:david.w.boyd@saic.com" target="_blank">mailto:david.w.boyd@saic.com</a> ============<br>
<br>
David W. Boyd<br>
VP, Chief Technical Officer<br>
Advanced Intelligence Solutions Operation<br>
<br>
6359 Walker Ln, Suite 100<br>
Alexandria, Va 22310<br>
<br>
US voice: +1-703-253-6960<br>
fax: +1-703-253-1061<br>
US cell: +1-703-402-7908<br>
============== <a href="http://www.saic.com/" target="_blank">http://www.saic.com/</a> ============<br>
</font>
</p>
</div>
<br>_______________________________________________<br>
gdal-dev mailing list<br>
<a href="mailto:gdal-dev@lists.osgeo.org">gdal-dev@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/gdal-dev" target="_blank">http://lists.osgeo.org/mailman/listinfo/gdal-dev</a><br></blockquote></div><br><br clear="all"><br>-- <br>-------------------------------------------------------<br>
Eng. Daniele Romagnoli <br>Software Engineer<br><br>GeoSolutions S.A.S.<br>Via Carignoni 51<br>55041 Camaiore (LU)<br>Italy<br><br>phone: +39 0584983027<br>fax: +39 0584983027<br>mob: +39 328 0559267<br><br><br><a href="http://www.geo-solutions.it">http://www.geo-solutions.it</a><br>
<br>-------------------------------------------------------<br><br>