[Gdal-dev] ogr2ogr on Red Hat Advanced Server 2.1 vs. Red Hat 9

Doug_Newcomb at fws.gov Doug_Newcomb at fws.gov
Fri Sep 5 09:29:13 EDT 2003


Frank,
      I ran valgrind on the cvs version and I got the following:
[dnewcomb at r4gis athens]$ valgrind massspogr.pl
==22625== Memcheck, a.k.a. Valgrind, a memory error detector for x86-linux.
==22625== Copyright (C) 2002, and GNU GPL'd, by Julian Seward.
==22625== Using valgrind-1.9.6, a program instrumentation system for
x86-linux.
==22625== Copyright (C) 2000-2002, and GNU GPL'd, by Julian Seward.
==22625== Estimated CPU clock rate is 1503 MHz
==22625== For more details, rerun with: -v
==22625==
==22625== Invalid write of size 4
==22625==    at 0x80854ED: S_cl_init (in /usr/bin/perl)
==22625==    by 0x8088245: Perl_pregcomp (in /usr/bin/perl)
==22625==    by 0x807D910: Perl_pmruntime (in /usr/bin/perl)
==22625==    by 0x8078704: Perl_yyparse (in /usr/bin/perl)
==22625==    Address 0xBFFEBB80 is just below %esp.  Possibly a bug in
GCC/G++
==22625==    v 2.96 or 3.0.X.  To suppress, use:
--workaround-gcc296-bugs=yes
==22625==

-------------------------------------------------------------------------------------------------------------------------------------------------------------------------
This was repeated several times  and ended with
shapedir = /gis/import/nwi/athens/aonia_l.prj
prjnam =
quadname=aonia_l
deleting /oracle/data1/gisdata/SERegion/nwi/athens/aonia_l.shp
ERROR 4: Failed to open Shapefile
`/oracle/data1/gisdata/SERegion/nwi/athens/aonia_l.shp'.

ERROR 1: Terminating translation prematurely after failed
translation of layer aonia_l

shape project failed at /usr/local/bin/massspogr.pl line 47, <NWILIST> line
1.
==22625==
==22625== ERROR SUMMARY: 222 errors from 24 contexts (suppressed: 3 from 1)
==22625== malloc/free: in use at exit: 314201 bytes in 6533 blocks.
==22625== malloc/free: 12803 allocs, 6270 frees, 745643 bytes allocated.
==22625== For a detailed leak analysis,  rerun with: --leak-check=yes
==22625== For counts of detected errors, rerun with: -v
---------------------------------------------------------------------------------------

So, I reran valgrind with --leak-check=yes and --trace-child=yes and got
the following:

 valgrind --trace-children=yes --leak-check=yes massspogr.pl
==22640== Memcheck, a.k.a. Valgrind, a memory error detector for x86-linux.
==22640== Copyright (C) 2002, and GNU GPL'd, by Julian Seward.
==22640== Using valgrind-1.9.6, a program instrumentation system for
x86-linux.
==22640== Copyright (C) 2000-2002, and GNU GPL'd, by Julian Seward.
==22640== Estimated CPU clock rate is 1508 MHz
==22640== For more details, rerun with: -v
==22640==
==22640== Invalid write of size 4
==22640==    at 0x80854ED: S_cl_init (in /usr/bin/perl)
==22640==    by 0x8088245: Perl_pregcomp (in /usr/bin/perl)
==22640==    by 0x807D910: Perl_pmruntime (in /usr/bin/perl)
==22640==    by 0x8078704: Perl_yyparse (in /usr/bin/perl)
==22640==    Address 0xBFFEB3D0 is just below %esp.  Possibly a bug in
GCC/G++
==22640==    v 2.96 or 3.0.X.  To suppress, use:
--workaround-gcc296-bugs=yes
==22640==
-----------------------------------------------------------------------------------
repeated several times and then
-----------------------------------------------------------------------------------
shapedir = /gis/import/nwi/athens/aonia_l.prj
prjnam =
quadname=aonia_l
deleting /oracle/data1/gisdata/SERegion/nwi/athens/aonia_l.shp
==22641== Memcheck, a.k.a. Valgrind, a memory error detector for x86-linux.
==22641== Copyright (C) 2002, and GNU GPL'd, by Julian Seward.
==22641== Using valgrind-1.9.6, a program instrumentation system for
x86-linux.
==22641== Copyright (C) 2000-2002, and GNU GPL'd, by Julian Seward.
==22641== Estimated CPU clock rate is 1509 MHz
==22641== For more details, rerun with: -v
==22641==
==22641== Memcheck, a.k.a. Valgrind, a memory error detector for x86-linux.
==22641== Copyright (C) 2002, and GNU GPL'd, by Julian Seward.
==22641== Using valgrind-1.9.6, a program instrumentation system for
x86-linux.
==22641== Copyright (C) 2000-2002, and GNU GPL'd, by Julian Seward.
==22641== Estimated CPU clock rate is 1504 MHz
==22641== For more details, rerun with: -v
==22641==
==22641== FATAL: M_PROCMAP_BUF is too small; increase it and recompile
shape project failed at /usr/local/bin/massspogr.pl line 47, <NWILIST> line
1.
==22640==
==22640== ERROR SUMMARY: 222 errors from 24 contexts (suppressed: 3 from 1)
==22640== malloc/free: in use at exit: 314239 bytes in 6533 blocks.
==22640== malloc/free: 12803 allocs, 6270 frees, 745681 bytes allocated.
==22640== For counts of detected errors, rerun with: -v
==22640== searching for pointers to 6533 not-freed blocks.
==22640== checked 4985440 bytes.
==22640==
==22640== LEAK SUMMARY:
==22640==    definitely lost: 0 bytes in 0 blocks.
==22640==    possibly lost:   0 bytes in 0 blocks.
==22640==    still reachable: 314239 bytes in 6533 blocks.
==22640==         suppressed: 0 bytes in 0 blocks.
==22640== Reachable blocks (those to which a pointer was found) are not
shown.
==22640== To see them, rerun with: --show-reachable=yes
==22640==

I'm not an expert, but it doesn't look like perl is happy.  I see the
M_PROCMAP_BUF is too small message above.  Does that refer to perl or
ogr2ogr?

According to rpm -qa|grep perl, I have the following loaded:

perl-NDBM_File-1.75-26.72.4
perl-MIME-Base64-2.12-6
perl-DB_File-1.75-26.72.4
perl-DateManip-5.39-5
perl-XML-Twig-2.02-2
openssl-perl-0.9.6b-32.7
groff-perl-1.17.2-7.0.2
perl-XML-Grove-0.46alpha-3
gimp-perl-1.2.1-7
perl-CGI-2.752-26.72.4
perl-XML-Encoding-1.01-2
perl-5.6.1-26.72.4
perl-Digest-MD5-2.13-1
perl-libwww-perl-5.53-3
perl-SGMLSpm-1.03ii-4
perl-libnet-1.0703-6
perl-XML-Parser-2.30-7
mod_perl-1.26-2
perl-CPAN-1.59_54-26.72.4
perl-Storable-0.6.11-6
perl-XML-Dumper-0.4-5
perl-DBI-1.18-1
perl-Parse-Yapp-1.04-3
perl-libxml-enno-1.02-5
perl-libxml-perl-0.07-5
perl-URI-1.12-5
perl-HTML-Parser-3.25-2
perl-HTML-Tagset-3.03-3

      This should be the most "up2date" for Red Hat Advanced Server 2.1.

BTW, the Red Hat 9 box bombed on one run in a similar fashion, but I have
been unable to repeat it.

I have attached the complete capture of the valgrind outputs since I
probably generalized too much.


Doug Newcomb
Raleigh, NC


(See attached file: valgrindout.txt)(See attached file:
valgrindoutlchk.txt)









                                                                                                                                  
                      Frank Warmerdam                                                                                             
                      <warmerdam at pobox.com>         To:      gdal-dev at remotesensing.org                                           
                      Sent by:                      cc:                                                                           
                      gdal-dev-admin at remote         Subject: Re: [Gdal-dev] ogr2ogr on Red Hat Advanced Server 2.1 vs. Red Hat 9  
                      sensing.org                                                                                                 
                                                                                                                                  
                                                                                                                                  
                      09/04/2003 09:46 AM                                                                                         
                      Please respond to                                                                                           
                      gdal-dev                                                                                                    
                                                                                                                                  
                                                                                                                                  




Doug_Newcomb at fws.gov wrote:
> Hi Folks,
>       I'm running into some strangeness with ogr2ogr .  I am reprojecting
> the nwi quadrangle shapefiles  (ftp://www.nwi.fws.gov/shapedata ) using
> ogr2ogr called in a perl script  in the following fashion.
>
>  ogr2ogr -t_srs "NAD83" -f "ESRI Shapefile" $destnwi  $nwishape
>
> where $nwishape is the name of the input shape file and $destnwi is the
> name of the destination directory.
> I have the following as output:
>
> shapedir = /gis/import/nwi/athens/aonia_l.prj  #echoing the input
filename
> quadname=aonia_l                                                  #
echoing
> the quad filename
> deleting /oracle/data1/gisdata/SERegion/nwi/athens/aonia_l.shp  # delete
> the output shape file if it exists
>
> ERROR 4: Failed to open Shapefile
> `/oracle/data1/gisdata/SERegion/nwi/athens/aonia_l.shp'.
>
> ERROR 1: Terminating translation prematurely after failed
> translation of layer aonia_l
>
> A single file , aonia_l.shp is created with size 0 (according to ls -al)
.

Doug,

I don't know why this failing, expecially with the error message you are
seeing.
If the issue where create permissions for the shapefile, I would expect
nothing
to be created.  It might be helpful to set "CPL_DEBUG=ON" in your
environment
to get additional information.  Also, if you can run things under valgrind
that
might provide some useful information.

I would appreciate anything you can do to narrow down this problem to
something
I might be able to reproduce and debug.

PS. You have some nice systems!

Best regards,

--
---------------------------------------+--------------------------------------

I set the clouds in motion - turn up   | Frank Warmerdam,
warmerdam at pobox.com
light and sound - activate the windows | http://pobox.com/~warmerdam
and watch the world go round - Rush    | Geospatial Programmer for Rent


_______________________________________________
Gdal-dev mailing list
Gdal-dev at remotesensing.org
http://remotesensing.org/mailman/listinfo/gdal-dev




-------------- next part --------------
A non-text attachment was scrubbed...
Name: valgrindout.txt
Type: application/octet-stream
Size: 11896 bytes
Desc: not available
Url : http://lists.osgeo.org/pipermail/gdal-dev/attachments/20030905/77a2ab11/valgrindout.obj
-------------- next part --------------
A non-text attachment was scrubbed...
Name: valgrindoutlchk.txt
Type: application/octet-stream
Size: 13058 bytes
Desc: not available
Url : http://lists.osgeo.org/pipermail/gdal-dev/attachments/20030905/77a2ab11/valgrindoutlchk.obj


More information about the Gdal-dev mailing list