[pgpointcloud] Importing to pgpointcloud

[Roger Bedell]

Hi Howard,
I think something is not quite right in Windows-land.

1) I was not able to compile in release mode in Win32, lots of errors that
I did not chase down yet.
2) On my laptop, I get the memory fault with a single cache_block.
3) On the server, it works reasonably well, but still fairly slow (although
faster than with 3 cache blocks). It is good enough for now.
4) I tried just exporting to the las file like you did on the server, and
it is about the same speed as the pgpointcloud pipeline, about 5 minutes
for the sample file on a pretty fast machine.
5) I never did try the branch you sent me, this is the main branch from
last week that I'm testing.

So, I'm going to leave it the way it is for now while I do some other
things, like export and visualization. I'll come back to the speed and
compile issues later on.

Thanks for your help!
Roger


On Thu, Jul 18, 2013 at 10:27 PM, Howard Butler <hobu.inc at gmail.com> wrote:

> Any news on this?
>
> Begin forwarded message:
>
> > From: Howard Butler <hobu.inc at gmail.com>
> > Subject: Re: [pgpointcloud] Importing to pgpointcloud
> > Date: July 17, 2013 7:11:31 PM CDT
> > To: "pgpointcloud at lists.osgeo.org" <pgpointcloud at lists.osgeo.org>
> >
> > A few things to check
> >
> > * Are you built in Release or RelWithDebInfo mode? PDAL defaults to
> debug mode.
> > * What does your PostgreSQL configuration look like?
> >
> > On my 15" Retina MacBook Pro, a pipeline that chips this data at 400
> points per chip and outputs to a LAS file instead of PostgreSQL only takes
> 13 seconds using PDAL/PDAL:master. That includes the reprojection.
> >
> > <Pipeline version="1.0">
> >  <Writer type="drivers.las.writer">
> >    <Option name="filename">output.las</Option>
> >    <Filter type="filters.chipper">
> >      <Option name="capacity">400</Option>
> >      <Filter type="filters.cache">
> >        <Option name="max_cache_blocks">1</Option>
> >        <Filter type="filters.inplacereprojection">
> >          <Option name="out_srs">EPSG:4326</Option>
> >          <Option name="offset_x">-104</Option>
> >          <Option name="offset_y">33</Option>
> >          <Option name="offset_z">0.0</Option>
> >          <Option name="scale_x">0.00000001</Option>
> >          <Option name="scale_y">0.00000001</Option>
> >          <Option name="scale_z">0.001</Option>
> >          <Reader type="drivers.las.reader">
> >            <Option name="filename">36096a8_NW_C.las</Option>
> >          </Reader>
> >        </Filter>
> >      </Filter>
> >    </Filter>
> >  </Writer>
> > </Pipeline>
> >
> > Howard
> >
> > On Jul 17, 2013, at 1:26 PM, Paul Ramsey <pramsey at cleverelephant.ca>
> wrote:
> >
> >> If we're talking 8M features per file, that's still blisteringly slow.
> >>
> >> P
> >>
> >> --
> >> Paul Ramsey
> >> http://cleverelephant.ca
> >> http://postgis.net
> >>
> >>
> >> On Wednesday, July 17, 2013 at 11:24 AM, Roger Bedell wrote:
> >>
> >>> Hello Howard,
> >>> Update on this. I transferred the program to another machine (without
> Visual Studio), and all four files worked fine, at a more reasonable speed
> of around 15 minutes per file.
> >>>
> >>> Roger
> >>>
> >>>
> >>> On Wed, Jul 17, 2013 at 4:04 PM, Roger Bedell <
> rbedell at coordinatesolutions.com (mailto:rbedell at coordinatesolutions.com)>
> wrote:
> >>>> Here are four of them I'm using for testing.
> >>>>
> >>>> http://ogi.state.ok.us/ogi/Downloads%5CLidar%5C36096a8_NW_D.zip
> >>>>
> >>>> I was using 36096a8_NW_C.las and the above pipeline xml. It is a 32
> bit build of PDAL on Windows. If you can point me in the right direction, I
> can run in debug mode in Visual Studio and maybe see something.
> >>>>
> >>>> Roger
> >>>>
> >>>>
> >>>> On Wed, Jul 17, 2013 at 3:36 PM, Howard Butler <hobu.inc at gmail.com(mailto:
> hobu.inc at gmail.com)> wrote:
> >>>>>
> >>>>> On Jul 17, 2013, at 8:21 AM, Roger Bedell <
> rbedell at coordinatesolutions.com (mailto:rbedell at coordinatesolutions.com)>
> wrote:
> >>>>>>
> >>>>>> The problem is I get this error:
> >>>>>>
> >>>>>> C:\Users\roger>c:\dev\pdal\pcpipeline.exe -i
> C:\dev\pdal\ImportLASFile.xml
> >>>>>> Requested to read 8072702 points
> >>>>>> Requested to write 8072702 points
> >>>>>> Buffer capacity is 8072702
> >>>>>> 0Caught exception: bad allocation
> >>>>>>
> >>>>>> Any suggestions?
> >>>>>
> >>>>> Something's overflowing, but I don't have any idea where. Can you
> post the file available for download, and I'll give it a test locally on my
> osx box with gdb?
> >>>>>
> >>>>> Thanks,
> >>>>>
> >>>>> Howard
> >>>>
> >>>>
> >>>>
> >>>> --
> >>>> Roger Bedell
> >>>> Coordinate Solutions Inc.
> >>>
> >>>
> >>>
> >>>
> >>> --
> >>> Roger Bedell
> >>> Coordinate Solutions Inc.
> >>> _______________________________________________
> >>> pgpointcloud mailing list
> >>> pgpointcloud at lists.osgeo.org (mailto:pgpointcloud at lists.osgeo.org)
> >>> http://lists.osgeo.org/cgi-bin/mailman/listinfo/pgpointcloud
> >>
> >>
> >>
> >
>
> --
> Roger Bedell
> Coordinate Solutions Inc.
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/pgpointcloud/attachments/20130719/793e9587/attachment.html>