[pdal] How to handle las files that don't fit in memory

[Andrew Bell]

On Mon, Dec 21, 2015 at 2:10 PM, Tom van Tilburg <tom.van.tilburg at gmail.com>
wrote:

> Hi Andrew,
>
> Increasing SWAP is possible but wouldn't this seriously degrade the
> performance?
>

It depends what you're comparing to.  It's really hard to say without
giving it a go.  Unless you're short disk space, it seems like a relatively
trivial exercise to add the swap and see.


> I have about 30 gigs of RAM and it already takes ages to load everything
> in there.
>

Make sure you're using a release version of PDAL.  It's significantly
faster than the debug version.  Without know a lot about your system, I
don't have much to offer.  However, if your time is worth anything, memory
is cheap.

Streaming would definitely be a way to go, as it works fine with lastools
> for me. I'll look into it. Chopping the data into smaller spatial blocks
> would be my first approach here.
>


Any estimate on when streaming will get into the api?
>

No, sorry.  Streaming won't really solve your problem exactly anyway,
because you can't stream with the splitter.  If you've already split your
data into chunks spatially, you've already done the work of the splitter,
so I'm not sure what to advise.

Is it necessary to break up your data?  Perhaps there's another solution
that doesn't involve tiling?

Best,

-- 
Andrew Bell
andrew.bell.ia at gmail.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/pdal/attachments/20151221/26372316/attachment.html>