[pdal] PDAL pipeline issues with large datasets

[Michael Smith]

Vishu,

 

I just ran this slightly modified successfully:

{

  "pipeline": [{

    "type": "readers.ept",

    "filename": "https://s3-us-west-2.amazonaws.com/usgs-lidar-public/USGS_LPC_TN_Middle_B2_2018_LAS_2019/ept.json",

    "bounds": "([-9666713.882998705, -9662911.140841518], [4283077.817410117,4287281.853965801])"

  },

  {

    "type":"filters.reprojection",

    "in_srs":"EPSG:3857",

    "out_srs":"EPSG:32616"

  },{

    "type" : "writers.las",

    "filename": "points.laz",

    "forward": "all"

  }]}

 

 

pdal pipeline test_pipe.json -v 8

(PDAL Debug) Debugging...

(pdal pipeline readers.ept Debug) Query bounds: ([-9666713.882998705, -9662911.140841518], [4283077.817410117, 4287281.853965801], [-1.797693134862316e+308, 1.797693134862316e+308])

Threads: 15

(pdal pipeline Debug) Executing pipeline in stream mode.

(pdal pipeline writers.las Debug) Wrote 64357942 points to the LAS file

 

 

pdal info points.laz --metadata

{

  "file_size": 365318431,

  "filename": "points.laz",

  "metadata":

  {

    "comp_spatialreference": "PROJCS[\"WGS 84 / UTM zone 16N

 

 

-- 

Michael Smith

US Army Corps / Remote Sensing GIS Center

 

 

 

From: pdal <pdal-bounces at lists.osgeo.org> on behalf of "Nandigam, Viswanath" <vnandigam at ucsd.edu>
Date: Friday, August 5, 2022 at 4:33 PM
To: "pdal at lists.osgeo.org" <pdal at lists.osgeo.org>
Subject: [pdal] PDAL pipeline issues with large datasets

 

Hi All,

I’m trying to get pdal pipeline working with the latest install of pdal via conda. It works for very small areas but is erroring out on larger selections.

 

The pipeline.json file is

 

{

  "pipeline": [{

    "type": "readers.ept",

    "filename": "https://s3-us-west-2.amazonaws.com/usgs-lidar-public/USGS_LPC_TN_Middle_B2_2018_LAS_2019/ept.json",

    "bounds": "([-9666713.882998705, -9662911.140841518], [4283077.817410117,4287281.853965801])"

  },

  {

    "type":"filters.reprojection",

    "in_srs":"EPSG:3857",

    "out_srs":"EPSG:32616"

  },{

    "type" : "writers.las",

    "filename": "points.laz",

    "a_srs": "EPSG:32616"

  }]}

 

 

The version of pdal (via conda) is

 

pdal --version
-----------------------------------------------------
pdal 2.4.2 (git-version: e4772e)
----------------------------------------------------- 

 

I have tried it on two machines with both Ubuntu 22.04 LTS and Ubuntu 18.04.

It seems to work with PDAL version 2.4.1.

 

I see the following error:

PDAL: readers.las: VLR 1(SF/0) size too large -- flows into point data.



Maybe I’m missing something. Is anyone else having this issue? Can anyone please advice? 

Thank you!

- Vishu




_______________________________________________ pdal mailing list pdal at lists.osgeo.org https://lists.osgeo.org/mailman/listinfo/pdal 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/pdal/attachments/20220805/e09b5652/attachment.htm>