[pdal-commits] [PDAL/PDAL] ce278a: Improve BPF streaming performance for dimension-ma...

Tue Dec 13 06:50:24 PST 2016

  Branch: refs/tags/docker-master
  Home:   https://github.com/PDAL/PDAL
  Commit: ce278af7ded713559b6789256cc25b4661918453
      https://github.com/PDAL/PDAL/commit/ce278af7ded713559b6789256cc25b4661918453
  Author: Connor Manning <connor at hobu.co>
  Date:   2016-12-07 (Wed, 07 Dec 2016)

  Changed paths:
    M io/BpfReader.cpp
    M io/BpfReader.hpp

  Log Message:
  -----------
  Improve BPF streaming performance for dimension-major format.

  Commit: 7a94de31ec5b78df3b047040572f5744aeb5e691
      https://github.com/PDAL/PDAL/commit/7a94de31ec5b78df3b047040572f5744aeb5e691
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M CMakeLists.txt
    M filters/AttributeFilter.cpp
    M filters/CropFilter.cpp
    M filters/CropFilter.hpp
    A filters/private/crop/Point.cpp
    A filters/private/crop/Point.hpp
    M pdal/GEOSUtils.cpp
    M pdal/GEOSUtils.hpp
    A pdal/Geometry.cpp
    A pdal/Geometry.hpp
    M pdal/Polygon.cpp
    M pdal/Polygon.hpp
    M test/unit/filters/CropFilterTest.cpp

  Log Message:
  -----------
  support point/radius and sphere/radius cropping #1387 (#1388)

* support point/radius and sphere/radius cropping #1387

* #include <limits>

* pdal::Geometry and pdal::Point refactoring

* use proper GEOS init if available

* refactoring cleanup

* RAII for GEOS geometry management

* refactor cropfilter::Point to use new pdal::Geometry stuff

* too many ctx's

* lint cleanup

* lint cleanup

* Geometry.cpp|hpp addition

* Build private .cpp files.
Don't install private .hpp files.
Remove duplicate files.

  Commit: 28003df716821b6aa333f400b4a8156199fe9b81
      https://github.com/PDAL/PDAL/commit/28003df716821b6aa333f400b4a8156199fe9b81
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    R test/data/nitf/write_test1.ntf

  Log Message:
  -----------
  remove unused and invalid NITF test file #1025

  Commit: a115ab49f18d01f95dcc8881c32ba3e6f228e985
      https://github.com/PDAL/PDAL/commit/a115ab49f18d01f95dcc8881c32ba3e6f228e985
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M plugins/oci/test/OCITest.cpp

  Log Message:
  -----------
  no need for property_tree in oci test

  Commit: 779524839c4b05d64698861fa0f12097f96f1720
      https://github.com/PDAL/PDAL/commit/779524839c4b05d64698861fa0f12097f96f1720
  Author: Bradley J Chambers <brad.chambers at gmail.com>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M filters/MongusFilter.cpp
    M filters/MongusFilter.hpp
    M pdal/EigenUtils.cpp
    M pdal/EigenUtils.hpp

  Log Message:
  -----------
  The TPS interpolation in filters.mongus is generic enough to move to EigenUtils

A number of other ground segmentation routines (yet to be implemented) use a
similar approach for estimating the ground surface. Our modified version of
SMRF even uses TPS to fill holes, although we have yet to port that over to
this EigenUtils function, as it differs slightly.

  Commit: 58155dd57794b21e9a843a87429b5ace086eb13f
      https://github.com/PDAL/PDAL/commit/58155dd57794b21e9a843a87429b5ace086eb13f
  Author: Bradley J Chambers <brad.chambers at gmail.com>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M filters/SMRFilter.cpp
    M filters/SMRFilter.hpp

  Log Message:
  -----------
  Fix some issues with SMRF

* Be consistent when addressing rows/cols
* By default, SMRF now writes no debugging outputs, but optional directory
  argument enables it
* Make args more consistent with paper, add scalar arg

  Commit: 1e4ed06f67fb90bdb214fe6667ba2c2722241512
      https://github.com/PDAL/PDAL/commit/1e4ed06f67fb90bdb214fe6667ba2c2722241512
  Author: chambbj <brad.chambers at gmail.com>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M filters/SMRFilter.cpp
    M filters/SMRFilter.hpp

  Log Message:
  -----------
  Merge pull request #1424 from PDAL/basic-smrf-fixes

Fix some issues with SMRF

  Commit: 796a89ea0ecdb64371f6a1bcff40692a4cec9a98
      https://github.com/PDAL/PDAL/commit/796a89ea0ecdb64371f6a1bcff40692a4cec9a98
  Author: chambbj <brad.chambers at gmail.com>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M filters/MongusFilter.cpp
    M filters/MongusFilter.hpp
    M pdal/EigenUtils.cpp
    M pdal/EigenUtils.hpp

  Log Message:
  -----------
  Merge pull request #1394 from PDAL/tps-as-eigenutil

The TPS interpolation in filters.mongus is generic enough to move to EigenUtils

  Commit: 7f35d84c8d828400dee19dc69139d53d73a2a741
      https://github.com/PDAL/PDAL/commit/7f35d84c8d828400dee19dc69139d53d73a2a741
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M doc/index.rst

  Log Message:
  -----------
  docker.com, not org

  Commit: 9990fd9b642659b083e973e0f8bf7817ab30fa4c
      https://github.com/PDAL/PDAL/commit/9990fd9b642659b083e973e0f8bf7817ab30fa4c
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-08 (Thu, 08 Dec 2016)

  Changed paths:
    M test/unit/BoundsTest.cpp

  Log Message:
  -----------
  kill more property_tree

  Commit: 2b33df75307cb8b5a9313989362d59ee993e6983
      https://github.com/PDAL/PDAL/commit/2b33df75307cb8b5a9313989362d59ee993e6983
  Author: Bradley J Chambers <brad.chambers at gmail.com>
  Date:   2016-12-09 (Fri, 09 Dec 2016)

  Changed paths:
    M filters/PMFFilter.cpp

  Log Message:
  -----------
  PMF updates

* Revert back to a 2D box search (vice radius) as in the original PCL
  implementation.
* Do not store map of neighbors, which can grow quite large and blow up
  available memory, just take the hit and redo the search in both the
  erosion and dilation steps.

  Commit: cb3f2ce14332ec9998fec264ff301b0d1de85976
      https://github.com/PDAL/PDAL/commit/cb3f2ce14332ec9998fec264ff301b0d1de85976
  Author: Andrew Bell <andrew.bell.ia at gmail.com>
  Date:   2016-12-09 (Fri, 09 Dec 2016)

  Changed paths:
    M filters/ReprojectionFilter.cpp
    M io/Ilvis2MetadataReader.hpp
    M io/LasHeader.cpp
    M io/LasReader.cpp
    M io/LasWriter.cpp
    M io/OptechReader.cpp
    M pdal/Geometry.cpp
    M pdal/Polygon.cpp
    M pdal/SpatialReference.cpp
    M pdal/SpatialReference.hpp
    M pdal/Stage.cpp
    M plugins/nitf/io/NitfWriter.cpp
    M plugins/p2g/io/P2gWriter.cpp
    M test/unit/SpatialReferenceTest.cpp
    M test/unit/io/LasReaderTest.cpp
    M test/unit/io/OptechReaderTest.cpp

  Log Message:
  -----------
  Don't mess with wkt that's passed as SRS.

  Commit: 51227df69f1751877f4a6f342f6776721fda84b2
      https://github.com/PDAL/PDAL/commit/51227df69f1751877f4a6f342f6776721fda84b2
  Author: Bradley J Chambers <brad.chambers at gmail.com>
  Date:   2016-12-09 (Fri, 09 Dec 2016)

  Changed paths:
    M filters/PMFFilter.cpp

  Log Message:
  -----------
  Remove lingering references to PointIdVec and neighborMap

  Commit: eb8cc1c5f820037b256b05d5a446ea88d8effd55
      https://github.com/PDAL/PDAL/commit/eb8cc1c5f820037b256b05d5a446ea88d8effd55
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-11 (Sun, 11 Dec 2016)

  Changed paths:
    M cmake/geotiff.cmake
    M scripts/appveyor/config.cmd
    M test/unit/apps/pc2pcTest.cpp

  Log Message:
  -----------
  GeoTIFF no longer optional

* make GeoTIFF required

  Commit: d32c77f37007a494ce88e1e9ca64a14a6b21892f
      https://github.com/PDAL/PDAL/commit/d32c77f37007a494ce88e1e9ca64a14a6b21892f
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-12 (Mon, 12 Dec 2016)

  Changed paths:
    M pdal/pdal_config.cpp
    M test/unit/ConfigTest.cpp
    M test/unit/SpatialReferenceTest.cpp
    M test/unit/apps/pc2pcTest.cpp
    M test/unit/filters/ReprojectionFilterTest.cpp
    M test/unit/io/LasWriterTest.cpp

  Log Message:
  -----------
  more GEOTIFF #define removal related to #1428 (#1429)

  Commit: 26cc2353fcaf95a04ad385236d4bfc22011c8a6e
      https://github.com/PDAL/PDAL/commit/26cc2353fcaf95a04ad385236d4bfc22011c8a6e
  Author: Bradley J Chambers <brad.chambers at gmail.com>
  Date:   2016-12-12 (Mon, 12 Dec 2016)

  Changed paths:
    M doc/apps/ground.rst
    M doc/apps/translate.rst
    R doc/apps/view.rst
    M doc/development/compilation/dependencies.rst
    M doc/development/contributors.rst
    R doc/stages/filters.dartsample.rst
    R doc/stages/filters.ground.rst
    R doc/stages/filters.height.rst
    R doc/stages/filters.radiusoutlier.rst
    R doc/stages/filters.statisticaloutlier.rst
    R doc/stages/writers.pclvisualizer.rst
    M doc/tutorial/calculating-normalized-heights.rst
    M doc/tutorial/dart-throwing.rst
    M doc/tutorial/pcl_ground.rst
    M doc/workshop/exercises/analysis/denoising/denoise.json
    M doc/workshop/exercises/analysis/denoising/denoising.rst
    R doc/workshop/exercises/analysis/ground/filter.json
    M doc/workshop/exercises/analysis/ground/ground-run-ground-only.txt
    M doc/workshop/exercises/analysis/ground/ground-run-no-filter.txt
    R doc/workshop/exercises/analysis/ground/ground-run-pcl-filter.txt
    M doc/workshop/exercises/analysis/ground/ground.rst
    A doc/workshop/exercises/analysis/ground/translate-run-ground-only.txt
    M doc/workshop/exercises/analysis/thinning/thinning-run-dartsample.txt
    M doc/workshop/exercises/analysis/thinning/thinning.rst
    M doc/workshop/pdal-introduction.rst
    M doc/workshop/slides/source/denoising.rst
    M doc/workshop/slides/source/ground.rst
    A kernels/GroundKernel.cpp
    A kernels/GroundKernel.hpp
    M pdal/KernelFactory.cpp
    M plugins/pcl/CMakeLists.txt
    R plugins/pcl/dartsample/dart_sample.cpp
    R plugins/pcl/dartsample/dart_sample.h
    R plugins/pcl/dartsample/dart_sample.hpp
    R plugins/pcl/filters/DartSampleFilter.cpp
    R plugins/pcl/filters/DartSampleFilter.hpp
    R plugins/pcl/filters/GroundFilter.cpp
    R plugins/pcl/filters/GroundFilter.hpp
    R plugins/pcl/filters/HeightFilter.cpp
    R plugins/pcl/filters/HeightFilter.hpp
    R plugins/pcl/filters/RadiusOutlierFilter.cpp
    R plugins/pcl/filters/RadiusOutlierFilter.hpp
    R plugins/pcl/filters/StatisticalOutlierFilter.cpp
    R plugins/pcl/filters/StatisticalOutlierFilter.hpp
    R plugins/pcl/io/PCLVisualizer.cpp
    R plugins/pcl/io/PCLVisualizer.hpp
    R plugins/pcl/kernel/GroundKernel.cpp
    R plugins/pcl/kernel/GroundKernel.hpp
    R plugins/pcl/kernel/HeightAboveGroundKernel.cpp
    R plugins/pcl/kernel/HeightAboveGroundKernel.hpp
    R plugins/pcl/kernel/ViewKernel.cpp
    R plugins/pcl/kernel/ViewKernel.hpp
    M plugins/pcl/test/PCLBlockFilterTest.cpp
    R test/data/filters/pcl/example_PMF_1.json
    R test/data/filters/pcl/example_PMF_2.json
    R test/data/filters/pcl/filter_APMF_1.json
    R test/data/filters/pcl/filter_PMF_1.json
    R test/data/filters/pcl/filter_PMF_2.json
    R test/data/filters/pcl/filter_PMF_3.json
    R test/data/filters/pcl/filter_PMF_4.json
    R test/data/filters/pcl/filter_PMF_5.json
    R test/data/filters/pcl/filter_PMF_6.json
    R test/data/filters/pcl/filter_PMF_7.json
    R test/data/filters/pcl/filter_PMF_8.json
    R test/data/filters/pcl/filter_PMF_9.json
    R test/data/filters/pcl/filter_RadiusOutlierRemoval_1.json
    R test/data/filters/pcl/filter_RadiusOutlierRemoval_2.json
    R test/data/filters/pcl/filter_StatisticalOutlierRemoval_1.json
    R test/data/filters/pcl/filter_StatisticalOutlierRemoval_2.json
    M test/unit/CMakeLists.txt
    A test/unit/OldPCLBlockTest.cpp

  Log Message:
  -----------
  Shrink the PCL plugin

As discussed in #1404, PDAL can now do many of the things we had been relying
on PCL to do. This commit removes the PCL versions of filters that had been
duplicated across PDAL and PCL, specifically:

* filters.dartsample
* filters.ground
* filters.height
* filters.radiusoutlier
* filters.statisticaloutlier
* kernels.views
* writers.pclvisualizer

Ground kernel is now a native PDAL kernel (it had been part of the PCL plugin).
It now calls filters.pmf (PDAL) as opposed to filters.ground (PCL), which are
both implementations of the PMF algorithm.

We have made an effort to update documentation (especially in the workshop) to
instruction users in the proper usage of the native PDAL capabilities. Many of
the tutorials still refer to the PCL implementations though, as they serve a
dual purpose of introducing the filtering approach and also covering concepts
of how to write plugins for PDAL.

The HeightAboveGround kernel in the PCL plugin had not been built or maintained
in months and has been removed.

To the extent that filters.ground, filters.statisticaloutlier, and
filters.radiusoutlier were being tested via the PCLBlockFilterTest, filters.pmf
and filters.outlier are being tested now in OldPCLBlockTest.

  Commit: d2ef963032384bead508d4e57546f5c8739fca4d
      https://github.com/PDAL/PDAL/commit/d2ef963032384bead508d4e57546f5c8739fca4d
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-12 (Mon, 12 Dec 2016)

  Changed paths:
    M filters/StatsFilter.cpp

  Log Message:
  -----------
  Set 'boundary' objects as JSON, not escaped strings (#1431)

* don't override pdal::Metadata::setValue

* set 'boundary' with pdal::Metadata::addWithType #1430

  Commit: c631935dc259c012c61018a84b3fb7f90792cbf9
      https://github.com/PDAL/PDAL/commit/c631935dc259c012c61018a84b3fb7f90792cbf9
  Author: Howard Butler <howard at hobu.co>
  Date:   2016-12-12 (Mon, 12 Dec 2016)

  Changed paths:
    M plugins/hexbin/filters/HexBin.cpp

  Log Message:
  -----------
  output a 'boundary_json' GeoJSON boundary for filters.hexbin output (#1433)

  Commit: 2c75c5efcdd1f2a6372f1fd1690639c0340d30fa
      https://github.com/PDAL/PDAL/commit/2c75c5efcdd1f2a6372f1fd1690639c0340d30fa
  Author: Andrew Bell <andrew.bell.ia at gmail.com>
  Date:   2016-12-12 (Mon, 12 Dec 2016)

  Changed paths:
    M io/BpfReader.cpp
    M io/BpfReader.hpp

  Log Message:
  -----------
  Merge pull request #1422 from PDAL/bpf-streaming

Improve BPF streaming performance for dimension-major format.

  Commit: 8c3aaae4220d654484059fbffe6e906a88a9216b
      https://github.com/PDAL/PDAL/commit/8c3aaae4220d654484059fbffe6e906a88a9216b
  Author: chambbj <brad.chambers at gmail.com>
  Date:   2016-12-13 (Tue, 13 Dec 2016)

  Changed paths:
    M filters/PMFFilter.cpp

  Log Message:
  -----------
  Merge pull request #1426 from PDAL/pmf-improvements

PMF updates

  Commit: 78437ca7ad78a0d294fd60eaac79138c3665a9f1
      https://github.com/PDAL/PDAL/commit/78437ca7ad78a0d294fd60eaac79138c3665a9f1
  Author: chambbj <brad.chambers at gmail.com>
  Date:   2016-12-13 (Tue, 13 Dec 2016)

  Changed paths:
    M doc/apps/ground.rst
    M doc/apps/translate.rst
    R doc/apps/view.rst
    M doc/development/compilation/dependencies.rst
    M doc/development/contributors.rst
    R doc/stages/filters.dartsample.rst
    R doc/stages/filters.ground.rst
    R doc/stages/filters.height.rst
    R doc/stages/filters.radiusoutlier.rst
    R doc/stages/filters.statisticaloutlier.rst
    R doc/stages/writers.pclvisualizer.rst
    M doc/tutorial/calculating-normalized-heights.rst
    M doc/tutorial/dart-throwing.rst
    M doc/tutorial/pcl_ground.rst
    M doc/workshop/exercises/analysis/denoising/denoise.json
    M doc/workshop/exercises/analysis/denoising/denoising.rst
    R doc/workshop/exercises/analysis/ground/filter.json
    M doc/workshop/exercises/analysis/ground/ground-run-ground-only.txt
    M doc/workshop/exercises/analysis/ground/ground-run-no-filter.txt
    R doc/workshop/exercises/analysis/ground/ground-run-pcl-filter.txt
    M doc/workshop/exercises/analysis/ground/ground.rst
    A doc/workshop/exercises/analysis/ground/translate-run-ground-only.txt
    M doc/workshop/exercises/analysis/thinning/thinning-run-dartsample.txt
    M doc/workshop/exercises/analysis/thinning/thinning.rst
    M doc/workshop/pdal-introduction.rst
    M doc/workshop/slides/source/denoising.rst
    M doc/workshop/slides/source/ground.rst
    A kernels/GroundKernel.cpp
    A kernels/GroundKernel.hpp
    M pdal/KernelFactory.cpp
    M plugins/pcl/CMakeLists.txt
    R plugins/pcl/dartsample/dart_sample.cpp
    R plugins/pcl/dartsample/dart_sample.h
    R plugins/pcl/dartsample/dart_sample.hpp
    R plugins/pcl/filters/DartSampleFilter.cpp
    R plugins/pcl/filters/DartSampleFilter.hpp
    R plugins/pcl/filters/GroundFilter.cpp
    R plugins/pcl/filters/GroundFilter.hpp
    R plugins/pcl/filters/HeightFilter.cpp
    R plugins/pcl/filters/HeightFilter.hpp
    R plugins/pcl/filters/RadiusOutlierFilter.cpp
    R plugins/pcl/filters/RadiusOutlierFilter.hpp
    R plugins/pcl/filters/StatisticalOutlierFilter.cpp
    R plugins/pcl/filters/StatisticalOutlierFilter.hpp
    R plugins/pcl/io/PCLVisualizer.cpp
    R plugins/pcl/io/PCLVisualizer.hpp
    R plugins/pcl/kernel/GroundKernel.cpp
    R plugins/pcl/kernel/GroundKernel.hpp
    R plugins/pcl/kernel/HeightAboveGroundKernel.cpp
    R plugins/pcl/kernel/HeightAboveGroundKernel.hpp
    R plugins/pcl/kernel/ViewKernel.cpp
    R plugins/pcl/kernel/ViewKernel.hpp
    M plugins/pcl/test/PCLBlockFilterTest.cpp
    R test/data/filters/pcl/example_PMF_1.json
    R test/data/filters/pcl/example_PMF_2.json
    R test/data/filters/pcl/filter_APMF_1.json
    R test/data/filters/pcl/filter_PMF_1.json
    R test/data/filters/pcl/filter_PMF_2.json
    R test/data/filters/pcl/filter_PMF_3.json
    R test/data/filters/pcl/filter_PMF_4.json
    R test/data/filters/pcl/filter_PMF_5.json
    R test/data/filters/pcl/filter_PMF_6.json
    R test/data/filters/pcl/filter_PMF_7.json
    R test/data/filters/pcl/filter_PMF_8.json
    R test/data/filters/pcl/filter_PMF_9.json
    R test/data/filters/pcl/filter_RadiusOutlierRemoval_1.json
    R test/data/filters/pcl/filter_RadiusOutlierRemoval_2.json
    R test/data/filters/pcl/filter_StatisticalOutlierRemoval_1.json
    R test/data/filters/pcl/filter_StatisticalOutlierRemoval_2.json
    M test/unit/CMakeLists.txt
    A test/unit/OldPCLBlockTest.cpp

  Log Message:
  -----------
  Merge pull request #1432 from PDAL/pcl-shrinkage

Shrink the PCL plugin

Compare: https://github.com/PDAL/PDAL/compare/230b6c9f0f29...78437ca7ad78