[pdal-commits] [PDAL/PDAL] 366bd3: HDF Reader (#2934)

Ryan Pals noreply at github.com
Fri Feb 21 11:39:59 PST 2020


  Branch: refs/heads/master
  Home:   https://github.com/PDAL/PDAL
  Commit: 366bd3b78249ad8734e6f245780f7c6a8aedb514
      https://github.com/PDAL/PDAL/commit/366bd3b78249ad8734e6f245780f7c6a8aedb514
  Author: Ryan Pals <ryan at hobu.co>
  Date:   2020-02-21 (Fri, 21 Feb 2020)

  Changed paths:
    M cmake/options.cmake
    A doc/stages/readers.hdf.rst
    M plugins/CMakeLists.txt
    A plugins/hdf/CMakeLists.txt
    A plugins/hdf/io/Hdf5Handler.cpp
    A plugins/hdf/io/Hdf5Handler.hpp
    A plugins/hdf/io/HdfReader.cpp
    A plugins/hdf/io/HdfReader.hpp
    A plugins/hdf/test/HdfReadertest.cpp
    M scripts/azp/linux-conda.yml
    M scripts/azp/linux.yml
    M scripts/azp/osx.yml
    M scripts/azp/win.yml
    M scripts/conda/osx.sh
    A test/data/hdf/autzen.h5

  Log Message:
  -----------
  HDF Reader (#2934)

* Copy icebridge files over to hdf plugin

* WIP
Print out info from hard-coded autzen. remove test points in test file. iterate over dimensions and print size, offset, type and endianness

* Remove unused

* Compiles!

* Reads!

* Fix offset calculation

* Fix hard coded struct size

* Fix hard coded number of points

* Remove hard coded dataset name, add dataset selection from stage options

* Add case for non-compound datatypes

* Fix compound case

* Remove code for compound types

* Add ability to name dataset

* Cleanup

* Fix type bug

* Reads one chunk - wip

* WIP

* No longer segfaults - wip

* Reads an entire array

* Add JSON

* Read dataset and dims from JSON map

* WIP

* Remove unused

* Cleanup

* Fix key-value misordering

* Works for multiple dims

* Use proper loggers

* add simple readers.hdf test based on autzen

* Make chunkSize a property of dimension, rather than file

* Clean up loop

* Fix indexing bug

* Init buffers in prepare() instead of read()

* Streams!!!

* Fix sign-compare warning

* Add json validation

* Check that all datasets are the same length

* Update test data file with metadata

* Add HDF Reader docs WIP

* Add check for null map

* Add HDF plugin to AZP

* Connor's changes

* Stuff WIP

* Review changes

* Feedback

* Address feedback

* Add more test cases

* random chunk sizes, check GPSTime

* CMake feedback: Cleanup, remove LibXML2

* Get rid of compiler warnings

* Address doc feedback

* Cleanup

* Step 1

* Step 2

* Remove BufferInfo; return pointer to val instead of pointer to bufer

* Remove unused

* Get rid of m_buffers

* Style

* Get rid of all parallel vectors

* Don't open dataset on each point. Fixes 20x performance regression introduced by last commit

* Use range based for-loops

* Remove unused

* Move Handler class into hdf5 namespace

* Fix outdated error

* Sepearte initialization code into constructor

* Cleanup

* Make getValue a method of DimInfo instead of Handler

* Styling

* Remove unused

* Use fewer auto types

* Change shared_ptr to unique_ptr

* Fix macOS compiler warning

Co-authored-by: Howard Butler <howard at hobu.co>




More information about the pdal-commits mailing list