[Qgis-developer] Announcing raster-pipes-2 branch for testing

Fri Jul 27 13:43:13 PDT 2012

Recent changes by Radim was to remove entirely statistics-related
functions from rasterlayer. While this is good in the
medium/long-term, I was wondering if we should not keep some of them
around for some time (as deprecated).

I am referring to hasStatistics() and bandStatistics() - they could
remain as wrappers for the providers functions.

I am concerned that some plugins will require a certain number of
tests for different apis, and it may be early to remove entirely some
basic functions.

Etienne

On Wed, Jul 25, 2012 at 1:00 PM, Marco Hugentobler
<marco.hugentobler at sourcepole.ch> wrote:
> Hi all
>
> The branch is merged. Enjoy (and report issues on the bugtracker).
>
> Regards,
> Marco
>
> Am 24.07.2012 16:53, schrieb Marco Hugentobler:
>
>> Hi all
>>
>> I think it would be a good move to merge the raster-pipes-2 branch back to
>> trunk. Ok, I know more instabilities, things to polish, etc. But in trunk,
>> it receives more attention and people are more motivated to work on it.
>>
>> Any objections?
>>
>> Regards,
>> Marco
>>
>> Am 20.07.2012 22:15, schrieb Tim Sutton:
>>>
>>> Hi
>>>
>>> On Fri, Jul 20, 2012 at 10:13 PM, Etienne Tourigny
>>> <etourigny.dev at gmail.com> wrote:
>>>>
>>>> Ok this is a more general question then - which format(s) should
>>>> raster export support?
>>>>
>>> It should support any GDAL raster driver that supports write and that
>>> is useable with the active dataset.
>>>
>>> I was referring to tif only in terms of the default profiles I mentioned.
>>>
>>> Regards
>>>
>>> Tim
>>>
>>>> Etienne
>>>>
>>>> On Fri, Jul 20, 2012 at 5:11 PM, Tim Sutton <lists at linfiniti.com> wrote:
>>>>>
>>>>> Hi
>>>>>
>>>>> On Fri, Jul 20, 2012 at 10:07 PM, Etienne Tourigny
>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>
>>>>>>> One thing that would be really nice is to have
>>>>>>> some default profiles:
>>>>>>>
>>>>>>> - options for maximum read performance regardless of disk space
>>>>>>> - options for minumum file size regardless of performance
>>>>>>> - options for 'middle of the road' between the above two
>>>>>>
>>>>>> would you have these options for all file types? it could get a little
>>>>>> complex, but worth the effort. For now I am implementing 1 default for
>>>>>> each driver, which can be defined by the user.
>>>>>>
>>>>> I was thinking just for tiff as I think it is the most generically
>>>>> used.
>>>>>
>>>>> Regards
>>>>>
>>>>> Tim
>>>>>
>>>>>> Etienne
>>>>>>
>>>>>>> Regards
>>>>>>>
>>>>>>> Tim
>>>>>>>
>>>>>>>
>>>>>>>>> I have granted you write access, please work directly in
>>>>>>>>> raster-pipes-2.
>>>>>>>>
>>>>>>>> thanks
>>>>>>>> Etienne
>>>>>>>>
>>>>>>>>> Radim
>>>>>>>>>
>>>>>>>>>> Etienne
>>>>>>>>>>
>>>>>>>>>> On Thu, Jul 19, 2012 at 7:21 PM, Tim Sutton <lists at linfiniti.com>
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hi
>>>>>>>>>>>
>>>>>>>>>>> On Fri, Jul 20, 2012 at 12:19 AM, Etienne Tourigny
>>>>>>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Jul 19, 2012 at 4:09 PM, Marco Hugentobler
>>>>>>>>>>>> <marco.hugentobler at sourcepole.ch> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Etienne
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks for the feedback, very much appreciated. I've fixed
>>>>>>>>>>>>> these issues in
>>>>>>>>>>>>> raster-pipes-2 branch now.
>>>>>>>>>>>>>
>>>>>>>>>>>>> There are still a few things missing in raster saving:
>>>>>>>>>>>>> - write colortable to output dataset
>>>>>>>>>>>>> - format specific options (e.g. compression)
>>>>>>>>>>>>> - dynamic populating of the format combo box (currently
>>>>>>>>>>>>> hardcoded to
>>>>>>>>>>>>> geotiff)
>>>>>>>>>>>>> - progress indication for tile based saving and possibility to
>>>>>>>>>>>>> cancel
>>>>>>>>>>>>
>>>>>>>>>>>> It just occurred to me that it would be a great thing to
>>>>>>>>>>>> implement
>>>>>>>>>>>> this as a widget+class in QgisGui, so that it could be used
>>>>>>>>>>>> elsewhere
>>>>>>>>>>>> (e.g. gdaltools, sextante).
>>>>>>>>>>>>
>>>>>>>>>>> You mean as a reusable widget like the crs selector? Yes that
>>>>>>>>>>> would be great!
>>>>>>>>>>>
>>>>>>>>>>> Regards
>>>>>>>>>>>
>>>>>>>>>>> Tim
>>>>>>>>>>>
>>>>>>>>>>>> Any way I can help?
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>> Marco
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On 18.07.2012 21:12, Etienne Tourigny wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Noticed a few issues with the save dialog
>>>>>>>>>>>>>>    1) "format" drop-down is empty
>>>>>>>>>>>>>> 2) cannot select a new file
>>>>>>>>>>>>>> 3) segfault when saving to an existing file
>>>>>>>>>>>>>> 4) It would be nice to have that action in the legend
>>>>>>>>>>>>>> contextual menu,
>>>>>>>>>>>>>> like for vector layers.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>> Etienne
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Jul 18, 2012 at 3:59 PM, Etienne Tourigny
>>>>>>>>>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> That's great news!
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Concerning raster saving - will there be a mechanism for
>>>>>>>>>>>>>>> compressing
>>>>>>>>>>>>>>> files?
>>>>>>>>>>>>>>> It would be great if default compression schemes could be
>>>>>>>>>>>>>>> chosen for
>>>>>>>>>>>>>>> different file types, and an option at save time - sort of
>>>>>>>>>>>>>>> like image
>>>>>>>>>>>>>>> editors.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I had trouble building it with external spatialite, could
>>>>>>>>>>>>>>> only get it
>>>>>>>>>>>>>>> to compile with cmake -DWITH_INTERNAL_SPATIALITE=TRUE - does
>>>>>>>>>>>>>>> this
>>>>>>>>>>>>>>> require a special version of spatialite?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>> Etienne
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Jul 18, 2012 at 12:13 PM, Marco Hugentobler
>>>>>>>>>>>>>>> <marco.hugentobler at sourcepole.ch> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi devs
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I'd like to announce the branch 'raster-pipes-2' in Radims
>>>>>>>>>>>>>>>> repository
>>>>>>>>>>>>>>>> https://github.com/blazek/Quantum-GIS for testing.
>>>>>>>>>>>>>>>> Radim did a great job in refactoring the process of reading
>>>>>>>>>>>>>>>> / resampling
>>>>>>>>>>>>>>>> /
>>>>>>>>>>>>>>>> reprojecting / displaying / modifying raster layers. Every
>>>>>>>>>>>>>>>> step is now a
>>>>>>>>>>>>>>>> subclass of QgsRasterInterface, with the advantage that
>>>>>>>>>>>>>>>> several steps
>>>>>>>>>>>>>>>> can be
>>>>>>>>>>>>>>>> chained in a QgsRasterPipe. Like that, the raster
>>>>>>>>>>>>>>>> functionality is
>>>>>>>>>>>>>>>> nicely
>>>>>>>>>>>>>>>> separated into different classes and it is easy to
>>>>>>>>>>>>>>>> add/remove elements
>>>>>>>>>>>>>>>> in
>>>>>>>>>>>>>>>> the pipe. The iteration over the raster parts is controlled
>>>>>>>>>>>>>>>> by
>>>>>>>>>>>>>>>> QgsRasterIterator (because for high-resolution prints or
>>>>>>>>>>>>>>>> analysis on
>>>>>>>>>>>>>>>> large
>>>>>>>>>>>>>>>> datasets, it is impossible to keep everything in memory at
>>>>>>>>>>>>>>>> once).
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Please report any issue you find in the branch to the
>>>>>>>>>>>>>>>> developer mailing
>>>>>>>>>>>>>>>> list.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Besides the changes in code architecture, there is also a
>>>>>>>>>>>>>>>> new feature in
>>>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>> raster-pipes-2 branch. It is now possible to write through
>>>>>>>>>>>>>>>> QgsRasterDataProvider (currently only supported by the gdal
>>>>>>>>>>>>>>>> provider).
>>>>>>>>>>>>>>>> There
>>>>>>>>>>>>>>>> is a 'save as...' function also for rasters now (though it
>>>>>>>>>>>>>>>> is not 100%
>>>>>>>>>>>>>>>> complete at the moment). There is the option to save a
>>>>>>>>>>>>>>>> raster in one
>>>>>>>>>>>>>>>> file or
>>>>>>>>>>>>>>>> in tiles (the tiles are then saved in one directory and vrt
>>>>>>>>>>>>>>>> / pyramides
>>>>>>>>>>>>>>>> are
>>>>>>>>>>>>>>>> automatically created. Very usefull for saving the contents
>>>>>>>>>>>>>>>> of a WMS
>>>>>>>>>>>>>>>> layer).
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>> Marco
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>> Dr. Marco Hugentobler
>>>>>>>>>>>>>>>> Sourcepole -  Linux & Open Source Solutions
>>>>>>>>>>>>>>>> Weberstrasse 5, CH-8004 Zürich, Switzerland
>>>>>>>>>>>>>>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>>>>>>>>>>>>>>> Technical Advisor QGIS Project Steering Committee
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Dr. Marco Hugentobler
>>>>>>>>>>>>> Sourcepole -  Linux & Open Source Solutions
>>>>>>>>>>>>> Churerstrasse 22, CH-8808 Pfäffikon SZ, Switzerland
>>>>>>>>>>>>>
>>>>>>>>>>>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>>>>>>>>>>>> Technical Advisor QGIS Project Steering Committee
>>>>>>>>>>>>>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release
>>>>>>>>>>> Manager)
>>>>>>>>>>> ==============================================
>>>>>>>>>>> Please do not email me off-list with technical
>>>>>>>>>>> support questions. Using the lists will gain
>>>>>>>>>>> more exposure for your issues and the knowledge
>>>>>>>>>>> surrounding your issue will be shared with all.
>>>>>>>>>>>
>>>>>>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>>>>>>   * QGIS programming and support services
>>>>>>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>>>>>>   * FOSS Consulting Services
>>>>>>>>>>> Skype: timlinux
>>>>>>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>>>>>>> ==============================================
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Qgis-developer mailing list
>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release
>>>>>>> Manager)
>>>>>>> ==============================================
>>>>>>> Please do not email me off-list with technical
>>>>>>> support questions. Using the lists will gain
>>>>>>> more exposure for your issues and the knowledge
>>>>>>> surrounding your issue will be shared with all.
>>>>>>>
>>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>>   * QGIS programming and support services
>>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>>   * FOSS Consulting Services
>>>>>>> Skype: timlinux
>>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>>> ==============================================
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release  Manager)
>>>>> ==============================================
>>>>> Please do not email me off-list with technical
>>>>> support questions. Using the lists will gain
>>>>> more exposure for your issues and the knowledge
>>>>> surrounding your issue will be shared with all.
>>>>>
>>>>> Visit http://linfiniti.com to find out about:
>>>>>   * QGIS programming and support services
>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>   * FOSS Consulting Services
>>>>> Skype: timlinux
>>>>> Irc: timlinux on #qgis at freenode.net
>>>>> ==============================================
>>>
>>>
>>>
>>
>>
>
>
> --
> Dr. Marco Hugentobler
> Sourcepole -  Linux & Open Source Solutions
> Weberstrasse 5, CH-8004 Zürich, Switzerland
> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
> Technical Advisor QGIS Project Steering Committee
>
> _______________________________________________
> Qgis-developer mailing list
> Qgis-developer at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/qgis-developer