[Qgis-developer] Announcing raster-pipes-2 branch for testing

Tue Jul 24 11:44:26 PDT 2012

On Tue, Jul 24, 2012 at 7:15 PM, Radim Blazek <radim.blazek at gmail.com> wrote:
> On Tue, Jul 24, 2012 at 4:53 PM, Marco Hugentobler
> <marco.hugentobler at sourcepole.ch> wrote:
>> Hi all
>>
>> I think it would be a good move to merge the raster-pipes-2 branch back to
>> trunk. Ok, I know more instabilities, things to polish, etc. But in trunk,
>> it receives more attention and people are more motivated to work on it.
>>
>> Any objections?
>
> Tests should pass OK before merge, I think. Then +1.

Fixed. Now +1.

Radim

> Do you want to merge everything as a single commit or all commits from
> raster-pipes-2? I would prefer to squash my initial work on pipes
> (87607187-2fdd82f4) into a single commit.
>
> Radim
>
>
>> Regards,
>> Marco
>>
>> Am 20.07.2012 22:15, schrieb Tim Sutton:
>>
>>> Hi
>>>
>>> On Fri, Jul 20, 2012 at 10:13 PM, Etienne Tourigny
>>> <etourigny.dev at gmail.com> wrote:
>>>>
>>>> Ok this is a more general question then - which format(s) should
>>>> raster export support?
>>>>
>>> It should support any GDAL raster driver that supports write and that
>>> is useable with the active dataset.
>>>
>>> I was referring to tif only in terms of the default profiles I mentioned.
>>>
>>> Regards
>>>
>>> Tim
>>>
>>>> Etienne
>>>>
>>>> On Fri, Jul 20, 2012 at 5:11 PM, Tim Sutton <lists at linfiniti.com> wrote:
>>>>>
>>>>> Hi
>>>>>
>>>>> On Fri, Jul 20, 2012 at 10:07 PM, Etienne Tourigny
>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>
>>>>>>> One thing that would be really nice is to have
>>>>>>> some default profiles:
>>>>>>>
>>>>>>> - options for maximum read performance regardless of disk space
>>>>>>> - options for minumum file size regardless of performance
>>>>>>> - options for 'middle of the road' between the above two
>>>>>>
>>>>>> would you have these options for all file types? it could get a little
>>>>>> complex, but worth the effort. For now I am implementing 1 default for
>>>>>> each driver, which can be defined by the user.
>>>>>>
>>>>> I was thinking just for tiff as I think it is the most generically used.
>>>>>
>>>>> Regards
>>>>>
>>>>> Tim
>>>>>
>>>>>> Etienne
>>>>>>
>>>>>>> Regards
>>>>>>>
>>>>>>> Tim
>>>>>>>
>>>>>>>
>>>>>>>>> I have granted you write access, please work directly in
>>>>>>>>> raster-pipes-2.
>>>>>>>>
>>>>>>>> thanks
>>>>>>>> Etienne
>>>>>>>>
>>>>>>>>> Radim
>>>>>>>>>
>>>>>>>>>> Etienne
>>>>>>>>>>
>>>>>>>>>> On Thu, Jul 19, 2012 at 7:21 PM, Tim Sutton <lists at linfiniti.com>
>>>>>>>>>> wrote:
>>>>>>>>>>>
>>>>>>>>>>> Hi
>>>>>>>>>>>
>>>>>>>>>>> On Fri, Jul 20, 2012 at 12:19 AM, Etienne Tourigny
>>>>>>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> On Thu, Jul 19, 2012 at 4:09 PM, Marco Hugentobler
>>>>>>>>>>>> <marco.hugentobler at sourcepole.ch> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>> Hi Etienne
>>>>>>>>>>>>>
>>>>>>>>>>>>> Thanks for the feedback, very much appreciated. I've fixed these
>>>>>>>>>>>>> issues in
>>>>>>>>>>>>> raster-pipes-2 branch now.
>>>>>>>>>>>>>
>>>>>>>>>>>>> There are still a few things missing in raster saving:
>>>>>>>>>>>>> - write colortable to output dataset
>>>>>>>>>>>>> - format specific options (e.g. compression)
>>>>>>>>>>>>> - dynamic populating of the format combo box (currently
>>>>>>>>>>>>> hardcoded to
>>>>>>>>>>>>> geotiff)
>>>>>>>>>>>>> - progress indication for tile based saving and possibility to
>>>>>>>>>>>>> cancel
>>>>>>>>>>>>
>>>>>>>>>>>> It just occurred to me that it would be a great thing to
>>>>>>>>>>>> implement
>>>>>>>>>>>> this as a widget+class in QgisGui, so that it could be used
>>>>>>>>>>>> elsewhere
>>>>>>>>>>>> (e.g. gdaltools, sextante).
>>>>>>>>>>>>
>>>>>>>>>>> You mean as a reusable widget like the crs selector? Yes that
>>>>>>>>>>> would be great!
>>>>>>>>>>>
>>>>>>>>>>> Regards
>>>>>>>>>>>
>>>>>>>>>>> Tim
>>>>>>>>>>>
>>>>>>>>>>>> Any way I can help?
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>> Marco
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On 18.07.2012 21:12, Etienne Tourigny wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Noticed a few issues with the save dialog
>>>>>>>>>>>>>>    1) "format" drop-down is empty
>>>>>>>>>>>>>> 2) cannot select a new file
>>>>>>>>>>>>>> 3) segfault when saving to an existing file
>>>>>>>>>>>>>> 4) It would be nice to have that action in the legend
>>>>>>>>>>>>>> contextual menu,
>>>>>>>>>>>>>> like for vector layers.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>> Etienne
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Jul 18, 2012 at 3:59 PM, Etienne Tourigny
>>>>>>>>>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> That's great news!
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Concerning raster saving - will there be a mechanism for
>>>>>>>>>>>>>>> compressing
>>>>>>>>>>>>>>> files?
>>>>>>>>>>>>>>> It would be great if default compression schemes could be
>>>>>>>>>>>>>>> chosen for
>>>>>>>>>>>>>>> different file types, and an option at save time - sort of
>>>>>>>>>>>>>>> like image
>>>>>>>>>>>>>>> editors.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I had trouble building it with external spatialite, could only
>>>>>>>>>>>>>>> get it
>>>>>>>>>>>>>>> to compile with cmake -DWITH_INTERNAL_SPATIALITE=TRUE - does
>>>>>>>>>>>>>>> this
>>>>>>>>>>>>>>> require a special version of spatialite?
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>> Etienne
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Jul 18, 2012 at 12:13 PM, Marco Hugentobler
>>>>>>>>>>>>>>> <marco.hugentobler at sourcepole.ch> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Hi devs
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I'd like to announce the branch 'raster-pipes-2' in Radims
>>>>>>>>>>>>>>>> repository
>>>>>>>>>>>>>>>> https://github.com/blazek/Quantum-GIS for testing.
>>>>>>>>>>>>>>>> Radim did a great job in refactoring the process of reading /
>>>>>>>>>>>>>>>> resampling
>>>>>>>>>>>>>>>> /
>>>>>>>>>>>>>>>> reprojecting / displaying / modifying raster layers. Every
>>>>>>>>>>>>>>>> step is now a
>>>>>>>>>>>>>>>> subclass of QgsRasterInterface, with the advantage that
>>>>>>>>>>>>>>>> several steps
>>>>>>>>>>>>>>>> can be
>>>>>>>>>>>>>>>> chained in a QgsRasterPipe. Like that, the raster
>>>>>>>>>>>>>>>> functionality is
>>>>>>>>>>>>>>>> nicely
>>>>>>>>>>>>>>>> separated into different classes and it is easy to add/remove
>>>>>>>>>>>>>>>> elements
>>>>>>>>>>>>>>>> in
>>>>>>>>>>>>>>>> the pipe. The iteration over the raster parts is controlled
>>>>>>>>>>>>>>>> by
>>>>>>>>>>>>>>>> QgsRasterIterator (because for high-resolution prints or
>>>>>>>>>>>>>>>> analysis on
>>>>>>>>>>>>>>>> large
>>>>>>>>>>>>>>>> datasets, it is impossible to keep everything in memory at
>>>>>>>>>>>>>>>> once).
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Please report any issue you find in the branch to the
>>>>>>>>>>>>>>>> developer mailing
>>>>>>>>>>>>>>>> list.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Besides the changes in code architecture, there is also a new
>>>>>>>>>>>>>>>> feature in
>>>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>> raster-pipes-2 branch. It is now possible to write through
>>>>>>>>>>>>>>>> QgsRasterDataProvider (currently only supported by the gdal
>>>>>>>>>>>>>>>> provider).
>>>>>>>>>>>>>>>> There
>>>>>>>>>>>>>>>> is a 'save as...' function also for rasters now (though it is
>>>>>>>>>>>>>>>> not 100%
>>>>>>>>>>>>>>>> complete at the moment). There is the option to save a raster
>>>>>>>>>>>>>>>> in one
>>>>>>>>>>>>>>>> file or
>>>>>>>>>>>>>>>> in tiles (the tiles are then saved in one directory and vrt /
>>>>>>>>>>>>>>>> pyramides
>>>>>>>>>>>>>>>> are
>>>>>>>>>>>>>>>> automatically created. Very usefull for saving the contents
>>>>>>>>>>>>>>>> of a WMS
>>>>>>>>>>>>>>>> layer).
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>> Marco
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>> Dr. Marco Hugentobler
>>>>>>>>>>>>>>>> Sourcepole -  Linux & Open Source Solutions
>>>>>>>>>>>>>>>> Weberstrasse 5, CH-8004 Zürich, Switzerland
>>>>>>>>>>>>>>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>>>>>>>>>>>>>>> Technical Advisor QGIS Project Steering Committee
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Dr. Marco Hugentobler
>>>>>>>>>>>>> Sourcepole -  Linux & Open Source Solutions
>>>>>>>>>>>>> Churerstrasse 22, CH-8808 Pfäffikon SZ, Switzerland
>>>>>>>>>>>>>
>>>>>>>>>>>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>>>>>>>>>>>> Technical Advisor QGIS Project Steering Committee
>>>>>>>>>>>>>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release
>>>>>>>>>>> Manager)
>>>>>>>>>>> ==============================================
>>>>>>>>>>> Please do not email me off-list with technical
>>>>>>>>>>> support questions. Using the lists will gain
>>>>>>>>>>> more exposure for your issues and the knowledge
>>>>>>>>>>> surrounding your issue will be shared with all.
>>>>>>>>>>>
>>>>>>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>>>>>>   * QGIS programming and support services
>>>>>>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>>>>>>   * FOSS Consulting Services
>>>>>>>>>>> Skype: timlinux
>>>>>>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>>>>>>> ==============================================
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Qgis-developer mailing list
>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release  Manager)
>>>>>>> ==============================================
>>>>>>> Please do not email me off-list with technical
>>>>>>> support questions. Using the lists will gain
>>>>>>> more exposure for your issues and the knowledge
>>>>>>> surrounding your issue will be shared with all.
>>>>>>>
>>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>>   * QGIS programming and support services
>>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>>   * FOSS Consulting Services
>>>>>>> Skype: timlinux
>>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>>> ==============================================
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release  Manager)
>>>>> ==============================================
>>>>> Please do not email me off-list with technical
>>>>> support questions. Using the lists will gain
>>>>> more exposure for your issues and the knowledge
>>>>> surrounding your issue will be shared with all.
>>>>>
>>>>> Visit http://linfiniti.com to find out about:
>>>>>   * QGIS programming and support services
>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>   * FOSS Consulting Services
>>>>> Skype: timlinux
>>>>> Irc: timlinux on #qgis at freenode.net
>>>>> ==============================================
>>>
>>>
>>>
>>
>>
>> --
>> Dr. Marco Hugentobler
>> Sourcepole -  Linux & Open Source Solutions
>> Weberstrasse 5, CH-8004 Zürich, Switzerland
>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>> Technical Advisor QGIS Project Steering Committee
>>
>> _______________________________________________
>> Qgis-developer mailing list
>> Qgis-developer at lists.osgeo.org
>> http://lists.osgeo.org/mailman/listinfo/qgis-developer