[Qgis-developer] Announcing raster-pipes-2 branch for testing

Tim Sutton lists at linfiniti.com
Tue Jul 24 13:19:47 PDT 2012


Hi

On Tue, Jul 24, 2012 at 8:44 PM, Radim Blazek <radim.blazek at gmail.com> wrote:
> On Tue, Jul 24, 2012 at 7:15 PM, Radim Blazek <radim.blazek at gmail.com> wrote:
>> On Tue, Jul 24, 2012 at 4:53 PM, Marco Hugentobler
>> <marco.hugentobler at sourcepole.ch> wrote:
>>> Hi all
>>>
>>> I think it would be a good move to merge the raster-pipes-2 branch back to
>>> trunk. Ok, I know more instabilities, things to polish, etc. But in trunk,
>>> it receives more attention and people are more motivated to work on it.
>>>
>>> Any objections?
>>
>> Tests should pass OK before merge, I think. Then +1.
>
> Fixed. Now +1.
>

+1 from me

Regards

Tim

> Radim
>
>> Do you want to merge everything as a single commit or all commits from
>> raster-pipes-2? I would prefer to squash my initial work on pipes
>> (87607187-2fdd82f4) into a single commit.
>>
>> Radim
>>
>>
>>> Regards,
>>> Marco
>>>
>>> Am 20.07.2012 22:15, schrieb Tim Sutton:
>>>
>>>> Hi
>>>>
>>>> On Fri, Jul 20, 2012 at 10:13 PM, Etienne Tourigny
>>>> <etourigny.dev at gmail.com> wrote:
>>>>>
>>>>> Ok this is a more general question then - which format(s) should
>>>>> raster export support?
>>>>>
>>>> It should support any GDAL raster driver that supports write and that
>>>> is useable with the active dataset.
>>>>
>>>> I was referring to tif only in terms of the default profiles I mentioned.
>>>>
>>>> Regards
>>>>
>>>> Tim
>>>>
>>>>> Etienne
>>>>>
>>>>> On Fri, Jul 20, 2012 at 5:11 PM, Tim Sutton <lists at linfiniti.com> wrote:
>>>>>>
>>>>>> Hi
>>>>>>
>>>>>> On Fri, Jul 20, 2012 at 10:07 PM, Etienne Tourigny
>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>
>>>>>>>> One thing that would be really nice is to have
>>>>>>>> some default profiles:
>>>>>>>>
>>>>>>>> - options for maximum read performance regardless of disk space
>>>>>>>> - options for minumum file size regardless of performance
>>>>>>>> - options for 'middle of the road' between the above two
>>>>>>>
>>>>>>> would you have these options for all file types? it could get a little
>>>>>>> complex, but worth the effort. For now I am implementing 1 default for
>>>>>>> each driver, which can be defined by the user.
>>>>>>>
>>>>>> I was thinking just for tiff as I think it is the most generically used.
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>> Tim
>>>>>>
>>>>>>> Etienne
>>>>>>>
>>>>>>>> Regards
>>>>>>>>
>>>>>>>> Tim
>>>>>>>>
>>>>>>>>
>>>>>>>>>> I have granted you write access, please work directly in
>>>>>>>>>> raster-pipes-2.
>>>>>>>>>
>>>>>>>>> thanks
>>>>>>>>> Etienne
>>>>>>>>>
>>>>>>>>>> Radim
>>>>>>>>>>
>>>>>>>>>>> Etienne
>>>>>>>>>>>
>>>>>>>>>>> On Thu, Jul 19, 2012 at 7:21 PM, Tim Sutton <lists at linfiniti.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>> Hi
>>>>>>>>>>>>
>>>>>>>>>>>> On Fri, Jul 20, 2012 at 12:19 AM, Etienne Tourigny
>>>>>>>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Thu, Jul 19, 2012 at 4:09 PM, Marco Hugentobler
>>>>>>>>>>>>> <marco.hugentobler at sourcepole.ch> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi Etienne
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Thanks for the feedback, very much appreciated. I've fixed these
>>>>>>>>>>>>>> issues in
>>>>>>>>>>>>>> raster-pipes-2 branch now.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> There are still a few things missing in raster saving:
>>>>>>>>>>>>>> - write colortable to output dataset
>>>>>>>>>>>>>> - format specific options (e.g. compression)
>>>>>>>>>>>>>> - dynamic populating of the format combo box (currently
>>>>>>>>>>>>>> hardcoded to
>>>>>>>>>>>>>> geotiff)
>>>>>>>>>>>>>> - progress indication for tile based saving and possibility to
>>>>>>>>>>>>>> cancel
>>>>>>>>>>>>>
>>>>>>>>>>>>> It just occurred to me that it would be a great thing to
>>>>>>>>>>>>> implement
>>>>>>>>>>>>> this as a widget+class in QgisGui, so that it could be used
>>>>>>>>>>>>> elsewhere
>>>>>>>>>>>>> (e.g. gdaltools, sextante).
>>>>>>>>>>>>>
>>>>>>>>>>>> You mean as a reusable widget like the crs selector? Yes that
>>>>>>>>>>>> would be great!
>>>>>>>>>>>>
>>>>>>>>>>>> Regards
>>>>>>>>>>>>
>>>>>>>>>>>> Tim
>>>>>>>>>>>>
>>>>>>>>>>>>> Any way I can help?
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>> Marco
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On 18.07.2012 21:12, Etienne Tourigny wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Noticed a few issues with the save dialog
>>>>>>>>>>>>>>>    1) "format" drop-down is empty
>>>>>>>>>>>>>>> 2) cannot select a new file
>>>>>>>>>>>>>>> 3) segfault when saving to an existing file
>>>>>>>>>>>>>>> 4) It would be nice to have that action in the legend
>>>>>>>>>>>>>>> contextual menu,
>>>>>>>>>>>>>>> like for vector layers.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>> Etienne
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Jul 18, 2012 at 3:59 PM, Etienne Tourigny
>>>>>>>>>>>>>>> <etourigny.dev at gmail.com> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> That's great news!
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> Concerning raster saving - will there be a mechanism for
>>>>>>>>>>>>>>>> compressing
>>>>>>>>>>>>>>>> files?
>>>>>>>>>>>>>>>> It would be great if default compression schemes could be
>>>>>>>>>>>>>>>> chosen for
>>>>>>>>>>>>>>>> different file types, and an option at save time - sort of
>>>>>>>>>>>>>>>> like image
>>>>>>>>>>>>>>>> editors.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I had trouble building it with external spatialite, could only
>>>>>>>>>>>>>>>> get it
>>>>>>>>>>>>>>>> to compile with cmake -DWITH_INTERNAL_SPATIALITE=TRUE - does
>>>>>>>>>>>>>>>> this
>>>>>>>>>>>>>>>> require a special version of spatialite?
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> regards,
>>>>>>>>>>>>>>>> Etienne
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Wed, Jul 18, 2012 at 12:13 PM, Marco Hugentobler
>>>>>>>>>>>>>>>> <marco.hugentobler at sourcepole.ch> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Hi devs
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I'd like to announce the branch 'raster-pipes-2' in Radims
>>>>>>>>>>>>>>>>> repository
>>>>>>>>>>>>>>>>> https://github.com/blazek/Quantum-GIS for testing.
>>>>>>>>>>>>>>>>> Radim did a great job in refactoring the process of reading /
>>>>>>>>>>>>>>>>> resampling
>>>>>>>>>>>>>>>>> /
>>>>>>>>>>>>>>>>> reprojecting / displaying / modifying raster layers. Every
>>>>>>>>>>>>>>>>> step is now a
>>>>>>>>>>>>>>>>> subclass of QgsRasterInterface, with the advantage that
>>>>>>>>>>>>>>>>> several steps
>>>>>>>>>>>>>>>>> can be
>>>>>>>>>>>>>>>>> chained in a QgsRasterPipe. Like that, the raster
>>>>>>>>>>>>>>>>> functionality is
>>>>>>>>>>>>>>>>> nicely
>>>>>>>>>>>>>>>>> separated into different classes and it is easy to add/remove
>>>>>>>>>>>>>>>>> elements
>>>>>>>>>>>>>>>>> in
>>>>>>>>>>>>>>>>> the pipe. The iteration over the raster parts is controlled
>>>>>>>>>>>>>>>>> by
>>>>>>>>>>>>>>>>> QgsRasterIterator (because for high-resolution prints or
>>>>>>>>>>>>>>>>> analysis on
>>>>>>>>>>>>>>>>> large
>>>>>>>>>>>>>>>>> datasets, it is impossible to keep everything in memory at
>>>>>>>>>>>>>>>>> once).
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Please report any issue you find in the branch to the
>>>>>>>>>>>>>>>>> developer mailing
>>>>>>>>>>>>>>>>> list.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Besides the changes in code architecture, there is also a new
>>>>>>>>>>>>>>>>> feature in
>>>>>>>>>>>>>>>>> the
>>>>>>>>>>>>>>>>> raster-pipes-2 branch. It is now possible to write through
>>>>>>>>>>>>>>>>> QgsRasterDataProvider (currently only supported by the gdal
>>>>>>>>>>>>>>>>> provider).
>>>>>>>>>>>>>>>>> There
>>>>>>>>>>>>>>>>> is a 'save as...' function also for rasters now (though it is
>>>>>>>>>>>>>>>>> not 100%
>>>>>>>>>>>>>>>>> complete at the moment). There is the option to save a raster
>>>>>>>>>>>>>>>>> in one
>>>>>>>>>>>>>>>>> file or
>>>>>>>>>>>>>>>>> in tiles (the tiles are then saved in one directory and vrt /
>>>>>>>>>>>>>>>>> pyramides
>>>>>>>>>>>>>>>>> are
>>>>>>>>>>>>>>>>> automatically created. Very usefull for saving the contents
>>>>>>>>>>>>>>>>> of a WMS
>>>>>>>>>>>>>>>>> layer).
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>>> Marco
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>>>> Dr. Marco Hugentobler
>>>>>>>>>>>>>>>>> Sourcepole -  Linux & Open Source Solutions
>>>>>>>>>>>>>>>>> Weberstrasse 5, CH-8004 Zürich, Switzerland
>>>>>>>>>>>>>>>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>>>>>>>>>>>>>>>> Technical Advisor QGIS Project Steering Committee
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Dr. Marco Hugentobler
>>>>>>>>>>>>>> Sourcepole -  Linux & Open Source Solutions
>>>>>>>>>>>>>> Churerstrasse 22, CH-8808 Pfäffikon SZ, Switzerland
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>>>>>>>>>>>>> Technical Advisor QGIS Project Steering Committee
>>>>>>>>>>>>>>
>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release
>>>>>>>>>>>> Manager)
>>>>>>>>>>>> ==============================================
>>>>>>>>>>>> Please do not email me off-list with technical
>>>>>>>>>>>> support questions. Using the lists will gain
>>>>>>>>>>>> more exposure for your issues and the knowledge
>>>>>>>>>>>> surrounding your issue will be shared with all.
>>>>>>>>>>>>
>>>>>>>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>>>>>>>   * QGIS programming and support services
>>>>>>>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>>>>>>>   * FOSS Consulting Services
>>>>>>>>>>>> Skype: timlinux
>>>>>>>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>>>>>>>> ==============================================
>>>>>>>>>>>
>>>>>>>>>>> _______________________________________________
>>>>>>>>>>> Qgis-developer mailing list
>>>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>>
>>>>>>>>> _______________________________________________
>>>>>>>>> Qgis-developer mailing list
>>>>>>>>> Qgis-developer at lists.osgeo.org
>>>>>>>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release  Manager)
>>>>>>>> ==============================================
>>>>>>>> Please do not email me off-list with technical
>>>>>>>> support questions. Using the lists will gain
>>>>>>>> more exposure for your issues and the knowledge
>>>>>>>> surrounding your issue will be shared with all.
>>>>>>>>
>>>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>>>   * QGIS programming and support services
>>>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>>>   * FOSS Consulting Services
>>>>>>>> Skype: timlinux
>>>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>>>> ==============================================
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Tim Sutton - QGIS Project Steering Committee Member (Release  Manager)
>>>>>> ==============================================
>>>>>> Please do not email me off-list with technical
>>>>>> support questions. Using the lists will gain
>>>>>> more exposure for your issues and the knowledge
>>>>>> surrounding your issue will be shared with all.
>>>>>>
>>>>>> Visit http://linfiniti.com to find out about:
>>>>>>   * QGIS programming and support services
>>>>>>   * Mapserver and PostGIS based hosting plans
>>>>>>   * FOSS Consulting Services
>>>>>> Skype: timlinux
>>>>>> Irc: timlinux on #qgis at freenode.net
>>>>>> ==============================================
>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Dr. Marco Hugentobler
>>> Sourcepole -  Linux & Open Source Solutions
>>> Weberstrasse 5, CH-8004 Zürich, Switzerland
>>> marco.hugentobler at sourcepole.ch http://www.sourcepole.ch
>>> Technical Advisor QGIS Project Steering Committee
>>>
>>> _______________________________________________
>>> Qgis-developer mailing list
>>> Qgis-developer at lists.osgeo.org
>>> http://lists.osgeo.org/mailman/listinfo/qgis-developer
> _______________________________________________
> Qgis-developer mailing list
> Qgis-developer at lists.osgeo.org
> http://lists.osgeo.org/mailman/listinfo/qgis-developer



-- 
Tim Sutton - QGIS Project Steering Committee Member (Release  Manager)
==============================================
Please do not email me off-list with technical
support questions. Using the lists will gain
more exposure for your issues and the knowledge
surrounding your issue will be shared with all.

Visit http://linfiniti.com to find out about:
 * QGIS programming and support services
 * Mapserver and PostGIS based hosting plans
 * FOSS Consulting Services
Skype: timlinux
Irc: timlinux on #qgis at freenode.net
==============================================


More information about the Qgis-developer mailing list