[QGIS-Developer] Refactor Fields: save and load mapping configuration

Matthias Kuhn matthias at opengis.ch
Thu Nov 23 04:42:01 PST 2017


Hi,

this is awesome and something I have been trying to push towards at a
lot of meetings over the last year.

It reminds me a lot of this proposal by Arnaud Morvan, with the
technical details that are required to get all your wishes working:

https://github.com/qgis/QGIS-Enhancement-Proposals/issues/89

Cheers
Matthias

On 11/23/2017 01:35 PM, Andreas Neumann wrote:
> Hi Régis,
> 
> I agree - it would be good to brainstorm what's missing to have an
> FME-like ETL environment.
> 
> I see that you are coming to the Madeira dev meeting. Would be a good
> opportunity for such discussions and then open the QEP in parallel (or
> open it before and work on it).
> 
> BTW: refactor fields isn't such a bad name in my opinion. Perhaps we
> could introduce aliases for algorithms - so that they could be found
> more easily?
> 
> Greetings,
> 
> Andreas
> 
> On 2017-11-23 09:12, Régis Haubourg wrote:
> 
>> Hi Andreas, 
>> I don't have any answer to that particular question, but in many
>> project we are working for, it becomes clear that we need to push
>> processing to become an ETL, and the field mapping component is
>> clearly a key feature. 
>> What do you think about opening a QEP and store in there all what's
>> currently missing for a clean and easy workflow? 
>> We clearly will have some funders in 2018. 
>>  
>> I see :
>>  
>> # Mapping field alg:
>>  
>>  - rename it to something more easy to find. What about "Field matcher" ?
>>  - automap fields using tolerant expression based on heuristics
>> (unaccent, lowercase, soundhex or whatever, field order.. )
>>  - save and restore config. 
>>  - Auto restore for same table names
>>  - And, the key for fame,  a graphical component for field matching,
>> because this is what we all want :)
>>  
>> # database writer :
>>  - finely control all SQL options: drop table / recreate / truncate /
>> insert / update with where clause 
>>  - add rollback option to just try without commiting
>>  - return all database logs in details
>>  
>> Opinions? 
>>  
>> Régis
>>  
>>
>> 2017-11-23 9:01 GMT+01:00 Andreas Neumann <a.neumann at carto.net
>> <mailto:a.neumann at carto.net>>:
>>
>>     Hi,
>>
>>     The refactor fields algorithm is potentially very powerful.
>>
>>     However, I do miss a way to save and load the configuration (or
>>     maybe I just haven't found it). I have layers with many fields and
>>     I am adding additional fields with expressions.
>>
>>     Every time I run it, I have to do the configuration again and
>>     again. Is there a way to save and load the mapping configuration?
>>     It would save me a lot of time!
>>
>>     Thanks,
>>     Andreas
>>
>>
>>
>>     _______________________________________________
>>     QGIS-Developer mailing list
>>     QGIS-Developer at lists.osgeo.org <mailto:QGIS-Developer at lists.osgeo.org>
>>     List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
>>     <https://lists.osgeo.org/mailman/listinfo/qgis-developer>
>>     Unsubscribe:
>>     https://lists.osgeo.org/mailman/listinfo/qgis-developer
>>     <https://lists.osgeo.org/mailman/listinfo/qgis-developer>
>>
> 
> 
> 
> _______________________________________________
> QGIS-Developer mailing list
> QGIS-Developer at lists.osgeo.org
> List info: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> Unsubscribe: https://lists.osgeo.org/mailman/listinfo/qgis-developer
> 


More information about the QGIS-Developer mailing list