I agree with this. <br><br>FDO is already seen as large and awkward by much of the larger open source community. Anything that can be done to reduce complexity, or at least not increase complexity, is good.<br><br>Jason<br>
<br><div class="gmail_quote">2009/9/16 Traian Stanev <span dir="ltr"><<a href="mailto:traian.stanev@autodesk.com">traian.stanev@autodesk.com</a>></span><br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br>
Hi Dan,<br>
<br>
I think you are right, there are not many places where the performance gain would be significant -- but they do exist. Imagine a copy from one data source to another, of a feature class with 100K features and 100 columns -- a common situation with street network files. For each feature, for each property, you would have to do a name->index lookup inside the reader provider (SDF, SQLite, SHP or whatever other provider gets columns by index natively). Such lookups do get costly once you have lots of columns.<br>
<br>
If given a choice between the RFC34 as it is now and not having access by index at all, I would choose the latter -- i.e. I'd rather see the RFC withdrawn than implemented in a way that will require API users to write more code to use it than if they used access by name. Simply because if it's more work to use access by index, I don't see people switching their code around to make use of it.<br>
<font color="#888888"><br>
Traian<br>
</font><div class="im"><br>
<br>
> -----Original Message-----<br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
</div><div><div></div><div class="h5">> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Dan Stoica<br>
> Sent: Wednesday, September 16, 2009 9:54 AM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Talking about the performance gain it might be disappointing. The reason is<br>
> the access by name has been optimized for a number of providers.<br>
><br>
> As for convenience, I'm not very sure either.<br>
><br>
> Dan.<br>
><br>
> -----Original Message-----<br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Klain Qin<br>
> Sent: Tuesday, September 15, 2009 10:02 PM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Yes, Carsten. You are right. This is exactly the way being proposed for the<br>
> default implementation as depicted in the RFC.<br>
><br>
> Klain<br>
><br>
> -----Original Message-----<br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Carsten Hess<br>
> Sent: Wednesday, September 16, 2009 9:39 AM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Hi,<br>
><br>
> Couldn't the default implementation of the reader base class implement an<br>
> index based access using a name / index hashtable?<br>
> That way index based access would be about as slow as name based access in<br>
> the default cases and in providers taht override this index based behavior<br>
> the access would be faster. It also would not put a burden on the client<br>
> code while not loosing any performance in either case.<br>
><br>
> Cheers,<br>
> Carsten<br>
> ________________________________________<br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [fdo-internals-<br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Klain Qin [<a href="mailto:klain.qin@autodesk.com">klain.qin@autodesk.com</a>]<br>
> Sent: Tuesday, September 15, 2009 9:34 PM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> To fix all of the providers internally would be hard and involve much work.<br>
> One example is: there are several providers like sqllite/rdbms which have<br>
> delay loading readers in some cases meaning the first property being<br>
> accessed will be first cached for class definition. There are other<br>
> complexities to ensure the consistency. So to provide an API like<br>
> GetPropertyIndex() would be easier for the users to use the new API<br>
> conveniently and correctly. The only concern is, as you mentioned, the<br>
> client codes have to keep a property name->index map by themselves. But<br>
> still providing this new API will be the easiest and least efforts at this<br>
> time.<br>
><br>
> Klain<br>
><br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Traian Stanev<br>
> Sent: Tuesday, September 15, 2009 10:25 PM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
><br>
> How hard would it be to fix the providers internally so that the index of<br>
> the properties in the collection returned with GetClassDefinition<br>
> corresponds to the index needed for getting the property by index? I suspect<br>
> it is not too hard since it would involve the same amount of work as<br>
> implementing this new GetPropertyIndex API, but will not add new API that<br>
> one has to call before getting the properties by index.<br>
><br>
><br>
> Traian<br>
><br>
><br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Klain Qin<br>
> Sent: Monday, September 14, 2009 11:02 PM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Hi all,<br>
><br>
> While this RFC is being voted, I've updated it again in order to use access<br>
> by index API more efficiently and correctly.<br>
><br>
> Previously in order to use access by index functions for FdoIFeatureReader<br>
> or FdoIDataReader, the API users will have to know beforehand how index is<br>
> mapping to property name. And mapping is different for different provider<br>
> implementations like SqlLite/SDF and RDBMS. E.g. with the same FDO schema<br>
> definition, SqlLite and RDBMS will arrange the property order returned from<br>
> GetClassDefinition() differently:<br>
><br>
><br>
> a. If you don't set selected property names be returned from an<br>
> FdoISelect command<br>
><br>
><br>
><br>
> SqlLite provider will arrange the properties in the order: Identity property<br>
> -> Geometry property -> the left will be arranged in the order of how they<br>
> are added into the class definition, like ID -> geometry -> datetime-><br>
> double<br>
><br>
> For RDBMS provider the order is: identity property -> the left is ordered by<br>
> the first character of the property name like ID -> datetime-> double -><br>
> geometry<br>
><br>
><br>
><br>
> b. If you do set selected property names to be returned from an<br>
> FdoISelect command<br>
><br>
><br>
><br>
> SqlLite provider will respect the order of how they are added to selected<br>
> properties.<br>
><br>
> SDF provider will respect the order of corresponding properties defined in<br>
> the original class definition(without setting selected properties)<br>
><br>
> So to resolve this inconvenience, RFC 34 is updated again to add another<br>
> function for getting the index of a specific property name. Now both of the<br>
> property name and index related functions are moved to FdoIReader as they<br>
> are needed for both FdoIFeatureReader and FdoIDataReader.<br>
> FdoString* GetPropertyName(FdoInt32 index);<br>
> FdoInt32 GetPropertyIndex(FdoString* propertyName);<br>
> Can you take a look again at this RFC?<br>
><br>
> <a href="http://trac.osgeo.org/fdo/wiki/FDORfc34" target="_blank">http://trac.osgeo.org/fdo/wiki/FDORfc34</a><br>
><br>
> Thanks,<br>
> Klain<br>
><br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Greg Boone<br>
> Sent: Monday, September 14, 2009 11:33 PM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] MOTION: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Hi all,<br>
><br>
> There were no further comments on RFC 34:<br>
> <a href="http://trac.osgeo.org/fdo/wiki/FDORfc34" target="_blank">http://trac.osgeo.org/fdo/wiki/FDORfc34</a> - FDO Reader Access By Index.<br>
><br>
> I would like to motion a vote to accept this RFC.<br>
><br>
> Thanks,<br>
> Greg.<br>
><br>
><br>
><br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Greg Boone<br>
> Sent: Wednesday, September 09, 2009 12:41 PM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] RE: FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Hi All,<br>
><br>
> FDO RFC 34 - Access By Index: <a href="http://trac.osgeo.org/fdo/wiki/FDORfc34" target="_blank">http://trac.osgeo.org/fdo/wiki/FDORfc34</a> has<br>
> been updated and is ready for a secondary review.<br>
><br>
> Please refer to the section labeled: "Provider Implementation"<br>
><br>
> Please respond with comments by end of day, Friday September 11.<br>
><br>
> Greg<br>
><br>
> From: <a href="mailto:fdo-internals-bounces@lists.osgeo.org">fdo-internals-bounces@lists.osgeo.org</a> [mailto:<a href="mailto:fdo-internals-">fdo-internals-</a><br>
> <a href="mailto:bounces@lists.osgeo.org">bounces@lists.osgeo.org</a>] On Behalf Of Greg Boone<br>
> Sent: Thursday, August 06, 2009 9:39 AM<br>
> To: FDO Internals Mail List<br>
> Subject: [fdo-internals] FDO RFC 34 - FDO Reader Access By Index<br>
><br>
> Hi All,<br>
><br>
> FDO RFC 34, <a href="http://trac.osgeo.org/fdo/wiki/FDORfc34" target="_blank">http://trac.osgeo.org/fdo/wiki/FDORfc34</a>, is ready for review.<br>
><br>
> Please review and respond with comments.<br>
><br>
> Greg<br>
><br>
><br>
><br>
><br>
> _______________________________________________<br>
> fdo-internals mailing list<br>
> <a href="mailto:fdo-internals@lists.osgeo.org">fdo-internals@lists.osgeo.org</a><br>
> <a href="http://lists.osgeo.org/mailman/listinfo/fdo-internals" target="_blank">http://lists.osgeo.org/mailman/listinfo/fdo-internals</a><br>
> _______________________________________________<br>
> fdo-internals mailing list<br>
> <a href="mailto:fdo-internals@lists.osgeo.org">fdo-internals@lists.osgeo.org</a><br>
> <a href="http://lists.osgeo.org/mailman/listinfo/fdo-internals" target="_blank">http://lists.osgeo.org/mailman/listinfo/fdo-internals</a><br>
> _______________________________________________<br>
> fdo-internals mailing list<br>
> <a href="mailto:fdo-internals@lists.osgeo.org">fdo-internals@lists.osgeo.org</a><br>
> <a href="http://lists.osgeo.org/mailman/listinfo/fdo-internals" target="_blank">http://lists.osgeo.org/mailman/listinfo/fdo-internals</a><br>
_______________________________________________<br>
fdo-internals mailing list<br>
<a href="mailto:fdo-internals@lists.osgeo.org">fdo-internals@lists.osgeo.org</a><br>
<a href="http://lists.osgeo.org/mailman/listinfo/fdo-internals" target="_blank">http://lists.osgeo.org/mailman/listinfo/fdo-internals</a><br>
</div></div></blockquote></div><br>