[fdo-trac] #431: Make SDF Cache size tunable

FDO trac_fdo at osgeo.org
Wed Nov 19 14:37:16 EST 2008


#431: Make SDF Cache size tunable
-----------------------------+----------------------------------------------
   Reporter:  brentrobinson  |       Owner:  brentrobinson               
       Type:  enhancement    |      Status:  new                         
   Priority:  major          |   Milestone:  3.4.0                       
  Component:  FDO API        |     Version:  3.4.0                       
   Severity:  2              |    Keywords:  SDF insert performance cache
External_id:                 |  
-----------------------------+----------------------------------------------
 The SDF provider has an in-memory cache of inserted and updated features.
 The cache limit is 500 features. When the cache size is exceeded, the
 features are flushed to the SDF file.

 For some data sets, a larger cache limit leads to better feature insertion
 performance, which can speed up the initial population of these SDF files.
 However, the amount of improvement varies greatly by data set.

 This ticket proposes a couple of modifications to make the SDF cache size
 adjustable:

  1. Add a new environment variable called SDF_MAXCACHESIZE. When set, the
 SDF provider sets the cache size to the number specified. If the variable
 is a non-positive number, not numeric, or not set then the cache size
 defaults to 500 features.

  2. Add a new SDF Provider connection parameter, called MaxCacheSize,
 which behaves the same way as the above environment variable. This allows
 the tuning of the cache size for individual SDF connections. If the
 environment variable is also set, the connection parameter takes
 precedence.

 The above provides the opportunity to try different cache sizes to arrive
 at the optimal sizes for particular data sets.

-- 
Ticket URL: <http://trac.osgeo.org/fdo/ticket/431>
FDO <http://fdo.osgeo.org/>
Feature Data Objects


More information about the fdo-trac mailing list