[gdal-dev] Default page size of the OAPIF driver
Rahkonen Jukka
jukka.rahkonen at maanmittauslaitos.fi
Fri Oct 6 07:39:53 PDT 2023
Hi,
The OAPIF driver is using page size of 10 features by default https://gdal.org/drivers/vector/oapif.html#open-options.
"PAGE_SIZE=<integer>: Defaults to 10. Number of features to retrieve per request. Minimum is 1, maximum 10000."
I know that 10 is the default page size ("limit") also in the standard but I think that this is too small page size, both for the users and especially for the service providers. Most users run GDAL utilities with the defaults. The buildings collection in our OGC API Features service has about 5 million features, which means that GDAL users are fetching the data by sending half a million request. That is much slower for the users than making 500 request, 10000 features each. And think about our log files.
The better default page size would be the biggest that the OAPIF server supports. By the standard the maximum is 10000 but service providers may use bigger or smaller maximum page sizes. By the standard the server can always return less features than client is asking with "limit=" and the client must be prepared to follow the next links.
My suggestion for the new page size default is 10000. If that feels too big for some reason, then would 1000 feel better?
-Jukka Rahkonen-
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.osgeo.org/pipermail/gdal-dev/attachments/20231006/7a3332be/attachment.htm>
More information about the gdal-dev
mailing list