[postgis-tickets] r15468 - Bring performance tips section up to newer versions
Regina Obe
lr at pcorp.us
Fri Jun 30 11:33:34 PDT 2017
Author: robe
Date: 2017-06-30 11:33:34 -0700 (Fri, 30 Jun 2017)
New Revision: 15468
Modified:
trunk/doc/performance_tips.xml
trunk/doc/using_postgis_dataman.xml
Log:
Bring performance tips section up to newer versions
References #3746 for PostGIS 2.4 (trunk)
Modified: trunk/doc/performance_tips.xml
===================================================================
--- trunk/doc/performance_tips.xml 2017-06-28 08:27:14 UTC (rev 15467)
+++ trunk/doc/performance_tips.xml 2017-06-30 18:33:34 UTC (rev 15468)
@@ -8,7 +8,7 @@
<sect2>
<title>Problem description</title>
- <para>Current PostgreSQL versions (including 8.0) suffer from a query
+ <para>Current PostgreSQL versions (including 9.6) suffer from a query
optimizer weakness regarding TOAST tables. TOAST tables are a kind of
"extension room" used to store large (in the sense of data size) values
that do not fit into normal data pages (like long texts, images or
@@ -17,7 +17,7 @@
information).</para>
<para>The problem appears if you happen to have a table with rather
- large geometries, but not too much rows of them (like a table containing
+ large geometries, but not too manyrows of them (like a table containing
the boundaries of all European countries in high resolution). Then the
table itself is small, but it uses lots of TOAST space. In our example
case, the table itself had about 80 rows and used only 3 data pages, but
@@ -26,17 +26,19 @@
<para>Now issue a query where you use the geometry operator &&
to search for a bounding box that matches only very few of those rows.
Now the query optimizer sees that the table has only 3 pages and 80
- rows. He estimates that a sequential scan on such a small table is much
- faster than using an index. And so he decides to ignore the GIST index.
+ rows. It estimates that a sequential scan on such a small table is much
+ faster than using an index. And so it decides to ignore the GIST index.
Usually, this estimation is correct. But in our case, the &&
operator has to fetch every geometry from disk to compare the bounding
boxes, thus reading all TOAST pages, too.</para>
- <para>To see whether your suffer from this bug, use the "EXPLAIN
+ <para>To see whether your suffer from this issue, use the "EXPLAIN
ANALYZE" postgresql command. For more information and the technical
details, you can read the thread on the postgres performance mailing
list:
- http://archives.postgresql.org/pgsql-performance/2005-02/msg00030.php</para>
+ <ulink url="http://archives.postgresql.org/pgsql-performance/2005-02/msg00030.php">http://archives.postgresql.org/pgsql-performance/2005-02/msg00030.php</ulink></para>
+
+ <para>and newer thread on PostGIS <ulink url="https://lists.osgeo.org/pipermail/postgis-devel/2017-June/026209.html">https://lists.osgeo.org/pipermail/postgis-devel/2017-June/026209.html</ulink></para>
</sect2>
<sect2>
@@ -146,7 +148,7 @@
geometries and rasters are heavy so memory related optimizations generally have more of an impact on PostGIS than other types of PostgreSQL queries.</para>
<para>For general details about optimizing PostgreSQL, refer to <ulink url="https://wiki.postgresql.org/wiki/Tuning_Your_PostgreSQL_Server">Tuning your PostgreSQL Server</ulink>.</para>
-
+
<para>For PostgreSQL 9.4+ all these can be set at the server level without touching postgresql.conf or postgresql.auto.conf
by using the <code>ALTER SYSTEM..</code> command.</para>
<programlisting>ALTER SYSTEM SET work_mem = '256MB';
@@ -191,17 +193,17 @@
<itemizedlist>
<listitem>
<para>
- Default: ~32MB
+ Default: ~128MB in PostgreSQL 9.6
</para>
</listitem>
<listitem>
<para>
- Set to about 1/3 to 3/4 of available RAM
+ Set to about 25% to 40% of available RAM. On windows you may not be able to set as high.
</para>
</listitem>
</itemizedlist>
-
-
+
+
<para>
<ulink url="https://www.postgresql.org/docs/current/static/runtime-config-resource.html#GUC-MAX-WORKER-PROCESSES">max_worker_processes</ulink>
This setting is only available for PostgreSQL 9.4+. For PostgreSQL 9.6+ this setting has additional importance in that it controls the
@@ -251,7 +253,7 @@
<para>
If you have lots of RAM and few developers:
<programlisting>
- SET work_mem TO '256MB';;
+ SET work_mem TO '256MB';
</programlisting>
</para>
</listitem>
@@ -282,10 +284,10 @@
</para>
</listitem>
</itemizedlist>
-
+
<para>
<ulink url="https://www.postgresql.org/docs/current/static/runtime-config-resource.html#GUC-MAX-PARALLEL-WORKERS-PER-GATHER">max_parallel_workers_per_gather</ulink>
- This setting is only available for PostgreSQL 9.6+ and will only affect PostGIS 2.3+, since only PostGIS 2.3+ supports parallel queries.
+ This setting is only available for PostgreSQL 9.6+ and will only affect PostGIS 2.3+, since only PostGIS 2.3+ supports parallel queries.
If set to higher than 0, then some queries such as those involving relation functions like <code>ST_Intersects</code> can use multiple processes and can run
more than twice as fast when doing so. If you have a lot of processors to spare, you should change the value of this to as many processors as you have.
Also make sure to bump up <code>max_worker_processes</code> to at least as high as this number.
Modified: trunk/doc/using_postgis_dataman.xml
===================================================================
--- trunk/doc/using_postgis_dataman.xml 2017-06-28 08:27:14 UTC (rev 15467)
+++ trunk/doc/using_postgis_dataman.xml 2017-06-30 18:33:34 UTC (rev 15468)
@@ -748,16 +748,17 @@
<sect2 id="Manual_Register_Spatial_Column">
<title>Manually Registering Geometry Columns in geometry_columns</title>
- <para>The AddGeometryColumn() approach creates a geometry column and also registers the new
- column in the geometry_columns table. If your software utilizes geometry_columns, then
- any geometry columns you need to query by must be registered in this view.
+ <para>The AddGeometryColumn() approach creates a geometry column of specified type.
+ This type and dimension are queryable from the <varname>geometry_columns</varname> view.
Starting with PostGIS 2.0, geometry_columns is no longer editable and all geometry columns are autoregistered.</para>
- <para>However they may be registered as a generic geometry column if the column was not defined as a specific type during creation.</para>
+ <para>If your geometry columns were created as generic in a table or view and no constraints applied, they will not have a dimension, type or srid in geometry_columns views, but will still be listed.</para>
<para>Two of the cases
where this may happen, but you can't use
- AddGeometryColumn, is in the case of SQL Views and bulk inserts. For these cases, you can correct the registration in the geometry_columns table
- by constraining the column. Note in PostGIS 2.0+ if your column is typmod based, the creation process would register it correctly, so no need to do anything.</para>
+ AddGeometryColumn, is in the case of SQL Views and bulk inserts. For bulk insert case, you can correct the registration in the geometry_columns table
+ by constraining the column or doing an alter table. For views, you could expose using a CAST operation.
+ Note in PostGIS 2.0+ if your column is typmod based, the creation process would register it correctly, so no need to do anything.
+ Also views that have no spatial function applied to the geometry will register the same as the underlying table geometry column.</para>
<programlisting>--Lets say you have a view created like this
CREATE VIEW public.vwmytablemercator AS
More information about the postgis-tickets
mailing list