[PostGIS] #5798: Out of memory: Killed process

Wed Oct 16 00:57:14 PDT 2024

#5798: Out of memory: Killed process
--------------------------------+---------------------------
  Reporter:  Lars Aksel Opsahl  |      Owner:  strk
      Type:  defect             |     Status:  new
  Priority:  medium             |  Milestone:  PostGIS 3.5.1
 Component:  topology           |    Version:  3.4.x
Resolution:                     |   Keywords:
--------------------------------+---------------------------
Comment (by Lars Aksel Opsahl):

 We started at

 {{{
 2024-10-16 06:48:55.150 CEST >LOG:  starting PostgreSQL 16.4 (Ubuntu
 16.4-1.pgdg22.04+1) on x86_64-pc-linux-gnu, compiled by gcc (Ubuntu
 11.4.0-1ubuntu1~22.04) 11.4.0, 64-bit
 }}}

 It failed around 4 hours later, setting overcommit to 2 and reduce threads
 did not help.

 {{{

 NOTICE:  Start create with transfer_method_from_temp_2_final_topology 3
 for has_edges_temp_table_name tmp_dyrkbarjord_10_c3_037.edge_data_tmp_1224
 at 2024-10-16 09:40:19.671996+02 used_time: 0.448377
 NOTICE:  Done create with transfer_method_from_temp_2_final_topology 3 for
 has_edges_temp_table_name tmp_dyrkbarjord_10_c3_037.edge_data_tmp_1224 at
 2024-10-16 09:40:20.179359+02 used_time: 0.506995
 NOTICE:  Done adding lines 1213 (edges 18327)  of 1319, and done ANALYZE
 for tmp_dyrkbarjord_10_c3_037_1174 .
 NOTICE:  start to map face 3 for has_edges_temp_table_name
 tmp_dyrkbarjord_10_c3_037.edge_data_tmp_1224 at 2024-10-16
 09:40:20.807004+02 used_time: 0.506995
 TopMemoryContext: 282504 total in 8 blocks; 10184 free (21 chunks); 272320
 used
   TopTransactionContext: 8192 total in 1 blocks; 6696 free (1 chunks);
 1496 used
   Attopt cache: 16384 total in 2 blocks; 6672 free (3 chunks); 9712 used
   TableSpace cache: 8192 total in 1 blocks; 2128 free (0 chunks); 6064
 used
   Type information cache: 24368 total in 2 blocks; 2648 free (0 chunks);
 21720 used
   TOAST to main relid map: 262144 total in 6 blocks; 38864 free (23
 chunks); 223280 used
   Autovacuum worker: 131072 total in 5 blocks; 56328 free (17 chunks);
 74744 used
     Autovacuum Portal: 8192 total in 1 blocks; 7744 free (0 chunks); 448
 used
       Vacuum: 8192 total in 1 blocks; 7784 free (0 chunks); 408 used
   Operator class cache: 8192 total in 1 blocks; 592 free (0 chunks); 7600
 used
   smgr relation table: 32768 total in 3 blocks; 16880 free (8 chunks);
 15888 used
   PgStat Pending: 24576 total in 6 blocks; 4048 free (13 chunks); 20528
 used
   TransactionAbortContext: 32768 total in 1 blocks; 32504 free (0 chunks);
 264 used
   Portal hash: 8192 total in 1 blocks; 592 free (0 chunks); 7600 used
   TopPortalContext: 8192 total in 1 blocks; 7928 free (0 chunks); 264 used
   Relcache by OID: 16384 total in 2 blocks; 3584 free (2 chunks); 12800
 used
   CacheMemoryContext: 1048576 total in 8 blocks; 585048 free (94 chunks);
 463528 used
     index info: 2048 total in 2 blocks; 616 free (1 chunks); 1432 used:
 pg_attrdef_adrelid_adnum_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_namespace_oid_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_index_indrelid_index
     index info: 2048 total in 2 blocks; 544 free (1 chunks); 1504 used:
 pg_toast_2619_index
     index info: 3072 total in 2 blocks; 912 free (1 chunks); 2160 used:
 pg_statistic_relid_att_inh_index
     index info: 3072 total in 2 blocks; 1088 free (1 chunks); 1984 used:
 pg_amop_opr_fam_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_tablespace_oid_index
     index info: 1024 total in 1 blocks; 0 free (0 chunks); 1024 used:
 pg_statistic_ext_relid_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_operator_oid_index
     index info: 3072 total in 2 blocks; 808 free (1 chunks); 2264 used:
 pg_amop_fam_strat_index
     index info: 2048 total in 2 blocks; 544 free (1 chunks); 1504 used:
 pg_cast_source_target_index
     index info: 3072 total in 2 blocks; 1088 free (1 chunks); 1984 used:
 pg_opclass_am_name_nsp_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_type_oid_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_index_indexrelid_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_opclass_oid_index
     index info: 2048 total in 2 blocks; 544 free (2 chunks); 1504 used:
 pg_trigger_tgrelid_tgname_index
     index info: 2048 total in 2 blocks; 616 free (3 chunks); 1432 used:
 pg_rewrite_rel_rulename_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_class_oid_index
     index info: 2048 total in 2 blocks; 544 free (2 chunks); 1504 used:
 pg_attribute_relid_attnum_index
     index info: 3072 total in 2 blocks; 808 free (3 chunks); 2264 used:
 pg_amproc_fam_proc_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_authid_oid_index
     index info: 3072 total in 2 blocks; 1200 free (3 chunks); 1872 used:
 pg_auth_members_member_role_index
     index info: 3072 total in 2 blocks; 1232 free (3 chunks); 1840 used:
 pg_shseclabel_object_index
     index info: 1024 total in 1 blocks; 72 free (0 chunks); 952 used:
 pg_database_datname_index
     index info: 2048 total in 2 blocks; 912 free (0 chunks); 1136 used:
 pg_database_oid_index
     index info: 1024 total in 1 blocks; 72 free (0 chunks); 952 used:
 pg_authid_rolname_index
   PgStat Shared Ref Hash: 7216 total in 2 blocks; 688 free (0 chunks);
 6528 used
   PgStat Shared Ref: 16384 total in 5 blocks; 4296 free (5 chunks); 12088
 used
   WAL record construction: 50200 total in 2 blocks; 6376 free (0 chunks);
 43824 used
   PrivateRefCount: 8192 total in 1 blocks; 2648 free (0 chunks); 5544 used
   MdSmgr: 8192 total in 1 blocks; 7200 free (17 chunks); 992 used
   LOCALLOCK hash: 8192 total in 1 blocks; 592 free (0 chunks); 7600 used
   GUCMemoryContext: 24576 total in 2 blocks; 7952 free (9 chunks); 16624
 used
     GUC hash table: 32768 total in 3 blocks; 12704 free (5 chunks); 20064
 used
   Timezones: 104112 total in 2 blocks; 2648 free (0 chunks); 101464 used
   Postmaster: 16384 total in 2 blocks; 13712 free (15 chunks); 2672 used
     ident parser context: 1024 total in 1 blocks; 760 free (0 chunks); 264
 used
     hba parser context: 50176 total in 9 blocks; 7824 free (12 chunks);
 42352 used
   ErrorContext: 8192 total in 1 blocks; 7928 free (4 chunks); 264 used
 Grand total: 2321840 bytes in 131 blocks; 885360 free (272 chunks);
 1436480 used
 < , , , 2024-10-16 09:40:22.693 CEST >ERROR:  out of memory
 < , , , 2024-10-16 09:40:22.693 CEST >DETAIL:  Failed on request of size
 1073741822 in memory context "TopTransactionContext".
 < , , , 2024-10-16 09:40:22.693 CEST >CONTEXT:  automatic vacuum of table
 "rog_02.pg_toast.pg_toast_2619"
 }}}
-- 
Ticket URL: <https://trac.osgeo.org/postgis/ticket/5798#comment:2>
PostGIS <http://trac.osgeo.org/postgis/>
The PostGIS Trac is used for bug, enhancement & task tracking, a user and developer wiki, and a view into the subversion code repository of PostGIS project.