[SCM] PostGIS Buildbots; Jenkins jobs and instructions for setting up winnie and debbie bots. branch master updated. 68d9b2d99391fc22c1edcbca926cc380ec5f85b3
git at osgeo.org
git at osgeo.org
Thu Nov 7 08:56:58 PST 2024
This is an automated email from the git hooks/post-receive script. It was
generated because a ref change was pushed to the repository containing
the project "PostGIS Buildbots; Jenkins jobs and instructions for setting up winnie and debbie bots.".
The branch, master has been updated
via 68d9b2d99391fc22c1edcbca926cc380ec5f85b3 (commit)
via ff5558d538cb982f28ba20aa62bb96ffa14dce59 (commit)
from 4dcaa66928b0178a095551ca8df2e47a0b3cbd26 (commit)
Those revisions listed above that are new to this repository have
not appeared on any other notification email; so we list those
revisions in full, below.
- Log -----------------------------------------------------------------
commit 68d9b2d99391fc22c1edcbca926cc380ec5f85b3
Author: Regina Obe <lr at pcorp.us>
Date: Thu Nov 7 11:56:54 2024 -0500
Remove old bessie setup, now obsolete
diff --git a/freebsd/bessie_setup.txt b/freebsd/bessie_setup.txt
deleted file mode 100644
index 14901af..0000000
--- a/freebsd/bessie_setup.txt
+++ /dev/null
@@ -1,259 +0,0 @@
-Bessie currently setup on winnie's virtual box - ssh port ssh your_user_name at winnie.postgis.net -p 51022
-Built from https://download.freebsd.org/ftp/releases/VM-IMAGES/12.0-RELEASE/amd64/Latest/FreeBSD-12.0-RELEASE-amd64.vmdk.xz dated (Dec 2018)
-
-vi /etc/rc.conf
-
-add to file
-
-hostname="bessie"
-sshd_enable="YES"
-
-#then edit the sshd_config
-vi /etc/ssh/sshd_config
-
-Add line
-AllowGroups wheel
-and add to AllowUsers list
-
-vi /etc/ssh/sshd_config #:g/AllowUsers/, :g/PermitRootLogin #change to yes so can configure - can change later to no
-
-#Make sure jenkins is in AllowUsers list of /sshd_config
-cat /etc/ssh/sshd_config | grep AllowUsers #if jenkins not listed add
-
-
-
-Then run:
-service sshd restart
-
-#if get host keys not found run
-ssh-keygen -A
-
-To create and add a user robe (repeat for jenkins, pramsey, strk, komzpa, cvvergara, Algunenano) and install relevant ssh keys in homedirs
-
-adduser robe
-adduser Algunenano
-#when prompted make sure to add to wheel group
-
-#for adds after user created
-pw group mod wheel -m robe
-
-#Now robe can do
-
-su root
-
-(to do admin stuff)
-#upgrade to latest patches
-freebsd-update fetch
-
-#installing ports
-portsnap fetch
-portsnap extract
-
-#in future to update ports
-portsnap fetch
-portsnap update
-
-pkg install sudo
-
-#choose LDAP protocol support in addition to default selected
-
-Then run:
-
-visudo
-
-and uncomment line wheel nopasswd allowing wheel to use sudo without password.
-
-pkg install jed bash tcpdump wget git proj geos
-#had these installed, didn't work but worked with openjdk8
-pkg install openjdk11
-
-mount -t fdescfs fdesc /dev/fd
-mount -t procfs proc /proc
-
-
-#add following lines to /etc/fstab
-fdesc /dev/fd fdescfs rw 0 0
-proc /proc procfs rw 0 0
-
-pkg install gmake gdb subversion autoconf libtool curl automake expect
-pkg install libxslt libxml2 bison
-pkg install imagemagick #if not found try imagemagick7 (was required for FreeBSD 12)
-pkg install gdal geos proj
-pkg install sfcgal json-c
-pkg install cunit iconv
-pkg install protobuf protobuf-c #needed for building mvt
-
-#was going to install postgresql in jail but got lost quickly
-#did these steps to enable jails in future
-sysctl security.jail.sysvipc_allowed=1
-
-#Make it persistent by adding this line to /etc/sysctl.conf
-
-security.jail.sysvipc_allowed=1
-
-#Add this line to /etc/rc.conf
-
-jail_sysvipc_allow="YES"
-
-#Enter your jail and install Postgres.
-
-# had to use 16 because gdal has 16 client and installing 17 removes gdal
-pkg install postgresql16-server postgresql16-contrib gdal
-service postgresql initdb #create data cluster
-
-edit the /etc/rc.conf
-
-and add a line
-postgresql_enable="YES"
-
-pkg update #update available list
-pkg upgrade #upgrades all packages
-
-pkg info proj #get details of proj
-pkg install cmake #install needed for building pgrouting and sfcgal in future
-
-#for code coverage testing
-pkg install lcov
-
-#for pgtap tests needed for pgrouting
-git clone https://github.com/theory/pgtap.git
-cd pgtap
-gmake
-sudo gmake install
-sudo gmake installcheck PGUSER=postgres
-sudo cpan TAP::Parser::SourceHandler::pgTAP
-
-
-#installing from ports
-#installed latest proj from ports by doing https://www.freebsd.org/doc/handbook/ports-using.html
-portsnap fetch #only needs to be done once
-portsnap extract #only needs to be done once
-portsnap fetch update #to keep up to date
-cd /usr/ports/graphics/proj
-make install
-#note you might be asked remove gdal and libgeotiff go ahead
-cd /usr/ports/graphics/gdal
-make install
-
-
-#upgrade to 12.2
-#check version running
-sudo -i
-freebsd-version -k #kernel version # read 12.0-RELEASE
-freebsd-version -u #client apps userland read 12.0-RELEASE
-freebsd-update upgrade -r 12.2-RELEASE
-#after all downloaded
- /usr/sbin/freebsd-update install
- reboot
- #run again after logging back in
-/usr/sbin/freebsd-update install
-freebsd-version -k #now reads 12.2-RELEASE-p1
-freebsd-version -u #now reads 12.2-RELEASE-p1
-pkg update
-rm -rf /home/jenkin/tmp/* #had 11G of junk
-pkg upgrade #upgraded pkg: 1.13.2 -> 1.15.10
-
-#for pgtap tests needed for pgrouting
-pkg search postgresql #shows all postgresql
-pkg install postgresql11-contrib #needed to get citext
-#note said this may be needed for compiling -Wl,-rpath=/usr/local/lib/gcc9
-
-cd /root
-git clone https://github.com/theory/pgtap.git
-cd pgtap
-git pull
-gmake
-
-sudo gmake install
-sudo gmake installcheck PGUSER=postgres
-sudo cpan TAP::Parser::SourceHandler::pgTAP
-
-#fix date time https://www.cyberciti.biz/faq/howto-set-date-and-time-timezone-in-freebsd/
-date yymmddhhmmss
-e.g date 2106121811
-
-#set time without changing date
-date hhmmss
-e.g. - date 1810
-
-cp /usr/share/zoneinfo/US/Eastern /etc/localtime
-
-#see list of packages
-pkg info | grep postgresql
-#lists all installed
-pkg info –all
-
-pkg remove postgresql12-server postgresql12-contrib postgresql12-client gdal
-pkg install postgresql12-server postgresql12-contrib postgresql12-client gdal
-/usr/local/etc/rc.d/postgresql initdb
-
-#Make suretime service is running and starts on bootup otherwise looses time
-# https://forums.freebsd.org/threads/the-system-clock-is-falling-behind.61450/
-service ntpd enable
-service ntpd start
-
-sysrc ntpdate_enable="YES"
-```
-# remove no longer used packages
-```
-pkg remove subversion
-pkg autoremove
-pkg clean -a -n #will just show how much will be cleared by clearing downloads
-pkg clean -a -y #will actually purge
-```
-
-#Patching to p14
-```
-#check version running
-sudo -i
-freebsd-version -k #kernel version # read 12.2-RELEASE-p1
-freebsd-version -u #client apps userland read 12.2-RELEASE-p1
-rm -rf /var/db/freebsd-update/*
-freebsd-update fetch
-freebsd-update install
-reboot
-
-freebsd-version -k #kernel version # read 12.2-RELEASE-p14
-freebsd-version -u #client apps userland read 12.2-RELEASE-p14
-```
-
-# upgrade to 12.3
-```
-#check version running
-sudo -i
-freebsd-version -k #kernel version # read 12.2-RELEASE-p14
-freebsd-version -u #client apps userland read 12.2-RELEASE-p15
-freebsd-update upgrade -r 12.3-RELEASE
-#after all downloaded
-/usr/sbin/freebsd-update install
-reboot
-/usr/sbin/freebsd-update install
-
-freebsd-version -k #kernel version # read 12.3-RELEASE-p5
-freebsd-version -u #client apps userland read 12.3-RELEASE-p5
-reboot
-
-pkg update
-pkg upgrade
-
-# purge upgrade files
-cd /var/db/freebsd-update/files
-rm -rf [0-1]*
-rm -rf [1-3]*
-rm -rf [3-5]*
-rm -rf [5-7]*
-rm -rf [0-9]*
-rm -rf [a-b]*
-rm -rf [a-d]*
-rm -rf [a-h]*
-```
-
-# build gdal from ports
-```
-portsnap fetch extract #first time
-# there after
-portsnap fetch update
-export ALLOW_UNSUPPORTED_SYSTEM=yes
-cd /usr/ports/graphics/gdal/ && make install clean
-make config # to change options
-```
\ No newline at end of file
commit ff5558d538cb982f28ba20aa62bb96ffa14dce59
Author: Regina Obe <lr at pcorp.us>
Date: Thu Nov 7 11:56:21 2024 -0500
New bessie setup on osgeo8
diff --git a/debian/reallie.txt b/debian/reallie.txt
index 8d34c61..3f2b366 100644
--- a/debian/reallie.txt
+++ b/debian/reallie.txt
@@ -24,3 +24,5 @@ apt install pkg-config
#for code coverage testing
apt install lcov
apt install liblz4-dev
+
+
diff --git a/freebsd/bessie_setup.txt b/freebsd/bessie_setup.txt
index 371bc80..14901af 100644
--- a/freebsd/bessie_setup.txt
+++ b/freebsd/bessie_setup.txt
@@ -5,7 +5,7 @@ vi /etc/rc.conf
add to file
-hostname="bessie12"
+hostname="bessie"
sshd_enable="YES"
#then edit the sshd_config
@@ -97,8 +97,8 @@ jail_sysvipc_allow="YES"
#Enter your jail and install Postgres.
-
-pkg install postgresql11-server postgresql11-contrib
+# had to use 16 because gdal has 16 client and installing 17 removes gdal
+pkg install postgresql16-server postgresql16-contrib gdal
service postgresql initdb #create data cluster
edit the /etc/rc.conf
diff --git a/freebsd/osgeo8-bessie_setup.md b/freebsd/osgeo8-bessie_setup.md
new file mode 100644
index 0000000..3017a53
--- /dev/null
+++ b/freebsd/osgeo8-bessie_setup.md
@@ -0,0 +1,165 @@
+Bessie currently setup on winnie's virtual box - ssh port ssh your_user_name at winnie.postgis.net -p 51022
+Built from wget https://download.freebsd.org/ftp/releases/VM-IMAGES/14.1-RELEASE/amd64/Latest/FreeBSD-14.1-RELEASE-amd64-zfs.qcow2.xz dated (Oct 2024)
+
+vi /etc/rc.conf
+
+add to file
+
+hostname="bessie"
+sshd_enable="YES"
+
+#then edit the sshd_config
+vi /etc/ssh/sshd_config
+
+Add line
+AllowGroups wheel
+and add to AllowUsers list
+
+vi /etc/ssh/sshd_config #:g/AllowUsers/, :g/PermitRootLogin #change to yes so can configure - can change later to no
+
+#Make sure jenkins is in AllowUsers list of /sshd_config
+cat /etc/ssh/sshd_config | grep AllowUsers #if jenkins not listed add
+
+
+
+Then run:
+service sshd restart
+
+#if get host keys not found run
+ssh-keygen -A
+
+To create and add a user robe (repeat for jenkins, pramsey, strk, komzpa, cvvergara, Algunenano) and install relevant ssh keys in homedirs
+
+adduser robe
+su robe
+mkdir ~/.ssh
+echo ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAmf79bn/i3jeP9IuFZ0BXGTJundqVLW5gRUfnG2cPvmDtGRnvKZ/cEoxDbuvh9vyQhV/wn3Y1ACgBc+lwhJUXmjZDq2ft4iL0GfOpjyEwT+QohSyShy9lijCJ2iNdxG1ixZokXReYkyldSgjSpMzTbtaAZCx0rMk9zY/3lQM+IR3OTTv8HUmzECFwgA6fcjKnzq98Ng2fdf/1tcvz73YfVZlo92Q0pSsGFhU4ytsI7CqVF9i5JdFlUToOB+KXQpsizQ3XeDgp+kxcOGHiXHbZb3h5w7yy7J7+cwrWOrZxCEMfHITy7NQcRj3bbK2B+pPVG87/oHTzAGgDbcZYq6uzLQ== robe2048 >> ~/.ssh/authorized_keys
+
+
+adduser jenkins
+su jenkins
+mkdir ~/.ssh
+echo ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAmf79bn/i3jeP9IuFZ0BXGTJundqVLW5gRUfnG2cPvmDtGRnvKZ/cEoxDbuvh9vyQhV/wn3Y1ACgBc+lwhJUXmjZDq2ft4iL0GfOpjyEwT+QohSyShy9lijCJ2iNdxG1ixZokXReYkyldSgjSpMzTbtaAZCx0rMk9zY/3lQM+IR3OTTv8HUmzECFwgA6fcjKnzq98Ng2fdf/1tcvz73YfVZlo92Q0pSsGFhU4ytsI7CqVF9i5JdFlUToOB+KXQpsizQ3XeDgp+kxcOGHiXHbZb3h5w7yy7J7+cwrWOrZxCEMfHITy7NQcRj3bbK2B+pPVG87/oHTzAGgDbcZYq6uzLQ== robe2048 >> ~/.ssh/authorized_keys
+
+echo ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMWfil4H34fePXGfx0uR6Gd9TnHTgKKYPJLmaMsTicmx vicky at pgvicky >> ~/.ssh/authorized_keys
+
+
+#when prompted make sure to add to wheel group
+
+#for adds after user created
+pw group mod wheel -m robe
+
+#Now robe can do
+
+su root
+
+(to do admin stuff)
+#upgrade to latest patches
+freebsd-update fetch
+
+#installing ports
+portsnap fetch
+portsnap extract
+
+#in future to update ports
+portsnap fetch
+portsnap update
+
+pkg install sudo
+
+Then run:
+
+visudo
+
+and uncomment line wheel nopasswd allowing wheel to use sudo without password.
+
+pkg install jed bash tcpdump wget git proj geos
+#had these installed, didn't work but worked with openjdk8
+pkg install openjdk17
+
+mount -t fdescfs fdesc /dev/fd
+mount -t procfs proc /proc
+
+
+#add following lines to /etc/fstab
+fdesc /dev/fd fdescfs rw 0 0
+proc /proc procfs rw 0 0
+
+pkg install gmake gdb autoconf libtool curl automake expect
+pkg install libxslt libxml2 bison
+pkg install imagemagick7
+pkg install gdal geos proj pkgconf
+projsync --system-directory --source-id us_noaa
+projsync --system-directory --source-id ch_swisstopo
+pkg install sfcgal json-c
+pkg install cunit iconv
+pkg install protobuf protobuf-c #needed for building mvt
+ldconfig
+
+#was going to install postgresql in jail but got lost quickly
+#did these steps to enable jails in future
+sysctl security.jail.sysvipc_allowed=1
+
+#Make it persistent by adding this line to /etc/sysctl.conf
+
+security.jail.sysvipc_allowed=1
+
+#Add this line to /etc/rc.conf
+
+jail_sysvipc_allow="YES"
+
+#Enter your jail and install Postgres.
+
+
+pkg install postgresql16-server postgresql16-contrib gdal
+service postgresql initdb #create data cluster
+
+edit the /etc/rc.conf
+
+and add a line
+postgresql_enable="YES"
+
+pkg update #update available list
+pkg upgrade #upgrades all packages
+
+pkg info proj #get details of proj
+pkg install cmake #install needed for building pgrouting and sfcgal in future
+
+#for code coverage testing
+pkg install lcov
+
+#for pgtap tests needed for pgrouting
+git clone https://github.com/theory/pgtap.git
+cd pgtap
+gmake
+sudo gmake install
+sudo cpan TAP::Parser::SourceHandler::pgTAP
+sudo gmake installcheck PGUSER=postgres
+
+
+
+# purge upgrade files
+cd /var/db/freebsd-update/files
+rm -rf [0-1]*
+rm -rf [1-3]*
+rm -rf [3-5]*
+rm -rf [5-7]*
+rm -rf [0-9]*
+rm -rf [a-b]*
+rm -rf [a-d]*
+rm -rf [a-h]*
+```
+
+# install agent jar
+```
+su jenkins
+mkdir bin
+cd bin
+#can't use ssh for launching agent because we need bastion
+# and when using the launch command, doesnt' automatically deploy agent
+curl -sO https://debbie.postgis.net/jnlpJars/agent.jar
+
+#then on jenkins config use Launch agent via execution of comman on the controller
+
+launch command:ssh jenkins at osgeo8-bessie " java -jar /home/jenkins/bin/agent.jar"
+```
\ No newline at end of file
diff --git a/raspberry_pi/berrie.txt b/raspberry_pi/berrie.txt
index fb50578..73783f6 100644
--- a/raspberry_pi/berrie.txt
+++ b/raspberry_pi/berrie.txt
@@ -15,4 +15,8 @@ apt install git
apt install libgeos-dev libproj-dev
apt install libgdal-dev
apt install pkg-config
-apt install lz4 liblz4-dev #needed to build postgresql with lz4 support
\ No newline at end of file
+apt install lz4 liblz4-dev #needed to build postgresql with lz4 support
+
+#upgrade jdk
+apt install openjdk-17-jdk
+update-alternatives --config java #switch from 11 to 17
\ No newline at end of file
diff --git a/raspberry_pi/berrie64.txt b/raspberry_pi/berrie64.txt
index 3b34aee..feee286 100644
--- a/raspberry_pi/berrie64.txt
+++ b/raspberry_pi/berrie64.txt
@@ -23,3 +23,8 @@ apt install libgdal-dev
apt install pkg-config
#for code coverage testing
sudo apt install lcov
+
+
+#upgrade jdk
+apt install openjdk-17-jdk
+update-alternatives --config java #switch from 11 to 17
-----------------------------------------------------------------------
Summary of changes:
debian/reallie.txt | 2 +
freebsd/bessie_setup.txt | 259 -----------------------------------------
freebsd/osgeo8-bessie_setup.md | 165 ++++++++++++++++++++++++++
raspberry_pi/berrie.txt | 6 +-
raspberry_pi/berrie64.txt | 5 +
5 files changed, 177 insertions(+), 260 deletions(-)
delete mode 100644 freebsd/bessie_setup.txt
create mode 100644 freebsd/osgeo8-bessie_setup.md
hooks/post-receive
--
PostGIS Buildbots; Jenkins jobs and instructions for setting up winnie and debbie bots.
More information about the postgis-tickets
mailing list