Devops 06-20 - 07-03 (Continuing LTS upgrades, etc.)

[landreev]

The main issue in the coming days will be working with LTS to finish the upgrades of the remaining app. nodes to RH8, before the RH7 EOL.
This is going to be easier/less disruptive than the Solr upgrade, since they will be doing one server at a time, with the load balancer sending all the traffic to the other node.

[landreev]

app-1 was upgraded this morning. It was for the most part uneventful, the Payara/Dataverse instance came back right up, with the node having spent less than an hour total taken out of the load balancing.
Some minor things did not survive the upgrade - a perl package that spamassassin depends on and some of the postgresql-13 rpms. I'll document the cleanup that needed to be performed.

[landreev]

app-2 has been upgraded as well.
all the small kinks detected during the first upgrade (v. 13 of psql that failed to reinstall, for ex.) have been resolved by now.