It took months before the system came back, and every problem wasn't solved before this migration.

The one ray of hope is that having rebuilt it once, there is a chance that they have learned at least a little from what went wrong last time.

We got an update.

September 8, 2025

Over the weekend we were able to restore the DB2 databases for the website and forums.
It was a redirected restore that first required a fully containerized instance of DB2 running the same OS as we were in Graham cloud, and we ran into issues attempting the restore of the final backups. Both databases are now successfully restored, and we have moved on to containerizing Websphere and IBM MQ.
We were able to restore the BOINC database.
As part of our work on MAM1 we developed an integration testing environment and containerized the BOINC database.
We also did this for the BOINC server components (scheduler, upload and download servers with file_upload_handler, transitioner/validators/assimilators etc.).
Once we get IBM MQ and Websphere up, we will be able to bring the entire system online shortly afterwards.

In reply to unixchick's message of 8 Sep 2025:

We got an update.

September 8, 2025

Thank you for posting it here unixchick. Let's hope that the system will be online soon.

Hi!
We got a new update:

September 9, 2025
We are finalizing IBM MQ <-> DB2 <-> BOINC db <-> website axis, which will allow us to bring up the website. If all goes to plan now - we should have the website up tonight.
Once that is solved - we will go through the BOINC stack to ensure nothing catastrophic will happen when once we let traffic through to the scheduler, upload/download servers. Then we can finally start letting the BOINC daemons manipulate state in the BOINC db.

👌😉

In reply to Hans Sveen's message of 10 Sep 2025:

Hi!
We got a new update:

September 9, 2025

Thank you Hans for posting the new update. We'll see, which "night" they meant with "If all goes to plan now - we should have the website up tonight." 😃

Nothing yet. So I guess it means that all did not go as planned.

Situation normal - plans fail at the first contact with the enemy (reality)....

Is anyone running a book on the day/hour things come back up?

In reply to Dave's message of 11 Sep 2025:

Is anyone running a book on the day/hour things come back up?

I’ve already lost on that one

might be better to run one on which year/century/millennium

December 24, 2025. ☀️ 😃 🏂

In reply to Grumpy Swede's message of 11 Sep 2025:

December 24, 2025. ☀️ 😃 🏂

In the year 2525, if man is still alive, if woman can survive.

---

In reply to Warped's message of 11 Sep 2025:

In reply to Grumpy Swede's message of 11 Sep 2025:

December 24, 2025. ☀️ 😃 🏂

In the year 2525, if man is still alive, if woman can survive.

Full Lyrics:

In the year 2525, if man is still alive
If woman can survive, they may find
In the year 3535
Ain't gonna need to tell the truth, tell no lie
Everything you think, do and say
Is in the pill you took today
In the year 4545
You ain't gonna need your teeth, won't need your eyes
You won't find a thing to chew
Nobody's gonna look at you
In the year 5555
Your arms hangin' limp at your sides
Your legs got nothin' to do
Some machine's doin' that for you
In the year 6565
You won't need no husband, won't need no wife
You'll pick your son, pick your daughter too
From the bottom of a long glass tube
In the year 7510
If God's a coming, He oughta make it by then
Maybe He'll look around Himself and say
Guess it's time for the judgment day
In the year 8510
God is gonna shake His mighty head
He'll either say I'm pleased where man has been
Or tear it down, and start again
In the year 9595
I'm kinda wonderin' if man is gonna be alive
He's taken everything this old earth can give
And he ain't put back nothing
Now it's been ten thousand years
Man has cried a billion tears
For what, he never knew, now man's reign is through
But through eternal night, the twinkling of starlight
So very far away, maybe it's only yesterday
In the year 2525, if man is still alive
If woman can survive, they may find

---

Worth taking in to consideration, is that the WCG web certificate will expire 2025-09-18 01:59:59 CEST
So, they better renew it now.

I just sent a message to Igor Jurisica about that.

Let's not make this a regular thing, but try to keep on topic in this thread. If you truly want to throw more lyrics around, please make a thread about it in the Lounge.

It's 9:29 AM Friday morning Toronto Canada time, no updates.since September 9.

Website still has the banner "503: Service Temporarily Unavailable during Migration to Nibi Cloud".

All we can do is wait and see if they have it working by this evening, otherwise it's some time next week.

I'm going off line for a few days. Hopefully when I get back I'll see you all on the WCG forum. I'm sending good thoughts to the techs that the machines and code behave.

September 12, 2025

Configuration of Websphere and IBM MQ is taking longer than expected. We are moving all provisioning, build, and deploy stages for all repos from Ansible and Gitlab CI to Dockerfiles and docker compose files, which is a step that precedes running these containers as StatefulSets on Kubernetes. So far, we have functional containers for IBM MQ, Websphere, DB2, MariaDB, and all BOINC endpoints up and running, and what we are still struggling through is configuration.
This approach will benefit site reliability and scalability in an obvious way on Kubernetes, and will improve our development and QA lifecycles drastically. It was also necessary to preserve a maximum compatibility with the CentOS 7 virtual machines that the legacy stack was previously running on, a requirement for the redirected restore of the DB2 data for example, https://www.ibm.com/docs/en/db2/11.5.x?topic=restore-performing-redirected-operation.
So why are we not up, and when will we be up? We are debugging the entrypoint scripts for Websphere and IBM MQ containers. Website cannot be brought up until Websphere is up and configured correctly, receiving messages from all MQ sidecars across the stack, sending emails, etc. Each of the databases, the webserver, and the scheduler have to run MQ, and we are still adapting some of the previous mqsc and other runtime configuration for the MQ service to work with this new setup where each important container that requires one gets an MQ sidecar container that uses the Ubuntu 24.04 host VM network.

---

Paul.

The IBM system stack appears to be a big pain in the butt to manage and get the underlying software to talking to each other.

Sending lot of good luck to the technicians working on getting it working again.

In reply to Dr Who Fan's message of 12 Sep 2025:

The IBM system stack appears to be a big pain in the butt to manage and get the underlying software to talking to each other.

Sending lot of good luck to the technicians working on getting it working again.

I can confirm that from my own personal experience.