In reply to Grumpy Swede's message of 15 Apr 2026:

Well, that didn't last for long this time either. Every upload fails with "transient HTTP error". A couple of more stuck uploads here, and I will not be able to get any new tasks. No panic yet though, I still have 54 tasks in the cache. All are resends (_2-_6)

snap !

Still can't upload the 4 completed tasks from previous outrage last week on my 2 Android phones.

They are now past the "sell by date" with the transient http error message on uploading. The oldest task is almost 6 days expired.

The only good thing so far has been WCG credits finally made available to the stats sites.

How many days, weeks, months or maybe years is it going to be before Juriscia "fixes" everything?

My old tasks finally uploaded earlier today, received a few new tasks that have completed, they are not uploading, getting the "transient http error" almost immediately upon contacting the website.

I see Dylan posted the following about 2 hours ago:

I blocked traffic again while I fix the 404 issue, which I tried to fix while we were live and crashed postgres with too many connections - went through pgbouncer to extract the list of workunits I needed to regenerate results, but crashed us again trying to write the files all in one go and OOM-killing the node which is recovered, bouncing everything and checkign logs before restarting, and testing the workunit input regeneration a bit more as well before restarting. Should be back up tonight, was able to fix the upload issue.

In reply to Dr Who Fan's message of 16 Apr 2026:

I see Dylan posted the following about 2 hours ago

I'm thinking there should be a new project here to clone Dylan. I figger another 3 copies and they could keep "him" on-site 24x365.

Still dead!

The "back up tonight" mentioned in yesterdays update ("Should be back up tonight, was able to fix the upload issue."), obviously did not happen.
So, for now, I have 60 tasks ready to update and report, and not a single one left to crunch.

Edit: And now the entire WCG site went "forbidden"

Forbidden
You don't have permission to access this resource.

Edit 2: Cookie issue. Deleted all WCG cookies and logged in again solved the problem.

it's almost weekend again... we might be down until next month.

In reply to Robokapp's message of 17 Apr 2026:

it's almost weekend again... we might be down until next month.

Or next year, or even forever.

WCG website is up and down for me right now.

There is a "scheduled maintenance" message up.

I'm really hoping this is a sign of good progress. Keeping my fingers crossed.

For me it is:

System error
World Community Grid is currently experiencing an unexpected error. Please check Facebook or Twitter for more information.

The same message we had over 8 months ago.

In reply to Hadrian's message of 17 Apr 2026:

The same message we had over 8 months ago.

Recycling.

New update on Jurisica Lab page https://www.cs.toronto.edu/~juris/jlab/wcg.html:

April 17, 2026
More problems - this time issues with the data center.

More info now in that update.

April 17, 2026
More problems - this time issues with the data center.

Website/Forum Outage - possibly due to a service interruption in our cloud environment that hosting is working to fix and prevents us from accessing our running instances for maintenance, and may be responsible for other issues although this is currently unclear. Hosting provided an ETA of 1h at 19:00 UTC today April 17th, 2026, and we will keep volunteers posted as we get information and attempt to come back online.

BOINC Backend Outage Ongoing after brief success window on Wednesday, April 15th, 2026 - we enabled the BOINC stats dump after seeing the new architecture handle load and fixing the 503 upload issue. However, in attempting to fix the 404s on the download path by rebuilding the input files and writing them to the tmpfs cache from which downloads are served, we pushed several nodes into various failure states such as SUnreclaim slab memory exhaustion due to the overhead of writing each file to tmpfs en masse, and ill-advised queries run against postgres before EXPLAIN and without paging results to disk that backed up everything else waiting on postgres and caused soft lockup on the node. In addition to issues with the io_method = 'io_uring' setting in combination with our network-attached volumes for the postgres datadir, a setting we may have to change and evaluate before restarting. The naive "should be backup tonight" note in the forums by the WCG Tech was based on having recovered from one of these soft lockups many times in the past few weeks, and before understanding the reason for the initial crash or causing the later crashes on other nodes while attempting various methods of safely regenerating workunits that were throwing 404s on download after being assigned by the scheduler. We will bring the system online as soon as we are confident the results the scheduler will assign have download URLs with files at those paths, and the cluster is stable again.

Thanks for
the update.

The website is back. I have shut down my cruncher, so I do not know if BOINC is back. I doubt it is....

Website gone again. Sigh.....
I think it's time to forget about WCG for a couple of weeks/months, and do something else than babysitting BOINC on WCG. Even my patience have limits.

Scheduled Maintenance
World Community Grid is undergoing a scheduled infrastructure upgrade.

website is back.

In reply to Grumpy Swede's message of 17 Apr 2026:

Website gone again. Sigh.....
I think it's time to forget about WCG for a couple of weeks/months, and do something else than babysitting BOINC on WCG. Even my patience have limits.

Scheduled Maintenance
World Community Grid is undergoing a scheduled infrastructure upgrade.

I stopped crunching weeks ago and do other projects like Einstein, they are always there when I choose to crunch. I seriously wonder if WCG has been made too complicated to function without continuous intervention. Seems to have dropped off the Active Projects list.

In reply to Hadrian's message of 18 Apr 2026:

In reply to Grumpy Swede's message of 17 Apr 2026:

Website gone again. Sigh.....
I think it's time to forget about WCG for a couple of weeks/months, and do something else than babysitting BOINC on WCG. Even my patience have limits.

Scheduled Maintenance
World Community Grid is undergoing a scheduled infrastructure upgrade.

I stopped crunching weeks ago and do other projects like Einstein, they are always there when I choose to crunch. I seriously wonder if WCG has been made too complicated to function without continuous intervention. Seems to have dropped off the Active Projects list.

I am trying to send work back to WGC, but is it still down I see in my logs:

18/04/2026 10:36:26 | World Community Grid | Computation for task MCM1_0248614_6376_3 finished
18/04/2026 10:36:28 | World Community Grid | Started upload of MCM1_0248614_6376_3_r59533544_0
18/04/2026 10:36:29 | World Community Grid | Temporarily failed upload of MCM1_0248614_6376_3_r59533544_0: transient HTTP error
18/04/2026 10:36:29 | World Community Grid | Backing off 00:03:19 on upload of MCM1_0248614_6376_3_r59533544_0

Nothing new. They seem to go from one Cris to the next.

I've got like 10 tasks waiting to upload for 3-4 days.