The pictured Orange Pi Zero Plus with NAS expansion board and 500Gb mSATA disk (not pictured) served us very, very well the last 3-4 months.

During testing of our updated Docker Hub mirroring process we overshot what the hardware could handle. During some fine tuning we managed to corrupt the filesystem on the mSATA disk which contained our entire set of backups and cached Docker Images.

Thankfully we sync our backups off site daily and the Docker Hub images are still online.

We are in the process of rebuilding our Docker Hub cache, restoring our backups from our off site mirror and finalizing new hardware.

We are *NOT* down, all of our public services are unaffected and this was an *expected* situation. We have planned for total failure of our Lollipops that host our project infrastructure and have recovery plans. We are in the recovery phase and know exactly what caused thebl failure.

The original NAS (pictured) we deployed was a testing board that we knew couldn't keep up over time. We deployed it as a test to ensure our officially recommended hardware would be reliable for our users. It couldn't keep up and we were planning on replacing it next week.

The O-Droid HC2 that we recommend is doing a great job keeping up and we will be putting it through a good series of stress tests over the coming week.

In the mean time our public services remain online and we look forward to seeing you around.

:)