🍱 Sean Todd ☕ @GigaByte4711@whitespashe.uk

Well, we're accessible over IPv6. We can't actually talk to other IPv6 instances because of docker-compose nonsense.

Looks like I'm gonna have to start preparing for a migration from docker to a proper VM.

😭 I was sooooo close.....

#mastodon #ipv6 #fediverse #mastoadmin #docker #sysadmin

Well everyone, I think Whitespashe is now available over IPv6! Does anyone know of any IPv6 only Fedi Instances I can try out?

#mastoadmin #fediverse #ipv6 #sysadmin

Is there a method of culling servers that have broken SSL/Excessive timeouts from my instance?

I know `tootctl accounts cull` does something similar, but surely there's a way for mastodon to go: "That instance is dead. I'm cutting all ties with it."

#mastoadmin #mastodon #sysadmin

Today I implemented a master/master MySQL setup, and integrated it into my HAProxy install.

And nothing is on fire!

Yesterday I successfully deployed backup mail servers in my homelab AND in the cloud.

This is the year of high-availability (or at the very least: basic redundancy) folks!

#haproxy #mysql #email #sysadmin #homelab

Ugh! Spent 2 days troubleshooting media issues with proxying my s3 media storage for mastodon.

I'm pretty sure I've reverted back to my original config (the one I thought I had issues with), and now it's all okay again!

This weekend has been sent to try me!!!

#mastodon #mastoadmin #s3 #sysadmin #homelab

Making the most of the Pre-Christmas lull to cull my incident queue at work.

I'm currently fueled by coffee and an intense urge to finish my Day-Job work, so that I can get back to my homelab work!

#infosec #homelab #sysadmin #coffee

And now Whitespashe is running on Mastodon 3.2.0!

We're now as up-to-date and efficient as we can reasonably be! Time for a well-earned coffee!

#sysadmin #mastodon #mastoadmin #homelab

After watching the slow loading of assets via backblaze, I've now implemented an nginx cache and haproxy wizardry to try and speed stuff up somewhat!

@angristan contributed to my success via his blog post: https://stanislas.blog/2018/05/moving-mastodon-media-files-to-wasabi-object-storage/

After following that, I then stole a load of code from the mastodon docs and https://blog.sentry.io/2017/03/01/dodging-s3-downtime-with-nginx-and-haproxy

Now I've got a fairly resilient media hosting stack!

My hard drives will surely thank me! Backups too!

#sysadmin #mastodon #hosting #backblaze #haproxy

I've updated Whitespashe to use backblaze for its media storage! Hopefully I'll have a much less sad hard drive now!

#mastodon #sysadmin #backblaze

Ugh. Had so many issues with networking yesterday. I lost internet for a fair part of the day, my VM hosts would not stay clustered or in sync, either!

I had to completely redesign the network connectivity at home and finally for sorted at about 1am today!

Things seem stable now, but yesterday was sent to try me. 😓

#sysadmin #homelab

Whitespashe is going offline for the 3.1.4 update!

#sysadmin #fediverse #mastodon

Whitespashe is going offline whilst I bring us up to the most recent version. It's gonna get wild.

#mastoadmin #sysadmin #fediverse

Whitespashe.uk is now running on Mastodon Master branch, as the v3.1.2 release can't be built due to a dependency being yanked.

We're bleeding edge guys!

#mastoadmin #sysadmin

Playing around with ansible when I should be sleeping....

My next big project: every service I host must be deployable in ansible.

#sysadmin #ansible

New storage server is racked, the rack is pretty much built, awaiting tomorrow to migrate my existing server stuff across!

The rack has claimed blood from both myself and my wife, so it has been correctly sanctified.

#sysadmin #homelab

Whitespashe is getting an upgrade! One server rack being installed in my house....

#homelab #sysadmin

Ugh, dealing with my old dovecot mail server....

I can get the maildirs and userdirs separated nicely, I can get the mysql lookups to work perfectly...

Can I fix a permissions error when I enable autoexpunge on the junk folder? Hell no I can't!

😡

#mail #sysadmin #dovecot

Ugh. I've had to disable full-text searching, as my VM is unable to handle the high memory requirements. Looks like a hardware upgrade is in order soon. 😥

#mastoadmin #sysadmin

Some memory issues on whitespashe.uk

Rebuilding my elasticsearch db, as it hasn't been running for a couple of months.

#mastoadmin #sysadmin

Whitespashe is going down for a little while whilst I add SSD caching to my ESX host. Fingers crossed!!

#sysadmin #mastodon #mastodev