Search results

ipv6 offline; the upstream-provider did have some severe problems with their BGP... I'm talking with chompy about possible alternatives.

so... i fucked up a config & needed to wait till i got to my notebook again. sorry for the offline-time. Backup-Issue is not yet solved :(

Still not solved <.< Disabled the backup until I’m home from Holliday Also got an error on the filesystem… again … I hate when that happens

Backup fucked up. Only 300kb/s is way too slow. So the typical 1min hiccup was 1h - I stopped it. I must look into this - new - error <.< Sorry for the inconvenience

Not again! We need to find a new provider if this keeps going on :(

Server 2 seems to be stable for the last 24 hours. I will monitor it and return the 1st eu-node back to production… Not sure how to handle this a better way. Some times the network of the provider does very strange things. :/

Im going to puke on these servers … The 2nd one worked flawelessly. I removed the one, who has errors - now the 2nd starts throwing errors … Going to look into this

Hi. Im going to check this out. At the moment we do have an issue with one of the European frontend systems. It’s the same that got the same issues the last time. Perhaps we have to ditch it.

Sorry for the unplanned maintenance; I urgently had to patch the firewall (and in this case also change the SSD...) Systems are back online, going to check. The last script i hacked it working - but nevertheless it produced about 1k Error-Messages per day. If there is a new plugin, i'm going...

Sorry for the upload issues. the backup went wrong and pushed all VMs into the grave with IO-errors :/ seems like a proxmox issue with failing backups. Let's see if we need to change this in the future.

yes. We still have issues with the EU frontends :( they drop the Connection every few minutes to hours... I've removed the most unstable-one from the DNS Status: Moved to new Hardware; Upgrade of Software in Progress 1/?: moved all Data to the new Server [done] 2/?: Database-Backup [done]...

more or less back to the old design (the dark theme is back, too. You need to change to it - on the page scroll down to the bottom and click on "UI.X Akiba") There are still lots of problems. Missing Plugins: force-words; Thread-Thumbnails some plugin is also causing errors when the system...

as you notice ... we are back on the default xenforo-theme. i'm sorry, that this didn't work out like i wanted. Status: Moved to new Hardware; Upgrade of Software in Progress 1/?: moved all Data to the new Server [done] 2/?: Database-Backup [done] 3/?: Database-VM-Backup [done] 4/?: Upgrade...

I think there was a problem with the backup of the database-server. I didn't really thought about chaning my backup-strategy; so every sunday it will do a full backup including a freeze of the system. Timing should match. I'm changing this (as for your info; cluster node 3 is normally used for...

the new database-cluster is working now. Commencing data-transfer.

Well... I need to buy another server; the 3rd database-node is f***ing slow :( until then (probably a few hours) the system is back online on 2/3 of a cluster. As already mentioned above: expect a little bit slower system than what you are expected due to latency. edit somehow we hit a MySQL...

Oh; I can recycle this thread - nice! After a few years on the current infrastructure - we need to move again. The increased pricing and resources we need (more than 1TB of storage, 100GB Database, ~20TB traffic) are forcing us to move providers. I will try to have as little downtime as...

fucked up the certificate replacement :( all working now. sorry!

EU systems are back without any package loss... It's not so easy to find hoster, that will accept everything that is here, AND are stable.

we do have a massive package drop between the EU frontend and our backend. not sure why (at least for now); access from other sources to the VPS seem fine; hopefully it won't be blackholed due to suspicisous traffic. until then - rerouted everything to our asia servers. Perhaps we need more...

well.. one of our frontend-systems has hit 100% hdd usage. So hopefully this was the only problem. I freed some space and adjusted the size of the cache on the EU-Nodes. 10GB Storage for the whole system including caches is probably a bit too tiny :/ Hopefully this helps; if not i need to...

and database-communication errors :/ not sure where they came from... hopefully a restart was enough. seems to be back online

rebuilding search-index. sorry, totally broke down due to an error in the datacenter. edit also fixed mails ... i hate that the VPN changes ip -.- edit2 favicon is back Configuration broken ... edit4 Search-index is back online - search should now work as expected - sorry, that it took me...

i'm going to rebuild the caches. hopefully this will help :/ at least i still got the favicon :/

Asia Servers are down ... moved all to the remaining ones :( i need to automate this -.- Asia servers are under DDOS. Sometimes outages are expected :/

Transfer complete. Attachment upload is reenabled and should work again normally. i only added about 250GB at the moment. Let's see how long this will last. At least i now know what i did wrong and why we had to do a desaster recovery :/ Attached the transfer-speeds (take into account...

of course i had to fuck up the hdd-resize... desaster recovery is running. Unfortionately it's slow - really slow; about 1.5MB/s so expect broken attachments, until the sync is done. in the meantime i'm going to look out for a new backup -.- Also... mail is working again... edit also...

Disk has hit 100% (so we are now officially hitting 1TB of Data O.o) I'm in touch with the DC to add more space. I will report back.

The load balancer to our backend has some severe problems... I probably need to boot them into rescue mode or even reinstall the two nodes. if that happens expect downtimes :( I will start this procedure probably Wednesday next week

and hoster fucked up again. main database-server did crash... rest of the cluster is configured read-only

well.... provider did have some hughe hickups. Not exactly sure what has happened :/ but it crashed the database - twice. But replication is still up and running. It's a little bit fishy :/ perhaps the internal network crashed temporarily and something broke let's hope for the best?

Mail-Server is back online it took a while because of personal issues. There may still be some problems. For E.g. mail.ru is blocking the IP (I already asked for a removal) but Microsoft accepted - google seems to be fine, too. at the moment the mail-queues are being emptied out. Hopefully...

*sight* and now the mailserver has some strange behaviour... i can't even access the system anymore. hopefully they didn't do something with it... So... no mail notification at the moment -.- chompy is informed to take a look a the hoster edit Mail-Server is gone for good. I need to reinstall...

sorry for the unplanned outage. hopefully database is now back to 100% operation

at least 1 part is back up. the 3rd node is somehow totally crashed and it seems like a reinstall didn't help... toDos: check backup, rebuild the 3rd note edit done

Nice one. first we have a problem with the mail-servers. now our database-cluster crashed :/ main-system is back online - but we are missing replication & backup at the moment. Expect another downtime to rebuild the cluster :/

contact form is running again - i think.

mail-server is up and running again. errors are still expected - also check your spam folders

Hi, if you are waiting for a mail ... our mail-server is a little bit ill - we are working on it. ETA? absolutely no idea :/

Asia servers are down :( moved everything to eu

there could be the possibility that the database switched to read-only mode i'm not sure why -.-# sorry about that. everything is back online

routes are back! Asia Servers are back to the DNS system. Let's hope it won't break again in the next few days, because i won't be able to access the internet with more than edge-speeds.

some severe errors with our asia servers. one asia server is able to reach part of the load-balancer, but not the other one the 2nd asia server doesn't reach any of the two systems Routed everything through europe :/ I hope this is just some "minor" BGP has fucked up thing :/

unfortunately the media gallery did get broken when we upgraded from xenforo 1.x to 2.x i tried to bring it back - but it was a huge mess (new database structure, new storage path, new storage format of the files. After a "good guess" and multiple tests, I somehow ignored it (it was about 3GB...

asia frontend is down :/ see: https://status.akiba-online.com/status If this won't be fixed in an hour or so, i will reroute all the asia traffic through emea (I should really automate this already) edit changed to emea only -> traffic went up again ^^'' I will need more different...

we got a replacement! were you affected of the fuckup I did now? (the first drop down to 0Mb/s is what I mean) messing with the DNS and also double-checking everything will still lead to a strange replaced : with _ which I didn't find the the first time I checked. sorry about that. New...

We lost our last Hoster for EU/US/everything-not-asia expect slow page-loading (after the DNS is updated for everyone) also ... we are again on the lookout for new servers :/

Hi, this will be back, as soon as the developer has fixed it for the xenforo version. if I now enable it, it will generate about 3k Errors per Minute.

Dark-Mode is back online & usable. sorry for all that got their eyes destroyed, while using the white theme.

sometimes it always happens at the same time. as you may know, we are hosting on a cloud. but a cloud is only some remote system - and the node where our main-database was hosted was shutdown about 11:45pm UTC. about 10 minutes after that, the database-vm came back up online - but I was...