Maybe calling the guy directly might help... @tliu223, hey!
(I see "Ignore" button on the hover popup.)
(I see "Ignore" button on the hover popup.)
Please post all forum bugs here
- Thread starter elgringo14
- Start date
-
Akiba-Online is sponsored by FileJoker.
FileJoker is a required filehost for all new posts and content replies in the Direct Downloads subforums.
Failure to include FileJoker links for Direct Download posts will result in deletion of your posts or worse.
For more information see this thread.
I did that, lets see if this fixes the issue
We lost our servers in Asia.
Expect a very slow site, since we have to route everything through Europe (and they will be overloaded for 100%)
Sorry about that. Not sure, why they are down. I hope @chompy can figure this out, soon.
Edit:
Systems are back up running.
Sorry about that.
DNS will take a bit to get the new systems back online.
Expect a very slow site, since we have to route everything through Europe (and they will be overloaded for 100%)
Sorry about that. Not sure, why they are down. I hope @chompy can figure this out, soon.
Edit:
Systems are back up running.
Sorry about that.
DNS will take a bit to get the new systems back online.
Last edited:
sometimes it always happens at the same time.
as you may know, we are hosting on a cloud.
but a cloud is only some remote system - and the node where our main-database was hosted was shutdown about 11:45pm UTC.
about 10 minutes after that, the database-vm came back up online - but I was sleeping, since I really need to sleep sometimes
For security reasons a "normal" start is not possible - i need to manually enter a Password to decrypt the files. (better safe than sorry | also better save then sorry)
As you may see now - they system is back up online.
perhaps we should consider adding an additional master-database-node, at a different location, if something like this happens again.
But this will mean, that I have to change the whole cluster setup - again some downtime is needed
as you may know, we are hosting on a cloud.
but a cloud is only some remote system - and the node where our main-database was hosted was shutdown about 11:45pm UTC.
about 10 minutes after that, the database-vm came back up online - but I was sleeping, since I really need to sleep sometimes
For security reasons a "normal" start is not possible - i need to manually enter a Password to decrypt the files. (better safe than sorry | also better save then sorry)
As you may see now - they system is back up online.
perhaps we should consider adding an additional master-database-node, at a different location, if something like this happens again.
But this will mean, that I have to change the whole cluster setup - again some downtime is needed
We lost our last Hoster for EU/US/everything-not-asia
expect slow page-loading (after the DNS is updated for everyone)
also ... we are again on the lookout for new servers :/
expect slow page-loading (after the DNS is updated for everyone)
also ... we are again on the lookout for new servers :/
we got a replacement!
were you affected of the fuckup I did now? (the first drop down to 0Mb/s is what I mean)
messing with the DNS and also double-checking everything will still lead to a strange replaced : with _ which I didn't find the the first time I checked.
sorry about that.
New servers are already receiving a "little" bit of traffic
were you affected of the fuckup I did now? (the first drop down to 0Mb/s is what I mean)
messing with the DNS and also double-checking everything will still lead to a strange replaced : with _ which I didn't find the the first time I checked.
sorry about that.
New servers are already receiving a "little" bit of traffic
asia frontend is down :/
see: https://status.akiba-online.com/status
If this won't be fixed in an hour or so, i will reroute all the asia traffic through emea
(I should really automate this already)
edit
changed to emea only -> traffic went up again ^^''
I will need more different locations, if this continues to happen :/
edit2
Systems are back online. DNS is changed back to full load-balancing
see: https://status.akiba-online.com/status
If this won't be fixed in an hour or so, i will reroute all the asia traffic through emea
(I should really automate this already)
edit
changed to emea only -> traffic went up again ^^''
I will need more different locations, if this continues to happen :/
edit2
Systems are back online. DNS is changed back to full load-balancing
Last edited:
not sure what happened there, since the upgrade there are many things that is wrong
unfortunately the media gallery did get broken when we upgraded from xenforo 1.x to 2.x
i tried to bring it back - but it was a huge mess (new database structure, new storage path, new storage format of the files.
After a "good guess" and multiple tests, I somehow ignored it (it was about 3GB of images; and they should still linger around on some backup, but it's just a pain to reformat the attachment-files to it's original name and then upload them again :/
Sorry about that.
i tried to bring it back - but it was a huge mess (new database structure, new storage path, new storage format of the files.
After a "good guess" and multiple tests, I somehow ignored it (it was about 3GB of images; and they should still linger around on some backup, but it's just a pain to reformat the attachment-files to it's original name and then upload them again :/
Sorry about that.
some severe errors with our asia servers.
one asia server is able to reach part of the load-balancer, but not the other one
the 2nd asia server doesn't reach any of the two systems
Routed everything through europe :/
I hope this is just some "minor" BGP has fucked up thing :/
one asia server is able to reach part of the load-balancer, but not the other one
the 2nd asia server doesn't reach any of the two systems
Routed everything through europe :/
I hope this is just some "minor" BGP has fucked up thing :/
Last edited:
routes are back!
Asia Servers are back to the DNS system.
Let's hope it won't break again in the next few days, because i won't be able to access the internet with more than edge-speeds.
Asia Servers are back to the DNS system.
Let's hope it won't break again in the next few days, because i won't be able to access the internet with more than edge-speeds.
there could be the possibility that the database switched to read-only mode
i'm not sure why -.-#
sorry about that.
everything is back online
i'm not sure why -.-#
sorry about that.
everything is back online
Nice one.
first we have a problem with the mail-servers.
now our database-cluster crashed :/
main-system is back online - but we are missing replication & backup at the moment.
Expect another downtime to rebuild the cluster :/
first we have a problem with the mail-servers.
now our database-cluster crashed :/
main-system is back online - but we are missing replication & backup at the moment.
Expect another downtime to rebuild the cluster :/