Page 1 of 2

Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 5:04 am
by DM Wish
Hello one and all,

There is a chance that following the crashes that certain characters may be corrupted, with stats, or content having been disrupted in some way. This will cause further problems down the line so to save that bother if you discover your character has been corrupted:

1) Send a message to the 'Active DMs' & 'Active Admins'
In this message should be your character's name, your player name and a brief summary on what you suspect the issue is/symptoms you experience.
2) Wait patiently - we will get in touch.

How to find out if your character is corrupted:
1) If you can't log in. That is a fairly clear indicator.
2) If you discover a stat has been horrendously changed.

If you have any questions on the above, you are welcome to PM myself, or any of the DM team for clarification.

Thank you for your time in reading all of the above.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 5:33 am
by Cortex
Is this only affecting characters that were online during the crash?

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 5:49 am
by I can be your angle or yuor devil
I think so yeah. My entire character is corrupted.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 6:04 am
by Cuchilla
Seems like it's not just the character being online, but the whole vault. PM sent

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 7:07 am
by Caliber
I wasn't online during the crash, and it's affecting me, so I've sent a PM.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 7:08 am
by Tourmaline
Before I join.. is it safe to try to play or better to wait until the all clear?

And just because i have a few lower level alts.. is it easier on the maintenance staff if I just delete and remake if a corrupted character isn't that far along instead of bugging them with PMs?

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 7:51 am
by Stath
My Character seems to be missing his keened masterly damask weapon and UMD cache ; )

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:02 am
by Irongron
I was going to make a general post to say that I'm now back (internet finally connected at new house), but this seems a good a place as any.

Am looking into this. Will likely require a team effort though - will keep you all posted.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:06 am
by Cortex
literally how i picture you coming back

Image

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:17 am
by DM Wish
Cortex wrote:literally how i picture you coming back

Image
I think your optimism may be misplaced.
Despite this, we appreciate everyone's continued patience in the current issue; as we understand it is quite frustrating. All efforts that can be made are.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:17 am
by Irongron
Yep, only part missing is where I reach for the phone and call Midnight & Mithreas.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:34 am
by DM Symphony
But, Pizza for everyone once things are fixed?

I don't mind cold pizza.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:35 am
by caldura firebourne
you guys are like..... the justice league of NWN

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:38 am
by DM Wish
caldura firebourne wrote:you guys are like..... the justice league of NWN
In that we do things for the good of the server out of the altruism in our hearts, or that we do such while wearing ridiculous costumes? I mean both statements are true but nevertheless worth clarifying.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:50 am
by Irongron
Update:

The problem is/was simple, but the process of fixing this will be time-consuming.

We ran out of hard disk space, meaning characters weren't saving, or only partially. Those of you who have played since this happened, and then logged out will also likely find your characters corrupted.

To those that are interested the space was getting eaten up by logs, more players has meant more logs, and sooner or later I'll either have to review what we're logging, or buy more space from the server folk.

Mithreas is already getting us some hard disk space back, but the corrupted characters will have to be indivdually restored to an earlier version (that's the painful part). To avoid having to do this via reports from every affected character Symphony is looking at building some software for us to detect them.

The extra space is added already though, so hopefully this won't happen to anyone else in the meantime. Mith's efforts have bought us probably about another 4 weeks before it explodes again, and before then Midnight and I shall discuss what we do about renting a better server (with more space)

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 8:59 am
by Lorkas
If we haven't played at all since before the crash, will we be okay?

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:08 am
by Seekeepeek
Iam in the same boat as Lorkas, so a heads up when it's safe to log in would be nice ^.^

Don't know if it's possible, but wouldn't it be neat to make a program or script that warn about available space is about to reach it's limit? you know as a preventive measurement so it don't happen again, kinda sounds like a ton of work to restore once it's broke... so my hats off in respects to those that are working on that!

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:15 am
by Irongron
Lorkas wrote:If we haven't played at all since before the crash, will we be okay?
You should be fine, yes. Characters will have been corrupted if you logged off at any point in the last 5 hours or so.

Server is safe to play on again, but fixing damaged characters will take a while longer.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:18 am
by FrozenSolid
The negative energy elemental corrupted the server too.

Dangit

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:29 am
by Hatsune Miku
May wish to revise the saving part of the module if its possible to do with the toolkit.
Have it work with a buffer which leaves enough room for it to save all characters as they are and kills the server instance until the problem is looked at.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:34 am
by DirtyDeity
@Irongron

Server is safe to play on, but is empty. Most people can't log in, and when you manage to log in, you get kicked out after about 5 minutes.

Maybe a reset is required?

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:38 am
by Irongron
Server is resetting now, normal service should then be resumed. As I said, if you had a corrupted character then it may be some hours until they're back, otherwise it should all be good after this reset.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:42 am
by Emotionaloverload
I have logged in in the last 5 hours and my character isn't corrupted. Is this luck or should I expect it to blow up soon?

-S

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 9:44 am
by DirtyDeity
Just updating: Server is still kicking people out, even after reset.

Logged for like 3 minutes, got booted, and now it probably won't be available for 10~ minutes before the same repeats.

Re: Crash Potentiality - Corrupt Characters

Posted: Fri May 26, 2017 10:13 am
by kittenblackfriends
Irongron wrote:To avoid having to do this via reports from every affected character Symphony is looking at building some software for us to detect them.
Bless Symphony. Give them pizza and coffee to turn into code.

Anyways, atm, I don't see the C+P or Surface servers (hey, I think that one might be the intermediary server, since it's got the same IP address and a different port, which makes for three), both marked as offline...but so are half of the other servers I keep on my server list, meaning it could be at my end XD