Slowdowns, Offline and slowdowns follow up

Since the Sunday right before Labor day monday, the sites have been slow. And today, Sunday the 9th or September, the whole server farm went offline from 1:00am EDT ’til 9:40am EDT. Even now that the sites are online, things are flaky with lots of slowdowns and dropped connections.

After much investigation, we found that our oldest two servers (circa 2003) have given up the ghost and the rest are not keeping up with demand. It seems that the electric power in the facilities have something to do with the issue.

Here is what we will do to remedy the situation:

This week sometime, the servers will be moved to a different facility and the dead servers will be replaced. We don’t know the exact time of the move, but it will be in the coming few days. We will make an announcement few hours before the actual move and as soon as we have a firm time.

During the few hours before the move, the site will be in limited functionality. No new postings and no payments accepted.

During the move, the site will be completely offline, and it will last for a couple of hours at least. After that, everything should be back to normal.

Meanwhile, until that happens, the server farm has decreased in capacity, so expect lower performance from all the site that we have, including SOL and Finestories.

We apologize for any inconvenience that this will have. Hopefully, we’ll restore the service to a better than ever shape.

Comments

61 responses to “Slowdowns, Offline and slowdowns follow up”

  1. Dark Vision

    Thanks for the update. I will look forward to the improvements. While I can’t speak for everyone, I want you to know how much I appreciate your continuing efforts and the top-notch site you provide.

    Good luck with the move and updates.

    Dark Vision

  2. canette

    ty for telling us, I was wondering what the problem was

  3. starbo63

    These things happen! Glad that the site is still functioning. And thank you.

  4. starbo63

    These things happen. Glad that the site is still functioning and will get better

    thank you for all this work

  5. John

    Hi,
    That sucks but then again that is life. 🙂

    Thanks for the info and what you are doingt o get things back working and here’s hoping it goes smoothly.

    Thanks.

  6. David Langle

    Thank You.
    It’s so seldom somebody tells the grunts what going on.
    THANK YOU from the grunts ! ! !
    david

  7. ggunn74

    thanks for the update, always good to get info. i hope everything goes well with the move. thank you for the brilliant sites and the wonderful service.

  8. Rick Cross

    Lazeez, you and any staff that you have (if any) do an excellent job maintaining and developing the sites. I take the outages with a grain of salt as I know how frustrating it is trying to servers well serving. This is especially true when the servers are located where you can’t easily get your hands on them. I’ve been doing that with a much smaller system for 15 years. I’ll probably never qualify for a free premium membership as an author. In fact, I didn’t even know that it existed until a fellow author told me about it. I don’t care, I’m happy to pay for the service.

  9. joe

    Thank you for all you do – you do do a Yomans job keeping this site up and running, Thanks again

  10. johnanderson

    Thank you for letting us know what is going on. It really does help a lot to know what a general plan is.

    Laz keep up the good work

  11. tom

    Thanks for the update.
    I had been worried that someone or something had been messing with the data while in transit for the last week.

    For what it is worth the secure site does not seem to be affected by this.

  12. Sylverman

    Thanks for the update from my end also. from Vancouver Island, Canada

  13. Pat

    Thanks for the update. I know all about computer problems, I have been working with computers (including programming) since1976. Good luck with your move.

  14. wilbur

    Boy am I glad it was the site and not my computer!!

  15. Celtic Bard

    Thanks for the info. I got more than a little worried when both sites were inaccessible last night. Hope the move goes well.

  16. RustyKen

    Thanks for the update.

  17. Nicholas Cooke

    Man we can’t complain you do a great job and keep us informed. What more can we ask!

  18. Mike

    Laz, you do a fantastic Job, in my opinion, and no one can blame you for what has happened. Keep up the good work. It was funny though, I never thought that I would use Rogers to gain admittance, like through the back door.

  19. Geoff Harkness

    Like Dark Vision, I also want to thankyou for the great site and work you do. Thanks for letting us know what happened.

    G’day from Melbourne Australia

  20. Keith

    Thank you, The service you provide is excellent, and the down time minimal, breakdowns happen, and as with the other respondents, I wish you well with the move

  21. tucson

    How about a quick note on BTFH when you take it down. They are the ones that let us know of the problem. I believe a lot of your readers are logged into both sites each day. Thanks for all that you do.
    tucson

  22. Larrygator2004

    Thanks Laz, good job as always!

  23. Richard king

    Since I moved to sol after getting pissed off at Literotica for the final time, thanks for your wonderful service!

  24. Derek

    Thanks for the update, Keep up the good work.

  25. Chris

    Never thought I’d experienced something akin to mild withdrawal symptoms during the outage. Sunday afternoons weren’t meant to be spent any other way! Kept going back to check if the site was back up. Guess I’m not alone in saying SOL has become a part of my life. Thanks Laz

  26. Ty for the update i had wondered what was going on.

  27. Randy

    Well Laz I know from experience that a sure fire way of warping a server is to have dirty electricity. I think you do a great job keeping it up. Hope the new digs treat you and your servers better. Good luck with the move and may it go smoothly for you.

  28. Helen Lee

    You do such a good job of keeping things running smoothly’ that on the rare occasions that something does go wrong, I first assume that there’s something wrong with my computer. Then think it’s my modem. Then I assume it’s my ISP. Only much (very much) later do I even think to check your blog to see if the site might be having problems! I appreciate your efforts including that you keep us informed.

  29. Mark

    Thanks, as well, for the update!! Great service and nice to see you get in front of the problem.

  30. chuck messer

    Should have read the blog before I sent my questions….DDDDDDDUUUUUHHHHHHHH

  31. john

    Yup – I was wondering why connection and response time has been so flaky.
    thanks for the info. Maybe now I’ll learn patience!!! It’s worth waiting for

  32. Jim Deane

    Thanks so much for the update and all your work.
    Jim

  33. Keith

    GoDaddy is also suffering a major outage, reporting as many as 5 mllion sites down because their network is Kaput!

    Zog

  34. Jim

    The funny thing was about 2hrs after you came back on line, my ISP went down, must have be all the users of SOL, in the UK trying to get into to your site. Thanks for the update on this and goodluck with the move.

    Jimbristol (UK)

  35. Jim French

    Thanks for keeping us informed. You all have provided us with great service for the last 10 years that I have been here. You are constantly making a good thing always better. I do not think that there should be any complaints when something (very rarely!) goes wrong. You all do a fine job and no one can foresee every potential problem! Thanks for a job well done!

  36. Lapi/Wayne

    Dark and the others express my thoughts also. It is not easy to do what you do

    Lapi

  37. Thanks for this great site and all your hard work. Hope move goes as planned.

  38. R.J. Shore

    Sure glad to hear the problem is on your end. I was beginning to think this old machine was about to give up the ghost!

    Of all the sites I’ve worked through, this is one of the easiest and most reliable. Wouldn’t want to lose it now! Even this small glitch is nothing compared to what it could have been — like a hacked site that has to be completely scrubbed!
    (Dun dat, bin dere!)

    R.J. Shore ( on the Left Coast of Canada)

  39. Cere Burn

    Thanks for keeping us informed. If you can afford it, I suggest getting a rack mount UPS with Automatic Voltage Regulation or a line conditioner with a regular UPS. Those will take care of over and under voltage due to power problems. If you are getting ready to invest in new servers, might as well get this kind of insurance to keep them covered.

  40. David Healy

    Thanks for the info. Good to know it was not my system (for once)!
    Here’s to an uneventful move. Might want to make a sacrifice to
    the Internet Gods before the move, just to be safe.

    Elbrute

  41. Joe

    THANKS Its nice to have a reason for the outages. Please keep up the good work. I don’t like the delays but it will be well worth it to me and others, I am sure of it. Thanks again. Good luck on the moves.

  42. ajohnson

    As with all the other respondents, I really appreciate you posting the update.

  43. JMan5

    Virtualize the suckers!!!! Then you can just vMotion them to new hardware. VMware vSphere #FTW!!!!!!

    1. Mark N

      VMWare is fairly expensive, and if the servers that died were from around 2003, it probably isn’t financially feasible to use it. I know the feeling. I have 4 servers that date from about that time that are still in operation.

  44. Wildnature

    Thanks for the update. I was worried it was the damn internet connection. You never know with Cox Internet. Ya’ll are doing fantastic.

  45. Medik47

    Thanks for the info.
    Speaking of glitches and only because I don’t know where else to report this, carnigirl’s (who has comments turned off) ‘Deputy Porter’ with it’s latest 3 chapter (58 – 60) update seems to be out of sequence and out of context.

    Maybe you could pass this on to the author.

  46. Rangoon

    Every page is still loading very slowly for me. I notice because your site is usually one of the fastest I’ve experienced, but I am giving up lately after waiting a minute for a page to load.

    1. R.J. Shore

      I’m finding that trying to access the site between mid-morning and early evening results in many pages timing out before they load and sometimes won’t load at all, but later in the evening when traffic is down, it’s lightning-quick. Sounds like the servers still haven’t caught up with the traffic yet. Can we assume that’ll take care of itself over the next few weeks?

  47. It’s been over a week now, do you have any further news for us on the move and when the site will be back in full operation? I think I can say for everyone we really love this site and want to contunue for a very long time, PLEASE keep us informed.

    Dale

  48. Charles

    Any idea when you will have this fixed? I get that the site is unavalible several times a day.

  49. Iknew something was up when the pages were taking “forever” to load up or time out. Glad you can solve the problem. Many thanks for all you do and for helping me in the past. It is greatly appreciated.

    Jethro

  50. fishercat

    Glad new servers are in. When I am logging in, I get a message from my anti-virus software saying that the certificates don’t match. It may cause some people to worry.

    1. I’m unable to reproduce any security warning using all the browsers that I have. I don’t know what your ‘anti-virus’ software is looking for, but the certificates are there and they’re valid and Safari, Firefox, Chrome and Opera didn’t complain about the site’s credentials.

  51. yamasemi

    Just for info – it’s not just slow, but can’t download Kindle (.mobi) files either. Hope you get it sorted out soon, but I sympathise; something very similar happened to me a year or so ago, and it took a couple of months to sort out completely! Hope you’re luckier than that!

    1. The kindle issue has been fixed. we needed updated binaries for the kindle file generator.

      Is it still slow?

  52. michael.m

    Two hours i dont know if it was accurate as im in UK england so i was asleep i think. but well done anyway. In the years ive been reading stories on line and fine stories ive not had any real complaint to make and the only comment i can make is the number of stories seemingly discontinued for a long time i just wonder if the authors were still around?

  53. tucson

    Fantastic the new equipment is just blazing fast. Thanks

  54. Terry Cooper

    I was wandering, When i try to log on to storiesonline with my kindle 3g key board it says site is down for maintenance. Site works great on computer but does come up with a security advisory. I run enternet explorer and norton. Should i do some thing different. Love the site. Thanks

    1. You need to reset your kindle so that it would refresh the contents.

      As for the security certificate, the issue is only with IE7 or IE8. Try a different browser and you’ll find that it has no complaint. I filed a bug report with the certificate authority. We’ll see if there is something to be done to fix the issue.

  55. Mike99

    Is it just me or is the ‘Remember Password’ option not working now ?

    1. We didn’t change anything with that. Check to see if your browser or your security software is configured to delete cookies when you leave the site.