What's with that server AGAIN?

[Pierre-Marie Baty]

Tonight the Bots United server has been unreachable from 5:30AM to 8:15AM or so. I was pinging it continuously to check when it would be back online. What's wrong with it again ??? > Is it the hosting provider or is it something else ?? I noticed that there was a new eMule service and also a new overnet service installed on our server, wtf ? questions :

1. It's not the first time the server goes down for a duration exceeding one hour. It already went down one night a few days ago. Whose fault ? Providers ? If so, what is their excuse ?
2. Is there a NEED for an eMule server and/or an Overnet server on the Bots United machine ?
3. Would these servers run, what is the advantage of putting up such services on the Bots United machine over using one of the thousands existing servers in the world for our peer to peer needs ?
3. Are eMule and Overnet servers secure ? In order to be efficient servers (worth the consideration) how many client hits do they need ? What bandwidth does this represent ?

So gentlemen, we want a professionnal quality of service or what ? > >

Notice, the php page to reply don't work sometimes. It was the case, yesterday and the day before for example. I had to wait for 1 hour.

---Edit---
seems to be the case here... 5 min...

[Nova]

Originally Posted by Pierre-Marie Baty

Tonight the Bots United server has been unreachable from 5:30AM to 8:15AM or so. I was pinging it continuously to check when it would be back online. What's wrong with it again ??? > Is it the hosting provider or is it something else ?? I noticed that there was a new eMule service and also a new overnet service installed on our server, wtf ? questions :

1. It's not the first time the server goes down for a duration exceeding one hour. It already went down one night a few days ago. Whose fault ? Providers ? If so, what is their excuse ?
2. Is there a NEED for an eMule server and/or an Overnet server on the Bots United machine ?
3. Would these servers run, what is the advantage of putting up such services on the Bots United machine over using one of the thousands existing servers in the world for our peer to peer needs ?
3. Are eMule and Overnet servers secure ? In order to be efficient servers (worth the consideration) how many client hits do they need ? What bandwidth does this represent ?

So gentlemen, we want a professionnal quality of service or what ? > >

Answer to 1. I asked the Hoster, 11 days ago there was a downtime at night of 3 hours due to a lightning strike that destroyed the whole UPS Powere system. Theye were restoring these systems last night when a fuse blew and ALL servers lost power.

Answer to 2,3,4
Can be deleted, is not running anyway. i used it to get some rare files that just download faster on the appropriate bandwidth. just delete the whole /overnet folder

[Pierre-Marie Baty]

Well Nova, I am somehow suspecting that the guy lied to you. Why so, I don't have a clue. Like I told you, I was pinging the server continuously and I was also running traceroutes from time to time to ensure all was OK by my side. And I can tell you that at least the routers of greatnet.de were ALWAYS up and working, and the results of the last hop were alternatively: "ping timeout" for 1 or 2 minutes or so, and "no route to host" for 30 seconds. This is typical : the guys were shutting down the machine, unplugging wires, then plugging them again and checking whether it worked, then unplugging/shutting down again, then testing another thing, etc. They did this little comedy for more than one hour before it managed to work. I don't have a clue what they were up to, but it was clearly not just a bad fuse to replace.

Anyhow, what sort of manners are these ? If I were a hosting provider, I would AT LEAST send an email to my customers telling them that from time t1 to t2 I would bring their servers down for maintenance, so the customers could AT LEAST put a notification on their web servers to their users before the shutdown, politesse oblige, what do you think ?

[Nova]

Originally Posted by Pierre-Marie Baty

Well Nova, I am somehow suspecting that the guy lied to you. Why so, I don't have a clue. Like I told you, I was pinging the server continuously and I was also running traceroutes from time to time to ensure all was OK by my side. And I can tell you that at least the routers of greatnet.de were ALWAYS up and working, and the results of the last hop were alternatively: "ping timeout" for 1 or 2 minutes or so, and "no route to host" for 30 seconds. This is typical : the guys were shutting down the machine, unplugging wires, then plugging them again and checking whether it worked, then unplugging/shutting down again, then testing another thing, etc. They did this little comedy for more than one hour before it managed to work. I don't have a clue what they were up to, but it was clearly not just a bad fuse to replace.

Anyhow, what sort of manners are these ? If I were a hosting provider, I would AT LEAST send an email to my customers telling them that from time t1 to t2 I would bring their servers down for maintenance, so the customers could AT LEAST put a notification on their web servers to their users before the shutdown, politesse oblige, what do you think ?

True.

Well, luckily this wasnt at daytime ...

[Austin]

Originally Posted by Pierre-Marie Baty

Anyhow, what sort of manners are these ? If I were a hosting provider, I would AT LEAST send an email to my customers telling them that from time t1 to t2

I agree. totally, but
after hosting dedicated servers 24/7 on the internet since 1994, with 4 different providers, I have found it doesn't happen. They just go down now and then. You can call and scream at them, you can take the price breaks written in your contract for the service going down but it will still happen, unfortunately.

The best thing to do is have your DNS setup with a register that has dynamic DNS (I use dotyou.com) and have a back up server somewhere that has one web page that says the server is down for maintenance check back later. This server could even be at someone home sitting on DSL since it is just serving a small web page, performance will still be ok even for a lot of hits. Then when you see the site is down kick in your dynamic DNS to point the domain to the back up server.

This process can be automated using the IE web control to create a custom browser to check the web site every 30 seconds to make sure it gets a response. If it doesn't it can browse to the domain name registrar service and set DNS to the back up ip address. It can them keep monitoring the main server to see when it comes back on line and set the IP back to the main server’s IP. This way everyone will either get the main web site or a page telling them to check back.

Dynamic DNS works very well. It is amazing how fast the world knows about the IP change at their local DNS server.

If you want a sample VC++ project that shows how to do this let me know I will send it. I have done a number of projects for companies that use custom web browsers. But you may want to take a look at doing this in Java.

Nova " Well, luckily this wasnt at daytime ..."
Daytime for who? :-)

[Pierre-Marie Baty]

*BUMP*

what the F happened this morning again ??? BU has been down for HOURS !!! I could ping it but no services could respond at all !! Router problem I bet !! They're doing it on purpose or what ??? Now what's their excuse again ? Someone gotta tell them there's a limit and they're getting pretty damn close !!!
> > >

[Onno Kreuzinger]

Originally Posted by Pierre-Marie Baty

Anyhow, what sort of manners are these ? If I were a hosting provider, I would AT LEAST send an email to my customers telling them that from time t1 to t2 I would bring their servers down for maintenance, so the customers could AT LEAST put a notification on their web servers to their users before the shutdown, politesse oblige, what do you think ?

well you can say they don't have a status page and do not post maintanace on a website or via email, but i have been working for an isp for 2 years and can tell you as long as humans do some work, it will fail from time to time.

depending on how expensive the hoster is the more backup's it has, i.e. more human maintainable. but even then the craziest thing you can imagine can happen:
someone switches _the_ master switch ..... blob .... all dark .... 1,5 mil domains offline .... 24 GBIT internet up/downlink dead .... 200 000 phones dead .....

and like on the NASA mars mission which missed mars some years ago (metric system not usen in calcs.), is was a human error, someone wanted to work on high voltage and used the main switch, like he used to do it allways, no one told him that is was _the_ master switch.
in your case a fuse busted (if that is true), you can hardly send emails before a fuse explodes when you fix the power backup. and lightnings (like bullzosers) can hardly be totaly excluded from the danger list.

i could tell you examples of real life, but just think yourself when was the last local power outage, when was the last flooding somewhere you wantet to walk along, when was the last train/plain canceld you needed ?

s**t happens
* use backups *

Cheers MeMeD


[b.t.w. it happend 2002 in duesseldorf/germany at the level3 site, just for the suspicious. they have all you can dream of, double diesel genrators, 4x power backup, 3x aircondition, two physical differnt conncetion routes on 8+ telco carriers, handscanner access, security guards,..., and until 2002 they had a single big red main power switch for this, AFAIK they now have 2 with loud warning signals]

[Nova]

According to hosting, this time it wasnt their fault. Look at this, its from /var/log/warn:

Jan 29 18:48:45 server-one kernel: VM: killing process httpd
Jan 29 18:48:45 server-one kernel: swap_free: Bad swap offset entry 80098500

Thats the last message in any log before the server crashed. PM, memed, is that of any use to you ?

[Pierre-Marie Baty]

FYI the server was ONCE MORE unable to answer HTTP/FTP/SSH requests (and basically nothing but ICMP) this morning at 7AM, 8AM and 9AM. I did not check earlier (was sleeping) but I'd bet my ass it has been unreachable half the night.

*edit*

just seen your post Nova... YIKES, this looks like a REALLY nasty thing. The server's HDD may be corrupted... but I find it weird, though, because when the server was unreachable, it was just like all the userland code was frozen, only the kernel was still alive and able to reply to ICMP requests... I'm not sure a missing swap entry could crash the whole userland code, memed what do you think ?