Categories
Downtimes Problems

Server flatlined four times in not even two hours…

Due to until now unknown reasons the server which holds the Jabber services crashed four times in the last not even two hours. From one second to the other the ejabberd processes took every resource they could get, and even more. 8 gigs of RAM and 8 gigs of swap, everything gone. Plus a lot of CPU load. The machine was loaded that “top” refreshed just every 5 minutes and in the end just a hardware reset helped to reboot the machine.

For the tech geeks:

top – 19:56:21 up 31 min,  1 user,  load average: 22.86, 13.11, 8.71
Tasks: 240 total,   3 running, 231 sleeping,   0 stopped,   6 zombie
Cpu(s):  1.4%us,  5.8%sy,  0.0%ni, 12.4%id, 80.3%wa,  0.0%hi,  0.1%si,  0.0%st
Mem:   8190900k total,  8138972k used,    51928k free,      796k buffers
Swap:  8393848k total,  7276916k used,  1116932k free,    42404k cached

PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
3239 ejabberd  20   0 15.7g 6.0g 460 S   23 76.7   3:06.65 beam.smp

We are looking into this issue. Maybe a severe bug with ejabberd, maybe a DoS attack. We don’t know, yet.

Categories
Downtimes Features Maintenance

Proper certificates for secondary domains

To avoid login errors or messages and also to avoid certain problems with server-to-server connections we installed proper certificates for the secondary domains today.

We had to restart the Jabber services several times, sorry. The ejabberd config file isn’t commented very good, also Google didn’t tell us the correct settings in the first place. But everything works fine now.

PS: For old SSL connections to port 5223 there are no dynamic certificates. This just isn’t possible because of how SSL works.

Categories
Downtimes Maintenance Security

Upgrade to ejabberd 2.1.3

At 2pm CEST today I just upgraded the server to ejabberd 2.1.3, which is a bugfixing release. Finally the Debian package is available. Sorry for the less than one minute short service downtime. ;-)

Categories
Features

Virtual Jabber domain hosting

The switch to MySQL was used to test virtual hosts on the Jabber server which works really great.

Next to the primary domain jabber.hot-chilli.net this domain was added for public use:

  • jabber.hot-chilli.eu

Some time later two extra domains for public use were added:

  • hot-chilli.net
  • hot-chilli.eu

We also offer Jabber hosting for private domains.

Categories
Maintenance

ejabberd MySQL storage

On December 22nd, 2008, we switched the ejabberd daemon from Mnesia storage to MySQL storage.

Categories
General Transports

Migration to ejabberd

Migration from jabberd 1.x to ejabberd on August 29th, 2006. The transports were also migrated (to PyXXXt).