testotron

https://github.com/MichalPokorny/testotron

Testotron can automatically test basic functions of common servers, so you can get an alert when some piece of your configuration stops working.