get notification when systemd-monitored service enters failed stateHow to set environment variable in systemd service?Find the location of a systemd serviceDo systemd unit files have to be reloaded when modified?start systemd service on start of requirementsystemd: Scope vs Servicesystemd cannot restart service fileGet systemd actual stateConfigure buggy systemd service to terminate via SIGKILLsystemd not shutting down MariaDB properly?systemd service with multiple After
Should I email my professor to clear up a (possibly very irrelevant) awkward misunderstanding?
Manager wants to hire me; HR does not. How to proceed?
What is the precise meaning of "подсел на мак"?
Is the infant mortality rate among African-American babies in Youngstown, Ohio greater than that of babies in Iran?
Testing thermite for chemical properties
Do my partner and son need an SSN to be dependents on my taxes?
How to know whether to write accidentals as sharps or flats?
My student in one course asks for paid tutoring in another course. Appropriate?
Explicit direct #include vs. Non-contractual transitive #include
Digital signature that is only verifiable by one specific person
What does a/.b[c][[1]] mean?
Converting 3x7 to a 1x7. Is it possible with only existing parts?
Background for black and white chart
Does knowing the surface area of all faces uniquely determine a tetrahedron?
How can Caller ID be faked?
Leaving job close to major deadlines
Is there a risk to write an invitation letter for a stranger to obtain a Czech (Schengen) visa?
Would a 7805 5v regulator drain a 9v battery?
Why can't we feel the Earth's revolution?
What is the context for Napoleon's quote "[the Austrians] did not know the value of five minutes"?
High-end PC graphics circa 1990?
How could I create a situation in which a PC has to make a saving throw or be forced to pet a dog?
Are there any super-powered aliens in the Marvel universe?
Time at 1G acceleration to travel 100000 light years
get notification when systemd-monitored service enters failed state
How to set environment variable in systemd service?Find the location of a systemd serviceDo systemd unit files have to be reloaded when modified?start systemd service on start of requirementsystemd: Scope vs Servicesystemd cannot restart service fileGet systemd actual stateConfigure buggy systemd service to terminate via SIGKILLsystemd not shutting down MariaDB properly?systemd service with multiple After
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I need to have network messages sent when a systemd service I have crashes or is hung (i.e., enters failed state; I monitor for hung by using WatchdogSec=). I noticed that newer systemd have FailureAction=, but then saw that this doesn't allow arbitrary commands, but just rebooting/shutdown.
Specifically, I need a way to have one network message sent when systemd detects the program has crashed, and another when it detects it has hung.
I'm hoping for a better answer than "parse the logs", and I need something that has a near-instant response time, so I don't think a polling approach is good; it should be something triggered by the event occurring.
linux bash service systemd
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
add a comment |
I need to have network messages sent when a systemd service I have crashes or is hung (i.e., enters failed state; I monitor for hung by using WatchdogSec=). I noticed that newer systemd have FailureAction=, but then saw that this doesn't allow arbitrary commands, but just rebooting/shutdown.
Specifically, I need a way to have one network message sent when systemd detects the program has crashed, and another when it detects it has hung.
I'm hoping for a better answer than "parse the logs", and I need something that has a near-instant response time, so I don't think a polling approach is good; it should be something triggered by the event occurring.
linux bash service systemd
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
Can you please provide an example (even a non working one) of what you are trying to achieve?
– dawud
May 27 '15 at 19:05
Can you please edit your question to add this information instead of adding it in a comment? :)
– dawud
May 27 '15 at 19:11
add a comment |
I need to have network messages sent when a systemd service I have crashes or is hung (i.e., enters failed state; I monitor for hung by using WatchdogSec=). I noticed that newer systemd have FailureAction=, but then saw that this doesn't allow arbitrary commands, but just rebooting/shutdown.
Specifically, I need a way to have one network message sent when systemd detects the program has crashed, and another when it detects it has hung.
I'm hoping for a better answer than "parse the logs", and I need something that has a near-instant response time, so I don't think a polling approach is good; it should be something triggered by the event occurring.
linux bash service systemd
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
I need to have network messages sent when a systemd service I have crashes or is hung (i.e., enters failed state; I monitor for hung by using WatchdogSec=). I noticed that newer systemd have FailureAction=, but then saw that this doesn't allow arbitrary commands, but just rebooting/shutdown.
Specifically, I need a way to have one network message sent when systemd detects the program has crashed, and another when it detects it has hung.
I'm hoping for a better answer than "parse the logs", and I need something that has a near-instant response time, so I don't think a polling approach is good; it should be something triggered by the event occurring.
linux bash service systemd
linux bash service systemd
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
edited May 28 '15 at 0:48
Display Name
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
asked May 27 '15 at 19:03
Display NameDisplay Name
2961411
2961411
Can you please provide an example (even a non working one) of what you are trying to achieve?
– dawud
May 27 '15 at 19:05
Can you please edit your question to add this information instead of adding it in a comment? :)
– dawud
May 27 '15 at 19:11
add a comment |
Can you please provide an example (even a non working one) of what you are trying to achieve?
– dawud
May 27 '15 at 19:05
Can you please edit your question to add this information instead of adding it in a comment? :)
– dawud
May 27 '15 at 19:11
Can you please provide an example (even a non working one) of what you are trying to achieve?
– dawud
May 27 '15 at 19:05
Can you please provide an example (even a non working one) of what you are trying to achieve?
– dawud
May 27 '15 at 19:05
Can you please edit your question to add this information instead of adding it in a comment? :)
– dawud
May 27 '15 at 19:11
Can you please edit your question to add this information instead of adding it in a comment? :)
– dawud
May 27 '15 at 19:11
add a comment |
3 Answers
3
active
oldest
votes
systemd units support OnFailure that will activate a unit (or more) when the unit goes to failed. You can put something like
OnFailure=notify-failed@%n
And then create the notify-failed@.service service where you can use the required specifier (you probably will want at least %i) to launch the script or command that will send notification.
You can see a practical example in http://northernlightlabs.se/systemd.status.mail.on.unit.failure
edited Jan 2 '18 at 22:01
Davy Landman
17315
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
5
There are a couple corrections needed to the instructions on the linked site. First,notify%n.serviceis redundant, and will result innotify@my-service.service.service. Second,%ishould be used instead of%I, or all dashes in the name will be converted to forward slashes.
– orodbhen
Jun 22 '16 at 15:42
3
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
add a comment |
Just my way to notify :
/etc/systemd/system/notify-email@.service
[Unit]
Description=Sent email
[Service]
Type=oneshot
ExecStart=/usr/bin/bash -c '/usr/bin/systemctl status %i | /usr/bin/mailx -Ssendwait -s "[SYSTEMD_%i] Fail" your_admin@company.blablabla'
add to systemd :
systemctl enable /etc/systemd/system/notify-email@service
At others services add :
[Unit]
OnFailure=notify-email@%i.service
Reload de configurations :
systemctl daemon-reload
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
add a comment |
I came across this utility which seems to provide this: https://github.com/joonty/systemd_mon
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f694818%2fget-notification-when-systemd-monitored-service-enters-failed-state%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
3 Answers
3
active
oldest
votes
3 Answers
3
active
oldest
votes
active
oldest
votes
active
oldest
votes
systemd units support OnFailure that will activate a unit (or more) when the unit goes to failed. You can put something like
OnFailure=notify-failed@%n
And then create the notify-failed@.service service where you can use the required specifier (you probably will want at least %i) to launch the script or command that will send notification.
You can see a practical example in http://northernlightlabs.se/systemd.status.mail.on.unit.failure
edited Jan 2 '18 at 22:01
Davy Landman
17315
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
5
There are a couple corrections needed to the instructions on the linked site. First,notify%n.serviceis redundant, and will result innotify@my-service.service.service. Second,%ishould be used instead of%I, or all dashes in the name will be converted to forward slashes.
– orodbhen
Jun 22 '16 at 15:42
3
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
add a comment |
systemd units support OnFailure that will activate a unit (or more) when the unit goes to failed. You can put something like
OnFailure=notify-failed@%n
And then create the notify-failed@.service service where you can use the required specifier (you probably will want at least %i) to launch the script or command that will send notification.
You can see a practical example in http://northernlightlabs.se/systemd.status.mail.on.unit.failure
edited Jan 2 '18 at 22:01
Davy Landman
17315
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
5
There are a couple corrections needed to the instructions on the linked site. First,notify%n.serviceis redundant, and will result innotify@my-service.service.service. Second,%ishould be used instead of%I, or all dashes in the name will be converted to forward slashes.
– orodbhen
Jun 22 '16 at 15:42
3
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
add a comment |
systemd units support OnFailure that will activate a unit (or more) when the unit goes to failed. You can put something like
OnFailure=notify-failed@%n
And then create the notify-failed@.service service where you can use the required specifier (you probably will want at least %i) to launch the script or command that will send notification.
You can see a practical example in http://northernlightlabs.se/systemd.status.mail.on.unit.failure
edited Jan 2 '18 at 22:01
Davy Landman
17315
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
systemd units support OnFailure that will activate a unit (or more) when the unit goes to failed. You can put something like
OnFailure=notify-failed@%n
And then create the notify-failed@.service service where you can use the required specifier (you probably will want at least %i) to launch the script or command that will send notification.
You can see a practical example in http://northernlightlabs.se/systemd.status.mail.on.unit.failure
edited Jan 2 '18 at 22:01
Davy Landman
17315
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
edited Jan 2 '18 at 22:01
Davy Landman
17315
edited Jan 2 '18 at 22:01
Davy Landman
17315
edited Jan 2 '18 at 22:01
Davy Landman
17315
17315
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
answered Jun 23 '15 at 20:10
Pablo MartinezPablo Martinez
1,8861110
1,8861110
5
There are a couple corrections needed to the instructions on the linked site. First,notify%n.serviceis redundant, and will result innotify@my-service.service.service. Second,%ishould be used instead of%I, or all dashes in the name will be converted to forward slashes.
– orodbhen
Jun 22 '16 at 15:42
3
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
add a comment |
5
There are a couple corrections needed to the instructions on the linked site. First,notify%n.serviceis redundant, and will result innotify@my-service.service.service. Second,%ishould be used instead of%I, or all dashes in the name will be converted to forward slashes.
– orodbhen
Jun 22 '16 at 15:42
3
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
5
5
There are a couple corrections needed to the instructions on the linked site. First,
notify%n.service is redundant, and will result in notify@my-service.service.service. Second, %i should be used instead of %I, or all dashes in the name will be converted to forward slashes.– orodbhen
Jun 22 '16 at 15:42
There are a couple corrections needed to the instructions on the linked site. First,
notify%n.service is redundant, and will result in notify@my-service.service.service. Second, %i should be used instead of %I, or all dashes in the name will be converted to forward slashes.– orodbhen
Jun 22 '16 at 15:42
3
3
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
Is there a way to do this for multiple or all units, without modifying their unit files?
– Vladimir Panteleev
Sep 10 '17 at 12:52
add a comment |
Just my way to notify :
/etc/systemd/system/notify-email@.service
[Unit]
Description=Sent email
[Service]
Type=oneshot
ExecStart=/usr/bin/bash -c '/usr/bin/systemctl status %i | /usr/bin/mailx -Ssendwait -s "[SYSTEMD_%i] Fail" your_admin@company.blablabla'
add to systemd :
systemctl enable /etc/systemd/system/notify-email@service
At others services add :
[Unit]
OnFailure=notify-email@%i.service
Reload de configurations :
systemctl daemon-reload
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
add a comment |
Just my way to notify :
/etc/systemd/system/notify-email@.service
[Unit]
Description=Sent email
[Service]
Type=oneshot
ExecStart=/usr/bin/bash -c '/usr/bin/systemctl status %i | /usr/bin/mailx -Ssendwait -s "[SYSTEMD_%i] Fail" your_admin@company.blablabla'
add to systemd :
systemctl enable /etc/systemd/system/notify-email@service
At others services add :
[Unit]
OnFailure=notify-email@%i.service
Reload de configurations :
systemctl daemon-reload
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
add a comment |
Just my way to notify :
/etc/systemd/system/notify-email@.service
[Unit]
Description=Sent email
[Service]
Type=oneshot
ExecStart=/usr/bin/bash -c '/usr/bin/systemctl status %i | /usr/bin/mailx -Ssendwait -s "[SYSTEMD_%i] Fail" your_admin@company.blablabla'
add to systemd :
systemctl enable /etc/systemd/system/notify-email@service
At others services add :
[Unit]
OnFailure=notify-email@%i.service
Reload de configurations :
systemctl daemon-reload
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
Just my way to notify :
/etc/systemd/system/notify-email@.service
[Unit]
Description=Sent email
[Service]
Type=oneshot
ExecStart=/usr/bin/bash -c '/usr/bin/systemctl status %i | /usr/bin/mailx -Ssendwait -s "[SYSTEMD_%i] Fail" your_admin@company.blablabla'
add to systemd :
systemctl enable /etc/systemd/system/notify-email@service
At others services add :
[Unit]
OnFailure=notify-email@%i.service
Reload de configurations :
systemctl daemon-reload
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
answered Aug 1 '18 at 12:40
ceinmartceinmart
262211
262211
add a comment |
add a comment |
I came across this utility which seems to provide this: https://github.com/joonty/systemd_mon
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
add a comment |
I came across this utility which seems to provide this: https://github.com/joonty/systemd_mon
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
add a comment |
I came across this utility which seems to provide this: https://github.com/joonty/systemd_mon
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
I came across this utility which seems to provide this: https://github.com/joonty/systemd_mon
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
answered Nov 23 '17 at 19:25
Michael WarkentinMichael Warkentin
1091
1091
add a comment |
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f694818%2fget-notification-when-systemd-monitored-service-enters-failed-state%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Can you please provide an example (even a non working one) of what you are trying to achieve?
– dawud
May 27 '15 at 19:05
Can you please edit your question to add this information instead of adding it in a comment? :)
– dawud
May 27 '15 at 19:11