How can I use grep to find the most frequently recurring errors in my log file?How can I display and log PHP errors on IIS7?How to grab a word from a file using sed or grepGetting the last match in a file using grepgrep or sed to find a integer value above a given amount?Display specific word in file. To be used as varible, grep for email in logGREP find and use SED to replace string on all filesExim log file errorsSed - extract only parts of file with certain timestampsGrep in a huge log file (>14 GB) only the last x GB?Trying to do grep and sed from a file and push the output into a variable
What does this quote in Small Gods refer to?
How are Core iX names like Core i5, i7 related to Haswell, Ivy Bridge?
Ex-manager wants to stay in touch, I don't want to
How to pronounce "r" after a "g"?
Make all the squares explode
Exception propagation: When to catch exceptions?
How could we transfer large amounts of energy sourced in space to Earth?
histogram using edges
Will change of address affect direct deposit?
What is the airplane type in this formation seen above Eugene, Oregon?
How does Howard Stark know this?
Looking for a simple way to manipulate one column of a matrix
Is there any evidence to support the claim that the United States was "suckered into WW1" by Zionists, made by Benjamin Freedman in his 1961 speech?
Was this a power play by Daenerys?
Why is it so slow when assigning a concatenated string to a variable in python?
Why does TypeScript pack a Class in an IIFE?
Remove everything except csv file Bash Script
Washer drain pipe overflow
What are the ramifications of setting ARITHABORT ON for all connections in SQL Server?
How could a Lich maintain the appearance of being alive without magic?
Would an 8% reduction in drag outweigh the weight addition from this custom CFD-tested winglet?
How to align underlines in a cases environment
The lexical root of the perfect tense forms differs from the lexical root of the infinitive form
Why was the Ancient One so hesitant to teach Dr. Strange the art of sorcery?
How can I use grep to find the most frequently recurring errors in my log file?
How can I display and log PHP errors on IIS7?How to grab a word from a file using sed or grepGetting the last match in a file using grepgrep or sed to find a integer value above a given amount?Display specific word in file. To be used as varible, grep for email in logGREP find and use SED to replace string on all filesExim log file errorsSed - extract only parts of file with certain timestampsGrep in a huge log file (>14 GB) only the last x GB?Trying to do grep and sed from a file and push the output into a variable
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I've got a PHP application that is generating large amounts of warnings and notices in the log file..
I'm fixing these one at a time.
I would like to be able to fix the most frequently occurring first in order to maximize the amount of effect my changes have on the size of the log file.
How can I use grep/sed/regex etc.find out which notices are most frequent?
I can't compare the whole line since the time stamp is at the beginning, but perhaps a listing/grouping/sorting of "on line ..."?
log-files grep analysis sed frequency
edited May 1 at 15:48
Glorfindel
4481716
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
add a comment |
I've got a PHP application that is generating large amounts of warnings and notices in the log file..
I'm fixing these one at a time.
I would like to be able to fix the most frequently occurring first in order to maximize the amount of effect my changes have on the size of the log file.
How can I use grep/sed/regex etc.find out which notices are most frequent?
I can't compare the whole line since the time stamp is at the beginning, but perhaps a listing/grouping/sorting of "on line ..."?
log-files grep analysis sed frequency
edited May 1 at 15:48
Glorfindel
4481716
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
add a comment |
I've got a PHP application that is generating large amounts of warnings and notices in the log file..
I'm fixing these one at a time.
I would like to be able to fix the most frequently occurring first in order to maximize the amount of effect my changes have on the size of the log file.
How can I use grep/sed/regex etc.find out which notices are most frequent?
I can't compare the whole line since the time stamp is at the beginning, but perhaps a listing/grouping/sorting of "on line ..."?
log-files grep analysis sed frequency
edited May 1 at 15:48
Glorfindel
4481716
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
I've got a PHP application that is generating large amounts of warnings and notices in the log file..
I'm fixing these one at a time.
I would like to be able to fix the most frequently occurring first in order to maximize the amount of effect my changes have on the size of the log file.
How can I use grep/sed/regex etc.find out which notices are most frequent?
I can't compare the whole line since the time stamp is at the beginning, but perhaps a listing/grouping/sorting of "on line ..."?
log-files grep analysis sed frequency
log-files grep analysis sed frequency
edited May 1 at 15:48
Glorfindel
4481716
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
edited May 1 at 15:48
Glorfindel
4481716
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
edited May 1 at 15:48
Glorfindel
4481716
edited May 1 at 15:48
Glorfindel
4481716
edited May 1 at 15:48
Glorfindel
4481716
4481716
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
asked Aug 10 '09 at 7:11
Edward TanguayEdward Tanguay
47531424
47531424
add a comment |
add a comment |
2 Answers
2
active
oldest
votes
How about this?
grep 'on line' /var/log/httpd/error_log | cut -d' ' -f6- | sort | uniq -c | sort -nr
I.e.
- Get the right lines from the logfile
- Chop the date off the front
- Sort them
- Aggregate and count the duplicates
- Sort by number of duplicates
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
add a comment |
I think this is more concise, so you really could avoid 'cut'.
grep -o 'on line [[:digit:]]*' /var/log/nginx/error.log | sort | uniq -c | sort -nr
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
add a comment |
Your Answer
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "2"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f52124%2fhow-can-i-use-grep-to-find-the-most-frequently-recurring-errors-in-my-log-file%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
How about this?
grep 'on line' /var/log/httpd/error_log | cut -d' ' -f6- | sort | uniq -c | sort -nr
I.e.
- Get the right lines from the logfile
- Chop the date off the front
- Sort them
- Aggregate and count the duplicates
- Sort by number of duplicates
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
add a comment |
How about this?
grep 'on line' /var/log/httpd/error_log | cut -d' ' -f6- | sort | uniq -c | sort -nr
I.e.
- Get the right lines from the logfile
- Chop the date off the front
- Sort them
- Aggregate and count the duplicates
- Sort by number of duplicates
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
add a comment |
How about this?
grep 'on line' /var/log/httpd/error_log | cut -d' ' -f6- | sort | uniq -c | sort -nr
I.e.
- Get the right lines from the logfile
- Chop the date off the front
- Sort them
- Aggregate and count the duplicates
- Sort by number of duplicates
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
How about this?
grep 'on line' /var/log/httpd/error_log | cut -d' ' -f6- | sort | uniq -c | sort -nr
I.e.
- Get the right lines from the logfile
- Chop the date off the front
- Sort them
- Aggregate and count the duplicates
- Sort by number of duplicates
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
answered Aug 10 '09 at 7:44
Niels BasjesNiels Basjes
1,61431425
1,61431425
add a comment |
add a comment |
I think this is more concise, so you really could avoid 'cut'.
grep -o 'on line [[:digit:]]*' /var/log/nginx/error.log | sort | uniq -c | sort -nr
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
add a comment |
I think this is more concise, so you really could avoid 'cut'.
grep -o 'on line [[:digit:]]*' /var/log/nginx/error.log | sort | uniq -c | sort -nr
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
add a comment |
I think this is more concise, so you really could avoid 'cut'.
grep -o 'on line [[:digit:]]*' /var/log/nginx/error.log | sort | uniq -c | sort -nr
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
I think this is more concise, so you really could avoid 'cut'.
grep -o 'on line [[:digit:]]*' /var/log/nginx/error.log | sort | uniq -c | sort -nr
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
answered Oct 6 '11 at 14:33
J. M. BeckerJ. M. Becker
2,05111320
2,05111320
add a comment |
add a comment |
Thanks for contributing an answer to Server Fault!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fserverfault.com%2fquestions%2f52124%2fhow-can-i-use-grep-to-find-the-most-frequently-recurring-errors-in-my-log-file%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
