Needs help for grouping data

[Sam Saha]

I have a log file sitting in UNIX server which is a combination of ERROR and CRIT in a random order. I want to group all ERROR together and all CRIT together. And there are so many lines for each ERROR and CRIT. I just want to capture only main error description line from each ERROR and CRIT to reduce the file. I have to write unix script to handle this. I am very new to UNIX and before writing script I want to write an algorithm for that. I am wondering if someone can show me the algorithm for this.

The log file looks like this:

ERROR|2011-10-13 12:19:52,870|server|java.lang.Runtime@8090809|WebContainer : 4|aut001|gcNRXjSAiBgv8FhM2uBM1wm|/s1gcb/csr/common/corp/corporationEditComprehensiveView|Error checking if the object of the correct type cannot be found on the session
com.s1.common.ui.SessionAssertionException: Object of type 'class com.s1.app.sam.web.company.edit.CompanyEditValue' not found under key 'com.s1.app.sam.web.company.edit.COMPANY'
	at com.s1.common.ui.UIAssert.assertIsPresent(UIAssert.java:60)
	at com.s1.app.sam.web.company.edit.CompanyViewCommonAction.execute(CompanyViewCommonAction.java:77)
	at com.s1.app.sam.web.company.edit.CompanyViewCommonAction.execute(CompanyViewCommonAction.java:55)
	at com.s1.app.sam.web.company.edit.CompanyViewDecideAction.execute(CompanyViewDecideAction.java:56)
	at com.s1.arch.ui.action.CustomRequestProcessor.processActionPerform(CustomRequestProcessor.java:202)
	at com.s1.arch.ui.action.CustomRequestProcessor.process(CustomRequestProcessor.java:511)
	at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1913)
	at com.s1.arch.ui.action.CustomActionServlet.process(CustomActionServlet.java:195)
	at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:449)
CRIT|2011-10-13 12:20:47,686|server|java.lang.Runtime@8090809|WebContainer : 4|mbettycoach@mbettyco|gcNRXjSAiBgv8FhM2uBM1wm|/s1gcb/logon/app/disbursements/corpach/common/createAchTemplate/preview|Error while getting CrossBorder destination country-currency info. 
com.s1.app.disbursements.corpach.common.ui.CorpAchException: Method: getCountryAlpha2CodeByCBrDestKy(ObjectId crossBorderDestKy) Unknown Cross Border Destination. crossBorderDestKy not in table.
	at com.s1.app.disbursements.corpach.common.CorpAchCrossBorderDestTable.getCountryAlpha2CodeByCBrDestKy(CorpAchCrossBorderDestTable.java:253)
	at com.s1.app.disbursements.corpach.common.validator.CorpAchBankIdTypeValidator.validate(CorpAchBankIdTypeValidator.java:93)
	at com.s1.arch.validation.ValidationChain.executeOn(ValidationChain.java:70)
	at com.s1.app.disbursements.corpach.common.validator.CorpAchCommonValidator.validate(CorpAchCommonValidator.java:27)
ERROR|2011-10-13 12:24:13,747|server|java.lang.Runtime@8090809|WebContainer : 2|aut001|bvrEVjZf-CeUGaSNE4Fzxzc|/s1gcb/csr/common/corp/corporationEditComprehensiveView|Error checking if the object of the correct type cannot be found on the session
com.s1.common.ui.SessionAssertionException: Object of type 'class com.s1.app.sam.web.company.edit.CompanyEditValue' not found under key 'com.s1.app.sam.web.company.edit.COMPANY'
	at com.s1.common.ui.UIAssert.assertIsPresent(UIAssert.java:60)
	at com.s1.app.sam.web.company.edit.CompanyViewCommonAction.execute(CompanyViewCommonAction.java:77)
	at com.s1.app.sam.web.company.edit.CompanyViewCommonAction.execute(CompanyViewCommonAction.java:55)
	at com.s1.app.sam.web.company.edit.CompanyViewDecideAction.execute(CompanyViewDecideAction.java:56)
	at com.s1.arch.ui.action.CustomRequestProcessor.processActionPerform(CustomRequestProcessor.java:202)
CRIT|2011-10-13 12:25:03,368|server|java.lang.Runtime@8090809|WebContainer : 2|mbettycoach@mbettyco|bvrEVjZf-CeUGaSNE4Fzxzc|/s1gcb/logon/app/disbursements/corpach/common/createAchTemplate/preview|Error while getting CrossBorder destination country-currency info. 
com.s1.app.disbursements.corpach.common.ui.CorpAchException: Method: getCountryAlpha2CodeByCBrDestKy(ObjectId crossBorderDestKy) Unknown Cross Border Destination. crossBorderDestKy not in table.
	at com.s1.app.disbursements.corpach.common.CorpAchCrossBorderDestTable.getCountryAlpha2CodeByCBrDestKy(CorpAchCrossBorderDestTable.java:253)
	at com.s1.app.disbursements.corpach.common.validator.CorpAchBankIdTypeValidator.validate(CorpAchBankIdTypeValidator.java:93)
	at com.s1.arch.validation.ValidationChain.executeOn(ValidationChain.java:70)
	at com.s1.app.disbursements.corpach.common.validator.CorpAchCommonValidator.validate(CorpAchCommonValidator.java:27)

I want the output like this:

ERROR|2011-10-13 12:19:52,870|server|java.lang.Runtime@8090809|WebContainer : 4|aut001|gcNRXjSAiBgv8FhM2uBM1wm|/s1gcb/csr/common/corp/corporationEditComprehensiveView|Error checking if the object of the correct type cannot be found on the session
com.s1.common.ui.SessionAssertionException: Object of type 'class com.s1.app.sam.web.company.edit.CompanyEditValue' not found under key 'com.s1.app.sam.web.company.edit.COMPANY'
ERROR|2011-10-13 12:24:13,747|server|java.lang.Runtime@8090809|WebContainer : 2|aut001|bvrEVjZf-CeUGaSNE4Fzxzc|/s1gcb/csr/common/corp/corporationEditComprehensiveView|Error checking if the object of the correct type cannot be found on the session
com.s1.common.ui.SessionAssertionException: Object of type 'class com.s1.app.sam.web.company.edit.CompanyEditValue' not found under key 'com.s1.app.sam.web.company.edit.COMPANY'
CRIT|2011-10-13 12:20:47,686|server|java.lang.Runtime@8090809|WebContainer : 4|mbettycoach@mbettyco|gcNRXjSAiBgv8FhM2uBM1wm|/s1gcb/logon/app/disbursements/corpach/common/createAchTemplate/preview|Error while getting CrossBorder destination country-currency info. 
com.s1.app.disbursements.corpach.common.ui.CorpAchException: Method: getCountryAlpha2CodeByCBrDestKy(ObjectId crossBorderDestKy) Unknown Cross Border Destination. crossBorderDestKy not in table.
CRIT|2011-10-13 12:25:03,368|server|java.lang.Runtime@8090809|WebContainer : 2|mbettycoach@mbettyco|bvrEVjZf-CeUGaSNE4Fzxzc|/s1gcb/logon/app/disbursements/corpach/common/createAchTemplate/preview|Error while getting CrossBorder destination country-currency info. 
com.s1.app.disbursements.corpach.common.ui.CorpAchException: Method: getCountryAlpha2CodeByCBrDestKy(ObjectId crossBorderDestKy) Unknown Cross Border Destination. crossBorderDestKy not in table.

[Ernest Friedman-Hill]

grep for lines that start with one of your keywords, then sort the result:

egrep "^ERROR|^CRIT" LOGFILE | sort 

[Sam Saha]

I would appreciate if you could show the algorithm for that.

[Ernest Friedman-Hill]

Note sure what you mean by "algorithm" here. The egrep command filters out only those lines that start with ERROR ("^ERROR") or ("|") start with CRIT ("^CRIT").Those lines are then piped to the sort program, which will group lines starting with the same keywords together.