File APIs for Java Developers
Manipulate DOC, XLS, PPT, PDF and many others from your application.
http://aspose.com/file-tools
The moose likes Tomcat and the fly likes Tomcat is getting killed intermittently Big Moose Saloon
  Search | Java FAQ | Recent Topics | Flagged Topics | Hot Topics | Zero Replies
Register / Login
JavaRanch » Java Forums » Products » Tomcat
Bookmark "Tomcat is getting killed intermittently" Watch "Tomcat is getting killed intermittently" New topic
Author

Tomcat is getting killed intermittently

Sunday Oyeniyi
Greenhorn

Joined: Jul 12, 2005
Posts: 14
Hi all,

pls urgently advise me on how to handle this embarrassing situation when tomcat 5.5.17 gets killed intermittently. The below was copied from the server status of tomcat and suddently when it grows this much it just die.

Pls advise on what I can do to avert this danger of Tomcat.

/spms/pages/j_security_check seems to appear too much and that is what we used for the authentication.

--------------------------------------------------------------------------------
Complete Server Status

Manager
List Applications HTML Manager Help Manager Help Server Status

Server Information
Tomcat Version JVM Version JVM Vendor OS Name OS Version OS Architecture
Apache Tomcat/5.5.17 1.5.0_05-b05 Sun Microsystems Inc. Windows 2003 5.2 x86


OS
Physical memory: 3071.49 MB Available memory: 640.07 MB Total page file: 4967.55 MB Free page file: 2551.43 MB Memory load: 79
Process kernel time: 5.5 s Process user time: 54.234 s

JVM
Free memory: 115.61 MB Total memory: 225.25 MB Max memory: 1444.50 MB

http-8080
Max threads: 150 Min spare threads: 0 Max spare threads: 0 Current thread count: 113 Current thread busy: 110 Keeped alive sockets count: 6
Max processing time: 61656 ms Processing time: 391.621 s Request count: 3415 Error count: 408 Bytes received: 0.07 MB Bytes sent: 8.30 MB

Stage Time B Sent B Recv Client VHost Request
S 309281 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 336093 ms 0 KB 2 KB 10.0.132.89 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepost.jsp HTTP/1.1
S 329437 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 285781 ms 0 KB 0 KB 57.31.17.33 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 258281 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 292734 ms 0 KB 3 KB 10.11.10.28 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepost.jsp HTTP/1.1
S 260234 ms 0 KB 0 KB 57.13.17.95 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 263234 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 227828 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 216922 ms 0 KB 0 KB 57.110.17.200 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 312015 ms 0 KB 0 KB 57.30.17.193 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 329062 ms 0 KB 0 KB 57.13.17.95 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 299406 ms 0 KB 0 KB 57.52.17.201 10.100.5.237 GET /spms/pages/appraisal/appraisalaccept.jsp HTTP/1.1
S 325640 ms 0 KB 0 KB 58.23.17.11 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 269703 ms 0 KB 0 KB 58.17.8.72 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 277843 ms 0 KB 0 KB 10.0.176.211 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 278093 ms 0 KB 0 KB 10.2.140.203 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 305828 ms 0 KB 0 KB 57.45.8.121 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 236109 ms 0 KB 0 KB 10.0.160.15 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepage2.jsp HTTP/1.1
S 206593 ms 0 KB 0 KB 57.13.17.95 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 170297 ms 0 KB 0 KB 10.2.140.203 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 256625 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 286812 ms 0 KB 0 KB 10.0.156.207 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 328578 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 333984 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 260172 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 335125 ms 0 KB 1 KB 192.168.7.202 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepost.jsp HTTP/1.1
S 330609 ms 0 KB 0 KB 10.1.116.201 10.100.5.237 GET /spms/pages/appraisal/appraisalappraise.jsp HTTP/1.1
S 323453 ms 0 KB 0 KB 10.2.28.46 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 312734 ms 0 KB 0 KB 10.18.5.36 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 335515 ms 0 KB 0 KB 10.11.3.21 10.100.5.237 GET /spms/pages/appraisal/appraisalapprove.jsp HTTP/1.1
S 250625 ms 0 KB 0 KB 57.23.8.26 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 310640 ms 0 KB 0 KB 57.116.8.48 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 221140 ms 0 KB 0 KB 57.116.8.48 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 212078 ms 0 KB 0 KB 57.45.8.121 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 245531 ms 0 KB 0 KB 10.1.236.50 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 170015 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 261593 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraisepage1.jsp?appraiseeEmployeeId=A05487&appraisalExerciseId=1&appraisalId=513&appraisalPartNo=1&mgtCadreId=1 HTTP/1.1
S 330859 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraisepage1.jsp?appraiseeEmployeeId=A05487&appraisalExerciseId=1&appraisalId=513&appraisalPartNo=1&mgtCadreId=1 HTTP/1.1
S 228297 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 246578 ms 0 KB 0 KB 10.11.10.147 10.100.5.237 GET /spms/pages/kpiUpload/appraisal_score_summary.jsp HTTP/1.1
S 270906 ms 0 KB 0 KB 10.3.92.19 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 242516 ms 0 KB 0 KB 10.11.10.147 10.100.5.237 GET /spms/pages/kpiUpload/appraisal_score_summary.jsp HTTP/1.1
S 255516 ms 0 KB 0 KB 57.19.17.13 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 238297 ms 0 KB 0 KB 57.46.17.34 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 282125 ms 0 KB 0 KB 10.18.5.36 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 205594 ms 0 KB 0 KB 10.0.160.15 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepage2.jsp HTTP/1.1
S 171359 ms 0 KB 0 KB 10.1.236.50 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 171328 ms 0 KB 0 KB 192.168.18.188 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 190281 ms 0 KB 0 KB 10.2.124.104 10.100.5.237 GET /spms/pages/kpiUpload/appraisal_score_summary.jsp HTTP/1.1
S 183453 ms 0 KB 0 KB 58.23.17.11 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 183625 ms 0 KB 0 KB 57.116.8.48 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 185188 ms 0 KB 0 KB 10.0.176.211 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 159938 ms 0 KB 0 KB 57.46.17.34 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 166781 ms 0 KB 0 KB 10.13.5.217 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 160031 ms 0 KB 0 KB 10.0.156.232 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 159844 ms 0 KB 0 KB 10.18.14.179 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 158156 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 151953 ms 0 KB 0 KB 10.3.40.150 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 155734 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 150859 ms 0 KB 0 KB 10.3.40.150 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 148609 ms 0 KB 0 KB 10.0.160.15 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepage2.jsp HTTP/1.1
S 146859 ms 0 KB 0 KB 10.11.10.2 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 149156 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraisepage1.jsp?appraiseeEmployeeId=A05487&appraisalExerciseId=1&appraisalId=513&appraisalPartNo=1&mgtCadreId=1 HTTP/1.1
S 132922 ms 0 KB 0 KB 57.46.17.34 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 135047 ms 0 KB 0 KB 10.1.236.50 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 143391 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 140250 ms 0 KB 0 KB 57.46.17.34 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 137953 ms 0 KB 0 KB 10.11.10.2 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 134047 ms 0 KB 0 KB 10.11.10.2 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 134672 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 134188 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 127172 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraise.jsp HTTP/1.1
S 71703 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 104875 ms 0 KB 0 KB 10.0.176.211 10.100.5.237 GET /spms/pages/loginhelper.jsp HTTP/1.1
S 115766 ms 0 KB 0 KB 57.110.17.200 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 104953 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 116469 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 94188 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 127579 ms 0 KB 0 KB 57.110.17.200 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 125032 ms 0 KB 0 KB 10.0.176.211 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 109188 ms 0 KB 2 KB 10.100.2.190 10.100.5.237 POST /spms/pages/appraisal/appraisalinitiatepost.jsp HTTP/1.1
S 113719 ms 0 KB 0 KB 57.63.17.43 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 82391 ms 0 KB 0 KB 10.1.208.250 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 32391 ms 0 KB 0 KB 57.29.17.21 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 99766 ms 0 KB 0 KB 58.48.17.37 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 67500 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 101625 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 79985 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraise.jsp HTTP/1.1
S 78297 ms 0 KB 0 KB 10.11.11.14 10.100.5.237 GET /spms/pages/appraisal/appraisalappraisepage1.jsp?appraiseeEmployeeId=A01968&appraisalExerciseId=1&appraisalId=739&appraisalPartNo=1&mgtCadreId=1 HTTP/1.1
S 68641 ms 0 KB 0 KB 10.11.10.171 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 72563 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
R ? ? ? ? ? ?
S 16860 ms 0 KB 0 KB 10.13.10.105 10.100.5.237 GET /spms/pages/appraisal/appraisalinitiate.jsp HTTP/1.1
S 37813 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 31469 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 39000 ms 0 KB 0 KB 10.11.10.52 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 32469 ms 0 KB 4 KB 10.11.11.14 10.100.5.237 POST /spms/pages/appraisal/appraisalappraisepost.jsp HTTP/1.1
S 38187 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 35844 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 38515 ms 0 KB 0 KB 10.11.10.52 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 51828 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraise.jsp HTTP/1.1
S 49172 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 45594 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 53515 ms 0 KB 0 KB 192.168.7.79 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 27078 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
R ? ? ? ? ? ?
S 13922 ms 0 KB 0 KB 57.34.17.17 10.100.5.237 GET /spms/pages/appraisal/appraisalappraise.jsp HTTP/1.1
S 4203 ms 0 KB 0 KB 192.168.1.29 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
R ? ? ? ? ? ?
R ? ? ? ? ? ?
S 7344 ms 0 KB 0 KB 10.100.2.190 10.100.5.237 POST /spms/pages/j_security_check HTTP/1.1
S 78 ms 24 KB 0 KB 10.100.2.190 10.100.5.237 GET /manager/status/all HTTP/1.1

P: Parse and prepare request S: Service F: Finishing R: Ready K: Keepalive

ajp-8009
Max threads: 40 Min spare threads: 0 Max spare threads: 0 Current thread count: 1 Current thread busy: 1 Keeped alive sockets count: 0
Max processing time: 0 ms Processing time: 0.0 s Request count: 0 Error count: 0 Bytes received: 0.00 MB Bytes sent: 0.00 MB

Stage Time B Sent B Recv Client VHost Request

P: Parse and prepare request S: Service F: Finishing R: Ready K: Keepalive

Application list
[ January 05, 2007: Message edited by: Bear Bibeault ]

Performance is Everything!
William Brogden
Author and all-around good cowpoke
Rancher

Joined: Mar 22, 2000
Posts: 12786
    
    5
Look at those Thread run times - over 300 seconds in some cases - everything is hanging waiting for some process to complete. You need to figure out some way to abort the request if the security check or whatever takes too long or the critical service is not available.

I had something very similar happen to me when an "orphan" web app made a request for a service that was no longer there.

Bill
Bear Bibeault
Author and ninkuma
Marshal

Joined: Jan 10, 2002
Posts: 61218
    
  66

Please read this regarding plastering URGENT all over your post.

I have removevd it from your title.

Also, please refrain from posting in all uppercase.
[ January 05, 2007: Message edited by: Bear Bibeault ]

[Asking smart questions] [Bear's FrontMan] [About Bear] [Books by Bear]
 
I agree. Here's the link: http://aspose.com/file-tools
 
subject: Tomcat is getting killed intermittently