Win a copy of Think Java: How to Think Like a Computer Scientist this week in the Java in General forum!
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic

Tomcat performance problems

 
sammaiah kyatham
Ranch Hand
Posts: 104
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Hi All,
Iam using Tomcat to run my server side application in production environment.Iam using thick client and Tomcat contains 2 web applications called as CLFEngine and Jags,

Iam finding lots of problems in production environment which are not replicated in testing environment.Can any body suggest, whether it is tomcat performace problem or my application problem by looking at the below information:

Complete Server Status:
-----------------------

Server Information
Tomcat Version JVM Version JVM Vendor OS Name OS Version OS Architecture
Apache Tomcat/5.0.28 1.4.2_07-b05 Sun Microsystems Inc. Windows 2003 5.2 x86


JVM
Free memory: 141.83 MB Total memory: 253.18 MB Max memory: 506.31 MB

http-8080
Max threads: 150 Min spare threads: 25 Max spare threads: 75 Current thread count: 25 Current thread busy: 6
Max processing time: 278843 ms Processing time: 7920 s Request count: 21543 Error count: 1 Bytes received: 17.08 MB Bytes sent: 22.41 MB


P: Parse and prepare request S: Service F: Finishing R: Ready K: Keepalive

jk-8009
Max threads: 200 Min spare threads: 4 Max spare threads: 50 Current thread count: 4 Current thread busy: 1
Max processing time: 0 ms Processing time: 0 s Request count: 0 Error count: 0 Bytes received: 0.00 MB Bytes sent: 0.00 MB

Stage Time B Sent B Recv Client VHost Request

P: Parse and prepare request S: Service F: Finishing R: Ready K: Keepalive

Application list
localhost/
localhost/admin
localhost/jags2vs
localhost/balancer
localhost/manager
localhost/jags2
localhost/clfenginevs

localhost/
Startup time: 16 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

org.apache.jsp.index_jsp [ /index.jsp ]
Processing time: 0 s Max time: 62 ms Request count: 1 Error count: 0 Load time: 31 ms Classloading time: 31 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 3 Error count: 0 Load time: 0 ms Classloading time: 0 ms

localhost/admin
Startup time: 47 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

admin.server.server_jsp [ /server/server.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.host.hosts_jsp [ /host/hosts.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.valve.remoteAddrValve_jsp [ /valve/remoteAddrValve.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.listUsers_jsp [ /users/listUsers.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.role_jsp [ /users/role.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.frameset_jsp [ /frameset.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.savefail_jsp [ /savefail.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

action [ *.do ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 1609 ms Classloading time: 15 ms

admin.index_jsp [ /index.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.listDataSources_jsp [ /resources/listDataSources.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.listResourceLinks_jsp [ /resources/listResourceLinks.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.service.service_jsp [ /service/service.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.userDatabase_jsp [ /resources/userDatabase.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.group_jsp [ /users/group.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.deleteEnvEntries_jsp [ /resources/deleteEnvEntries.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.header_jsp [ /users/header.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.dumpServer_jsp [ /dumpServer.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.login_jsp [ /login.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.listUserDatabases_jsp [ /resources/listUserDatabases.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.context.contexts_jsp [ /context/contexts.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.error_jsp [ /error.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.buttons_jsp [ /buttons.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.logger.loggers_jsp [ /logger/loggers.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.tree_002dcontrol_002dtest_jsp [ /tree-control-test.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.realm.memoryRealm_jsp [ /realm/memoryRealm.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.valve.accessLogValve_jsp [ /valve/accessLogValve.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.realm.jdbcRealm_jsp [ /realm/jdbcRealm.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.listMailSessions_jsp [ /resources/listMailSessions.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.user_jsp [ /users/user.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.valve.valves_jsp [ /valve/valves.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.banner_jsp [ /banner.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.mailSession_jsp [ /resources/mailSession.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.deleteDataSources_jsp [ /resources/deleteDataSources.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.host.host_jsp [ /host/host.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.valve.singleSignOnValve_jsp [ /valve/singleSignOnValve.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.footer_jsp [ /footer.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.defaultcontext.defaultcontext_jsp [ /defaultcontext/defaultcontext.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.realm.dataSourceRealm_jsp [ /realm/dataSourceRealm.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.realm.realms_jsp [ /realm/realms.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.dumpRegistry_jsp [ /dumpRegistry.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.service.services_jsp [ /service/services.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.header_jsp [ /header.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.host.alias_jsp [ /host/alias.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.host.aliases_jsp [ /host/aliases.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.blank_jsp [ /blank.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.realm.userDatabaseRealm_jsp [ /realm/userDatabaseRealm.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.deleteUsers_jsp [ /users/deleteUsers.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.logger.logger_jsp [ /logger/logger.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.context.context_jsp [ /context/context.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.deleteMailSessions_jsp [ /resources/deleteMailSessions.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.listEnvEntries_jsp [ /resources/listEnvEntries.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.footer_jsp [ /users/footer.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.listRoles_jsp [ /users/listRoles.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.valve.requestDumperValve_jsp [ /valve/requestDumperValve.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.connector.connectors_jsp [ /connector/connectors.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.resourceLink_jsp [ /resources/resourceLink.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.realm.jndiRealm_jsp [ /realm/jndiRealm.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.listGroups_jsp [ /users/listGroups.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.deleteResourceLinks_jsp [ /resources/deleteResourceLinks.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.dataSource_jsp [ /resources/dataSource.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.saved_jsp [ /saved.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.deleteGroups_jsp [ /users/deleteGroups.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.users.deleteRoles_jsp [ /users/deleteRoles.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.connector.connector_jsp [ /connector/connector.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.deleteUserDatabases_jsp [ /resources/deleteUserDatabases.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.resources.envEntry_jsp [ /resources/envEntry.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

admin.valve.remoteHostValve_jsp [ /valve/remoteHostValve.jsp ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

localhost/jags2vs
Startup time: 0 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

VSServlet [ /vsservlet ]
Processing time: 2647 s Max time: 30265 ms Request count: 7039 Error count: 0 Load time: 922 ms Classloading time: 203 ms

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

localhost/balancer
Startup time: 16 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

localhost/manager
Startup time: 16 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

JMXProxy [ /jmxproxy/* ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 2 Error count: 0 Load time: 0 ms Classloading time: 0 ms

HTMLManager [ /html/* ]
Processing time: 0 s Max time: 63 ms Request count: 1 Error count: 0 Load time: 47 ms Classloading time: 47 ms

Status [ /status/* ]
Processing time: 0 s Max time: 16 ms Request count: 2 Error count: 0 Load time: 0 ms Classloading time: 0 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

Manager [ /list , /sessions , /start , /stop , /install , /remove , /deploy , /undeploy , /reload , /save , /serverinfo , /roles , /resources ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

localhost/jags2
Startup time: 0 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

VSServlet [ /vsservlet ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 0 ms Classloading time: 0 ms

localhost/clfenginevs
Startup time: 31 ms TLD scan time: 0 ms
Active sessions: 0 Session count: 0 Max active sessions: 0 Rejected session creations: 0 Expired sessions: 0 Processing time: 0 ms
JSPs loaded: 0 JSPs reloaded: 0

default [ / ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 46 ms Classloading time: 46 ms

jsp [ *.jsp , *.jspx ]
Processing time: 0 s Max time: 0 ms Request count: 0 Error count: 0 Load time: 47 ms Classloading time: 0 ms

CLFServiceRouterVS [ /CLFServiceRouterVS ]
Processing time: 5266 s Max time: 278843 ms Request count: 14497 Error count: 0 Load time: 3563 ms Classloading time: 32 ms
 
William Brogden
Author and all-around good cowpoke
Rancher
Posts: 13061
6
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
CLFServiceRouterVS [ /CLFServiceRouterVS ]
Processing time: 5266 s Max time: 278843 ms Request count: 14497 Error count: 0 Load time: 3563 ms Classloading time: 32 ms

It appears that the average request is handled pretty quickly but at least one took a reallllly long time. Memory and number of threads looks fine.
Does this application use some external resource such as a database connection?
Bill
 
sammaiah kyatham
Ranch Hand
Posts: 104
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Yes this application uses external hosts owned by some other.

Thanks,
sam
 
William Brogden
Author and all-around good cowpoke
Rancher
Posts: 13061
6
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Yes this application uses external hosts owned by some other.

That suggests that the production environment has major delays in these other resources. Plugging in some JAmon timing statements in the area that uses these other resources would be a good start on locating the problems.
A starting point for the open source JAmon toolkit.
 
Sumit Chachra
Greenhorn
Posts: 4
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Any solutions to this problem ?
 
Sumit Chachra
Greenhorn
Posts: 4
 
Ben Souther
Sheriff
Posts: 13411
Firefox Browser Redhat VI Editor
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Originally posted by Sumit Chachra:
Any solutions to this problem ?


Did you read William Brogden's last post?
 
Ben Souther
Sheriff
Posts: 13411
Firefox Browser Redhat VI Editor
  • Mark post as helpful
  • send pies
  • Quote
  • Report post to moderator
Originally posted by Sumit Chachra:
Was the solution this: http://ferret.wrc.noaa.gov/mail_archives/las_users/fu_2004/msg00234.html ??


This link describes Tomcat hanging on Redhat9.
It has nothing to do with the problem described in this thread.
 
  • Post Reply
  • Bookmark Topic Watch Topic
  • New Topic