Tomcat Service can not be started when System user is trying to start it gives EXCEPTION_ACCESS_VIOL

[anushka vaze]

We have an application deployed on Windows 2008 R2 and Tomcat 5 and and JAVA 1.5.11
When we start the application service from the Windows services manager it can not be restarted and it gives EXCEPTION_ACCESS_VIOLATION error in tomcat logs.
The log is as follows:


#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x6d641e63, pid=2944, tid=3968
#
# Java VM: Java HotSpot(TM) Client VM (1.5.0_11-b03 mixed mode)
# Problematic frame:
# V [jvm.dll+0x1e63]
#

--------------- T H R E A D ---------------

Current thread (0x00fdffa0): ConcurrentMarkSweepThread [id=3968]

siginfo: ExceptionCode=0xc0000005, reading address 0x0000005a

Registers:
EAX=0x0000000a, EBX=0x00003700, ECX=0x039a0018, EDX=0x039a0018
ESP=0x5e7efc04, EBP=0x5e7efcbc, ESI=0x039a0000, EDI=0x5e7efd4c
EIP=0x6d641e63, EFLAGS=0x00010246

Top of Stack: (sp=0x5e7efc04)
0x5e7efc04: 039a0000 039a0000 6d69ee26 039a0018
0x5e7efc14: 039a0000 039a0000 6d692f74 039a0000
0x5e7efc24: 039a0000 00003700 0000006e 00fdfca0
0x5e7efc34: 6d7742ec 6d69cef4 039a0000 00003700
0x5e7efc44: 5e7efd4c 00000000 00fdfca0 00000001
0x5e7efc54: 00fdffa0 00fdfa78 00fe0458 00fe0460
0x5e7efc64: 00fe084c 00fdfa98 00000001 00ff3078
0x5e7efc74: 00fdfd20 00000000 00fe2978 00fe0058

Instructions: (pc=0x6d641e63)
0x6d641e53: 07 c1 e8 02 25 fe ff ff 3f eb 08 8b 02 56 8b ca
0x6d641e63: ff 50 50 5e c2 04 00 e9 00 00 00 00 a1 00 58 7b


Stack: [0x5e7b0000,0x5e7f0000), sp=0x5e7efc04, free space=255k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [jvm.dll+0x1e63]
V [jvm.dll+0x5c9b2]
V [jvm.dll+0x5c620]
V [jvm.dll+0x5b429]
V [jvm.dll+0x6063c]
V [jvm.dll+0xdcb33]
C [MSVCRT.dll+0x22599]
C [MSVCRT.dll+0x226b3]
C [kernel32.dll+0x8eccb]
C [ntdll.dll+0x7d819]
C [ntdll.dll+0x7da2b]


--------------- P R O C E S S ---------------

Java Threads: ( => current thread )
0x5e87ee98 JavaThread "Thread-1" [_thread_in_vm, id=4844]
0x5e812708 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=608]
0x0105fd48 JavaThread "CompilerThread0" daemon [_thread_blocked, id=3680]
0x5e809d40 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=4344]
0x0105fbc0 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=5048]
0x010597e0 JavaThread "Finalizer" daemon [_thread_blocked, id=3132]
0x01058a18 JavaThread "Reference Handler" daemon [_thread_blocked, id=3936]
0x0018c428 JavaThread "main" [_thread_in_native, id=4896]

Other Threads:
0x5e8019a0 VMThread [id=2132]
0x00fddf10 WatcherThread [id=3752]

VM state:not at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00183f10/0x000001e4] Heap_lock - owner thread: 0x5e87ee98

Heap
par new generation total 8128K, used 8588K [0x031a0000, 0x039a0000, 0x039a0000)
eden space 8064K, 106% used [0x031a0000, 0x03a03020, 0x03980000)
from space 64K, 0% used [0x03980000, 0x03980000, 0x03990000)
to space 64K, 0% used [0x03990000, 0x03990000, 0x039a0000)
concurrent mark-sweep generation total 253952K, used 0K [0x039a0000, 0x131a0000, 0x531a0000)
concurrent-mark-sweep perm gen total 8192K, used 3982K [0x531a0000, 0x539a0000, 0x5b1a0000)

Dynamic libraries:
0x00400000 - 0x0040e000 D:\infra_apps\BMC Software\CWA\apache-tomcat\bin\tomcat5.exe
0x77c20000 - 0x77d80000 C:\Windows\SysWOW64\ntdll.dll
0x77750000 - 0x77860000 C:\Windows\syswow64\kernel32.dll
0x76ee0000 - 0x76fb0000 C:\Windows\syswow64\USER32.dll
0x773c0000 - 0x77450000 C:\Windows\syswow64\GDI32.dll
0x76040000 - 0x76106000 C:\Windows\syswow64\ADVAPI32.dll
0x77170000 - 0x77260000 C:\Windows\syswow64\RPCRT4.dll
0x75da0000 - 0x75e00000 C:\Windows\syswow64\Secur32.dll
0x75f90000 - 0x7603a000 C:\Windows\syswow64\MSVCRT.dll
0x76300000 - 0x76e11000 C:\Windows\syswow64\SHELL32.dll
0x77570000 - 0x775c9000 C:\Windows\syswow64\SHLWAPI.dll
0x75f30000 - 0x75f90000 C:\Windows\system32\IMM32.DLL
0x77450000 - 0x77518000 C:\Windows\syswow64\MSCTF.dll
0x75e90000 - 0x75e99000 C:\Windows\syswow64\LPK.DLL
0x77260000 - 0x772dd000 C:\Windows\syswow64\USP10.dll
0x756b0000 - 0x7584e000 C:\Windows\WinSxS\x86_microsoft.windows.common-controls_6595b64144ccf1df_6.0.6002.18305_none_5cb72f2a088b0ed3\comctl32.dll
0x6d640000 - 0x6d7dd000 D:\infra_apps\BMC Software\CWA\jre1.5.0\bin\client\jvm.dll
0x729d0000 - 0x72a02000 C:\Windows\system32\WINMM.dll
0x775d0000 - 0x77715000 C:\Windows\syswow64\ole32.dll
0x75ea0000 - 0x75f2d000 C:\Windows\syswow64\OLEAUT32.dll
0x727b0000 - 0x727ee000 C:\Windows\system32\OLEACC.dll
0x74610000 - 0x7463c000 C:\Windows\system32\apphelp.dll
0x6d290000 - 0x6d298000 D:\infra_apps\BMC Software\CWA\jre1.5.0\bin\hpi.dll
0x76160000 - 0x76167000 C:\Windows\syswow64\PSAPI.DLL
0x6d610000 - 0x6d61c000 D:\infra_apps\BMC Software\CWA\jre1.5.0\bin\verify.dll
0x6d310000 - 0x6d32d000 D:\infra_apps\BMC Software\CWA\jre1.5.0\bin\java.dll
0x6d630000 - 0x6d63f000 D:\infra_apps\BMC Software\CWA\jre1.5.0\bin\zip.dll
0x76170000 - 0x762fa000 C:\Windows\syswow64\SETUPAPI.dll

VM Arguments:
jvm_args: -Dcatalina.base=D:\infra_apps\BMC Software\CWA\apache-tomcat -Dcatalina.home=D:\infra_apps\BMC Software\CWA\apache-tomcat -Djava.endorsed.dirs=D:\infra_apps\BMC Software\CWA\apache-tomcat\common\endorsed -Xms256m -Xmx1280m -XX:MaxPermSize=128m -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+UseTLAB -XX:+CMSIncrementalMode -XX:+CMSIncrementalPacing -XX:CMSIncrementalDutyCycleMin=0 -XX:CMSIncrementalDutyCycle=10 -XX:MaxTenuringThreshold=0 -XX:SurvivorRatio=256 -XX:CMSInitiatingOccupancyFraction=60 -XX:+DisableExplicitGC -Dmtfile.path=D:\infra_apps\BMC Software\CWA\apache-tomcat\webapps\qtv\mgroup\MetricTable.mgt -Djava.security.auth.login.config=D:\infra_apps\BMC Software\CWA\apache-tomcat\conf\login.config -Djava.io.tmpdir=D:\infra_apps\BMC Software\CWA\apache-tomcat\temp vfprintf
java_command: <unknown>
Launcher Type: generic

Environment Variables:
JAVA_HOME=D:\infra_apps\BMC Software\CWA\jre1.5.0\bin
PATH=D:\infra_apps\BMC Software\CWA\apache-tomcat\shared\lib
USERNAME=CPPWRCF2$
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 26 Stepping 5, GenuineIntel



--------------- S Y S T E M ---------------

OS: Windows Vista Build 6002 Service Pack 2

CPU:total 2 (cores per cpu 1, threads per core 1) family 6 model 10 stepping 5, cmov, cx8, fxsr, mmx, sse, sse2

Memory: 4k page, physical 4192868k(2719232k free), swap 4194303k(4194303k free)

vm_info: Java HotSpot(TM) Client VM (1.5.0_11-b03) for windows-x86, built on Dec 15 2006 01:16:12 by "java_re" with MS VC++ 6.0

We tried to increase java ots setting and also PermGen size to 256 but the Problem still persists.
The tomcat restart happens after frequent trials but it does not start as such.

While going through JVM dump logs, what we found out that "eden space" (i.e., new Garbage collector) in cases of this specific scenario running service as system service, it is not able to inflate the assigned memory to start garbage collection.

Searching for: eden space
hs_err_pid2084.log(71): eden space 3968K, 116% used [0x02aa0000, 0x02f27dc0, 0x02e80000)
hs_err_pid2100.log(71): eden space 3968K, 120% used [0x02aa0000, 0x02f4baf0, 0x02e80000)
hs_err_pid2372.log(72): eden space 3968K, 115% used [0x02aa0000, 0x02f194e8, 0x02e80000)
hs_err_pid2668.log(71): eden space 3968K, 116% used [0x02aa0000, 0x02f21758, 0x02e80000)
hs_err_pid2708.log(72): eden space 3968K, 117% used [0x02aa0000, 0x02f2cd38, 0x02e80000)
hs_err_pid2836.log(71): eden space 3968K, 116% used [0x02aa0000, 0x02f21340, 0x02e80000)
hs_err_pid2856.log(71): eden space 3968K, 114% used [0x02aa0000, 0x02f14818, 0x02e80000)
hs_err_pid2896.log(72): eden space 3968K, 134% used [0x02aa0000, 0x02fd2fc0, 0x02e80000)
hs_err_pid292.log(71): eden space 3968K, 118% used [0x02aa0000, 0x02f36018, 0x02e80000)
hs_err_pid2940.log(71): eden space 3968K, 117% used [0x02aa0000, 0x02f321d0, 0x02e80000)
hs_err_pid3008.log(71): eden space 3968K, 118% used [0x02aa0000, 0x02f3c3e8, 0x02e80000)
hs_err_pid3060.log(71): eden space 3968K, 117% used [0x02aa0000, 0x02f2c938, 0x02e80000)
hs_err_pid3112.log(71): eden space 3968K, 110% used [0x02aa0000, 0x02eebac8, 0x02e80000)
hs_err_pid3308.log(71): eden space 3968K, 143% used [0x02aa0000, 0x0302df80, 0x02e80000)
hs_err_pid3372.log(71): eden space 3968K, 119% used [0x02aa0000, 0x02f406d8, 0x02e80000)
hs_err_pid3460.log(71): eden space 3968K, 117% used [0x02aa0000, 0x02f2cd38, 0x02e80000)
hs_err_pid3764.log(71): eden space 3968K, 114% used [0x02aa0000, 0x02f14818, 0x02e80000)
hs_err_pid3880.log(71): eden space 3968K, 117% used [0x02aa0000, 0x02f2e1a8, 0x02e80000)
Found 18 occurrence(s) in 18 file(s)

[Maneesh Godbole]

Please do not post, essentially the same question multiple times. Let us continue the discussion in your original topic http://www.coderanch.com/t/578934/java/java/EXCEPTION-ACCESS-VIOLATION