Help understanding JVM Crash Dump file

[Sri Harsha Yenuganti]

I am using JNI to run some native code from Java. The code runs fine in Windows XP system. When i port the code to Linux and try running it there, It runs perfectly for 2-3 times. And after that it crashes. This crash is so random that it crashes the first time sometimes. Sometimes it works for 2-3 times and then crashes.

As the code is running fine for some time, the problem may be with the memory.

My Java Memory Arguments are "-Xms 768m -Xmx1024m".
Java Version : 1.6.0_12 and I am running my application in Weblogic 11g.

Every time it crashes, it gives me a JVM crash dump file, from which I am not able to decode the problem.

Here is the latest crash dump file:

#
# An unexpected error has been detected by Java Runtime Environment:
#
# SIGSEGV (0xb) at pc=0x0000002a995c0700, pid=10275, tid=1078122848
#
# Java VM: Java HotSpot(TM) 64-Bit Server VM (11.2-b01 mixed mode linux-amd64)
# Problematic frame:
# C 0x0000002a995c0700
#
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
#

T H R E A D

Current thread (0x000000004011fc00): GCTaskThread [stack: 0x000000004032d000,0x000000004042e000] [id=10278]

siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x0000000000000000

..............
........
.....
.
.
.


Instructions: (pc=0x0000002a995c0700)
0x0000002a995c06f0: c0 03 5c 99 2a 00 00 00 02 00 5b 43 00 00 00 00
0x0000002a995c0700: 01 00 00 00 00 00 00 00 00 03 5c 99 2a 00 00 00 

Stack: [0x000000004032d000,0x000000004042e000], sp=0x000000004042cde8, free space=1023k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C 0x0000002a995c0700
V [libjvm.so+0x529714]
V [libjvm.so+0x52c857]
V [libjvm.so+0x2c10aa]
V [libjvm.so+0x4e310a]
C [libpthread.so.0+0x6137]
C 0x0000000000000000


P R O C E S S

Java Threads: ( => current thread )

0x0000002aef098400 JavaThread "weblogic.GCMonitor" daemon [_thread_blocked, id=10328, stack(0x000000004305a000,0x000000004315b000)]
0x0000002aeecd8800 JavaThread "weblogic.cluster.MessageReceiver" daemon [_thread_in_native, id=10326, stack(0x0000000042f59000,0x000000004305a000)]
0x0000002aeec4cc00 JavaThread "Thread-15" daemon [_thread_blocked, id=10320, stack(0x0000000042953000,0x0000000042a54000)]
0x0000002af1554800 JavaThread "DefaultQuartzScheduler_QuartzSchedulerThread" [_thread_blocked, id=10319, stack(0x0000000042852000,0x0000000042953000)]
0x0000002af174b400 JavaThread "Timer-2" daemon [_thread_blocked, id=10303, stack(0x0000000041842000,0x0000000041943000)]
0x0000002af1446800 JavaThread "LDAPConnThread-0 ldap://146.18.89.205:8001" daemon [_thread_in_native, id=10302, stack(0x0000000041741000,0x0000000041842000)]
0x0000002aef2e7000 JavaThread "Thread-11" daemon [_thread_blocked, id=10298, stack(0x0000000041640000,0x0000000041741000)]
0x0000002aeebfd400 JavaThread "[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=10297, stack(0x000000004143e000,0x000000004153f000)]
0x0000002aef591800 JavaThread "DoSManager" daemon [_thread_blocked, id=10296, stack(0x000000004153f000,0x0000000041640000)]
0x0000002aed0f7800 JavaThread "VDE Transaction Processor Thread" daemon [_thread_blocked, id=10294, stack(0x000000004133d000,0x000000004143e000)]
0x0000002aecede400 JavaThread "[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=10293, stack(0x000000004123c000,0x000000004133d000)]
0x0000002aefd87800 JavaThread "Thread-7" daemon [_thread_blocked, id=10292, stack(0x000000004113b000,0x000000004123c000)]
0x0000002aed0ce800 JavaThread "weblogic.timers.TimerThread" daemon [_thread_blocked, id=10291, stack(0x000000004103a000,0x000000004113b000)]
0x0000002aef339400 JavaThread "weblogic.time.TimeEventGenerator" daemon [_thread_blocked, id=10290, stack(0x0000000040f39000,0x000000004103a000)]
0x0000002aef338800 JavaThread "[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=10289, stack(0x0000000040e38000,0x0000000040f39000)]
0x0000002aecb27400 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=10285, stack(0x0000000040a34000,0x0000000040b35000)]
0x0000002aecb24800 JavaThread "CompilerThread1" daemon [_thread_blocked, id=10284, stack(0x0000000040933000,0x0000000040a34000)]
0x0000002ae9b3ec00 JavaThread "CompilerThread0" daemon [_thread_blocked, id=10283, stack(0x0000000040832000,0x0000000040933000)]
0x0000002ae9b3cc00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=10282, stack(0x0000000040731000,0x0000000040832000)]
0x0000002ae9b21c00 JavaThread "Finalizer" daemon [_thread_blocked, id=10281, stack(0x0000000040630000,0x0000000040731000)]
0x0000002ae9b20000 JavaThread "Reference Handler" daemon [_thread_blocked, id=10280, stack(0x000000004052f000,0x0000000040630000)]
0x0000000040113800 JavaThread "main" [_thread_blocked, id=10276, stack(0x000000004012b000,0x000000004022c000)]

Other Threads:
0x0000002ae9b1a800 VMThread [stack: 0x000000004042e000,0x000000004052f000] [id=10279]
0x0000002aecb29400 WatcherThread [stack: 0x0000000040b35000,0x0000000040c36000] [id=10286]

=>0x000000004011fc00 (exited) GCTaskThread [stack: 0x000000004032d000,0x000000004042e000] [id=10278]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x0000000040111500] UNKNOWN - owner thread: 0x0000002ae9b1a800
[0x0000000040111aa0] UNKNOWN - owner thread: 0x0000002aefe3a400

Heap
PSYoungGen total 283200K, used 283198K [0x0000002ad4070000, 0x0000002ae95c0000, 0x0000002ae95c0000)
eden space 250432K, 100% used [0x0000002ad4070000,0x0000002ae3500000,0x0000002ae3500000)
from space 32768K, 99% used [0x0000002ae75c0000,0x0000002ae95bf908,0x0000002ae95c0000)
to space 49536K, 20% used [0x0000002ae3500000,0x0000002ae3ebb0b0,0x0000002ae6560000)
PSOldGen total 524288K, used 40121K [0x0000002aa95c0000, 0x0000002ac95c0000, 0x0000002ad4070000)
object space 524288K, 7% used [0x0000002aa95c0000,0x0000002aabcee450,0x0000002ac95c0000)
PSPermGen total 104192K, used 104177K [0x0000002a995c0000, 0x0000002a9fb80000, 0x0000002aa95c0000)
object space 104192K, 99% used [0x0000002a995c0000,0x0000002a9fb7c4b8,0x0000002a9fb80000)

..........
..................

S Y S T E M

OS:Red Hat Enterprise Linux AS release 4 (Nahant Update 5)

uname:Linux 2.6.9-55.ELsmp #1 SMP Fri Apr 20 16:36:54 EDT 2007 x86_64
libc:glibc 2.3.4 NPTL 2.3.4 
rlimit: STACK 10240k, CORE 0k, NPROC 38911, NOFILE 1024, AS infinity
load average:0.00 0.00 0.00

CPU:total 2 (2 cores per cpu, 1 threads per core) family 6 model 15 stepping 11, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3

Memory: 4k page, physical 4040084k(2407856k free), swap 10485592k(10485592k free)

vm_info: Java HotSpot(TM) 64-Bit Server VM (11.2-b01) for linux-amd64 JRE (1.6.0_12-b04), built on Jan 17 2009 01:04:06 by "java_re" with gcc 3.2.2 (SuSE Linux)

time: Fri Aug 27 16:01:25 2010
elapsed time: 1211 seconds

Can anyone help me to locate the reason for these random crashes ? Is the problem with Heap Memory as some of the statics say the memory space is 99% used ?