[jira] [Updated] (ASTERIXDB-1788) JVM crash on AWS t2.micro instance

[Yingyi Bu (JIRA)]

     [ 
https://issues.apache.org/jira/browse/ASTERIXDB-1788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Yingyi Bu updated ASTERIXDB-1788:
---------------------------------
    Description: 
I have a 2-node AsterixDB instance on AWS, using the t2.micro configuration (1 
vcore + 1GB RAM + 8GB EBS disk). CCDriver runs on the same node with one 
NCDriver.  I load tpch datasets with scale factor of 0.2 into the instance, 
i.e., 200MB data in total.  

JVM crashes when queries are running.  Two JVM crash logs are attached.

Here are the crash dump files:

cat /tmp/hsperfdata_ec2-user/3265
{noformat}
????p>?/? 
?8J0sun.rt._sync_Inflationsk8J0sun.rt._sync_Deflations]@J8sun.rt._sync_ContendedLockAttempts?b8J0sun.rt._sync_FutileWakeups?0J(sun.rt._sync_Parks?@j8sun.rt._sync_emptynotifications8j0sun.rt._sync_notificationsv8j0sun.rt._sync_slowenter8j0sun.rt._sync_slowexit8j0sun.rt._sync_slownotify8j0sun.rt._sync_slownotifyall8j0sun.rt._sync_failedsp...@j8sun.rt._sync_successfulspins8j0sun.rt._sync_privatea8j0sun.rt._sync_priva...@j8sun.rt._sync_MonInCirculation8J0sun.rt._sync_MonScavenged8J0sun.rt._sync_MonExtant8J0sun.rt.createVmBeginTime?7A*Z8J0sun.rt.createVmEndTime?7A*Z8J0sun.rt.vmInitDoneTime?7A*Z8J0java.threads.startedK0J(java.threads.live8J0java.threads.livePeak0J(java.threads.daemon8J0sun.rt.safepointSyncTime?0J(sun.rt.safepoints48J0sun.rt.safepointTime?N58J0sun.rt.applicationTimeF3???0J(su...@j8sun.rt.threadinterruptsignaled8j0sun.rt.interruptedbeforeio8j0sun.rt.interruptedDuringIOpAB+sun.rt.jvmCapabilities11000000000000000000000000000000000000000000000000000000000000008J0java.cls.loadedClasses?8j0java.cls.unloadedclas...@j8java.cls.sharedloadedclas...@j8java.cls.sharedUnloadedClasses0J(sun.cls.loadedBytesH?{8J0sun.cls.unloadedBytesx?8J0sun.cls.sharedLoadedBytes8J0sun.cls.sharedUnloadedBJ0sun.cls.classVerifyTime/vZ'@J8sun.cls.classVerifyTime.self݇?assInitTime??TB8J0sun.cls.classInitTime.self8)?
8J0sun.cls.linkedClasses?8J0sun.cls.verifiedClasses?8J0sun.cls.parseClassTime??G8J0sun.cls.parseClassTime.self?߫8J0sun.cls.lookupSysClassTime?8J0sun.cls.sharedClassLoadTime?8J0sun.cls.sysClassLoadTime??8J0sun.cls.appClassLoadTime???_...@j8sun.cls.appclassloadtime.self???<8J0sun.cls.appClassLoadCount?
                                                                                
               8J0sun.cls.defineAppClassesf
                                                                                
                                           
8J0sun.cls.defineAppClassTime??@J8sun.cls.defineAppClassTime.self??8J0sun.cls.appClassBytes5?8J0sun.cls.sysClassBytes??o...@sun.cls.systemloaderlockcontentionrat...@sun.cls.nonsystemloaderlockcontentionrat...@sun.cls.jvmFindLoadedClassNoLockCalls?@J8sun.cls.jvmDefineClassNoLockCallsc
  
@j8sun.cls.jnidefineclassnolockc...@j8sun.cls.unsafedefineclasscal...@j8sun.cls.isunsyncloadclass...@j8sun.cls.loadInstanceClassFailRatexQB!sun.gc.causeNo
 GCxQB%sun.gc.lastCauseAllocation 
failur...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.01??(h...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes...@j8sun.gc.generation.0.agetable.size8b-sun.gc.generation.0.namenew8j0sun.gc.generation.0.spa...@j8sun.gc.generation.0.mincapaci...@j8sun.gc.generation.0.maxCapacityu
                                                                                
                                                                                
                                     @J8sun.gc.generation.0.capacityu
                           
8B,sun.gc.collector.0.namec...@j8sun.gc.collector.0.invocations=8J0sun.gc.collector.0.time???@J8sun.gc.collector.0.lastEntryTime????@J8sun.gc.collector.0.lastExitTime?0??@b5sun.gc.generation.0.space.0.nameede...@sun.gc.generation.0.space.0.maxCapacity?
 h...@sun.gc.generation.0.space.0.capacity?      
@J8sun.gc.generation.0.space.0.used?Z?h...@sun.gc.generation.0.space.0.initcapacity8b5sun.gc.generation.0.space.1.names...@sun.gc.generation.0.space.1.maxCapacity>h...@sun.gc.generation.0.space.1.capacity>@J8sun.gc.generation.0.space.1.used??(h...@sun.gc.generation.0.space.1.initcapacity8b5sun.gc.generation.0.space.2.names...@sun.gc.generation.0.space.2.maxCapacity>h...@sun.gc.generation.0.space.2.capacity>@j8sun.gc.generation.0.space.2.use...@sun.gc.generation.0.space.2.initcapacity8b-sun.gc.generation.1.nameold8j0sun.gc.generation.1.spa...@j8sun.gc.generation.1.minCapacity?@J8sun.gc.generation.1.maxCapacity?@J8sun.gc.generation.1.capacity?0B,sun.gc.collector.1.name...@j8sun.gc.collector.1.invocation8j0sun.gc.collector.1.time
                                                
l...@j8sun.gc.collector.1.lastEntryTimet??m...@j8sun.gc.collector.1.lastExitTime?[l...@b5sun.gc.generation.1.space.0.nameol...@sun.gc.generation.1.space.0.maxCapacity?h...@sun.gc.generation.1.space.0.capacity?@J8sun.gc.generation.1.space.0.used??U
0J(sun.gc.tlab.fills?8J0sun.gc.tlab.maxFills=0J(sun.gc.tlab.alloc9?W0J(sun.gc.tlab.gcWastenX8J0sun.gc.tlab.maxGcWasteM8J0sun.gc.tlab.slowWaste8J0sun.gc.tlab.maxSlowWasteO
                                                                                
                                                                                
          8J0sun.gc.tlab.fastWasteO8J0sun.gc.tlab.maxFastWaste
                    8J0sun.gc.tlab.slowAlloc?8J0sun.gc.tlab.maxSlowAlloc~0      
B'sun.gc.policy.nameCopy:msc8j0sun.gc.policy.collectors8j0sun.gc.policy.generati...@j8sun.gc.policy.maxtenuringthresh...@j8sun.gc.policy.tenuringthresh...@j8sun.gc.policy.desiredSurvivorSize?@j8sun.gc.metaspace.mincapacity8j0sun.gc.metaspace.capaci...@j8sun.gc.metaspace.maxCapacity`A8J0sun.gc.metaspace.used?
g...@sun.gc.compressedclassspace.mincapacit...@sun.gc.compressedclassspace.capacity...@sun.gc.compressedclassspace.maxCapacity@@J8sun.gc.compressedclassspace.used??-8J0sun.threads.vmOperationTime?Q+??b3sun.ci.compilerthread.0.met...@j8sun.ci.compilerthread.0.type@j8sun.ci.compilerthread.0.t...@j8sun.ci.compilerThread.0.compiles???b3sun.ci.compilerthread.1.met...@j8sun.ci.compilerthread.1.type@J8sun.ci.0J(sun.ci.threads0J(java.ci.totalTimeD?^0J(sun.ci.osrTime????0J(sun.ci.standardTime}??8J0sun.ci.totalBailouts8J0sun.ci.totalInvalidates8J0sun.ci.totalCompiles0J(sun.ci.osrCompilesr8J0sun.ci.standardCompiles?0J(sun.ci.osrBytes?18J0sun.ci.standardBytes)p
                                                  
0J(sun.ci.nmethodSizeP??8J0sun.ci.nmethodCodeSize?El??B&sun.ci.lastMethodjava/io/BufferedOutputStream
 
flushBuffer??B,sun.ci.lastFailedMethod??B1sun.ci.lastInvalidatedMethod0J(sun.ci.lastType0J(sun.ci.lastSize8J0sun.ci.lastFailedType8J0sun.ci.lastInvalidatedType8J0sun.os.hrt.frequencyʚ;h...@java.property.java.vm.specification.version1.8`#B=java.property.java.vm.specification.nameJava
 Virtual Machine 
SpecificationXB?java.property.java.vm.specification.vendorOracle Corporation@
                                                                                
                                           
B2java.property.java.vm.version25.121-b13X"B/java.property.java.vm.nameJava 
HotSpot(TM) 64-Bit Server VMHB1java.property.java.vm.vendorOracle Corporation@
                                                                           
B/java.property.java.vm.infomixed 
modex=B4java.property.java.library.path/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib8B2java.property.java.class.path/home/ec2-user/asterixdb/etc:/home/ec2-user/asterixdb/repo/hyracks-util-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/jersey-test-framework-core-1.9.jar:/home/ec2-user/asterixdb/repo/jetty-server-9.3.11.v20160721.jar:/home/ec2-user/asterixdb/repo/grizzly-rcm-2.1.2.jar:/home/ec2-user/asterixdb/repo/hyracks-api-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/slf4j-log4j12-1.7.5.jar:/home/ec2-user/asterixdb/repo/xz-1.0.jar:/home/ec2-user/asterixdb/repo/asterix-lang-common-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/commons-math-2.1.jar:/home/ec2-user/asterixdb/repo/commons-beanutils-1.7.0.jar:/home/ec2-user/asterixdb/repo/asterix-metadata-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/rome-1.0.1-modified-01.jar:/home/ec2-user/asterixdb/repo/asterix-events-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/guava-18.0.jar:/home/ec2-user/asterixdb/repo/hadoop-hdfs-2.2.0.jar:/home/ec2-user/asterixdb/repo/hadoop-mapreduce-client-core-2.2.0.jar:/home/ec2-user/asterixdb/repo/jetty-security-9.3.11.v20160721.jar`(B5java.property.java.endorsed.dirs/usr/java/jdk1.8.0_121/jre/lib/endorsedp>B0java.property.java.ext.dirs/usr/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext@
B/java.property.java.version1.8.0_121H,java.property.java.home/usr/java/jdk1.8.0_121/jre?FB5sun.property.sun.boot.class.path/usr/java/jdk1.8.0_121/jre/lib/resources.jar:/usr/java/jdk1.8.0_121/jre/lib/rt.jar:/usr/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_121/jre/lib/jsse.jar:/usr/java/jdk1.8.0_121/jre/lib/jce.jar:/usr/java/jdk1.8.0_121/jre/lib/charsets.jar:/usr/java/jdk1.8.0_121/jre/lib/jfr.jar:/usr/java/jdk1.8.0_121/jre/classes`%B7sun.property.sun.boot.library.path/usr/java/jdk1.8.0_121/jre/lib/amd64(B$java.rt.vmFlags??B#java.rt.vmArgs-Xmx598m
 -Dapp.name=asterixnc -Dapp.pid=3265 -Dapp.repo=/home/ec2-user/asterixdb/repo 
-Dapp.home=/home/ec2-user/asterixdb 
-Dbasedir=/home/ec2-user/asterixdb??B'sun.rt.javaCommandorg.apache.hyracks.control.nc.NCDriver
 -app-nc-main-class 
org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint -config-file 
/tmp/ncconf5632576373570895499.conf -ncservice-pid 
3235??B+sun.rt.internalVersionJava HotSpot(TM) 64-Bit Server VM (25.121-b13) 
for linux-amd64 JRE (1.8.0_121-b13), built on Dec 12 2016 16:36:53 by "java_re" 
with gcc 4.3.0 20080428 (Red Hat 
4.3.0-8)0J(sun.os.hrt.ticks\?ߠHJ@sun.classloader.parentDelegationTimeK??8J0sun.classloader.findClasses!
{noformat}

cat /tmp/hsperfdata_ec2-user/3235
{noformat}
?????=?& 
?8j0sun.rt._sync_inflations8j0sun.rt._sync_deflati...@j8sun.rt._sync_ContendedLockAttempts8J0sun.rt._sync_FutileWakeups0J(sun.rt._sync_pa...@j8sun.rt._sync_emptynotifications8j0sun.rt._sync_notifications8j0sun.rt._sync_slowenter8j0sun.rt._sync_slowexit8j0sun.rt._sync_slownotify8j0sun.rt._sync_slownotifyall8j0sun.rt._sync_failedsp...@j8sun.rt._sync_successfulspins8j0sun.rt._sync_privatea8j0sun.rt._sync_priva...@j8sun.rt._sync_MonInCirculation8J0sun.rt._sync_MonScavenged8J0sun.rt._sync_MonExtant?8J0sun.rt.createVmBeginTime?A*Z8J0sun.rt.createVmEndTime7A*Z8J0sun.rt.vmInitDoneTimeA*Z8J0java.threads.started0J(java.threads.live8J0java.threads.livePeak0J(java.threads.daemon8J0sun.rt.safepointSyncTime
y...@j8sun.rt.threadinterruptsignaled8j0sun.rt.interruptedbeforeio8j0sun.rt.interruptedduringiopab+sun.rt.jvmcapabilities11000000000000000000000000000000000000000000000000000000000000008j0java.cls.loadedclassesv8j0java.cls.unloadedclas...@j8java.cls.sharedloadedclas...@j8java.cls.sharedUnloadedClasses0J(sun.cls.loadedBytes?u!8J0sun.cls.unloadedBytes8J0sun.cls.sharedLoadedBytes8J0sun.cls.sharedUnloadedByt8J0sun.cls.classInitTime.self?͸n8J0sun.cls.classVerifyTime??a...@j8sun.cls.classVerifyTime.self0?8J0sun.cls.classLinkedTimeP?@J8sun.cls.classLinkedTime.self?G?8J0sun.cls.initializedClasses?8J0sun.cls.linkedClasses&8J0sun.cls.verifiedClasses&8J0sun.cls.parseClassTime~??8J0sun.cls.parseClassTime.self??8J0sun.cls.lookupSysClassTime?a8J0sun.cls.sharedClassLoadTime?8J0sun.cls.sysClassLoadTimeǢ?8J0sun.cls.appClassLoadTime??k...@j8sun.cls.appclassloadtime.self$??8J0sun.cls.appClassLoadCount?8j0sun.cls.defineappclassesr8j0sun.cls.defineappclasstim...@j8sun.cls.defineappclasstime.self8j0sun.cls.appClassBytes˪8J0sun.cls.sysClassBytes?7...@sun.cls.systemloaderlockcontentionrat...@sun.cls.nonsystemloaderlockcontentionrat...@sun.cls.jvmFindLoadedClassNoLockCalls"@j8sun.cls.jvmdefineclassnolockcal...@j8sun.cls.jnidefineclassnolockca...@j8sun.cls.unsafedefineclasscal...@j8sun.cls.isunsyncloadclass...@j8sun.cls.loadInstanceClassFailRatexQB!sun.gc.causeNo
 GCxQB%sun.gc.lastCauseAllocation 
failur...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.01??h...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes...@j8sun.gc.generation.0.agetable.size8b-sun.gc.generation.0.namenew8j0sun.gc.generation.0.spa...@j8sun.gc.generation.0.mincapaci...@j8sun.gc.generation.0.maxcapaci...@j8sun.gc.generation.0.capacityU8B,sun.gc.collector.0.namec...@j8sun.gc.collector.0.invocations8j0sun.gc.collector.0.time?q...@j8sun.gc.collector.0.lastEntryTime#??!@J8sun.gc.collector.0.lastExitTimeƞ?!@b5sun.gc.generation.0.space.0.nameede...@sun.gc.generation.0.space.0.maxcapacity...@sun.gc.generation.0.space.0.capaci...@j8sun.gc.generation.0.space.0.used@?
                                                                                
                                                   
h...@sun.gc.generation.0.space.0.initcapacity8b5sun.gc.generation.0.space.1.names...@sun.gc.generation.0.space.1.maxCapacity?h...@sun.gc.generation.0.space.1.capa...@j8sun.gc.generation.0.space.1.used??h...@sun.gc.generation.0.space.1.initcapacity8b5sun.gc.generation.0.space.2.names...@sun.gc.generation.0.space.2.maxCapacity?h...@sun.gc.generation.0.space.2.capa...@j8sun.gc.generation.0.space.2.use...@sun.gc.generation.0.space.2.initcapacity8b-sun.gc.generation.1.nameold8j0sun.gc.generation.1.spa...@j8sun.gc.generation.1.minCapacity?@J8sun.gc.generation.1.maxCapacityk
@J8sun.gc.generation.1.capacity?0B,sun.gc.collector.1.name...@j8sun.gc.collector.1.invocations8j0sun.gc.collector.1.time@j8sun.gc.collector.1.lastentryt...@j8sun.gc.collector.1.lastexitt...@b5sun.gc.generation.1.space.0.nameol...@sun.gc.generation.1.space.0.maxCapacityk
h...@sun.gc.generation.1.space.0.capacity?@J8sun.gc.generation.1.space.0.used??h...@sun.gc.generation.1.space.0.initCapacity?8J0sun.gc.tlab.allocThreads0J(sun.gc.tlab.fills28J0sun.gc.tlab.maxFills10J(sun.gc.tlab.alloc?0J(sun.gc.tlab.gcWaste?8J0sun.gc.tlab.maxGcWaste?8J0sun.gc.tlab.slowWaste?8J0sun.gc.tlab.maxSlowWaste?8J0sun.gc.tlab.fastWaste?8J0sun.gc.tlab.maxFastWaste?8J0sun.gc.tlab.slowAlloc
                                                                                
                                                                                
                               8J0sun.gc.tlab.maxSlowAlloc
                0       
B'sun.gc.policy.nameCopy:msc8j0sun.gc.policy.collectors8j0sun.gc.policy.generati...@j8sun.gc.policy.maxtenuringthresh...@j8sun.gc.policy.tenuringthresh...@j8sun.gc.policy.desiredsurvivors...@j8sun.gc.metaspace.mincapacity8j0sun.gc.metaspace.capacity`@J8sun.gc.metaspace.maxCapacity?@8J0sun.gc.metaspace.used?-\h...@sun.gc.compressedclassspace.mincapacit...@sun.gc.compressedclassspace.capacity
           
h...@sun.gc.compressedclassspace.maxCapacity@@J8sun.gc.compressedclassspace.used
 ?
cV??b3sun.ci.compilerthread.0.met...@j8sun.ci.compilerthread.0.type@J8sun.ci.compilerThread.0.time?@J8sun.ci.compilerThread.0.compiles??b3sun.ci.compilerthread.1.met...@j8sun.ci.compilerthread.1.type@J8sun.ci.compilerThread.1.time?@J8sun.ci.compilerThread.1.compiles?0J(sun.ci.threads0J(java.ci.totalTime?u0J(sun.ci.osrTimef?#0J(sun.ci.standardTimez??8J0sun.ci.totalBailouts8J0sun.ci.totalInvalidates8J0sun.ci.totalCompiles?0J(sun.ci.osrCompiles8J0sun.ci.standardCompiles?0J(sun.ci.osrBytesF8J0sun.ci.standardBytes̘0J(sun.ci.nmethodSize@?
                                                                                
                                                     
8J0sun.ci.nmethodCodeSize@???B&sun.ci.lastMethodsun/invoke/util/BytecodeDescriptor
 
unparseSig??B,sun.ci.lastFailedMethod??B1sun.ci.lastInvalidatedMethod0J(sun.ci.lastType0J(sun.ci.lastSize?8J0sun.ci.lastFailedType8J0sun.ci.lastInvalidatedType8J0sun.os.hrt.frequencyʚ;h...@java.property.java.vm.specification.version1.8`#B=java.property.java.vm.specification.nameJava
 Virtual Machine 
SpecificationXB?java.property.java.vm.specification.vendorOracle Corporation@
                                                                                
                                                                                
                           
B2java.property.java.vm.version25.121-b13X"B/java.property.java.vm.nameJava 
HotSpot(TM) 64-Bit Server VMHB1java.property.java.vm.vendorOracle Corporation@
                                                                                
                                                           
B/java.property.java.vm.infomixed 
modex=B4java.property.java.library.path/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib8B2java.property.java.class.path/home/ec2-user/asterixdb/etc:/home/ec2-user/asterixdb/repo/hyracks-util-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/jersey-test-framework-core-1.9.jar:/home/ec2-user/asterixdb/repo/jetty-server-9.3.11.v20160721.jar:/home/ec2-user/asterixdb/repo/grizzly-rcm-2.1.2.jar:/home/ec2-user/asterixdb/repo/hyracks-api-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/slf4j-log4j12-1.7.5.jar:/home/ec2-user/asterixdb/repo/xz-1.0.jar:/home/ec2-user/asterixdb/repo/asterix-lang-common-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/commons-math-2.1.jar:/home/ec2-user/asterixdb/repo/commons-beanutils-1.7.0.jar:/home/ec2-user/asterixdb/repo/asterix-metadata-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/rome-1.0.1-modified-01.jar:/home/ec2-user/asterixdb/repo/asterix-events-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/guava-18.0.jar:/home/ec2-user/asterixdb/repo/hadoop-hdfs-2.2.0.jar:/home/ec2-user/asterixdb/repo/hadoop-mapreduce-client-core-2.2.0.jar:/home/ec2-user/asterixdb/repo/jetty-security-9.3.11.v20160721.jar`(B5java.property.java.endorsed.dirs/usr/java/jdk1.8.0_121/jre/lib/endorsedp>B0java.property.java.ext.dirs/usr/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext@
B/java.property.java.version1.8.0_121H,java.property.java.home/usr/java/jdk1.8.0_121/jre?FB5sun.property.sun.boot.class.path/usr/java/jdk1.8.0_121/jre/lib/resources.jar:/usr/java/jdk1.8.0_121/jre/lib/rt.jar:/usr/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_121/jre/lib/jsse.jar:/usr/java/jdk1.8.0_121/jre/lib/jce.jar:/usr/java/jdk1.8.0_121/jre/lib/charsets.jar:/usr/java/jdk1.8.0_121/jre/lib/jfr.jar:/usr/java/jdk1.8.0_121/jre/classes`%B7sun.property.sun.boot.library.path/usr/java/jdk1.8.0_121/jre/lib/amd64(B$java.rt.vmFlags??B#java.rt.vmArgs-Dapp.name=asterixncservice
 -Dapp.pid=3235 -Dapp.repo=/home/ec2-user/asterixdb/repo 
-Dapp.home=/home/ec2-user/asterixdb 
-Dbasedir=/home/ec2-user/asterixdbX0B'sun.rt.javaCommandorg.apache.hyracks.control.nc.service.NCService??B+sun.rt.internalVersionJava
 HotSpot(TM) 64-Bit Server VM (25.121-b13) for linux-amd64 JRE (1.8.0_121-b13), 
built on Dec 12 2016 16:36:53 by "java_re" with gcc 4.3.0 20080428 (Red Hat 
4.3.0-8)0J(sun.os.hrt.ticks????6HJ@sun.classloader.parentDelegationTime\??8J0sun.classloader.findClassesO@J8sun.classloader.findClassTimeئ
                                                                                
                
HJ@sun.urlClassLoader.readClassBytesTimeQ?0J(sun.zip.zipFiles?8J0sun.zip.zipFile.openTime?

{noformat}
                                                                                
                                                                                
                          


  was:
I have a 2-node AsterixDB instance on AWS, using the t2.micro configuration (1 
vcore + 1GB RAM + 8GB EBS disk). CCDriver runs on the same node with one 
NCDriver.  I load tpch datasets with scale factor of 0.2 into the instance, 
i.e., 200MB data in total.

JVM crashes when queries are running. Here are the crash dump files:

cat /tmp/hsperfdata_ec2-user/3265
{noformat}
????p>?/? 
?8J0sun.rt._sync_Inflationsk8J0sun.rt._sync_Deflations]@J8sun.rt._sync_ContendedLockAttempts?b8J0sun.rt._sync_FutileWakeups?0J(sun.rt._sync_Parks?@j8sun.rt._sync_emptynotifications8j0sun.rt._sync_notificationsv8j0sun.rt._sync_slowenter8j0sun.rt._sync_slowexit8j0sun.rt._sync_slownotify8j0sun.rt._sync_slownotifyall8j0sun.rt._sync_failedsp...@j8sun.rt._sync_successfulspins8j0sun.rt._sync_privatea8j0sun.rt._sync_priva...@j8sun.rt._sync_MonInCirculation8J0sun.rt._sync_MonScavenged8J0sun.rt._sync_MonExtant8J0sun.rt.createVmBeginTime?7A*Z8J0sun.rt.createVmEndTime?7A*Z8J0sun.rt.vmInitDoneTime?7A*Z8J0java.threads.startedK0J(java.threads.live8J0java.threads.livePeak0J(java.threads.daemon8J0sun.rt.safepointSyncTime?0J(sun.rt.safepoints48J0sun.rt.safepointTime?N58J0sun.rt.applicationTimeF3???0J(su...@j8sun.rt.threadinterruptsignaled8j0sun.rt.interruptedbeforeio8j0sun.rt.interruptedDuringIOpAB+sun.rt.jvmCapabilities11000000000000000000000000000000000000000000000000000000000000008J0java.cls.loadedClasses?8j0java.cls.unloadedclas...@j8java.cls.sharedloadedclas...@j8java.cls.sharedUnloadedClasses0J(sun.cls.loadedBytesH?{8J0sun.cls.unloadedBytesx?8J0sun.cls.sharedLoadedBytes8J0sun.cls.sharedUnloadedBJ0sun.cls.classVerifyTime/vZ'@J8sun.cls.classVerifyTime.self݇?assInitTime??TB8J0sun.cls.classInitTime.self8)?
8J0sun.cls.linkedClasses?8J0sun.cls.verifiedClasses?8J0sun.cls.parseClassTime??G8J0sun.cls.parseClassTime.self?߫8J0sun.cls.lookupSysClassTime?8J0sun.cls.sharedClassLoadTime?8J0sun.cls.sysClassLoadTime??8J0sun.cls.appClassLoadTime???_...@j8sun.cls.appclassloadtime.self???<8J0sun.cls.appClassLoadCount?
                                                                                
               8J0sun.cls.defineAppClassesf
                                                                                
                                           
8J0sun.cls.defineAppClassTime??@J8sun.cls.defineAppClassTime.self??8J0sun.cls.appClassBytes5?8J0sun.cls.sysClassBytes??o...@sun.cls.systemloaderlockcontentionrat...@sun.cls.nonsystemloaderlockcontentionrat...@sun.cls.jvmFindLoadedClassNoLockCalls?@J8sun.cls.jvmDefineClassNoLockCallsc
  
@j8sun.cls.jnidefineclassnolockc...@j8sun.cls.unsafedefineclasscal...@j8sun.cls.isunsyncloadclass...@j8sun.cls.loadInstanceClassFailRatexQB!sun.gc.causeNo
 GCxQB%sun.gc.lastCauseAllocation 
failur...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.01??(h...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes...@j8sun.gc.generation.0.agetable.size8b-sun.gc.generation.0.namenew8j0sun.gc.generation.0.spa...@j8sun.gc.generation.0.mincapaci...@j8sun.gc.generation.0.maxCapacityu
                                                                                
                                                                                
                                     @J8sun.gc.generation.0.capacityu
                           
8B,sun.gc.collector.0.namec...@j8sun.gc.collector.0.invocations=8J0sun.gc.collector.0.time???@J8sun.gc.collector.0.lastEntryTime????@J8sun.gc.collector.0.lastExitTime?0??@b5sun.gc.generation.0.space.0.nameede...@sun.gc.generation.0.space.0.maxCapacity?
 h...@sun.gc.generation.0.space.0.capacity?      
@J8sun.gc.generation.0.space.0.used?Z?h...@sun.gc.generation.0.space.0.initcapacity8b5sun.gc.generation.0.space.1.names...@sun.gc.generation.0.space.1.maxCapacity>h...@sun.gc.generation.0.space.1.capacity>@J8sun.gc.generation.0.space.1.used??(h...@sun.gc.generation.0.space.1.initcapacity8b5sun.gc.generation.0.space.2.names...@sun.gc.generation.0.space.2.maxCapacity>h...@sun.gc.generation.0.space.2.capacity>@j8sun.gc.generation.0.space.2.use...@sun.gc.generation.0.space.2.initcapacity8b-sun.gc.generation.1.nameold8j0sun.gc.generation.1.spa...@j8sun.gc.generation.1.minCapacity?@J8sun.gc.generation.1.maxCapacity?@J8sun.gc.generation.1.capacity?0B,sun.gc.collector.1.name...@j8sun.gc.collector.1.invocation8j0sun.gc.collector.1.time
                                                
l...@j8sun.gc.collector.1.lastEntryTimet??m...@j8sun.gc.collector.1.lastExitTime?[l...@b5sun.gc.generation.1.space.0.nameol...@sun.gc.generation.1.space.0.maxCapacity?h...@sun.gc.generation.1.space.0.capacity?@J8sun.gc.generation.1.space.0.used??U
0J(sun.gc.tlab.fills?8J0sun.gc.tlab.maxFills=0J(sun.gc.tlab.alloc9?W0J(sun.gc.tlab.gcWastenX8J0sun.gc.tlab.maxGcWasteM8J0sun.gc.tlab.slowWaste8J0sun.gc.tlab.maxSlowWasteO
                                                                                
                                                                                
          8J0sun.gc.tlab.fastWasteO8J0sun.gc.tlab.maxFastWaste
                    8J0sun.gc.tlab.slowAlloc?8J0sun.gc.tlab.maxSlowAlloc~0      
B'sun.gc.policy.nameCopy:msc8j0sun.gc.policy.collectors8j0sun.gc.policy.generati...@j8sun.gc.policy.maxtenuringthresh...@j8sun.gc.policy.tenuringthresh...@j8sun.gc.policy.desiredSurvivorSize?@j8sun.gc.metaspace.mincapacity8j0sun.gc.metaspace.capaci...@j8sun.gc.metaspace.maxCapacity`A8J0sun.gc.metaspace.used?
g...@sun.gc.compressedclassspace.mincapacit...@sun.gc.compressedclassspace.capacity...@sun.gc.compressedclassspace.maxCapacity@@J8sun.gc.compressedclassspace.used??-8J0sun.threads.vmOperationTime?Q+??b3sun.ci.compilerthread.0.met...@j8sun.ci.compilerthread.0.type@j8sun.ci.compilerthread.0.t...@j8sun.ci.compilerThread.0.compiles???b3sun.ci.compilerthread.1.met...@j8sun.ci.compilerthread.1.type@J8sun.ci.0J(sun.ci.threads0J(java.ci.totalTimeD?^0J(sun.ci.osrTime????0J(sun.ci.standardTime}??8J0sun.ci.totalBailouts8J0sun.ci.totalInvalidates8J0sun.ci.totalCompiles0J(sun.ci.osrCompilesr8J0sun.ci.standardCompiles?0J(sun.ci.osrBytes?18J0sun.ci.standardBytes)p
                                                  
0J(sun.ci.nmethodSizeP??8J0sun.ci.nmethodCodeSize?El??B&sun.ci.lastMethodjava/io/BufferedOutputStream
 
flushBuffer??B,sun.ci.lastFailedMethod??B1sun.ci.lastInvalidatedMethod0J(sun.ci.lastType0J(sun.ci.lastSize8J0sun.ci.lastFailedType8J0sun.ci.lastInvalidatedType8J0sun.os.hrt.frequencyʚ;h...@java.property.java.vm.specification.version1.8`#B=java.property.java.vm.specification.nameJava
 Virtual Machine 
SpecificationXB?java.property.java.vm.specification.vendorOracle Corporation@
                                                                                
                                           
B2java.property.java.vm.version25.121-b13X"B/java.property.java.vm.nameJava 
HotSpot(TM) 64-Bit Server VMHB1java.property.java.vm.vendorOracle Corporation@
                                                                           
B/java.property.java.vm.infomixed 
modex=B4java.property.java.library.path/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib8B2java.property.java.class.path/home/ec2-user/asterixdb/etc:/home/ec2-user/asterixdb/repo/hyracks-util-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/jersey-test-framework-core-1.9.jar:/home/ec2-user/asterixdb/repo/jetty-server-9.3.11.v20160721.jar:/home/ec2-user/asterixdb/repo/grizzly-rcm-2.1.2.jar:/home/ec2-user/asterixdb/repo/hyracks-api-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/slf4j-log4j12-1.7.5.jar:/home/ec2-user/asterixdb/repo/xz-1.0.jar:/home/ec2-user/asterixdb/repo/asterix-lang-common-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/commons-math-2.1.jar:/home/ec2-user/asterixdb/repo/commons-beanutils-1.7.0.jar:/home/ec2-user/asterixdb/repo/asterix-metadata-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/rome-1.0.1-modified-01.jar:/home/ec2-user/asterixdb/repo/asterix-events-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/guava-18.0.jar:/home/ec2-user/asterixdb/repo/hadoop-hdfs-2.2.0.jar:/home/ec2-user/asterixdb/repo/hadoop-mapreduce-client-core-2.2.0.jar:/home/ec2-user/asterixdb/repo/jetty-security-9.3.11.v20160721.jar`(B5java.property.java.endorsed.dirs/usr/java/jdk1.8.0_121/jre/lib/endorsedp>B0java.property.java.ext.dirs/usr/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext@
B/java.property.java.version1.8.0_121H,java.property.java.home/usr/java/jdk1.8.0_121/jre?FB5sun.property.sun.boot.class.path/usr/java/jdk1.8.0_121/jre/lib/resources.jar:/usr/java/jdk1.8.0_121/jre/lib/rt.jar:/usr/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_121/jre/lib/jsse.jar:/usr/java/jdk1.8.0_121/jre/lib/jce.jar:/usr/java/jdk1.8.0_121/jre/lib/charsets.jar:/usr/java/jdk1.8.0_121/jre/lib/jfr.jar:/usr/java/jdk1.8.0_121/jre/classes`%B7sun.property.sun.boot.library.path/usr/java/jdk1.8.0_121/jre/lib/amd64(B$java.rt.vmFlags??B#java.rt.vmArgs-Xmx598m
 -Dapp.name=asterixnc -Dapp.pid=3265 -Dapp.repo=/home/ec2-user/asterixdb/repo 
-Dapp.home=/home/ec2-user/asterixdb 
-Dbasedir=/home/ec2-user/asterixdb??B'sun.rt.javaCommandorg.apache.hyracks.control.nc.NCDriver
 -app-nc-main-class 
org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint -config-file 
/tmp/ncconf5632576373570895499.conf -ncservice-pid 
3235??B+sun.rt.internalVersionJava HotSpot(TM) 64-Bit Server VM (25.121-b13) 
for linux-amd64 JRE (1.8.0_121-b13), built on Dec 12 2016 16:36:53 by "java_re" 
with gcc 4.3.0 20080428 (Red Hat 
4.3.0-8)0J(sun.os.hrt.ticks\?ߠHJ@sun.classloader.parentDelegationTimeK??8J0sun.classloader.findClasses!
{noformat}

cat /tmp/hsperfdata_ec2-user/3235
{noformat}
?????=?& 
?8j0sun.rt._sync_inflations8j0sun.rt._sync_deflati...@j8sun.rt._sync_ContendedLockAttempts8J0sun.rt._sync_FutileWakeups0J(sun.rt._sync_pa...@j8sun.rt._sync_emptynotifications8j0sun.rt._sync_notifications8j0sun.rt._sync_slowenter8j0sun.rt._sync_slowexit8j0sun.rt._sync_slownotify8j0sun.rt._sync_slownotifyall8j0sun.rt._sync_failedsp...@j8sun.rt._sync_successfulspins8j0sun.rt._sync_privatea8j0sun.rt._sync_priva...@j8sun.rt._sync_MonInCirculation8J0sun.rt._sync_MonScavenged8J0sun.rt._sync_MonExtant?8J0sun.rt.createVmBeginTime?A*Z8J0sun.rt.createVmEndTime7A*Z8J0sun.rt.vmInitDoneTimeA*Z8J0java.threads.started0J(java.threads.live8J0java.threads.livePeak0J(java.threads.daemon8J0sun.rt.safepointSyncTime
y...@j8sun.rt.threadinterruptsignaled8j0sun.rt.interruptedbeforeio8j0sun.rt.interruptedduringiopab+sun.rt.jvmcapabilities11000000000000000000000000000000000000000000000000000000000000008j0java.cls.loadedclassesv8j0java.cls.unloadedclas...@j8java.cls.sharedloadedclas...@j8java.cls.sharedUnloadedClasses0J(sun.cls.loadedBytes?u!8J0sun.cls.unloadedBytes8J0sun.cls.sharedLoadedBytes8J0sun.cls.sharedUnloadedByt8J0sun.cls.classInitTime.self?͸n8J0sun.cls.classVerifyTime??a...@j8sun.cls.classVerifyTime.self0?8J0sun.cls.classLinkedTimeP?@J8sun.cls.classLinkedTime.self?G?8J0sun.cls.initializedClasses?8J0sun.cls.linkedClasses&8J0sun.cls.verifiedClasses&8J0sun.cls.parseClassTime~??8J0sun.cls.parseClassTime.self??8J0sun.cls.lookupSysClassTime?a8J0sun.cls.sharedClassLoadTime?8J0sun.cls.sysClassLoadTimeǢ?8J0sun.cls.appClassLoadTime??k...@j8sun.cls.appclassloadtime.self$??8J0sun.cls.appClassLoadCount?8j0sun.cls.defineappclassesr8j0sun.cls.defineappclasstim...@j8sun.cls.defineappclasstime.self8j0sun.cls.appClassBytes˪8J0sun.cls.sysClassBytes?7...@sun.cls.systemloaderlockcontentionrat...@sun.cls.nonsystemloaderlockcontentionrat...@sun.cls.jvmFindLoadedClassNoLockCalls"@j8sun.cls.jvmdefineclassnolockcal...@j8sun.cls.jnidefineclassnolockca...@j8sun.cls.unsafedefineclasscal...@j8sun.cls.isunsyncloadclass...@j8sun.cls.loadInstanceClassFailRatexQB!sun.gc.causeNo
 GCxQB%sun.gc.lastCauseAllocation 
failur...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.01??h...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes...@j8sun.gc.generation.0.agetable.size8b-sun.gc.generation.0.namenew8j0sun.gc.generation.0.spa...@j8sun.gc.generation.0.mincapaci...@j8sun.gc.generation.0.maxcapaci...@j8sun.gc.generation.0.capacityU8B,sun.gc.collector.0.namec...@j8sun.gc.collector.0.invocations8j0sun.gc.collector.0.time?q...@j8sun.gc.collector.0.lastEntryTime#??!@J8sun.gc.collector.0.lastExitTimeƞ?!@b5sun.gc.generation.0.space.0.nameede...@sun.gc.generation.0.space.0.maxcapacity...@sun.gc.generation.0.space.0.capaci...@j8sun.gc.generation.0.space.0.used@?
                                                                                
                                                   
h...@sun.gc.generation.0.space.0.initcapacity8b5sun.gc.generation.0.space.1.names...@sun.gc.generation.0.space.1.maxCapacity?h...@sun.gc.generation.0.space.1.capa...@j8sun.gc.generation.0.space.1.used??h...@sun.gc.generation.0.space.1.initcapacity8b5sun.gc.generation.0.space.2.names...@sun.gc.generation.0.space.2.maxCapacity?h...@sun.gc.generation.0.space.2.capa...@j8sun.gc.generation.0.space.2.use...@sun.gc.generation.0.space.2.initcapacity8b-sun.gc.generation.1.nameold8j0sun.gc.generation.1.spa...@j8sun.gc.generation.1.minCapacity?@J8sun.gc.generation.1.maxCapacityk
@J8sun.gc.generation.1.capacity?0B,sun.gc.collector.1.name...@j8sun.gc.collector.1.invocations8j0sun.gc.collector.1.time@j8sun.gc.collector.1.lastentryt...@j8sun.gc.collector.1.lastexitt...@b5sun.gc.generation.1.space.0.nameol...@sun.gc.generation.1.space.0.maxCapacityk
h...@sun.gc.generation.1.space.0.capacity?@J8sun.gc.generation.1.space.0.used??h...@sun.gc.generation.1.space.0.initCapacity?8J0sun.gc.tlab.allocThreads0J(sun.gc.tlab.fills28J0sun.gc.tlab.maxFills10J(sun.gc.tlab.alloc?0J(sun.gc.tlab.gcWaste?8J0sun.gc.tlab.maxGcWaste?8J0sun.gc.tlab.slowWaste?8J0sun.gc.tlab.maxSlowWaste?8J0sun.gc.tlab.fastWaste?8J0sun.gc.tlab.maxFastWaste?8J0sun.gc.tlab.slowAlloc
                                                                                
                                                                                
                               8J0sun.gc.tlab.maxSlowAlloc
                0       
B'sun.gc.policy.nameCopy:msc8j0sun.gc.policy.collectors8j0sun.gc.policy.generati...@j8sun.gc.policy.maxtenuringthresh...@j8sun.gc.policy.tenuringthresh...@j8sun.gc.policy.desiredsurvivors...@j8sun.gc.metaspace.mincapacity8j0sun.gc.metaspace.capacity`@J8sun.gc.metaspace.maxCapacity?@8J0sun.gc.metaspace.used?-\h...@sun.gc.compressedclassspace.mincapacit...@sun.gc.compressedclassspace.capacity
           
h...@sun.gc.compressedclassspace.maxCapacity@@J8sun.gc.compressedclassspace.used
 ?
cV??b3sun.ci.compilerthread.0.met...@j8sun.ci.compilerthread.0.type@J8sun.ci.compilerThread.0.time?@J8sun.ci.compilerThread.0.compiles??b3sun.ci.compilerthread.1.met...@j8sun.ci.compilerthread.1.type@J8sun.ci.compilerThread.1.time?@J8sun.ci.compilerThread.1.compiles?0J(sun.ci.threads0J(java.ci.totalTime?u0J(sun.ci.osrTimef?#0J(sun.ci.standardTimez??8J0sun.ci.totalBailouts8J0sun.ci.totalInvalidates8J0sun.ci.totalCompiles?0J(sun.ci.osrCompiles8J0sun.ci.standardCompiles?0J(sun.ci.osrBytesF8J0sun.ci.standardBytes̘0J(sun.ci.nmethodSize@?
                                                                                
                                                     
8J0sun.ci.nmethodCodeSize@???B&sun.ci.lastMethodsun/invoke/util/BytecodeDescriptor
 
unparseSig??B,sun.ci.lastFailedMethod??B1sun.ci.lastInvalidatedMethod0J(sun.ci.lastType0J(sun.ci.lastSize?8J0sun.ci.lastFailedType8J0sun.ci.lastInvalidatedType8J0sun.os.hrt.frequencyʚ;h...@java.property.java.vm.specification.version1.8`#B=java.property.java.vm.specification.nameJava
 Virtual Machine 
SpecificationXB?java.property.java.vm.specification.vendorOracle Corporation@
                                                                                
                                                                                
                           
B2java.property.java.vm.version25.121-b13X"B/java.property.java.vm.nameJava 
HotSpot(TM) 64-Bit Server VMHB1java.property.java.vm.vendorOracle Corporation@
                                                                                
                                                           
B/java.property.java.vm.infomixed 
modex=B4java.property.java.library.path/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib8B2java.property.java.class.path/home/ec2-user/asterixdb/etc:/home/ec2-user/asterixdb/repo/hyracks-util-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/jersey-test-framework-core-1.9.jar:/home/ec2-user/asterixdb/repo/jetty-server-9.3.11.v20160721.jar:/home/ec2-user/asterixdb/repo/grizzly-rcm-2.1.2.jar:/home/ec2-user/asterixdb/repo/hyracks-api-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/slf4j-log4j12-1.7.5.jar:/home/ec2-user/asterixdb/repo/xz-1.0.jar:/home/ec2-user/asterixdb/repo/asterix-lang-common-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/commons-math-2.1.jar:/home/ec2-user/asterixdb/repo/commons-beanutils-1.7.0.jar:/home/ec2-user/asterixdb/repo/asterix-metadata-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/rome-1.0.1-modified-01.jar:/home/ec2-user/asterixdb/repo/asterix-events-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/guava-18.0.jar:/home/ec2-user/asterixdb/repo/hadoop-hdfs-2.2.0.jar:/home/ec2-user/asterixdb/repo/hadoop-mapreduce-client-core-2.2.0.jar:/home/ec2-user/asterixdb/repo/jetty-security-9.3.11.v20160721.jar`(B5java.property.java.endorsed.dirs/usr/java/jdk1.8.0_121/jre/lib/endorsedp>B0java.property.java.ext.dirs/usr/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext@
B/java.property.java.version1.8.0_121H,java.property.java.home/usr/java/jdk1.8.0_121/jre?FB5sun.property.sun.boot.class.path/usr/java/jdk1.8.0_121/jre/lib/resources.jar:/usr/java/jdk1.8.0_121/jre/lib/rt.jar:/usr/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_121/jre/lib/jsse.jar:/usr/java/jdk1.8.0_121/jre/lib/jce.jar:/usr/java/jdk1.8.0_121/jre/lib/charsets.jar:/usr/java/jdk1.8.0_121/jre/lib/jfr.jar:/usr/java/jdk1.8.0_121/jre/classes`%B7sun.property.sun.boot.library.path/usr/java/jdk1.8.0_121/jre/lib/amd64(B$java.rt.vmFlags??B#java.rt.vmArgs-Dapp.name=asterixncservice
 -Dapp.pid=3235 -Dapp.repo=/home/ec2-user/asterixdb/repo 
-Dapp.home=/home/ec2-user/asterixdb 
-Dbasedir=/home/ec2-user/asterixdbX0B'sun.rt.javaCommandorg.apache.hyracks.control.nc.service.NCService??B+sun.rt.internalVersionJava
 HotSpot(TM) 64-Bit Server VM (25.121-b13) for linux-amd64 JRE (1.8.0_121-b13), 
built on Dec 12 2016 16:36:53 by "java_re" with gcc 4.3.0 20080428 (Red Hat 
4.3.0-8)0J(sun.os.hrt.ticks????6HJ@sun.classloader.parentDelegationTime\??8J0sun.classloader.findClassesO@J8sun.classloader.findClassTimeئ
                                                                                
                
HJ@sun.urlClassLoader.readClassBytesTimeQ?0J(sun.zip.zipFiles?8J0sun.zip.zipFile.openTime?

{noformat}
                                                                                
                                                                                
                          



> JVM crash on AWS t2.micro instance
> ----------------------------------
>
>                 Key: ASTERIXDB-1788
>                 URL: https://issues.apache.org/jira/browse/ASTERIXDB-1788
>             Project: Apache AsterixDB
>          Issue Type: Bug
>          Components: AsterixDB
>            Reporter: Yingyi Bu
>            Assignee: Yingyi Bu
>         Attachments: hs_err_pid3528.log, hs_err_pid3587.log
>
>
> I have a 2-node AsterixDB instance on AWS, using the t2.micro configuration 
> (1 vcore + 1GB RAM + 8GB EBS disk). CCDriver runs on the same node with one 
> NCDriver.  I load tpch datasets with scale factor of 0.2 into the instance, 
> i.e., 200MB data in total.  
> JVM crashes when queries are running.  Two JVM crash logs are attached.
> Here are the crash dump files:
> cat /tmp/hsperfdata_ec2-user/3265
> {noformat}
> ????p>?/? 
> ?8J0sun.rt._sync_Inflationsk8J0sun.rt._sync_Deflations]@J8sun.rt._sync_ContendedLockAttempts?b8J0sun.rt._sync_FutileWakeups?0J(sun.rt._sync_Parks?@j8sun.rt._sync_emptynotifications8j0sun.rt._sync_notificationsv8j0sun.rt._sync_slowenter8j0sun.rt._sync_slowexit8j0sun.rt._sync_slownotify8j0sun.rt._sync_slownotifyall8j0sun.rt._sync_failedsp...@j8sun.rt._sync_successfulspins8j0sun.rt._sync_privatea8j0sun.rt._sync_priva...@j8sun.rt._sync_MonInCirculation8J0sun.rt._sync_MonScavenged8J0sun.rt._sync_MonExtant8J0sun.rt.createVmBeginTime?7A*Z8J0sun.rt.createVmEndTime?7A*Z8J0sun.rt.vmInitDoneTime?7A*Z8J0java.threads.startedK0J(java.threads.live8J0java.threads.livePeak0J(java.threads.daemon8J0sun.rt.safepointSyncTime?0J(sun.rt.safepoints48J0sun.rt.safepointTime?N58J0sun.rt.applicationTimeF3???0J(su...@j8sun.rt.threadinterruptsignaled8j0sun.rt.interruptedbeforeio8j0sun.rt.interruptedDuringIOpAB+sun.rt.jvmCapabilities11000000000000000000000000000000000000000000000000000000000000008J0java.cls.loadedClasses?8j0java.cls.unloadedclas...@j8java.cls.sharedloadedclas...@j8java.cls.sharedUnloadedClasses0J(sun.cls.loadedBytesH?{8J0sun.cls.unloadedBytesx?8J0sun.cls.sharedLoadedBytes8J0sun.cls.sharedUnloadedBJ0sun.cls.classVerifyTime/vZ'@J8sun.cls.classVerifyTime.self݇?assInitTime??TB8J0sun.cls.classInitTime.self8)?
> 8J0sun.cls.linkedClasses?8J0sun.cls.verifiedClasses?8J0sun.cls.parseClassTime??G8J0sun.cls.parseClassTime.self?߫8J0sun.cls.lookupSysClassTime?8J0sun.cls.sharedClassLoadTime?8J0sun.cls.sysClassLoadTime??8J0sun.cls.appClassLoadTime???_...@j8sun.cls.appclassloadtime.self???<8J0sun.cls.appClassLoadCount?
>                                                                               
>                  8J0sun.cls.defineAppClassesf
>                                                                               
>                                              
> 8J0sun.cls.defineAppClassTime??@J8sun.cls.defineAppClassTime.self??8J0sun.cls.appClassBytes5?8J0sun.cls.sysClassBytes??o...@sun.cls.systemloaderlockcontentionrat...@sun.cls.nonsystemloaderlockcontentionrat...@sun.cls.jvmFindLoadedClassNoLockCalls?@J8sun.cls.jvmDefineClassNoLockCallsc
>   
> @j8sun.cls.jnidefineclassnolockc...@j8sun.cls.unsafedefineclasscal...@j8sun.cls.isunsyncloadclass...@j8sun.cls.loadInstanceClassFailRatexQB!sun.gc.causeNo
>  GCxQB%sun.gc.lastCauseAllocation 
> failur...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.01??(h...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes...@j8sun.gc.generation.0.agetable.size8b-sun.gc.generation.0.namenew8j0sun.gc.generation.0.spa...@j8sun.gc.generation.0.mincapaci...@j8sun.gc.generation.0.maxCapacityu
>                                                                               
>                                                                               
>                                          @J8sun.gc.generation.0.capacityu
>                            
> 8B,sun.gc.collector.0.namec...@j8sun.gc.collector.0.invocations=8J0sun.gc.collector.0.time???@J8sun.gc.collector.0.lastEntryTime????@J8sun.gc.collector.0.lastExitTime?0??@b5sun.gc.generation.0.space.0.nameede...@sun.gc.generation.0.space.0.maxCapacity?
>        h...@sun.gc.generation.0.space.0.capacity?      
> @J8sun.gc.generation.0.space.0.used?Z?h...@sun.gc.generation.0.space.0.initcapacity8b5sun.gc.generation.0.space.1.names...@sun.gc.generation.0.space.1.maxCapacity>h...@sun.gc.generation.0.space.1.capacity>@J8sun.gc.generation.0.space.1.used??(h...@sun.gc.generation.0.space.1.initcapacity8b5sun.gc.generation.0.space.2.names...@sun.gc.generation.0.space.2.maxCapacity>h...@sun.gc.generation.0.space.2.capacity>@j8sun.gc.generation.0.space.2.use...@sun.gc.generation.0.space.2.initcapacity8b-sun.gc.generation.1.nameold8j0sun.gc.generation.1.spa...@j8sun.gc.generation.1.minCapacity?@J8sun.gc.generation.1.maxCapacity?@J8sun.gc.generation.1.capacity?0B,sun.gc.collector.1.name...@j8sun.gc.collector.1.invocation8j0sun.gc.collector.1.time
>                                                 
> l...@j8sun.gc.collector.1.lastEntryTimet??m...@j8sun.gc.collector.1.lastExitTime?[l...@b5sun.gc.generation.1.space.0.nameol...@sun.gc.generation.1.space.0.maxCapacity?h...@sun.gc.generation.1.space.0.capacity?@J8sun.gc.generation.1.space.0.used??U
> 0J(sun.gc.tlab.fills?8J0sun.gc.tlab.maxFills=0J(sun.gc.tlab.alloc9?W0J(sun.gc.tlab.gcWastenX8J0sun.gc.tlab.maxGcWasteM8J0sun.gc.tlab.slowWaste8J0sun.gc.tlab.maxSlowWasteO
>                                                                               
>                                                                               
>               8J0sun.gc.tlab.fastWasteO8J0sun.gc.tlab.maxFastWaste
>                     8J0sun.gc.tlab.slowAlloc?8J0sun.gc.tlab.maxSlowAlloc~0    
> B'sun.gc.policy.nameCopy:msc8j0sun.gc.policy.collectors8j0sun.gc.policy.generati...@j8sun.gc.policy.maxtenuringthresh...@j8sun.gc.policy.tenuringthresh...@j8sun.gc.policy.desiredSurvivorSize?@j8sun.gc.metaspace.mincapacity8j0sun.gc.metaspace.capaci...@j8sun.gc.metaspace.maxCapacity`A8J0sun.gc.metaspace.used?
> g...@sun.gc.compressedclassspace.mincapacit...@sun.gc.compressedclassspace.capacity...@sun.gc.compressedclassspace.maxCapacity@@J8sun.gc.compressedclassspace.used??-8J0sun.threads.vmOperationTime?Q+??b3sun.ci.compilerthread.0.met...@j8sun.ci.compilerthread.0.type@j8sun.ci.compilerthread.0.t...@j8sun.ci.compilerThread.0.compiles???b3sun.ci.compilerthread.1.met...@j8sun.ci.compilerthread.1.type@J8sun.ci.0J(sun.ci.threads0J(java.ci.totalTimeD?^0J(sun.ci.osrTime????0J(sun.ci.standardTime}??8J0sun.ci.totalBailouts8J0sun.ci.totalInvalidates8J0sun.ci.totalCompiles0J(sun.ci.osrCompilesr8J0sun.ci.standardCompiles?0J(sun.ci.osrBytes?18J0sun.ci.standardBytes)p
>                                                   
> 0J(sun.ci.nmethodSizeP??8J0sun.ci.nmethodCodeSize?El??B&sun.ci.lastMethodjava/io/BufferedOutputStream
>  
> flushBuffer??B,sun.ci.lastFailedMethod??B1sun.ci.lastInvalidatedMethod0J(sun.ci.lastType0J(sun.ci.lastSize8J0sun.ci.lastFailedType8J0sun.ci.lastInvalidatedType8J0sun.os.hrt.frequencyʚ;h...@java.property.java.vm.specification.version1.8`#B=java.property.java.vm.specification.nameJava
>  Virtual Machine 
> SpecificationXB?java.property.java.vm.specification.vendorOracle Corporation@
>                                                                               
>                                              
> B2java.property.java.vm.version25.121-b13X"B/java.property.java.vm.nameJava 
> HotSpot(TM) 64-Bit Server VMHB1java.property.java.vm.vendorOracle Corporation@
>                                                                            
> B/java.property.java.vm.infomixed 
> modex=B4java.property.java.library.path/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib8B2java.property.java.class.path/home/ec2-user/asterixdb/etc:/home/ec2-user/asterixdb/repo/hyracks-util-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/jersey-test-framework-core-1.9.jar:/home/ec2-user/asterixdb/repo/jetty-server-9.3.11.v20160721.jar:/home/ec2-user/asterixdb/repo/grizzly-rcm-2.1.2.jar:/home/ec2-user/asterixdb/repo/hyracks-api-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/slf4j-log4j12-1.7.5.jar:/home/ec2-user/asterixdb/repo/xz-1.0.jar:/home/ec2-user/asterixdb/repo/asterix-lang-common-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/commons-math-2.1.jar:/home/ec2-user/asterixdb/repo/commons-beanutils-1.7.0.jar:/home/ec2-user/asterixdb/repo/asterix-metadata-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/rome-1.0.1-modified-01.jar:/home/ec2-user/asterixdb/repo/asterix-events-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/guava-18.0.jar:/home/ec2-user/asterixdb/repo/hadoop-hdfs-2.2.0.jar:/home/ec2-user/asterixdb/repo/hadoop-mapreduce-client-core-2.2.0.jar:/home/ec2-user/asterixdb/repo/jetty-security-9.3.11.v20160721.jar`(B5java.property.java.endorsed.dirs/usr/java/jdk1.8.0_121/jre/lib/endorsedp>B0java.property.java.ext.dirs/usr/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext@
> B/java.property.java.version1.8.0_121H,java.property.java.home/usr/java/jdk1.8.0_121/jre?FB5sun.property.sun.boot.class.path/usr/java/jdk1.8.0_121/jre/lib/resources.jar:/usr/java/jdk1.8.0_121/jre/lib/rt.jar:/usr/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_121/jre/lib/jsse.jar:/usr/java/jdk1.8.0_121/jre/lib/jce.jar:/usr/java/jdk1.8.0_121/jre/lib/charsets.jar:/usr/java/jdk1.8.0_121/jre/lib/jfr.jar:/usr/java/jdk1.8.0_121/jre/classes`%B7sun.property.sun.boot.library.path/usr/java/jdk1.8.0_121/jre/lib/amd64(B$java.rt.vmFlags??B#java.rt.vmArgs-Xmx598m
>  -Dapp.name=asterixnc -Dapp.pid=3265 -Dapp.repo=/home/ec2-user/asterixdb/repo 
> -Dapp.home=/home/ec2-user/asterixdb 
> -Dbasedir=/home/ec2-user/asterixdb??B'sun.rt.javaCommandorg.apache.hyracks.control.nc.NCDriver
>  -app-nc-main-class 
> org.apache.asterix.hyracks.bootstrap.NCApplicationEntryPoint -config-file 
> /tmp/ncconf5632576373570895499.conf -ncservice-pid 
> 3235??B+sun.rt.internalVersionJava HotSpot(TM) 64-Bit Server VM (25.121-b13) 
> for linux-amd64 JRE (1.8.0_121-b13), built on Dec 12 2016 16:36:53 by 
> "java_re" with gcc 4.3.0 20080428 (Red Hat 
> 4.3.0-8)0J(sun.os.hrt.ticks\?ߠHJ@sun.classloader.parentDelegationTimeK??8J0sun.classloader.findClasses!
> {noformat}
> cat /tmp/hsperfdata_ec2-user/3235
> {noformat}
> ?????=?& 
> ?8j0sun.rt._sync_inflations8j0sun.rt._sync_deflati...@j8sun.rt._sync_ContendedLockAttempts8J0sun.rt._sync_FutileWakeups0J(sun.rt._sync_pa...@j8sun.rt._sync_emptynotifications8j0sun.rt._sync_notifications8j0sun.rt._sync_slowenter8j0sun.rt._sync_slowexit8j0sun.rt._sync_slownotify8j0sun.rt._sync_slownotifyall8j0sun.rt._sync_failedsp...@j8sun.rt._sync_successfulspins8j0sun.rt._sync_privatea8j0sun.rt._sync_priva...@j8sun.rt._sync_MonInCirculation8J0sun.rt._sync_MonScavenged8J0sun.rt._sync_MonExtant?8J0sun.rt.createVmBeginTime?A*Z8J0sun.rt.createVmEndTime7A*Z8J0sun.rt.vmInitDoneTimeA*Z8J0java.threads.started0J(java.threads.live8J0java.threads.livePeak0J(java.threads.daemon8J0sun.rt.safepointSyncTime
> y...@j8sun.rt.threadinterruptsignaled8j0sun.rt.interruptedbeforeio8j0sun.rt.interruptedduringiopab+sun.rt.jvmcapabilities11000000000000000000000000000000000000000000000000000000000000008j0java.cls.loadedclassesv8j0java.cls.unloadedclas...@j8java.cls.sharedloadedclas...@j8java.cls.sharedUnloadedClasses0J(sun.cls.loadedBytes?u!8J0sun.cls.unloadedBytes8J0sun.cls.sharedLoadedBytes8J0sun.cls.sharedUnloadedByt8J0sun.cls.classInitTime.self?͸n8J0sun.cls.classVerifyTime??a...@j8sun.cls.classVerifyTime.self0?8J0sun.cls.classLinkedTimeP?@J8sun.cls.classLinkedTime.self?G?8J0sun.cls.initializedClasses?8J0sun.cls.linkedClasses&8J0sun.cls.verifiedClasses&8J0sun.cls.parseClassTime~??8J0sun.cls.parseClassTime.self??8J0sun.cls.lookupSysClassTime?a8J0sun.cls.sharedClassLoadTime?8J0sun.cls.sysClassLoadTimeǢ?8J0sun.cls.appClassLoadTime??k...@j8sun.cls.appclassloadtime.self$??8J0sun.cls.appClassLoadCount?8j0sun.cls.defineappclassesr8j0sun.cls.defineappclasstim...@j8sun.cls.defineappclasstime.self8j0sun.cls.appClassBytes˪8J0sun.cls.sysClassBytes?7...@sun.cls.systemloaderlockcontentionrat...@sun.cls.nonsystemloaderlockcontentionrat...@sun.cls.jvmFindLoadedClassNoLockCalls"@j8sun.cls.jvmdefineclassnolockcal...@j8sun.cls.jnidefineclassnolockca...@j8sun.cls.unsafedefineclasscal...@j8sun.cls.isunsyncloadclass...@j8sun.cls.loadInstanceClassFailRatexQB!sun.gc.causeNo
>  GCxQB%sun.gc.lastCauseAllocation 
> failur...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.01??h...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.0...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes.1...@sun.gc.generation.0.agetable.bytes...@j8sun.gc.generation.0.agetable.size8b-sun.gc.generation.0.namenew8j0sun.gc.generation.0.spa...@j8sun.gc.generation.0.mincapaci...@j8sun.gc.generation.0.maxcapaci...@j8sun.gc.generation.0.capacityU8B,sun.gc.collector.0.namec...@j8sun.gc.collector.0.invocations8j0sun.gc.collector.0.time?q...@j8sun.gc.collector.0.lastEntryTime#??!@J8sun.gc.collector.0.lastExitTimeƞ?!@b5sun.gc.generation.0.space.0.nameede...@sun.gc.generation.0.space.0.maxcapacity...@sun.gc.generation.0.space.0.capaci...@j8sun.gc.generation.0.space.0.used@?
>                                                                               
>                                                      
> h...@sun.gc.generation.0.space.0.initcapacity8b5sun.gc.generation.0.space.1.names...@sun.gc.generation.0.space.1.maxCapacity?h...@sun.gc.generation.0.space.1.capa...@j8sun.gc.generation.0.space.1.used??h...@sun.gc.generation.0.space.1.initcapacity8b5sun.gc.generation.0.space.2.names...@sun.gc.generation.0.space.2.maxCapacity?h...@sun.gc.generation.0.space.2.capa...@j8sun.gc.generation.0.space.2.use...@sun.gc.generation.0.space.2.initcapacity8b-sun.gc.generation.1.nameold8j0sun.gc.generation.1.spa...@j8sun.gc.generation.1.minCapacity?@J8sun.gc.generation.1.maxCapacityk
> @J8sun.gc.generation.1.capacity?0B,sun.gc.collector.1.name...@j8sun.gc.collector.1.invocations8j0sun.gc.collector.1.time@j8sun.gc.collector.1.lastentryt...@j8sun.gc.collector.1.lastexitt...@b5sun.gc.generation.1.space.0.nameol...@sun.gc.generation.1.space.0.maxCapacityk
> h...@sun.gc.generation.1.space.0.capacity?@J8sun.gc.generation.1.space.0.used??h...@sun.gc.generation.1.space.0.initCapacity?8J0sun.gc.tlab.allocThreads0J(sun.gc.tlab.fills28J0sun.gc.tlab.maxFills10J(sun.gc.tlab.alloc?0J(sun.gc.tlab.gcWaste?8J0sun.gc.tlab.maxGcWaste?8J0sun.gc.tlab.slowWaste?8J0sun.gc.tlab.maxSlowWaste?8J0sun.gc.tlab.fastWaste?8J0sun.gc.tlab.maxFastWaste?8J0sun.gc.tlab.slowAlloc
>                                                                               
>                                                                               
>                                    8J0sun.gc.tlab.maxSlowAlloc
>                 0     
> B'sun.gc.policy.nameCopy:msc8j0sun.gc.policy.collectors8j0sun.gc.policy.generati...@j8sun.gc.policy.maxtenuringthresh...@j8sun.gc.policy.tenuringthresh...@j8sun.gc.policy.desiredsurvivors...@j8sun.gc.metaspace.mincapacity8j0sun.gc.metaspace.capacity`@J8sun.gc.metaspace.maxCapacity?@8J0sun.gc.metaspace.used?-\h...@sun.gc.compressedclassspace.mincapacit...@sun.gc.compressedclassspace.capacity
>            
> h...@sun.gc.compressedclassspace.maxCapacity@@J8sun.gc.compressedclassspace.used
>  ?
> cV??b3sun.ci.compilerthread.0.met...@j8sun.ci.compilerthread.0.type@J8sun.ci.compilerThread.0.time?@J8sun.ci.compilerThread.0.compiles??b3sun.ci.compilerthread.1.met...@j8sun.ci.compilerthread.1.type@J8sun.ci.compilerThread.1.time?@J8sun.ci.compilerThread.1.compiles?0J(sun.ci.threads0J(java.ci.totalTime?u0J(sun.ci.osrTimef?#0J(sun.ci.standardTimez??8J0sun.ci.totalBailouts8J0sun.ci.totalInvalidates8J0sun.ci.totalCompiles?0J(sun.ci.osrCompiles8J0sun.ci.standardCompiles?0J(sun.ci.osrBytesF8J0sun.ci.standardBytes̘0J(sun.ci.nmethodSize@?
>                                                                               
>                                                        
> 8J0sun.ci.nmethodCodeSize@???B&sun.ci.lastMethodsun/invoke/util/BytecodeDescriptor
>  
> unparseSig??B,sun.ci.lastFailedMethod??B1sun.ci.lastInvalidatedMethod0J(sun.ci.lastType0J(sun.ci.lastSize?8J0sun.ci.lastFailedType8J0sun.ci.lastInvalidatedType8J0sun.os.hrt.frequencyʚ;h...@java.property.java.vm.specification.version1.8`#B=java.property.java.vm.specification.nameJava
>  Virtual Machine 
> SpecificationXB?java.property.java.vm.specification.vendorOracle Corporation@
>                                                                               
>                                                                               
>                                
> B2java.property.java.vm.version25.121-b13X"B/java.property.java.vm.nameJava 
> HotSpot(TM) 64-Bit Server VMHB1java.property.java.vm.vendorOracle Corporation@
>                                                                               
>                                                              
> B/java.property.java.vm.infomixed 
> modex=B4java.property.java.library.path/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib8B2java.property.java.class.path/home/ec2-user/asterixdb/etc:/home/ec2-user/asterixdb/repo/hyracks-util-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/jersey-test-framework-core-1.9.jar:/home/ec2-user/asterixdb/repo/jetty-server-9.3.11.v20160721.jar:/home/ec2-user/asterixdb/repo/grizzly-rcm-2.1.2.jar:/home/ec2-user/asterixdb/repo/hyracks-api-0.3.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/slf4j-log4j12-1.7.5.jar:/home/ec2-user/asterixdb/repo/xz-1.0.jar:/home/ec2-user/asterixdb/repo/asterix-lang-common-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/commons-math-2.1.jar:/home/ec2-user/asterixdb/repo/commons-beanutils-1.7.0.jar:/home/ec2-user/asterixdb/repo/asterix-metadata-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/rome-1.0.1-modified-01.jar:/home/ec2-user/asterixdb/repo/asterix-events-0.9.1-SNAPSHOT.jar:/home/ec2-user/asterixdb/repo/guava-18.0.jar:/home/ec2-user/asterixdb/repo/hadoop-hdfs-2.2.0.jar:/home/ec2-user/asterixdb/repo/hadoop-mapreduce-client-core-2.2.0.jar:/home/ec2-user/asterixdb/repo/jetty-security-9.3.11.v20160721.jar`(B5java.property.java.endorsed.dirs/usr/java/jdk1.8.0_121/jre/lib/endorsedp>B0java.property.java.ext.dirs/usr/java/jdk1.8.0_121/jre/lib/ext:/usr/java/packages/lib/ext@
> B/java.property.java.version1.8.0_121H,java.property.java.home/usr/java/jdk1.8.0_121/jre?FB5sun.property.sun.boot.class.path/usr/java/jdk1.8.0_121/jre/lib/resources.jar:/usr/java/jdk1.8.0_121/jre/lib/rt.jar:/usr/java/jdk1.8.0_121/jre/lib/sunrsasign.jar:/usr/java/jdk1.8.0_121/jre/lib/jsse.jar:/usr/java/jdk1.8.0_121/jre/lib/jce.jar:/usr/java/jdk1.8.0_121/jre/lib/charsets.jar:/usr/java/jdk1.8.0_121/jre/lib/jfr.jar:/usr/java/jdk1.8.0_121/jre/classes`%B7sun.property.sun.boot.library.path/usr/java/jdk1.8.0_121/jre/lib/amd64(B$java.rt.vmFlags??B#java.rt.vmArgs-Dapp.name=asterixncservice
>  -Dapp.pid=3235 -Dapp.repo=/home/ec2-user/asterixdb/repo 
> -Dapp.home=/home/ec2-user/asterixdb 
> -Dbasedir=/home/ec2-user/asterixdbX0B'sun.rt.javaCommandorg.apache.hyracks.control.nc.service.NCService??B+sun.rt.internalVersionJava
>  HotSpot(TM) 64-Bit Server VM (25.121-b13) for linux-amd64 JRE 
> (1.8.0_121-b13), built on Dec 12 2016 16:36:53 by "java_re" with gcc 4.3.0 
> 20080428 (Red Hat 
> 4.3.0-8)0J(sun.os.hrt.ticks????6HJ@sun.classloader.parentDelegationTime\??8J0sun.classloader.findClassesO@J8sun.classloader.findClassTimeئ
>                                                                               
>                   
> HJ@sun.urlClassLoader.readClassBytesTimeQ?0J(sun.zip.zipFiles?8J0sun.zip.zipFile.openTime?
> {noformat}
>                                                                               
>                                                                               
>                               



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)