[
https://issues.apache.org/jira/browse/GRIFFIN-176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Juan Li updated GRIFFIN-176:
----------------------------
Description:
our griffin streaming job stopped reporting OOM error as below:
```save source data count: 6672
write path: hdfs:///griffin/streaming/pri7406in/dump/source/new
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 12288 bytes for committing
reserved memory.
# An error report file with more information is saved as:
/home/relmgmt/griffin-job/pri7406in/hs_err_pid12123.log```
attached corresponding hs_err_pid12123.log file
we manually start a griffin job with:
```
spark-submit --class org.apache.griffin.measure.Application --master yarn
--deploy-mode client --queue default --driver-memory 512m --executor-memory
512m --num-executors 3 --conf
"spark.driver.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf"
--conf
"spark.executor.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf"
--files "jaas.conf,keystore.jks,truststore.jks" griffin-measure-rheos-test.jar
env.json config.json local,local
````
was:
our griffin streaming job stopped reporting OOM error as below:
```save source data count: 6672
write path: hdfs:///griffin/streaming/pri7406in/dump/source/new
#
# There is insufficient memory for the Java Runtime Environment to continue.
# Native memory allocation (mmap) failed to map 12288 bytes for committing
reserved memory.
# An error report file with more information is saved as:
/home/relmgmt/griffin-job/pri7406in/hs_err_pid12123.log```
attached corresponding hs_err_pid12123.log file
> [measure] griffin streaming job stopped due to OOM
> --------------------------------------------------
>
> Key: GRIFFIN-176
> URL: https://issues.apache.org/jira/browse/GRIFFIN-176
> Project: Griffin (Incubating)
> Issue Type: Task
> Reporter: Juan Li
> Priority: Major
> Attachments: hs_err_pid12123.log
>
>
> our griffin streaming job stopped reporting OOM error as below:
> ```save source data count: 6672
> write path: hdfs:///griffin/streaming/pri7406in/dump/source/new
> #
> # There is insufficient memory for the Java Runtime Environment to continue.
> # Native memory allocation (mmap) failed to map 12288 bytes for committing
> reserved memory.
> # An error report file with more information is saved as:
> /home/relmgmt/griffin-job/pri7406in/hs_err_pid12123.log```
> attached corresponding hs_err_pid12123.log file
>
> we manually start a griffin job with:
> ```
> spark-submit --class org.apache.griffin.measure.Application --master yarn
> --deploy-mode client --queue default --driver-memory 512m --executor-memory
> 512m --num-executors 3 --conf
> "spark.driver.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf"
> --conf
> "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf"
> --files "jaas.conf,keystore.jks,truststore.jks"
> griffin-measure-rheos-test.jar env.json config.json local,local
> ````
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
