Re: griffin job crashed due to OOM
Hi Juan, Thanks for your question. I will follow this issue. Thanks, William On Wed, Jul 11, 2018 at 11:42 AM, jenny li wrote: > Hi Experts, > > our griffin job stopped running reporting OOM error as below: > > ```save source data count: 6672 > > write path: hdfs:///griffin/streaming/pri7406in/dump/source/new > > # > >1. There is insufficient memory for the Java Runtime Environment to >continue. > > >1. Native memory allocation (mmap) failed to map 12288 bytes for >committing reserved memory. > > >1. An error report file with more information is saved as: > > /home/relmgmt/griffin-job/pri7406in/hs_err_pid12123.log``` > > attached the hs_err_pid12123.log > > > and we manually start a griffin job with: > > *spark-submit --class org.apache.griffin.measure.Application --master yarn > --deploy-mode client --queue default --driver-memory 512m --executor-memory > 512m --num-executors 3 --conf > "spark.driver.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf" > --conf > "spark.executor.extraJavaOptions=-Djava.security.auth.login.config=jaas.conf" > --files "jaas.conf,keystore.jks,truststore.jks" > griffin-measure-rheos-test.jar env.json config.json local,local* > > would you please help to check? many thanks > > I created a jira ticket for it as well: https://issues.apache. > org/jira/browse/GRIFFIN-176 > > BR- > Juan > >
[jira] [Commented] (GRIFFIN-178) [UI] job state not update after performing start/stop actions on job page
[ https://issues.apache.org/jira/browse/GRIFFIN-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540167#comment-16540167 ] ASF GitHub Bot commented on GRIFFIN-178: GitHub user icesmartjuan opened a pull request: https://github.com/apache/incubator-griffin/pull/346 GRIFFIN-178 - job state not update after performing start/stop actions on job page GRIFFIN-178 - job state not update after performing start/stop actions on job page You can merge this pull request into a Git repository by running: $ git pull https://github.com/icesmartjuan/incubator-griffin bug/job_state_auto_refresh Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-griffin/pull/346.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #346 commit bdfca096317edcfb5ec448bf36ddbc30286518f3 Author: Li, Juan Date: 2018-07-11T09:41:15Z fix job state incorrect commit 76ed1379223b832eb4a24031724e95905068e3be Author: Li, Juan Date: 2018-07-11T14:27:36Z fix job state display abnormal issue > [UI] job state not update after performing start/stop actions on job page > - > > Key: GRIFFIN-178 > URL: https://issues.apache.org/jira/browse/GRIFFIN-178 > Project: Griffin (Incubating) > Issue Type: Bug >Reporter: Juan Li >Assignee: Juan Li >Priority: Major > Attachments: 178.png > > > job state is not update properly after performing start/stop job action, > still previouse state > attached issue snapshot > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] incubator-griffin pull request #346: GRIFFIN-178 - job state not update afte...
GitHub user icesmartjuan opened a pull request: https://github.com/apache/incubator-griffin/pull/346 GRIFFIN-178 - job state not update after performing start/stop actions on job page GRIFFIN-178 - job state not update after performing start/stop actions on job page You can merge this pull request into a Git repository by running: $ git pull https://github.com/icesmartjuan/incubator-griffin bug/job_state_auto_refresh Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-griffin/pull/346.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #346 commit bdfca096317edcfb5ec448bf36ddbc30286518f3 Author: Li, Juan Date: 2018-07-11T09:41:15Z fix job state incorrect commit 76ed1379223b832eb4a24031724e95905068e3be Author: Li, Juan Date: 2018-07-11T14:27:36Z fix job state display abnormal issue ---
[jira] [Updated] (GRIFFIN-178) [UI] job state not update after performing start/stop actions on job page
[ https://issues.apache.org/jira/browse/GRIFFIN-178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Li updated GRIFFIN-178: Attachment: 178.png > [UI] job state not update after performing start/stop actions on job page > - > > Key: GRIFFIN-178 > URL: https://issues.apache.org/jira/browse/GRIFFIN-178 > Project: Griffin (Incubating) > Issue Type: Bug >Reporter: Juan Li >Assignee: Juan Li >Priority: Major > Attachments: 178.png > > > job state is not update properly after performing start/stop job action, > still previouse state > attached issue snapshot > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Updated] (GRIFFIN-178) [UI] job state not update after performing start/stop actions on job page
[ https://issues.apache.org/jira/browse/GRIFFIN-178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Li updated GRIFFIN-178: Description: job state is not update properly after performing start/stop job action, still previouse state attached issue snapshot > [UI] job state not update after performing start/stop actions on job page > - > > Key: GRIFFIN-178 > URL: https://issues.apache.org/jira/browse/GRIFFIN-178 > Project: Griffin (Incubating) > Issue Type: Bug >Reporter: Juan Li >Assignee: Juan Li >Priority: Major > Attachments: 178.png > > > job state is not update properly after performing start/stop job action, > still previouse state > attached issue snapshot > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Assigned] (GRIFFIN-178) [UI] job state not update after performing start/stop actions on job page
[ https://issues.apache.org/jira/browse/GRIFFIN-178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Li reassigned GRIFFIN-178: --- Assignee: Juan Li > [UI] job state not update after performing start/stop actions on job page > - > > Key: GRIFFIN-178 > URL: https://issues.apache.org/jira/browse/GRIFFIN-178 > Project: Griffin (Incubating) > Issue Type: Bug >Reporter: Juan Li >Assignee: Juan Li >Priority: Major > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GRIFFIN-178) [UI] job state not update after performing start/stop actions on job page
Juan Li created GRIFFIN-178: --- Summary: [UI] job state not update after performing start/stop actions on job page Key: GRIFFIN-178 URL: https://issues.apache.org/jira/browse/GRIFFIN-178 Project: Griffin (Incubating) Issue Type: Bug Reporter: Juan Li -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[GitHub] incubator-griffin pull request #345: Head option
GitHub user toyboxman opened a pull request: https://github.com/apache/incubator-griffin/pull/345 Head option You can merge this pull request into a Git repository by running: $ git pull https://github.com/toyboxman/incubator-griffin headOption Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-griffin/pull/345.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #345 commit 4200bfc3b34a0dec54b975aeeba3b53cf290d064 Author: Eugene Date: 2018-07-05T00:54:19Z add scala static analysis plugin commit cd523f423e0e01db29c6457ffd49fd13c86ce84f Author: Eugene Date: 2018-07-11T09:54:44Z Refactor Fix some static analysis errors after integrated with scala codes quality plugin ---
[jira] [Assigned] (GRIFFIN-177) [UI] measure page wrong display
[
https://issues.apache.org/jira/browse/GRIFFIN-177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Juan Li reassigned GRIFFIN-177:
---
Assignee: Juan Li
> [UI] measure page wrong display
>
>
> Key: GRIFFIN-177
> URL: https://issues.apache.org/jira/browse/GRIFFIN-177
> Project: Griffin (Incubating)
> Issue Type: Bug
>Reporter: Juan Li
>Assignee: Juan Li
>Priority: Major
> Attachments: 177.png
>
>
> found measure page wrongly displayed attached the symptom
> root cause: \{{row["dq.type"].toLowerCase()}} in
> measure.component.html causing infinite loading if row["dq.type"] is null
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[GitHub] incubator-griffin pull request #344: GRIFFIN-177 - fix measure page display ...
GitHub user icesmartjuan opened a pull request: https://github.com/apache/incubator-griffin/pull/344 GRIFFIN-177 - fix measure page display issue GRIFFIN-177 - fix measure page display issue You can merge this pull request into a Git repository by running: $ git pull https://github.com/icesmartjuan/incubator-griffin bug/measure_display Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-griffin/pull/344.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #344 commit c56cab5f139c28094d5c09718989ef6104aaedf1 Author: Li, Juan Date: 2018-07-11T08:36:43Z fix measure page display issue ---
[jira] [Commented] (GRIFFIN-177) [UI] measure page wrong display
[
https://issues.apache.org/jira/browse/GRIFFIN-177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16539729#comment-16539729
]
ASF GitHub Bot commented on GRIFFIN-177:
GitHub user icesmartjuan opened a pull request:
https://github.com/apache/incubator-griffin/pull/344
GRIFFIN-177 - fix measure page display issue
GRIFFIN-177 - fix measure page display issue
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/icesmartjuan/incubator-griffin
bug/measure_display
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-griffin/pull/344.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #344
commit c56cab5f139c28094d5c09718989ef6104aaedf1
Author: Li, Juan
Date: 2018-07-11T08:36:43Z
fix measure page display issue
> [UI] measure page wrong display
>
>
> Key: GRIFFIN-177
> URL: https://issues.apache.org/jira/browse/GRIFFIN-177
> Project: Griffin (Incubating)
> Issue Type: Bug
>Reporter: Juan Li
>Priority: Major
> Attachments: 177.png
>
>
> found measure page wrongly displayed attached the symptom
> root cause: \{{row["dq.type"].toLowerCase()}} in
> measure.component.html causing infinite loading if row["dq.type"] is null
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (GRIFFIN-177) [UI] measure page wrong display
[
https://issues.apache.org/jira/browse/GRIFFIN-177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Juan Li updated GRIFFIN-177:
Attachment: 177.png
> [UI] measure page wrong display
>
>
> Key: GRIFFIN-177
> URL: https://issues.apache.org/jira/browse/GRIFFIN-177
> Project: Griffin (Incubating)
> Issue Type: Bug
>Reporter: Juan Li
>Priority: Major
> Attachments: 177.png
>
>
> found measure page wrongly displayed attached the symptom
> root cause: \{{row["dq.type"].toLowerCase()}} in
> measure.component.html causing infinite loading if row["dq.type"] is null
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (GRIFFIN-177) [UI] measure page wrong display
[
https://issues.apache.org/jira/browse/GRIFFIN-177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Juan Li updated GRIFFIN-177:
Description:
found measure page wrongly displayed attached the symptom
root cause: \{{row["dq.type"].toLowerCase()}} in
measure.component.html causing infinite loading if row["dq.type"] is null
was:
found measure page wrongly displayed attached the symptom
> [UI] measure page wrong display
>
>
> Key: GRIFFIN-177
> URL: https://issues.apache.org/jira/browse/GRIFFIN-177
> Project: Griffin (Incubating)
> Issue Type: Bug
>Reporter: Juan Li
>Priority: Major
> Attachments: 177.png
>
>
> found measure page wrongly displayed attached the symptom
> root cause: \{{row["dq.type"].toLowerCase()}} in
> measure.component.html causing infinite loading if row["dq.type"] is null
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Updated] (GRIFFIN-177) [UI] measure page wrong display
[ https://issues.apache.org/jira/browse/GRIFFIN-177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Juan Li updated GRIFFIN-177: Description: found measure page wrongly displayed attached the symptom > [UI] measure page wrong display > > > Key: GRIFFIN-177 > URL: https://issues.apache.org/jira/browse/GRIFFIN-177 > Project: Griffin (Incubating) > Issue Type: Bug >Reporter: Juan Li >Priority: Major > > found measure page wrongly displayed attached the symptom > -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Created] (GRIFFIN-177) [UI] measure page wrong display
Juan Li created GRIFFIN-177: --- Summary: [UI] measure page wrong display Key: GRIFFIN-177 URL: https://issues.apache.org/jira/browse/GRIFFIN-177 Project: Griffin (Incubating) Issue Type: Bug Reporter: Juan Li -- This message was sent by Atlassian JIRA (v7.6.3#76005)
