[jira] [Updated] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-25717: -- Description: Consider the following scenario: {code:java} spark.range(100).createTempView("temp") (0 u

[jira] [Created] (SPARK-25717) Insert overwrite a recreated external and partitioned table may result in incorrect query results

2018-10-12 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-25717: - Summary: Insert overwrite a recreated external and partitioned table may result in incorrect query results Key: SPARK-25717 URL: https://issues.apache.org/jira/browse/SPARK-25717

[jira] [Created] (SPARK-25701) Supports calculation of table statistics from partition's catalog statistics

2018-10-10 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-25701: - Summary: Supports calculation of table statistics from partition's catalog statistics Key: SPARK-25701 URL: https://issues.apache.org/jira/browse/SPARK-25701 Project: Spark

[jira] [Updated] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string

2018-09-11 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-25404: -- Description: Considering the follow scenario:   {code:java} SET hive.exec.stagingdir=temp; CREATE TAB

[jira] [Updated] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string

2018-09-11 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-25404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-25404: -- Description: Considering the follow scenario:   {code:java} SET hive.exec.stagingdir=temp; CREATE TAB

[jira] [Created] (SPARK-25404) Staging path may not on the expected place when table path contains the stagingDir string

2018-09-11 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-25404: - Summary: Staging path may not on the expected place when table path contains the stagingDir string Key: SPARK-25404 URL: https://issues.apache.org/jira/browse/SPARK-25404 P

[jira] [Updated] (SPARK-20758) Add Constant propagation optimization

2018-05-17 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20758: -- Issue Type: New JIRA Project (was: Improvement) > Add Constant propagation optimization >

[jira] [Created] (SPARK-21786) The 'spark.sql.parquet.compression.codec' configuration doesn't take effect on tables with partition field(s)

2017-08-18 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-21786: - Summary: The 'spark.sql.parquet.compression.codec' configuration doesn't take effect on tables with partition field(s) Key: SPARK-21786 URL: https://issues.apache.org/jira/browse/SPARK-

[jira] [Created] (SPARK-21135) On history server page,duration of incompleted applications should be hidden instead of showing up as 0

2017-06-19 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-21135: - Summary: On history server page,duration of incompleted applications should be hidden instead of showing up as 0 Key: SPARK-21135 URL: https://issues.apache.org/jira/browse/SPARK-21135

[jira] [Updated] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

2017-06-08 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-21018: -- Description: When using Thriftsever, the number of jobs and Stages may be very large, and if not pagin

[jira] [Updated] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

2017-06-08 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-21018: -- Attachment: PagedTasks.png > "Completed Jobs" and "Completed Stages" support pagination > -

[jira] [Updated] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

2017-06-08 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-21018: -- Attachment: CompletedJobs.png > "Completed Jobs" and "Completed Stages" support pagination > --

[jira] [Created] (SPARK-21018) "Completed Jobs" and "Completed Stages" support pagination

2017-06-08 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-21018: - Summary: "Completed Jobs" and "Completed Stages" support pagination Key: SPARK-21018 URL: https://issues.apache.org/jira/browse/SPARK-21018 Project: Spark Issue Ty

[jira] [Commented] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-04 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996681#comment-15996681 ] Jinhua Fu commented on SPARK-20591: --- Does it need modify and may I take this PR? > Suc

[jira] [Updated] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-04 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20591: -- Description: when spark.speculation is enabled,and there are some speculative tasks, then we can see s

[jira] [Updated] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-04 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20591: -- Attachment: job detail page(stages).png > Succeeded tasks num not equal in job page and job detail page

[jira] [Updated] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-04 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20591: -- Attachment: (was: screenshot-1.png) > Succeeded tasks num not equal in job page and job detail page

[jira] [Updated] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-04 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20591: -- Attachment: screenshot-1.png > Succeeded tasks num not equal in job page and job detail page on spark w

[jira] [Updated] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-04 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20591: -- Attachment: job page.png > Succeeded tasks num not equal in job page and job detail page on spark web u

[jira] [Created] (SPARK-20591) Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist

2017-05-03 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-20591: - Summary: Succeeded tasks num not equal in job page and job detail page on spark web ui when speculative task(s) exist Key: SPARK-20591 URL: https://issues.apache.org/jira/browse/SPARK-2

[jira] [Updated] (SPARK-20150) Add permsize statistics for worker memory which may be very useful for the memory usage assessment

2017-03-29 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinhua Fu updated SPARK-20150: -- Summary: Add permsize statistics for worker memory which may be very useful for the memory usage assess

[jira] [Created] (SPARK-20150) Can the spark add a mechanism for permsize statistics which may be very useful for the memory usage assessment

2017-03-29 Thread Jinhua Fu (JIRA)
Jinhua Fu created SPARK-20150: - Summary: Can the spark add a mechanism for permsize statistics which may be very useful for the memory usage assessment Key: SPARK-20150 URL: https://issues.apache.org/jira/browse/SPARK

[jira] [Comment Edited] (SPARK-20120) spark-sql CLI support silent mode

2017-03-27 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944635#comment-15944635 ] Jinhua Fu edited comment on SPARK-20120 at 3/28/17 6:51 AM: G

[jira] [Commented] (SPARK-20120) spark-sql CLI support silent mode

2017-03-27 Thread Jinhua Fu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15944635#comment-15944635 ] Jinhua Fu commented on SPARK-20120: --- Good idea.I agree with you! > spark-sql CLI suppo