[jira] [Resolved] (SPARK-21579) dropTempView has a critical BUG

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21579. --- Resolution: Not A Problem > dropTempView has a critical BUG > --- > >

[jira] [Updated] (SPARK-21591) Implement treeAggregate on Dataset API

2017-08-01 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-21591: Description: The Tungsten execution engine substantially improved the efficiency of memory and

[jira] [Created] (SPARK-21592) Skip maven-compiler-plugin main and test compilations in Maven build

2017-08-01 Thread Grzegorz Slowikowski (JIRA)
Grzegorz Slowikowski created SPARK-21592: Summary: Skip maven-compiler-plugin main and test compilations in Maven build Key: SPARK-21592 URL: https://issues.apache.org/jira/browse/SPARK-21592

[jira] [Resolved] (SPARK-21522) Flaky test: LauncherServerSuite.testStreamFiltering

2017-08-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-21522. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.3.0

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109311#comment-16109311 ] Sean Owen commented on SPARK-650: - I still don't see an argument against my primary suggestion: the

[jira] [Resolved] (SPARK-20079) Re registration of AM hangs spark cluster in yarn-client mode

2017-08-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-20079. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.3.0 > Re

[jira] [Commented] (SPARK-650) Add a "setup hook" API for running initialization code on each executor

2017-08-01 Thread Louis Bergelson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109179#comment-16109179 ] Louis Bergelson commented on SPARK-650: --- I can't understand how people are dismissing this as not an

[jira] [Updated] (SPARK-20657) Speed up Stage page

2017-08-01 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-20657: --- Description: The Stage page in the UI is very slow when a large number of tasks exist (tens

[jira] [Created] (SPARK-21590) Structured Streaming window start time should support negative values to adjust time zone

2017-08-01 Thread Kevin Zhang (JIRA)
Kevin Zhang created SPARK-21590: --- Summary: Structured Streaming window start time should support negative values to adjust time zone Key: SPARK-21590 URL: https://issues.apache.org/jira/browse/SPARK-21590

[jira] [Resolved] (SPARK-21593) Fix broken configuration page

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21593. --- Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 Issue resolved by pull

[jira] [Commented] (SPARK-21573) Tests failing with run-tests.py SyntaxError occasionally in Jenkins

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109440#comment-16109440 ] Sean Owen commented on SPARK-21573: --- FWIW I noticed it fails on 4 and 7 but not on 6. Go ahead with

[jira] [Resolved] (SPARK-21592) Skip maven-compiler-plugin main and test compilations in Maven build

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21592. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18750

[jira] [Assigned] (SPARK-21593) Fix broken configuration page

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21593: - Assignee: Sean Owen > Fix broken configuration page > - > >

[jira] [Assigned] (SPARK-21592) Skip maven-compiler-plugin main and test compilations in Maven build

2017-08-01 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21592: - Assignee: Grzegorz Slowikowski > Skip maven-compiler-plugin main and test compilations in Maven

[jira] [Created] (SPARK-21596) Audit the places calling HDFSMetadataLog.get

2017-08-01 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-21596: Summary: Audit the places calling HDFSMetadataLog.get Key: SPARK-21596 URL: https://issues.apache.org/jira/browse/SPARK-21596 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-21573) Tests failing with run-tests.py SyntaxError occasionally in Jenkins

2017-08-01 Thread shane knapp (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16109465#comment-16109465 ] shane knapp commented on SPARK-21573: - i'm chatting w/@joshrosen @ 130pm to discuss how to proceed.

[jira] [Resolved] (SPARK-21589) Add documents about unsupported functions in Hive UDF/UDTF/UDAF

2017-08-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21589. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > Add documents about

[jira] [Updated] (SPARK-21579) dropTempView has a critical BUG

2017-08-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-21579: Issue Type: Improvement (was: Bug) > dropTempView has a critical BUG > --- >

[jira] [Commented] (SPARK-21579) dropTempView has a critical BUG

2017-08-01 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16108440#comment-16108440 ] Xiao Li commented on SPARK-21579: - Like what I said in the PR. Correctness is more important for us. The

<    1   2