[jira] [Commented] (SPARK-18085) SPIP: Better History Server scalability for many / large applications

2017-08-12 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124731#comment-16124731 ] Marcelo Vanzin commented on SPARK-18085: [~duyanghao] that should all be explained in the

[jira] [Assigned] (SPARK-21709) use sbt 0.13.16 and update sbt plugins

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-21709: - Assignee: PJ Fanning > use sbt 0.13.16 and update sbt plugins >

[jira] [Resolved] (SPARK-21709) use sbt 0.13.16 and update sbt plugins

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-21709. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 18921

[jira] [Updated] (SPARK-21716) The time-range window can't be applied on the reduce operator

2017-08-12 Thread Fan Donglai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Donglai updated SPARK-21716: Summary: The time-range window can't be applied on the reduce operator (was: The time-range

[jira] [Updated] (SPARK-21716) The time-range window can't be applid on the reduce operator

2017-08-12 Thread Fan Donglai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fan Donglai updated SPARK-21716: Description: I can't use GroupBy + Window operator to get the newest(the maximum event time) row

[jira] [Created] (SPARK-21716) The time-range window can't be applid on the reduce operator

2017-08-12 Thread Fan Donglai (JIRA)
Fan Donglai created SPARK-21716: --- Summary: The time-range window can't be applid on the reduce operator Key: SPARK-21716 URL: https://issues.apache.org/jira/browse/SPARK-21716 Project: Spark

[jira] [Comment Edited] (SPARK-5564) Support sparse LDA solutions

2017-08-12 Thread Valeriy Avanesov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16123803#comment-16123803 ] Valeriy Avanesov edited comment on SPARK-5564 at 8/12/17 10:29 AM: --- I am

[jira] [Commented] (SPARK-21691) Accessing canonicalized plan for query with limit throws exception

2017-08-12 Thread Anton Okolnychyi (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21691?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124532#comment-16124532 ] Anton Okolnychyi commented on SPARK-21691: -- The issue is related to `Project \[\*\]` but not to

[jira] [Commented] (SPARK-14371) OnlineLDAOptimizer should not collect stats for each doc in mini-batch to driver

2017-08-12 Thread Valeriy Avanesov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124531#comment-16124531 ] Valeriy Avanesov commented on SPARK-14371: -- Hi, I've opened a PR regarding this Jira yesterday

[jira] [Commented] (SPARK-21711) spark-submit command should accept log4j configuration parameters for spark client logging.

2017-08-12 Thread Mahesh Ambule (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124529#comment-16124529 ] Mahesh Ambule commented on SPARK-21711: --- Sean Owen: I figured out a way to configure the log4j

[jira] [Updated] (SPARK-21655) Kill CLI for Yarn mode

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21655: -- Target Version/s: (was: 2.1.1) Fix Version/s: (was: 2.1.1) > Kill CLI for Yarn mode >

[jira] [Updated] (SPARK-21715) History Server respondes history page html content multiple times for only one http request

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21715: -- Affects Version/s: (was: 2.3.0) Target Version/s: (was: 2.3.0) Fix Version/s:

[jira] [Updated] (SPARK-21694) Support Mesos CNI network labels

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21694: -- Priority: Minor (was: Major) Fix Version/s: (was: 2.3.0) > Support Mesos CNI network

[jira] [Updated] (SPARK-21715) History Server respondes history page html content multiple times for only one http request

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21715: -- Issue Type: Improvement (was: Bug) > History Server respondes history page html content multiple

[jira] [Updated] (SPARK-21687) Spark SQL should set createTime for Hive partition

2017-08-12 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21687: -- Target Version/s: (was: 2.3.0) Priority: Minor (was: Major) Fix Version/s:

[jira] [Commented] (SPARK-17025) Cannot persist PySpark ML Pipeline model that includes custom Transformer

2017-08-12 Thread Peter Knight (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124496#comment-16124496 ] Peter Knight commented on SPARK-17025: -- Thank you for your e-mail. I am on holiday until Monday

[jira] [Commented] (SPARK-17025) Cannot persist PySpark ML Pipeline model that includes custom Transformer

2017-08-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16124493#comment-16124493 ] Joseph K. Bradley commented on SPARK-17025: --- [~nchammas] I just merged