[jira] [Created] (SPARK-20273) No non-deterministic Filter push-down into Join Conditions

Xiao Li created SPARK-20273: --- Summary: No non-deterministic Filter push-down into Join Conditions Key: SPARK-20273 URL: https://issues.apache.org/jira/browse/SPARK-20273 Project: Spark Issue Type:

[jira] [Updated] (SPARK-20273) Disallow Non-deterministic Filter push-down into Join Conditions

[ https://issues.apache.org/jira/browse/SPARK-20273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20273: Summary: Disallow Non-deterministic Filter push-down into Join Conditions (was: No non-deterministic

[jira] [Created] (SPARK-20272) about graph shortestPath algorithm question

huangjunjun created SPARK-20272: --- Summary: about graph shortestPath algorithm question Key: SPARK-20272 URL: https://issues.apache.org/jira/browse/SPARK-20272 Project: Spark Issue Type:

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962455#comment-15962455 ] Saisai Shao commented on SPARK-16742: - Hi [~mgummelt], I'm working on the design of SPARK-19143, by

[jira] [Resolved] (SPARK-20229) add semanticHash to QueryPlan

[ https://issues.apache.org/jira/browse/SPARK-20229?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20229. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17541

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962450#comment-15962450 ] Michael Gummelt commented on SPARK-16742: - Also, note that the above Mesos implementation is not

[jira] [Comment Edited] (SPARK-16742) Kerberos support for Spark on Mesos

[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962440#comment-15962440 ] Michael Gummelt edited comment on SPARK-16742 at 4/10/17 5:28 AM: -- Hi

[jira] [Commented] (SPARK-16742) Kerberos support for Spark on Mesos

[ https://issues.apache.org/jira/browse/SPARK-16742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962440#comment-15962440 ] Michael Gummelt commented on SPARK-16742: - Hi [~vanzin], [~ganger85] and Strat.io are pulling

[jira] [Resolved] (SPARK-20270) na.fill will change the values in long or integer when the default value is in double

[ https://issues.apache.org/jira/browse/SPARK-20270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-20270. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17577

[jira] [Commented] (SPARK-20193) Selecting empty struct causes ExpressionEncoder error.

[ https://issues.apache.org/jira/browse/SPARK-20193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962422#comment-15962422 ] Hyukjin Kwon commented on SPARK-20193: -- Maybe, yea. but I guess we can't change the method signature

[jira] [Closed] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jerry.X.He closed SPARK-20266. -- > ExecutorBackend blocked at "UserGroupInformation.doAs" >

[jira] [Commented] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962415#comment-15962415 ] Jerry.X.He commented on SPARK-20266: [~hyukjin.kwon] thank you, I don't think it is Spark's problem

[jira] [Commented] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962407#comment-15962407 ] Hyukjin Kwon commented on SPARK-20266: -- Please refer "Mailing Lists" in

[jira] [Resolved] (SPARK-20259) Support push down join optimizations in DataFrameReader when loading from JDBC

[ https://issues.apache.org/jira/browse/SPARK-20259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20259. -- Resolution: Duplicate Actually, the title refers pushing down the join. I am resolving this.

[jira] [Commented] (SPARK-20259) Support push down join optimizations in DataFrameReader when loading from JDBC

[ https://issues.apache.org/jira/browse/SPARK-20259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962404#comment-15962404 ] Hyukjin Kwon commented on SPARK-20259: -- If so, I guess it is a duplicate of SPARK-12449. I'd close

[jira] [Commented] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962401#comment-15962401 ] Jerry.X.He commented on SPARK-20266: [~hyukjin.kwon] I'm sorry, I don't know how to ask questions,

[jira] [Resolved] (SPARK-20264) asm should be non-test dependency in sql/core

[ https://issues.apache.org/jira/browse/SPARK-20264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20264. - Resolution: Fixed Fix Version/s: 2.2.0 2.1.2 > asm should be non-test

[jira] [Commented] (SPARK-20259) Support push down join optimizations in DataFrameReader when loading from JDBC

[ https://issues.apache.org/jira/browse/SPARK-20259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962400#comment-15962400 ] Xiao Li commented on SPARK-20259: - Pushing join into JDBC data sources? > Support push down join

[jira] [Updated] (SPARK-20271) Add FuncTransformer to simplify custom transformer creation

[ https://issues.apache.org/jira/browse/SPARK-20271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-20271: --- Description: Just to share some code I implemented to help easily create a custom Transformer in

[jira] [Assigned] (SPARK-20271) Add FuncTransformer to simplify custom transformer creation

[ https://issues.apache.org/jira/browse/SPARK-20271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20271: Assignee: Apache Spark > Add FuncTransformer to simplify custom transformer creation >

[jira] [Assigned] (SPARK-20271) Add FuncTransformer to simplify custom transformer creation

[ https://issues.apache.org/jira/browse/SPARK-20271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20271: Assignee: (was: Apache Spark) > Add FuncTransformer to simplify custom transformer

[jira] [Commented] (SPARK-20271) Add FuncTransformer to simplify custom transformer creation

[ https://issues.apache.org/jira/browse/SPARK-20271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962398#comment-15962398 ] Apache Spark commented on SPARK-20271: -- User 'hhbyyh' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20239) Improve HistoryServer ACL mechanism

[ https://issues.apache.org/jira/browse/SPARK-20239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20239: Assignee: Apache Spark > Improve HistoryServer ACL mechanism >

[jira] [Commented] (SPARK-20239) Improve HistoryServer ACL mechanism

[ https://issues.apache.org/jira/browse/SPARK-20239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962394#comment-15962394 ] Apache Spark commented on SPARK-20239: -- User 'jerryshao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20239) Improve HistoryServer ACL mechanism

[ https://issues.apache.org/jira/browse/SPARK-20239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20239: Assignee: (was: Apache Spark) > Improve HistoryServer ACL mechanism >

[jira] [Created] (SPARK-20271) Add FuncTransformer to simplify custom transformer creation

yuhao yang created SPARK-20271: -- Summary: Add FuncTransformer to simplify custom transformer creation Key: SPARK-20271 URL: https://issues.apache.org/jira/browse/SPARK-20271 Project: Spark

[jira] [Resolved] (SPARK-20253) Remove unnecessary nullchecks of a return value from Spark runtime routines in generated Java code

[ https://issues.apache.org/jira/browse/SPARK-20253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-20253. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17569

[jira] [Assigned] (SPARK-20253) Remove unnecessary nullchecks of a return value from Spark runtime routines in generated Java code

[ https://issues.apache.org/jira/browse/SPARK-20253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-20253: --- Assignee: Kazuaki Ishizaki > Remove unnecessary nullchecks of a return value from Spark

[jira] [Commented] (SPARK-20248) Spark SQL add limit parameter to enhance the reliability.

[ https://issues.apache.org/jira/browse/SPARK-20248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962359#comment-15962359 ] Apache Spark commented on SPARK-20248: -- User 'shaolinliu' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-20251) Spark streaming skips batches in a case of failure

[ https://issues.apache.org/jira/browse/SPARK-20251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962318#comment-15962318 ] Nan Zhu edited comment on SPARK-20251 at 4/10/17 12:16 AM: --- more details here,

[jira] [Commented] (SPARK-20251) Spark streaming skips batches in a case of failure

[ https://issues.apache.org/jira/browse/SPARK-20251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962318#comment-15962318 ] Nan Zhu commented on SPARK-20251: - more details here, by "be proceeding", I mean it is expected that the

[jira] [Comment Edited] (SPARK-20251) Spark streaming skips batches in a case of failure

[ https://issues.apache.org/jira/browse/SPARK-20251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962313#comment-15962313 ] Nan Zhu edited comment on SPARK-20251 at 4/9/17 11:57 PM: -- why this is an

[jira] [Commented] (SPARK-20251) Spark streaming skips batches in a case of failure

[ https://issues.apache.org/jira/browse/SPARK-20251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962313#comment-15962313 ] Nan Zhu commented on SPARK-20251: - why this is an invalid report? I have been observing the same behavior

[jira] [Assigned] (SPARK-20260) MLUtils parseLibSVMRecord has incorrect string interpolation for error message

[ https://issues.apache.org/jira/browse/SPARK-20260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20260: - Assignee: Vijay Krishna Ramesh Priority: Minor (was: Trivial) > MLUtils parseLibSVMRecord

[jira] [Resolved] (SPARK-20260) MLUtils parseLibSVMRecord has incorrect string interpolation for error message

[ https://issues.apache.org/jira/browse/SPARK-20260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20260. --- Resolution: Fixed Fix Version/s: 2.1.2 2.2.0 Issue resolved by pull

[jira] [Comment Edited] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962160#comment-15962160 ] Hyukjin Kwon edited comment on SPARK-20266 at 4/9/17 3:21 PM: -- I am

[jira] [Resolved] (SPARK-20266) ExecutorBackend blocked at "UserGroupInformation.doAs"

[ https://issues.apache.org/jira/browse/SPARK-20266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20266. -- Resolution: Invalid I am resolving this as It sounds like a question and questions should be

[jira] [Commented] (SPARK-10931) PySpark ML Models should contain Param values

[ https://issues.apache.org/jira/browse/SPARK-10931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962141#comment-15962141 ] Maciej Szymkiewicz commented on SPARK-10931: [~vlad.feinberg] It is worth noting that without

[jira] [Updated] (SPARK-20269) add JavaWordCountProducer in steaming examples

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20269: --- Description: 1.run example of streaming kafka,currently missing java word count producer,not

[jira] [Updated] (SPARK-20269) add java class 'JavaWordCountProducer' to 'provide java word count producer'.

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20269: --- Summary: add java class 'JavaWordCountProducer' to 'provide java word count producer'.

[jira] [Resolved] (SPARK-20268) Arbitrary RDD element (Fast return) instead of using first

[ https://issues.apache.org/jira/browse/SPARK-20268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20268. --- Resolution: Not A Problem > Arbitrary RDD element (Fast return) instead of using first >

[jira] [Reopened] (SPARK-20268) Arbitrary RDD element (Fast return) instead of using first

[ https://issues.apache.org/jira/browse/SPARK-20268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-20268: --- > Arbitrary RDD element (Fast return) instead of using first >

[jira] [Commented] (SPARK-20269) add JavaWordCountProducer in steaming examples

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962101#comment-15962101 ] guoxiaolongzte commented on SPARK-20269: https://github.com/apache/spark/pull/17578 is invalid.I

[jira] [Closed] (SPARK-20268) Arbitrary RDD element (Fast return) instead of using first

[ https://issues.apache.org/jira/browse/SPARK-20268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hayri Volkan Agun closed SPARK-20268. - Resolution: Fixed > Arbitrary RDD element (Fast return) instead of using first >

[jira] [Commented] (SPARK-20268) Arbitrary RDD element (Fast return) instead of using first

[ https://issues.apache.org/jira/browse/SPARK-20268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962098#comment-15962098 ] Hayri Volkan Agun commented on SPARK-20268: --- Hi Owen, If the first element is the fastest

[jira] [Commented] (SPARK-20269) add JavaWordCountProducer in steaming examples

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962088#comment-15962088 ] Apache Spark commented on SPARK-20269: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Commented] (SPARK-20269) add JavaWordCountProducer in steaming examples

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962084#comment-15962084 ] Apache Spark commented on SPARK-20269: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-20269) add JavaWordCountProducer in steaming examples

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20269: Assignee: Apache Spark > add JavaWordCountProducer in steaming examples >

[jira] [Assigned] (SPARK-20269) add JavaWordCountProducer in steaming examples

[ https://issues.apache.org/jira/browse/SPARK-20269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20269: Assignee: (was: Apache Spark) > add JavaWordCountProducer in steaming examples >

[jira] [Assigned] (SPARK-20270) na.fill will change the values in long or integer when the default value is in double

[ https://issues.apache.org/jira/browse/SPARK-20270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20270: Assignee: Apache Spark (was: DB Tsai) > na.fill will change the values in long or

[jira] [Assigned] (SPARK-20270) na.fill will change the values in long or integer when the default value is in double

[ https://issues.apache.org/jira/browse/SPARK-20270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20270: Assignee: DB Tsai (was: Apache Spark) > na.fill will change the values in long or

[jira] [Commented] (SPARK-20270) na.fill will change the values in long or integer when the default value is in double

[ https://issues.apache.org/jira/browse/SPARK-20270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15962065#comment-15962065 ] Apache Spark commented on SPARK-20270: -- User 'dbtsai' has created a pull request for this issue:

[jira] [Created] (SPARK-20270) na.fill will change the values in long or integer when the default value is in double

DB Tsai created SPARK-20270: --- Summary: na.fill will change the values in long or integer when the default value is in double Key: SPARK-20270 URL: https://issues.apache.org/jira/browse/SPARK-20270 Project:

[jira] [Assigned] (SPARK-19991) FileSegmentManagedBuffer performance improvement.

[ https://issues.apache.org/jira/browse/SPARK-19991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-19991: - Assignee: Sean Owen > FileSegmentManagedBuffer performance improvement. >

[jira] [Resolved] (SPARK-19991) FileSegmentManagedBuffer performance improvement.

[ https://issues.apache.org/jira/browse/SPARK-19991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-19991. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17567

[jira] [Created] (SPARK-20269) add JavaWordCountProducer in steaming examples

guoxiaolongzte created SPARK-20269: -- Summary: add JavaWordCountProducer in steaming examples Key: SPARK-20269 URL: https://issues.apache.org/jira/browse/SPARK-20269 Project: Spark Issue