[jira] [Commented] (SPARK-11654) add reduce to GroupedDataset

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003671#comment-15003671 ] Apache Spark commented on SPARK-11654: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-11677) ORC filter tests all pass if filters are actually not pushed down.

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11677: Assignee: Apache Spark > ORC filter tests all pass if filters are actually not pushed down

[jira] [Assigned] (SPARK-11677) ORC filter tests all pass if filters are actually not pushed down.

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11677: Assignee: (was: Apache Spark) > ORC filter tests all pass if filters are actually not

[jira] [Commented] (SPARK-11677) ORC filter tests all pass if filters are actually not pushed down.

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11677?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003670#comment-15003670 ] Apache Spark commented on SPARK-11677: -- User 'HyukjinKwon' has created a pull reques

[jira] [Assigned] (SPARK-11724) Casting integer types to timestamp has unexpected semantics

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11724: Assignee: Apache Spark > Casting integer types to timestamp has unexpected semantics > ---

[jira] [Commented] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003666#comment-15003666 ] Apache Spark commented on SPARK-8029: - User 'davies' has created a pull request for th

[jira] [Commented] (SPARK-11724) Casting integer types to timestamp has unexpected semantics

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003665#comment-15003665 ] Apache Spark commented on SPARK-11724: -- User 'nongli' has created a pull request for

[jira] [Assigned] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-11-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-8029: - Assignee: Davies Liu (was: Imran Rashid) > ShuffleMapTasks must be robust to concurrent attempts

[jira] [Assigned] (SPARK-11724) Casting integer types to timestamp has unexpected semantics

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11724: Assignee: (was: Apache Spark) > Casting integer types to timestamp has unexpected sema

[jira] [Updated] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-11-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8029: -- Fix Version/s: (was: 1.7.0) 1.6.0 > ShuffleMapTasks must be robust to concurrent

[jira] [Created] (SPARK-11724) Casting integer types to timestamp has unexpected semantics

2015-11-12 Thread Nong Li (JIRA)
Nong Li created SPARK-11724: --- Summary: Casting integer types to timestamp has unexpected semantics Key: SPARK-11724 URL: https://issues.apache.org/jira/browse/SPARK-11724 Project: Spark Issue Type

[jira] [Updated] (SPARK-11723) Use sqlContext.read.format("libsvm").load(***) to load DataFrame

2015-11-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11723: Description: We prefer to use sqlContext.read.format("libsvm").load(...) rather than MLUtils.loadLi

[jira] [Created] (SPARK-11723) Use sqlContext.read.format("libsvm").load(***) to load DataFrame

2015-11-12 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11723: --- Summary: Use sqlContext.read.format("libsvm").load(***) to load DataFrame Key: SPARK-11723 URL: https://issues.apache.org/jira/browse/SPARK-11723 Project: Spark

[jira] [Commented] (SPARK-6152) Spark does not support Java 8 compiled Scala classes

2015-11-12 Thread Oskar Blom (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003634#comment-15003634 ] Oskar Blom commented on SPARK-6152: --- Nice - when is 1.6.0 due for release? > Spark does

[jira] [Resolved] (SPARK-8029) ShuffleMapTasks must be robust to concurrent attempts on the same executor

2015-11-12 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8029. --- Resolution: Fixed Fix Version/s: 1.7.0 Issue resolved by pull request 9610 [https://github.com/

[jira] [Commented] (SPARK-11688) UDF's doesn't work when it has a default arguments

2015-11-12 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003603#comment-15003603 ] Jakob Odersky commented on SPARK-11688: --- As a workaround, you could register your f

[jira] [Resolved] (SPARK-11719) Remove duplicate DecisionTreeExample under examples/ml

2015-11-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-11719. - Resolution: Not A Problem > Remove duplicate DecisionTreeExample under examples/ml >

[jira] [Commented] (SPARK-11701) YARN - dynamic allocation and speculation active task accounting wrong

2015-11-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11701?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003601#comment-15003601 ] Saisai Shao commented on SPARK-11701: - Hi [~tgraves], I think I also hit this issue,

[jira] [Commented] (SPARK-11688) UDF's doesn't work when it has a default arguments

2015-11-12 Thread Jakob Odersky (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003600#comment-15003600 ] Jakob Odersky commented on SPARK-11688: --- Registering a UDF requires a function (ins

[jira] [Commented] (SPARK-2960) Spark executables fail to start via symlinks

2015-11-12 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003598#comment-15003598 ] Saisai Shao commented on SPARK-2960: Hi [~yinxusen], from script's view point, it cann

[jira] [Assigned] (SPARK-11718) Explicit killing executor dies silent without get response information

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11718: Assignee: Apache Spark > Explicit killing executor dies silent without get response inform

[jira] [Assigned] (SPARK-11718) Explicit killing executor dies silent without get response information

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11718: Assignee: (was: Apache Spark) > Explicit killing executor dies silent without get resp

[jira] [Commented] (SPARK-11718) Explicit killing executor dies silent without get response information

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11718?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003597#comment-15003597 ] Apache Spark commented on SPARK-11718: -- User 'jerryshao' has created a pull request

[jira] [Commented] (SPARK-11720) Return Double.NaN instead of null for Mean and Average when count = 0

2015-11-12 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003589#comment-15003589 ] Jihong MA commented on SPARK-11720: --- Also, for mean, we treat Decimal differently vs. o

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Study Hsueh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003586#comment-15003586 ] Study Hsueh commented on SPARK-11191: - This is my exception stacktrace. {code} 13:34

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003585#comment-15003585 ] Jacek Lewandowski commented on SPARK-11707: --- Some more info: {noformat} scala>

[jira] [Updated] (SPARK-11629) Python example code for Multilayer Perceptron Classification

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11629: -- Assignee: Yanbo Liang > Python example code for Multilayer Perceptron Classification >

[jira] [Updated] (SPARK-11629) Python example code for Multilayer Perceptron Classification

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11629: -- Target Version/s: 1.6.0 > Python example code for Multilayer Perceptron Classification > --

[jira] [Commented] (SPARK-11629) Python example code for Multilayer Perceptron Classification

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003582#comment-15003582 ] Xiangrui Meng commented on SPARK-11629: --- [~yanboliang] Please set the target versio

[jira] [Resolved] (SPARK-11629) Python example code for Multilayer Perceptron Classification

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11629. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9594 [https://gi

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003578#comment-15003578 ] Cheng Lian commented on SPARK-11191: What error message/exception stacktrace did you

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Study Hsueh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003574#comment-15003574 ] Study Hsueh commented on SPARK-11191: - I have implemented Hive persisted function loo

[jira] [Created] (SPARK-11722) Rdds could be different between orginal one and save-out-then-read-in one

2015-11-12 Thread liangguoning (JIRA)
liangguoning created SPARK-11722: Summary: Rdds could be different between orginal one and save-out-then-read-in one Key: SPARK-11722 URL: https://issues.apache.org/jira/browse/SPARK-11722 Project: Sp

[jira] [Commented] (SPARK-11707) StreamCorruptedException if authentication is enabled

2015-11-12 Thread Jacek Lewandowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003564#comment-15003564 ] Jacek Lewandowski commented on SPARK-11707: --- I simply expect that the code whic

[jira] [Commented] (SPARK-11720) Return Double.NaN instead of null for Mean and Average when count = 0

2015-11-12 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003558#comment-15003558 ] Jihong MA commented on SPARK-11720: --- [~mengxr] the implementation of average is not a n

[jira] [Commented] (SPARK-2960) Spark executables fail to start via symlinks

2015-11-12 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003555#comment-15003555 ] Xusen Yin commented on SPARK-2960: -- Here we use the SPARK_HOME in those shell scripts may

[jira] [Commented] (SPARK-11191) [1.5] Can't create UDF's using hive thrift service

2015-11-12 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11191?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003549#comment-15003549 ] Cheng Lian commented on SPARK-11191: Sorry that I wasn't clear enough in my previous

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003548#comment-15003548 ] Felix Cheung commented on SPARK-10863: -- [~olarayej] I"m a little confused - I though

[jira] [Commented] (SPARK-11637) Alias do not work with udf with * parameter

2015-11-12 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003536#comment-15003536 ] Xiao Li commented on SPARK-11637: - https://github.com/apache/spark/pull/9343 has already

[jira] [Resolved] (SPARK-11717) Ignore R session and history files from git

2015-11-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11717. --- Resolution: Fixed Assignee: Kai Sasaki Fix Version/s: 1.7.0 R

[jira] [Created] (SPARK-11721) The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work

2015-11-12 Thread Neelesh Srinivas Salian (JIRA)
Neelesh Srinivas Salian created SPARK-11721: --- Summary: The programming guide for Spark SQL in Spark 1.3.0 needs additional imports to work Key: SPARK-11721 URL: https://issues.apache.org/jira/browse/SPAR

[jira] [Updated] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-11263: -- Assignee: Felix Cheung > lintr Throws Warnings on Commented Code in Documentati

[jira] [Resolved] (SPARK-11263) lintr Throws Warnings on Commented Code in Documentation

2015-11-12 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11263?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-11263. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request

[jira] [Resolved] (SPARK-11672) Flaky test: ml.JavaDefaultReadWriteSuite

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11672. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9677 [https://gi

[jira] [Created] (SPARK-11720) Return Double.NaN instead of null for Mean and Average when count = 0

2015-11-12 Thread Jihong MA (JIRA)
Jihong MA created SPARK-11720: - Summary: Return Double.NaN instead of null for Mean and Average when count = 0 Key: SPARK-11720 URL: https://issues.apache.org/jira/browse/SPARK-11720 Project: Spark

[jira] [Updated] (SPARK-11720) Return Double.NaN instead of null for Mean and Average when count = 0

2015-11-12 Thread Jihong MA (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jihong MA updated SPARK-11720: -- Issue Type: Sub-task (was: Improvement) Parent: SPARK-10384 > Return Double.NaN instead of nul

[jira] [Updated] (SPARK-11719) Remove duplicate DecisionTreeExample under examples/ml

2015-11-12 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-11719: Issue Type: Sub-task (was: Improvement) Parent: SPARK-11685 > Remove duplicate DecisionTre

[jira] [Assigned] (SPARK-11637) Alias do not work with udf with * parameter

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11637: Assignee: (was: Apache Spark) > Alias do not work with udf with * parameter >

[jira] [Assigned] (SPARK-11637) Alias do not work with udf with * parameter

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11637: Assignee: Apache Spark > Alias do not work with udf with * parameter > ---

[jira] [Commented] (SPARK-11719) Remove duplicate DecisionTreeExample under examples/ml

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003482#comment-15003482 ] Apache Spark commented on SPARK-11719: -- User 'yanboliang' has created a pull request

[jira] [Commented] (SPARK-11637) Alias do not work with udf with * parameter

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003483#comment-15003483 ] Apache Spark commented on SPARK-11637: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-11719) Remove duplicate DecisionTreeExample under examples/ml

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11719: Assignee: (was: Apache Spark) > Remove duplicate DecisionTreeExample under examples/ml

[jira] [Assigned] (SPARK-11719) Remove duplicate DecisionTreeExample under examples/ml

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11719: Assignee: Apache Spark > Remove duplicate DecisionTreeExample under examples/ml >

[jira] [Comment Edited] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003478#comment-15003478 ] Liang-Chi Hsieh edited comment on SPARK-11698 at 11/13/15 3:17 AM:

[jira] [Commented] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003478#comment-15003478 ] Liang-Chi Hsieh commented on SPARK-11698: - Yes, but it is intentional. We don't w

[jira] [Created] (SPARK-11719) Remove duplicate DecisionTreeExample under examples/ml

2015-11-12 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-11719: --- Summary: Remove duplicate DecisionTreeExample under examples/ml Key: SPARK-11719 URL: https://issues.apache.org/jira/browse/SPARK-11719 Project: Spark Issue Ty

[jira] [Resolved] (SPARK-11681) Fix state timestamp update logic in TrackStateRDD

2015-11-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11681. --- Resolution: Fixed Fix Version/s: 1.6.0 > Fix state timestamp update logic in TrackStat

[jira] [Reopened] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-11-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang reopened SPARK-9273: --- Reopen the jira since it's an independent feature and under active development. > Add Convolutional Neura

[jira] [Created] (SPARK-11718) Explicit killing executor dies silent without get response information

2015-11-12 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-11718: --- Summary: Explicit killing executor dies silent without get response information Key: SPARK-11718 URL: https://issues.apache.org/jira/browse/SPARK-11718 Project: Spark

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-11-12 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003466#comment-15003466 ] yuhao yang commented on SPARK-9273: --- I'd like to hear more opinions on if we should make

[jira] [Closed] (SPARK-11697) Spark submit can't load user config file using Standalone cluster

2015-11-12 Thread Sam Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sam Fang closed SPARK-11697. Resolution: Not A Problem > Spark submit can't load user config file using Standalone cluster > ---

[jira] [Commented] (SPARK-11697) Spark submit can't load user config file using Standalone cluster

2015-11-12 Thread Sam Fang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003435#comment-15003435 ] Sam Fang commented on SPARK-11697: -- Thanks for explanation! From spark-submit command de

[jira] [Resolved] (SPARK-11419) WriteAheadLog recovery improvements for when closeFileAfterWrite is enabled

2015-11-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11419. --- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 1.6.0 > WriteAheadLog

[jira] [Commented] (SPARK-11717) Ignore R session and history files from git

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003407#comment-15003407 ] Apache Spark commented on SPARK-11717: -- User 'Lewuathe' has created a pull request f

[jira] [Assigned] (SPARK-11717) Ignore R session and history files from git

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11717: Assignee: (was: Apache Spark) > Ignore R session and history files from git >

[jira] [Assigned] (SPARK-11717) Ignore R session and history files from git

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11717: Assignee: Apache Spark > Ignore R session and history files from git > ---

[jira] [Created] (SPARK-11717) Ignore R session and history files from git

2015-11-12 Thread Kai Sasaki (JIRA)
Kai Sasaki created SPARK-11717: -- Summary: Ignore R session and history files from git Key: SPARK-11717 URL: https://issues.apache.org/jira/browse/SPARK-11717 Project: Spark Issue Type: Improveme

[jira] [Comment Edited] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki edited comment on SPARK-11439 at 11/13/15 1:50 AM: -

[jira] [Comment Edited] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki edited comment on SPARK-11439 at 11/13/15 1:51 AM: -

[jira] [Resolved] (SPARK-11663) Add Java API for trackStateByKey

2015-11-12 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11663. --- Resolution: Fixed Fix Version/s: 1.6.0 > Add Java API for trackStateByKey > --

[jira] [Comment Edited] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki edited comment on SPARK-11439 at 11/13/15 1:49 AM: -

[jira] [Comment Edited] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki edited comment on SPARK-11439 at 11/13/15 1:48 AM: -

[jira] [Comment Edited] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki edited comment on SPARK-11439 at 11/13/15 1:48 AM: -

[jira] [Comment Edited] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki edited comment on SPARK-11439 at 11/13/15 1:47 AM: -

[jira] [Commented] (SPARK-11439) Optimization of creating sparse feature without dense one

2015-11-12 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003384#comment-15003384 ] Kai Sasaki commented on SPARK-11439: [~nakul02] It seems to indicate the model in Spa

[jira] [Updated] (SPARK-11654) add reduce to GroupedDataset

2015-11-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11654: - Assignee: Wenchen Fan > add reduce to GroupedDataset > > >

[jira] [Resolved] (SPARK-11654) add reduce to GroupedDataset

2015-11-12 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11654. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9673 [http

[jira] [Created] (SPARK-11716) UDFRegistration Drops Input Type Information

2015-11-12 Thread Artjom Metro (JIRA)
Artjom Metro created SPARK-11716: Summary: UDFRegistration Drops Input Type Information Key: SPARK-11716 URL: https://issues.apache.org/jira/browse/SPARK-11716 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11712) Refactor spark.ml LDAModel to be abstract

2015-11-12 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11712. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9678 [ht

[jira] [Commented] (SPARK-11698) Add option to ignore kafka messages that are out of limit rate

2015-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003301#comment-15003301 ] Felix Cheung commented on SPARK-11698: -- Should we ignore message? Doesn't that mean

[jira] [Resolved] (SPARK-11709) Include call site info in SparkContext.assertNotStopped

2015-11-12 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11709. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9675 [https://gi

[jira] [Assigned] (SPARK-11715) R support corr for Column Aggregration

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11715: Assignee: Apache Spark > R support corr for Column Aggregration >

[jira] [Assigned] (SPARK-11715) R support corr for Column Aggregration

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11715: Assignee: (was: Apache Spark) > R support corr for Column Aggregration > -

[jira] [Commented] (SPARK-11715) R support corr for Column Aggregration

2015-11-12 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003275#comment-15003275 ] Apache Spark commented on SPARK-11715: -- User 'felixcheung' has created a pull reques

[jira] [Updated] (SPARK-11715) R support corr for Column Aggregration

2015-11-12 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-11715: - Summary: R support corr for Column Aggregration (was: Support corr for Column Aggregration) > R

[jira] [Created] (SPARK-11715) Support corr for Column Aggregration

2015-11-12 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-11715: Summary: Support corr for Column Aggregration Key: SPARK-11715 URL: https://issues.apache.org/jira/browse/SPARK-11715 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11683) DataFrameWriter.insertInto() fails on non-default schema

2015-11-12 Thread Xin Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003251#comment-15003251 ] Xin Wu commented on SPARK-11683: It seems like in 1.6.0, this issue is resolved: {code} s

[jira] [Updated] (SPARK-11671) Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11671: -- Fix Version/s: (was: 1.7.0) 1.6.0 > Example for sqlContext.createDataDrame from

[jira] [Updated] (SPARK-11671) Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11671: -- Target Version/s: 1.6.0 (was: 1.7.0) > Example for sqlContext.createDataDrame from pandas.DataFrame ha

[jira] [Updated] (SPARK-11658) simplify documentation for PySpark combineByKey

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11658: -- Target Version/s: 1.6.0 (was: 1.7.0) > simplify documentation for PySpark combineByKey > -

[jira] [Updated] (SPARK-11658) simplify documentation for PySpark combineByKey

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11658: -- Fix Version/s: (was: 1.7.0) 1.6.0 > simplify documentation for PySpark combineBy

[jira] [Comment Edited] (SPARK-11601) ML 1.6 QA: API: Binary incompatible changes

2015-11-12 Thread Tim Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003230#comment-15003230 ] Tim Hunter edited comment on SPARK-11601 at 11/12/15 11:48 PM:

[jira] [Resolved] (SPARK-11667) Update dynamic allocation docs to reflect supported cluster managers

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11667. --- Resolution: Fixed Fix Version/s: 1.6.0 > Update dynamic allocation docs to reflect supported c

[jira] [Commented] (SPARK-11601) ML 1.6 QA: API: Binary incompatible changes

2015-11-12 Thread Tim Hunter (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11601?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15003230#comment-15003230 ] Tim Hunter commented on SPARK-11601: Issues found: - org.apache.spark.ml.classificat

[jira] [Resolved] (SPARK-11670) Fix incorrect kryo buffer default value in docs

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11670. --- Resolution: Fixed Fix Version/s: 1.6.0 > Fix incorrect kryo buffer default value in docs > ---

[jira] [Resolved] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-2533. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Show summary of locali

[jira] [Updated] (SPARK-2533) Show summary of locality level of completed tasks in the each stage page of web UI

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2533?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-2533: - Assignee: Jean-Baptiste Onofré > Show summary of locality level of completed tasks in the each stage page

[jira] [Resolved] (SPARK-11658) simplify documentation for PySpark combineByKey

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11658. --- Resolution: Fixed Assignee: chris snow Fix Version/s: 1.7.0 Target Versio

[jira] [Updated] (SPARK-11671) Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-11671: -- Assignee: chris snow > Example for sqlContext.createDataDrame from pandas.DataFrame has a typo > --

[jira] [Resolved] (SPARK-11671) Example for sqlContext.createDataDrame from pandas.DataFrame has a typo

2015-11-12 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11671. --- Resolution: Fixed Fix Version/s: 1.7.0 Target Version/s: 1.7.0 > Example for sqlCont

  1   2   3   >