[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737454#comment-15737454 ] Alex Bozarth commented on SPARK-18816: -- That's odd, I tested my code on Safari, Chrome and FF when I

[jira] [Comment Edited] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737454#comment-15737454 ] Alex Bozarth edited comment on SPARK-18816 at 12/10/16 7:57 AM: That's

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Bozarth updated SPARK-18816: - Priority: Major (was: Blocker) > executor page fails to show log links if executors are added

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

2016-12-09 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737368#comment-15737368 ] Wenchen Fan commented on SPARK-18209: - Hmm, `AnalysisContext` maybe an overkill, can we just

[jira] [Resolved] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-18811. -- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.2.0

[jira] [Commented] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737254#comment-15737254 ] Yin Huai commented on SPARK-18816: -- btw, my testing was done with chrome. I then terminated the

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Attachment: screenshot-1.png > executor page fails to show log links if executors are added after an app

[jira] [Created] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
Yin Huai created SPARK-18816: Summary: executor page fails to show log links if executors are added after an app is launched Key: SPARK-18816 URL: https://issues.apache.org/jira/browse/SPARK-18816

[jira] [Updated] (SPARK-18816) executor page fails to show log links if executors are added after an app is launched

2016-12-09 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-18816: - Description: How to reproduce with standalone mode: 1. Launch a spark master 2. Launch a spark shell. At

[jira] [Comment Edited] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-09 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736953#comment-15736953 ] yuhao yang edited comment on SPARK-18813 at 12/10/16 5:06 AM: -- The plan is

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737148#comment-15737148 ] Eric Liang commented on SPARK-18814: It seems that the references of an Alias expression should

[jira] [Comment Edited] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737142#comment-15737142 ] Nattavut Sutyanyong edited comment on SPARK-18814 at 12/10/16 3:50 AM:

[jira] [Comment Edited] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737142#comment-15737142 ] Nattavut Sutyanyong edited comment on SPARK-18814 at 12/10/16 3:50 AM:

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737142#comment-15737142 ] Nattavut Sutyanyong commented on SPARK-18814: - It looks like the `Project` between

[jira] [Assigned] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18815: Assignee: (was: Apache Spark) > NPE when collecting column stats for string/binary

[jira] [Commented] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737134#comment-15737134 ] Apache Spark commented on SPARK-18815: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18815: Assignee: Apache Spark > NPE when collecting column stats for string/binary column having

[jira] [Updated] (SPARK-18815) NPE when collecting column stats for string/binary column having only null values

2016-12-09 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18815: - Summary: NPE when collecting column stats for string/binary column having only null values

[jira] [Updated] (SPARK-18815) NPE when collecting column stats for column having only null values

2016-12-09 Thread Zhenhua Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenhua Wang updated SPARK-18815: - Affects Version/s: 2.1.1 > NPE when collecting column stats for column having only null values >

[jira] [Created] (SPARK-18815) NPE when collecting column stats for column having only null values

2016-12-09 Thread Zhenhua Wang (JIRA)
Zhenhua Wang created SPARK-18815: Summary: NPE when collecting column stats for column having only null values Key: SPARK-18815 URL: https://issues.apache.org/jira/browse/SPARK-18815 Project: Spark

[jira] [Resolved] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-18807. --- Resolution: Fixed Fix Version/s: 2.1.1 Resolved by

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737084#comment-15737084 ] Shivaram Venkataraman commented on SPARK-18788: --- Hmm I am not sure but I think the reason

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737079#comment-15737079 ] Nattavut Sutyanyong commented on SPARK-18814: - I am looking at this. > CheckAnalysis rejects

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737074#comment-15737074 ] Reynold Xin commented on SPARK-18814: - cc [~hvanhovell] and [~nsyca] > CheckAnalysis rejects TPCDS

[jira] [Commented] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Eric Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737068#comment-15737068 ] Eric Liang commented on SPARK-18814: [~rxin] > CheckAnalysis rejects TPCDS query 32 >

[jira] [Created] (SPARK-18814) CheckAnalysis rejects TPCDS query 32

2016-12-09 Thread Eric Liang (JIRA)
Eric Liang created SPARK-18814: -- Summary: CheckAnalysis rejects TPCDS query 32 Key: SPARK-18814 URL: https://issues.apache.org/jira/browse/SPARK-18814 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15737022#comment-15737022 ] Felix Cheung commented on SPARK-18788: -- I looked and didn't see that on DataFrame? I'm not sure what

[jira] [Comment Edited] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-09 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736953#comment-15736953 ] yuhao yang edited comment on SPARK-18813 at 12/10/16 1:55 AM: -- The plan is

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

2016-12-09 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736957#comment-15736957 ] Saisai Shao commented on SPARK-13955: - Yes, forgot to mention this zip file doesn't support nested

[jira] [Commented] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-09 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736953#comment-15736953 ] yuhao yang commented on SPARK-18813: The plan is definitely solid and practical. I understand for

[jira] [Resolved] (SPARK-18812) Clarify "Spark ML"

2016-12-09 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-18812. --- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 Issue resolved by

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2016-12-09 Thread liujianhui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736943#comment-15736943 ] liujianhui commented on SPARK-18806: when you stop worker by ssh from the client machine, if the

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2016-12-09 Thread liujianhui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736941#comment-15736941 ] liujianhui commented on SPARK-18806: when you stop worker by ssh from the client machine, if the

[jira] [Issue Comment Deleted] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2016-12-09 Thread liujianhui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] liujianhui updated SPARK-18806: --- Comment: was deleted (was: when you stop worker by ssh from the client machine, if the driverwrapper

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736911#comment-15736911 ] Shivaram Venkataraman commented on SPARK-18788: --- Sorry I didn't complete the question - the

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736907#comment-15736907 ] Shivaram Venkataraman commented on SPARK-18788: --- Is there an equivalent Scala or Python

[jira] [Updated] (SPARK-18120) QueryExecutionListener method doesnt' get executed for DataFrameWriter methods

2016-12-09 Thread Mark Grover (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Grover updated SPARK-18120: Description: QueryExecutionListener is a class that has methods named onSuccess() and onFailure()

[jira] [Assigned] (SPARK-18628) Update handle invalid documentation string

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18628: Assignee: Apache Spark > Update handle invalid documentation string >

[jira] [Assigned] (SPARK-18628) Update handle invalid documentation string

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18628: Assignee: (was: Apache Spark) > Update handle invalid documentation string >

[jira] [Commented] (SPARK-18628) Update handle invalid documentation string

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736843#comment-15736843 ] Apache Spark commented on SPARK-18628: -- User 'krishnakalyan3' has created a pull request for this

[jira] [Commented] (SPARK-18788) Add getNumPartitions() to SparkR

2016-12-09 Thread Raela Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736836#comment-15736836 ] Raela Wang commented on SPARK-18788: Yes, RDD support in SparkR has been removed, which is why I

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736807#comment-15736807 ] Shivaram Venkataraman commented on SPARK-15799: --- Hmm I think I read it wrong. It does the

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736801#comment-15736801 ] Shivaram Venkataraman commented on SPARK-15799: --- There is already some code which considers

[jira] [Commented] (SPARK-18812) Clarify "Spark ML"

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736799#comment-15736799 ] Apache Spark commented on SPARK-18812: -- User 'mengxr' has created a pull request for this issue:

[jira] [Commented] (SPARK-16815) Dataset[List[T]] leads to ArrayStoreException

2016-12-09 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-16815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736804#comment-15736804 ] Michal Šenkýř commented on SPARK-16815: --- I made a PR that should fix this issue

[jira] [Comment Edited] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736790#comment-15736790 ] Felix Cheung edited comment on SPARK-15799 at 12/10/16 12:23 AM: - That

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736790#comment-15736790 ] Felix Cheung commented on SPARK-15799: -- That certainly would be the option. Typically when

[jira] [Assigned] (SPARK-16792) Dataset containing a Case Class with a List type causes a CompileException (converting sequence to list)

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16792: Assignee: (was: Apache Spark) > Dataset containing a Case Class with a List type

[jira] [Commented] (SPARK-16792) Dataset containing a Case Class with a List type causes a CompileException (converting sequence to list)

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736773#comment-15736773 ] Apache Spark commented on SPARK-16792: -- User 'michalsenkyr' has created a pull request for this

[jira] [Assigned] (SPARK-16792) Dataset containing a Case Class with a List type causes a CompileException (converting sequence to list)

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16792: Assignee: Apache Spark > Dataset containing a Case Class with a List type causes a

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736753#comment-15736753 ] Shivaram Venkataraman commented on SPARK-15799: --- Sure > Release SparkR on CRAN >

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736748#comment-15736748 ] Joseph K. Bradley commented on SPARK-15799: --- [~shivaram] Could I list you as the shepherd for

[jira] [Updated] (SPARK-15573) Backwards-compatible persistence for spark.ml

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-15573: -- Shepherd: Joseph K. Bradley > Backwards-compatible persistence for spark.ml >

[jira] [Commented] (SPARK-15572) MLlib in R format: compatibility with other languages

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736744#comment-15736744 ] Joseph K. Bradley commented on SPARK-15572: --- Would you be interested in shepherding this

[jira] [Updated] (SPARK-4591) Algorithm/model parity for spark.ml (Scala)

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-4591: - Shepherd: Joseph K. Bradley > Algorithm/model parity for spark.ml (Scala) >

[jira] [Updated] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-18813: -- Description: *PROPOSAL: This includes a proposal for the 2.2 roadmap process for

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736731#comment-15736731 ] Joseph K. Bradley commented on SPARK-15581: --- Everyone, I just posted a proposal for the 2.2

[jira] [Created] (SPARK-18813) MLlib 2.2 Roadmap

2016-12-09 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-18813: - Summary: MLlib 2.2 Roadmap Key: SPARK-18813 URL: https://issues.apache.org/jira/browse/SPARK-18813 Project: Spark Issue Type: Umbrella

[jira] [Resolved] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2016-12-09 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4105. - Resolution: Fixed Fix Version/s: 2.2.0 > FAILED_TO_UNCOMPRESS(5) errors when fetching

[jira] [Commented] (SPARK-15581) MLlib 2.1 Roadmap

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736685#comment-15736685 ] Joseph K. Bradley commented on SPARK-15581: --- I like a lot of the points made here. A few

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736671#comment-15736671 ] Shivaram Venkataraman commented on SPARK-15799: --- Sure - That will be great. > Release

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Brendan Dwyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736657#comment-15736657 ] Brendan Dwyer commented on SPARK-15799: --- I think that's the best solution. Can I create a pull

[jira] [Created] (SPARK-18812) Clarify "Spark ML"

2016-12-09 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-18812: - Summary: Clarify "Spark ML" Key: SPARK-18812 URL: https://issues.apache.org/jira/browse/SPARK-18812 Project: Spark Issue Type: Documentation

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736616#comment-15736616 ] Shivaram Venkataraman commented on SPARK-15799: --- I see - Looks like its controlled by this

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Brendan Dwyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736591#comment-15736591 ] Brendan Dwyer commented on SPARK-15799: --- On my machine it gets created in my home directory when I

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736588#comment-15736588 ] Shivaram Venkataraman commented on SPARK-15799: --- Where does it get created right now ? We

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

2016-12-09 Thread Brendan Dwyer (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736572#comment-15736572 ] Brendan Dwyer commented on SPARK-15799: --- [CRAN

[jira] [Resolved] (SPARK-18802) java.lang.ClassCastException in a simple spark application

2016-12-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18802. --- Resolution: Duplicate Please don't reopen without a meaningful change in the discussion. It's still

[jira] [Closed] (SPARK-18802) java.lang.ClassCastException in a simple spark application

2016-12-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-18802. - > java.lang.ClassCastException in a simple spark application >

[jira] [Resolved] (SPARK-18745) java.lang.IndexOutOfBoundsException running query 68 Spark SQL on (100TB)

2016-12-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-18745. --- Resolution: Fixed Fix Version/s: 2.1.1 2.0.3 >

[jira] [Closed] (SPARK-18798) Expose the kill Executor in Yarn Mode

2016-12-09 Thread Narendra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18798?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Narendra closed SPARK-18798. > Expose the kill Executor in Yarn Mode > - > > Key:

[jira] [Assigned] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18811: Assignee: Apache Spark > Stream Source resolution should happen in StreamExecution

[jira] [Commented] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736427#comment-15736427 ] Apache Spark commented on SPARK-18811: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18811: Assignee: (was: Apache Spark) > Stream Source resolution should happen in

[jira] [Updated] (SPARK-18808) ml.KMeansModel.transform is very inefficient

2016-12-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18808: -- Issue Type: Improvement (was: Bug) Agree, the private predict() method should accept a reference to a

[jira] [Resolved] (SPARK-18620) Spark Streaming + Kinesis : Receiver MaxRate is violated

2016-12-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18620. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16114

[jira] [Updated] (SPARK-18620) Spark Streaming + Kinesis : Receiver MaxRate is violated

2016-12-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18620: -- Assignee: Takeshi Yamamuro > Spark Streaming + Kinesis : Receiver MaxRate is violated >

[jira] [Commented] (SPARK-18806) driverwrapper and executor doesn't exit when worker killed

2016-12-09 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736396#comment-15736396 ] Sean Owen commented on SPARK-18806: --- Can you elaborate -- what is the effect of this? can you reproduce

[jira] [Resolved] (SPARK-18316) Spark MLlib, GraphX 2.1 QA umbrella

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18316. --- Resolution: Done Fix Version/s: 2.1.0 Marking everything done! Thanks very

[jira] [Reopened] (SPARK-18779) Messages being received only from one partition when using Spark Streaming integration for Kafka 0.10 with kafka client library at 0.10.1

2016-12-09 Thread Pranav Nakhe (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pranav Nakhe reopened SPARK-18779: -- Well there seems to be an issue in spark after all. In the ConsumerStrategy class there is a

[jira] [Commented] (SPARK-18455) General support for correlated subquery processing

2016-12-09 Thread Nattavut Sutyanyong (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736300#comment-15736300 ] Nattavut Sutyanyong commented on SPARK-18455: - Thanks for the comments. I will respond to

[jira] [Created] (SPARK-18811) Stream Source resolution should happen in StreamExecution thread, not main thread

2016-12-09 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-18811: --- Summary: Stream Source resolution should happen in StreamExecution thread, not main thread Key: SPARK-18811 URL: https://issues.apache.org/jira/browse/SPARK-18811

[jira] [Resolved] (SPARK-18323) Update MLlib, GraphX websites for 2.1

2016-12-09 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-18323. --- Resolution: Fixed Fix Version/s: 2.1.0 > Update MLlib, GraphX websites for

[jira] [Commented] (SPARK-18808) ml.KMeansModel.transform is very inefficient

2016-12-09 Thread Michel Lemay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736254#comment-15736254 ] Michel Lemay commented on SPARK-18808: -- Subclassing/overriding/adding methods in KMeans/Model is a

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736230#comment-15736230 ] Felix Cheung commented on SPARK-18810: -- Also to expand on the earlier note above, I think the main

[jira] [Commented] (SPARK-13955) Spark in yarn mode fails

2016-12-09 Thread liyunzhang_intel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736236#comment-15736236 ] liyunzhang_intel commented on SPARK-13955: -- [~jerryshao]: After testing, i can use

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736233#comment-15736233 ] Shivaram Venkataraman commented on SPARK-18810: --- Yeah I think that sounds good. This need

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736217#comment-15736217 ] Felix Cheung commented on SPARK-18810: -- For RC, it actually expects to have a subdirectory

[jira] [Comment Edited] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736217#comment-15736217 ] Felix Cheung edited comment on SPARK-18810 at 12/9/16 8:06 PM: --- For RC, it

[jira] [Commented] (SPARK-18455) General support for correlated subquery processing

2016-12-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736195#comment-15736195 ] Herman van Hovell commented on SPARK-18455: --- Thanks for adding the doc. I look forward to the

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736182#comment-15736182 ] Shivaram Venkataraman commented on SPARK-18810: --- I think the snapshot case and the RC case

[jira] [Commented] (SPARK-18799) Spark SQL expose interface for plug-gable parser extension

2016-12-09 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736179#comment-15736179 ] Herman van Hovell commented on SPARK-18799: --- It is way too late to put this in Spark 2.1. So

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Apache Spark (was: Felix Cheung) > Should suppress output print for calls to

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Felix Cheung (was: Apache Spark) > Should suppress output print for calls to

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Felix Cheung (was: Apache Spark) > Should suppress output print for calls to

[jira] [Assigned] (SPARK-18807) Should suppress output print for calls to JVM methods with void return values

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18807: Assignee: Apache Spark (was: Felix Cheung) > Should suppress output print for calls to

[jira] [Commented] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736161#comment-15736161 ] Felix Cheung commented on SPARK-18810: -- I've found the same issue while testing as well, and was

[jira] [Commented] (SPARK-18798) Expose the kill Executor in Yarn Mode

2016-12-09 Thread Narendra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15736153#comment-15736153 ] Narendra commented on SPARK-18798: -- Thanks for Clarifying , It helped > Expose the kill Executor in

[jira] [Created] (SPARK-18810) SparkR install.spark does not work for RCs, snapshots

2016-12-09 Thread Shivaram Venkataraman (JIRA)
Shivaram Venkataraman created SPARK-18810: - Summary: SparkR install.spark does not work for RCs, snapshots Key: SPARK-18810 URL: https://issues.apache.org/jira/browse/SPARK-18810 Project:

[jira] [Assigned] (SPARK-18809) Kinesis deaggregation issue on master

2016-12-09 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18809: Assignee: Apache Spark > Kinesis deaggregation issue on master >

  1   2   >