[jira] [Commented] (SPARK-14393) values generated by non-deterministic functions shouldn't change after coalesce or union

[ https://issues.apache.org/jira/browse/SPARK-14393?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631653#comment-15631653 ] Apache Spark commented on SPARK-14393: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-17822) JVMObjectTracker.objMap may leak JVM objects

[ https://issues.apache.org/jira/browse/SPARK-17822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631612#comment-15631612 ] Felix Cheung commented on SPARK-17822: -- I see. Is it possible that the R object is alive? Does

[jira] [Commented] (SPARK-18239) Gradient Boosted Tree wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631585#comment-15631585 ] Apache Spark commented on SPARK-18239: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-18239) Gradient Boosted Tree wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18239: Assignee: Felix Cheung (was: Apache Spark) > Gradient Boosted Tree wrapper in SparkR >

[jira] [Assigned] (SPARK-18239) Gradient Boosted Tree wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18239: Assignee: Apache Spark (was: Felix Cheung) > Gradient Boosted Tree wrapper in SparkR >

[jira] [Updated] (SPARK-18239) Gradient Boosted Tree wrapper in SparkR

[ https://issues.apache.org/jira/browse/SPARK-18239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-18239: - Component/s: ML > Gradient Boosted Tree wrapper in SparkR >

[jira] [Created] (SPARK-18239) Gradient Boosted Tree wrapper in SparkR

Felix Cheung created SPARK-18239: Summary: Gradient Boosted Tree wrapper in SparkR Key: SPARK-18239 URL: https://issues.apache.org/jira/browse/SPARK-18239 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-15799) Release SparkR on CRAN

[ https://issues.apache.org/jira/browse/SPARK-15799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631551#comment-15631551 ] Felix Cheung commented on SPARK-15799: -- Hi - how are we on this? With Spark 2.0.0 and 2.0.1

[jira] [Comment Edited] (SPARK-15507) ClassCastException: SomeCaseClass cannot be cast to org.apache.spark.sql.Row

[ https://issues.apache.org/jira/browse/SPARK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631543#comment-15631543 ] Anbu Cheeralan edited comment on SPARK-15507 at 11/3/16 4:38 AM: - This

[jira] [Comment Edited] (SPARK-15507) ClassCastException: SomeCaseClass cannot be cast to org.apache.spark.sql.Row

[ https://issues.apache.org/jira/browse/SPARK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631543#comment-15631543 ] Anbu Cheeralan edited comment on SPARK-15507 at 11/3/16 4:38 AM: - This

[jira] [Comment Edited] (SPARK-15507) ClassCastException: SomeCaseClass cannot be cast to org.apache.spark.sql.Row

[ https://issues.apache.org/jira/browse/SPARK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631543#comment-15631543 ] Anbu Cheeralan edited comment on SPARK-15507 at 11/3/16 4:37 AM: - This

[jira] [Comment Edited] (SPARK-15507) ClassCastException: SomeCaseClass cannot be cast to org.apache.spark.sql.Row

[ https://issues.apache.org/jira/browse/SPARK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631543#comment-15631543 ] Anbu Cheeralan edited comment on SPARK-15507 at 11/3/16 4:37 AM: - This

[jira] [Commented] (SPARK-15507) ClassCastException: SomeCaseClass cannot be cast to org.apache.spark.sql.Row

[ https://issues.apache.org/jira/browse/SPARK-15507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631543#comment-15631543 ] Anbu Cheeralan commented on SPARK-15507: This also creates issues in float to Double conversion

[jira] [Assigned] (SPARK-18175) Improve the test case coverage of implicit type casting

[ https://issues.apache.org/jira/browse/SPARK-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-18175: --- Assignee: Xiao Li > Improve the test case coverage of implicit type casting >

[jira] [Resolved] (SPARK-18175) Improve the test case coverage of implicit type casting

[ https://issues.apache.org/jira/browse/SPARK-18175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-18175. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15691

[jira] [Commented] (SPARK-18128) Add support for publishing to PyPI

[ https://issues.apache.org/jira/browse/SPARK-18128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631463#comment-15631463 ] holdenk commented on SPARK-18128: - Extracted from the discussion around SPARK-1267: People who are

[jira] [Updated] (SPARK-17963) Add examples (extend) in each function and improve documentation

[ https://issues.apache.org/jira/browse/SPARK-17963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17963: Summary: Add examples (extend) in each function and improve documentation (was: Add examples (extend) in

[jira] [Updated] (SPARK-17963) Add examples (extend) in each function and improve documentation with arguments

[ https://issues.apache.org/jira/browse/SPARK-17963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-17963: Assignee: Hyukjin Kwon > Add examples (extend) in each function and improve documentation with >

[jira] [Resolved] (SPARK-17963) Add examples (extend) in each function and improve documentation with arguments

[ https://issues.apache.org/jira/browse/SPARK-17963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-17963. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15677

[jira] [Commented] (SPARK-17459) Add Linear Discriminant to dimensionality reduction algorithms

[ https://issues.apache.org/jira/browse/SPARK-17459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631369#comment-15631369 ] Joshua Howard commented on SPARK-17459: --- Got it. Won't touch the fields. Whenever a committer can

[jira] [Updated] (SPARK-14319) Speed up group-by aggregates

[ https://issues.apache.org/jira/browse/SPARK-14319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal updated SPARK-14319: --- Fix Version/s: 2.0.0 > Speed up group-by aggregates > > >

[jira] [Resolved] (SPARK-14319) Speed up group-by aggregates

[ https://issues.apache.org/jira/browse/SPARK-14319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sameer Agarwal resolved SPARK-14319. Resolution: Done > Speed up group-by aggregates > > >

[jira] [Assigned] (SPARK-18207) class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18207: Assignee: (was: Apache Spark) > class >

[jira] [Assigned] (SPARK-18207) class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18207: Assignee: Apache Spark > class >

[jira] [Commented] (SPARK-18207) class "org.apache.spark.sql.catalyst.expressions.GeneratedClass$SpecificUnsafeProjection" grows beyond 64 KB

[ https://issues.apache.org/jira/browse/SPARK-18207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631321#comment-15631321 ] Apache Spark commented on SPARK-18207: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

[ https://issues.apache.org/jira/browse/SPARK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18237: Assignee: (was: Apache Spark) > hive.exec.stagingdir have no effect in spark2.0.1 >

[jira] [Commented] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

[ https://issues.apache.org/jira/browse/SPARK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631313#comment-15631313 ] Apache Spark commented on SPARK-18237: -- User 'ClassNotFoundExp' has created a pull request for this

[jira] [Assigned] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

[ https://issues.apache.org/jira/browse/SPARK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18237: Assignee: Apache Spark > hive.exec.stagingdir have no effect in spark2.0.1 >

[jira] [Comment Edited] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631204#comment-15631204 ] SathyaNarayanan Srinivasan edited comment on SPARK-18200 at 11/3/16 2:31 AM:

[jira] [Comment Edited] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631292#comment-15631292 ] Liang-Chi Hsieh edited comment on SPARK-18209 at 11/3/16 2:30 AM: -- I

[jira] [Comment Edited] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631292#comment-15631292 ] Liang-Chi Hsieh edited comment on SPARK-18209 at 11/3/16 2:29 AM: -- I

[jira] [Commented] (SPARK-18209) More robust view canonicalization without full SQL expansion

[ https://issues.apache.org/jira/browse/SPARK-18209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631292#comment-15631292 ] Liang-Chi Hsieh commented on SPARK-18209: - I think the disallowed one is to use CTEs in a

[jira] [Commented] (SPARK-17055) add groupKFold to CrossValidator

[ https://issues.apache.org/jira/browse/SPARK-17055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631286#comment-15631286 ] Vincent commented on SPARK-17055: - [~srowen] No offense. Maybe we can invite more ppl to have a look at

[jira] [Created] (SPARK-18238) WARN Executor: 1 block locks were not released by TID

Harish created SPARK-18238: -- Summary: WARN Executor: 1 block locks were not released by TID Key: SPARK-18238 URL: https://issues.apache.org/jira/browse/SPARK-18238 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631251#comment-15631251 ] Dongjoon Hyun commented on SPARK-18200: --- Good for you. :) > GraphX Invalid initial capacity when

[jira] [Commented] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec

[ https://issues.apache.org/jira/browse/SPARK-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631238#comment-15631238 ] Xiao Li commented on SPARK-14922: - Sure, thanks! > Alter Table Drop Partition Using Predicate-based

[jira] [Closed] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec

[ https://issues.apache.org/jira/browse/SPARK-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li closed SPARK-14922. --- Resolution: Duplicate > Alter Table Drop Partition Using Predicate-based Partition Spec >

[jira] [Updated] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

[ https://issues.apache.org/jira/browse/SPARK-18237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ClassNotFoundExp updated SPARK-18237: - Target Version/s: (was: 2.0.1) Fix Version/s: (was: 2.0.1) >

[jira] [Created] (SPARK-18237) hive.exec.stagingdir have no effect in spark2.0.1

ClassNotFoundExp created SPARK-18237: Summary: hive.exec.stagingdir have no effect in spark2.0.1 Key: SPARK-18237 URL: https://issues.apache.org/jira/browse/SPARK-18237 Project: Spark

[jira] [Commented] (SPARK-17727) PySpark SQL arrays are not immutable, .remove and .pop cause issues

[ https://issues.apache.org/jira/browse/SPARK-17727?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631228#comment-15631228 ] Hyukjin Kwon commented on SPARK-17727: -- Hi [~srowen], would this JIRA be resolved with an action? >

[jira] [Resolved] (SPARK-5151) Parquet Predicate Pushdown Does Not Work with Nested Structures.

[ https://issues.apache.org/jira/browse/SPARK-5151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-5151. - Resolution: Duplicate I am going to resolve this as a duplicate. The reason why I resolve this

[jira] [Commented] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631204#comment-15631204 ] SathyaNarayanan Srinivasan commented on SPARK-18200: Thank you Dongjoon Hyun and

[jira] [Resolved] (SPARK-17049) LAG function fails when selecting all columns

[ https://issues.apache.org/jira/browse/SPARK-17049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-17049. -- Resolution: Cannot Reproduce I am resolving this JIRA as Cannot Reproduce as described in the

[jira] [Resolved] (SPARK-16210) DataFrame.drop(colName) fails if another column has a period in its name

[ https://issues.apache.org/jira/browse/SPARK-16210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-16210. -- Resolution: Cannot Reproduce I can't reproduce this too {code} scala> val rdd =

[jira] [Closed] (SPARK-15174) DataFrame does not have correct number of rows after dropDuplicates

[ https://issues.apache.org/jira/browse/SPARK-15174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-15174. Resolution: Cannot Reproduce I can't reproduce this in the current master. So, I am going to mark

[jira] [Assigned] (SPARK-18236) Reduce memory usage of Spark UI and HistoryServer by reducing duplicate objects

[ https://issues.apache.org/jira/browse/SPARK-18236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18236: Assignee: Josh Rosen (was: Apache Spark) > Reduce memory usage of Spark UI and

[jira] [Closed] (SPARK-18222) Use math instead of Math

[ https://issues.apache.org/jira/browse/SPARK-18222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengruifeng closed SPARK-18222. Resolution: Not A Problem > Use math instead of Math > > >

[jira] [Assigned] (SPARK-18236) Reduce memory usage of Spark UI and HistoryServer by reducing duplicate objects

[ https://issues.apache.org/jira/browse/SPARK-18236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18236: Assignee: Apache Spark (was: Josh Rosen) > Reduce memory usage of Spark UI and

[jira] [Commented] (SPARK-18236) Reduce memory usage of Spark UI and HistoryServer by reducing duplicate objects

[ https://issues.apache.org/jira/browse/SPARK-18236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631147#comment-15631147 ] Apache Spark commented on SPARK-18236: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-14922) Alter Table Drop Partition Using Predicate-based Partition Spec

[ https://issues.apache.org/jira/browse/SPARK-14922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631137#comment-15631137 ] Hyukjin Kwon commented on SPARK-14922: -- Hi [~smilegator], would this be supposed to be closed as a

[jira] [Commented] (SPARK-14840) Cannot drop a table which has the name starting with 'or'

[ https://issues.apache.org/jira/browse/SPARK-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631134#comment-15631134 ] Hyukjin Kwon commented on SPARK-14840: -- Please revoke my action if this is inappropriate. > Cannot

[jira] [Resolved] (SPARK-14840) Cannot drop a table which has the name starting with 'or'

[ https://issues.apache.org/jira/browse/SPARK-14840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-14840. -- Resolution: Duplicate I can't reproduce this against the current master. {code} scala>

[jira] [Created] (SPARK-18236) Reduce memory usage of Spark UI and HistoryServer by reducing duplicate objects

Josh Rosen created SPARK-18236: -- Summary: Reduce memory usage of Spark UI and HistoryServer by reducing duplicate objects Key: SPARK-18236 URL: https://issues.apache.org/jira/browse/SPARK-18236 Project:

[jira] [Resolved] (SPARK-17470) unify path for data source table and locationUri for hive serde table

[ https://issues.apache.org/jira/browse/SPARK-17470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-17470. -- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15024

[jira] [Commented] (SPARK-14443) parse_url() does not escape query parameters

[ https://issues.apache.org/jira/browse/SPARK-14443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631103#comment-15631103 ] Hyukjin Kwon commented on SPARK-14443: -- I just tried this too. It seems we can do this via manually

[jira] [Reopened] (SPARK-18193) queueStream not updated if rddQueue.add after create queueStream in Java

[ https://issues.apache.org/jira/browse/SPARK-18193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hubert Kang reopened SPARK-18193: - While it's inconsistent with that in QueueStream.scala. something is pushed to the queue after

[jira] [Commented] (SPARK-14319) Speed up group-by aggregates

[ https://issues.apache.org/jira/browse/SPARK-14319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631091#comment-15631091 ] Hyukjin Kwon commented on SPARK-14319: -- Hey [~sameerag], I guess we might be able to take an action

[jira] [Closed] (SPARK-14197) Error: org.apache.spark.sql.catalyst.analysis.UnresolvedException: Invalid call to name on unresolved object, tree: unresolvedalias(if ((imei#33365 = 1AA10007)) imei#3336

[ https://issues.apache.org/jira/browse/SPARK-14197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-14197. Resolution: Cannot Reproduce I am closing this as Cannot Reproduce as I can't reproduce this

[jira] [Comment Edited] (SPARK-14195) Error: org.apache.spark.sql.AnalysisException: cannot recognize input near 'select' 'MAC' 'from' in expression specification; line 1 pos 16 (state=,code=0)

[ https://issues.apache.org/jira/browse/SPARK-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15631071#comment-15631071 ] Hyukjin Kwon edited comment on SPARK-14195 at 11/3/16 12:52 AM: I am

[jira] [Closed] (SPARK-14196) Error: org.apache.spark.sql.AnalysisException: cannot resolve 'query_alias_fix_conflicts_0._c0'; (state=,code=0)

[ https://issues.apache.org/jira/browse/SPARK-14196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-14196. Resolution: Cannot Reproduce I am closing this as Cannot Reproduce as I can't against the current

[jira] [Closed] (SPARK-14195) Error: org.apache.spark.sql.AnalysisException: cannot recognize input near 'select' 'MAC' 'from' in expression specification; line 1 pos 16 (state=,code=0)

[ https://issues.apache.org/jira/browse/SPARK-14195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon closed SPARK-14195. Resolution: Cannot Reproduce I am closing this as Cannot Reproduce as I can't against the current

[jira] [Commented] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

[ https://issues.apache.org/jira/browse/SPARK-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630940#comment-15630940 ] Vinayak Joshi commented on SPARK-16808: --- Added a pull request with my take at this issue as well.

[jira] [Commented] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

[ https://issues.apache.org/jira/browse/SPARK-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630935#comment-15630935 ] Apache Spark commented on SPARK-16808: -- User 'vijoshi' has created a pull request for this issue:

[jira] [Updated] (SPARK-18235) ml.ALSModel function parity: ALSModel should support recommendforAll

[ https://issues.apache.org/jira/browse/SPARK-18235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuhao yang updated SPARK-18235: --- Description: For function parity with MatrixFactorizationModel, ALS model should support API:

[jira] [Commented] (SPARK-18235) ml.ALSModel function parity: ALSModel should support recommendforAll

[ https://issues.apache.org/jira/browse/SPARK-18235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630878#comment-15630878 ] yuhao yang commented on SPARK-18235: I can work on the implementation. Appreciate if there's any

[jira] [Created] (SPARK-18235) ml.ALSModel function parity: ALSModel should support recommendforAll

yuhao yang created SPARK-18235: -- Summary: ml.ALSModel function parity: ALSModel should support recommendforAll Key: SPARK-18235 URL: https://issues.apache.org/jira/browse/SPARK-18235 Project: Spark

[jira] [Commented] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630864#comment-15630864 ] Dongjoon Hyun commented on SPARK-18200: --- The described scenario is also tested. {code} scala>

[jira] [Commented] (SPARK-18086) Regression: Hive variables no longer work in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630855#comment-15630855 ] Reynold Xin commented on SPARK-18086: - Because the execution code no longer depends on Hive's

[jira] [Updated] (SPARK-18024) Introduce an internal commit protocol API along with OutputCommitter implementation

[ https://issues.apache.org/jira/browse/SPARK-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18024: Summary: Introduce an internal commit protocol API along with OutputCommitter implementation

[jira] [Commented] (SPARK-18086) Regression: Hive variables no longer work in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630849#comment-15630849 ] Ryan Blue commented on SPARK-18086: --- What is the rationale for propagating configuration but not

[jira] [Updated] (SPARK-18024) Introduce a commit protocol API along with OutputCommitter implementation

[ https://issues.apache.org/jira/browse/SPARK-18024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18024: Description: This commit protocol API should wrap around Hadoop's output committer. Later we can

[jira] [Updated] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18200: Target Version/s: 2.0.3, 2.1.0 > GraphX Invalid initial capacity when running triangleCount >

[jira] [Resolved] (SPARK-18214) Simplify RuntimeReplaceable type coercion

[ https://issues.apache.org/jira/browse/SPARK-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-18214. - Resolution: Fixed Fix Version/s: 2.1.0 > Simplify RuntimeReplaceable type coercion >

[jira] [Comment Edited] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630821#comment-15630821 ] Dongjoon Hyun edited comment on SPARK-18200 at 11/2/16 10:58 PM: -

[jira] [Commented] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630821#comment-15630821 ] Dongjoon Hyun commented on SPARK-18200: --- Actually, there is a node whose don't have neighbor. So,

[jira] [Assigned] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18200: Assignee: Apache Spark > GraphX Invalid initial capacity when running triangleCount >

[jira] [Assigned] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18200: Assignee: (was: Apache Spark) > GraphX Invalid initial capacity when running

[jira] [Commented] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630814#comment-15630814 ] Apache Spark commented on SPARK-18200: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-18200) GraphX Invalid initial capacity when running triangleCount

[ https://issues.apache.org/jira/browse/SPARK-18200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630798#comment-15630798 ] Dongjoon Hyun commented on SPARK-18200: --- Hi, [~dennyglee]. It's due to `OpenHashSet`. I'll make a

[jira] [Commented] (SPARK-18232) Support Mesos CNI

[ https://issues.apache.org/jira/browse/SPARK-18232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630768#comment-15630768 ] Apache Spark commented on SPARK-18232: -- User 'mgummelt' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18232) Support Mesos CNI

[ https://issues.apache.org/jira/browse/SPARK-18232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18232: Assignee: (was: Apache Spark) > Support Mesos CNI > - > >

[jira] [Assigned] (SPARK-18232) Support Mesos CNI

[ https://issues.apache.org/jira/browse/SPARK-18232?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18232: Assignee: Apache Spark > Support Mesos CNI > - > > Key:

[jira] [Updated] (SPARK-18234) Update mode in structured streaming

[ https://issues.apache.org/jira/browse/SPARK-18234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18234: Summary: Update mode in structured streaming (was: Update mode) > Update mode in structured

[jira] [Created] (SPARK-18234) Update mode

Michael Armbrust created SPARK-18234: Summary: Update mode Key: SPARK-18234 URL: https://issues.apache.org/jira/browse/SPARK-18234 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-18230) MatrixFactorizationModel.recommendProducts throws NoSuchElement exception when the user does not exist

[ https://issues.apache.org/jira/browse/SPARK-18230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630741#comment-15630741 ] yuhao yang commented on SPARK-18230: Perhaps we can use Double.NaN for the case, just to be

[jira] [Commented] (SPARK-18086) Regression: Hive variables no longer work in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630718#comment-15630718 ] Reynold Xin commented on SPARK-18086: - The thing is that we don't really propagate Hive's session

[jira] [Commented] (SPARK-16726) Improve `Union/Intersect/Except` error messages on incompatible types

[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630657#comment-15630657 ] Dongjoon Hyun commented on SPARK-16726: --- You're welcome. Thank you, [~nchammas]! > Improve

[jira] [Commented] (SPARK-18131) Support returning Vector/Dense Vector from backend

[ https://issues.apache.org/jira/browse/SPARK-18131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630625#comment-15630625 ] Felix Cheung commented on SPARK-18131: -- See https://issues.apache.org/jira/browse/SPARK-18226 >

[jira] [Commented] (SPARK-18226) SparkR displaying vector columns in incorrect way

[ https://issues.apache.org/jira/browse/SPARK-18226?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630623#comment-15630623 ] Felix Cheung commented on SPARK-18226: -- Thanks, this is actually the issue outlined in

[jira] [Commented] (SPARK-16726) Improve `Union/Intersect/Except` error messages on incompatible types

[ https://issues.apache.org/jira/browse/SPARK-16726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630597#comment-15630597 ] Nicholas Chammas commented on SPARK-16726: -- I just hit this error in 2.0.1 and it was this JIRA

[jira] [Created] (SPARK-18233) Failed to deserialize the task

Davies Liu created SPARK-18233: -- Summary: Failed to deserialize the task Key: SPARK-18233 URL: https://issues.apache.org/jira/browse/SPARK-18233 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-18232) Support Mesos CNI

Michael Gummelt created SPARK-18232: --- Summary: Support Mesos CNI Key: SPARK-18232 URL: https://issues.apache.org/jira/browse/SPARK-18232 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-18212) Flaky test: org.apache.spark.sql.kafka010.KafkaSourceSuite.assign from specific offsets

[ https://issues.apache.org/jira/browse/SPARK-18212?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630567#comment-15630567 ] Shixiong Zhu commented on SPARK-18212: -- [~c...@koeninger.org] Sounds good to me. > Flaky test:

[jira] [Closed] (SPARK-4549) Support BigInt -> Decimal in convertToCatalyst in SparkSQL

[ https://issues.apache.org/jira/browse/SPARK-4549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu closed SPARK-4549. - Resolution: Incomplete > Support BigInt -> Decimal in convertToCatalyst in SparkSQL >

[jira] [Updated] (SPARK-17972) Query planning slows down dramatically for large query plans even when sub-trees are cached

[ https://issues.apache.org/jira/browse/SPARK-17972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-17972: --- Description: The following Spark shell snippet creates a series of query plans that grow

[jira] [Updated] (SPARK-11879) Checkpoint support for DataFrame/Dataset

[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11879: Fix Version/s: 2.1.0 > Checkpoint support for DataFrame/Dataset >

[jira] [Resolved] (SPARK-11879) Checkpoint support for DataFrame/Dataset

[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-11879. Resolution: Duplicate > Checkpoint support for DataFrame/Dataset >

[jira] [Updated] (SPARK-11879) Checkpoint support for DataFrame/Dataset

[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-11879: Assignee: Cheng Lian > Checkpoint support for DataFrame/Dataset >

[jira] [Commented] (SPARK-11879) Checkpoint support for DataFrame/Dataset

[ https://issues.apache.org/jira/browse/SPARK-11879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15630537#comment-15630537 ] Cheng Lian commented on SPARK-11879: Sorry that I didn't notice this ticket while working on

[jira] [Assigned] (SPARK-16808) History Server main page does not honor APPLICATION_WEB_PROXY_BASE

[ https://issues.apache.org/jira/browse/SPARK-16808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16808: Assignee: Apache Spark > History Server main page does not honor

  1   2   3   >