[jira] [Issue Comment Deleted] (SPARK-10000) Consolidate cache memory management and execution memory management

2015-08-16 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-1: -- Comment: was deleted (was: N! I had 8 JIRAs lined up to create...but forgot to

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699080#comment-14699080 ] Shivaram Venkataraman commented on SPARK-9427: -- Yeah I think the simplest thi

[jira] [Commented] (SPARK-9199) Upgrade Tachyon dependency to 0.7.0

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699079#comment-14699079 ] Apache Spark commented on SPARK-9199: - User 'calvinjia' has created a pull request for

[jira] [Commented] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699075#comment-14699075 ] Fei Wang commented on SPARK-10030: -- [~hyukjin.kwon] this is defenitly a spark sql bug, s

[jira] [Updated] (SPARK-9871) Add expression functions into SparkR which have a variable parameter

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-9871: - Assignee: Yu Ishikawa > Add expression functions into SparkR which have a variable

[jira] [Resolved] (SPARK-9871) Add expression functions into SparkR which have a variable parameter

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9871. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 819

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

2015-08-16 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699072#comment-14699072 ] Yu Ishikawa commented on SPARK-9427: [~shivaram] and [~davies] How do we convert R {{

[jira] [Commented] (SPARK-10041) Proposal of Parameter Server Interface for Spark

2015-08-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699059#comment-14699059 ] Sean Owen commented on SPARK-10041: --- Same as SPARK-6932, SPARK-4590 or at least coverin

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2015-08-16 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699058#comment-14699058 ] Yu Ishikawa commented on SPARK-10043: - [~shivaram] At least, {{lead}} function doesn'

[jira] [Created] (SPARK-10046) Hive warehouse dir not set in current directory when not providing hive-site.xml

2015-08-16 Thread Antonio Murgia (JIRA)
Antonio Murgia created SPARK-10046: -- Summary: Hive warehouse dir not set in current directory when not providing hive-site.xml Key: SPARK-10046 URL: https://issues.apache.org/jira/browse/SPARK-10046

[jira] [Created] (SPARK-10045) Add support for DataFrameStatFunctions in SparkR

2015-08-16 Thread Sun Rui (JIRA)
Sun Rui created SPARK-10045: --- Summary: Add support for DataFrameStatFunctions in SparkR Key: SPARK-10045 URL: https://issues.apache.org/jira/browse/SPARK-10045 Project: Spark Issue Type: New Featur

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699036#comment-14699036 ] Cheng Lian commented on SPARK-7837: --- Good job! > NPE when save as parquet in speculativ

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699032#comment-14699032 ] Shivaram Venkataraman commented on SPARK-10043: --- [~yuu.ishik...@gmail.com]

[jira] [Assigned] (SPARK-10044) AnalysisException in resolving reference for sorting with aggregation

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10044: Assignee: (was: Apache Spark) > AnalysisException in resolving reference for sorting w

[jira] [Assigned] (SPARK-10044) AnalysisException in resolving reference for sorting with aggregation

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10044: Assignee: Apache Spark > AnalysisException in resolving reference for sorting with aggrega

[jira] [Commented] (SPARK-10044) AnalysisException in resolving reference for sorting with aggregation

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699029#comment-14699029 ] Apache Spark commented on SPARK-10044: -- User 'chenghao-intel' has created a pull req

[jira] [Created] (SPARK-10044) AnalysisException in resolving reference for sorting with aggregation

2015-08-16 Thread Cheng Hao (JIRA)
Cheng Hao created SPARK-10044: - Summary: AnalysisException in resolving reference for sorting with aggregation Key: SPARK-10044 URL: https://issues.apache.org/jira/browse/SPARK-10044 Project: Spark

[jira] [Resolved] (SPARK-10011) Cannot process hidden file

2015-08-16 Thread Naga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naga resolved SPARK-10011. -- Resolution: Not A Problem No need to fix, as Hadoop/MapReduce itself ignores dot files for some reason. > Cann

[jira] [Commented] (SPARK-10011) Cannot process hidden file

2015-08-16 Thread Naga (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699018#comment-14699018 ] Naga commented on SPARK-10011: -- You are right, Hadoop/MapReduce ignores dot files; not sure

[jira] [Comment Edited] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699000#comment-14699000 ] Hyukjin Kwon edited comment on SPARK-10030 at 8/17/15 4:26 AM:

[jira] [Commented] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14699000#comment-14699000 ] Hyukjin Kwon commented on SPARK-10030: -- Such use case issue (maybe rather question)

[jira] [Updated] (SPARK-10041) Proposal of Parameter Server Interface for Spark

2015-08-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated SPARK-10041: --- Component/s: MLlib > Proposal of Parameter Server Interface for Spark > -

[jira] [Commented] (SPARK-10043) Add window functions into SparkR

2015-08-16 Thread Yu Ishikawa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698994#comment-14698994 ] Yu Ishikawa commented on SPARK-10043: - As far as I know, there is no unit testing of

[jira] [Created] (SPARK-10043) Add window functions into SparkR

2015-08-16 Thread Yu Ishikawa (JIRA)
Yu Ishikawa created SPARK-10043: --- Summary: Add window functions into SparkR Key: SPARK-10043 URL: https://issues.apache.org/jira/browse/SPARK-10043 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread Fei Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698974#comment-14698974 ] Fei Wang commented on SPARK-10030: -- [~liancheng] can you have a look on this issue? > M

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Priority: Blocker (was: Major) > Managed memory leak detected when cache table > -

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698949#comment-14698949 ] Yin Huai commented on SPARK-7837: - ah i see the reason of the NPE. We actually called clos

[jira] [Created] (SPARK-10042) Use consistent behavior for Internal Accumulators across stage retries

2015-08-16 Thread Imran Rashid (JIRA)
Imran Rashid created SPARK-10042: Summary: Use consistent behavior for Internal Accumulators across stage retries Key: SPARK-10042 URL: https://issues.apache.org/jira/browse/SPARK-10042 Project: Spark

[jira] [Updated] (SPARK-10041) Proposal of Parameter Server Interface for Spark

2015-08-16 Thread Yi Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yi Liu updated SPARK-10041: --- Attachment: Proposal of Parameter Server Interface for Spark - v1.pdf Attach the first version document of pr

[jira] [Created] (SPARK-10041) Proposal of Parameter Server Interface for Spark

2015-08-16 Thread Yi Liu (JIRA)
Yi Liu created SPARK-10041: -- Summary: Proposal of Parameter Server Interface for Spark Key: SPARK-10041 URL: https://issues.apache.org/jira/browse/SPARK-10041 Project: Spark Issue Type: New Feature

[jira] [Created] (SPARK-10040) JDBC writer change to use batch insert for performance

2015-08-16 Thread Rama Mullapudi (JIRA)
Rama Mullapudi created SPARK-10040: -- Summary: JDBC writer change to use batch insert for performance Key: SPARK-10040 URL: https://issues.apache.org/jira/browse/SPARK-10040 Project: Spark Is

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: I test the lastest spark-1.5.0 in local, standalone, yarn mode and follow the steps bellow, t

[jira] [Updated] (SPARK-10039) Resetting REPL state not work

2015-08-16 Thread Kevin Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Jung updated SPARK-10039: --- Priority: Minor (was: Major) > Resetting REPL state not work > - > >

[jira] [Updated] (SPARK-10039) Resetting REPL state not work

2015-08-16 Thread Kevin Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Jung updated SPARK-10039: --- Description: Spark shell can't find a base directory of class server after running ":reset" command.

[jira] [Created] (SPARK-10039) Resetting REPL state not work

2015-08-16 Thread Kevin Jung (JIRA)
Kevin Jung created SPARK-10039: -- Summary: Resetting REPL state not work Key: SPARK-10039 URL: https://issues.apache.org/jira/browse/SPARK-10039 Project: Spark Issue Type: Bug Component

[jira] [Updated] (SPARK-10038) TungstenProject code generation fails when applied to array

2015-08-16 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10038: --- Priority: Blocker (was: Major) > TungstenProject code generation fails when applied to array > -

[jira] [Created] (SPARK-10038) TungstenProject code generation fails when applied to array

2015-08-16 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10038: -- Summary: TungstenProject code generation fails when applied to array Key: SPARK-10038 URL: https://issues.apache.org/jira/browse/SPARK-10038 Project: Spark Issu

[jira] [Commented] (SPARK-9911) User guide for MulticlassClassificationEvaluator

2015-08-16 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698857#comment-14698857 ] Feynman Liang commented on SPARK-9911: -- Sure, [~mengxr] > User guide for MulticlassC

[jira] [Commented] (SPARK-10037) dev/change-scala-version.sh ends up with incorrect jline dependency for REPL

2015-08-16 Thread Stephen Boesch (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698846#comment-14698846 ] Stephen Boesch commented on SPARK-10037: I verified that the 2.10.4 jline depend

[jira] [Commented] (SPARK-9911) User guide for MulticlassClassificationEvaluator

2015-08-16 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698841#comment-14698841 ] Manoj Kumar commented on SPARK-9911: Can I work on this? > User guide for MulticlassC

[jira] [Updated] (SPARK-10011) Cannot process hidden file

2015-08-16 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10011: -- Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) I think dot files are always ig

[jira] [Created] (SPARK-10037) dev/change-scala-version.sh ends up with incorrect jline dependency for REPL

2015-08-16 Thread Stephen Boesch (JIRA)
Stephen Boesch created SPARK-10037: -- Summary: dev/change-scala-version.sh ends up with incorrect jline dependency for REPL Key: SPARK-10037 URL: https://issues.apache.org/jira/browse/SPARK-10037 Pr

[jira] [Commented] (SPARK-10016) ML model broadcasts should be stored in private vars: spark.ml Word2Vec

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698808#comment-14698808 ] Apache Spark commented on SPARK-10016: -- User 'vinodkc' has created a pull request fo

[jira] [Assigned] (SPARK-10016) ML model broadcasts should be stored in private vars: spark.ml Word2Vec

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10016: Assignee: (was: Apache Spark) > ML model broadcasts should be stored in private vars:

[jira] [Assigned] (SPARK-10016) ML model broadcasts should be stored in private vars: spark.ml Word2Vec

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10016: Assignee: Apache Spark > ML model broadcasts should be stored in private vars: spark.ml Wo

[jira] [Commented] (SPARK-7837) NPE when save as parquet in speculative tasks

2015-08-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698767#comment-14698767 ] Cheng Lian commented on SPARK-7837: --- Just a note to people who want to reproduce this is

[jira] [Resolved] (SPARK-10005) Parquet reader doesn't handle schema merging properly for nested structs

2015-08-16 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10005. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8228 [https://github.com/a

[jira] [Assigned] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman reassigned SPARK-9760: Assignee: Shivaram Venkataraman > SparkSubmit doesn't work with --packages

[jira] [Resolved] (SPARK-9760) SparkSubmit doesn't work with --packages when --repositories is not specified

2015-08-16 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman resolved SPARK-9760. -- Resolution: Fixed Fix Version/s: 1.5.0 > SparkSubmit doesn't work with --

[jira] [Commented] (SPARK-9985) DataFrameWriter jdbc method ignore options that have been set

2015-08-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698729#comment-14698729 ] Shixiong Zhu commented on SPARK-9985: - I just realized SPARK-8463 didn't fix all probl

[jira] [Assigned] (SPARK-10036) DataFrameReader.json and DataFrameWriter.json don't load the JDBC driver class before creating JDBC connection

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10036: Assignee: Apache Spark > DataFrameReader.json and DataFrameWriter.json don't load the JDBC

[jira] [Commented] (SPARK-10036) DataFrameReader.json and DataFrameWriter.json don't load the JDBC driver class before creating JDBC connection

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10036?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698727#comment-14698727 ] Apache Spark commented on SPARK-10036: -- User 'zsxwing' has created a pull request fo

[jira] [Assigned] (SPARK-10036) DataFrameReader.json and DataFrameWriter.json don't load the JDBC driver class before creating JDBC connection

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10036: Assignee: (was: Apache Spark) > DataFrameReader.json and DataFrameWriter.json don't lo

[jira] [Created] (SPARK-10036) DataFrameReader.json and DataFrameWriter.json don't load the JDBC driver class before creating JDBC connection

2015-08-16 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-10036: Summary: DataFrameReader.json and DataFrameWriter.json don't load the JDBC driver class before creating JDBC connection Key: SPARK-10036 URL: https://issues.apache.org/jira/browse

[jira] [Commented] (SPARK-9985) DataFrameWriter jdbc method ignore options that have been set

2015-08-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698706#comment-14698706 ] Shixiong Zhu commented on SPARK-9985: - BTW, `sqlContext.load` will load the driver cla

[jira] [Commented] (SPARK-9985) DataFrameWriter jdbc method ignore options that have been set

2015-08-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698702#comment-14698702 ] Shixiong Zhu commented on SPARK-9985: - [~rlgarris_databricks] I think this has been fi

[jira] [Resolved] (SPARK-9985) DataFrameWriter jdbc method ignore options that have been set

2015-08-16 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-9985. - Resolution: Fixed Target Version/s: (was: 1.5.0) > DataFrameWriter jdbc method ignore

[jira] [Commented] (SPARK-10034) Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering"

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698701#comment-14698701 ] Apache Spark commented on SPARK-10034: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-10034) Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering"

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10034: Assignee: (was: Apache Spark) > Can't analyze Sort on Aggregate with aggregation expre

[jira] [Assigned] (SPARK-10034) Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering"

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10034: Assignee: Apache Spark > Can't analyze Sort on Aggregate with aggregation expression named

[jira] [Created] (SPARK-10035) Parquet filters does not process EqualNullSafe filter.

2015-08-16 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-10035: Summary: Parquet filters does not process EqualNullSafe filter. Key: SPARK-10035 URL: https://issues.apache.org/jira/browse/SPARK-10035 Project: Spark Issue

[jira] [Closed] (SPARK-10033) Sort on

2015-08-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan closed SPARK-10033. --- Resolution: Invalid > Sort on > > > Key: SPARK-10033 > URL:

[jira] [Updated] (SPARK-10034) Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering"

2015-08-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-10034: Description: {code=scala} val df = Seq(1 -> 2).toDF("i", "j") val query = df.groupBy('i) .agg(max

[jira] [Updated] (SPARK-10034) Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering"

2015-08-16 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-10034: Description: {code} val df = Seq(1 -> 2).toDF("i", "j") val query = df.groupBy('i) .agg(max('j).a

[jira] [Created] (SPARK-10034) Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering"

2015-08-16 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-10034: --- Summary: Can't analyze Sort on Aggregate with aggregation expression named "_aggOrdering" Key: SPARK-10034 URL: https://issues.apache.org/jira/browse/SPARK-10034 Projec

[jira] [Created] (SPARK-10033) Sort on

2015-08-16 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-10033: --- Summary: Sort on Key: SPARK-10033 URL: https://issues.apache.org/jira/browse/SPARK-10033 Project: Spark Issue Type: Bug Reporter: Wenchen Fan

[jira] [Assigned] (SPARK-7707) User guide and example code for KernelDensity

2015-08-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza reassigned SPARK-7707: - Assignee: Sandy Ryza > User guide and example code for KernelDensity > --

[jira] [Assigned] (SPARK-7707) User guide and example code for KernelDensity

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7707: --- Assignee: Apache Spark > User guide and example code for KernelDensity >

[jira] [Commented] (SPARK-7707) User guide and example code for KernelDensity

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698647#comment-14698647 ] Apache Spark commented on SPARK-7707: - User 'sryza' has created a pull request for thi

[jira] [Assigned] (SPARK-7707) User guide and example code for KernelDensity

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7707: --- Assignee: (was: Apache Spark) > User guide and example code for KernelDensity > -

[jira] [Updated] (SPARK-7707) User guide and example code for KernelDensity

2015-08-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandy Ryza updated SPARK-7707: -- Summary: User guide and example code for KernelDensity (was: User guide and example code for Statistics

[jira] [Commented] (SPARK-8918) Add @since tags to mllib.clustering

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698635#comment-14698635 ] Apache Spark commented on SPARK-8918: - User 'XiaoqingWang' has created a pull request

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: I test lastest spark-1.5.0 in local, standalone, yarn mode and follow the steps bellow, then

[jira] [Commented] (SPARK-7707) User guide and example code for Statistics.kernelDensity

2015-08-16 Thread Sandy Ryza (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698634#comment-14698634 ] Sandy Ryza commented on SPARK-7707: --- [~mengxr] thoughts on which page this should land i

[jira] [Updated] (SPARK-9973) Wrong initial size of in-memory columnar buffers

2015-08-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9973: -- Fix Version/s: 1.5.0 > Wrong initial size of in-memory columnar buffers > --

[jira] [Resolved] (SPARK-9973) Wrong initial size of in-memory columnar buffers

2015-08-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-9973. --- Resolution: Fixed Resolved by https://github.com/apache/spark/pull/8189 > Wrong initial size of in-me

[jira] [Assigned] (SPARK-10005) Parquet reader doesn't handle schema merging properly for nested structs

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10005: Assignee: Apache Spark (was: Cheng Lian) > Parquet reader doesn't handle schema merging p

[jira] [Updated] (SPARK-10005) Parquet reader doesn't handle schema merging properly for nested structs

2015-08-16 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-10005: --- Description: Spark shell snippet to reproduce this issue (note that both {{DataFrame}} written below

[jira] [Commented] (SPARK-10005) Parquet reader doesn't handle schema merging properly for nested structs

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698631#comment-14698631 ] Apache Spark commented on SPARK-10005: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-10005) Parquet reader doesn't handle schema merging properly for nested structs

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10005: Assignee: Cheng Lian (was: Apache Spark) > Parquet reader doesn't handle schema merging p

[jira] [Updated] (SPARK-10029) Add Python examples for mllib IsotonicRegression user guide

2015-08-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10029: Labels: 1.5.0 (was: ) > Add Python examples for mllib IsotonicRegression user guide >

[jira] [Assigned] (SPARK-10032) Add Python example for mllib LDAModel user guide

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10032: Assignee: Apache Spark > Add Python example for mllib LDAModel user guide > --

[jira] [Assigned] (SPARK-10032) Add Python example for mllib LDAModel user guide

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10032: Assignee: (was: Apache Spark) > Add Python example for mllib LDAModel user guide > ---

[jira] [Commented] (SPARK-10032) Add Python example for mllib LDAModel user guide

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698627#comment-14698627 ] Apache Spark commented on SPARK-10032: -- User 'yanboliang' has created a pull request

[jira] [Updated] (SPARK-10032) Add Python example for mllib LDAModel user guide

2015-08-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10032: Affects Version/s: (was: 1.5.0) > Add Python example for mllib LDAModel user guide > --

[jira] [Created] (SPARK-10032) Add Python example for mllib LDAModel user guide

2015-08-16 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10032: --- Summary: Add Python example for mllib LDAModel user guide Key: SPARK-10032 URL: https://issues.apache.org/jira/browse/SPARK-10032 Project: Spark Issue Type: Su

[jira] [Updated] (SPARK-10032) Add Python example for mllib LDAModel user guide

2015-08-16 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10032: Labels: 1.5.0 (was: ) > Add Python example for mllib LDAModel user guide > ---

[jira] [Assigned] (SPARK-10031) Join two UnsafeRows in SortMergeJoin if possible

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10031: Assignee: Apache Spark > Join two UnsafeRows in SortMergeJoin if possible > --

[jira] [Commented] (SPARK-10031) Join two UnsafeRows in SortMergeJoin if possible

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14698609#comment-14698609 ] Apache Spark commented on SPARK-10031: -- User 'viirya' has created a pull request for

[jira] [Assigned] (SPARK-10031) Join two UnsafeRows in SortMergeJoin if possible

2015-08-16 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10031: Assignee: (was: Apache Spark) > Join two UnsafeRows in SortMergeJoin if possible > ---

[jira] [Created] (SPARK-10031) Join two UnsafeRows in SortMergeJoin if possible

2015-08-16 Thread Liang-Chi Hsieh (JIRA)
Liang-Chi Hsieh created SPARK-10031: --- Summary: Join two UnsafeRows in SortMergeJoin if possible Key: SPARK-10031 URL: https://issues.apache.org/jira/browse/SPARK-10031 Project: Spark Issue

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: I test lastest spark-1.5.0 in local, standalone, yarn mode and follow the steps bellow, then

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: I test lastest spark-1.5.0 in local, standalone, yarn mode and follow the steps bellow, then

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: I test lastest spark-1.5.0 in standalone mode and follow the steps bellow, then issues occure

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: 1. create table cache_test(id int, name string) stored as textfile ; 2. load data local inpat

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: 1. create table cache_test(id int, name string) stored as textfile ; 2. load data local inpat

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: 1. create table cache_test(id int, name string) stored as textfile ; 2. load data local inpat

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: 1. create table cache_test(id int, name string) stored as textfile ; 2. load data local inpat

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: 1. create table cache_test(id int, name string) stored as textfile ; 2. load data local inpat

[jira] [Updated] (SPARK-10030) Managed memory leak detected when cache table

2015-08-16 Thread wangwei (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] wangwei updated SPARK-10030: Description: 1. create table cache_test(id int, name string) stored as textfile ; 2. load data local inpat

  1   2   >