[jira] [Updated] (SPARK-10331) Update user guide to address minor comments during code review

2015-08-29 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10331: -- Priority: Major (was: Minor) Update user guide to address minor comments during code review

[jira] [Created] (SPARK-10349) OneVsRest use when ... otherwise not UDF to generate new label at binary reduction

2015-08-29 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-10349: --- Summary: OneVsRest use when ... otherwise not UDF to generate new label at binary reduction Key: SPARK-10349 URL: https://issues.apache.org/jira/browse/SPARK-10349

[jira] [Resolved] (SPARK-10175) Enhance spark doap file

2015-08-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-10175. --- Resolution: Fixed Assignee: Luciano Resende (was: Sean Owen) Fix Version/s: 1.5.0

[jira] [Created] (SPARK-10348) Improve Spark ML user guide

2015-08-29 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10348: - Summary: Improve Spark ML user guide Key: SPARK-10348 URL: https://issues.apache.org/jira/browse/SPARK-10348 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-10349) OneVsRest use when ... otherwise not UDF to generate new label at binary reduction

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721026#comment-14721026 ] Apache Spark commented on SPARK-10349: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-10349) OneVsRest use when ... otherwise not UDF to generate new label at binary reduction

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10349: Assignee: Apache Spark OneVsRest use when ... otherwise not UDF to generate new label at

[jira] [Assigned] (SPARK-10349) OneVsRest use when ... otherwise not UDF to generate new label at binary reduction

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10349: Assignee: (was: Apache Spark) OneVsRest use when ... otherwise not UDF to generate

[jira] [Assigned] (SPARK-10331) Update user guide to address minor comments during code review

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10331: Assignee: Xiangrui Meng (was: Apache Spark) Update user guide to address minor comments

[jira] [Commented] (SPARK-10331) Update user guide to address minor comments during code review

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721007#comment-14721007 ] Apache Spark commented on SPARK-10331: -- User 'mengxr' has created a pull request for

[jira] [Updated] (SPARK-10175) Enhance spark doap file

2015-08-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10175: -- Shepherd: (was: Matei Zaharia) Assignee: Sean Owen Target Version/s: 1.5.0

[jira] [Assigned] (SPARK-10331) Update user guide to address minor comments during code review

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10331: Assignee: Apache Spark (was: Xiangrui Meng) Update user guide to address minor comments

[jira] [Updated] (SPARK-10349) OneVsRest use when ... otherwise not UDF to generate new label at binary reduction

2015-08-29 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-10349: Description: Currently OneVsRest use UDF to generate new binary label during training. Considering

[jira] [Commented] (SPARK-10348) Improve Spark ML user guide

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14720995#comment-14720995 ] Apache Spark commented on SPARK-10348: -- User 'mengxr' has created a pull request for

[jira] [Assigned] (SPARK-10348) Improve Spark ML user guide

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10348: Assignee: Xiangrui Meng (was: Apache Spark) Improve Spark ML user guide

[jira] [Assigned] (SPARK-10348) Improve Spark ML user guide

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10348: Assignee: Apache Spark (was: Xiangrui Meng) Improve Spark ML user guide

[jira] [Commented] (SPARK-5992) Locality Sensitive Hashing (LSH) for MLlib

2015-08-29 Thread Maruf Aytekin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5992?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721066#comment-14721066 ] Maruf Aytekin commented on SPARK-5992: -- I have developed spark implementation of LSH

[jira] [Created] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Guoqiang Li (JIRA)
Guoqiang Li created SPARK-10350: --- Summary: Fix SQL Programming Guide Key: SPARK-10350 URL: https://issues.apache.org/jira/browse/SPARK-10350 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10350: -- Target Version/s: (was: 1.5.0) [~gq] this doesn't contain any explanation, and neither does the pull

[jira] [Updated] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-10350: Description:

[jira] [Updated] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-10350: Description:

[jira] [Updated] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guoqiang Li updated SPARK-10350: Description:

[jira] [Assigned] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10350: Assignee: Apache Spark Fix SQL Programming Guide -

[jira] [Commented] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721074#comment-14721074 ] Apache Spark commented on SPARK-10350: -- User 'witgo' has created a pull request for

[jira] [Assigned] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10350: Assignee: (was: Apache Spark) Fix SQL Programming Guide -

[jira] [Commented] (SPARK-10301) For struct type, if parquet's global schema has less fields than a file's schema, data reading will fail

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721187#comment-14721187 ] Apache Spark commented on SPARK-10301: -- User 'yhuai' has created a pull request for

[jira] [Updated] (SPARK-10340) Use S3 bulk listing for S3-backed Hive tables

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10340: - Target Version/s: 1.6.0 (was: 1.5.0) Use S3 bulk listing for S3-backed Hive tables

[jira] [Updated] (SPARK-10340) Use S3 bulk listing for S3-backed Hive tables

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10340: - Target Version/s: 1.5.0 Use S3 bulk listing for S3-backed Hive tables

[jira] [Commented] (SPARK-10330) Use SparkHadoopUtil TaskAttemptContext reflection methods in more places

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721275#comment-14721275 ] Apache Spark commented on SPARK-10330: -- User 'JoshRosen' has created a pull request

[jira] [Updated] (SPARK-9926) Parallelize file listing for partitioned Hive table

2015-08-29 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai updated SPARK-9926: --- Assignee: Cheolsoo Park Parallelize file listing for partitioned Hive table

[jira] [Commented] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap memory

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721286#comment-14721286 ] Feynman Liang commented on SPARK-10351: --- I'm working on a PR to make my use case

[jira] [Created] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap memory

2015-08-29 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10351: - Summary: UnsafeRow.getUTF8String should handle off-heap memory Key: SPARK-10351 URL: https://issues.apache.org/jira/browse/SPARK-10351 Project: Spark

[jira] [Updated] (SPARK-10170) Writing from data frame into db2 database using jdbc data source api fails with error for string, and boolean column types.

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10170: - Target Version/s: 1.6.0 Writing from data frame into db2 database using jdbc data

[jira] [Resolved] (SPARK-10350) Fix SQL Programming Guide

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10350. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8520

[jira] [Resolved] (SPARK-10226) Error occured in SparkSQL when using !=

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10226. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8420

[jira] [Resolved] (SPARK-10344) Add tests for extraStrategies

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10344. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8516

[jira] [Commented] (SPARK-9523) Receiver for Spark Streaming does not naturally support kryo serializer

2015-08-29 Thread John Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721354#comment-14721354 ] John Chen commented on SPARK-9523: -- The problem here is not about warn/error/etc, it's

[jira] [Updated] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2015-08-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-1564: - Assignee: Deron Eriksson (was: Andrew Or) Add JavaScript into Javadoc to turn ::Experimental:: and such

[jira] [Updated] (SPARK-10353) MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication

2015-08-29 Thread Burak Yavuz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Burak Yavuz updated SPARK-10353: Affects Version/s: 1.5.0 MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose

[jira] [Assigned] (SPARK-10353) MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10353: Assignee: Apache Spark MLlib BLAS gemm outputs wrong result when beta = 0.0 for

[jira] [Assigned] (SPARK-10353) MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10353: Assignee: (was: Apache Spark) MLlib BLAS gemm outputs wrong result when beta = 0.0

[jira] [Commented] (SPARK-10353) MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721392#comment-14721392 ] Apache Spark commented on SPARK-10353: -- User 'brkyvz' has created a pull request for

[jira] [Created] (SPARK-10353) MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication

2015-08-29 Thread Burak Yavuz (JIRA)
Burak Yavuz created SPARK-10353: --- Summary: MLlib BLAS gemm outputs wrong result when beta = 0.0 for transpose transpose matrix multiplication Key: SPARK-10353 URL: https://issues.apache.org/jira/browse/SPARK-10353

[jira] [Updated] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap memory

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10351: -- Description: {{UnsafeRow.getUTF8String}} delegates to {{UTF8String.fromAddress}} which returns

[jira] [Updated] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap memory

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10351: -- Description: {{UnsafeRow.getUTF8String}} delegates to {{UTF8String.fromAddress}} which

[jira] [Comment Edited] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap memory

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721286#comment-14721286 ] Feynman Liang edited comment on SPARK-10351 at 8/29/15 11:12 PM:

[jira] [Commented] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721289#comment-14721289 ] Feynman Liang commented on SPARK-10352: --- Working on a PR. [~rxin] can you confirm

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code scala} val inputString = abc val row =

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {{code}} val inputString = abc val row =

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code} val inputString = abc val row =

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code} val inputString = abc val row =

[jira] [Created] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-10352: - Summary: BaseGenericInternalRow.getUTF8String should support java.lang.String Key: SPARK-10352 URL: https://issues.apache.org/jira/browse/SPARK-10352 Project:

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code:scala} val inputString = abc val row =

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code} val inputString = abc val row =

[jira] [Commented] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721291#comment-14721291 ] Apache Spark commented on SPARK-10352: -- User 'feynmanliang' has created a pull

[jira] [Assigned] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10352: Assignee: Apache Spark BaseGenericInternalRow.getUTF8String should support

[jira] [Assigned] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10352: Assignee: (was: Apache Spark) BaseGenericInternalRow.getUTF8String should support

[jira] [Resolved] (SPARK-10334) Partitioned table scan's query plan does not show Filter and Project on top of the table scan

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10334. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8515

[jira] [Resolved] (SPARK-10339) When scanning a partitioned table having thousands of partitions, Driver has a very high memory pressure because of SQL metrics

2015-08-29 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10339. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8515

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code} val inputString = abc val row =

[jira] [Updated] (SPARK-10352) BaseGenericInternalRow.getUTF8String should support java.lang.String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Description: Running the code: {code} val inputString = abc val row =

[jira] [Updated] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap memory

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10351: -- Description: {{UnsafeRow.getUTF8String}} delegates to {{UTF8String.fromAddress}} which

[jira] [Updated] (SPARK-10351) UnsafeRow.getString should handle off-heap backed UnsafeRow

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10351: -- Summary: UnsafeRow.getString should handle off-heap backed UnsafeRow (was:

[jira] [Updated] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap backed UnsafeRow

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10351: -- Summary: UnsafeRow.getUTF8String should handle off-heap backed UnsafeRow (was:

[jira] [Assigned] (SPARK-10351) UnsafeRow.getString should handle off-heap backed UnsafeRow

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10351: Assignee: Apache Spark UnsafeRow.getString should handle off-heap backed UnsafeRow

[jira] [Assigned] (SPARK-10351) UnsafeRow.getString should handle off-heap backed UnsafeRow

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10351: Assignee: (was: Apache Spark) UnsafeRow.getString should handle off-heap backed

[jira] [Commented] (SPARK-10351) UnsafeRow.getString should handle off-heap backed UnsafeRow

2015-08-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721302#comment-14721302 ] Apache Spark commented on SPARK-10351: -- User 'feynmanliang' has created a pull

[jira] [Updated] (SPARK-10352) Replace internal usages of String with UTF8String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Summary: Replace internal usages of String with UTF8String (was:

[jira] [Updated] (SPARK-10352) Replace SQLTestData internal usages of String with UTF8String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10352: -- Summary: Replace SQLTestData internal usages of String with UTF8String (was: Replace internal

[jira] [Updated] (SPARK-10334) Partitioned table scan's query plan does not show Filter and Project on top of the table scan

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10334: - Target Version/s: 1.5.0 (was: 1.6.0, 1.5.1) Partitioned table scan's query plan does not show Filter

[jira] [Commented] (SPARK-10301) For struct type, if parquet's global schema has less fields than a file's schema, data reading will fail

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721312#comment-14721312 ] Yin Huai commented on SPARK-10301: -- https://github.com/apache/spark/pull/8515 has been

[jira] [Updated] (SPARK-10301) For struct type, if parquet's global schema has less fields than a file's schema, data reading will fail

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10301: - Assignee: Cheng Lian (was: Yin Huai) For struct type, if parquet's global schema has less fields than

[jira] [Updated] (SPARK-10301) For struct type, if parquet's global schema has less fields than a file's schema, data reading will fail

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10301: - Target Version/s: 1.6.0 (was: 1.5.0) For struct type, if parquet's global schema has less fields than

[jira] [Updated] (SPARK-9976) create function do not work

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9976: Fix Version/s: (was: 1.4.2) (was: 1.5.0) create function do not work

[jira] [Commented] (SPARK-9976) create function do not work

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721313#comment-14721313 ] Yin Huai commented on SPARK-9976: - Can you try our 1.5 branch and see if add jar in thrift

[jira] [Updated] (SPARK-9514) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9514: Fix Version/s: (was: 1.5.0) Add EventHubsReceiver to support Spark Streaming using Azure EventHubs

[jira] [Commented] (SPARK-10110) StringIndexer lacks of parameter handleInvalid.

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721314#comment-14721314 ] Yin Huai commented on SPARK-10110: -- I am removing fix version since this field will not

[jira] [Updated] (SPARK-10110) StringIndexer lacks of parameter handleInvalid.

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10110?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-10110: - Fix Version/s: (was: 1.5.0) StringIndexer lacks of parameter handleInvalid.

[jira] [Closed] (SPARK-10352) Replace SQLTestData internal usages of String with UTF8String

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang closed SPARK-10352. - Resolution: Not A Problem Caused by my code not respecting {{InternalRow}} can only contain

[jira] [Commented] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721316#comment-14721316 ] Yin Huai commented on SPARK-1564: - https://github.com/apache/spark/pull/7169 has been

[jira] [Commented] (SPARK-10351) UnsafeRow.getString should handle off-heap backed UnsafeRow

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721318#comment-14721318 ] Reynold Xin commented on SPARK-10351: - getString is only used in debugging I think?

[jira] [Resolved] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-1564. - Resolution: Fixed Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

[jira] [Commented] (SPARK-1564) Add JavaScript into Javadoc to turn ::Experimental:: and such into badges

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721319#comment-14721319 ] Yin Huai commented on SPARK-1564: - [~andrewor14] seems I cannot change the assignee to

[jira] [Updated] (SPARK-10351) UnsafeRow.getUTF8String should handle off-heap backed UnsafeRow

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Feynman Liang updated SPARK-10351: -- Summary: UnsafeRow.getUTF8String should handle off-heap backed UnsafeRow (was:

[jira] [Commented] (SPARK-8684) Update R version in Spark EC2 AMI

2015-08-29 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721324#comment-14721324 ] Yin Huai commented on SPARK-8684: - Should we resolve it? Update R version in Spark EC2

[jira] [Commented] (SPARK-10351) UnsafeRow.getString should handle off-heap backed UnsafeRow

2015-08-29 Thread Feynman Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721325#comment-14721325 ] Feynman Liang commented on SPARK-10351: --- Sorry, the fix is for {{getUTF8String}}.

[jira] [Resolved] (SPARK-9991) Create local limit operator

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9991. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Create local limit

[jira] [Comment Edited] (SPARK-6817) DataFrame UDFs in R

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14717079#comment-14717079 ] Reynold Xin edited comment on SPARK-6817 at 8/30/15 1:14 AM: -

[jira] [Resolved] (SPARK-9986) Create a simple test framework for local operators

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9986. Resolution: Fixed Fix Version/s: 1.6.0 Create a simple test framework for local operators

[jira] [Resolved] (SPARK-9993) Create local union operator

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9993. Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Create local union

[jira] [Commented] (SPARK-9078) Use of non-standard LIMIT keyword in JDBC tableExists code

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14721328#comment-14721328 ] Reynold Xin commented on SPARK-9078: Please submit a pull request, [~tsuresh]. I

[jira] [Updated] (SPARK-10219) Error when additional options provided as variable in write.df

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10219: Fix Version/s: (was: 1.5.1) (was: 1.6.0) 1.5.0

[jira] [Updated] (SPARK-10308) %in% is not exported in SparkR

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10308: Fix Version/s: (was: 1.5.1) (was: 1.6.0) 1.5.0 %in%

[jira] [Updated] (SPARK-10287) After processing a query using JSON data, Spark SQL continuously refreshes metadata of the table

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10287: Fix Version/s: (was: 1.5.1) 1.5.0 After processing a query using JSON

[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10188: Fix Version/s: (was: 1.5.1) 1.5.0 Pyspark CrossValidator with RMSE selects

[jira] [Updated] (SPARK-9671) ML 1.5 QA: Programming guide update and migration guide

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9671: --- Fix Version/s: (was: 1.5.1) 1.5.0 ML 1.5 QA: Programming guide update and

[jira] [Updated] (SPARK-10188) Pyspark CrossValidator with RMSE selects incorrect model

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10188: Target Version/s: 1.5.0 (was: 1.5.1) Pyspark CrossValidator with RMSE selects incorrect model

[jira] [Updated] (SPARK-9316) Add support for filtering using `[` (synonym for filter / select)

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9316: --- Fix Version/s: (was: 1.5.1) (was: 1.6.0) 1.5.0 Add

[jira] [Updated] (SPARK-8952) JsonFile() of SQLContext display improper warning message for a S3 path

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8952?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8952: --- Fix Version/s: (was: 1.5.1) (was: 1.6.0) 1.5.0

[jira] [Updated] (SPARK-9890) User guide for CountVectorizer

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9890: --- Fix Version/s: (was: 1.5.1) 1.5.0 User guide for CountVectorizer

[jira] [Updated] (SPARK-10315) remove document on spark.akka.failure-detector.threshold

2015-08-29 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-10315: Fix Version/s: (was: 1.5.1) (was: 1.6.0) 1.5.0

  1   2   >