[jira] [Assigned] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12196: Assignee: (was: Apache Spark) > Store blocks in storage devices with hierarchy way > -

[jira] [Updated] (SPARK-12144) Support more external data source API in SparkR

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12144: Description: Currently we support read.df, write.df, jsonFile, parquetFile in SQLContext, we shoul

[jira] [Commented] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046544#comment-15046544 ] Apache Spark commented on SPARK-12196: -- User 'yucai' has created a pull request for

[jira] [Updated] (SPARK-12144) Support more external data source API in SparkR

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12144: Description: Currently we support read.df, write.df, jsonFile, parquetFile in SQLContext, we shoul

[jira] [Assigned] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12196: Assignee: Apache Spark > Store blocks in storage devices with hierarchy way >

[jira] [Updated] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12198: Issue Type: Sub-task (was: Improvement) Parent: SPARK-12144 > SparkR support read.parquet

[jira] [Resolved] (SPARK-11957) SQLTransformer docs are unclear about generality of SQL statements

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11957. --- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10006 [https://g

[jira] [Resolved] (SPARK-11958) Create user guide section for SQLTransformer

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11958. --- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10006 [https://g

[jira] [Updated] (SPARK-12144) Support more external data source API in SparkR

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12144: Description: Currently we support read.df, write.df, jsonFile, parquetFile in SQLContext, we should

[jira] [Assigned] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12198: Assignee: Apache Spark > SparkR support read.parquet and deprecate parquetFile > -

[jira] [Commented] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046531#comment-15046531 ] Apache Spark commented on SPARK-12198: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12198: Assignee: (was: Apache Spark) > SparkR support read.parquet and deprecate parquetFile

[jira] [Commented] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Rotem Shaul (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046530#comment-15046530 ] Rotem Shaul commented on SPARK-12197: - Implemented solution as described above. Added

[jira] [Resolved] (SPARK-10259) Add @Since annotation to ml.classification

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10259. --- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 8534 [https://gi

[jira] [Assigned] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12197: Assignee: Apache Spark > Kryo's Avro Serializer add support for dynamic schemas using Sche

[jira] [Commented] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046528#comment-15046528 ] Apache Spark commented on SPARK-12197: -- User 'RotemShaul' has created a pull request

[jira] [Updated] (SPARK-12144) Support more external data source API in SparkR

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12144: Summary: Support more external data source API in SparkR (was: Implement DataFrameReader and Data

[jira] [Assigned] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12197: Assignee: (was: Apache Spark) > Kryo's Avro Serializer add support for dynamic schemas

[jira] [Commented] (SPARK-12199) Follow-up: Refine example code in ml-features.md

2015-12-07 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046527#comment-15046527 ] Xusen Yin commented on SPARK-12199: --- I am working on it > Follow-up: Refine example co

[jira] [Updated] (SPARK-12199) Follow-up: Refine example code in ml-features.md

2015-12-07 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin updated SPARK-12199: -- Fix Version/s: (was: 1.6.1) > Follow-up: Refine example code in ml-features.md > --

[jira] [Created] (SPARK-12199) Follow-up: Refine example code in ml-features.md

2015-12-07 Thread Xusen Yin (JIRA)
Xusen Yin created SPARK-12199: - Summary: Follow-up: Refine example code in ml-features.md Key: SPARK-12199 URL: https://issues.apache.org/jira/browse/SPARK-12199 Project: Spark Issue Type: Sub-ta

[jira] [Created] (SPARK-12198) SparkR support read.parquet and deprecate parquetFile

2015-12-07 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12198: --- Summary: SparkR support read.parquet and deprecate parquetFile Key: SPARK-12198 URL: https://issues.apache.org/jira/browse/SPARK-12198 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12160. --- Resolution: Fixed Fix Version/s: (was: 1.6.1) 1.5.3 Issue resol

[jira] [Updated] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12160: -- Target Version/s: 1.5.3, 1.6.1 (was: 1.4.2, 1.5.3, 1.6.1) > spark.mllib should use SQLContext.

[jira] [Updated] (SPARK-12160) spark.mllib should use SQLContext.getOrCreate

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12160: -- Fix Version/s: 1.6.1 > spark.mllib should use SQLContext.getOrCreate >

[jira] [Updated] (SPARK-11964) Create user guide section explaining export/import

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11964: -- Shepherd: Joseph K. Bradley > Create user guide section explaining export/import >

[jira] [Updated] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11551: -- Assignee: somil deshmukh > Replace example code in ml-features.md using include_example > -

[jira] [Resolved] (SPARK-11551) Replace example code in ml-features.md using include_example

2015-12-07 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11551. --- Resolution: Fixed Fix Version/s: 1.6.1 Issue resolved by pull request 10002 [https://g

[jira] [Updated] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Rotem Shaul (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rotem Shaul updated SPARK-12197: Description: The original problem: Serializing GenericRecords in Spark Core results in a very high

[jira] [Created] (SPARK-12197) Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository

2015-12-07 Thread Rotem Shaul (JIRA)
Rotem Shaul created SPARK-12197: --- Summary: Kryo's Avro Serializer add support for dynamic schemas using SchemaRepository Key: SPARK-12197 URL: https://issues.apache.org/jira/browse/SPARK-12197 Project:

[jira] [Closed] (SPARK-10290) Spark can register temp table and hive table with the same table name

2015-12-07 Thread pin_zhang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pin_zhang closed SPARK-10290. - not a bug > Spark can register temp table and hive table with the same table name >

[jira] [Updated] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread yucai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yucai updated SPARK-12196: -- Description: Problem: Nowadays, users have both SSDs and HDDs. SSDs have great performance, but capaci

[jira] [Created] (SPARK-12196) Store blocks in storage devices with hierarchy way

2015-12-07 Thread yucai (JIRA)
yucai created SPARK-12196: - Summary: Store blocks in storage devices with hierarchy way Key: SPARK-12196 URL: https://issues.apache.org/jira/browse/SPARK-12196 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-11487) Spark Master shutdown automatically after some applications execution

2015-12-07 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046438#comment-15046438 ] Xu Chen commented on SPARK-11487: - {code} java.lang.OutOfMemoryError: Java heap space {

[jira] [Commented] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046429#comment-15046429 ] Apache Spark commented on SPARK-12170: -- User 'yanboliang' has created a pull request

[jira] [Assigned] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12170: Assignee: Apache Spark > Deprecate the JAVA-specific deserialized storage levels > ---

[jira] [Assigned] (SPARK-12170) Deprecate the JAVA-specific deserialized storage levels

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12170: Assignee: (was: Apache Spark) > Deprecate the JAVA-specific deserialized storage level

[jira] [Commented] (SPARK-11928) Master retry deadlock

2015-12-07 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046393#comment-15046393 ] Xu Chen commented on SPARK-11928: - hi guys this issue have fixed at newly version > Mas

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-07 Thread Sun Rui (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046376#comment-15046376 ] Sun Rui commented on SPARK-12144: - [~yanboliang] go ahead. Could you please change the t

[jira] [Commented] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046369#comment-15046369 ] Felix Cheung commented on SPARK-12172: -- Sure. What are the uses for RDD stuff you ha

[jira] [Updated] (SPARK-12172) Consider removing SparkR internal RDD APIs

2015-12-07 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-12172: - Summary: Consider removing SparkR internal RDD APIs (was: Remove SparkR internal RDD APIs) > Co

[jira] [Commented] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046365#comment-15046365 ] Apache Spark commented on SPARK-12195: -- User 'gatorsmile' has created a pull request

[jira] [Assigned] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12195: Assignee: (was: Apache Spark) > Adding BigDecimal, Date and Timestamp into Encoder > -

[jira] [Assigned] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12195: Assignee: Apache Spark > Adding BigDecimal, Date and Timestamp into Encoder >

[jira] [Created] (SPARK-12195) Adding BigDecimal, Date and Timestamp into Encoder

2015-12-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12195: --- Summary: Adding BigDecimal, Date and Timestamp into Encoder Key: SPARK-12195 URL: https://issues.apache.org/jira/browse/SPARK-12195 Project: Spark Issue Type: Improvem

[jira] [Assigned] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12194: Assignee: Apache Spark > Add Sink for reporting Spark Metrics to OpenTSDB > --

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046359#comment-15046359 ] Apache Spark commented on SPARK-12194: -- User 'kapilsingh5050' has created a pull req

[jira] [Assigned] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12194: Assignee: (was: Apache Spark) > Add Sink for reporting Spark Metrics to OpenTSDB > ---

[jira] [Commented] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Kapil Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046331#comment-15046331 ] Kapil Singh commented on SPARK-12194: - I'm working on this. > Add Sink for reporting

[jira] [Created] (SPARK-12194) Add Sink for reporting Spark Metrics to OpenTSDB

2015-12-07 Thread Kapil Singh (JIRA)
Kapil Singh created SPARK-12194: --- Summary: Add Sink for reporting Spark Metrics to OpenTSDB Key: SPARK-12194 URL: https://issues.apache.org/jira/browse/SPARK-12194 Project: Spark Issue Type: Ne

[jira] [Updated] (SPARK-12190) spark does not start cleanly windows 7 64 bit

2015-12-07 Thread stefan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stefan updated SPARK-12190: --- Summary: spark does not start cleanly windows 7 64 bit (was: spark does not star cleanly windows 7 64 bit)

[jira] [Created] (SPARK-12193) Spark-Submit from node.js and call the process

2015-12-07 Thread himanshu singhal (JIRA)
himanshu singhal created SPARK-12193: Summary: Spark-Submit from node.js and call the process Key: SPARK-12193 URL: https://issues.apache.org/jira/browse/SPARK-12193 Project: Spark Issue

[jira] [Commented] (SPARK-12144) Implement DataFrameReader and DataFrameWriter API in SparkR

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046311#comment-15046311 ] Yanbo Liang commented on SPARK-12144: - I'm working on SPARK-12146 which is similar wi

[jira] [Commented] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046301#comment-15046301 ] Apache Spark commented on SPARK-11923: -- User 'yinxusen' has created a pull request f

[jira] [Assigned] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11923: Assignee: (was: Apache Spark) > Python API for ml.feature.ChiSqSelector >

[jira] [Assigned] (SPARK-11923) Python API for ml.feature.ChiSqSelector

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11923: Assignee: Apache Spark > Python API for ml.feature.ChiSqSelector > ---

[jira] [Comment Edited] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046278#comment-15046278 ] jinglei.chen edited comment on SPARK-12192 at 12/8/15 3:49 AM:

[jira] [Closed] (SPARK-11987) Python API update for ChiSqSelector and QuantileDiscretizer

2015-12-07 Thread Xusen Yin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xusen Yin closed SPARK-11987. - Resolution: Duplicate > Python API update for ChiSqSelector and QuantileDiscretizer > ---

[jira] [Commented] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046290#comment-15046290 ] Apache Spark commented on SPARK-12136: -- User 'bomeng' has created a pull request for

[jira] [Assigned] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12136: Assignee: Apache Spark > rddToFileName does not properly handle prefix and suffix paramete

[jira] [Assigned] (SPARK-12136) rddToFileName does not properly handle prefix and suffix parameters

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12136?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12136: Assignee: (was: Apache Spark) > rddToFileName does not properly handle prefix and suff

[jira] [Updated] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinglei.chen updated SPARK-12192: - Description: recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wr

[jira] [Updated] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jinglei.chen updated SPARK-12192: - Description: recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wr

[jira] [Comment Edited] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046278#comment-15046278 ] jinglei.chen edited comment on SPARK-12192 at 12/8/15 3:33 AM:

[jira] [Commented] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046278#comment-15046278 ] jinglei.chen commented on SPARK-12192: -- recommendProductsForUsers(num: Int) can run

[jira] [Updated] (SPARK-12191) Support "." character in DataFrame column name for ML

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12191: Description: Currently if you specify the inputCol/outputCol with names which include dot, it will

[jira] [Created] (SPARK-12192) recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data

2015-12-07 Thread jinglei.chen (JIRA)
jinglei.chen created SPARK-12192: Summary: recommendProductsForUsers(num: Int) can run OK when the dataset is small,but run wrong when large amount of data Key: SPARK-12192 URL: https://issues.apache.org/jira/bro

[jira] [Created] (SPARK-12191) Support "." character in DataFrame column name for ML

2015-12-07 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-12191: --- Summary: Support "." character in DataFrame column name for ML Key: SPARK-12191 URL: https://issues.apache.org/jira/browse/SPARK-12191 Project: Spark Issue Typ

[jira] [Commented] (SPARK-11046) Pass schema from R to JVM using JSON format

2015-12-07 Thread Nakul Jindal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046269#comment-15046269 ] Nakul Jindal commented on SPARK-11046: -- I am trying to understand the benefit of doi

[jira] [Commented] (SPARK-11977) Support accessing a DataFrame column using its name without backticks if the name contains special character

2015-12-07 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046267#comment-15046267 ] Yanbo Liang commented on SPARK-11977: - I think the check for interfere with the exist

[jira] [Commented] (SPARK-10802) Let ALS recommend for subset of data

2015-12-07 Thread jinglei.chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046264#comment-15046264 ] jinglei.chen commented on SPARK-10802: -- recommendProductsForUsers(num: Int): RDD[(In

[jira] [Updated] (SPARK-12190) spark does not star cleanly windows 7 64 bit

2015-12-07 Thread stefan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stefan updated SPARK-12190: --- Description: See environment description above for all my PATH info and ENV variables. Hadoop is not compiled

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: I see there was some exceptions in my executors stderr log: 15/12/08 00:47:44 INF

[jira] [Created] (SPARK-12190) spark does not star cleanly windows 7 64 bit

2015-12-07 Thread stefan (JIRA)
stefan created SPARK-12190: -- Summary: spark does not star cleanly windows 7 64 bit Key: SPARK-12190 URL: https://issues.apache.org/jira/browse/SPARK-12190 Project: Spark Issue Type: Bug Co

[jira] [Comment Edited] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046243#comment-15046243 ] Tao Li edited comment on SPARK-12179 at 12/8/15 3:00 AM: - I see t

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046243#comment-15046243 ] Tao Li commented on SPARK-12179: I see there was some exceptions in my executors stderr l

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SPARK-11009 is already fixe

[jira] [Issue Comment Deleted] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Li updated SPARK-12179: --- Comment: was deleted (was: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SPARK-11009 is already fixe

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046239#comment-15046239 ] Tao Li commented on SPARK-12179: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SP

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046240#comment-15046240 ] Tao Li commented on SPARK-12179: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SP

[jira] [Commented] (SPARK-12179) Spark SQL get different result with the same code

2015-12-07 Thread Tao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046238#comment-15046238 ] Tao Li commented on SPARK-12179: yes, my spark version is 1.5.3-SNAPSHOT,and the issue SP

[jira] [Commented] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046236#comment-15046236 ] Apache Spark commented on SPARK-12189: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12189: Assignee: Josh Rosen (was: Apache Spark) > UnifiedMemoryManager double counts storage mem

[jira] [Assigned] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12189?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12189: Assignee: Apache Spark (was: Josh Rosen) > UnifiedMemoryManager double counts storage mem

[jira] [Created] (SPARK-12189) UnifiedMemoryManager double counts storage memory freed

2015-12-07 Thread Andrew Or (JIRA)
Andrew Or created SPARK-12189: - Summary: UnifiedMemoryManager double counts storage memory freed Key: SPARK-12189 URL: https://issues.apache.org/jira/browse/SPARK-12189 Project: Spark Issue Type:

[jira] [Commented] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046205#comment-15046205 ] Marcelo Vanzin commented on SPARK-12176: As I tried to explain, you need to show

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Assigned] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12188: Assignee: Apache Spark > [SQL] Code refactoring and comment correction in Dataset APIs > -

[jira] [Assigned] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12188: Assignee: (was: Apache Spark) > [SQL] Code refactoring and comment correction in Datas

[jira] [Commented] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046196#comment-15046196 ] Apache Spark commented on SPARK-12188: -- User 'gatorsmile' has created a pull request

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Created] (SPARK-12188) [SQL] Code refactoring and comment correction in Dataset APIs

2015-12-07 Thread Xiao Li (JIRA)
Xiao Li created SPARK-12188: --- Summary: [SQL] Code refactoring and comment correction in Dataset APIs Key: SPARK-12188 URL: https://issues.apache.org/jira/browse/SPARK-12188 Project: Spark Issue Ty

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Updated] (SPARK-10299) word2vec should allow users to specify the window size

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10299: -- Assignee: holdenk > word2vec should allow users to specify the window size > --

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12159: -- Shepherd: Joseph K. Bradley > Add user guide section for IndexToString transformer > --

[jira] [Updated] (SPARK-12159) Add user guide section for IndexToString transformer

2015-12-07 Thread Joseph K. Bradley (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12159: -- Assignee: Benjamin Fradet > Add user guide section for IndexToString transformer >

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Commented] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046162#comment-15046162 ] Yuhang Chen commented on SPARK-12176: - I modified the descriptions, hope I've made my

[jira] [Updated] (SPARK-12176) SparkLauncher's setConf() does not support configs containing spaces

2015-12-07 Thread Yuhang Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuhang Chen updated SPARK-12176: Description: The spark-submit uses '--conf K=V' pattern for setting configs. According to the docs

[jira] [Commented] (SPARK-12183) Remove spark.mllib tree, forest implementations and use spark.ml

2015-12-07 Thread Seth Hendrickson (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046094#comment-15046094 ] Seth Hendrickson commented on SPARK-12183: -- Do you mean these are lower priority

  1   2   3   >