[jira] [Commented] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631404#comment-14631404 ] Apache Spark commented on SPARK-9109: - User 'tien-dungle' has created a pull request

[jira] [Assigned] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9109: --- Assignee: (was: Apache Spark) Unpersist a graph object does not work properly

[jira] [Assigned] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9109: --- Assignee: Apache Spark Unpersist a graph object does not work properly

[jira] [Commented] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-17 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631412#comment-14631412 ] Tien-Dung LE commented on SPARK-9109: - [~sowen] This is my first PR for spark so I am

[jira] [Comment Edited] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-17 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631412#comment-14631412 ] Tien-Dung LE edited comment on SPARK-9109 at 7/17/15 2:38 PM: --

[jira] [Assigned] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8975: --- Assignee: Apache Spark Implement a mechanism to send a new rate from the driver to the

[jira] [Resolved] (SPARK-8851) in Yarn client mode, Client.scala does not login even when credentials are specified

2015-07-17 Thread Thomas Graves (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves resolved SPARK-8851. -- Resolution: Fixed Assignee: Hari Shreedharan Fix Version/s: 1.5.0 in Yarn

[jira] [Commented] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631418#comment-14631418 ] Apache Spark commented on SPARK-8975: - User 'dragos' has created a pull request for

[jira] [Assigned] (SPARK-8975) Implement a mechanism to send a new rate from the driver to the block generator

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8975: --- Assignee: (was: Apache Spark) Implement a mechanism to send a new rate from the driver

[jira] [Created] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2015-07-17 Thread Mateusz Michalowski (JIRA)
Mateusz Michalowski created SPARK-9135: -- Summary: Filter fails when filtering with a method reference to overloaded method Key: SPARK-9135 URL: https://issues.apache.org/jira/browse/SPARK-9135

[jira] [Updated] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2015-07-17 Thread Mateusz Michalowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Michalowski updated SPARK-9135: --- Description: Filter fails when filtering with a method reference to overloaded

[jira] [Updated] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2015-07-17 Thread Mateusz Michalowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Michalowski updated SPARK-9135: --- Description: Filter fails when filtering with a method reference to overloaded

[jira] [Updated] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2015-07-17 Thread Mateusz Michalowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Michalowski updated SPARK-9135: --- Description: Filter fails when filtering with a method reference to overloaded

[jira] [Updated] (SPARK-9135) Filter fails when filtering with a method reference to overloaded method

2015-07-17 Thread Mateusz Michalowski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mateusz Michalowski updated SPARK-9135: --- Description: Filter fails when filtering with a method reference to overloaded

[jira] [Commented] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-17 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631367#comment-14631367 ] Bolke de Bruin commented on SPARK-9019: --- Ok. I tracked down the log entry due to a

[jira] [Updated] (SPARK-8899) remove duplicated equals method for Row

2015-07-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8899: - Assignee: Wenchen Fan remove duplicated equals method for Row ---

[jira] [Comment Edited] (SPARK-9019) spark-submit fails on yarn with kerberos enabled

2015-07-17 Thread Bolke de Bruin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631367#comment-14631367 ] Bolke de Bruin edited comment on SPARK-9019 at 7/17/15 2:00 PM:

[jira] [Commented] (SPARK-8255) string function: regexp_extract

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631289#comment-14631289 ] Apache Spark commented on SPARK-8255: - User 'chenghao-intel' has created a pull

[jira] [Commented] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631285#comment-14631285 ] Apache Spark commented on SPARK-9059: - User 'kico445' has created a pull request for

[jira] [Assigned] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9059: --- Assignee: (was: Apache Spark) Update Direct Kafka Word count examples to show the use

[jira] [Assigned] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9059: --- Assignee: Apache Spark Update Direct Kafka Word count examples to show the use of

[jira] [Assigned] (SPARK-8255) string function: regexp_extract

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8255: --- Assignee: Apache Spark (was: Cheng Hao) string function: regexp_extract

[jira] [Commented] (SPARK-8256) string function: regexp_replace

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631290#comment-14631290 ] Apache Spark commented on SPARK-8256: - User 'chenghao-intel' has created a pull

[jira] [Assigned] (SPARK-8256) string function: regexp_replace

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8256: --- Assignee: Apache Spark (was: Cheng Hao) string function: regexp_replace

[jira] [Assigned] (SPARK-8256) string function: regexp_replace

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8256: --- Assignee: Cheng Hao (was: Apache Spark) string function: regexp_replace

[jira] [Assigned] (SPARK-8255) string function: regexp_extract

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8255: --- Assignee: Cheng Hao (was: Apache Spark) string function: regexp_extract

[jira] [Updated] (SPARK-5269) BlockManager.dataDeserialize always creates a new serializer instance

2015-07-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-5269: -- Assignee: Matt Cheah BlockManager.dataDeserialize always creates a new serializer instance

[jira] [Commented] (SPARK-5269) BlockManager.dataDeserialize always creates a new serializer instance

2015-07-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631443#comment-14631443 ] Josh Rosen commented on SPARK-5269: --- [~mcheah], sure, feel free to work on this. I'll

[jira] [Commented] (SPARK-6776) Implement backwards-compatibility rules in Catalyst converters (which convert Parquet record to rows)

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631448#comment-14631448 ] Apache Spark commented on SPARK-6776: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-4879) Missing output partitions after job completes with speculative execution

2015-07-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631463#comment-14631463 ] Josh Rosen commented on SPARK-4879: --- That's a good point about the post-save-action

[jira] [Commented] (SPARK-2546) Configuration object thread safety issue

2015-07-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631465#comment-14631465 ] Josh Rosen commented on SPARK-2546: --- [~ankurmitujjain], you can try setting

[jira] [Commented] (SPARK-8571) spark streaming hanging processes upon build exit

2015-07-17 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631467#comment-14631467 ] Josh Rosen commented on SPARK-8571: --- I don't think that bumping up the build timeouts

[jira] [Comment Edited] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-17 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630820#comment-14630820 ] Joseph Batchik edited comment on SPARK-8007 at 7/17/15 6:01 AM:

[jira] [Resolved] (SPARK-9126) StopwatchSuite shouldn't use Thread.sleep()

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9126. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7457

[jira] [Created] (SPARK-9129) Integrate convolutional deep belief networks for visual recognition tasks

2015-07-17 Thread hujiayin (JIRA)
hujiayin created SPARK-9129: --- Summary: Integrate convolutional deep belief networks for visual recognition tasks Key: SPARK-9129 URL: https://issues.apache.org/jira/browse/SPARK-9129 Project: Spark

[jira] [Assigned] (SPARK-9130) throw exception when check equality between external and internal row

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9130: --- Assignee: (was: Apache Spark) throw exception when check equality between external and

[jira] [Updated] (SPARK-8188) date/time function: from_utc_timestamp

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8188?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8188: --- Assignee: Adrian Wang date/time function: from_utc_timestamp --

[jira] [Updated] (SPARK-8233) misc function: hash

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8233: --- Assignee: (was: Josh Rosen) misc function: hash --- Key:

[jira] [Updated] (SPARK-8191) date/time function: to_utc_timestamp

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8191?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8191: --- Assignee: Adrian Wang date/time function: to_utc_timestamp

[jira] [Updated] (SPARK-8185) date/time function: datediff

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8185: --- Assignee: Adrian Wang date/time function: datediff

[jira] [Created] (SPARK-9132) Implement code gen for Conv

2015-07-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9132: -- Summary: Implement code gen for Conv Key: SPARK-9132 URL: https://issues.apache.org/jira/browse/SPARK-9132 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-9062) Change output type of Tokenizer to Array(String, true)

2015-07-17 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630934#comment-14630934 ] yuhao yang commented on SPARK-9062: --- Currently it seems Word2Vec is able to handle the

[jira] [Comment Edited] (SPARK-9062) Change output type of Tokenizer to Array(String, true)

2015-07-17 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630934#comment-14630934 ] yuhao yang edited comment on SPARK-9062 at 7/17/15 8:03 AM:

[jira] [Created] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

2015-07-17 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-9133: -- Summary: Add and Subtract should support date/timestamp and interval type Key: SPARK-9133 URL: https://issues.apache.org/jira/browse/SPARK-9133 Project: Spark

[jira] [Commented] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630957#comment-14630957 ] Xiangrui Meng commented on SPARK-6485: -- [~mwdus...@us.ibm.com] Since this is blocking

[jira] [Created] (SPARK-9134) LDA Asymmetric topic-word prior

2015-07-17 Thread Feynman Liang (JIRA)
Feynman Liang created SPARK-9134: Summary: LDA Asymmetric topic-word prior Key: SPARK-9134 URL: https://issues.apache.org/jira/browse/SPARK-9134 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631042#comment-14631042 ] Apache Spark commented on SPARK-8405: - User 'carsonwang' has created a pull request

[jira] [Comment Edited] (SPARK-5571) LDA should handle text as well

2015-07-17 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630871#comment-14630871 ] Alok Singh edited comment on SPARK-5571 at 7/17/15 6:52 AM: Hi

[jira] [Commented] (SPARK-5571) LDA should handle text as well

2015-07-17 Thread Alok Singh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630871#comment-14630871 ] Alok Singh commented on SPARK-5571: --- Hi Feynman, Sorry for the delay and gap, here at

[jira] [Created] (SPARK-9131) UDF change data values

2015-07-17 Thread Luis Guerra (JIRA)
Luis Guerra created SPARK-9131: -- Summary: UDF change data values Key: SPARK-9131 URL: https://issues.apache.org/jira/browse/SPARK-9131 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630940#comment-14630940 ] Xiangrui Meng commented on SPARK-8518: -- [~yanboliang] Thanks for working the design

[jira] [Updated] (SPARK-6485) Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6485: - Shepherd: Xiangrui Meng Add CoordinateMatrix/RowMatrix/IndexedRowMatrix in PySpark

[jira] [Commented] (SPARK-6486) Add BlockMatrix in PySpark

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630964#comment-14630964 ] Xiangrui Meng commented on SPARK-6486: -- [~MechCoder] I think you can start this task

[jira] [Resolved] (SPARK-9022) UnsafeProject

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9022. Resolution: Fixed Fix Version/s: 1.5.0 UnsafeProject - Key:

[jira] [Commented] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-17 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630998#comment-14630998 ] Tathagata Das commented on SPARK-9059: -- Yes, needs to be updated for python. For Java

[jira] [Commented] (SPARK-9109) Unpersist a graph object does not work properly

2015-07-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9109?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631018#comment-14631018 ] Sean Owen commented on SPARK-9109: -- Yes, we should expect that calling unpersist() (just

[jira] [Updated] (SPARK-8996) Add Python API for Kolmogorov-Smirnov Test

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8996: - Shepherd: Xiangrui Meng Add Python API for Kolmogorov-Smirnov Test

[jira] [Assigned] (SPARK-8137) Improve treeAggregate to combine all data on one machine first

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8137: --- Assignee: Apache Spark Improve treeAggregate to combine all data on one machine first

[jira] [Commented] (SPARK-8137) Improve treeAggregate to combine all data on one machine first

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630893#comment-14630893 ] Apache Spark commented on SPARK-8137: - User 'kmadhugit' has created a pull request for

[jira] [Assigned] (SPARK-8137) Improve treeAggregate to combine all data on one machine first

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8137: --- Assignee: (was: Apache Spark) Improve treeAggregate to combine all data on one machine

[jira] [Resolved] (SPARK-9123) Spark HistoryServer load logs too slow and can load the latest logs

2015-07-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9123. -- Resolution: Duplicate [~xietingwen] even this issue is a duplicate. Please search JIRA. In fact you

[jira] [Resolved] (SPARK-9097) Tasks are not completed but the number of executor is zero

2015-07-17 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9097. -- Resolution: Invalid Target Version/s: (was: 1.5.0) [~KaiXinXIaoLei] this remains unclear.

[jira] [Updated] (SPARK-8518) Log-linear models for survival analysis

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8518: - Description: We want to add basic log-linear models for survival analysis. The implementation

[jira] [Updated] (SPARK-8174) date/time function: unix_timestamp

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8174: --- Assignee: Adrian Wang date/time function: unix_timestamp --

[jira] [Commented] (SPARK-9096) Unevenly distributed task loads after using JavaRDD.subtract()

2015-07-17 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630916#comment-14630916 ] Gisle Ytrestøl commented on SPARK-9096: --- This makes a lot of sense - my vectors are

[jira] [Updated] (SPARK-8175) date/time function: from_unixtime

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8175: --- Assignee: Adrian Wang date/time function: from_unixtime -

[jira] [Updated] (SPARK-8178) date/time function: quarter

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8178: --- Assignee: Tarek Auel date/time function: quarter --- Key:

[jira] [Updated] (SPARK-8176) date/time function: to_date

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8176: --- Assignee: Adrian Wang date/time function: to_date ---

[jira] [Resolved] (SPARK-9093) Fix single-quotes strings in SparkR

2015-07-17 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta resolved SPARK-9093. --- Resolution: Fixed Fix single-quotes strings in SparkR ---

[jira] [Updated] (SPARK-9093) Fix single-quotes strings in SparkR

2015-07-17 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-9093: -- Fix Version/s: 1.5.0 Fix single-quotes strings in SparkR ---

[jira] [Updated] (SPARK-9131) UDFs change data values

2015-07-17 Thread Luis Guerra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Guerra updated SPARK-9131: --- Summary: UDFs change data values (was: UDF change data values) UDFs change data values

[jira] [Updated] (SPARK-8996) Add Python API for Kolmogorov-Smirnov Test

2015-07-17 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8996?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8996: - Assignee: Manoj Kumar Add Python API for Kolmogorov-Smirnov Test

[jira] [Commented] (SPARK-8230) complex function: size

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630920#comment-14630920 ] Apache Spark commented on SPARK-8230: - User 'EntilZha' has created a pull request for

[jira] [Assigned] (SPARK-8230) complex function: size

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8230: --- Assignee: Apache Spark (was: Cheng Hao) complex function: size --

[jira] [Commented] (SPARK-8230) complex function: size

2015-07-17 Thread Pedro Rodriguez (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630921#comment-14630921 ] Pedro Rodriguez commented on SPARK-8230: [~chenghao], code is ready for review

[jira] [Assigned] (SPARK-8230) complex function: size

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8230: --- Assignee: Cheng Hao (was: Apache Spark) complex function: size --

[jira] [Closed] (SPARK-6573) Convert inbound NaN values as null

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-6573. -- Resolution: Won't Fix Marking this as won't fix since we will officially support NaN, and letting

[jira] [Updated] (SPARK-9093) Fix single-quotes strings in SparkR

2015-07-17 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated SPARK-9093: -- Assignee: Yu Ishikawa Fix single-quotes strings in SparkR ---

[jira] [Commented] (SPARK-9059) Update Direct Kafka Word count examples to show the use of HasOffsetRanges

2015-07-17 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630984#comment-14630984 ] Benjamin Fradet commented on SPARK-9059: Agreed. Update Direct Kafka Word count

[jira] [Commented] (SPARK-6573) Convert inbound NaN values as null

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630994#comment-14630994 ] Reynold Xin commented on SPARK-6573: It's the parent of this ticket. Convert

[jira] [Updated] (SPARK-6573) Convert inbound NaN values as null

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-6573: --- Target Version/s: (was: 1.5.0) Convert inbound NaN values as null

[jira] [Commented] (SPARK-8405) Show executor logs on Web UI when Yarn log aggregation is enabled

2015-07-17 Thread Carson Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8405?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631024#comment-14631024 ] Carson Wang commented on SPARK-8405: I think we can improve the doc so users will know

[jira] [Commented] (SPARK-9062) Change output type of Tokenizer to Array(String, true)

2015-07-17 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14631027#comment-14631027 ] yuhao yang commented on SPARK-9062: --- This jira is trying to chain the tokenizer and

[jira] [Updated] (SPARK-9131) UDF change data values

2015-07-17 Thread Luis Guerra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Guerra updated SPARK-9131: --- Environment: Pyspark 1.4 and 1.4.1, Redhat 6.6 (was: Pyspark 1.4, Redhat 6.6) UDF change data

[jira] [Updated] (SPARK-9131) UDF change data values

2015-07-17 Thread Luis Guerra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Guerra updated SPARK-9131: --- Affects Version/s: 1.4.1 UDF change data values -- Key:

[jira] [Created] (SPARK-9130) throw exception when check equality between external and internal row

2015-07-17 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-9130: -- Summary: throw exception when check equality between external and internal row Key: SPARK-9130 URL: https://issues.apache.org/jira/browse/SPARK-9130 Project: Spark

[jira] [Assigned] (SPARK-9130) throw exception when check equality between external and internal row

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9130: --- Assignee: Apache Spark throw exception when check equality between external and internal

[jira] [Commented] (SPARK-9130) throw exception when check equality between external and internal row

2015-07-17 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630882#comment-14630882 ] Apache Spark commented on SPARK-9130: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14630897#comment-14630897 ] Reynold Xin commented on SPARK-8007: [~jd] Take a look at this:

[jira] [Updated] (SPARK-8177) date/time function: year

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8177: --- Assignee: Tarek Auel date/time function: year Key:

[jira] [Updated] (SPARK-8180) date/time function: day / dayofmonth

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8180: --- Assignee: Tarek Auel date/time function: day / dayofmonth -

[jira] [Updated] (SPARK-9131) UDF change data values

2015-07-17 Thread Luis Guerra (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9131?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luis Guerra updated SPARK-9131: --- Target Version/s: (was: 1.4.2) UDF change data values --

[jira] [Updated] (SPARK-9115) date/time function: dayInYear

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9115: --- Assignee: Tarek Auel date/time function: dayInYear -

[jira] [Updated] (SPARK-8184) date/time function: weekofyear

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8184: --- Assignee: Tarek Auel date/time function: weekofyear --

[jira] [Updated] (SPARK-8199) date/time function: date_format

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8199: --- Assignee: Tarek Auel date/time function: date_format ---

[jira] [Updated] (SPARK-8181) date/time function: hour

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8181: --- Assignee: Tarek Auel date/time function: hour Key:

[jira] [Updated] (SPARK-8183) date/time function: second

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8183: --- Assignee: Tarek Auel date/time function: second -- Key:

[jira] [Updated] (SPARK-8179) date/time function: month

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8179: --- Assignee: Tarek Auel date/time function: month - Key:

[jira] [Updated] (SPARK-8182) date/time function: minute

2015-07-17 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8182?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8182: --- Assignee: Tarek Auel date/time function: minute -- Key:

[jira] [Resolved] (SPARK-9102) Improve project collapse with nondeterministic expressions

2015-07-17 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9102. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7445

  1   2   3   >