[jira] [Resolved] (SPARK-9268) Params.setDefault should not keep varargs annotation

2015-07-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9268. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7604

[jira] [Commented] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-23 Thread Cheng Hao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638276#comment-14638276 ] Cheng Hao commented on SPARK-9239: -- [~yhuai] are you working on this now? Or I can take

[jira] [Commented] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638992#comment-14638992 ] Meihua Wu commented on SPARK-9225: -- working on this. LDASuite needs unit tests for

[jira] [Assigned] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9264: --- Assignee: Apache Spark (was: Davies Liu) When dealing with Union/Intersect/Except, we cast

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Greg Rahn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639065#comment-14639065 ] Greg Rahn commented on SPARK-9182: -- Looks like it's related to NUMERIC data types from a

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Greg Rahn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639036#comment-14639036 ] Greg Rahn commented on SPARK-9182: -- {code} grahn=# \d emp Table public.emp

[jira] [Updated] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9278: -- Priority: Blocker (was: Major) DataFrameWriter.insertInto inserts incorrect data

[jira] [Commented] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639010#comment-14639010 ] Apache Spark commented on SPARK-9225: - User 'rotationsymmetry' has created a pull

[jira] [Assigned] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9225: --- Assignee: Apache Spark LDASuite needs unit tests for empty documents

[jira] [Assigned] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9264: --- Assignee: Davies Liu (was: Apache Spark) When dealing with Union/Intersect/Except, we cast

[jira] [Commented] (SPARK-2352) [MLLIB] Add Artificial Neural Network (ANN) to Spark

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639048#comment-14639048 ] Apache Spark commented on SPARK-2352: - User 'avulanov' has created a pull request for

[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:08 PM:

[jira] [Created] (SPARK-9275) IsolatedClientLoader could not load shared JNI libraries

2015-07-23 Thread Peng Zhen (JIRA)
Peng Zhen created SPARK-9275: Summary: IsolatedClientLoader could not load shared JNI libraries Key: SPARK-9275 URL: https://issues.apache.org/jira/browse/SPARK-9275 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9092) Make --num-executors compatible with dynamic allocation

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638689#comment-14638689 ] Sean Owen commented on SPARK-9092: -- I tend to agree with [~sandyr] for these reasons. The

[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:13 PM:

[jira] [Assigned] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8105: --- Assignee: Apache Spark sqlContext.table(databaseName.tableName) broke with SPARK-6908

[jira] [Commented] (SPARK-6908) Refactor existing code to use the isolated client

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639089#comment-14639089 ] Apache Spark commented on SPARK-6908: - User 'piaozhexiu' has created a pull request

[jira] [Commented] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639103#comment-14639103 ] Yin Huai commented on SPARK-9082: - The follow-up of it

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639150#comment-14639150 ] Omar Padron commented on SPARK-9279: bq. This has nothing to do with Spark. Any

[jira] [Reopened] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Padron reopened SPARK-9279: Spark Master Refuses to Bind WebUI to a Privileged Port

[jira] [Commented] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639155#comment-14639155 ] Cheolsoo Park commented on SPARK-8105: -- OK, I guess I got the answer to my question

[jira] [Created] (SPARK-9281) Parse literals as decimal in SQL

2015-07-23 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9281: - Summary: Parse literals as decimal in SQL Key: SPARK-9281 URL: https://issues.apache.org/jira/browse/SPARK-9281 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639187#comment-14639187 ] Joseph Batchik commented on SPARK-8007: --- You will be able to solve this issue by

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639213#comment-14639213 ] Sean Owen commented on SPARK-9279: -- Oh I see, I apologize, I read right past that at the

[jira] [Resolved] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9183. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 NPE / confusing error

[jira] [Commented] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639217#comment-14639217 ] Reynold Xin commented on SPARK-8105: A pretty close racing condition!

[jira] [Resolved] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9243. Resolution: Fixed Fix Version/s: 1.5.0 Update crosstab doc for pairs that have no

[jira] [Commented] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639218#comment-14639218 ] Reynold Xin commented on SPARK-8105: Or [~liancheng] did that whole PR in 30 mins ...

[jira] [Assigned] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7105: --- Assignee: Yu Ishikawa (was: Apache Spark) Support model save/load in Python's

[jira] [Commented] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638729#comment-14638729 ] Apache Spark commented on SPARK-7105: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7105: --- Assignee: Apache Spark (was: Yu Ishikawa) Support model save/load in Python's

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639331#comment-14639331 ] Sean Owen commented on SPARK-9279: -- No it's the per-app driver, not the master, but the

[jira] [Commented] (SPARK-9256) Message delay causes Master crash upon registering application

2015-07-23 Thread Colin Scott (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639351#comment-14639351 ] Colin Scott commented on SPARK-9256: Ah, you are quite right; I didn't realize that I

[jira] [Commented] (SPARK-9256) Message delay causes Master crash upon registering application

2015-07-23 Thread Colin Scott (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639354#comment-14639354 ] Colin Scott commented on SPARK-9256: On second thought, the appId also includes a

[jira] [Closed] (SPARK-9256) Message delay causes Master crash upon registering application

2015-07-23 Thread Colin Scott (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Scott closed SPARK-9256. -- Resolution: Invalid Message delay causes Master crash upon registering application

[jira] [Updated] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9279: - Component/s: (was: Spark Core) Web UI Issue Type: Improvement (was: Bug)

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639242#comment-14639242 ] Omar Padron commented on SPARK-9279: No, it is not *absolutely* necessary for me

[jira] [Comment Edited] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639242#comment-14639242 ] Omar Padron edited comment on SPARK-9279 at 7/23/15 5:43 PM: -

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639253#comment-14639253 ] Sean Owen commented on SPARK-9279: -- On looking at this code again, I think the issue is

[jira] [Updated] (SPARK-9040) StructField datatype Conversion Error

2015-07-23 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-9040: --- Description: The following issue occurs if I specify the StructFields in specific order in

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639273#comment-14639273 ] Omar Padron commented on SPARK-9279: For me, trying a bunch of ports in sequence

[jira] [Updated] (SPARK-9282) Join on Spark DataFrame with multiple columns

2015-07-23 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-9282: --- Description: Filter on dataframe does not work if we have more than one column inside the filter.

[jira] [Created] (SPARK-9283) Join on Spark DataFrame with multiple columns

2015-07-23 Thread Sandeep Pal (JIRA)
Sandeep Pal created SPARK-9283: -- Summary: Join on Spark DataFrame with multiple columns Key: SPARK-9283 URL: https://issues.apache.org/jira/browse/SPARK-9283 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639284#comment-14639284 ] Sean Owen commented on SPARK-9279: -- The default is to create a web UI for the driver, and

[jira] [Commented] (SPARK-8988) Driver logs links is missing on secure cluster

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639280#comment-14639280 ] Apache Spark commented on SPARK-8988: - User 'harishreedharan' has created a pull

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639298#comment-14639298 ] Omar Padron commented on SPARK-9279: Forgive me for not being fully aware of the

[jira] [Comment Edited] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639242#comment-14639242 ] Omar Padron edited comment on SPARK-9279 at 7/23/15 5:43 PM: -

[jira] [Updated] (SPARK-9282) Filter on Spark DataFrame with multiple columns

2015-07-23 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-9282: --- Summary: Filter on Spark DataFrame with multiple columns (was: Join on Spark DataFrame with multiple

[jira] [Assigned] (SPARK-8988) Driver logs links is missing on secure cluster

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8988: --- Assignee: Apache Spark Driver logs links is missing on secure cluster

[jira] [Created] (SPARK-9282) Join on Spark DataFrame with multiple columns

2015-07-23 Thread Sandeep Pal (JIRA)
Sandeep Pal created SPARK-9282: -- Summary: Join on Spark DataFrame with multiple columns Key: SPARK-9282 URL: https://issues.apache.org/jira/browse/SPARK-9282 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-8988) Driver logs links is missing on secure cluster

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8988: --- Assignee: (was: Apache Spark) Driver logs links is missing on secure cluster

[jira] [Commented] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639083#comment-14639083 ] Cheolsoo Park commented on SPARK-8105: -- [~yhuai], what's the plan for this?

[jira] [Assigned] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8105: --- Assignee: (was: Apache Spark) sqlContext.table(databaseName.tableName) broke with

[jira] [Commented] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639087#comment-14639087 ] Apache Spark commented on SPARK-8105: - User 'piaozhexiu' has created a pull request

[jira] [Commented] (SPARK-4366) Aggregation Improvement

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639110#comment-14639110 ] Apache Spark commented on SPARK-4366: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-7943) saveAsTable in DataFrameWriter can only add table to DataBase “default”

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639132#comment-14639132 ] Apache Spark commented on SPARK-7943: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8714) Refresh table not working with non-default databases

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8714: --- Assignee: (was: Apache Spark) Refresh table not working with non-default databases

[jira] [Assigned] (SPARK-8435) Cannot create tables in an specific database using a provider

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8435: --- Assignee: Apache Spark Cannot create tables in an specific database using a provider

[jira] [Commented] (SPARK-8714) Refresh table not working with non-default databases

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639135#comment-14639135 ] Apache Spark commented on SPARK-8714: - User 'liancheng' has created a pull request for

[jira] [Comment Edited] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639083#comment-14639083 ] Cheolsoo Park edited comment on SPARK-8105 at 7/23/15 4:27 PM:

[jira] [Commented] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639096#comment-14639096 ] Yin Huai commented on SPARK-9239: - No. I am not working on it. Feel free to take it.

[jira] [Commented] (SPARK-8435) Cannot create tables in an specific database using a provider

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639134#comment-14639134 ] Apache Spark commented on SPARK-8435: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8435) Cannot create tables in an specific database using a provider

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8435: --- Assignee: (was: Apache Spark) Cannot create tables in an specific database using a

[jira] [Commented] (SPARK-8561) Drop table can only drop the tables under database default

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639136#comment-14639136 ] Apache Spark commented on SPARK-8561: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8714) Refresh table not working with non-default databases

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8714: --- Assignee: Apache Spark Refresh table not working with non-default databases

[jira] [Commented] (SPARK-8105) sqlContext.table(databaseName.tableName) broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14639133#comment-14639133 ] Apache Spark commented on SPARK-8105: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-9256) Message delay causes Master crash upon registering application

2015-07-23 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638311#comment-14638311 ] Liang-Chi Hsieh commented on SPARK-9256: Since the FileSystemPersistenceEngine

[jira] [Updated] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-9270: - Description: Currently, the app name is hardcoded in pyspark as PySparkShell, and the

[jira] [Created] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-23 Thread yuhao yang (JIRA)
yuhao yang created SPARK-9273: - Summary: Add Convolutional Neural network to Spark MLlib Key: SPARK-9273 URL: https://issues.apache.org/jira/browse/SPARK-9273 Project: Spark Issue Type: New

[jira] [Updated] (SPARK-8695) TreeAggregation shouldn't be triggered when it doesn't save wall-clock time

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8695: - Assignee: Xiangrui Meng TreeAggregation shouldn't be triggered when it doesn't save wall-clock time

[jira] [Resolved] (SPARK-8695) TreeAggregation shouldn't be triggered when it doesn't save wall-clock time

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-8695. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7397

[jira] [Commented] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638325#comment-14638325 ] Sean Owen commented on SPARK-9270: -- Yeah there's probably an additional change to be

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638354#comment-14638354 ] Apache Spark commented on SPARK-9273: - User 'hhbyyh' has created a pull request for

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-23 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638364#comment-14638364 ] yuhao yang commented on SPARK-9273: --- Thanks Sean. I did some checking before creating

[jira] [Commented] (SPARK-8608) After initializing a DataFrame with random columns and a seed, df.show should return same value

2015-07-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638367#comment-14638367 ] Wenchen Fan commented on SPARK-8608: non-codegen also works: {code}

[jira] [Issue Comment Deleted] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-07-23 Thread Erik Schneider (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Schneider updated SPARK-4105: -- Comment: was deleted (was: I have the same issue running Spark1.5.0. {panel:title=Compression

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638427#comment-14638427 ] Cheng Lian commented on SPARK-9182: --- I suspect that the type of column {{sal}} is

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-07-23 Thread Erik Schneider (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638428#comment-14638428 ] Erik Schneider commented on SPARK-4105: --- I have the same issue running Spark1.5.0.

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638438#comment-14638438 ] Yijie Shen commented on SPARK-9183: --- OK, I will submit one soon. NPE / confusing error

[jira] [Updated] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-23 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9243: - Priority: Trivial (was: Major) Update crosstab doc for pairs that have no occurrences

[jira] [Resolved] (SPARK-8935) Implement code generation for all casts

2015-07-23 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8935. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7365

[jira] [Assigned] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9273: --- Assignee: Apache Spark Add Convolutional Neural network to Spark MLlib

[jira] [Assigned] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9273: --- Assignee: (was: Apache Spark) Add Convolutional Neural network to Spark MLlib

[jira] [Commented] (SPARK-8608) After initializing a DataFrame with random columns and a seed, df.show should return same value

2015-07-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638355#comment-14638355 ] Wenchen Fan commented on SPARK-8608: How to reproduce this issue? I tried {{{ val df =

[jira] [Comment Edited] (SPARK-8608) After initializing a DataFrame with random columns and a seed, df.show should return same value

2015-07-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638355#comment-14638355 ] Wenchen Fan edited comment on SPARK-8608 at 7/23/15 7:16 AM: -

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638414#comment-14638414 ] Yijie Shen commented on SPARK-9183: --- The cause of this confusing error message is *Log

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638421#comment-14638421 ] Cheng Lian commented on SPARK-9182: --- [~grahn] Could you please provide the schema of the

[jira] [Commented] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638302#comment-14638302 ] Apache Spark commented on SPARK-9243: - User 'mengxr' has created a pull request for

[jira] [Commented] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638319#comment-14638319 ] Cheolsoo Park commented on SPARK-9270: -- [~sowen], I just tested SPARK-9180 now. even

[jira] [Commented] (SPARK-9273) Add Convolutional Neural network to Spark MLlib

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638328#comment-14638328 ] Sean Owen commented on SPARK-9273: -- I think this is duplicated / subsumed many times by

[jira] [Comment Edited] (SPARK-8608) After initializing a DataFrame with random columns and a seed, df.show should return same value

2015-07-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638355#comment-14638355 ] Wenchen Fan edited comment on SPARK-8608 at 7/23/15 7:16 AM: -

[jira] [Assigned] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9270: --- Assignee: Apache Spark spark.app.name is not honored by pyspark

[jira] [Commented] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638389#comment-14638389 ] Apache Spark commented on SPARK-9270: - User 'piaozhexiu' has created a pull request

[jira] [Assigned] (SPARK-9270) spark.app.name is not honored by pyspark

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9270: --- Assignee: (was: Apache Spark) spark.app.name is not honored by pyspark

[jira] [Updated] (SPARK-9270) Allow --name option in pyspark

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-9270: - Description: Currently, the app name is hardcoded in pyspark as PySparkShell, and the app name

[jira] [Updated] (SPARK-9270) Allow --name option in pyspark

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheolsoo Park updated SPARK-9270: - Description: Currently, the app name is hardcoded in pyspark as PySparkShell, and the app name

[jira] [Resolved] (SPARK-9266) Prevent managed memory leak detected exception from masking original exception

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9266?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9266. Resolution: Fixed Fix Version/s: 1.5.0 Prevent managed memory leak detected exception from

[jira] [Commented] (SPARK-8518) Log-linear models for survival analysis

2015-07-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638397#comment-14638397 ] Yanbo Liang commented on SPARK-8518: [~meihuawu] Thank you for your valued comments. I

[jira] [Comment Edited] (SPARK-8518) Log-linear models for survival analysis

2015-07-23 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638397#comment-14638397 ] Yanbo Liang edited comment on SPARK-8518 at 7/23/15 7:47 AM: -

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14638418#comment-14638418 ] Reynold Xin commented on SPARK-9183: [~yijieshen] thanks for looking into this. Can

<    1   2   3   >