[jira] [Assigned] (SPARK-8988) Driver logs links is missing on secure cluster

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8988: --- Assignee: Apache Spark > Driver logs links is missing on secure cluster > ---

[jira] [Updated] (SPARK-9282) Filter on Spark DataFrame with multiple columns

2015-07-23 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-9282: --- Summary: Filter on Spark DataFrame with multiple columns (was: Join on Spark DataFrame with multiple

[jira] [Updated] (SPARK-9282) Join on Spark DataFrame with multiple columns

2015-07-23 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-9282: --- Description: Filter on dataframe does not work if we have more than one column inside the filter. Non

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639273#comment-14639273 ] Omar Padron commented on SPARK-9279: For me, trying a bunch of ports in sequence strik

[jira] [Updated] (SPARK-9040) StructField datatype Conversion Error

2015-07-23 Thread Sandeep Pal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sandeep Pal updated SPARK-9040: --- Description: The following issue occurs if I specify the StructFields in specific order in StructType

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639253#comment-14639253 ] Sean Owen commented on SPARK-9279: -- On looking at this code again, I think the issue is t

[jira] [Comment Edited] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639242#comment-14639242 ] Omar Padron edited comment on SPARK-9279 at 7/23/15 5:43 PM: -

[jira] [Comment Edited] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639242#comment-14639242 ] Omar Padron edited comment on SPARK-9279 at 7/23/15 5:43 PM: -

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639242#comment-14639242 ] Omar Padron commented on SPARK-9279: No, it is not *absolutely* necessary for me (henc

[jira] [Updated] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9279: - Component/s: (was: Spark Core) Web UI Issue Type: Improvement (was: Bug) > Spar

[jira] [Commented] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639218#comment-14639218 ] Reynold Xin commented on SPARK-8105: Or [~liancheng] did that whole PR in 30 mins ...

[jira] [Commented] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639217#comment-14639217 ] Reynold Xin commented on SPARK-8105: A pretty close racing condition! > sqlContext.t

[jira] [Resolved] (SPARK-9243) Update crosstab doc for pairs that have no occurrences

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9243. Resolution: Fixed Fix Version/s: 1.5.0 > Update crosstab doc for pairs that have no occurrenc

[jira] [Resolved] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9183. Resolution: Fixed Assignee: Yijie Shen Fix Version/s: 1.5.0 > NPE / confusing error

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639213#comment-14639213 ] Sean Owen commented on SPARK-9279: -- Oh I see, I apologize, I read right past that at the

[jira] [Commented] (SPARK-8007) Support resolving virtual columns in DataFrames

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639187#comment-14639187 ] Joseph Batchik commented on SPARK-8007: --- You will be able to solve this issue by doi

[jira] [Created] (SPARK-9281) Parse literals as decimal in SQL

2015-07-23 Thread Davies Liu (JIRA)
Davies Liu created SPARK-9281: - Summary: Parse literals as decimal in SQL Key: SPARK-9281 URL: https://issues.apache.org/jira/browse/SPARK-9281 Project: Spark Issue Type: Sub-task Compo

[jira] [Commented] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639155#comment-14639155 ] Cheolsoo Park commented on SPARK-8105: -- OK, I guess I got the answer to my question w

[jira] [Reopened] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Padron reopened SPARK-9279: > Spark Master Refuses to Bind WebUI to a Privileged Port >

[jira] [Commented] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639150#comment-14639150 ] Omar Padron commented on SPARK-9279: bq. This has nothing to do with Spark. Any Linux-

[jira] [Commented] (SPARK-8714) Refresh table not working with non-default databases

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639135#comment-14639135 ] Apache Spark commented on SPARK-8714: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8435) Cannot create tables in an specific database using a provider

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8435: --- Assignee: Apache Spark > Cannot create tables in an specific database using a provider >

[jira] [Assigned] (SPARK-8714) Refresh table not working with non-default databases

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8714: --- Assignee: (was: Apache Spark) > Refresh table not working with non-default databases > --

[jira] [Commented] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639133#comment-14639133 ] Apache Spark commented on SPARK-8105: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-8561) Drop table can only drop the tables under database "default"

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639136#comment-14639136 ] Apache Spark commented on SPARK-8561: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-8714) Refresh table not working with non-default databases

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8714: --- Assignee: Apache Spark > Refresh table not working with non-default databases > -

[jira] [Assigned] (SPARK-8435) Cannot create tables in an specific database using a provider

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8435: --- Assignee: (was: Apache Spark) > Cannot create tables in an specific database using a prov

[jira] [Commented] (SPARK-8435) Cannot create tables in an specific database using a provider

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639134#comment-14639134 ] Apache Spark commented on SPARK-8435: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-7943) saveAsTable in DataFrameWriter can only add table to DataBase “default”

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639132#comment-14639132 ] Apache Spark commented on SPARK-7943: - User 'liancheng' has created a pull request for

[jira] [Commented] (SPARK-4366) Aggregation Improvement

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639110#comment-14639110 ] Apache Spark commented on SPARK-4366: - User 'cloud-fan' has created a pull request for

[jira] [Commented] (SPARK-9082) Filter using non-deterministic expressions should not be pushed down

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9082?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639103#comment-14639103 ] Yin Huai commented on SPARK-9082: - The follow-up of it (https://github.com/apache/spark/pu

[jira] [Commented] (SPARK-9239) HiveUDAF support for AggregateFunction2

2015-07-23 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9239?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639096#comment-14639096 ] Yin Huai commented on SPARK-9239: - No. I am not working on it. Feel free to take it. > Hi

[jira] [Comment Edited] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639083#comment-14639083 ] Cheolsoo Park edited comment on SPARK-8105 at 7/23/15 4:27 PM: -

[jira] [Commented] (SPARK-6908) Refactor existing code to use the isolated client

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6908?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639089#comment-14639089 ] Apache Spark commented on SPARK-6908: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8105: --- Assignee: Apache Spark > sqlContext.table("databaseName.tableName") broke with SPARK-6908 > -

[jira] [Commented] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639087#comment-14639087 ] Apache Spark commented on SPARK-8105: - User 'piaozhexiu' has created a pull request fo

[jira] [Assigned] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8105: --- Assignee: (was: Apache Spark) > sqlContext.table("databaseName.tableName") broke with SPA

[jira] [Commented] (SPARK-8105) sqlContext.table("databaseName.tableName") broke with SPARK-6908

2015-07-23 Thread Cheolsoo Park (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639083#comment-14639083 ] Cheolsoo Park commented on SPARK-8105: -- [~yhuai], what's the plan for this? SPARK-810

[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:13 PM: --

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Greg Rahn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639065#comment-14639065 ] Greg Rahn commented on SPARK-9182: -- Looks like it's related to NUMERIC data types from a

[jira] [Comment Edited] (SPARK-746) Automatically Use Avro Serialization for Avro Objects

2015-07-23 Thread Joseph Batchik (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-746?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14637963#comment-14637963 ] Joseph Batchik edited comment on SPARK-746 at 7/23/15 4:08 PM: --

[jira] [Commented] (SPARK-2352) [MLLIB] Add Artificial Neural Network (ANN) to Spark

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639048#comment-14639048 ] Apache Spark commented on SPARK-2352: - User 'avulanov' has created a pull request for

[jira] [Commented] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639033#comment-14639033 ] Apache Spark commented on SPARK-9264: - User 'davies' has created a pull request for th

[jira] [Assigned] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9264: --- Assignee: Davies Liu (was: Apache Spark) > When dealing with Union/Intersect/Except, we cast

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Greg Rahn (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639036#comment-14639036 ] Greg Rahn commented on SPARK-9182: -- {code} grahn=# \d emp Table "public.emp

[jira] [Assigned] (SPARK-9264) When dealing with Union/Intersect/Except, we cast FloatType/DoubleType to the wrong DecimalType

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9264: --- Assignee: Apache Spark (was: Davies Liu) > When dealing with Union/Intersect/Except, we cast

[jira] [Assigned] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9225: --- Assignee: (was: Apache Spark) > LDASuite needs unit tests for empty documents > -

[jira] [Assigned] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9225: --- Assignee: Apache Spark > LDASuite needs unit tests for empty documents >

[jira] [Commented] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14639010#comment-14639010 ] Apache Spark commented on SPARK-9225: - User 'rotationsymmetry' has created a pull requ

[jira] [Commented] (SPARK-9225) LDASuite needs unit tests for empty documents

2015-07-23 Thread Meihua Wu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9225?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638992#comment-14638992 ] Meihua Wu commented on SPARK-9225: -- working on this. > LDASuite needs unit tests for em

[jira] [Updated] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-9278: -- Priority: Blocker (was: Major) > DataFrameWriter.insertInto inserts incorrect data > --

[jira] [Resolved] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9279. -- Resolution: Not A Problem This has nothing to do with Spark. Any Linux-like OS X requires root privilege

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Description: In a spark-shell session, stopping a spark context and create a new spark context and

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Description: In a spark-shell session, stopping a spark context and create a new spark context and

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Component/s: SQL > New HiveContext object unexpectedly loads configuration settings from history >

[jira] [Created] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
Tien-Dung LE created SPARK-9280: --- Summary: New HiveContext object unexpectedly loads configuration settings from history Key: SPARK-9280 URL: https://issues.apache.org/jira/browse/SPARK-9280 Project: S

[jira] [Updated] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

2015-07-23 Thread Tien-Dung LE (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tien-Dung LE updated SPARK-9280: Affects Version/s: 1.3.1 > New HiveContext object unexpectedly loads configuration settings from his

[jira] [Updated] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Omar Padron updated SPARK-9279: --- Description: When trying to start a spark master server as root... {code} export SPARK_MASTER_PORT=70

[jira] [Created] (SPARK-9279) Spark Master Refuses to Bind WebUI to a Privileged Port

2015-07-23 Thread Omar Padron (JIRA)
Omar Padron created SPARK-9279: -- Summary: Spark Master Refuses to Bind WebUI to a Privileged Port Key: SPARK-9279 URL: https://issues.apache.org/jira/browse/SPARK-9279 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-07-23 Thread Steve Lindemann (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9278?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638843#comment-14638843 ] Steve Lindemann commented on SPARK-9278: Here are the steps to reproduce the issue

[jira] [Created] (SPARK-9278) DataFrameWriter.insertInto inserts incorrect data

2015-07-23 Thread Steve Lindemann (JIRA)
Steve Lindemann created SPARK-9278: -- Summary: DataFrameWriter.insertInto inserts incorrect data Key: SPARK-9278 URL: https://issues.apache.org/jira/browse/SPARK-9278 Project: Spark Issue Typ

[jira] [Resolved] (SPARK-4024) Remember user preferences for metrics to show in the UI

2015-07-23 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4024. - Resolution: Fixed Fix Version/s: 1.5.0 Resolved in https://github.com/apache/spark/pull/739

[jira] [Updated] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array lenght

2015-07-23 Thread Andrey Vykhodtsev (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrey Vykhodtsev updated SPARK-9277: - Attachment: SparseVector test.ipynb SparseVector test.html Attached is th

[jira] [Created] (SPARK-9277) SparseVector constructor must throw an error when declared number of elements less than array lenght

2015-07-23 Thread Andrey Vykhodtsev (JIRA)
Andrey Vykhodtsev created SPARK-9277: Summary: SparseVector constructor must throw an error when declared number of elements less than array lenght Key: SPARK-9277 URL: https://issues.apache.org/jira/browse/SP

[jira] [Commented] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638729#comment-14638729 ] Apache Spark commented on SPARK-7105: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7105: --- Assignee: Yu Ishikawa (was: Apache Spark) > Support model save/load in Python's GaussianMixt

[jira] [Assigned] (SPARK-7105) Support model save/load in Python's GaussianMixture

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-7105: --- Assignee: Apache Spark (was: Yu Ishikawa) > Support model save/load in Python's GaussianMixt

[jira] [Commented] (SPARK-9276) ThriftServer process can't stop if using command "yarn application -kill appid"

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638714#comment-14638714 ] Sean Owen commented on SPARK-9276: -- I might misunderstand this, but, is that surprising?

[jira] [Created] (SPARK-9276) ThriftServer process can't stop if using command "yarn application -kill appid"

2015-07-23 Thread meiyoula (JIRA)
meiyoula created SPARK-9276: --- Summary: ThriftServer process can't stop if using command "yarn application -kill appid" Key: SPARK-9276 URL: https://issues.apache.org/jira/browse/SPARK-9276 Project: Spark

[jira] [Commented] (SPARK-9092) Make --num-executors compatible with dynamic allocation

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638689#comment-14638689 ] Sean Owen commented on SPARK-9092: -- I tend to agree with [~sandyr] for these reasons. The

[jira] [Updated] (SPARK-9212) update Netty version to "4.0.29.Final" for Netty Metrics

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9212: - Assignee: Zhang, Liye Priority: Trivial (was: Major) > update Netty version to "4.0.29.Final" for Net

[jira] [Resolved] (SPARK-9212) update Netty version to "4.0.29.Final" for Netty Metrics

2015-07-23 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9212?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9212. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7562 [https://github.com/ap

[jira] [Created] (SPARK-9275) IsolatedClientLoader could not load shared JNI libraries

2015-07-23 Thread Peng Zhen (JIRA)
Peng Zhen created SPARK-9275: Summary: IsolatedClientLoader could not load shared JNI libraries Key: SPARK-9275 URL: https://issues.apache.org/jira/browse/SPARK-9275 Project: Spark Issue Type: Bu

[jira] [Commented] (SPARK-5447) Replace reference to SchemaRDD with DataFrame

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638645#comment-14638645 ] Apache Spark commented on SPARK-5447: - User 'darroyocazorla' has created a pull reques

[jira] [Assigned] (SPARK-5991) Python API for ML model import/export

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5991: --- Assignee: Apache Spark (was: Joseph K. Bradley) > Python API for ML model import/export > --

[jira] [Commented] (SPARK-5991) Python API for ML model import/export

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638633#comment-14638633 ] Apache Spark commented on SPARK-5991: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-5991) Python API for ML model import/export

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-5991: --- Assignee: Joseph K. Bradley (was: Apache Spark) > Python API for ML model import/export > --

[jira] [Updated] (SPARK-9192) add initialization phase for nondeterministic expression

2015-07-23 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9192?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9192: --- Description: Currently nondeterministic expression is broken without a explicit initialization phase.

[jira] [Commented] (SPARK-9267) Remove highly unnecessary accumulators stringify methods

2015-07-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638547#comment-14638547 ] François Garillot commented on SPARK-9267: -- I see a *lot* of [string interpolati

[jira] [Commented] (SPARK-4886) Support cache control for each partition of a Hive partitioned table

2015-07-23 Thread Xu Chen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638545#comment-14638545 ] Xu Chen commented on SPARK-4886: +1 [~zhengxudong] Did you going to do this feature? > Su

[jira] [Commented] (SPARK-9268) Params.setDefault should not keep varargs annotation

2015-07-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9268?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638543#comment-14638543 ] François Garillot commented on SPARK-9268: -- You may want to add a link to the Sca

[jira] [Assigned] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9236: --- Assignee: Apache Spark > Left Outer Join with empty JavaPairRDD returns empty RDD > -

[jira] [Assigned] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9236: --- Assignee: (was: Apache Spark) > Left Outer Join with empty JavaPairRDD returns empty RDD

[jira] [Commented] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638530#comment-14638530 ] Apache Spark commented on SPARK-9236: - User 'huitseeker' has created a pull request fo

[jira] [Commented] (SPARK-9236) Left Outer Join with empty JavaPairRDD returns empty RDD

2015-07-23 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638527#comment-14638527 ] François Garillot commented on SPARK-9236: -- Very nice catch !! So, this is actual

[jira] [Assigned] (SPARK-9122) spark.mllib regression should support batch predict

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9122: --- Assignee: Yanbo Liang (was: Apache Spark) > spark.mllib regression should support batch pred

[jira] [Commented] (SPARK-9122) spark.mllib regression should support batch predict

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638510#comment-14638510 ] Apache Spark commented on SPARK-9122: - User 'yanboliang' has created a pull request fo

[jira] [Assigned] (SPARK-9122) spark.mllib regression should support batch predict

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9122: --- Assignee: Apache Spark (was: Yanbo Liang) > spark.mllib regression should support batch pred

[jira] [Created] (SPARK-9274) Tests using golden files can fail depending on new line characters in queries

2015-07-23 Thread Kousuke Saruta (JIRA)
Kousuke Saruta created SPARK-9274: - Summary: Tests using golden files can fail depending on new line characters in queries Key: SPARK-9274 URL: https://issues.apache.org/jira/browse/SPARK-9274 Project

[jira] [Assigned] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9183: --- Assignee: (was: Apache Spark) > NPE / confusing error message when looking up missing fun

[jira] [Assigned] (SPARK-9207) Turn on Parquet filter push-down by default

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9207: --- Assignee: Cheng Lian (was: Apache Spark) > Turn on Parquet filter push-down by default > ---

[jira] [Assigned] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9183: --- Assignee: Apache Spark > NPE / confusing error message when looking up missing function in Sp

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638468#comment-14638468 ] Apache Spark commented on SPARK-9183: - User 'yjshen' has created a pull request for th

[jira] [Assigned] (SPARK-9207) Turn on Parquet filter push-down by default

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9207: --- Assignee: Apache Spark (was: Cheng Lian) > Turn on Parquet filter push-down by default > ---

[jira] [Commented] (SPARK-9207) Turn on Parquet filter push-down by default

2015-07-23 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9207?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638469#comment-14638469 ] Apache Spark commented on SPARK-9207: - User 'liancheng' has created a pull request for

[jira] [Updated] (SPARK-8118) Turn off noisy log output produced by Parquet 1.7.0

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-8118: -- Description: Parquet 1.7.0 renames package name to "org.apache.parquet", need to adjust {{ParquetRelati

[jira] [Commented] (SPARK-9183) NPE / confusing error message when looking up missing function in Spark SQL

2015-07-23 Thread Yijie Shen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638438#comment-14638438 ] Yijie Shen commented on SPARK-9183: --- OK, I will submit one soon. > NPE / confusing erro

[jira] [Commented] (SPARK-9182) filter and groupBy on DataFrames are not passed through to jdbc source

2015-07-23 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638427#comment-14638427 ] Cheng Lian commented on SPARK-9182: --- I suspect that the type of column {{sal}} is {{text

[jira] [Issue Comment Deleted] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-07-23 Thread Erik Schneider (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Erik Schneider updated SPARK-4105: -- Comment: was deleted (was: I have the same issue running Spark1.5.0. {panel:title=Compression f

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-07-23 Thread Erik Schneider (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14638428#comment-14638428 ] Erik Schneider commented on SPARK-4105: --- I have the same issue running Spark1.5.0.

<    1   2   3   >