[jira] [Created] (SPARK-12637) Print stage info of finished stages properly

2016-01-04 Thread Navis (JIRA)
Navis created SPARK-12637: - Summary: Print stage info of finished stages properly Key: SPARK-12637 URL: https://issues.apache.org/jira/browse/SPARK-12637 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-12619) Combine small files in a hadoop directory into single split

2016-01-04 Thread Navis (JIRA)
Navis created SPARK-12619: - Summary: Combine small files in a hadoop directory into single split Key: SPARK-12619 URL: https://issues.apache.org/jira/browse/SPARK-12619 Project: Spark Issue Type:

[jira] [Commented] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2015-11-17 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010244#comment-15010244 ] Navis commented on SPARK-9686: -- @Cheng Lian Sorry, I've confused "remote metastore" with "remote database".

[jira] [Comment Edited] (SPARK-9686) Spark Thrift server doesn't return correct JDBC metadata

2015-11-17 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15010244#comment-15010244 ] Navis edited comment on SPARK-9686 at 11/18/15 5:06 AM: [~lian cheng] Sorry, I've

[jira] [Commented] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

2015-11-16 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15006352#comment-15006352 ] Navis commented on SPARK-9686: -- [~lian cheng] It's configured with remote database (maria-db in my case) of

[jira] [Created] (SPARK-11614) serde parameters should be set only when all params are ready

2015-11-09 Thread Navis (JIRA)
Navis created SPARK-11614: - Summary: serde parameters should be set only when all params are ready Key: SPARK-11614 URL: https://issues.apache.org/jira/browse/SPARK-11614 Project: Spark Issue Type:

[jira] [Updated] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

2015-11-05 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-9686: - Attachment: SPARK-9686.1.patch.txt > Spark hive jdbc client cannot get table from metadata store >

[jira] [Commented] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

2015-11-05 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14992767#comment-14992767 ] Navis commented on SPARK-9686: -- [~pin_zhang] Met the same problem and the patch attached is what I'm using

[jira] [Updated] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

2015-11-05 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-9686: - Affects Version/s: 1.5.0 1.5.1 > Spark hive jdbc client cannot get table from metadata

[jira] [Created] (SPARK-11546) Thrift server makes too many logs about result schema

2015-11-05 Thread Navis (JIRA)
Navis created SPARK-11546: - Summary: Thrift server makes too many logs about result schema Key: SPARK-11546 URL: https://issues.apache.org/jira/browse/SPARK-11546 Project: Spark Issue Type:

[jira] [Created] (SPARK-11124) JsonParser/Generator should be closed for resource reycle

2015-10-14 Thread Navis (JIRA)
Navis created SPARK-11124: - Summary: JsonParser/Generator should be closed for resource reycle Key: SPARK-11124 URL: https://issues.apache.org/jira/browse/SPARK-11124 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11124) JsonParser/Generator should be closed for resource recycle

2015-10-14 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-11124: -- Summary: JsonParser/Generator should be closed for resource recycle (was: JsonParser/Generator should be

[jira] [Commented] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-13 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14956121#comment-14956121 ] Navis commented on SPARK-11067: --- [~alexliu68] Seeing that "RowBasedSet" is in stack trace, It's older

[jira] [Created] (SPARK-11062) Thrift server does not support operationLog

2015-10-12 Thread Navis (JIRA)
Navis created SPARK-11062: - Summary: Thrift server does not support operationLog Key: SPARK-11062 URL: https://issues.apache.org/jira/browse/SPARK-11062 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11067) Spark SQL thrift server fails to handle decimal value

2015-10-12 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-11067: -- Attachment: SPARK-11067.1.patch.txt The exception would be gone with this patch but handling of big decimal

[jira] [Created] (SPARK-10684) StructType.interpretedOrdering need not to be serialized

2015-09-17 Thread Navis (JIRA)
Navis created SPARK-10684: - Summary: StructType.interpretedOrdering need not to be serialized Key: SPARK-10684 URL: https://issues.apache.org/jira/browse/SPARK-10684 Project: Spark Issue Type:

[jira] [Created] (SPARK-10679) javax.jdo.JDOFatalUserException in executor

2015-09-17 Thread Navis (JIRA)
Navis created SPARK-10679: - Summary: javax.jdo.JDOFatalUserException in executor Key: SPARK-10679 URL: https://issues.apache.org/jira/browse/SPARK-10679 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9032) scala.MatchError in DataFrameReader.json(String path)

2015-08-26 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14712712#comment-14712712 ] Navis commented on SPARK-9032: -- Seemingly fixed by SPARK-8093 scala.MatchError in

[jira] [Updated] (SPARK-9685) Unsupported dataType: char(X) in Hive

2015-08-24 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-9685: - Attachment: SPARK-9685.1.patch.txt I've also met the situation to handle char type in spark a few months ago. The

[jira] [Created] (SPARK-10151) Support invocation of hive macro

2015-08-21 Thread Navis (JIRA)
Navis created SPARK-10151: - Summary: Support invocation of hive macro Key: SPARK-10151 URL: https://issues.apache.org/jira/browse/SPARK-10151 Project: Spark Issue Type: Bug Components: SQL

[jira] [Created] (SPARK-10152) Support Init script for hive-thriftserver

2015-08-21 Thread Navis (JIRA)
Navis created SPARK-10152: - Summary: Support Init script for hive-thriftserver Key: SPARK-10152 URL: https://issues.apache.org/jira/browse/SPARK-10152 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-8826) Fix ClassCastException in GeneratedAggregate

2015-07-04 Thread Navis (JIRA)
Navis created SPARK-8826: Summary: Fix ClassCastException in GeneratedAggregate Key: SPARK-8826 URL: https://issues.apache.org/jira/browse/SPARK-8826 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8357) Memory leakage on unsafe aggregation path with empty input

2015-06-13 Thread Navis (JIRA)
Navis created SPARK-8357: Summary: Memory leakage on unsafe aggregation path with empty input Key: SPARK-8357 URL: https://issues.apache.org/jira/browse/SPARK-8357 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8334) Binary logical plan should provide more realistic statistics

2015-06-12 Thread Navis (JIRA)
Navis created SPARK-8334: Summary: Binary logical plan should provide more realistic statistics Key: SPARK-8334 URL: https://issues.apache.org/jira/browse/SPARK-8334 Project: Spark Issue Type:

[jira] [Created] (SPARK-8312) Populate statistics info of hive tables if it's needed to be

2015-06-11 Thread Navis (JIRA)
Navis created SPARK-8312: Summary: Populate statistics info of hive tables if it's needed to be Key: SPARK-8312 URL: https://issues.apache.org/jira/browse/SPARK-8312 Project: Spark Issue Type:

[jira] [Updated] (SPARK-8312) Populate statistics info of hive tables if it's needed to be

2015-06-11 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-8312: - Description: Currently, spark-sql uses stats in metastore for estimating size of hive table, which means analyze

[jira] [Created] (SPARK-8285) CombineSum should be calculated as unlimited decimal first

2015-06-09 Thread Navis (JIRA)
Navis created SPARK-8285: Summary: CombineSum should be calculated as unlimited decimal first Key: SPARK-8285 URL: https://issues.apache.org/jira/browse/SPARK-8285 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-8153) Add configuration for disabling partial aggregation in runtime

2015-06-07 Thread Navis (JIRA)
Navis created SPARK-8153: Summary: Add configuration for disabling partial aggregation in runtime Key: SPARK-8153 URL: https://issues.apache.org/jira/browse/SPARK-8153 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7936) Add configuration for initial size and limit of hash for aggregation

2015-05-29 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Navis updated SPARK-7936: - Summary: Add configuration for initial size and limit of hash for aggregation (was: Add configuration for

[jira] [Commented] (SPARK-7936) Add configuration for initial size of hash for aggregation and limit

2015-05-29 Thread Navis (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14564271#comment-14564271 ] Navis commented on SPARK-7936: -- Added two configuration 1.

[jira] [Created] (SPARK-7936) Add configuration for initial size of hash for aggregation and limit

2015-05-28 Thread Navis (JIRA)
Navis created SPARK-7936: Summary: Add configuration for initial size of hash for aggregation and limit Key: SPARK-7936 URL: https://issues.apache.org/jira/browse/SPARK-7936 Project: Spark Issue