[jira] [Commented] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

2017-06-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036566#comment-16036566 ] Dongjoon Hyun commented on SPARK-20954: --- Hi, [~garrosc]. This is due to recent incompatible change

[jira] [Updated] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

2017-06-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20954: -- Affects Version/s: (was: 2.2.1) 2.2.0 > DESCRIBE showing 1 extra

[jira] [Created] (SPARK-20981) Add --repositories equivalent configuration for Spark

2017-06-04 Thread Saisai Shao (JIRA)
Saisai Shao created SPARK-20981: --- Summary: Add --repositories equivalent configuration for Spark Key: SPARK-20981 URL: https://issues.apache.org/jira/browse/SPARK-20981 Project: Spark Issue

[jira] [Commented] (SPARK-20980) CSV: rename the option `wholeFile` to `multiLine`

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036562#comment-16036562 ] Xiao Li commented on SPARK-20980: - I think this JIRA should be the blocker level; otherwise, we might not

[jira] [Updated] (SPARK-20980) CSV: rename the option `wholeFile` to `multiLine`

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20980: Priority: Blocker (was: Major) > CSV: rename the option `wholeFile` to `multiLine` >

[jira] [Issue Comment Deleted] (SPARK-20980) CSV: rename the option `wholeFile` to `multiLine`

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20980: Comment: was deleted (was: The current option name `wholeFile` is misleading for CSV. Currently, it is

[jira] [Updated] (SPARK-20980) CSV: rename the option `wholeFile` to `multiLine`

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20980: Description: The current option name `wholeFile` is misleading for CSV. Currently, it is not representing

[jira] [Assigned] (SPARK-20980) CSV: rename the option `wholeFile` to `multiLine`

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reassigned SPARK-20980: --- Assignee: Xiao Li The current option name `wholeFile` is misleading for CSV. Currently, it is not

[jira] [Assigned] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20978: Assignee: Apache Spark > CSV emits NPE when the number of tokens is less than given

[jira] [Created] (SPARK-20980) CSV: rename the option `wholeFile` to `multiLine`

2017-06-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20980: --- Summary: CSV: rename the option `wholeFile` to `multiLine` Key: SPARK-20980 URL: https://issues.apache.org/jira/browse/SPARK-20980 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20978: Assignee: (was: Apache Spark) > CSV emits NPE when the number of tokens is less than

[jira] [Commented] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036555#comment-16036555 ] Apache Spark commented on SPARK-20978: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Updated] (SPARK-20954) DESCRIBE showing 1 extra row of "| # col_name | data_type | comment |"

2017-06-04 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-20954: -- Environment: (was: HDP 2.5) > DESCRIBE showing 1 extra row of "| # col_name | data_type

[jira] [Assigned] (SPARK-20979) Add a rate source to generate values for tests and benchmark

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20979: Assignee: Apache Spark (was: Shixiong Zhu) > Add a rate source to generate values for

[jira] [Commented] (SPARK-20979) Add a rate source to generate values for tests and benchmark

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036545#comment-16036545 ] Apache Spark commented on SPARK-20979: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20979) Add a rate source to generate values for tests and benchmark

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20979: Assignee: Shixiong Zhu (was: Apache Spark) > Add a rate source to generate values for

[jira] [Commented] (SPARK-20922) Unsafe deserialization in Spark LauncherConnection

2017-06-04 Thread Aditya Sharad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036543#comment-16036543 ] Aditya Sharad commented on SPARK-20922: --- I appreciate your quick response to this issue. I believe

[jira] [Created] (SPARK-20979) Add a rate source to generate values for tests and benchmark

2017-06-04 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-20979: Summary: Add a rate source to generate values for tests and benchmark Key: SPARK-20979 URL: https://issues.apache.org/jira/browse/SPARK-20979 Project: Spark

[jira] [Created] (SPARK-20978) CSV emits NPE when the number of tokens is less than given schema and corrupt column is given

2017-06-04 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-20978: Summary: CSV emits NPE when the number of tokens is less than given schema and corrupt column is given Key: SPARK-20978 URL: https://issues.apache.org/jira/browse/SPARK-20978

[jira] [Commented] (SPARK-14408) Update RDD.treeAggregate not to use reduce

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14408?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036516#comment-16036516 ] Apache Spark commented on SPARK-14408: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-20977) NPE in CollectionAccumulator

2017-06-04 Thread sharkd tu (JIRA)
sharkd tu created SPARK-20977: - Summary: NPE in CollectionAccumulator Key: SPARK-20977 URL: https://issues.apache.org/jira/browse/SPARK-20977 Project: Spark Issue Type: Bug Components:

[jira] [Closed] (SPARK-20968) Support separator in Tokenizer

2017-06-04 Thread darion yaphet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet closed SPARK-20968. - Resolution: Fixed > Support separator in Tokenizer > -- > >

[jira] [Updated] (SPARK-20162) Reading data from MySQL - Cannot up cast from decimal(30,6) to decimal(38,18)

2017-06-04 Thread coneyliu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] coneyliu updated SPARK-20162: - Component/s: (was: Spark Core) SQL > Reading data from MySQL - Cannot up cast from

[jira] [Commented] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2017-06-04 Thread Dapeng Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036478#comment-16036478 ] Dapeng Sun commented on SPARK-5159: --- I tested it with version 2.1.1, the issue is still existed, >

[jira] [Comment Edited] (SPARK-5159) Thrift server does not respect hive.server2.enable.doAs=true

2017-06-04 Thread Dapeng Sun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036478#comment-16036478 ] Dapeng Sun edited comment on SPARK-5159 at 6/5/17 2:44 AM: --- I tested it with

[jira] [Updated] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

2017-06-04 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] poseidon updated SPARK-20896: - Description: 1、zeppelin 0.6.2 in *SCOPE* mode 2、spark 1.6.2 3、HDP 2.4 for HDFS YARN trigger scala

[jira] [Updated] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

2017-06-04 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] poseidon updated SPARK-20896: - Description: 1、zeppelin 0.6.2 in *SCOPE* mode 2、spark 1.6.2 3、HDP 2.4 for HDFS YARN trigger scala

[jira] [Commented] (SPARK-20896) spark executor get java.lang.ClassCastException when trigger two job at same time

2017-06-04 Thread poseidon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036462#comment-16036462 ] poseidon commented on SPARK-20896: -- Sorry for the error code , JIRA must recognize some part of my code

[jira] [Comment Edited] (SPARK-7768) Make user-defined type (UDT) API public

2017-06-04 Thread Patrick Grandjean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036417#comment-16036417 ] Patrick Grandjean edited comment on SPARK-7768 at 6/4/17 10:56 PM: ---

[jira] [Commented] (SPARK-7768) Make user-defined type (UDT) API public

2017-06-04 Thread Patrick Grandjean (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036417#comment-16036417 ] Patrick Grandjean commented on SPARK-7768: -- Thanks [~metasim]! This feature request was opened

[jira] [Assigned] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20976: Assignee: Xiao Li (was: Apache Spark) > Unify Error Messages for FAILFAST mode. >

[jira] [Commented] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036388#comment-16036388 ] Apache Spark commented on SPARK-20976: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20976: Assignee: Apache Spark (was: Xiao Li) > Unify Error Messages for FAILFAST mode. >

[jira] [Updated] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20976: Description: Previously, we indicate the job was terminated because of `FAILFAST` mode. Malformed line

[jira] [Updated] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20976: Description: Previously, we indicate the job was terminated because of `FAILFAST` mode. Malformed line

[jira] [Updated] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-20976: Description: Previously, we indicate the job was terminated because of `FAILFAST` mode. {noformat}

[jira] [Created] (SPARK-20976) Unify Error Messages for FAILFAST mode.

2017-06-04 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20976: --- Summary: Unify Error Messages for FAILFAST mode. Key: SPARK-20976 URL: https://issues.apache.org/jira/browse/SPARK-20976 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-20841) Support table column aliases in FROM clause

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036384#comment-16036384 ] Xiao Li commented on SPARK-20841: - Just reopen it. Will mark it as resolved when the sub-tasks are

[jira] [Reopened] (SPARK-20841) Support table column aliases in FROM clause

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20841?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li reopened SPARK-20841: - > Support table column aliases in FROM clause > --- > >

[jira] [Resolved] (SPARK-20961) generalize the dictionary in ColumnVector

2017-06-04 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20961. - Resolution: Fixed Fix Version/s: 2.3.0 > generalize the dictionary in ColumnVector >

[jira] [Assigned] (SPARK-20921) While reading from oracle database, it converts to wrong type.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20921: Assignee: (was: Apache Spark) > While reading from oracle database, it converts to

[jira] [Assigned] (SPARK-20921) While reading from oracle database, it converts to wrong type.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20921: Assignee: Apache Spark > While reading from oracle database, it converts to wrong type. >

[jira] [Commented] (SPARK-20921) While reading from oracle database, it converts to wrong type.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036295#comment-16036295 ] Apache Spark commented on SPARK-20921: -- User 'wangyum' has created a pull request for this issue:

[jira] [Commented] (SPARK-20824) Generate code to get value from table cache with wider column in ColumnarBatch

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036263#comment-16036263 ] Apache Spark commented on SPARK-20824: -- User 'kiszk' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20824) Generate code to get value from table cache with wider column in ColumnarBatch

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20824: Assignee: (was: Apache Spark) > Generate code to get value from table cache with

[jira] [Assigned] (SPARK-20824) Generate code to get value from table cache with wider column in ColumnarBatch

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20824: Assignee: Apache Spark > Generate code to get value from table cache with wider column in

[jira] [Updated] (SPARK-15616) CatalogRelation should fallback to HDFS size of partitions that are involved in Query if statistics are not available.

2017-06-04 Thread Lianhui Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lianhui Wang updated SPARK-15616: - Summary: CatalogRelation should fallback to HDFS size of partitions that are involved in Query

[jira] [Commented] (SPARK-15616) Metastore relation should fallback to HDFS size of partitions that are involved in Query if statistics are not available.

2017-06-04 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16036197#comment-16036197 ] Apache Spark commented on SPARK-15616: -- User 'lianhuiwang' has created a pull request for this