[jira] [Updated] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22173: -- Issue Type: Improvement (was: Bug) > Table CSS style needs to be adjusted in History Page and in

[jira] [Resolved] (SPARK-22122) Respect WITH clauses to count input rows in TPCDSQueryBenchmark

2017-09-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22122. - Resolution: Fixed Assignee: Takeshi Yamamuro Fix Version/s: 2.3.0 > Respect WITH clauses

[jira] [Updated] (SPARK-22175) Add status column to history page

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22175: -- Priority: Trivial (was: Major) > Add status column to history page >

[jira] [Resolved] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22163. --- Resolution: Duplicate [~michaeln_apache] Don't reopen this issue. It isn't a bug and forks the

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186893#comment-16186893 ] Sean Owen commented on SPARK-21999: --- Please don't fork the discussion. Nothing about this suggests a

[jira] [Closed] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen closed SPARK-22163. - > Design Issue of Spark Streaming that Causes Random Run-time Exception >

[jira] [Assigned] (SPARK-22175) Add status column to history page

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22175: Assignee: (was: Apache Spark) > Add status column to history page >

[jira] [Assigned] (SPARK-22175) Add status column to history page

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22175: Assignee: Apache Spark > Add status column to history page >

[jira] [Commented] (SPARK-22175) Add status column to history page

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186832#comment-16186832 ] Apache Spark commented on SPARK-22175: -- User 'caneGuy' has created a pull request for this issue:

[jira] [Updated] (SPARK-22175) Add status column to history page

2017-09-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-22175: - Description: Currently, the history page has no status column which represent the status of

[jira] [Updated] (SPARK-22175) Add status column to history page

2017-09-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-22175: - Description: Currently, the history page has no status column which represent the status of

[jira] [Updated] (SPARK-22175) Add status column to history page

2017-09-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-22175: - Attachment: after.png before.png > Add status column to history page >

[jira] [Updated] (SPARK-22175) Add status column to history page

2017-09-29 Thread zhoukang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhoukang updated SPARK-22175: - Description: Currently, the history page has no status column which represent the status of

[jira] [Created] (SPARK-22175) Add status column to history page

2017-09-29 Thread zhoukang (JIRA)
zhoukang created SPARK-22175: Summary: Add status column to history page Key: SPARK-22175 URL: https://issues.apache.org/jira/browse/SPARK-22175 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-22174) Support to automatically create the directory where the event logs go (`spark.eventLog.dir`)

2017-09-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-22174. Resolution: Duplicate See duplicate bug for discussion. Also please close the PR. This

[jira] [Resolved] (SPARK-21904) Rename tempTables to tempViews in SessionCatalog

2017-09-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-21904. - Resolution: Fixed Fix Version/s: 2.3.0 > Rename tempTables to tempViews in SessionCatalog >

[jira] [Assigned] (SPARK-22174) Support to automatically create the directory where the event logs go (`spark.eventLog.dir`)

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22174: Assignee: (was: Apache Spark) > Support to automatically create the directory where

[jira] [Commented] (SPARK-22174) Support to automatically create the directory where the event logs go (`spark.eventLog.dir`)

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186808#comment-16186808 ] Apache Spark commented on SPARK-22174: -- User 'zuotingbing' has created a pull request for this

[jira] [Assigned] (SPARK-22174) Support to automatically create the directory where the event logs go (`spark.eventLog.dir`)

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22174: Assignee: Apache Spark > Support to automatically create the directory where the event

[jira] [Updated] (SPARK-22174) Support to automatically create the directory where the event logs go (`spark.eventLog.dir`)

2017-09-29 Thread zuotingbing (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zuotingbing updated SPARK-22174: Issue Type: Bug (was: Improvement) > Support to automatically create the directory where the

[jira] [Created] (SPARK-22174) Support to automatically create the directory where the event logs go (`spark.eventLog.dir`)

2017-09-29 Thread zuotingbing (JIRA)
zuotingbing created SPARK-22174: --- Summary: Support to automatically create the directory where the event logs go (`spark.eventLog.dir`) Key: SPARK-22174 URL: https://issues.apache.org/jira/browse/SPARK-22174

[jira] [Assigned] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22173: Assignee: (was: Apache Spark) > Table CSS style needs to be adjusted in History Page

[jira] [Commented] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186793#comment-16186793 ] Apache Spark commented on SPARK-22173: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22173: Assignee: Apache Spark > Table CSS style needs to be adjusted in History Page and in

[jira] [Commented] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-09-29 Thread Alex Bozarth (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186789#comment-16186789 ] Alex Bozarth commented on SPARK-22173: -- Just as a note, https://github.com/apache/spark/pull/19270

[jira] [Created] (SPARK-22173) Table CSS style needs to be adjusted in History Page and in Executors Page.

2017-09-29 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-22173: -- Summary: Table CSS style needs to be adjusted in History Page and in Executors Page. Key: SPARK-22173 URL: https://issues.apache.org/jira/browse/SPARK-22173

[jira] [Assigned] (SPARK-22172) Worker hangs when the external shuffle service port is already in use

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22172: Assignee: Apache Spark > Worker hangs when the external shuffle service port is already

[jira] [Assigned] (SPARK-22172) Worker hangs when the external shuffle service port is already in use

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22172: Assignee: (was: Apache Spark) > Worker hangs when the external shuffle service port

[jira] [Commented] (SPARK-22172) Worker hangs when the external shuffle service port is already in use

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186779#comment-16186779 ] Apache Spark commented on SPARK-22172: -- User 'devaraj-kavali' has created a pull request for this

[jira] [Created] (SPARK-22172) Worker hangs when the external shuffle service port is already in use

2017-09-29 Thread Devaraj K (JIRA)
Devaraj K created SPARK-22172: - Summary: Worker hangs when the external shuffle service port is already in use Key: SPARK-22172 URL: https://issues.apache.org/jira/browse/SPARK-22172 Project: Spark

[jira] [Commented] (SPARK-22171) Describe Table Extended Failed when Table Owner is Empty

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186739#comment-16186739 ] Apache Spark commented on SPARK-22171: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22171) Describe Table Extended Failed when Table Owner is Empty

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22171: Assignee: Apache Spark (was: Xiao Li) > Describe Table Extended Failed when Table Owner

[jira] [Assigned] (SPARK-22171) Describe Table Extended Failed when Table Owner is Empty

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22171: Assignee: Xiao Li (was: Apache Spark) > Describe Table Extended Failed when Table Owner

[jira] [Created] (SPARK-22171) Describe Table Extended Failed when Table Owner is Empty

2017-09-29 Thread Xiao Li (JIRA)
Xiao Li created SPARK-22171: --- Summary: Describe Table Extended Failed when Table Owner is Empty Key: SPARK-22171 URL: https://issues.apache.org/jira/browse/SPARK-22171 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-22170) Broadcast join holds an extra copy of rows in driver memory

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22170: Assignee: (was: Apache Spark) > Broadcast join holds an extra copy of rows in driver

[jira] [Assigned] (SPARK-22170) Broadcast join holds an extra copy of rows in driver memory

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22170: Assignee: Apache Spark > Broadcast join holds an extra copy of rows in driver memory >

[jira] [Commented] (SPARK-22170) Broadcast join holds an extra copy of rows in driver memory

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186713#comment-16186713 ] Apache Spark commented on SPARK-22170: -- User 'rdblue' has created a pull request for this issue:

[jira] [Created] (SPARK-22170) Broadcast join holds an extra copy of rows in driver memory

2017-09-29 Thread Ryan Blue (JIRA)
Ryan Blue created SPARK-22170: - Summary: Broadcast join holds an extra copy of rows in driver memory Key: SPARK-22170 URL: https://issues.apache.org/jira/browse/SPARK-22170 Project: Spark Issue

[jira] [Comment Edited] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186682#comment-16186682 ] Michael N edited comment on SPARK-21999 at 9/29/17 11:35 PM: - You were

[jira] [Reopened] (SPARK-22163) Design Issue of Spark Streaming that Causes Random Run-time Exception

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael N reopened SPARK-22163: --- This ticket is *not* duplicate of ticket https://issues.apache.org/jira/browse/SPARK-21999. This

[jira] [Commented] (SPARK-21999) ConcurrentModificationException - Spark Streaming

2017-09-29 Thread Michael N (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186682#comment-16186682 ] Michael N commented on SPARK-21999: --- You were looking at the mechanics of locking. However, let's look

[jira] [Commented] (SPARK-21644) LocalLimit.maxRows is defined incorrectly

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186464#comment-16186464 ] Apache Spark commented on SPARK-21644: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-09-29 Thread Marcelo Vanzin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186062#comment-16186062 ] Marcelo Vanzin commented on SPARK-18838: Not really. You could try to backport the patch (not

[jira] [Assigned] (SPARK-22169) table name with numbers and characters should be able to be parsed

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22169: Assignee: Wenchen Fan (was: Apache Spark) > table name with numbers and characters

[jira] [Commented] (SPARK-22169) table name with numbers and characters should be able to be parsed

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22169?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186033#comment-16186033 ] Apache Spark commented on SPARK-22169: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-22169) table name with numbers and characters should be able to be parsed

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-22169: Assignee: Apache Spark (was: Wenchen Fan) > table name with numbers and characters

[jira] [Created] (SPARK-22169) table name with numbers and characters should be able to be parsed

2017-09-29 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-22169: --- Summary: table name with numbers and characters should be able to be parsed Key: SPARK-22169 URL: https://issues.apache.org/jira/browse/SPARK-22169 Project: Spark

[jira] [Resolved] (SPARK-22161) Add Impala-modified TPC-DS queries

2017-09-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22161. - Resolution: Fixed Fix Version/s: 2.3.0 2.2.1 > Add Impala-modified TPC-DS

[jira] [Commented] (SPARK-22167) Spark Packaging w/R distro issues

2017-09-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186008#comment-16186008 ] holdenk commented on SPARK-22167: - So for some reason the R directory in the hadoop 2.7 build looks like:

[jira] [Commented] (SPARK-22168) py4j.protocol.Py4JNetworkError: Error while receiving Socket.timeout: timed out

2017-09-29 Thread Krishnaprasad (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22168?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186004#comment-16186004 ] Krishnaprasad commented on SPARK-22168: --- Thanks for the reply Owen. I will post this question on

[jira] [Commented] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16186001#comment-16186001 ] Apache Spark commented on SPARK-22146: -- User 'mgaido91' has created a pull request for this issue:

[jira] [Resolved] (SPARK-22168) py4j.protocol.Py4JNetworkError: Error while receiving Socket.timeout: timed out

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22168. --- Resolution: Invalid By itself this error doesn't many anything. It just says something else went

[jira] [Commented] (SPARK-22167) Spark Packaging w/R distro issues

2017-09-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185959#comment-16185959 ] holdenk commented on SPARK-22167: - Here is the build log

[jira] [Created] (SPARK-22168) py4j.protocol.Py4JNetworkError: Error while receiving Socket.timeout: timed out

2017-09-29 Thread Krishnaprasad (JIRA)
Krishnaprasad created SPARK-22168: - Summary: py4j.protocol.Py4JNetworkError: Error while receiving Socket.timeout: timed out Key: SPARK-22168 URL: https://issues.apache.org/jira/browse/SPARK-22168

[jira] [Issue Comment Deleted] (SPARK-22167) Spark Packaging w/R distro issues

2017-09-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-22167: Comment: was deleted (was: [^build.log]) > Spark Packaging w/R distro issues >

[jira] [Commented] (SPARK-22167) Spark Packaging w/R distro issues

2017-09-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185956#comment-16185956 ] holdenk commented on SPARK-22167: - [^build.log] > Spark Packaging w/R distro issues >

[jira] [Created] (SPARK-22167) Spark Packaging w/R distro issues

2017-09-29 Thread holdenk (JIRA)
holdenk created SPARK-22167: --- Summary: Spark Packaging w/R distro issues Key: SPARK-22167 URL: https://issues.apache.org/jira/browse/SPARK-22167 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-22138) Allow retry during release-build

2017-09-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-22138. - Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1 Issue

[jira] [Resolved] (SPARK-22129) Spark release scripts ignore the GPG_KEY and always sign with your default key

2017-09-29 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk resolved SPARK-22129. - Resolution: Fixed Fix Version/s: 2.1.2 2.3.0 2.2.1 Issue

[jira] [Comment Edited] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185937#comment-16185937 ] Liang-Chi Hsieh edited comment on SPARK-22137 at 9/29/17 3:04 PM: --

[jira] [Comment Edited] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185937#comment-16185937 ] Liang-Chi Hsieh edited comment on SPARK-22137 at 9/29/17 2:56 PM: --

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Liang-Chi Hsieh (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185937#comment-16185937 ] Liang-Chi Hsieh commented on SPARK-22137: - Actually that is because we only allow to cast between

[jira] [Commented] (SPARK-18838) High latency of event processing for large jobs

2017-09-29 Thread Shahbaz Hussain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185856#comment-16185856 ] Shahbaz Hussain commented on SPARK-18838: - Is there a work around to get it working before spark

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2017-09-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185744#comment-16185744 ] Steve Loughran commented on SPARK-2356: --- [~Vasilina], that probably means you're running with Hadoop

[jira] [Resolved] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2017-09-29 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved SPARK-2356. --- Resolution: Duplicate > Exception: Could not locate executable null\bin\winutils.exe in the

[jira] [Assigned] (SPARK-18935) Use Mesos "Dynamic Reservation" resource for Spark

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18935: Assignee: (was: Apache Spark) > Use Mesos "Dynamic Reservation" resource for Spark >

[jira] [Commented] (SPARK-18935) Use Mesos "Dynamic Reservation" resource for Spark

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185735#comment-16185735 ] Apache Spark commented on SPARK-18935: -- User 'skonto' has created a pull request for this issue:

[jira] [Assigned] (SPARK-18935) Use Mesos "Dynamic Reservation" resource for Spark

2017-09-29 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18935: Assignee: Apache Spark > Use Mesos "Dynamic Reservation" resource for Spark >

[jira] [Commented] (SPARK-22166) java.lang.OutOfMemoryError: error while calling spill()

2017-09-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185722#comment-16185722 ] 吴志龙 commented on SPARK-22166: - jvm data spill to disk throw exeception, I add exector-memory is ok . maybe

[jira] [Commented] (SPARK-2356) Exception: Could not locate executable null\bin\winutils.exe in the Hadoop

2017-09-29 Thread Vasilina Terahava (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185716#comment-16185716 ] Vasilina Terahava commented on SPARK-2356: -- as for parquet libraries in this case they print

[jira] [Updated] (SPARK-22166) java.lang.OutOfMemoryError: error while calling spill()

2017-09-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-22166: Description: ${SPARK_HOME}/bin/spark-sql --master=yarn --queue lx_etl --driver-memory 4g --driver-java-options

[jira] [Resolved] (SPARK-22166) java.lang.OutOfMemoryError: error while calling spill()

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22166. --- Resolution: Invalid This just means you ran out of memory. > java.lang.OutOfMemoryError: error

[jira] [Updated] (SPARK-22166) java.lang.OutOfMemoryError: error while calling spill()

2017-09-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-22166: Description: ${SPARK_HOME}/bin/spark-sql --master=yarn --queue lx_etl --driver-memory 4g --driver-java-options

[jira] [Updated] (SPARK-22166) java.lang.OutOfMemoryError: error while calling spill()

2017-09-29 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-22166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] 吴志龙 updated SPARK-22166: Description: ${SPARK_HOME}/bin/spark-sql --master=yarn --queue lx_etl --driver-memory 4g --driver-java-options

[jira] [Created] (SPARK-22166) java.lang.OutOfMemoryError: error while calling spill()

2017-09-29 Thread JIRA
吴志龙 created SPARK-22166: --- Summary: java.lang.OutOfMemoryError: error while calling spill() Key: SPARK-22166 URL: https://issues.apache.org/jira/browse/SPARK-22166 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Jia-Xuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185563#comment-16185563 ] Jia-Xuan Liu commented on SPARK-22137: -- I guess the problem is we can't create a table with vector

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread yzheng616 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185554#comment-16185554 ] yzheng616 commented on SPARK-22137: --- yes, the API just could not work with the table that manually

[jira] [Comment Edited] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Jia-Xuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185548#comment-16185548 ] Jia-Xuan Liu edited comment on SPARK-22137 at 9/29/17 9:16 AM: --- umm... It's

[jira] [Comment Edited] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Jia-Xuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185548#comment-16185548 ] Jia-Xuan Liu edited comment on SPARK-22137 at 9/29/17 9:14 AM: --- umm... It's

[jira] [Comment Edited] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Jia-Xuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185548#comment-16185548 ] Jia-Xuan Liu edited comment on SPARK-22137 at 9/29/17 9:13 AM: --- umm... It's

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Jia-Xuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185548#comment-16185548 ] Jia-Xuan Liu commented on SPARK-22137: -- umm... It's still fail. {code:java} scala> val tdf =

[jira] [Comment Edited] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread yzheng616 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185535#comment-16185535 ] yzheng616 edited comment on SPARK-22137 at 9/29/17 9:05 AM: Have you tried to

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread yzheng616 (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185535#comment-16185535 ] yzheng616 commented on SPARK-22137: --- Have you tried to use DataFrameWriter.insertInto(tableName:

[jira] [Commented] (SPARK-22137) Failed to insert VectorUDT to hive table with DataFrameWriter.insertInto(tableName: String)

2017-09-29 Thread Jia-Xuan Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16185527#comment-16185527 ] Jia-Xuan Liu commented on SPARK-22137: -- just do some testing. I'm not really sure where is the

[jira] [Updated] (SPARK-21893) Put Kafka 0.8 behind a profile

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-21893: -- Labels: releasenotes (was: ) > Put Kafka 0.8 behind a profile > -- > >

[jira] [Resolved] (SPARK-22142) Move Flume support behind a profile

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22142. --- Resolution: Fixed Fix Version/s: 2.3.0 Issue resolved by pull request 19365

[jira] [Updated] (SPARK-22142) Move Flume support behind a profile

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-22142: -- Labels: releasenotes (was: ) > Move Flume support behind a profile >

[jira] [Resolved] (SPARK-22157) The uniux_timestamp method handles the time field that is lost in mill

2017-09-29 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-22157. --- Resolution: Not A Problem > The uniux_timestamp method handles the time field that is lost in mill >

[jira] [Updated] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

2017-09-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li updated SPARK-22146: Fix Version/s: 2.3.0 > FileNotFoundException while reading ORC files containing '%' >

[jira] [Resolved] (SPARK-22146) FileNotFoundException while reading ORC files containing '%'

2017-09-29 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-22146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-22146. - Resolution: Fixed Assignee: Marco Gaido > FileNotFoundException while reading ORC files containing