[jira] [Assigned] (SPARK-19641) JSON schema inference in DROPMALFORMED mode produces incorrect schema

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19641: Assignee: (was: Apache Spark) > JSON schema inference in DROPMALFORMED mode produces

[jira] [Assigned] (SPARK-19641) JSON schema inference in DROPMALFORMED mode produces incorrect schema

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19641: Assignee: Apache Spark > JSON schema inference in DROPMALFORMED mode produces incorrect

[jira] [Commented] (SPARK-19641) JSON schema inference in DROPMALFORMED mode produces incorrect schema

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19641?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950368#comment-15950368 ] Apache Spark commented on SPARK-19641: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Created] (SPARK-20168) Enable kinesis to start stream from Initial position specified by a timestamp

2017-03-30 Thread Yash Sharma (JIRA)
Yash Sharma created SPARK-20168: --- Summary: Enable kinesis to start stream from Initial position specified by a timestamp Key: SPARK-20168 URL: https://issues.apache.org/jira/browse/SPARK-20168 Project:

[jira] [Assigned] (SPARK-20167) In SqlBase.g4,some of the comments is not correct.

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20167: Assignee: (was: Apache Spark) > In SqlBase.g4,some of the comments is not correct. >

[jira] [Assigned] (SPARK-20167) In SqlBase.g4,some of the comments is not correct.

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20167: Assignee: Apache Spark > In SqlBase.g4,some of the comments is not correct. >

[jira] [Commented] (SPARK-20167) In SqlBase.g4,some of the comments is not correct.

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950289#comment-15950289 ] Apache Spark commented on SPARK-20167: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Created] (SPARK-20167) In SqlBase.g4,some of the comments is not correct.

2017-03-30 Thread guoxiaolongzte (JIRA)
guoxiaolongzte created SPARK-20167: -- Summary: In SqlBase.g4,some of the comments is not correct. Key: SPARK-20167 URL: https://issues.apache.org/jira/browse/SPARK-20167 Project: Spark Issue

[jira] [Commented] (SPARK-20139) Spark UI reports partial success for completed stage while log shows all tasks are finished

2017-03-30 Thread Genmao Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950244#comment-15950244 ] Genmao Yu commented on SPARK-20139: --- The event queue exceeds its capacity, so new events will be

[jira] [Commented] (SPARK-20144) spark.read.parquet no long maintains ordering of the data

2017-03-30 Thread Li Jin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950221#comment-15950221 ] Li Jin commented on SPARK-20144: Ping, anyone? This is a pretty big blocker for us. > spark.read.parquet

[jira] [Assigned] (SPARK-20166) Use XXX for ISO timezone instead of ZZ which is FastDateFormat specific in CSV/JSON time related options

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20166: Assignee: (was: Apache Spark) > Use XXX for ISO timezone instead of ZZ which is

[jira] [Commented] (SPARK-20166) Use XXX for ISO timezone instead of ZZ which is FastDateFormat specific in CSV/JSON time related options

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950219#comment-15950219 ] Apache Spark commented on SPARK-20166: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-20166) Use XXX for ISO timezone instead of ZZ which is FastDateFormat specific in CSV/JSON time related options

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20166: Assignee: Apache Spark > Use XXX for ISO timezone instead of ZZ which is FastDateFormat

[jira] [Resolved] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-20152. -- Resolution: Invalid I opened a JIRA for replacing {{ZZ}} to {{XXX}} - SPARK-20166. It seems

[jira] [Updated] (SPARK-20166) Use XXX for ISO timezone instead of ZZ which is FastDateFormat specific in CSV/JSON time related options

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-20166: - Description: We can use {{XXX}} format instead of {{ZZ}}. {{ZZ}} seems a {{FastDateFormat}}

[jira] [Created] (SPARK-20166) Use XXX for ISO timezone instead of ZZ which is FastDateFormat specific in CSV/JSON time related options

2017-03-30 Thread Hyukjin Kwon (JIRA)
Hyukjin Kwon created SPARK-20166: Summary: Use XXX for ISO timezone instead of ZZ which is FastDateFormat specific in CSV/JSON time related options Key: SPARK-20166 URL:

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950149#comment-15950149 ] Hyukjin Kwon edited comment on SPARK-20152 at 3/31/17 1:39 AM: --- I think the

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950149#comment-15950149 ] Hyukjin Kwon edited comment on SPARK-20152 at 3/31/17 1:38 AM: --- I think the

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950149#comment-15950149 ] Hyukjin Kwon edited comment on SPARK-20152 at 3/31/17 1:36 AM: --- I think the

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950149#comment-15950149 ] Hyukjin Kwon edited comment on SPARK-20152 at 3/31/17 1:34 AM: --- I think the

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950149#comment-15950149 ] Hyukjin Kwon commented on SPARK-20152: -- I think the correct usage is as below: {code} scala> new

[jira] [Assigned] (SPARK-20165) Resolve state encoder's deserializer in driver in FlatMapGroupsWithStateExec

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20165: Assignee: Tathagata Das (was: Apache Spark) > Resolve state encoder's deserializer in

[jira] [Assigned] (SPARK-20165) Resolve state encoder's deserializer in driver in FlatMapGroupsWithStateExec

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20165: Assignee: Apache Spark (was: Tathagata Das) > Resolve state encoder's deserializer in

[jira] [Commented] (SPARK-20165) Resolve state encoder's deserializer in driver in FlatMapGroupsWithStateExec

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950069#comment-15950069 ] Apache Spark commented on SPARK-20165: -- User 'tdas' has created a pull request for this issue:

[jira] [Updated] (SPARK-20165) Resolve state encoder's deserializer in driver in FlatMapGroupsWithStateExec

2017-03-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-20165: -- Summary: Resolve state encoder's deserializer in driver in FlatMapGroupsWithStateExec (was:

[jira] [Updated] (SPARK-20165) Resolved state encoder's deserializer in driver in FlatMapGroupsWithStateExec

2017-03-30 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-20165: -- Summary: Resolved state encoder's deserializer in driver in FlatMapGroupsWithStateExec (was:

[jira] [Created] (SPARK-20165) Resolved Encoder deserializer in driver

2017-03-30 Thread Tathagata Das (JIRA)
Tathagata Das created SPARK-20165: - Summary: Resolved Encoder deserializer in driver Key: SPARK-20165 URL: https://issues.apache.org/jira/browse/SPARK-20165 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19759) ALSModel.predict on Dataframes : potential optimization by not using blas

2017-03-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19759?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15950003#comment-15950003 ] holdenk commented on SPARK-19759: - How do people feel about targeting this for 2.3? > ALSModel.predict

[jira] [Commented] (SPARK-19690) Join a streaming DataFrame with a batch DataFrame may not work

2017-03-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949997#comment-15949997 ] holdenk commented on SPARK-19690: - I think reducing priority and re-targetting might be called for (as

[jira] [Assigned] (SPARK-19522) --executor-memory flag doesn't work in local-cluster mode

2017-03-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-19522: --- Assignee: Andrew Or (was: holdenk) > --executor-memory flag doesn't work in local-cluster mode >

[jira] [Assigned] (SPARK-19522) --executor-memory flag doesn't work in local-cluster mode

2017-03-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk reassigned SPARK-19522: --- Assignee: holdenk (was: Andrew Or) > --executor-memory flag doesn't work in local-cluster mode >

[jira] [Commented] (SPARK-14492) Spark SQL 1.6.0 does not work with Hive version lower than 1.2.0; its not backwards compatible with earlier version

2017-03-30 Thread Sunil Rangwani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949965#comment-15949965 ] Sunil Rangwani commented on SPARK-14492: Ok, I raised this a year ago and no longer have access

[jira] [Assigned] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20145: Assignee: Apache Spark > "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)"

[jira] [Commented] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949956#comment-15949956 ] Apache Spark commented on SPARK-20145: -- User 'samelamin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20145: Assignee: (was: Apache Spark) > "SELECT * FROM range(1)" works, but "SELECT * FROM

[jira] [Commented] (SPARK-20164) AnalysisException not tolerant of null query plan

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949849#comment-15949849 ] Apache Spark commented on SPARK-20164: -- User 'kunalkhamar' has created a pull request for this

[jira] [Assigned] (SPARK-20164) AnalysisException not tolerant of null query plan

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20164: Assignee: (was: Apache Spark) > AnalysisException not tolerant of null query plan >

[jira] [Assigned] (SPARK-20164) AnalysisException not tolerant of null query plan

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20164: Assignee: Apache Spark > AnalysisException not tolerant of null query plan >

[jira] [Created] (SPARK-20164) AnalysisException not tolerant of null query plan

2017-03-30 Thread Kunal Khamar (JIRA)
Kunal Khamar created SPARK-20164: Summary: AnalysisException not tolerant of null query plan Key: SPARK-20164 URL: https://issues.apache.org/jira/browse/SPARK-20164 Project: Spark Issue

[jira] [Commented] (SPARK-12818) Implement Bloom filter and count-min sketch in DataFrames

2017-03-30 Thread Dominic Ricard (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949828#comment-15949828 ] Dominic Ricard commented on SPARK-12818: [~lian cheng] Is there plan to extend support to SQL?

[jira] [Assigned] (SPARK-20163) Kill all running tasks in a stage in case of fetch failure

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20163: Assignee: Apache Spark > Kill all running tasks in a stage in case of fetch failure >

[jira] [Commented] (SPARK-20163) Kill all running tasks in a stage in case of fetch failure

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20163?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949767#comment-15949767 ] Apache Spark commented on SPARK-20163: -- User 'sitalkedia' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20163) Kill all running tasks in a stage in case of fetch failure

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20163: Assignee: (was: Apache Spark) > Kill all running tasks in a stage in case of fetch

[jira] [Created] (SPARK-20163) Kill all running tasks in a stage in case of fetch failure

2017-03-30 Thread Sital Kedia (JIRA)
Sital Kedia created SPARK-20163: --- Summary: Kill all running tasks in a stage in case of fetch failure Key: SPARK-20163 URL: https://issues.apache.org/jira/browse/SPARK-20163 Project: Spark

[jira] [Resolved] (SPARK-20121) simplify NullPropagation with NullIntolerant

2017-03-30 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-20121. - Resolution: Fixed Fix Version/s: 2.2.0 > simplify NullPropagation with NullIntolerant >

[jira] [Created] (SPARK-20162) Reading data from MySQL - Cannot up cast from decimal(30,6) to decimal(38,18)

2017-03-30 Thread Miroslav Spehar (JIRA)
Miroslav Spehar created SPARK-20162: --- Summary: Reading data from MySQL - Cannot up cast from decimal(30,6) to decimal(38,18) Key: SPARK-20162 URL: https://issues.apache.org/jira/browse/SPARK-20162

[jira] [Commented] (SPARK-20158) crash in Spark sql insert in partitioned hive tables

2017-03-30 Thread Paride Casulli (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949643#comment-15949643 ] Paride Casulli commented on SPARK-20158: Hi, our code uses spark streaming for copying rows from

[jira] [Commented] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread Bo Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949588#comment-15949588 ] Bo Meng commented on SPARK-20145: - You do not need to be assigned. Just go ahead provide your solution in

[jira] [Commented] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread sam elamin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949579#comment-15949579 ] sam elamin commented on SPARK-20145: Perfect. Can you assign it to me please? > "SELECT * FROM

[jira] [Updated] (SPARK-20161) Default spark/conf/log4j.properties.template should print thread-id in ConversionPattern

2017-03-30 Thread Sahil Takiar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahil Takiar updated SPARK-20161: - Description: The default log4j file in {{spark/conf/log4j.properties.template}} doesn't display

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949486#comment-15949486 ] Sean Owen commented on SPARK-20152: --- That does not seem to parse, not in Java/Scala even: {code} scala>

[jira] [Created] (SPARK-20161) Default spark/conf/log4j.properties.template should print thread-id in ConversionPattern

2017-03-30 Thread Sahil Takiar (JIRA)
Sahil Takiar created SPARK-20161: Summary: Default spark/conf/log4j.properties.template should print thread-id in ConversionPattern Key: SPARK-20161 URL: https://issues.apache.org/jira/browse/SPARK-20161

[jira] [Resolved] (SPARK-20154) In web ui,http://ip:4040/executors/,the title 'Storage Memory' should modify 'Storage Memory used/total'

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20154. --- Resolution: Not A Problem > In web ui,http://ip:4040/executors/,the title 'Storage Memory' should

[jira] [Assigned] (SPARK-20160) Move ParquetConversions and OrcConversions Out Of HiveSessionCatalog

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20160: Assignee: Xiao Li (was: Apache Spark) > Move ParquetConversions and OrcConversions Out

[jira] [Commented] (SPARK-20160) Move ParquetConversions and OrcConversions Out Of HiveSessionCatalog

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949457#comment-15949457 ] Apache Spark commented on SPARK-20160: -- User 'gatorsmile' has created a pull request for this issue:

[jira] [Assigned] (SPARK-20160) Move ParquetConversions and OrcConversions Out Of HiveSessionCatalog

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20160: Assignee: Apache Spark (was: Xiao Li) > Move ParquetConversions and OrcConversions Out

[jira] [Created] (SPARK-20160) Move ParquetConversions and OrcConversions Out Of HiveSessionCatalog

2017-03-30 Thread Xiao Li (JIRA)
Xiao Li created SPARK-20160: --- Summary: Move ParquetConversions and OrcConversions Out Of HiveSessionCatalog Key: SPARK-20160 URL: https://issues.apache.org/jira/browse/SPARK-20160 Project: Spark

[jira] [Commented] (SPARK-15142) Spark Mesos dispatcher becomes unusable when the Mesos master restarts

2017-03-30 Thread Jared (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949450#comment-15949450 ] Jared commented on SPARK-15142: --- [~devaraj.k] are you still working on this problem? It seemed that

[jira] [Commented] (SPARK-20145) "SELECT * FROM range(1)" works, but "SELECT * FROM RANGE(1)" doesn't

2017-03-30 Thread Juliusz Sompolski (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20145?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949429#comment-15949429 ] Juliusz Sompolski commented on SPARK-20145: --- [~samelamin] sure, go ahead :-). > "SELECT * FROM

[jira] [Commented] (SPARK-20133) User guide for spark.ml.stat.ChiSquareTest

2017-03-30 Thread Benjamin Fradet (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949418#comment-15949418 ] Benjamin Fradet commented on SPARK-20133: - Can I take this one? > User guide for

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Navya Krishnappa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949399#comment-15949399 ] Navya Krishnappa edited comment on SPARK-20152 at 3/30/17 4:53 PM: --- But

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Navya Krishnappa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949399#comment-15949399 ] Navya Krishnappa commented on SPARK-20152: -- But if we specify timestampformat:

[jira] [Comment Edited] (SPARK-20158) crash in Spark sql insert in partitioned hive tables

2017-03-30 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949364#comment-15949364 ] Kazuaki Ishizaki edited comment on SPARK-20158 at 3/30/17 4:35 PM: ---

[jira] [Commented] (SPARK-20158) crash in Spark sql insert in partitioned hive tables

2017-03-30 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949364#comment-15949364 ] Kazuaki Ishizaki commented on SPARK-20158: -- What program did you run? > crash in Spark sql

[jira] [Comment Edited] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-03-30 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949359#comment-15949359 ] Kazuaki Ishizaki edited comment on SPARK-19984 at 3/30/17 4:33 PM: ---

[jira] [Commented] (SPARK-19984) ERROR codegen.CodeGenerator: failed to compile: org.codehaus.commons.compiler.CompileException: File 'generated.java'

2017-03-30 Thread Kazuaki Ishizaki (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949359#comment-15949359 ] Kazuaki Ishizaki commented on SPARK-19984: -- While I tried a reproducable program, I have not

[jira] [Assigned] (SPARK-20159) Support complete Catalog API in R

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20159: Assignee: Apache Spark (was: Felix Cheung) > Support complete Catalog API in R >

[jira] [Assigned] (SPARK-20159) Support complete Catalog API in R

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20159: Assignee: Felix Cheung (was: Apache Spark) > Support complete Catalog API in R >

[jira] [Commented] (SPARK-20159) Support complete Catalog API in R

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949350#comment-15949350 ] Apache Spark commented on SPARK-20159: -- User 'felixcheung' has created a pull request for this

[jira] [Commented] (SPARK-9002) KryoSerializer initialization does not include 'Array[Int]'

2017-03-30 Thread Denis Bolshakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949343#comment-15949343 ] Denis Bolshakov commented on SPARK-9002: [~rake], [~BenFradet] Folks, could you please review pull

[jira] [Updated] (SPARK-20159) Support complete Catalog API in R

2017-03-30 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-20159: - Summary: Support complete Catalog API in R (was: Complete Catalog API in R) > Support complete

[jira] [Created] (SPARK-20159) Complete Catalog API in R

2017-03-30 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-20159: Summary: Complete Catalog API in R Key: SPARK-20159 URL: https://issues.apache.org/jira/browse/SPARK-20159 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-9002) KryoSerializer initialization does not include 'Array[Int]'

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949334#comment-15949334 ] Apache Spark commented on SPARK-9002: - User 'dbolshak' has created a pull request for this issue:

[jira] [Assigned] (SPARK-9002) KryoSerializer initialization does not include 'Array[Int]'

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9002: --- Assignee: (was: Apache Spark) > KryoSerializer initialization does not include

[jira] [Assigned] (SPARK-9002) KryoSerializer initialization does not include 'Array[Int]'

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9002: --- Assignee: Apache Spark > KryoSerializer initialization does not include 'Array[Int]' >

[jira] [Issue Comment Deleted] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-03-30 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] guoxiaolongzte updated SPARK-20157: --- Comment: was deleted (was: Help to review the code, thank you) > In the menu ‘Storage’in

[jira] [Assigned] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20157: Assignee: (was: Apache Spark) > In the menu ‘Storage’in Web UI, click the Go button,

[jira] [Commented] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949295#comment-15949295 ] Apache Spark commented on SPARK-20157: -- User 'guoxiaolongzte' has created a pull request for this

[jira] [Assigned] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20157: Assignee: Apache Spark > In the menu ‘Storage’in Web UI, click the Go button, and shows

[jira] [Commented] (SPARK-20127) Minor code cleanup

2017-03-30 Thread Denis Bolshakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949284#comment-15949284 ] Denis Bolshakov commented on SPARK-20127: - [~srowen] thanks for driving me. A lot of motivation!

[jira] [Resolved] (SPARK-20127) Minor code cleanup

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20127. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17458

[jira] [Assigned] (SPARK-20127) Minor code cleanup

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20127: - Assignee: Denis Bolshakov > Minor code cleanup > -- > > Key:

[jira] [Resolved] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-20096. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17430

[jira] [Assigned] (SPARK-19999) Test failures in Spark Core due to java.nio.Bits.unaligned()

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-1: - Assignee: Sonia Garudi > Test failures in Spark Core due to java.nio.Bits.unaligned() >

[jira] [Assigned] (SPARK-20096) Expose the real queue name not null while using --verbose

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-20096: - Assignee: Kent Yao > Expose the real queue name not null while using --verbose >

[jira] [Resolved] (SPARK-19999) Test failures in Spark Core due to java.nio.Bits.unaligned()

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-1. --- Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 17472

[jira] [Assigned] (SPARK-20079) Re registration of AM hangs spark cluster in yarn-client mode

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20079: Assignee: Apache Spark > Re registration of AM hangs spark cluster in yarn-client mode >

[jira] [Assigned] (SPARK-20079) Re registration of AM hangs spark cluster in yarn-client mode

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-20079: Assignee: (was: Apache Spark) > Re registration of AM hangs spark cluster in

[jira] [Commented] (SPARK-20079) Re registration of AM hangs spark cluster in yarn-client mode

2017-03-30 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949180#comment-15949180 ] Apache Spark commented on SPARK-20079: -- User 'witgo' has created a pull request for this issue:

[jira] [Commented] (SPARK-20079) Re registration of AM hangs spark cluster in yarn-client mode

2017-03-30 Thread Guoqiang Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949164#comment-15949164 ] Guoqiang Li commented on SPARK-20079: - I met the problem when doing reliability test. After the

[jira] [Assigned] (SPARK-15354) Topology aware block replication strategies

2017-03-30 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-15354: --- Assignee: Shubham Chopra > Topology aware block replication strategies >

[jira] [Commented] (SPARK-11083) insert overwrite table failed when beeline reconnect

2017-03-30 Thread chenerlu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11083?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949153#comment-15949153 ] chenerlu commented on SPARK-11083: -- yes, in spark 2.x, we have reproduced this issue, but it is not

[jira] [Resolved] (SPARK-15354) Topology aware block replication strategies

2017-03-30 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-15354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-15354. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 13932

[jira] [Created] (SPARK-20158) crash in Spark sql insert in partitioned hive tables

2017-03-30 Thread Paride Casulli (JIRA)
Paride Casulli created SPARK-20158: -- Summary: crash in Spark sql insert in partitioned hive tables Key: SPARK-20158 URL: https://issues.apache.org/jira/browse/SPARK-20158 Project: Spark

[jira] [Commented] (SPARK-20157) In the menu ‘Storage’in Web UI, click the Go button, and shows no paging menu interface.

2017-03-30 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949117#comment-15949117 ] guoxiaolongzte commented on SPARK-20157: Help to review the code, thank you > In the menu

[jira] [Commented] (SPARK-19511) insert into table does not work on second session of beeline

2017-03-30 Thread chenerlu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19511?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949116#comment-15949116 ] chenerlu commented on SPARK-19511: -- Still, we have same problem on spark 2.x, but sometimes it accur,

[jira] [Commented] (SPARK-20137) In Spark1.5 I can 'cache table as select' for many times. In Spark2.1 it will show error TempTableAlreadyExistsException

2017-03-30 Thread guoxiaolongzte (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949107#comment-15949107 ] guoxiaolongzte commented on SPARK-20137: I also want to know why, thank you. > In Spark1.5 I can

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15949028#comment-15949028 ] Sean Owen commented on SPARK-20152: --- Ah OK the format is OK, it just means the timezone must be in

[jira] [Comment Edited] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Navya Krishnappa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948989#comment-15948989 ] Navya Krishnappa edited comment on SPARK-20152 at 3/30/17 12:48 PM:

[jira] [Commented] (SPARK-20152) Time zone is not respected while parsing csv for timeStampFormat "MM-dd-yyyy'T'HH:mm:ss.SSSZZ"

2017-03-30 Thread Navya Krishnappa (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-20152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15948989#comment-15948989 ] Navya Krishnappa commented on SPARK-20152: -- According to the spark "-MM-dd'T'HH:mm:ss.SSSZZ"

  1   2   >