[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511714#comment-15511714 ] Apache Spark commented on SPARK-14536: -- User 'sureshthalamati' has created a pull request for this

[jira] [Comment Edited] (SPARK-8500) Support for array types in JDBCRDD

2016-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511840#comment-15511840 ] Hyukjin Kwon edited comment on SPARK-8500 at 9/22/16 2:04 AM: -- I am leaving a

[jira] [Resolved] (SPARK-17494) Floor/ceil of decimal returns wrong result if it's in compact format

2016-09-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17494. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Floor/ceil of decimal

[jira] [Assigned] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14536: Assignee: Apache Spark > NPE in JDBCRDD when array column contains nulls (postgresql) >

[jira] [Assigned] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14536: Assignee: (was: Apache Spark) > NPE in JDBCRDD when array column contains nulls

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-09-21 Thread Gary Gregory (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511730#comment-15511730 ] Gary Gregory commented on SPARK-6305: - Hi, My name is Gary Gregory ([~garydgregory]) and I am also a

[jira] [Resolved] (SPARK-17627) Streaming Providers should be labeled Experimental

2016-09-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17627. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Streaming Providers

[jira] [Commented] (SPARK-14709) spark.ml API for linear SVM

2016-09-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512085#comment-15512085 ] Yanbo Liang commented on SPARK-14709: - [~yuhaoyan] Any update about this? I think providing

[jira] [Commented] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511467#comment-15511467 ] Apache Spark commented on SPARK-17620: -- User 'dilipbiswal' has created a pull request for this

[jira] [Assigned] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17620: Assignee: Apache Spark > hive.default.fileformat=orc does not set OrcSerde >

[jira] [Assigned] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17620: Assignee: (was: Apache Spark) > hive.default.fileformat=orc does not set OrcSerde >

[jira] [Resolved] (SPARK-17577) SparkR support add files to Spark job and get by executors

2016-09-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-17577. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.1.0 > SparkR support

[jira] [Created] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

2016-09-21 Thread Xin Ren (JIRA)
Xin Ren created SPARK-17628: --- Summary: Name of "object StreamingExamples" should be more self-explanatory Key: SPARK-17628 URL: https://issues.apache.org/jira/browse/SPARK-17628 Project: Spark

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

2016-09-21 Thread kui xiang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511989#comment-15511989 ] kui xiang commented on SPARK-13928: --- just copy the org.apache.spark.internal.Logging into your project

[jira] [Resolved] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

2016-09-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17569. -- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.1.0 > Don't recheck

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

2016-09-21 Thread Charles Allen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511767#comment-15511767 ] Charles Allen commented on SPARK-6305: -- Just FYI, as I found out recently, kafka (at least 8.x)

[jira] [Created] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

2016-09-21 Thread Asher Krim (JIRA)
Asher Krim created SPARK-17629: -- Summary: Should ml Word2Vec findSynonyms match the mllib implementation? Key: SPARK-17629 URL: https://issues.apache.org/jira/browse/SPARK-17629 Project: Spark

[jira] [Updated] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

2016-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17622: -- Target Version/s: (was: 2.0.0) Fix Version/s: (was: 1.6.2) (was:

[jira] [Commented] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

2016-09-21 Thread renzhi he (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512050#comment-15512050 ] renzhi he commented on SPARK-17622: --- Hi Sean, Sorry, I just stepped into this field. For this "bug",

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511459#comment-15511459 ] Apache Spark commented on SPARK-17549: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17628: Assignee: (was: Apache Spark) > Name of "object StreamingExamples" should be more

[jira] [Commented] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511650#comment-15511650 ] Apache Spark commented on SPARK-17628: -- User 'keypointt' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-14709) spark.ml API for linear SVM

2016-09-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512085#comment-15512085 ] Yanbo Liang edited comment on SPARK-14709 at 9/22/16 4:27 AM: -- [~yuhaoyan]

[jira] [Commented] (SPARK-17134) Use level 2 BLAS operations in LogisticAggregator

2016-09-21 Thread DB Tsai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509053#comment-15509053 ] DB Tsai commented on SPARK-17134: - I'm benchmarking MLOR with 22533 of classes, and dense feature of 100.

[jira] [Assigned] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17610: Assignee: (was: Apache Spark) > The failed stage caused by FetchFailed may never be

[jira] [Commented] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509082#comment-15509082 ] Apache Spark commented on SPARK-17610: -- User 'WangTaoTheTonic' has created a pull request for this

[jira] [Assigned] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17610: Assignee: Apache Spark > The failed stage caused by FetchFailed may never be resubmitted

[jira] [Created] (SPARK-17621) Accumulator value is doubled when using DataFrame.orderBy()

2016-09-21 Thread Sreelal S L (JIRA)
Sreelal S L created SPARK-17621: --- Summary: Accumulator value is doubled when using DataFrame.orderBy() Key: SPARK-17621 URL: https://issues.apache.org/jira/browse/SPARK-17621 Project: Spark

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509110#comment-15509110 ] Hyukjin Kwon commented on SPARK-17545: -- Yes. This is because we introduced {{FastDateFormat}} there

[jira] [Resolved] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17545. --- Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-13331) AES support for over-the-wire encryption

2016-09-21 Thread Lifeng Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509140#comment-15509140 ] Lifeng Wang commented on SPARK-13331: - We use TPCx-BB\[1\] to evaluate this performance feature. We

[jira] [Commented] (SPARK-17596) Streaming job lacks Scala runtime methods

2016-09-21 Thread Evgeniy Tsvigun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509146#comment-15509146 ] Evgeniy Tsvigun commented on SPARK-17596: - Thanks for the hint. I did include scala-library in

[jira] [Comment Edited] (SPARK-17596) Streaming job lacks Scala runtime methods

2016-09-21 Thread Evgeniy Tsvigun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509146#comment-15509146 ] Evgeniy Tsvigun edited comment on SPARK-17596 at 9/21/16 8:07 AM: --

[jira] [Comment Edited] (SPARK-17596) Streaming job lacks Scala runtime methods

2016-09-21 Thread Evgeniy Tsvigun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509146#comment-15509146 ] Evgeniy Tsvigun edited comment on SPARK-17596 at 9/21/16 8:09 AM: --

[jira] [Commented] (SPARK-17596) Streaming job lacks Scala runtime methods

2016-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509164#comment-15509164 ] Sean Owen commented on SPARK-17596: --- It's going to be a build issue one way or the other.

[jira] [Commented] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

2016-09-21 Thread Graeme Edwards (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511443#comment-15511443 ] Graeme Edwards commented on SPARK-17618: Thanks Josh, that perfectly explains what we saw. Thanks

[jira] [Commented] (SPARK-8500) Support for array types in JDBCRDD

2016-09-21 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511840#comment-15511840 ] Hyukjin Kwon commented on SPARK-8500: - I am leaving a note that PostgreSQL is supporting {{ArrayType}}

[jira] [Commented] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511386#comment-15511386 ] Apache Spark commented on SPARK-17616: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Updated] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17616: --- Assignee: Herman van Hovell > Getting "java.lang.RuntimeException: Distinct columns cannot exist in

[jira] [Updated] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17616: --- Target Version/s: 2.0.1 > Getting "java.lang.RuntimeException: Distinct columns cannot exist in >

[jira] [Resolved] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17615. Resolution: Duplicate > Getting "java.lang.RuntimeException: Distinct columns cannot exist in >

[jira] [Created] (SPARK-17627) Streaming Providers should be labeled Experimental

2016-09-21 Thread Michael Armbrust (JIRA)
Michael Armbrust created SPARK-17627: Summary: Streaming Providers should be labeled Experimental Key: SPARK-17627 URL: https://issues.apache.org/jira/browse/SPARK-17627 Project: Spark

[jira] [Reopened] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-17616: > Getting "java.lang.RuntimeException: Distinct columns cannot exist in > Aggregate " >

[jira] [Updated] (SPARK-17627) Streaming Providers should be labeled Experimental

2016-09-21 Thread Michael Armbrust (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-17627: - Component/s: SQL > Streaming Providers should be labeled Experimental >

[jira] [Updated] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17616: --- Target Version/s: 2.0.1, 2.1.0 (was: 2.0.1) > Getting "java.lang.RuntimeException: Distinct columns

[jira] [Assigned] (SPARK-17627) Streaming Providers should be labeled Experimental

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17627: Assignee: Michael Armbrust (was: Apache Spark) > Streaming Providers should be labeled

[jira] [Commented] (SPARK-17627) Streaming Providers should be labeled Experimental

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511420#comment-15511420 ] Apache Spark commented on SPARK-17627: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17627) Streaming Providers should be labeled Experimental

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17627: Assignee: Apache Spark (was: Michael Armbrust) > Streaming Providers should be labeled

[jira] [Commented] (SPARK-14709) spark.ml API for linear SVM

2016-09-21 Thread yuhao yang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512158#comment-15512158 ] yuhao yang commented on SPARK-14709: Thanks [~yanboliang] for picking this up. I'll try to send a PR

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

2016-09-21 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Description: Hi, I have 2 code-paths from my app that result in a jvm OOM. In the first code

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

2016-09-21 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Attachment: SecondCodePath.txt > jvm-exit-on-fatal-error for spark.rpc.netty like there is

[jira] [Resolved] (SPARK-17609) SessionCatalog.tableExists should not check temp view

2016-09-21 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17609. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15160

[jira] [Commented] (SPARK-17624) Flaky test? StateStoreSuite maintenance

2016-09-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512237#comment-15512237 ] Saisai Shao commented on SPARK-17624: - I cannot reproduce locally on my > Flaky test?

[jira] [Comment Edited] (SPARK-17624) Flaky test? StateStoreSuite maintenance

2016-09-21 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512237#comment-15512237 ] Saisai Shao edited comment on SPARK-17624 at 9/22/16 5:36 AM: -- I cannot

[jira] [Resolved] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReuseExchange work in text format table

2016-09-21 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17425. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14988

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReuseExchange work in text format table

2016-09-21 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17425: Assignee: Yadong Qi > Override sameResult in HiveTableScanExec to make ReuseExchange work in text

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

2016-09-21 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Description: Hi, I have 2 code-paths from my app that result in a jvm OOM. In the first code

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

2016-09-21 Thread Mario Briggs (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Attachment: firstCodepath.txt > jvm-exit-on-fatal-error for spark.rpc.netty like there is

[jira] [Created] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

2016-09-21 Thread Mario Briggs (JIRA)
Mario Briggs created SPARK-17630: Summary: jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka Key: SPARK-17630 URL: https://issues.apache.org/jira/browse/SPARK-17630

[jira] [Resolved] (SPARK-17492) Reading Cataloged Data Sources without Extending SchemaRelationProvider

2016-09-21 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17492. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15046

[jira] [Updated] (SPARK-17492) Reading Cataloged Data Sources without Extending SchemaRelationProvider

2016-09-21 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17492: Assignee: Xiao Li > Reading Cataloged Data Sources without Extending SchemaRelationProvider >

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

2016-09-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508996#comment-15508996 ] Yanbo Liang commented on SPARK-11918: - Cholesky decomposition is unstable (for near-singular and rank

[jira] [Commented] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

2016-09-21 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509001#comment-15509001 ] Yanbo Liang commented on SPARK-17588: - [~sowen] See my comments at SPARK-11918. Thanks. >

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

2016-09-21 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15509040#comment-15509040 ] Sean Owen commented on SPARK-17545: --- You are saying you believe this also resolved by

[jira] [Updated] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

2016-09-21 Thread Tao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17610: - Description: We have a problem in our environment, in which the failed stage has not been resubmitted

[jira] [Updated] (SPARK-17619) To add support for pattern matching in ArrayContains Expression.

2016-09-21 Thread Priyanka Garg (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Priyanka Garg updated SPARK-17619: -- Target Version/s: (was: 2.2.0) Fix Version/s: (was: 2.2.0) > To add support for

[jira] [Created] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

2016-09-21 Thread Brian Cho (JIRA)
Brian Cho created SPARK-17620: - Summary: hive.default.fileformat=orc does not set OrcSerde Key: SPARK-17620 URL: https://issues.apache.org/jira/browse/SPARK-17620 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-17452) Spark 2.0.0 is not supporting the "partition" keyword on a "describe" statement when using Hive Support

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17452: --- Component/s: (was: Build) SQL > Spark 2.0.0 is not supporting the "partition"

[jira] [Reopened] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-17485: Re-opening so I can backport to branch-1.6. > Failed remote cached block reads can lead to whole job

[jira] [Assigned] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17485: Assignee: Apache Spark (was: Josh Rosen) > Failed remote cached block reads can lead to

[jira] [Commented] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

2016-09-21 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511244#comment-15511244 ] Apache Spark commented on SPARK-17485: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

2016-09-21 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511251#comment-15511251 ] Reynold Xin commented on SPARK-17592: - What does other databases do, e.g. SQL server, Oracle? >

[jira] [Commented] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

2016-09-21 Thread Dilip Biswal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511267#comment-15511267 ] Dilip Biswal commented on SPARK-17620: -- fix it now. Thanks! > hive.default.fileformat=orc does not

[jira] [Resolved] (SPARK-14235) All downloads of spark .tgz archives seem to be corrupt

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14235. Resolution: Fixed I believe that this is now resolved, but please re-open if this is still an

[jira] [Commented] (SPARK-14209) Application failure during preemption.

2016-09-21 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511187#comment-15511187 ] Josh Rosen commented on SPARK-14209: I believe that this issue should have been fixed by SPARK-17485

[jira] [Resolved] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

2016-09-21 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4563. - Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 > Allow spark

[jira] [Resolved] (SPARK-17623) Failed tasks end reason is always a TaskFailedReason, types should reflect this

2016-09-21 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-17623. --- Resolution: Fixed Fix Version/s: 2.1.0 > Failed tasks end reason is always a

<    1   2