[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Description: Hi, I have 2 code-paths from my app that result in a jvm OOM. In the first code

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Attachment: SecondCodePath.txt > jvm-exit-on-fatal-error for spark.rpc.netty like there is

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Attachment: firstCodepath.txt > jvm-exit-on-fatal-error for spark.rpc.netty like there is

[jira] [Updated] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

[ https://issues.apache.org/jira/browse/SPARK-17630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mario Briggs updated SPARK-17630: - Description: Hi, I have 2 code-paths from my app that result in a jvm OOM. In the first code

[jira] [Created] (SPARK-17630) jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka

Mario Briggs created SPARK-17630: Summary: jvm-exit-on-fatal-error for spark.rpc.netty like there is available for akka Key: SPARK-17630 URL: https://issues.apache.org/jira/browse/SPARK-17630

[jira] [Comment Edited] (SPARK-17624) Flaky test? StateStoreSuite maintenance

[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512237#comment-15512237 ] Saisai Shao edited comment on SPARK-17624 at 9/22/16 5:36 AM: -- I cannot

[jira] [Commented] (SPARK-17624) Flaky test? StateStoreSuite maintenance

[ https://issues.apache.org/jira/browse/SPARK-17624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512237#comment-15512237 ] Saisai Shao commented on SPARK-17624: - I cannot reproduce locally on my > Flaky test?

[jira] [Resolved] (SPARK-17492) Reading Cataloged Data Sources without Extending SchemaRelationProvider

[ https://issues.apache.org/jira/browse/SPARK-17492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17492. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15046

[jira] [Updated] (SPARK-17492) Reading Cataloged Data Sources without Extending SchemaRelationProvider

[ https://issues.apache.org/jira/browse/SPARK-17492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17492: Assignee: Xiao Li > Reading Cataloged Data Sources without Extending SchemaRelationProvider >

[jira] [Updated] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReuseExchange work in text format table

[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-17425: Assignee: Yadong Qi > Override sameResult in HiveTableScanExec to make ReuseExchange work in text

[jira] [Resolved] (SPARK-17425) Override sameResult in HiveTableScanExec to make ReuseExchange work in text format table

[ https://issues.apache.org/jira/browse/SPARK-17425?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17425. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 14988

[jira] [Commented] (SPARK-14709) spark.ml API for linear SVM

[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512158#comment-15512158 ] yuhao yang commented on SPARK-14709: Thanks [~yanboliang] for picking this up. I'll try to send a PR

[jira] [Resolved] (SPARK-17609) SessionCatalog.tableExists should not check temp view

[ https://issues.apache.org/jira/browse/SPARK-17609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17609. - Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15160

[jira] [Comment Edited] (SPARK-14709) spark.ml API for linear SVM

[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512085#comment-15512085 ] Yanbo Liang edited comment on SPARK-14709 at 9/22/16 4:27 AM: -- [~yuhaoyan]

[jira] [Commented] (SPARK-14709) spark.ml API for linear SVM

[ https://issues.apache.org/jira/browse/SPARK-14709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512085#comment-15512085 ] Yanbo Liang commented on SPARK-14709: - [~yuhaoyan] Any update about this? I think providing

[jira] [Commented] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15512050#comment-15512050 ] renzhi he commented on SPARK-17622: --- Hi Sean, Sorry, I just stepped into this field. For this "bug",

[jira] [Resolved] (SPARK-17494) Floor/ceil of decimal returns wrong result if it's in compact format

[ https://issues.apache.org/jira/browse/SPARK-17494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17494. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Floor/ceil of decimal

[jira] [Resolved] (SPARK-17627) Streaming Providers should be labeled Experimental

[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-17627. - Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 > Streaming Providers

[jira] [Updated] (SPARK-17622) Cannot run create or load DF on Windows- Spark 2.0.0

[ https://issues.apache.org/jira/browse/SPARK-17622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17622: -- Target Version/s: (was: 2.0.0) Fix Version/s: (was: 1.6.2) (was:

[jira] [Commented] (SPARK-13928) Move org.apache.spark.Logging into org.apache.spark.internal.Logging

[ https://issues.apache.org/jira/browse/SPARK-13928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511989#comment-15511989 ] kui xiang commented on SPARK-13928: --- just copy the org.apache.spark.internal.Logging into your project

[jira] [Resolved] (SPARK-17577) SparkR support add files to Spark job and get by executors

[ https://issues.apache.org/jira/browse/SPARK-17577?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-17577. - Resolution: Fixed Assignee: Yanbo Liang Fix Version/s: 2.1.0 > SparkR support

[jira] [Comment Edited] (SPARK-8500) Support for array types in JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511840#comment-15511840 ] Hyukjin Kwon edited comment on SPARK-8500 at 9/22/16 2:04 AM: -- I am leaving a

[jira] [Commented] (SPARK-8500) Support for array types in JDBCRDD

[ https://issues.apache.org/jira/browse/SPARK-8500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511840#comment-15511840 ] Hyukjin Kwon commented on SPARK-8500: - I am leaving a note that PostgreSQL is supporting {{ArrayType}}

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511837#comment-15511837 ] Hyukjin Kwon commented on SPARK-14536: -- I see. I rushed to read this and didn't noticed that this is

[jira] [Created] (SPARK-17629) Should ml Word2Vec findSynonyms match the mllib implementation?

Asher Krim created SPARK-17629: -- Summary: Should ml Word2Vec findSynonyms match the mllib implementation? Key: SPARK-17629 URL: https://issues.apache.org/jira/browse/SPARK-17629 Project: Spark

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511767#comment-15511767 ] Charles Allen commented on SPARK-6305: -- Just FYI, as I found out recently, kafka (at least 8.x)

[jira] [Assigned] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14536: Assignee: Apache Spark > NPE in JDBCRDD when array column contains nulls (postgresql) >

[jira] [Assigned] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14536: Assignee: (was: Apache Spark) > NPE in JDBCRDD when array column contains nulls

[jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark

[ https://issues.apache.org/jira/browse/SPARK-6305?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511730#comment-15511730 ] Gary Gregory commented on SPARK-6305: - Hi, My name is Gary Gregory ([~garydgregory]) and I am also a

[jira] [Commented] (SPARK-15717) Cannot perform RDD operations on a checkpointed VertexRDD.

[ https://issues.apache.org/jira/browse/SPARK-15717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511727#comment-15511727 ] Asher Krim commented on SPARK-15717: Any update on this issue? We are experiencing

[jira] [Reopened] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Thalamati reopened SPARK-14536: -- SPARK-10186 added array data type support for postgres in 1.6. NPE issues still

[jira] [Commented] (SPARK-14536) NPE in JDBCRDD when array column contains nulls (postgresql)

[ https://issues.apache.org/jira/browse/SPARK-14536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511714#comment-15511714 ] Apache Spark commented on SPARK-14536: -- User 'sureshthalamati' has created a pull request for this

[jira] [Assigned] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17616: Assignee: Herman van Hovell (was: Apache Spark) > Getting "java.lang.RuntimeException:

[jira] [Assigned] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17616: Assignee: Apache Spark (was: Herman van Hovell) > Getting "java.lang.RuntimeException:

[jira] [Assigned] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

[ https://issues.apache.org/jira/browse/SPARK-17628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17628: Assignee: Apache Spark > Name of "object StreamingExamples" should be more

[jira] [Assigned] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

[ https://issues.apache.org/jira/browse/SPARK-17628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17628: Assignee: (was: Apache Spark) > Name of "object StreamingExamples" should be more

[jira] [Commented] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

[ https://issues.apache.org/jira/browse/SPARK-17628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511650#comment-15511650 ] Apache Spark commented on SPARK-17628: -- User 'keypointt' has created a pull request for this issue:

[jira] [Created] (SPARK-17628) Name of "object StreamingExamples" should be more self-explanatory

Xin Ren created SPARK-17628: --- Summary: Name of "object StreamingExamples" should be more self-explanatory Key: SPARK-17628 URL: https://issues.apache.org/jira/browse/SPARK-17628 Project: Spark

[jira] [Resolved] (SPARK-17569) Don't recheck existence of files when generating File Relation resolution in StructuredStreaming

[ https://issues.apache.org/jira/browse/SPARK-17569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-17569. -- Resolution: Fixed Assignee: Burak Yavuz Fix Version/s: 2.1.0 > Don't recheck

[jira] [Assigned] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17620: Assignee: Apache Spark > hive.default.fileformat=orc does not set OrcSerde >

[jira] [Assigned] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17620: Assignee: (was: Apache Spark) > hive.default.fileformat=orc does not set OrcSerde >

[jira] [Commented] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511467#comment-15511467 ] Apache Spark commented on SPARK-17620: -- User 'dilipbiswal' has created a pull request for this

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511459#comment-15511459 ] Apache Spark commented on SPARK-17549: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511443#comment-15511443 ] Graeme Edwards commented on SPARK-17618: Thanks Josh, that perfectly explains what we saw. Thanks

[jira] [Assigned] (SPARK-17627) Streaming Providers should be labeled Experimental

[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17627: Assignee: Apache Spark (was: Michael Armbrust) > Streaming Providers should be labeled

[jira] [Assigned] (SPARK-17627) Streaming Providers should be labeled Experimental

[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17627: Assignee: Michael Armbrust (was: Apache Spark) > Streaming Providers should be labeled

[jira] [Commented] (SPARK-17627) Streaming Providers should be labeled Experimental

[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511420#comment-15511420 ] Apache Spark commented on SPARK-17627: -- User 'marmbrus' has created a pull request for this issue:

[jira] [Reopened] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-17616: > Getting "java.lang.RuntimeException: Distinct columns cannot exist in > Aggregate " >

[jira] [Updated] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17616: --- Assignee: Herman van Hovell > Getting "java.lang.RuntimeException: Distinct columns cannot exist in

[jira] [Updated] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17616: --- Target Version/s: 2.0.1 > Getting "java.lang.RuntimeException: Distinct columns cannot exist in >

[jira] [Resolved] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17615. Resolution: Duplicate > Getting "java.lang.RuntimeException: Distinct columns cannot exist in >

[jira] [Created] (SPARK-17627) Streaming Providers should be labeled Experimental

Michael Armbrust created SPARK-17627: Summary: Streaming Providers should be labeled Experimental Key: SPARK-17627 URL: https://issues.apache.org/jira/browse/SPARK-17627 Project: Spark

[jira] [Updated] (SPARK-17627) Streaming Providers should be labeled Experimental

[ https://issues.apache.org/jira/browse/SPARK-17627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-17627: - Component/s: SQL > Streaming Providers should be labeled Experimental >

[jira] [Updated] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17616: --- Target Version/s: 2.0.1, 2.1.0 (was: 2.0.1) > Getting "java.lang.RuntimeException: Distinct columns

[jira] [Commented] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511386#comment-15511386 ] Apache Spark commented on SPARK-17616: -- User 'hvanhovell' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17623) Failed tasks end reason is always a TaskFailedReason, types should reflect this

[ https://issues.apache.org/jira/browse/SPARK-17623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-17623. --- Resolution: Fixed Fix Version/s: 2.1.0 > Failed tasks end reason is always a

[jira] [Resolved] (SPARK-4563) Allow spark driver to bind to different ip then advertise ip

[ https://issues.apache.org/jira/browse/SPARK-4563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-4563. - Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 > Allow spark

[jira] [Commented] (SPARK-17620) hive.default.fileformat=orc does not set OrcSerde

[ https://issues.apache.org/jira/browse/SPARK-17620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511267#comment-15511267 ] Dilip Biswal commented on SPARK-17620: -- fix it now. Thanks! > hive.default.fileformat=orc does not

[jira] [Commented] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511251#comment-15511251 ] Reynold Xin commented on SPARK-17592: - What does other databases do, e.g. SQL server, Oracle? >

[jira] [Assigned] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17485: Assignee: Apache Spark (was: Josh Rosen) > Failed remote cached block reads can lead to

[jira] [Commented] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511244#comment-15511244 ] Apache Spark commented on SPARK-17485: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Reopened] (SPARK-17485) Failed remote cached block reads can lead to whole job failure

[ https://issues.apache.org/jira/browse/SPARK-17485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reopened SPARK-17485: Re-opening so I can backport to branch-1.6. > Failed remote cached block reads can lead to whole job

[jira] [Commented] (SPARK-14209) Application failure during preemption.

[ https://issues.apache.org/jira/browse/SPARK-14209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511187#comment-15511187 ] Josh Rosen commented on SPARK-14209: I believe that this issue should have been fixed by SPARK-17485

[jira] [Updated] (SPARK-17452) Spark 2.0.0 is not supporting the "partition" keyword on a "describe" statement when using Hive Support

[ https://issues.apache.org/jira/browse/SPARK-17452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17452: --- Component/s: (was: Build) SQL > Spark 2.0.0 is not supporting the "partition"

[jira] [Resolved] (SPARK-14235) All downloads of spark .tgz archives seem to be corrupt

[ https://issues.apache.org/jira/browse/SPARK-14235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-14235. Resolution: Fixed I believe that this is now resolved, but please re-open if this is still an

[jira] [Assigned] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-17618: -- Assignee: Josh Rosen > Dataframe except returns incorrect results when combined with coalesce

[jira] [Assigned] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17618: Assignee: Josh Rosen (was: Apache Spark) > Dataframe except returns incorrect results

[jira] [Assigned] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17618: Assignee: Apache Spark (was: Josh Rosen) > Dataframe except returns incorrect results

[jira] [Commented] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15511034#comment-15511034 ] Apache Spark commented on SPARK-17618: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Updated] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17592: Labels: (was: correctness) > SQL: CAST string as INT inconsistent with Hive >

[jira] [Updated] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17592: Fix Version/s: (was: 2.0.1) (was: 2.1.0) > SQL: CAST string as INT

[jira] [Commented] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510934#comment-15510934 ] Josh Rosen commented on SPARK-17618: Yep, the problem is that {{Coalesce}} advertises that it accepts

[jira] [Updated] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17618: --- Target Version/s: 1.6.3 > Dataframe except returns incorrect results when combined with coalesce >

[jira] [Updated] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17618: --- Priority: Blocker (was: Minor) > Dataframe except returns incorrect results when combined with

[jira] [Commented] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510874#comment-15510874 ] Josh Rosen commented on SPARK-17618: It looks like this affects 1.6.2 as well, but I was unable to

[jira] [Updated] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17618: --- Labels: correctness (was: ) > Dataframe except returns incorrect results when combined with

[jira] [Resolved] (SPARK-11918) Better error from WLS for cases like singular input

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-11918. - Resolution: Fixed > Better error from WLS for cases like singular input >

[jira] [Updated] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17618: --- Affects Version/s: 1.6.2 > Dataframe except returns incorrect results when combined with coalesce >

[jira] [Resolved] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17616. Resolution: Duplicate > Getting "java.lang.RuntimeException: Distinct columns cannot exist in >

[jira] [Updated] (SPARK-17618) Dataframe except returns incorrect results when combined with coalesce

[ https://issues.apache.org/jira/browse/SPARK-17618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17618: --- Description: We were getting incorrect results from the DataFrame except method - all rows were

[jira] [Updated] (SPARK-17019) Expose off-heap memory usage in various places

[ https://issues.apache.org/jira/browse/SPARK-17019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17019: --- Target Version/s: 2.1.0 (was: 2.0.1, 2.1.0) > Expose off-heap memory usage in various places >

[jira] [Resolved] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-17418. Resolution: Fixed Assignee: Josh Rosen Fix Version/s: 2.1.0

[jira] [Commented] (SPARK-11918) Better error from WLS for cases like singular input

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510792#comment-15510792 ] DB Tsai commented on SPARK-11918: - +1 on QR decomposition. We may add a feature that using LBFGS/OWLQN to

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510787#comment-15510787 ] Michael Armbrust commented on SPARK-16407: -- I'm still a little unclear on the use cases we are

[jira] [Updated] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17626: -- Description: *TPC-DS performance improvements using star-schema heuristics* \\ \\ TPC-DS

[jira] [Updated] (SPARK-11702) Guava ClassLoading Issue When Using Different Hive Metastore Version

[ https://issues.apache.org/jira/browse/SPARK-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joey Paskhay updated SPARK-11702: - Description: A Guava classloading error can occur when using a different version of the Hive

[jira] [Commented] (SPARK-14849) shuffle broken when accessing standalone cluster through NAT

[ https://issues.apache.org/jira/browse/SPARK-14849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510745#comment-15510745 ] Shixiong Zhu commented on SPARK-14849: -- [~skyluc] do you still see the error in Spark 2.0.0? >

[jira] [Commented] (SPARK-11702) Guava ClassLoading Issue When Using Different Hive Metastore Version

[ https://issues.apache.org/jira/browse/SPARK-11702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510748#comment-15510748 ] Joey Paskhay commented on SPARK-11702: -- Apologies for the super late response, Sabs. In case you or

[jira] [Updated] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

[ https://issues.apache.org/jira/browse/SPARK-17626?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ioana Delaney updated SPARK-17626: -- Attachment: StarSchemaJoinReordering.pptx > TPC-DS performance improvements using star-schema

[jira] [Issue Comment Deleted] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Wu updated SPARK-17614: Comment: was deleted (was: Create pull request: https://github.com/apache/spark/pull/15183) >

[jira] [Created] (SPARK-17626) TPC-DS performance improvements using star-schema heuristics

Ioana Delaney created SPARK-17626: - Summary: TPC-DS performance improvements using star-schema heuristics Key: SPARK-17626 URL: https://issues.apache.org/jira/browse/SPARK-17626 Project: Spark

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510707#comment-15510707 ] Sean Owen commented on SPARK-17614: --- Yup, that much is clearly a bug. Go for a fix, anyone who wants to

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510709#comment-15510709 ] Paul Wu commented on SPARK-17614: - Create pull request: https://github.com/apache/spark/pull/15183 >

[jira] [Assigned] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17614: Assignee: (was: Apache Spark) > sparkSession.read() .jdbc(***) use the sql syntax

[jira] [Assigned] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17614: Assignee: Apache Spark > sparkSession.read() .jdbc(***) use the sql syntax "where 1=0"

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510704#comment-15510704 ] Apache Spark commented on SPARK-17614: -- User 'paulzwu' has created a pull request for this issue:

[jira] [Commented] (SPARK-17134) Use level 2 BLAS operations in LogisticAggregator

[ https://issues.apache.org/jira/browse/SPARK-17134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510672#comment-15510672 ] DB Tsai commented on SPARK-17134: - I'll try the old mlor in rdd tonight when the cluster is not busy.

[jira] [Commented] (SPARK-17625) expectedOutputAttributes should be set when converting SimpleCatalogRelation to LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15510658#comment-15510658 ] Apache Spark commented on SPARK-17625: -- User 'wzhfy' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17625) expectedOutputAttributes should be set when converting SimpleCatalogRelation to LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17625: Assignee: Apache Spark > expectedOutputAttributes should be set when converting

[jira] [Assigned] (SPARK-17625) expectedOutputAttributes should be set when converting SimpleCatalogRelation to LogicalRelation

[ https://issues.apache.org/jira/browse/SPARK-17625?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17625: Assignee: (was: Apache Spark) > expectedOutputAttributes should be set when

  1   2   >