[jira] [Resolved] (SPARK-17502) Multiple Bugs in DDL Statements on Temporary Views

[ https://issues.apache.org/jira/browse/SPARK-17502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-17502. - Resolution: Fixed Assignee: Xiao Li Fix Version/s: 2.1.0 > Multiple Bugs in DDL

[jira] [Assigned] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17611: Assignee: Apache Spark > YarnShuffleServiceSuite swallows exceptions, doesn't really test

[jira] [Assigned] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17611: Assignee: (was: Apache Spark) > YarnShuffleServiceSuite swallows exceptions, doesn't

[jira] [Commented] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507185#comment-15507185 ] Apache Spark commented on SPARK-17611: -- User 'vanzin' has created a pull request for this issue:

[jira] [Commented] (SPARK-10835) Change Output of NGram to Array(String, True)

[ https://issues.apache.org/jira/browse/SPARK-10835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506806#comment-15506806 ] Sean Owen commented on SPARK-10835: --- [~yuhaoyan] just reviving this one because it came up on the list.

[jira] [Created] (SPARK-17610) The failed stage caused FetchFailed may never be resubmitted

Tao Wang created SPARK-17610: Summary: The failed stage caused FetchFailed may never be resubmitted Key: SPARK-17610 URL: https://issues.apache.org/jira/browse/SPARK-17610 Project: Spark Issue

[jira] [Commented] (SPARK-10057) Faill to load class org.slf4j.impl.StaticLoggerBinder

[ https://issues.apache.org/jira/browse/SPARK-10057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506972#comment-15506972 ] Semet commented on SPARK-10057: --- Hello I confirm we have this issue on Spark 1.6.1 when writing a parquet

[jira] [Assigned] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17549: Assignee: Apache Spark > InMemoryRelation doesn't scale to large tables >

[jira] [Commented] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507146#comment-15507146 ] sai pavan kumar chitti commented on SPARK-17588: @swan owen - any suggestions on how i go

[jira] [Reopened] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin reopened SPARK-17549: Assignee: (was: Marcelo Vanzin) > InMemoryRelation doesn't scale to large tables >

[jira] [Updated] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin updated SPARK-17611: --- Component/s: Tests > YarnShuffleServiceSuite swallows exceptions, doesn't really test a few

[jira] [Created] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

Marcelo Vanzin created SPARK-17611: -- Summary: YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things Key: SPARK-17611 URL: https://issues.apache.org/jira/browse/SPARK-17611

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506949#comment-15506949 ] Marcelo Vanzin commented on SPARK-17549: Wouldn't hurt. > InMemoryRelation doesn't scale to

[jira] [Updated] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Wang updated SPARK-17610: - Summary: The failed stage caused by FetchFailed may never be resubmitted (was: The failed stage caused

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505921#comment-15505921 ] Cheng Lian commented on SPARK-17572: Which version of Hadoop are you using? Does it work when you

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506025#comment-15506025 ] Sankar Mittapally commented on SPARK-17572: --- Hey Cheng, We are not using HDFS at the backend.

[jira] [Resolved] (SPARK-17580) Assign random App name while creating spark context

[ https://issues.apache.org/jira/browse/SPARK-17580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17580. --- Resolution: Won't Fix > Assign random App name while creating spark context >

[jira] [Resolved] (SPARK-17594) Bug in left-outer join

[ https://issues.apache.org/jira/browse/SPARK-17594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17594. --- Resolution: Duplicate OK, that's good to know. Let's point at that issue for now. > Bug in

[jira] [Updated] (SPARK-17602) PySpark - Performance Optimization Large Size of Broadcast Variable

[ https://issues.apache.org/jira/browse/SPARK-17602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Ming Bao updated SPARK-17602: -- Attachment: PySpark – Performance Optimization for Large Size of Broadcast variable.pdf

[jira] [Created] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

Saisai Shao created SPARK-17604: --- Summary: Support purging aged file entry for FileStreamSource metadata log Key: SPARK-17604 URL: https://issues.apache.org/jira/browse/SPARK-17604 Project: Spark

[jira] [Updated] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-17604: Description: Currently with SPARK-15698, FileStreamSource metadata log will be compacted

[jira] [Created] (SPARK-17605) Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr

Jeff Zhang created SPARK-17605: -- Summary: Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr Key: SPARK-17605 URL: https://issues.apache.org/jira/browse/SPARK-17605

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506051#comment-15506051 ] Cheng Lian commented on SPARK-17572: Yea, I know you are not using HDFS. But Spark always uses Hadoop

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505810#comment-15505810 ] Reynold Xin commented on SPARK-15698: - This one is important for streaming running 24/7 for map-only

[jira] [Updated] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-15698: Priority: Major (was: Minor) > Ability to remove old metadata for structure streaming MetadataLog

[jira] [Updated] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-17572: --- Description: Hi, We have spark cluster with four nodes, all four nodes have NFS partition

[jira] [Updated] (SPARK-17604) Support purging aged file entry for FileStreamSource metadata log

[ https://issues.apache.org/jira/browse/SPARK-17604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-17604: Issue Type: Sub-task (was: Improvement) Parent: SPARK-17267 > Support purging aged file

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15505799#comment-15505799 ] Saisai Shao commented on SPARK-15698: - I think [~rxin] set this target version before. I'm OK to

[jira] [Assigned] (SPARK-17605) Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr

[ https://issues.apache.org/jira/browse/SPARK-17605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17605: Assignee: (was: Apache Spark) > Add option spark.usePython and spark.useR for

[jira] [Commented] (SPARK-17605) Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr

[ https://issues.apache.org/jira/browse/SPARK-17605?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506013#comment-15506013 ] Apache Spark commented on SPARK-17605: -- User 'zjffdu' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17605) Add option spark.usePython and spark.useR for applications that use both pyspark and sparkr

[ https://issues.apache.org/jira/browse/SPARK-17605?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17605: Assignee: Apache Spark > Add option spark.usePython and spark.useR for applications that

[jira] [Commented] (SPARK-17572) Write.df is failing on spark cluster

[ https://issues.apache.org/jira/browse/SPARK-17572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506059#comment-15506059 ] Sankar Mittapally commented on SPARK-17572: --- spark-2.0.0-bin-hadoop2.7 This is the package I

[jira] [Resolved] (SPARK-17597) HiveContext cannot create a table named sort

[ https://issues.apache.org/jira/browse/SPARK-17597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17597. --- Resolution: Duplicate > HiveContext cannot create a table named sort >

[jira] [Resolved] (SPARK-17437) uiWebUrl is not accessible to JavaSparkContext or pyspark.SparkContext

[ https://issues.apache.org/jira/browse/SPARK-17437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17437. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15000

[jira] [Created] (SPARK-17607) --driver-url doesn't point to my master_ip.

Sasi created SPARK-17607: Summary: --driver-url doesn't point to my master_ip. Key: SPARK-17607 URL: https://issues.apache.org/jira/browse/SPARK-17607 Project: Spark Issue Type: Bug Affects

[jira] [Created] (SPARK-17606) New batches are not created when there are 1000 created after restarting streaming from checkpoint.

etienne created SPARK-17606: --- Summary: New batches are not created when there are 1000 created after restarting streaming from checkpoint. Key: SPARK-17606 URL: https://issues.apache.org/jira/browse/SPARK-17606

[jira] [Updated] (SPARK-17607) --driver-url doesn't point to my master_ip.

[ https://issues.apache.org/jira/browse/SPARK-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sasi updated SPARK-17607: - Description: Hi, I have master machine and slave machine. My master machine contains 2 interfaces. First

[jira] [Updated] (SPARK-17606) New batches are not created when there are 1000 created after restarting streaming from checkpoint.

[ https://issues.apache.org/jira/browse/SPARK-17606?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17606: -- Target Version/s: (was: 1.6.2, 2.0.0) Component/s: (was: Spark Core)

[jira] [Commented] (SPARK-17607) --driver-url doesn't point to my master_ip.

[ https://issues.apache.org/jira/browse/SPARK-17607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15506436#comment-15506436 ] Sean Owen commented on SPARK-17607: --- Duplicate of https://issues.apache.org/jira/browse/SPARK-13317 ?

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507257#comment-15507257 ] Miao Wang commented on SPARK-17608: ---

[jira] [Commented] (SPARK-17568) Add spark-submit option for user to override ivy settings used to resolve packages/artifacts

[ https://issues.apache.org/jira/browse/SPARK-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507249#comment-15507249 ] Bryan Cutler commented on SPARK-17568: -- I agree, in production there are better ways to bring in

[jira] [Commented] (SPARK-17513) StreamExecution should discard unneeded metadata

[ https://issues.apache.org/jira/browse/SPARK-17513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507401#comment-15507401 ] Apache Spark commented on SPARK-17513: -- User 'petermaxlee' has created a pull request for this

[jira] [Assigned] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17549: Assignee: (was: Apache Spark) > InMemoryRelation doesn't scale to large tables >

[jira] [Resolved] (SPARK-17051) we should use hadoopConf in InsertIntoHiveTable

[ https://issues.apache.org/jira/browse/SPARK-17051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-17051. -- Resolution: Fixed Fix Version/s: 2.1.0 2.0.1 Issue resolved by pull request

[jira] [Updated] (SPARK-16757) Set up caller context to HDFS and Yarn

[ https://issues.apache.org/jira/browse/SPARK-16757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiqing Yang updated SPARK-16757: - Summary: Set up caller context to HDFS and Yarn (was: Set up caller context to HDFS) > Set up

[jira] [Resolved] (SPARK-16758) Set up caller context to YARN

[ https://issues.apache.org/jira/browse/SPARK-16758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Weiqing Yang resolved SPARK-16758. -- Resolution: Duplicate The code for this jira has been put into the PR of SPARK-16757. > Set

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507313#comment-15507313 ] Shixiong Zhu commented on SPARK-15698: -- I just merged the PR and sent a backport for branch 2.0.

[jira] [Assigned] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17613: Assignee: (was: Apache Spark) > PartitioningAwareFileCatalog.allFiles doesn't handle

[jira] [Commented] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507894#comment-15507894 ] Roy T. Fielding commented on SPARK-17418: - "Kinesis related" is not a useful term. The Amazon

[jira] [Commented] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507897#comment-15507897 ] Apache Spark commented on SPARK-17613: -- User 'brkyvz' has created a pull request for this issue:

[jira] [Resolved] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17588. --- Resolution: Duplicate Actually, I found a duplicate and will continue there. >

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507950#comment-15507950 ] Paul Wu commented on SPARK-17614: - Work around: Rebuild the Cassandra JDBC wrapper by modifying

[jira] [Assigned] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17613: Assignee: Apache Spark > PartitioningAwareFileCatalog.allFiles doesn't handle URI

[jira] [Comment Edited] (SPARK-17568) Add spark-submit option for user to override ivy settings used to resolve packages/artifacts

[ https://issues.apache.org/jira/browse/SPARK-17568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507249#comment-15507249 ] Bryan Cutler edited comment on SPARK-17568 at 9/20/16 10:00 PM: I agree,

[jira] [Commented] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507935#comment-15507935 ] Luciano Resende commented on SPARK-17418: - Thanks [~fielding]. It seems we are ok to publish

[jira] [Updated] (SPARK-17494) Floor/ceil of decimal returns wrong result if it's in compact format

[ https://issues.apache.org/jira/browse/SPARK-17494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17494: --- Target Version/s: 2.0.1, 2.1.0 > Floor/ceil of decimal returns wrong result if it's in compact

[jira] [Commented] (SPARK-17562) I think a little code is unnecessary to exist in ExternalSorter.spillMemoryIteratorToDisk

[ https://issues.apache.org/jira/browse/SPARK-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508076#comment-15508076 ] Josh Rosen commented on SPARK-17562: I'm not sure that "zero objects written" necessarily implies "no

[jira] [Comment Edited] (SPARK-11918) WLS can not resolve some kinds of equation

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15021787#comment-15021787 ] Sean Owen edited comment on SPARK-11918 at 9/20/16 9:54 PM: [~yanboliang] yes

[jira] [Commented] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

[ https://issues.apache.org/jira/browse/SPARK-17614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508059#comment-15508059 ] Josh Rosen commented on SPARK-17614: You should be able to customize the "table existence" query by

[jira] [Updated] (SPARK-17592) SQL: CAST string as INT inconsistent with Hive

[ https://issues.apache.org/jira/browse/SPARK-17592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17592: --- Fix Version/s: 2.1.0 2.0.1 > SQL: CAST string as INT inconsistent with Hive >

[jira] [Commented] (SPARK-17386) Default polling and trigger intervals cause excessive RPC calls

[ https://issues.apache.org/jira/browse/SPARK-17386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507192#comment-15507192 ] Apache Spark commented on SPARK-17386: -- User 'frreiss' has created a pull request for this issue:

[jira] [Commented] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507223#comment-15507223 ] Apache Spark commented on SPARK-15698: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507227#comment-15507227 ] Miao Wang commented on SPARK-17608: --- Let me take a look. Thanks! > Long type has incorrect

[jira] [Commented] (SPARK-11918) WLS can not resolve some kinds of equation

[ https://issues.apache.org/jira/browse/SPARK-11918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507914#comment-15507914 ] Sean Owen commented on SPARK-11918: --- Copying my comment from the other JIRA - yes we should have a

[jira] [Commented] (SPARK-17602) PySpark - Performance Optimization Large Size of Broadcast Variable

[ https://issues.apache.org/jira/browse/SPARK-17602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508065#comment-15508065 ] Miao Wang commented on SPARK-17602: --- Does this change also benefit/impact Windows OS? > PySpark -

[jira] [Commented] (SPARK-16115) Improve output column name for SHOW PARTITIONS command and improve an error message

[ https://issues.apache.org/jira/browse/SPARK-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507726#comment-15507726 ] Sunitha Kambhampati commented on SPARK-16115: - Other pr's for SPARK-16543 and SPARK-17502

[jira] [Resolved] (SPARK-16115) Improve output column name for SHOW PARTITIONS command and improve an error message

[ https://issues.apache.org/jira/browse/SPARK-16115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati resolved SPARK-16115. - Resolution: Resolved Fix Version/s: 2.1.0 > Improve output column name

[jira] [Commented] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507737#comment-15507737 ] sai pavan kumar chitti commented on SPARK-17588: we removed abspret_x_abspret and

[jira] [Commented] (SPARK-17608) Long type has incorrect serialization/deserialization

[ https://issues.apache.org/jira/browse/SPARK-17608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507787#comment-15507787 ] Felix Cheung commented on SPARK-17608: -- This is in fact problematic - R base supports integer in

[jira] [Reopened] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reopened SPARK-17588: --- Ah, OK that makes sense. I can reproduce it. Did you set 0 for the regularization parameter? Setting

[jira] [Updated] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17588: -- Assignee: Sean Owen Labels: (was: newbie) Priority: Minor (was: Major)

[jira] [Resolved] (SPARK-17611) YarnShuffleServiceSuite swallows exceptions, doesn't really test a few things

[ https://issues.apache.org/jira/browse/SPARK-17611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-17611. Resolution: Fixed Assignee: Marcelo Vanzin Fix Version/s: 2.1.0 >

[jira] [Closed] (SPARK-17588) java.lang.AssertionError: assertion failed: lapack.dppsv returned 105. when running glm using gaussian link function.

[ https://issues.apache.org/jira/browse/SPARK-17588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sai pavan kumar chitti closed SPARK-17588. -- Resolution: Fixed > java.lang.AssertionError: assertion failed: lapack.dppsv

[jira] [Updated] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

[ https://issues.apache.org/jira/browse/SPARK-17613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-17613: - Target Version/s: 2.0.1, 2.1.0 > PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path

[jira] [Created] (SPARK-17614) sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support

Paul Wu created SPARK-17614: --- Summary: sparkSession.read() .jdbc(***) use the sql syntax "where 1=0" that Cassandra does not support Key: SPARK-17614 URL: https://issues.apache.org/jira/browse/SPARK-17614

[jira] [Created] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

Dongjoon Hyun created SPARK-17612: - Summary: Support `DESCRIBE table PARTITION` SQL syntax Key: SPARK-17612 URL: https://issues.apache.org/jira/browse/SPARK-17612 Project: Spark Issue Type:

[jira] [Commented] (SPARK-17549) InMemoryRelation doesn't scale to large tables

[ https://issues.apache.org/jira/browse/SPARK-17549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507440#comment-15507440 ] Yin Huai commented on SPARK-17549: -- I have merged it to revert the original change. > InMemoryRelation

[jira] [Created] (SPARK-17613) PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent

Burak Yavuz created SPARK-17613: --- Summary: PartitioningAwareFileCatalog.allFiles doesn't handle URI specified path at parent Key: SPARK-17613 URL: https://issues.apache.org/jira/browse/SPARK-17613

[jira] [Resolved] (SPARK-15698) Ability to remove old metadata for structure streaming MetadataLog

[ https://issues.apache.org/jira/browse/SPARK-15698?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-15698. -- Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 2.1.0

[jira] [Assigned] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17612: Assignee: Apache Spark > Support `DESCRIBE table PARTITION` SQL syntax >

[jira] [Assigned] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17612: Assignee: (was: Apache Spark) > Support `DESCRIBE table PARTITION` SQL syntax >

[jira] [Commented] (SPARK-17418) Spark release must NOT distribute Kinesis related assembly artifact

[ https://issues.apache.org/jira/browse/SPARK-17418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507695#comment-15507695 ] Apache Spark commented on SPARK-17418: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Commented] (SPARK-17612) Support `DESCRIBE table PARTITION` SQL syntax

[ https://issues.apache.org/jira/browse/SPARK-17612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507697#comment-15507697 ] Apache Spark commented on SPARK-17612: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-13331) AES support for over-the-wire encryption

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-13331: Summary: AES support for over-the-wire encryption (was: Spark network encryption optimization) >

[jira] [Created] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

Egor Pahomov created SPARK-17615: Summary: Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate " Key: SPARK-17615 URL: https://issues.apache.org/jira/browse/SPARK-17615

[jira] [Created] (SPARK-17616) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

Egor Pahomov created SPARK-17616: Summary: Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate " Key: SPARK-17616 URL: https://issues.apache.org/jira/browse/SPARK-17616

[jira] [Created] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

Sean Zhong created SPARK-17617: -- Summary: Remainder(%) expression.eval returns incorrect result Key: SPARK-17617 URL: https://issues.apache.org/jira/browse/SPARK-17617 Project: Spark Issue

[jira] [Updated] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17617: --- Labels: correctness (was: ) > Remainder(%) expression.eval returns incorrect result >

[jira] [Updated] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-17617: --- Target Version/s: 1.6.3, 2.0.1, 2.1.0 > Remainder(%) expression.eval returns incorrect result >

[jira] [Commented] (SPARK-17610) The failed stage caused by FetchFailed may never be resubmitted

[ https://issues.apache.org/jira/browse/SPARK-17610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508362#comment-15508362 ] Tao Wang commented on SPARK-17610: -- cc [~rxin] [~andrewor14] > The failed stage caused by FetchFailed

[jira] [Commented] (SPARK-6072) Enable hash joins for null-safe equality predicates

[ https://issues.apache.org/jira/browse/SPARK-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508247#comment-15508247 ] Chowdary Davuluri commented on SPARK-6072: -- Hello, Has this been fixed as part of

[jira] [Commented] (SPARK-17562) I think a little code is unnecessary to exist in ExternalSorter.spillMemoryIteratorToDisk

[ https://issues.apache.org/jira/browse/SPARK-17562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508257#comment-15508257 ] Jianfei Wang commented on SPARK-17562: -- that sounds reasonable, thank you Josh Rosen! > I think a

[jira] [Commented] (SPARK-17545) Spark SQL Catalyst doesn't handle ISO 8601 date without colon in offset

[ https://issues.apache.org/jira/browse/SPARK-17545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508261#comment-15508261 ] Hyukjin Kwon commented on SPARK-17545: -- [~srowen] and [~nbeyer]. Just a gentle reminder that this

[jira] [Commented] (SPARK-16407) Allow users to supply custom StreamSinkProviders

[ https://issues.apache.org/jira/browse/SPARK-16407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508260#comment-15508260 ] Frederick Reiss commented on SPARK-16407: - It looks like there is a general agreement here that

[jira] [Commented] (SPARK-13331) Spark network encryption optimization

[ https://issues.apache.org/jira/browse/SPARK-13331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508355#comment-15508355 ] Apache Spark commented on SPARK-13331: -- User 'cjjnjust' has created a pull request for this issue:

[jira] [Comment Edited] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508376#comment-15508376 ] Hyukjin Kwon edited comment on SPARK-17615 at 9/21/16 1:36 AM: --- It seems

[jira] [Commented] (SPARK-17615) Getting "java.lang.RuntimeException: Distinct columns cannot exist in Aggregate "

[ https://issues.apache.org/jira/browse/SPARK-17615?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508376#comment-15508376 ] Hyukjin Kwon commented on SPARK-17615: -- It seems something went wrong when creating a JIRA. It seems

[jira] [Updated] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Zhong updated SPARK-17617: --- Description: h2.Problem Remainder(%) expression returns incorrect result when using expression.eval

[jira] [Commented] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508252#comment-15508252 ] Apache Spark commented on SPARK-17617: -- User 'clockfly' has created a pull request for this issue:

[jira] [Assigned] (SPARK-17617) Remainder(%) expression.eval returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-17617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-17617: Assignee: Apache Spark > Remainder(%) expression.eval returns incorrect result >

  1   2   >