[jira] [Commented] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008608#comment-15008608 ] Sean Owen commented on SPARK-11777: --- Why do you say it's not updated or readable? you say it did

[jira] [Created] (SPARK-11778) HiveContext.read.table does not support user-specified database names

Stanislav Hadjiiski created SPARK-11778: --- Summary: HiveContext.read.table does not support user-specified database names Key: SPARK-11778 URL: https://issues.apache.org/jira/browse/SPARK-11778

[jira] [Updated] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11777: -- Component/s: SQL I don't think this is a Spark issue right? yes, you generally have to ask Impala to

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11778: -- Component/s: SQL > HiveContext.read.table does not support user-specified database names >

[jira] [Commented] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008628#comment-15008628 ] Stanislav Hadjiiski commented on SPARK-11777: - Yes, it updates the HDFS, i.e. the new data is

[jira] [Created] (SPARK-11781) SparkR has problem in inferring type of raw type

Sun Rui created SPARK-11781: --- Summary: SparkR has problem in inferring type of raw type Key: SPARK-11781 URL: https://issues.apache.org/jira/browse/SPARK-11781 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-11781) SparkR has problem in inferring type of raw type

[ https://issues.apache.org/jira/browse/SPARK-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sun Rui updated SPARK-11781: Description: {code} > bytes <- as.raw(c(1, 2 ,3)) > bytes [1] 01 02 03 > df <- createDataFrame(sqlContext,

[jira] [Updated] (SPARK-11776) Cache fraction hardly reach 100%

[ https://issues.apache.org/jira/browse/SPARK-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenmin Wu updated SPARK-11776: -- Description: Even with plenty partitions as well as executor memory the cache fraction can hardly

[jira] [Resolved] (SPARK-11776) Cache fraction hardly reach 100%

[ https://issues.apache.org/jira/browse/SPARK-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11776. --- Resolution: Invalid I don't think this describes a valid problem. For example, there is no

[jira] [Created] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

Stanislav Hadjiiski created SPARK-11777: --- Summary: HiveContext.saveAsTable does not update the metastore on overwrite Key: SPARK-11777 URL: https://issues.apache.org/jira/browse/SPARK-11777

[jira] [Created] (SPARK-11779) Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable

Philipp Hoffmann created SPARK-11779: Summary: Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable Key: SPARK-11779 URL: https://issues.apache.org/jira/browse/SPARK-11779

[jira] [Commented] (SPARK-11779) Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable

[ https://issues.apache.org/jira/browse/SPARK-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008499#comment-15008499 ] Apache Spark commented on SPARK-11779: -- User 'philipphoffmann' has created a pull request for this

[jira] [Assigned] (SPARK-11779) Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable

[ https://issues.apache.org/jira/browse/SPARK-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11779: Assignee: Apache Spark > Fix reference of deprecated MESOS_NATIVE_LIBRARY environment

[jira] [Commented] (SPARK-11692) Support for Parquet logical types, JSON and BSON (embedded types)

[ https://issues.apache.org/jira/browse/SPARK-11692?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008497#comment-15008497 ] Hyukjin Kwon commented on SPARK-11692: -- I mistakenly added this for backporting to branch 1.6. So, I

[jira] [Commented] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008588#comment-15008588 ] Stanislav Hadjiiski commented on SPARK-11777: - I was to change the HDFS contents manually I

[jira] [Updated] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

[ https://issues.apache.org/jira/browse/SPARK-11782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11782: -- Component/s: (was: Spark Core) Web UI > Master Web UI should link to correct

[jira] [Comment Edited] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008908#comment-15008908 ] Yunjie Qiu edited comment on SPARK-6847 at 11/17/15 4:23 PM: - Hi Glyton

[jira] [Commented] (SPARK-11153) Turns off Parquet filter push-down for string and binary columns

[ https://issues.apache.org/jira/browse/SPARK-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008897#comment-15008897 ] Ian commented on SPARK-11153: - Cheng: Any plan to enable pushdown for timestamps? Should I open a ticket

[jira] [Comment Edited] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008908#comment-15008908 ] Yunjie Qiu edited comment on SPARK-6847 at 11/17/15 4:21 PM: - Hi Glyton

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008909#comment-15008909 ] Yunjie Qiu commented on SPARK-6847: --- Hi Glyton Camilleri & Jack Hu, We also ran into the same

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008908#comment-15008908 ] Yunjie Qiu commented on SPARK-6847: --- Hi Glyton Camilleri & Jack Hu, We also ran into the same

[jira] [Issue Comment Deleted] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yunjie Qiu updated SPARK-6847: -- Comment: was deleted (was: Hi Glyton Camilleri & Jack Hu, We also ran into the same StackOverflow

[jira] [Comment Edited] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008908#comment-15008908 ] Yunjie Qiu edited comment on SPARK-6847 at 11/17/15 4:22 PM: - Hi Glyton

[jira] [Assigned] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11725: Assignee: Apache Spark > Let UDF to handle null value > > >

[jira] [Commented] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008800#comment-15008800 ] Apache Spark commented on SPARK-11725: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Updated] (SPARK-11694) Parquet logical types are not being tested properly

[ https://issues.apache.org/jira/browse/SPARK-11694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-11694: --- Fix Version/s: 1.7.0 > Parquet logical types are not being tested properly >

[jira] [Assigned] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11725: Assignee: (was: Apache Spark) > Let UDF to handle null value >

[jira] [Created] (SPARK-11782) Master Web UI should link to correct Application UI in cluster mode

Matthias Niehoff created SPARK-11782: Summary: Master Web UI should link to correct Application UI in cluster mode Key: SPARK-11782 URL: https://issues.apache.org/jira/browse/SPARK-11782 Project:

[jira] [Commented] (SPARK-11153) Turns off Parquet filter push-down for string and binary columns

[ https://issues.apache.org/jira/browse/SPARK-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008827#comment-15008827 ] Cheng Lian commented on SPARK-11153: You are right that Impala and Hive write timestamps as Parquet

[jira] [Commented] (SPARK-11781) SparkR has problem in inferring type of raw type

[ https://issues.apache.org/jira/browse/SPARK-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008700#comment-15008700 ] Apache Spark commented on SPARK-11781: -- User 'sun-rui' has created a pull request for this issue:

[jira] [Updated] (SPARK-11779) Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable

[ https://issues.apache.org/jira/browse/SPARK-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11779: -- Assignee: Philipp Hoffmann Priority: Trivial (was: Major) > Fix reference of deprecated

[jira] [Updated] (SPARK-11751) Doc describe error in the "Spark Streaming Programming Guide" page

[ https://issues.apache.org/jira/browse/SPARK-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11751: -- Assignee: yangping wu > Doc describe error in the "Spark Streaming Programming Guide" page >

[jira] [Assigned] (SPARK-11781) SparkR has problem in inferring type of raw type

[ https://issues.apache.org/jira/browse/SPARK-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11781: Assignee: Apache Spark > SparkR has problem in inferring type of raw type >

[jira] [Assigned] (SPARK-11781) SparkR has problem in inferring type of raw type

[ https://issues.apache.org/jira/browse/SPARK-11781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11781: Assignee: (was: Apache Spark) > SparkR has problem in inferring type of raw type >

[jira] [Resolved] (SPARK-11751) Doc describe error in the "Spark Streaming Programming Guide" page

[ https://issues.apache.org/jira/browse/SPARK-11751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11751. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9734

[jira] [Resolved] (SPARK-11777) HiveContext.saveAsTable does not update the metastore on overwrite

[ https://issues.apache.org/jira/browse/SPARK-11777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11777. --- Resolution: Not A Problem I think this is a question about Impala then. Everything you have here

[jira] [Resolved] (SPARK-11779) Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable

[ https://issues.apache.org/jira/browse/SPARK-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11779. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9768

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008738#comment-15008738 ] Romi Kuntsman commented on SPARK-11293: --- The memory manager was rewritten there? Could it have

[jira] [Commented] (SPARK-11772) DataFrame.show() fails with non-ASCII strings

[ https://issues.apache.org/jira/browse/SPARK-11772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008996#comment-15008996 ] kevin yu commented on SPARK-11772: -- Hello Greg: I running against the latest spark, it works for me.

[jira] [Created] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

Cheng Lian created SPARK-11783: -- Summary: When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore Key: SPARK-11783 URL: https://issues.apache.org/jira/browse/SPARK-11783

[jira] [Commented] (SPARK-6847) Stack overflow on updateStateByKey which followed by a dstream with checkpoint set

[ https://issues.apache.org/jira/browse/SPARK-6847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15008993#comment-15008993 ] Glyton Camilleri commented on SPARK-6847: - Hi Yunjie, Whether 50 seconds is good or not as a

[jira] [Commented] (SPARK-9686) Spark hive jdbc client cannot get table from metadata store

[ https://issues.apache.org/jira/browse/SPARK-9686?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009033#comment-15009033 ] Cheng Lian commented on SPARK-9686: --- Tested 1.7-SNAPSHOT

[jira] [Commented] (SPARK-11153) Turns off Parquet filter push-down for string and binary columns

[ https://issues.apache.org/jira/browse/SPARK-11153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009057#comment-15009057 ] Cheng Lian commented on SPARK-11153: Yes please file a ticket. One complication here is that,

[jira] [Commented] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009055#comment-15009055 ] Marcelo Vanzin commented on SPARK-11617: Those errors are not necessarily caused by the changed

[jira] [Commented] (SPARK-7831) Mesos dispatcher doesn't deregister as a framework from Mesos when stopped

[ https://issues.apache.org/jira/browse/SPARK-7831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009070#comment-15009070 ] Zapi Dev commented on SPARK-7831: - Well and what's the state of this issue, do you have any plan to

[jira] [Commented] (SPARK-11783) When deployed against remote Hive metastore, HiveContext.executionHive points to wrong metastore

[ https://issues.apache.org/jira/browse/SPARK-11783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009098#comment-15009098 ] Cheng Lian commented on SPARK-11783: This

[jira] [Assigned] (SPARK-11779) Fix reference of deprecated MESOS_NATIVE_LIBRARY environment variable

[ https://issues.apache.org/jira/browse/SPARK-11779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11779: Assignee: (was: Apache Spark) > Fix reference of deprecated MESOS_NATIVE_LIBRARY

[jira] [Updated] (SPARK-11617) MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[ https://issues.apache.org/jira/browse/SPARK-11617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11617: -- Assignee: Marcelo Vanzin > MEMORY LEAK: ByteBuf.release() was not called before it's garbage-collected

[jira] [Updated] (SPARK-11767) Easy to OOM when cache large column

[ https://issues.apache.org/jira/browse/SPARK-11767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-11767: -- Component/s: SQL > Easy to OOM when cache large column > --- > >

[jira] [Created] (SPARK-11780) Provide type aliases in org.apache.spark.sql.types for backwards compatibility

Santiago M. Mola created SPARK-11780: Summary: Provide type aliases in org.apache.spark.sql.types for backwards compatibility Key: SPARK-11780 URL: https://issues.apache.org/jira/browse/SPARK-11780

[jira] [Resolved] (SPARK-11765) Avoid assign UI port between browser unsafe ports (or just 4045: lockd)

[ https://issues.apache.org/jira/browse/SPARK-11765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11765. --- Resolution: Not A Problem Agree, I don't think this is something that needs any change, as you can

[jira] [Resolved] (SPARK-11766) JSON serialization of Vectors

[ https://issues.apache.org/jira/browse/SPARK-11766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-11766. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9751

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009172#comment-15009172 ] Oscar D. Lara Yejas commented on SPARK-10863: - [~shivaram] [~sunrui] [~felixcheung] Any

[jira] [Updated] (SPARK-6776) Implement backwards-compatibility rules in Catalyst converters (which convert Parquet record to rows)

[ https://issues.apache.org/jira/browse/SPARK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-6776: -- Fix Version/s: 1.5.0 > Implement backwards-compatibility rules in Catalyst converters (which convert >

[jira] [Commented] (SPARK-6776) Implement backwards-compatibility rules in Catalyst converters (which convert Parquet record to rows)

[ https://issues.apache.org/jira/browse/SPARK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009181#comment-15009181 ] Cheng Lian commented on SPARK-6776: --- It's 1.5.0, just added. > Implement backwards-compatibility rules

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009189#comment-15009189 ] Jo Voordeckers commented on SPARK-11327: I've seen similar issues, when running on mesos (no

[jira] [Resolved] (SPARK-11695) Set s3a credentials by default similarly to s3 and s3n

[ https://issues.apache.org/jira/browse/SPARK-11695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11695. Resolution: Fixed Assignee: Chris Bannister Fix Version/s: 1.6.0 > Set s3a

[jira] [Commented] (SPARK-6776) Implement backwards-compatibility rules in Catalyst converters (which convert Parquet record to rows)

[ https://issues.apache.org/jira/browse/SPARK-6776?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009101#comment-15009101 ] Yin Huai commented on SPARK-6776: - [~liancheng] what is the fix version of this issue? > Implement

[jira] [Resolved] (SPARK-11744) bin/pyspark --version doesn't return version and exit

[ https://issues.apache.org/jira/browse/SPARK-11744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marcelo Vanzin resolved SPARK-11744. Resolution: Fixed Assignee: Saisai Shao Fix Version/s: 1.6.0 > bin/pyspark

[jira] [Assigned] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11327: Assignee: (was: Apache Spark) > spark-dispatcher doesn't pass along some spark

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009212#comment-15009212 ] Apache Spark commented on SPARK-11327: -- User 'jayv' has created a pull request for this issue:

[jira] [Assigned] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11327: Assignee: Apache Spark > spark-dispatcher doesn't pass along some spark properties >

[jira] [Created] (SPARK-11784) enable Timestamp filter pushdown

Ian created SPARK-11784: --- Summary: enable Timestamp filter pushdown Key: SPARK-11784 URL: https://issues.apache.org/jira/browse/SPARK-11784 Project: Spark Issue Type: Bug Affects Versions: 1.5.1

[jira] [Created] (SPARK-11785) When deployed against remote Hive metastore with lower versions, JDBC metadata calls throws exception

Cheng Lian created SPARK-11785: -- Summary: When deployed against remote Hive metastore with lower versions, JDBC metadata calls throws exception Key: SPARK-11785 URL: https://issues.apache.org/jira/browse/SPARK-11785

[jira] [Updated] (SPARK-11784) enable Timestamp filter pushdown

[ https://issues.apache.org/jira/browse/SPARK-11784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ian updated SPARK-11784: Component/s: SQL > enable Timestamp filter pushdown > > > Key:

[jira] [Comment Edited] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009274#comment-15009274 ] Huaxin Gao edited comment on SPARK-11778 at 11/17/15 7:05 PM: -- Will simply

[jira] [Resolved] (SPARK-11740) Fix DStream checkpointing logic to prevent failures during checkpoint recovery

[ https://issues.apache.org/jira/browse/SPARK-11740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11740. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 > Fix DStream

[jira] [Commented] (SPARK-6417) Add Linear Programming algorithm

[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009849#comment-15009849 ] Ehsan Mohyedin Kermani commented on SPARK-6417: --- As I am working on the implementation, I

[jira] [Issue Comment Deleted] (SPARK-6417) Add Linear Programming algorithm

[ https://issues.apache.org/jira/browse/SPARK-6417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ehsan Mohyedin Kermani updated SPARK-6417: -- Comment: was deleted (was: Thank you Joseph for the advice! I have started with

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009874#comment-15009874 ] Anubhav Kale commented on SPARK-5784: - Is there a handy list of all the dependent JARs needed to build

[jira] [Issue Comment Deleted] (SPARK-5784) Add StatsDSink to MetricsSystem

[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anubhav Kale updated SPARK-5784: Comment: was deleted (was: I pulled metrics-adapter-4.0.0-SNAPSHOT.jar and

[jira] [Commented] (SPARK-9896) Parquet Schema Assertion

[ https://issues.apache.org/jira/browse/SPARK-9896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009920#comment-15009920 ] Mark Grover commented on SPARK-9896: Posting here in case someone runs into this as well. Based on my

[jira] [Resolved] (SPARK-9552) Dynamic allocation kills busy executors on race condition

[ https://issues.apache.org/jira/browse/SPARK-9552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-9552. -- Resolution: Fixed Fix Version/s: 1.6.0 Target Version/s: 1.6.0 > Dynamic allocation

[jira] [Comment Edited] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009843#comment-15009843 ] Jo Voordeckers edited comment on SPARK-11327 at 11/17/15 11:41 PM: ---

[jira] [Resolved] (SPARK-11790) Flaky test: KafkaStreamTests.test_kafka_direct_stream_foreach_get_offsetRanges

[ https://issues.apache.org/jira/browse/SPARK-11790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11790. --- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 1.6.0 Target

[jira] [Commented] (SPARK-10104) Consolidate different forms of table identifiers

[ https://issues.apache.org/jira/browse/SPARK-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009864#comment-15009864 ] Russell Alexander Spitzer commented on SPARK-10104: --- Previously with Seq[String] it was

[jira] [Commented] (SPARK-5784) Add StatsDSink to MetricsSystem

[ https://issues.apache.org/jira/browse/SPARK-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009870#comment-15009870 ] Anubhav Kale commented on SPARK-5784: - I pulled metrics-adapter-4.0.0-SNAPSHOT.jar and

[jira] [Resolved] (SPARK-11726) Legacy Netty-RPC based submission in standalone mode does not work

[ https://issues.apache.org/jira/browse/SPARK-11726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11726. --- Resolution: Fixed Assignee: Jacek Laskowski Fix Version/s: 1.6.0 Target

[jira] [Commented] (SPARK-9875) Do not evaluate foreach and foreachPartition with count

[ https://issues.apache.org/jira/browse/SPARK-9875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009891#comment-15009891 ] Jakob Odersky commented on SPARK-9875: -- I'm not sure I understand the issue. Are you trying to force

[jira] [Commented] (SPARK-11770) Spark SQL field resolution error in GROUP BY HAVING clause

[ https://issues.apache.org/jira/browse/SPARK-11770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009916#comment-15009916 ] Xiao Li commented on SPARK-11770: - I can take a look at this problem. > Spark SQL field resolution

[jira] [Commented] (SPARK-11327) spark-dispatcher doesn't pass along some spark properties

[ https://issues.apache.org/jira/browse/SPARK-11327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009843#comment-15009843 ] Jo Voordeckers commented on SPARK-11327: I've done more forensics on this: SPARK_EXECUTOR_OPTS

[jira] [Updated] (SPARK-11195) Exception thrown on executor throws ClassNotFoundException on driver

[ https://issues.apache.org/jira/browse/SPARK-11195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-11195: - Target Version/s: 1.6.0 > Exception thrown on executor throws ClassNotFoundException on driver >

[jira] [Resolved] (SPARK-11771) Maximum memory is determined by two params but error message only lists one.

[ https://issues.apache.org/jira/browse/SPARK-11771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or resolved SPARK-11771. --- Resolution: Fixed Assignee: holdenk Fix Version/s: 1.6.0 Target

[jira] [Resolved] (SPARK-11764) JSON serialization of Param[Vector]

[ https://issues.apache.org/jira/browse/SPARK-11764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-11764. --- Resolution: Fixed Fix Version/s: 1.6.0 > JSON serialization of Param[Vector] >

[jira] [Commented] (SPARK-7286) Precedence of operator not behaving properly

[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009898#comment-15009898 ] Xiao Li commented on SPARK-7286: This is affected by the operator precedence in Scala. There does not

[jira] [Commented] (SPARK-10104) Consolidate different forms of table identifiers

[ https://issues.apache.org/jira/browse/SPARK-10104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009904#comment-15009904 ] Yin Huai commented on SPARK-10104: -- Where do you need those extra info? In your custom catalog? If we

[jira] [Comment Edited] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009274#comment-15009274 ] Huaxin Gao edited comment on SPARK-11778 at 11/17/15 7:12 PM: -- Will simply

[jira] [Resolved] (SPARK-11679) When invoking method " apply(fields: java.util.List[StructField])" in "StructType", get exception "java.lang.ClassCastException:

[ https://issues.apache.org/jira/browse/SPARK-11679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11679. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9649

[jira] [Commented] (SPARK-11787) Speed up parquet reader for flat schemas

[ https://issues.apache.org/jira/browse/SPARK-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009425#comment-15009425 ] Apache Spark commented on SPARK-11787: -- User 'nongli' has created a pull request for this issue:

[jira] [Updated] (SPARK-11764) JSON serialization of Param[Vector]

[ https://issues.apache.org/jira/browse/SPARK-11764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-11764: -- Shepherd: Joseph K. Bradley > JSON serialization of Param[Vector] >

[jira] [Resolved] (SPARK-11732) MiMa excludes miss private classes

[ https://issues.apache.org/jira/browse/SPARK-11732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-11732. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9697

[jira] [Resolved] (SPARK-10186) Add support for more postgres column types

[ https://issues.apache.org/jira/browse/SPARK-10186?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10186. -- Resolution: Fixed Fix Version/s: 1.6.0 > Add support for more postgres column

[jira] [Commented] (SPARK-6929) Alias for more complex expression causes attribute not been able to resolve

[ https://issues.apache.org/jira/browse/SPARK-6929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009340#comment-15009340 ] Xiao Li commented on SPARK-6929: [~mwaciega] The default Alias name generation was changed to _c$i in the

[jira] [Created] (SPARK-11788) Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException

Martin Tapp created SPARK-11788: --- Summary: Using java.sql.Timestamp and java.sql.Date in where clauses on JDBC dataframes causes SQLServerException Key: SPARK-11788 URL:

[jira] [Assigned] (SPARK-11787) Speed up parquet reader for flat schemas

[ https://issues.apache.org/jira/browse/SPARK-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11787: Assignee: (was: Apache Spark) > Speed up parquet reader for flat schemas >

[jira] [Assigned] (SPARK-11787) Speed up parquet reader for flat schemas

[ https://issues.apache.org/jira/browse/SPARK-11787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11787: Assignee: Apache Spark > Speed up parquet reader for flat schemas >

[jira] [Created] (SPARK-11786) Tone down error messages from AkkaRpcEnv

Marcelo Vanzin created SPARK-11786: -- Summary: Tone down error messages from AkkaRpcEnv Key: SPARK-11786 URL: https://issues.apache.org/jira/browse/SPARK-11786 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-11786) Tone down error messages from AkkaRpcEnv

[ https://issues.apache.org/jira/browse/SPARK-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11786: Assignee: (was: Apache Spark) > Tone down error messages from AkkaRpcEnv >

[jira] [Assigned] (SPARK-11786) Tone down error messages from AkkaRpcEnv

[ https://issues.apache.org/jira/browse/SPARK-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11786: Assignee: Apache Spark > Tone down error messages from AkkaRpcEnv >

[jira] [Commented] (SPARK-11786) Tone down error messages from AkkaRpcEnv

[ https://issues.apache.org/jira/browse/SPARK-11786?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15009367#comment-15009367 ] Apache Spark commented on SPARK-11786: -- User 'vanzin' has created a pull request for this issue:

  1   2   3   4   >