[jira] [Created] (SPARK-11021) SparkSQL cli throws exception when using with Hive 0.12 metastore in spark-1.5.0 version

iward created SPARK-11021: - Summary: SparkSQL cli throws exception when using with Hive 0.12 metastore in spark-1.5.0 version Key: SPARK-11021 URL: https://issues.apache.org/jira/browse/SPARK-11021 Project: S

[jira] [Commented] (SPARK-8658) AttributeReference equals method only compare name, exprId and dataType

[ https://issues.apache.org/jira/browse/SPARK-8658?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949946#comment-14949946 ] Xiao Li commented on SPARK-8658: Hi, Michael and Antonio, Trying to understand the probl

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949940#comment-14949940 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Thanks for the tip. I fix

[jira] [Commented] (SPARK-10185) Spark SQL does not handle comma separates paths on Hadoop FileSystem

[ https://issues.apache.org/jira/browse/SPARK-10185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949931#comment-14949931 ] koert kuipers commented on SPARK-10185: --- [~marmbrus] made it clear that the goal is

[jira] [Updated] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10959: -- Fix Version/s: 1.5.2 > PySpark StreamingLogisticRegressionWithSGD does not train with given reg

[jira] [Resolved] (SPARK-10875) RowMatrix.computeCovariance() result is not exactly symmetric

[ https://issues.apache.org/jira/browse/SPARK-10875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10875. --- Resolution: Fixed Fix Version/s: 1.6.0 > RowMatrix.computeCovariance() result is not e

[jira] [Resolved] (SPARK-10959) PySpark StreamingLogisticRegressionWithSGD does not train with given regParam and convergenceTol parameters

[ https://issues.apache.org/jira/browse/SPARK-10959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-10959. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9002 [https://gi

[jira] [Resolved] (SPARK-10956) Introduce common memory management interface for execution and storage

[ https://issues.apache.org/jira/browse/SPARK-10956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-10956. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9000 [https://github.c

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949885#comment-14949885 ] Joseph K. Bradley commented on SPARK-9963: -- Sure, I can, but you should be able t

[jira] [Commented] (SPARK-10574) HashingTF should use MurmurHash3

[ https://issues.apache.org/jira/browse/SPARK-10574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949883#comment-14949883 ] Joseph K. Bradley commented on SPARK-10574: --- Hi [~simeons] Thanks for your thou

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949840#comment-14949840 ] Luvsandondov Lkhamsuren commented on SPARK-9963: Thanks for the reply! Ap

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: Move predictNodeIndex to LearningNode

[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949839#comment-14949839 ] Apache Spark commented on SPARK-9963: - User 'lkhamsurenl' has created a pull request f

[jira] [Commented] (SPARK-10984) Simplify *MemoryManager class structure

[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949826#comment-14949826 ] Andrew Or commented on SPARK-10984: --- Thanks [~bowenzhangusa], but for this one I would

[jira] [Commented] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949819#comment-14949819 ] Daniel Lemire commented on SPARK-5949: -- @drcallen Thanks for pinging me. We will be

[jira] [Updated] (SPARK-10983) Implement unified memory manager

[ https://issues.apache.org/jira/browse/SPARK-10983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10983: --- Assignee: Andrew Or > Implement unified memory manager > > >

[jira] [Commented] (SPARK-10953) Benchmark codegen vs. hand-written code for univariate statistics

[ https://issues.apache.org/jira/browse/SPARK-10953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949797#comment-14949797 ] Jihong MA commented on SPARK-10953: --- we should have a cluster for testing next Monday.

[jira] [Assigned] (SPARK-10984) Simplify *MemoryManager class structure

[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-10984: -- Assignee: Josh Rosen > Simplify *MemoryManager class structure > -

[jira] [Commented] (SPARK-10984) Simplify *MemoryManager class structure

[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949796#comment-14949796 ] Josh Rosen commented on SPARK-10984: I'm actually planning to work on this, given tha

[jira] [Commented] (SPARK-10984) Simplify *MemoryManager class structure

[ https://issues.apache.org/jira/browse/SPARK-10984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949788#comment-14949788 ] Bowen Zhang commented on SPARK-10984: - [~andrewor14], can I take on this task after y

[jira] [Updated] (SPARK-10992) Partial Aggregation Support for Hive UDAF

[ https://issues.apache.org/jira/browse/SPARK-10992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-10992: --- Assignee: Cheng Hao > Partial Aggregation Support for Hive UDAF > ---

[jira] [Resolved] (SPARK-10955) Disable dynamic allocation for Streaming jobs

[ https://issues.apache.org/jira/browse/SPARK-10955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-10955. --- Resolution: Fixed Assignee: Hari Shreedharan Fix Version/s: 1.6.0

[jira] [Updated] (SPARK-11019) [streaming] [flume] Gracefully shutdown Flume receiver threads

[ https://issues.apache.org/jira/browse/SPARK-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das updated SPARK-11019: -- Fix Version/s: (was: 1.5.2) > [streaming] [flume] Gracefully shutdown Flume receiver thread

[jira] [Resolved] (SPARK-11019) [streaming] [flume] Gracefully shutdown Flume receiver threads

[ https://issues.apache.org/jira/browse/SPARK-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-11019. --- Resolution: Fixed Assignee: Hari Shreedharan Fix Version/s: 1.6.0

[jira] [Assigned] (SPARK-11020) HistoryServer fails to come up if HDFS takes too long to come out of safe mode

[ https://issues.apache.org/jira/browse/SPARK-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11020: Assignee: (was: Apache Spark) > HistoryServer fails to come up if HDFS takes too long

[jira] [Commented] (SPARK-11020) HistoryServer fails to come up if HDFS takes too long to come out of safe mode

[ https://issues.apache.org/jira/browse/SPARK-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949746#comment-14949746 ] Apache Spark commented on SPARK-11020: -- User 'vanzin' has created a pull request for

[jira] [Assigned] (SPARK-11020) HistoryServer fails to come up if HDFS takes too long to come out of safe mode

[ https://issues.apache.org/jira/browse/SPARK-11020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11020: Assignee: Apache Spark > HistoryServer fails to come up if HDFS takes too long to come out

[jira] [Updated] (SPARK-10906) More efficient SparseMatrix.equals

[ https://issues.apache.org/jira/browse/SPARK-10906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10906: -- Shepherd: Joseph K. Bradley Target Version/s: 1.6.0 > More efficient Sparse

[jira] [Reopened] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley reopened SPARK-10973: --- Reopening to backport > __gettitem__ method throws IndexError exception when we try to a

[jira] [Resolved] (SPARK-10973) __gettitem__ method throws IndexError exception when we try to access index after the last non-zero entry.

[ https://issues.apache.org/jira/browse/SPARK-10973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-10973. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9009 [ht

[jira] [Assigned] (SPARK-8386) DataFrame and JDBC regression

[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8386: --- Assignee: Apache Spark > DataFrame and JDBC regression > - > >

[jira] [Assigned] (SPARK-8386) DataFrame and JDBC regression

[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8386: --- Assignee: (was: Apache Spark) > DataFrame and JDBC regression > -

[jira] [Commented] (SPARK-8386) DataFrame and JDBC regression

[ https://issues.apache.org/jira/browse/SPARK-8386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949727#comment-14949727 ] Apache Spark commented on SPARK-8386: - User 'huaxingao' has created a pull request for

[jira] [Created] (SPARK-11020) HistoryServer fails to come up if HDFS takes too long to come out of safe mode

Marcelo Vanzin created SPARK-11020: -- Summary: HistoryServer fails to come up if HDFS takes too long to come out of safe mode Key: SPARK-11020 URL: https://issues.apache.org/jira/browse/SPARK-11020 Pr

[jira] [Commented] (SPARK-9280) New HiveContext object unexpectedly loads configuration settings from history

[ https://issues.apache.org/jira/browse/SPARK-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949706#comment-14949706 ] Davies Liu commented on SPARK-9280: --- [~tien-dung.le] I check this with latest master (wi

[jira] [Commented] (SPARK-6540) Spark SQL thrift server fails to pass settings to following query in the same session

[ https://issues.apache.org/jira/browse/SPARK-6540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949700#comment-14949700 ] Davies Liu commented on SPARK-6540: --- [~alexliu68] Could you check that this is fixed in

[jira] [Resolved] (SPARK-8552) Using incorrect database in multiple sessions

[ https://issues.apache.org/jira/browse/SPARK-8552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-8552. --- Resolution: Fixed Assignee: Davies Liu Fix Version/s: 1.6.0 Resolved by https://github

[jira] [Assigned] (SPARK-11018) Support UDT in codegen and unsafe projection

[ https://issues.apache.org/jira/browse/SPARK-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11018: Assignee: Apache Spark (was: Davies Liu) > Support UDT in codegen and unsafe projection >

[jira] [Assigned] (SPARK-11018) Support UDT in codegen and unsafe projection

[ https://issues.apache.org/jira/browse/SPARK-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11018: Assignee: Davies Liu (was: Apache Spark) > Support UDT in codegen and unsafe projection >

[jira] [Commented] (SPARK-11018) Support UDT in codegen and unsafe projection

[ https://issues.apache.org/jira/browse/SPARK-11018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949691#comment-14949691 ] Apache Spark commented on SPARK-11018: -- User 'davies' has created a pull request for

[jira] [Resolved] (SPARK-10810) Improve session management for SQL

[ https://issues.apache.org/jira/browse/SPARK-10810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10810. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8909 [https://github.c

[jira] [Resolved] (SPARK-10902) Hive UDF current_database() does not work

[ https://issues.apache.org/jira/browse/SPARK-10902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10902. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8909 [https://github.c

[jira] [Resolved] (SPARK-10914) UnsafeRow serialization breaks when two machines have different Oops size

[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-10914. - Resolution: Fixed Assignee: Reynold Xin Fix Version/s: 1.6.0 1.

[jira] [Commented] (SPARK-10903) Make sqlContext global

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949657#comment-14949657 ] Hossein Falaki commented on SPARK-10903: I meant the SQL Context: https://github

[jira] [Assigned] (SPARK-11019) [streaming] [flume] Gracefully shutdown Flume receiver threads

[ https://issues.apache.org/jira/browse/SPARK-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11019: Assignee: Apache Spark > [streaming] [flume] Gracefully shutdown Flume receiver threads >

[jira] [Commented] (SPARK-11019) [streaming] [flume] Gracefully shutdown Flume receiver threads

[ https://issues.apache.org/jira/browse/SPARK-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949655#comment-14949655 ] Apache Spark commented on SPARK-11019: -- User 'harishreedharan' has created a pull re

[jira] [Assigned] (SPARK-11019) [streaming] [flume] Gracefully shutdown Flume receiver threads

[ https://issues.apache.org/jira/browse/SPARK-11019?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11019: Assignee: (was: Apache Spark) > [streaming] [flume] Gracefully shutdown Flume receiver

[jira] [Commented] (SPARK-10903) Make sqlContext global

[ https://issues.apache.org/jira/browse/SPARK-10903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949654#comment-14949654 ] Felix Cheung commented on SPARK-10903: -- +1 perhaps sparkR.init() should create sqlCo

[jira] [Created] (SPARK-11019) [streaming] [flume] Gracefully shutdown Flume receiver threads

Hari Shreedharan created SPARK-11019: Summary: [streaming] [flume] Gracefully shutdown Flume receiver threads Key: SPARK-11019 URL: https://issues.apache.org/jira/browse/SPARK-11019 Project: Spark

[jira] [Created] (SPARK-11018) Support UDT in codegen and unsafe projection

Davies Liu created SPARK-11018: -- Summary: Support UDT in codegen and unsafe projection Key: SPARK-11018 URL: https://issues.apache.org/jira/browse/SPARK-11018 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-11007) Add dictionary support for CatalystDecimalConverter

[ https://issues.apache.org/jira/browse/SPARK-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949616#comment-14949616 ] Apache Spark commented on SPARK-11007: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-11007) Add dictionary support for CatalystDecimalConverter

[ https://issues.apache.org/jira/browse/SPARK-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11007: Assignee: Apache Spark (was: Cheng Lian) > Add dictionary support for CatalystDecimalConv

[jira] [Assigned] (SPARK-11007) Add dictionary support for CatalystDecimalConverter

[ https://issues.apache.org/jira/browse/SPARK-11007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11007: Assignee: Cheng Lian (was: Apache Spark) > Add dictionary support for CatalystDecimalConv

[jira] [Updated] (SPARK-10599) Decrease communication in BlockMatrix multiply and increase performance

[ https://issues.apache.org/jira/browse/SPARK-10599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-10599: -- Shepherd: Joseph K. Bradley Assignee: Burak Yavuz Target Version

[jira] [Commented] (SPARK-10086) Flaky StreamingKMeans test in PySpark

[ https://issues.apache.org/jira/browse/SPARK-10086?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949615#comment-14949615 ] Joseph K. Bradley commented on SPARK-10086: --- CC: [~davies] When you have a cha

[jira] [Assigned] (SPARK-10665) Connect the local iterators with the planner

[ https://issues.apache.org/jira/browse/SPARK-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10665: Assignee: Yin Huai (was: Apache Spark) > Connect the local iterators with the planner > -

[jira] [Commented] (SPARK-10665) Connect the local iterators with the planner

[ https://issues.apache.org/jira/browse/SPARK-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949612#comment-14949612 ] Apache Spark commented on SPARK-10665: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-10665) Connect the local iterators with the planner

[ https://issues.apache.org/jira/browse/SPARK-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10665: Assignee: Apache Spark (was: Yin Huai) > Connect the local iterators with the planner > -

[jira] [Resolved] (SPARK-6774) Implement Parquet complex types backwards-compatiblity rules

[ https://issues.apache.org/jira/browse/SPARK-6774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-6774. --- Resolution: Fixed Finally, fixed all the Parquet compatibility issues after 6 months! > Implement Par

[jira] [Resolved] (SPARK-8848) Write Parquet LISTs and MAPs conforming to Parquet format spec

[ https://issues.apache.org/jira/browse/SPARK-8848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-8848. --- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8988 [https://github.com/

[jira] [Commented] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

[ https://issues.apache.org/jira/browse/SPARK-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949576#comment-14949576 ] Apache Spark commented on SPARK-11017: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

[ https://issues.apache.org/jira/browse/SPARK-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11017: Assignee: Josh Rosen (was: Apache Spark) > Support ImperativeAggregates in TungstenAggreg

[jira] [Assigned] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

[ https://issues.apache.org/jira/browse/SPARK-11017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-11017: Assignee: Apache Spark (was: Josh Rosen) > Support ImperativeAggregates in TungstenAggreg

[jira] [Created] (SPARK-11017) Support ImperativeAggregates in TungstenAggregate

Josh Rosen created SPARK-11017: -- Summary: Support ImperativeAggregates in TungstenAggregate Key: SPARK-11017 URL: https://issues.apache.org/jira/browse/SPARK-11017 Project: Spark Issue Type: Imp

[jira] [Created] (SPARK-11016) Spark fails when running with a task that requires a more recent version of RoaringBitmaps

Charles Allen created SPARK-11016: - Summary: Spark fails when running with a task that requires a more recent version of RoaringBitmaps Key: SPARK-11016 URL: https://issues.apache.org/jira/browse/SPARK-11016

[jira] [Commented] (SPARK-6723) Model import/export for ChiSqSelector

[ https://issues.apache.org/jira/browse/SPARK-6723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949548#comment-14949548 ] Jayant Shekhar commented on SPARK-6723: --- Thanks [~fliang] [~mengxr] Can you trigger

[jira] [Commented] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949525#comment-14949525 ] Charles Allen commented on SPARK-5949: -- [~lemire] pinging to see if you have any sugg

[jira] [Commented] (SPARK-5949) Driver program has to register roaring bitmap classes used by spark with Kryo when number of partitions is greater than 2000

[ https://issues.apache.org/jira/browse/SPARK-5949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949518#comment-14949518 ] Charles Allen commented on SPARK-5949: -- This breaks when using more recent versions o

[jira] [Commented] (SPARK-10892) Join with Data Frame returns wrong results

[ https://issues.apache.org/jira/browse/SPARK-10892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949507#comment-14949507 ] Wenchen Fan commented on SPARK-10892: - a workaround is using $"prcp.value" instead of

[jira] [Assigned] (SPARK-10991) LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set

[ https://issues.apache.org/jira/browse/SPARK-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10991: Assignee: (was: Apache Spark) > LogisticRegressionTrainingSummary should dynamically a

[jira] [Commented] (SPARK-10991) LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set

[ https://issues.apache.org/jira/browse/SPARK-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949484#comment-14949484 ] Apache Spark commented on SPARK-10991: -- User 'holdenk' has created a pull request fo

[jira] [Assigned] (SPARK-10991) LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set

[ https://issues.apache.org/jira/browse/SPARK-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10991: Assignee: Apache Spark > LogisticRegressionTrainingSummary should dynamically add predicti

[jira] [Updated] (SPARK-10991) LogisticRegressionTrainingSummary should dynamically add prediction col if there is no prediction col set

[ https://issues.apache.org/jira/browse/SPARK-10991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-10991: Description: LogisticRegression training summary should still function if the predictionCol is set to an em

[jira] [Commented] (SPARK-10326) Cannot launch YARN job on Windows

[ https://issues.apache.org/jira/browse/SPARK-10326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949470#comment-14949470 ] Marcelo Vanzin commented on SPARK-10326: Ah, that's similar but not the same bug;

[jira] [Resolved] (SPARK-10988) Reduce duplication in Aggregate2's expression rewriting logic

[ https://issues.apache.org/jira/browse/SPARK-10988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10988. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9015 [https://github.com/a

[jira] [Created] (SPARK-11015) Add computeCost and clusterCenters to KMeansModel in spark.ml package

Richard Garris created SPARK-11015: -- Summary: Add computeCost and clusterCenters to KMeansModel in spark.ml package Key: SPARK-11015 URL: https://issues.apache.org/jira/browse/SPARK-11015 Project: Sp

[jira] [Commented] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949432#comment-14949432 ] Apache Spark commented on SPARK-8654: - User 'dilipbiswal' has created a pull request f

[jira] [Resolved] (SPARK-10993) Inital code generated encoder for product types

[ https://issues.apache.org/jira/browse/SPARK-10993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-10993. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9019 [https://github.com/a

[jira] [Commented] (SPARK-11014) RPC Time Out Exceptions

[ https://issues.apache.org/jira/browse/SPARK-11014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949404#comment-14949404 ] Sean Owen commented on SPARK-11014: --- This itself doesn't mean much. It means something

[jira] [Created] (SPARK-11014) RPC Time Out Exceptions

Gurpreet Singh created SPARK-11014: -- Summary: RPC Time Out Exceptions Key: SPARK-11014 URL: https://issues.apache.org/jira/browse/SPARK-11014 Project: Spark Issue Type: Bug Affects Versi

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949372#comment-14949372 ] Apache Spark commented on SPARK-10858: -- User 'tgravescs' has created a pull request

[jira] [Assigned] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10858: Assignee: Apache Spark (was: Thomas Graves) > YARN: archives/jar/files rename with # does

[jira] [Assigned] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10858: Assignee: Thomas Graves (was: Apache Spark) > YARN: archives/jar/files rename with # does

[jira] [Reopened] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust reopened SPARK-8654: - This broke tests and got reverted. > Analysis exception when using "NULL IN (...)": invalid c

[jira] [Commented] (SPARK-8546) PMML export for Naive Bayes

[ https://issues.apache.org/jira/browse/SPARK-8546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949361#comment-14949361 ] Xusen Yin commented on SPARK-8546: -- Hi [~mengxr], I'd like to work on it. > PMML export

[jira] [Commented] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949360#comment-14949360 ] Apache Spark commented on SPARK-8654: - User 'marmbrus' has created a pull request for

[jira] [Assigned] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8170: --- Assignee: Apache Spark > Ctrl-C in pyspark shell doesn't kill running job > -

[jira] [Assigned] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8170: --- Assignee: (was: Apache Spark) > Ctrl-C in pyspark shell doesn't kill running job > --

[jira] [Commented] (SPARK-8170) Ctrl-C in pyspark shell doesn't kill running job

[ https://issues.apache.org/jira/browse/SPARK-8170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949358#comment-14949358 ] Apache Spark commented on SPARK-8170: - User 'ashwinshankar77' has created a pull reque

[jira] [Commented] (SPARK-10337) Views are broken

[ https://issues.apache.org/jira/browse/SPARK-10337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949353#comment-14949353 ] Apache Spark commented on SPARK-10337: -- User 'cloud-fan' has created a pull request

[jira] [Commented] (SPARK-10858) YARN: archives/jar/files rename with # doesn't work unless scheme given

[ https://issues.apache.org/jira/browse/SPARK-10858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949334#comment-14949334 ] Thomas Graves commented on SPARK-10858: --- so now I'm really confused why this is bac

[jira] [Commented] (SPARK-10382) Make example code in user guide testable

[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949326#comment-14949326 ] Xusen Yin commented on SPARK-10382: --- Or I can custom it to use in Spark project easily.

[jira] [Commented] (SPARK-10382) Make example code in user guide testable

[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949324#comment-14949324 ] Xusen Yin commented on SPARK-10382: --- Hi Xiangrui, As far as I know, there are several

[jira] [Commented] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

[ https://issues.apache.org/jira/browse/SPARK-11013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949318#comment-14949318 ] Wenchen Fan commented on SPARK-11013: - cc [~zsxwing] > SparkPlan may mistakenly regi

[jira] [Created] (SPARK-11013) SparkPlan may mistakenly register child plan's accumulators for SQL metrics

Wenchen Fan created SPARK-11013: --- Summary: SparkPlan may mistakenly register child plan's accumulators for SQL metrics Key: SPARK-11013 URL: https://issues.apache.org/jira/browse/SPARK-11013 Project: Sp

[jira] [Commented] (SPARK-10930) History "Stages" page "duration" can be confusing

[ https://issues.apache.org/jira/browse/SPARK-10930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949313#comment-14949313 ] Derek Dagit commented on SPARK-10930: - We should create a new column with the maximum

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949308#comment-14949308 ] Prasad Chalasani commented on SPARK-11008: -- I don't think you can reproduce in l

[jira] [Commented] (SPARK-10936) UDAF "mode" for categorical variables

[ https://issues.apache.org/jira/browse/SPARK-10936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949306#comment-14949306 ] Frederick Reiss commented on SPARK-10936: - Mode is not an algebraic aggregate. T

[jira] [Commented] (SPARK-11005) Spark 1.5 Shuffle performance - (sort-based shuffle)

[ https://issues.apache.org/jira/browse/SPARK-11005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949305#comment-14949305 ] Sandeep Pal commented on SPARK-11005: - Ok, Thanks > Spark 1.5 Shuffle performance -

[jira] [Comment Edited] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949300#comment-14949300 ] Herman van Hovell edited comment on SPARK-11008 at 10/8/15 8:09 PM: ---

[jira] [Commented] (SPARK-11008) Spark window function returns inconsistent/wrong results

[ https://issues.apache.org/jira/browse/SPARK-11008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14949300#comment-14949300 ] Herman van Hovell commented on SPARK-11008: --- Hi, I have tried your code in loca

  1   2   3   >