[jira] [Comment Edited] (SPARK-13065) streaming-twitter pass twitter4j.FilterQuery argument to TwitterUtils.createStream()

[ https://issues.apache.org/jira/browse/SPARK-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128832#comment-15128832 ] Andrew Davidson edited comment on SPARK-13065 at 2/2/16 7:20 PM: - Hi

[jira] [Updated] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13094: - Assignee: Michael Armbrust > No encoder implicits for Seq[Primitive] >

[jira] [Resolved] (SPARK-12783) Dataset map serialization error

[ https://issues.apache.org/jira/browse/SPARK-12783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12783. -- Resolution: Fixed Fix Version/s: 1.6.1 Closing, please reopen if you can

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128745#comment-15128745 ] Wenchen Fan commented on SPARK-12988: - I'd also like to forbid to use invalid column names in `drop`

[jira] [Resolved] (SPARK-12631) Make Parameter Descriptions Consistent for PySpark MLlib Clustering

[ https://issues.apache.org/jira/browse/SPARK-12631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-12631. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10610

[jira] [Commented] (SPARK-13120) Shade protobuf-java

[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128759#comment-15128759 ] Ted Yu commented on SPARK-13120: https://groups.google.com/forum/#!topic/protobuf/wAqvtPLBsE8 PB2 and

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128829#comment-15128829 ] Yan commented on SPARK-12988: - My thinking is that projections should parse the column names; while the

[jira] [Updated] (SPARK-13065) streaming-twitter pass twitter4j.FilterQuery argument to TwitterUtils.createStream()

[ https://issues.apache.org/jira/browse/SPARK-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-13065: Description: The twitter stream api is very powerful provides a lot of support for

[jira] [Resolved] (SPARK-12711) ML StopWordsRemover does not protect itself from column name duplication

[ https://issues.apache.org/jira/browse/SPARK-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-12711. --- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue

[jira] [Commented] (SPARK-11293) Spillable collections leak shuffle memory

[ https://issues.apache.org/jira/browse/SPARK-11293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128935#comment-15128935 ] Mridul Muralidharan commented on SPARK-11293: - Not iterating to the end has a bunch of issues

[jira] [Resolved] (SPARK-13094) No encoder implicits for Seq[Primitive]

[ https://issues.apache.org/jira/browse/SPARK-13094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-13094. -- Resolution: Fixed Fix Version/s: 1.6.1 2.0.0 Issue resolved

[jira] [Updated] (SPARK-12780) Inconsistency returning value of ML python models' properties

[ https://issues.apache.org/jira/browse/SPARK-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12780: -- Fix Version/s: 1.6.1 > Inconsistency returning value of ML python models' properties >

[jira] [Updated] (SPARK-13002) Mesos scheduler backend does not follow the property spark.dynamicAllocation.initialExecutors

[ https://issues.apache.org/jira/browse/SPARK-13002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-13002: - Target Version/s: 2.0.0 (was: 1.6.1, 2.0.0) > Mesos scheduler backend does not follow

[jira] [Resolved] (SPARK-12913) Reimplement stat functions as declarative function

[ https://issues.apache.org/jira/browse/SPARK-12913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12913. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10960

[jira] [Resolved] (SPARK-13114) java.lang.NegativeArraySizeException in CSV

[ https://issues.apache.org/jira/browse/SPARK-13114?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13114. - Resolution: Fixed Assignee: Hyukjin Kwon Fix Version/s: 2.0.0 >

[jira] [Updated] (SPARK-13065) streaming-twitter pass twitter4j.FilterQuery argument to TwitterUtils.createStream()

[ https://issues.apache.org/jira/browse/SPARK-13065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Davidson updated SPARK-13065: Attachment: twitterFilterQueryPatch.tar.gz sorry bad name. its not in patch format >

[jira] [Updated] (SPARK-12711) ML StopWordsRemover does not protect itself from column name duplication

[ https://issues.apache.org/jira/browse/SPARK-12711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-12711: -- Assignee: Grzegorz Chilkiewicz > ML StopWordsRemover does not protect itself from

[jira] [Commented] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128871#comment-15128871 ] Apache Spark commented on SPARK-13121: -- User 'gabrielenizzoli' has created a pull request for this

[jira] [Comment Edited] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128902#comment-15128902 ] Dilip Biswal edited comment on SPARK-12988 at 2/2/16 7:56 PM: -- The subtle

[jira] [Commented] (SPARK-13009) spark-streaming-twitter_2.10 does not make it possible to access the raw twitter json

[ https://issues.apache.org/jira/browse/SPARK-13009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128843#comment-15128843 ] Andrew Davidson commented on SPARK-13009: - I Sean I total agree with you. The Twitter4j people

[jira] [Commented] (SPARK-12988) Can't drop columns that contain dots

[ https://issues.apache.org/jira/browse/SPARK-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128902#comment-15128902 ] Dilip Biswal commented on SPARK-12988: -- The shuttle difference between column path and column name

[jira] [Commented] (SPARK-13126) History Server page always has horizontal scrollbar

[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128927#comment-15128927 ] Zhuo Liu commented on SPARK-13126: -- Hi Alex, thanks for testing that out. I came up with the fix for

[jira] [Assigned] (SPARK-13126) History Server page always has horizontal scrollbar

[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13126: Assignee: (was: Apache Spark) > History Server page always has horizontal scrollbar >

[jira] [Assigned] (SPARK-13126) History Server page always has horizontal scrollbar

[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13126: Assignee: Apache Spark > History Server page always has horizontal scrollbar >

[jira] [Assigned] (SPARK-13146) API for managing streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13146: Assignee: Tathagata Das (was: Apache Spark) > API for managing streaming dataframes >

[jira] [Resolved] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-13121. -- Resolution: Fixed Fix Version/s: 2.0.0 > java mapWithState mishandles scala Option >

[jira] [Created] (SPARK-13147) improve readability of generated code

Davies Liu created SPARK-13147: -- Summary: improve readability of generated code Key: SPARK-13147 URL: https://issues.apache.org/jira/browse/SPARK-13147 Project: Spark Issue Type: Improvement

[jira] [Created] (SPARK-13146) API for managing streaming dataframes

Tathagata Das created SPARK-13146: - Summary: API for managing streaming dataframes Key: SPARK-13146 URL: https://issues.apache.org/jira/browse/SPARK-13146 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7997) Remove the developer api SparkEnv.actorSystem and AkkaUtils

[ https://issues.apache.org/jira/browse/SPARK-7997?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129019#comment-15129019 ] Apache Spark commented on SPARK-7997: - User 'zsxwing' has created a pull request for this issue:

[jira] [Updated] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13121: - Assignee: Gabriele Nizzoli > java mapWithState mishandles scala Option >

[jira] [Assigned] (SPARK-13147) improve readability of generated code

[ https://issues.apache.org/jira/browse/SPARK-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13147: Assignee: Davies Liu (was: Apache Spark) > improve readability of generated code >

[jira] [Commented] (SPARK-13147) improve readability of generated code

[ https://issues.apache.org/jira/browse/SPARK-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129108#comment-15129108 ] Apache Spark commented on SPARK-13147: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13147) improve readability of generated code

[ https://issues.apache.org/jira/browse/SPARK-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13147: Assignee: Apache Spark (was: Davies Liu) > improve readability of generated code >

[jira] [Created] (SPARK-13148) support zero-keytab Oozie application launch on a secure cluster

Steve Loughran created SPARK-13148: -- Summary: support zero-keytab Oozie application launch on a secure cluster Key: SPARK-13148 URL: https://issues.apache.org/jira/browse/SPARK-13148 Project: Spark

[jira] [Commented] (SPARK-13148) support zero-keytab Oozie application launch on a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129136#comment-15129136 ] Steve Loughran commented on SPARK-13148: Note that Hadoop's UGI class automatically loads the

[jira] [Commented] (SPARK-13148) support zero-keytab Oozie application launch on a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129176#comment-15129176 ] Apache Spark commented on SPARK-13148: -- User 'steveloughran' has created a pull request for this

[jira] [Assigned] (SPARK-13148) support zero-keytab Oozie application launch on a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13148: Assignee: Apache Spark > support zero-keytab Oozie application launch on a secure cluster

[jira] [Assigned] (SPARK-13148) support zero-keytab Oozie application launch on a secure cluster

[ https://issues.apache.org/jira/browse/SPARK-13148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13148: Assignee: (was: Apache Spark) > support zero-keytab Oozie application launch on a

[jira] [Assigned] (SPARK-13146) API for managing streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13146: Assignee: Apache Spark (was: Tathagata Das) > API for managing streaming dataframes >

[jira] [Commented] (SPARK-13146) API for managing streaming dataframes

[ https://issues.apache.org/jira/browse/SPARK-13146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129010#comment-15129010 ] Apache Spark commented on SPARK-13146: -- User 'tdas' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13149) Add FileStreamSource and a simple version of FileStreamSink

[ https://issues.apache.org/jira/browse/SPARK-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13149: Assignee: Shixiong Zhu (was: Apache Spark) > Add FileStreamSource and a simple version

[jira] [Assigned] (SPARK-13149) Add FileStreamSource and a simple version of FileStreamSink

[ https://issues.apache.org/jira/browse/SPARK-13149?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13149: Assignee: Apache Spark (was: Shixiong Zhu) > Add FileStreamSource and a simple version

[jira] [Created] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

Davies Liu created SPARK-13150: -- Summary: Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session Key: SPARK-13150 URL: https://issues.apache.org/jira/browse/SPARK-13150

[jira] [Assigned] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13101: Assignee: Apache Spark > Dataset complex types mapping to DataFrame (element

[jira] [Commented] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129347#comment-15129347 ] Apache Spark commented on SPARK-13101: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13101) Dataset complex types mapping to DataFrame (element nullability) mismatch

[ https://issues.apache.org/jira/browse/SPARK-13101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13101: Assignee: (was: Apache Spark) > Dataset complex types mapping to DataFrame (element

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129239#comment-15129239 ] Davies Liu commented on SPARK-13150: This one usually fail together :

[jira] [Created] (SPARK-13149) Add FileStreamSource and a simple version of FileStreamSink

Shixiong Zhu created SPARK-13149: Summary: Add FileStreamSource and a simple version of FileStreamSink Key: SPARK-13149 URL: https://issues.apache.org/jira/browse/SPARK-13149 Project: Spark

[jira] [Updated] (SPARK-13122) Race condition in MemoryStore.unrollSafely() causes memory leak

[ https://issues.apache.org/jira/browse/SPARK-13122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-13122: -- Assignee: Adam Budde > Race condition in MemoryStore.unrollSafely() causes memory leak >

[jira] [Updated] (SPARK-13151) Investigate replacing SynchronizedBuffer as it is deprecated/unreliable

[ https://issues.apache.org/jira/browse/SPARK-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13151: Component/s: Spark Core > Investigate replacing SynchronizedBuffer as it is deprecated/unreliable >

[jira] [Reopened] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reopened SPARK-13150: not fixed yet > Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test > single

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129556#comment-15129556 ] Cheng Lian commented on SPARK-13150: Seems that ADD JAR command in both flaky tests may fail silently

[jira] [Assigned] (SPARK-12991) Establish correspondence between SparkPlan and LogicalPlan nodes

[ https://issues.apache.org/jira/browse/SPARK-12991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12991: Assignee: Apache Spark > Establish correspondence between SparkPlan and LogicalPlan nodes

[jira] [Assigned] (SPARK-12991) Establish correspondence between SparkPlan and LogicalPlan nodes

[ https://issues.apache.org/jira/browse/SPARK-12991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-12991: Assignee: (was: Apache Spark) > Establish correspondence between SparkPlan and

[jira] [Commented] (SPARK-12991) Establish correspondence between SparkPlan and LogicalPlan nodes

[ https://issues.apache.org/jira/browse/SPARK-12991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129429#comment-15129429 ] Apache Spark commented on SPARK-12991: -- User 'mbautin' has created a pull request for this issue:

[jira] [Resolved] (SPARK-13020) fix random generator for map type

[ https://issues.apache.org/jira/browse/SPARK-13020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-13020. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10930

[jira] [Commented] (SPARK-11838) Spark SQL query fragment RDD reuse

[ https://issues.apache.org/jira/browse/SPARK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129534#comment-15129534 ] Wenchen Fan commented on SPARK-11838: - Can the new `StreamFrame` satisfy this requirement(avoid

[jira] [Assigned] (SPARK-13124) Adding JQuery DataTables messed up the Web UI css and js

[ https://issues.apache.org/jira/browse/SPARK-13124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13124: Assignee: (was: Apache Spark) > Adding JQuery DataTables messed up the Web UI css and

[jira] [Assigned] (SPARK-13124) Adding JQuery DataTables messed up the Web UI css and js

[ https://issues.apache.org/jira/browse/SPARK-13124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13124: Assignee: Apache Spark > Adding JQuery DataTables messed up the Web UI css and js >

[jira] [Commented] (SPARK-13124) Adding JQuery DataTables messed up the Web UI css and js

[ https://issues.apache.org/jira/browse/SPARK-13124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129533#comment-15129533 ] Apache Spark commented on SPARK-13124: -- User 'ajbozarth' has created a pull request for this issue:

[jira] [Updated] (SPARK-12986) Fix pydoc warnings in mllib/regression.py

[ https://issues.apache.org/jira/browse/SPARK-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-12986: -- Assignee: Nam Pham (was: Yu Ishikawa) > Fix pydoc warnings in mllib/regression.py >

[jira] [Commented] (SPARK-12986) Fix pydoc warnings in mllib/regression.py

[ https://issues.apache.org/jira/browse/SPARK-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129541#comment-15129541 ] Xiangrui Meng commented on SPARK-12986: --- [~holdenk] I think it is useful to check the pydoc

[jira] [Assigned] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3611: --- Assignee: Apache Spark > Show number of cores for each executor in application web UI >

[jira] [Commented] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129542#comment-15129542 ] Apache Spark commented on SPARK-3611: - User 'ajbozarth' has created a pull request for this issue:

[jira] [Assigned] (SPARK-3611) Show number of cores for each executor in application web UI

[ https://issues.apache.org/jira/browse/SPARK-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-3611: --- Assignee: (was: Apache Spark) > Show number of cores for each executor in application

[jira] [Commented] (SPARK-12291) Support UnsafeRow in BroadcastLeftSemiJoinHash

[ https://issues.apache.org/jira/browse/SPARK-12291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129369#comment-15129369 ] Apache Spark commented on SPARK-12291: -- User 'mbautin' has created a pull request for this issue:

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129433#comment-15129433 ] Apache Spark commented on SPARK-13150: -- User 'davies' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13150: Assignee: Apache Spark (was: Cheng Lian) > Flaky test:

[jira] [Assigned] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13150: Assignee: Cheng Lian (was: Apache Spark) > Flaky test:

[jira] [Updated] (SPARK-13020) fix random generator for map type

[ https://issues.apache.org/jira/browse/SPARK-13020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-13020: - Assignee: Wenchen Fan > fix random generator for map type > - > >

[jira] [Created] (SPARK-13151) Investigate replacing SynchronizedBuffer as it is deprecated/unreliable

holdenk created SPARK-13151: --- Summary: Investigate replacing SynchronizedBuffer as it is deprecated/unreliable Key: SPARK-13151 URL: https://issues.apache.org/jira/browse/SPARK-13151 Project: Spark

[jira] [Resolved] (SPARK-12992) Vectorize parquet decoding using ColumnarBatch

[ https://issues.apache.org/jira/browse/SPARK-12992?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-12992. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10908

[jira] [Created] (SPARK-13152) Fix task metrics deprecation warning

holdenk created SPARK-13152: --- Summary: Fix task metrics deprecation warning Key: SPARK-13152 URL: https://issues.apache.org/jira/browse/SPARK-13152 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-6476) Spark fileserver not started on same IP as using spark.driver.host

[ https://issues.apache.org/jira/browse/SPARK-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129567#comment-15129567 ] Hao Xia commented on SPARK-6476: I found a workaround by setting env SPARK_LOCAL_IP on the driver > Spark

[jira] [Assigned] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13150: Assignee: Cheng Lian (was: Apache Spark) > Flaky test:

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129598#comment-15129598 ] Apache Spark commented on SPARK-13150: -- User 'liancheng' has created a pull request for this issue:

[jira] [Assigned] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13150: Assignee: Apache Spark (was: Cheng Lian) > Flaky test:

[jira] [Updated] (SPARK-12629) SparkR: DataFrame's saveAsTable method has issues with the signature and HiveContext

[ https://issues.apache.org/jira/browse/SPARK-12629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shivaram Venkataraman updated SPARK-12629: -- Fix Version/s: 1.6.1 > SparkR: DataFrame's saveAsTable method has issues with

[jira] [Created] (SPARK-13145) checkAnswer should tolerate small float number error

Davies Liu created SPARK-13145: -- Summary: checkAnswer should tolerate small float number error Key: SPARK-13145 URL: https://issues.apache.org/jira/browse/SPARK-13145 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-13138) Add "logical" package prefix for ddl.scala

[ https://issues.apache.org/jira/browse/SPARK-13138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-13138. - Resolution: Fixed Fix Version/s: 2.0.0 > Add "logical" package prefix for ddl.scala >

[jira] [Commented] (SPARK-13156) JDBC using multiple partitions creates additional tasks but only executes on one

[ https://issues.apache.org/jira/browse/SPARK-13156?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129815#comment-15129815 ] Sean Owen commented on SPARK-13156: --- It just sounds like your data is skewed. Are you sure that's not

[jira] [Commented] (SPARK-13151) Investigate replacing SynchronizedBuffer as it is deprecated/unreliable

[ https://issues.apache.org/jira/browse/SPARK-13151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129816#comment-15129816 ] Sean Owen commented on SPARK-13151: --- +1 to this and your next JIRA > Investigate replacing

[jira] [Commented] (SPARK-13120) Shade protobuf-java

[ https://issues.apache.org/jira/browse/SPARK-13120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129820#comment-15129820 ] Sean Owen commented on SPARK-13120: --- Yeah, aren't you also saying this wouldn't help? And it is still

[jira] [Resolved] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13125. --- Resolution: Not A Problem Target Version/s: (was: 2.0.0) > makes the ratio of KafkaRDD

[jira] [Commented] (SPARK-13150) Flaky test: org.apache.spark.sql.hive.thriftserver.SingleSessionSuite.test single session

[ https://issues.apache.org/jira/browse/SPARK-13150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129857#comment-15129857 ] Cheng Lian commented on SPARK-13150: Please refer to [this PR

[jira] [Commented] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129860#comment-15129860 ] zhengcanbin commented on SPARK-13125: - Yes, you are right, but shuffle will increase net burden, and

[jira] [Commented] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129867#comment-15129867 ] zhengcanbin commented on SPARK-13125: - Shuffle will increase net burden, and number of partitions is

[jira] [Comment Edited] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129867#comment-15129867 ] zhengcanbin edited comment on SPARK-13125 at 2/3/16 6:08 AM: - Shuffle will

[jira] [Reopened] (SPARK-13125) makes the ratio of KafkaRDD partition to kafka topic partition configurable.

[ https://issues.apache.org/jira/browse/SPARK-13125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] zhengcanbin reopened SPARK-13125: - Shuffle will increase net burden, and number of partitions is limited by total number of disk. In

[jira] [Resolved] (SPARK-13147) improve readability of generated code

[ https://issues.apache.org/jira/browse/SPARK-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-13147. Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11032

[jira] [Resolved] (SPARK-10820) Initial infrastructure

[ https://issues.apache.org/jira/browse/SPARK-10820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-10820. -- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 11006

[jira] [Updated] (SPARK-13121) java mapWithState mishandles scala Option

[ https://issues.apache.org/jira/browse/SPARK-13121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-13121: - Fix Version/s: 1.6.1 > java mapWithState mishandles scala Option >

[jira] [Commented] (SPARK-13126) History Server page always has horizontal scrollbar

[ https://issues.apache.org/jira/browse/SPARK-13126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15128928#comment-15128928 ] Apache Spark commented on SPARK-13126: -- User 'zhuoliu' has created a pull request for this issue:

[jira] [Issue Comment Deleted] (SPARK-12811) Estimator interface for generalized linear models (GLMs)

[ https://issues.apache.org/jira/browse/SPARK-12811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-12811: Comment: was deleted (was: Should we put it under a new folder named "ml/glm"?) > Estimator

[jira] [Commented] (SPARK-12986) Fix pydoc warnings in mllib/regression.py

[ https://issues.apache.org/jira/browse/SPARK-12986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129760#comment-15129760 ] holdenk commented on SPARK-12986: - Sure :) > Fix pydoc warnings in mllib/regression.py >

[jira] [Updated] (SPARK-13154) Add pydoc lint for docs

[ https://issues.apache.org/jira/browse/SPARK-13154?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated SPARK-13154: Component/s: PySpark > Add pydoc lint for docs > --- > > Key:

[jira] [Created] (SPARK-13154) Add pydoc lint for docs

holdenk created SPARK-13154: --- Summary: Add pydoc lint for docs Key: SPARK-13154 URL: https://issues.apache.org/jira/browse/SPARK-13154 Project: Spark Issue Type: Improvement Reporter:

[jira] [Resolved] (SPARK-12732) Fix LinearRegression.train for the case when label is constant and fitIntercept=false

[ https://issues.apache.org/jira/browse/SPARK-12732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai resolved SPARK-12732. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request 10702

[jira] [Created] (SPARK-13155) add runtime null check when convert catalyst array to external array

Wenchen Fan created SPARK-13155: --- Summary: add runtime null check when convert catalyst array to external array Key: SPARK-13155 URL: https://issues.apache.org/jira/browse/SPARK-13155 Project: Spark

[jira] [Commented] (SPARK-13069) ActorHelper is not throttled by rate limiter

[ https://issues.apache.org/jira/browse/SPARK-13069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15129787#comment-15129787 ] sachin aggarwal commented on SPARK-13069: - As of Spark 2.0 (not yet released), Spark does not use

  1   2   3   >