[jira] [Assigned] (SPARK-9828) Should not share `{}` among instances

[ https://issues.apache.org/jira/browse/SPARK-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9828: --- Assignee: Manoj Kumar (was: Apache Spark) > Should not share `{}` among instances >

[jira] [Commented] (SPARK-9828) Should not share `{}` among instances

[ https://issues.apache.org/jira/browse/SPARK-9828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682254#comment-14682254 ] Apache Spark commented on SPARK-9828: - User 'MechCoder' has created a pull request for

[jira] [Assigned] (SPARK-9831) TPCDS Q73 Fails

[ https://issues.apache.org/jira/browse/SPARK-9831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9831: - Assignee: Davies Liu > TPCDS Q73 Fails > --- > > Key: SPARK-9831 >

[jira] [Assigned] (SPARK-9832) TPCDS Q98 Fails

[ https://issues.apache.org/jira/browse/SPARK-9832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu reassigned SPARK-9832: - Assignee: Davies Liu > TPCDS Q98 Fails > --- > > Key: SPARK-9832 >

[jira] [Resolved] (SPARK-8764) StringIndexer should take option to handle unseen values

[ https://issues.apache.org/jira/browse/SPARK-8764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley resolved SPARK-8764. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7266 [https

[jira] [Updated] (SPARK-9714) Cannot insert into a table using pySpark

[ https://issues.apache.org/jira/browse/SPARK-9714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai updated SPARK-9714: Issue Type: Sub-task (was: Bug) Parent: SPARK-9565 > Cannot insert into a table using pySpark > ---

[jira] [Commented] (SPARK-8989) Support aggregations in HAVING clause

[ https://issues.apache.org/jira/browse/SPARK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682242#comment-14682242 ] Reynold Xin commented on SPARK-8989: Thanks for looking at this, [~piccolbo]. > Suppo

[jira] [Commented] (SPARK-9826) Cannot use custom classes in log4j.properties

[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682233#comment-14682233 ] Apache Spark commented on SPARK-9826: - User 'michellemay' has created a pull request f

[jira] [Assigned] (SPARK-9826) Cannot use custom classes in log4j.properties

[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9826: --- Assignee: Apache Spark > Cannot use custom classes in log4j.properties >

[jira] [Assigned] (SPARK-9826) Cannot use custom classes in log4j.properties

[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9826: --- Assignee: (was: Apache Spark) > Cannot use custom classes in log4j.properties > -

[jira] [Commented] (SPARK-1006) MLlib ALS gets stack overflow with too many iterations

[ https://issues.apache.org/jira/browse/SPARK-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682235#comment-14682235 ] Anuradha Uduwage commented on SPARK-1006: - Is there away to find out which build f

[jira] [Closed] (SPARK-8989) Support aggregations in HAVING clause

[ https://issues.apache.org/jira/browse/SPARK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Antonio Piccolboni closed SPARK-8989. - Resolution: Not A Problem Seems SQLite specific. Most likely not a priority for SparkSQL t

[jira] [Created] (SPARK-9832) TPCDS Q98 Fails

Michael Armbrust created SPARK-9832: --- Summary: TPCDS Q98 Fails Key: SPARK-9832 URL: https://issues.apache.org/jira/browse/SPARK-9832 Project: Spark Issue Type: Sub-task Components

[jira] [Commented] (SPARK-8989) Support aggregations in HAVING clause

[ https://issues.apache.org/jira/browse/SPARK-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682231#comment-14682231 ] Antonio Piccolboni commented on SPARK-8989: --- Test schema and data CREATE TABLE

[jira] [Created] (SPARK-9831) TPCDS Q73 Fails

Michael Armbrust created SPARK-9831: --- Summary: TPCDS Q73 Fails Key: SPARK-9831 URL: https://issues.apache.org/jira/browse/SPARK-9831 Project: Spark Issue Type: Sub-task Components

[jira] [Commented] (SPARK-9827) Too many open files in TungstenExchange

[ https://issues.apache.org/jira/browse/SPARK-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682225#comment-14682225 ] Josh Rosen commented on SPARK-9827: --- I'm investigating this now by trying to use YourKit

[jira] [Updated] (SPARK-9827) Too many open files in TungstenExchange

[ https://issues.apache.org/jira/browse/SPARK-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9827: -- Sprint: Spark 1.5 release > Too many open files in TungstenExchange > --

[jira] [Commented] (SPARK-8724) Need documentation on how to deploy or use SparkR in Spark 1.4.0+

[ https://issues.apache.org/jira/browse/SPARK-8724?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682219#comment-14682219 ] Shivaram Venkataraman commented on SPARK-8724: -- [~cantdutchthis] One thing we

[jira] [Created] (SPARK-9830) Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

Yin Huai created SPARK-9830: --- Summary: Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s Key: SPARK-9830 URL: https://issues.apache.org/jira/browse/SPARK-9830 Project

[jira] [Resolved] (SPARK-9257) Fix the false negative of Aggregate2Sort and FinalAndCompleteAggregate2Sort's missingInput

[ https://issues.apache.org/jira/browse/SPARK-9257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9257. - Resolution: Fixed Fix Version/s: 1.5.0 After the clean up done by SPARK-9630, seems the problem has

[jira] [Assigned] (SPARK-9827) Too many open files in TungstenExchange

[ https://issues.apache.org/jira/browse/SPARK-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen reassigned SPARK-9827: - Assignee: Josh Rosen > Too many open files in TungstenExchange >

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682189#comment-14682189 ] Zhan Zhang commented on SPARK-5111: --- [~adkathu...@yahoo.com] Hive is upgrade to 1.2 in s

[jira] [Resolved] (SPARK-8345) Add an SQL node as a feature transformer

[ https://issues.apache.org/jira/browse/SPARK-8345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-8345. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 7465 [https://githu

[jira] [Updated] (SPARK-9829) peakExecutionMemory is not correct

[ https://issues.apache.org/jira/browse/SPARK-9829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9829: -- Description: When run a query with 8G memory, the peakExecutionMemory in WebUI said that 40344371200 (4

[jira] [Created] (SPARK-9829) peakExecutionMemory is not correct

Davies Liu created SPARK-9829: - Summary: peakExecutionMemory is not correct Key: SPARK-9829 URL: https://issues.apache.org/jira/browse/SPARK-9829 Project: Spark Issue Type: Bug Componen

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682168#comment-14682168 ] Reynold Xin commented on SPARK-9213: Thanks! > Improve regular expression performanc

[jira] [Updated] (SPARK-9713) Document SparkR MLlib glm() integration in Spark 1.5

[ https://issues.apache.org/jira/browse/SPARK-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9713: - Component/s: Documentation > Document SparkR MLlib glm() integration in Spark 1.5 > --

[jira] [Updated] (SPARK-9713) Document SparkR MLlib glm() integration in Spark 1.5

[ https://issues.apache.org/jira/browse/SPARK-9713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9713: - Priority: Critical (was: Major) > Document SparkR MLlib glm() integration in Spark 1.5 >

[jira] [Comment Edited] (SPARK-7379) pickle.loads expects a string instead of bytes in Python 3.

[ https://issues.apache.org/jira/browse/SPARK-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682145#comment-14682145 ] Xiangrui Meng edited comment on SPARK-7379 at 8/11/15 5:35 PM: -

[jira] [Commented] (SPARK-7379) pickle.loads expects a string instead of bytes in Python 3.

[ https://issues.apache.org/jira/browse/SPARK-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682145#comment-14682145 ] Xiangrui Meng commented on SPARK-7379: -- ping [~Davies Liu] > pickle.loads expects a

[jira] [Updated] (SPARK-9634) cleanup unnecessary Aliases in LogicalPlan

[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9634: --- Description: Also alias the ExtractValue instead of wrapping it with UnresolvedAlias when resolve attr

[jira] [Updated] (SPARK-9634) cleanup unnecessary Aliases in LogicalPlan at the end of analysis

[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9634: --- Summary: cleanup unnecessary Aliases in LogicalPlan at the end of analysis (was: cleanup unnecessary

[jira] [Updated] (SPARK-9634) cleanup unnecessary Aliases in LogicalPlan

[ https://issues.apache.org/jira/browse/SPARK-9634?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan updated SPARK-9634: --- Summary: cleanup unnecessary Aliases in LogicalPlan (was: resolve UnresolvedAlias in DataFrame.resolv

[jira] [Updated] (SPARK-9656) Add missing methods to linalg.distributed

[ https://issues.apache.org/jira/browse/SPARK-9656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9656: - Component/s: (was: ML) MLlib > Add missing methods to linalg.distributed > --

[jira] [Updated] (SPARK-9656) Add missing methods to linalg.distributed

[ https://issues.apache.org/jira/browse/SPARK-9656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9656: - Target Version/s: 1.6.0 > Add missing methods to linalg.distributed >

[jira] [Commented] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682116#comment-14682116 ] Xiangrui Meng commented on SPARK-9773: -- [~yanboliang] I changed the scope to Python A

[jira] [Updated] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9773: - Description: Add Python API for MultilayerPerceptronClassifier (was: Add Python API, user guide a

[jira] [Updated] (SPARK-8531) Update ML user guide for MinMaxScaler

[ https://issues.apache.org/jira/browse/SPARK-8531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-8531: - Shepherd: Joseph K. Bradley Assignee: yuhao yang Target Version/s:

[jira] [Updated] (SPARK-9768) Add Python API for ml.feature.ElementwiseProduct

[ https://issues.apache.org/jira/browse/SPARK-9768?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9768: - Shepherd: Joseph K. Bradley Assignee: Yanbo Liang Target Version/s:

[jira] [Updated] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9773: - Target Version/s: 1.6.0 (was: 1.5.0) > Add Python API for MultilayerPerceptronClassifier > --

[jira] [Created] (SPARK-9828) Should not share `{}` among instances

Xiangrui Meng created SPARK-9828: Summary: Should not share `{}` among instances Key: SPARK-9828 URL: https://issues.apache.org/jira/browse/SPARK-9828 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9773: - Target Version/s: 1.5.0 (was: 1.6.0) > Add Python API for MultilayerPerceptronClassifier > --

[jira] [Updated] (SPARK-9766) check and add missing docs for PySpark ML

[ https://issues.apache.org/jira/browse/SPARK-9766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph K. Bradley updated SPARK-9766: - Shepherd: Joseph K. Bradley > check and add missing docs for PySpark ML >

[jira] [Updated] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9773: - Shepherd: Xiangrui Meng Target Version/s: 1.6.0 > Add Python API for MultilayerPercept

[jira] [Updated] (SPARK-9773) Add Python API for MultilayerPerceptronClassifier

[ https://issues.apache.org/jira/browse/SPARK-9773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-9773: - Assignee: Yanbo Liang > Add Python API for MultilayerPerceptronClassifier > --

[jira] [Commented] (SPARK-5111) HiveContext and Thriftserver cannot work in secure cluster beyond hadoop2.5

[ https://issues.apache.org/jira/browse/SPARK-5111?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682106#comment-14682106 ] anuj commented on SPARK-5111: - [~zhazhan] Can you elaborate in which version of spark this h

[jira] [Updated] (SPARK-8542) PMML export for Decision Trees

[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8542: - Assignee: Jasmine George > PMML export for Decision Trees > -- > >

[jira] [Updated] (SPARK-9827) Too many open files in TungstenExchange

[ https://issues.apache.org/jira/browse/SPARK-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9827: -- Description: When run q19 on TPCDS (scale=5) dataset with 8G memory, it open 10k shuffle files, crash m

[jira] [Updated] (SPARK-7583) User guide update for RegexTokenizer

[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7583: - Target Version/s: 1.5.0 (was: 1.4.2, 1.5.0) > User guide update for RegexTokenizer >

[jira] [Updated] (SPARK-9827) Too many open files in TungstenExchange

[ https://issues.apache.org/jira/browse/SPARK-9827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9827: -- Description: When run q19 on TPCDS (scale=5) dataset with 8G memory, it open 10k shuffle files, crash m

[jira] [Updated] (SPARK-7583) User guide update for RegexTokenizer

[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7583: - Shepherd: Xiangrui Meng > User guide update for RegexTokenizer > -

[jira] [Created] (SPARK-9827) Too many open files in TungstenExchange

Davies Liu created SPARK-9827: - Summary: Too many open files in TungstenExchange Key: SPARK-9827 URL: https://issues.apache.org/jira/browse/SPARK-9827 Project: Spark Issue Type: Bug Com

[jira] [Updated] (SPARK-7583) User guide update for RegexTokenizer

[ https://issues.apache.org/jira/browse/SPARK-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7583: - Assignee: yuhao yang > User guide update for RegexTokenizer >

[jira] [Updated] (SPARK-8542) PMML export for Decision Trees

[ https://issues.apache.org/jira/browse/SPARK-8542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-8542: - Shepherd: Shuo Xiang > PMML export for Decision Trees > -- > >

[jira] [Commented] (SPARK-9592) First and Last aggregates are calculating the values for entire DataFrame partition not on GroupedData partition.

[ https://issues.apache.org/jira/browse/SPARK-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682053#comment-14682053 ] Yin Huai commented on SPARK-9592: - [~ggupta81] I am resolving it since our master is gener

[jira] [Resolved] (SPARK-9592) First and Last aggregates are calculating the values for entire DataFrame partition not on GroupedData partition.

[ https://issues.apache.org/jira/browse/SPARK-9592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9592. - Resolution: Fixed I think this issue has been fixed in master (I tried both new and old aggregation code

[jira] [Commented] (SPARK-9813) Incorrect UNION ALL behavior

[ https://issues.apache.org/jira/browse/SPARK-9813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682040#comment-14682040 ] Josh Rosen commented on SPARK-9813: --- Some related discussions: - https://github.com/apa

[jira] [Commented] (SPARK-9823) Spark application hangs when using dynamic allocations and executor fails connect to shuffle service

[ https://issues.apache.org/jira/browse/SPARK-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682025#comment-14682025 ] Thomas Graves commented on SPARK-9823: -- Sorry it turned out I had some really high ti

[jira] [Closed] (SPARK-9823) Spark application hangs when using dynamic allocations and executor fails connect to shuffle service

[ https://issues.apache.org/jira/browse/SPARK-9823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Graves closed SPARK-9823. Resolution: Invalid > Spark application hangs when using dynamic allocations and executor fails > c

[jira] [Updated] (SPARK-9826) Cannot use custom classes in log4j.properties

[ https://issues.apache.org/jira/browse/SPARK-9826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9826: - Priority: Minor (was: Major) > Cannot use custom classes in log4j.properties > --

[jira] [Commented] (SPARK-9808) Remove hash shuffle file consolidation

[ https://issues.apache.org/jira/browse/SPARK-9808?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14682005#comment-14682005 ] Josh Rosen commented on SPARK-9808: --- [~sandyr], I considered this but don't think that w

[jira] [Created] (SPARK-9826) Cannot use custom classes in log4j.properties

Michel Lemay created SPARK-9826: --- Summary: Cannot use custom classes in log4j.properties Key: SPARK-9826 URL: https://issues.apache.org/jira/browse/SPARK-9826 Project: Spark Issue Type: Bug

[jira] [Created] (SPARK-9825) Spark overwrites remote cluster "final" properties with local config

Rok Roskar created SPARK-9825: - Summary: Spark overwrites remote cluster "final" properties with local config Key: SPARK-9825 URL: https://issues.apache.org/jira/browse/SPARK-9825 Project: Spark

[jira] [Assigned] (SPARK-9824) Internal Accumulators will leak WeakReferences

[ https://issues.apache.org/jira/browse/SPARK-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9824: --- Assignee: Apache Spark > Internal Accumulators will leak WeakReferences > ---

[jira] [Assigned] (SPARK-9824) Internal Accumulators will leak WeakReferences

[ https://issues.apache.org/jira/browse/SPARK-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9824: --- Assignee: (was: Apache Spark) > Internal Accumulators will leak WeakReferences >

[jira] [Commented] (SPARK-9824) Internal Accumulators will leak WeakReferences

[ https://issues.apache.org/jira/browse/SPARK-9824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681985#comment-14681985 ] Apache Spark commented on SPARK-9824: - User 'zsxwing' has created a pull request for t

[jira] [Created] (SPARK-9824) Internal Accumulators will leak WeakReferences

Shixiong Zhu created SPARK-9824: --- Summary: Internal Accumulators will leak WeakReferences Key: SPARK-9824 URL: https://issues.apache.org/jira/browse/SPARK-9824 Project: Spark Issue Type: Bug

[jira] [Assigned] (SPARK-9407) Parquet shouldn't push down predicates over a column whose underlying Parquet type is an ENUM

[ https://issues.apache.org/jira/browse/SPARK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9407: --- Assignee: Apache Spark (was: Cheng Lian) > Parquet shouldn't push down predicates over a col

[jira] [Commented] (SPARK-9407) Parquet shouldn't push down predicates over a column whose underlying Parquet type is an ENUM

[ https://issues.apache.org/jira/browse/SPARK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681981#comment-14681981 ] Apache Spark commented on SPARK-9407: - User 'liancheng' has created a pull request for

[jira] [Assigned] (SPARK-9407) Parquet shouldn't push down predicates over a column whose underlying Parquet type is an ENUM

[ https://issues.apache.org/jira/browse/SPARK-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9407: --- Assignee: Cheng Lian (was: Apache Spark) > Parquet shouldn't push down predicates over a col

[jira] [Created] (SPARK-9823) Spark application hangs when using dynamic allocations and executor fails connect to shuffle service

Thomas Graves created SPARK-9823: Summary: Spark application hangs when using dynamic allocations and executor fails connect to shuffle service Key: SPARK-9823 URL: https://issues.apache.org/jira/browse/SPARK-9823

[jira] [Resolved] (SPARK-9785) HashPartitioning compatibility should consider expression ordering

[ https://issues.apache.org/jira/browse/SPARK-9785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9785. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8074 [https://github.com/apac

[jira] [Updated] (SPARK-9821) pyspark reduceByKey should allow a custom partitioner

[ https://issues.apache.org/jira/browse/SPARK-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9821: - Priority: Minor (was: Major) Issue Type: Improvement (was: Bug) I expect that indeed it's just the

[jira] [Updated] (SPARK-8976) Python 3 crash: ValueError: invalid mode 'a+' (only r, w, b allowed)

[ https://issues.apache.org/jira/browse/SPARK-8976?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-8976: -- Assignee: Davies Liu Target Version/s: 1.5.0 > Python 3 crash: ValueError: invalid mode 'a+'

[jira] [Updated] (SPARK-9822) Update doc about supported Python versions

[ https://issues.apache.org/jira/browse/SPARK-9822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-9822: -- Description: Not sure if here's the right place to post this, but the documentation on the official web

[jira] [Created] (SPARK-9822) Update doc about supported Python versions

Davies Liu created SPARK-9822: - Summary: Update doc about supported Python versions Key: SPARK-9822 URL: https://issues.apache.org/jira/browse/SPARK-9822 Project: Spark Issue Type: Documentation

[jira] [Resolved] (SPARK-9815) Rename PlatformDependent.UNSAFE -> Platform

[ https://issues.apache.org/jira/browse/SPARK-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9815. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 8094 [https://github.com/

[jira] [Commented] (SPARK-9820) NullPointerException that causes failure to request executors.

[ https://issues.apache.org/jira/browse/SPARK-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681913#comment-14681913 ] Kevin Cox commented on SPARK-9820: -- For our jobs the frequency of this exception has been

[jira] [Updated] (SPARK-9820) NullPointerException that causes failure to request executors.

[ https://issues.apache.org/jira/browse/SPARK-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Cox updated SPARK-9820: - Attachment: Frequency.png > NullPointerException that causes failure to request executors. > -

[jira] [Commented] (SPARK-9780) In case of invalid initialization of KafkaDirectStream, NPE is thrown

[ https://issues.apache.org/jira/browse/SPARK-9780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681886#comment-14681886 ] Cody Koeninger commented on SPARK-9780: --- Makes sense, traveling currently but I'll p

[jira] [Created] (SPARK-9821) pyspark reduceByKey should allow a custom partitioner

Diana Carroll created SPARK-9821: Summary: pyspark reduceByKey should allow a custom partitioner Key: SPARK-9821 URL: https://issues.apache.org/jira/browse/SPARK-9821 Project: Spark Issue Typ

[jira] [Commented] (SPARK-9820) NullPointerException that causes failure to request executors.

[ https://issues.apache.org/jira/browse/SPARK-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681820#comment-14681820 ] Kevin Cox commented on SPARK-9820: -- Its has the same stack trace but the context isn't th

[jira] [Commented] (SPARK-9820) NullPointerException that causes failure to request executors.

[ https://issues.apache.org/jira/browse/SPARK-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681817#comment-14681817 ] Sean Owen commented on SPARK-9820: -- Looks the same as SPARK-8592 > NullPointerException

[jira] [Commented] (SPARK-9820) NullPointerException that causes failure to request executors.

[ https://issues.apache.org/jira/browse/SPARK-9820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681813#comment-14681813 ] Kevin Cox commented on SPARK-9820: -- It's also worth nothing that this only happens on a s

[jira] [Created] (SPARK-9820) NullPointerException that causes failure to request executors.

Kevin Cox created SPARK-9820: Summary: NullPointerException that causes failure to request executors. Key: SPARK-9820 URL: https://issues.apache.org/jira/browse/SPARK-9820 Project: Spark Issue T

[jira] [Commented] (SPARK-9426) Job page DAG visualization is not shown

[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681806#comment-14681806 ] Apache Spark commented on SPARK-9426: - User 'carsonwang' has created a pull request fo

[jira] [Assigned] (SPARK-9426) Job page DAG visualization is not shown

[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9426: --- Assignee: Apache Spark > Job page DAG visualization is not shown > --

[jira] [Assigned] (SPARK-9426) Job page DAG visualization is not shown

[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9426: --- Assignee: (was: Apache Spark) > Job page DAG visualization is not shown > ---

[jira] [Issue Comment Deleted] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

[ https://issues.apache.org/jira/browse/SPARK-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] François Garillot updated SPARK-9819: - Comment: was deleted (was: https://github.com/apache/spark/pull/8103) > reduceBy(KeyAnd)W

[jira] [Updated] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

[ https://issues.apache.org/jira/browse/SPARK-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9819: - Affects Version/s: (was: 1.5.0) 1.4.1 Priority: Minor (was: Major)

[jira] [Assigned] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

[ https://issues.apache.org/jira/browse/SPARK-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9819: --- Assignee: Apache Spark > reduceBy(KeyAnd)Window should specify which is the accumulator argum

[jira] [Assigned] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

[ https://issues.apache.org/jira/browse/SPARK-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9819: --- Assignee: (was: Apache Spark) > reduceBy(KeyAnd)Window should specify which is the accumu

[jira] [Commented] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

[ https://issues.apache.org/jira/browse/SPARK-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681730#comment-14681730 ] Apache Spark commented on SPARK-9819: - User 'huitseeker' has created a pull request fo

[jira] [Commented] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

[ https://issues.apache.org/jira/browse/SPARK-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681729#comment-14681729 ] François Garillot commented on SPARK-9819: -- https://github.com/apache/spark/pull/

[jira] [Created] (SPARK-9819) reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc

François Garillot created SPARK-9819: Summary: reduceBy(KeyAnd)Window should specify which is the accumulator argument in invReduceFunc Key: SPARK-9819 URL: https://issues.apache.org/jira/browse/SPARK-9819

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681684#comment-14681684 ] Yadong Qi edited comment on SPARK-9213 at 8/11/15 12:08 PM: [~

[jira] [Comment Edited] (SPARK-9213) Improve regular expression performance (via joni)

[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681684#comment-14681684 ] Yadong Qi edited comment on SPARK-9213 at 8/11/15 11:53 AM: [~

[jira] [Commented] (SPARK-9213) Improve regular expression performance (via joni)

[ https://issues.apache.org/jira/browse/SPARK-9213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681684#comment-14681684 ] Yadong Qi commented on SPARK-9213: -- Reynold Xin I will work on this. > Improve regular e

[jira] [Assigned] (SPARK-9772) Add Python API, user guide and example for ml.feature.VectorSlicer

[ https://issues.apache.org/jira/browse/SPARK-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9772: --- Assignee: (was: Apache Spark) > Add Python API, user guide and example for ml.feature.Vec

[jira] [Commented] (SPARK-9772) Add Python API, user guide and example for ml.feature.VectorSlicer

[ https://issues.apache.org/jira/browse/SPARK-9772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14681609#comment-14681609 ] Apache Spark commented on SPARK-9772: - User 'yanboliang' has created a pull request fo

<    1   2   3   4   >