[jira] [Updated] (SPARK-11315) Add YARN extension service to publish Spark events to YARN timeline service

[ https://issues.apache.org/jira/browse/SPARK-11315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11315: - Target Version/s: (was: 1.6.0) > Add YARN extension service to publish Spark events to

[jira] [Updated] (SPARK-11600) Spark MLlib 1.6 QA umbrella

[ https://issues.apache.org/jira/browse/SPARK-11600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11600: - Component/s: Documentation > Spark MLlib 1.6 QA umbrella > --- >

[jira] [Commented] (SPARK-8414) Ensure ContextCleaner actually triggers clean ups

[ https://issues.apache.org/jira/browse/SPARK-8414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15033103#comment-15033103 ] Michael Armbrust commented on SPARK-8414: - Still planning to do this for 1.6? > E

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7348: Target Version/s: (was: 1.6.0) > DAG visualization: add links to RDD page > --

[jira] [Updated] (SPARK-11985) Update Spark Streaming - Kinesis Library Documentation regarding data de-aggregation and message handler

[ https://issues.apache.org/jira/browse/SPARK-11985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11985: - Component/s: Documentation > Update Spark Streaming - Kinesis Library Documentation regar

[jira] [Updated] (SPARK-6518) Add example code and user guide for bisecting k-means

[ https://issues.apache.org/jira/browse/SPARK-6518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6518: Component/s: Documentation > Add example code and user guide for bisecting k-means > ---

[jira] [Updated] (SPARK-12060) Avoid memory copy in JavaSerializerInstance.serialize

[ https://issues.apache.org/jira/browse/SPARK-12060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12060: - Priority: Critical (was: Major) > Avoid memory copy in JavaSerializerInstance.serialize

[jira] [Updated] (SPARK-8966) Design a mechanism to ensure that temporary files created in tasks are cleaned up after failures

[ https://issues.apache.org/jira/browse/SPARK-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8966: Target Version/s: (was: 1.6.0) > Design a mechanism to ensure that temporary files created

[jira] [Updated] (SPARK-12031) Integer overflow when do sampling.

[ https://issues.apache.org/jira/browse/SPARK-12031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12031: - Description: In my case, some partitions contain too much items. When do range partition,

[jira] [Updated] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11966: - Target Version/s: 1.7.0 > Spark API for UDTFs > --- > > K

[jira] [Resolved] (SPARK-12018) Refactor common subexpression elimination code

[ https://issues.apache.org/jira/browse/SPARK-12018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-12018. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 10009 [htt

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032946#comment-15032946 ] Michael Armbrust commented on SPARK-11941: -- Sorry, maybe I'm misunderstanding.

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032925#comment-15032925 ] Michael Armbrust commented on SPARK-11966: -- Ah, I was proposing the DataFrame fu

[jira] [Updated] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12032: - Issue Type: Improvement (was: Bug) > Filter can't be pushed down to correct Join because

[jira] [Commented] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032921#comment-15032921 ] Michael Armbrust commented on SPARK-11873: -- What about with Spark 1.6? > Regres

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Issue Type: Improvement (was: Bug) > JSON representation of nested StructTypes could be

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032899#comment-15032899 ] Michael Armbrust commented on SPARK-11941: -- /cc [~lian cheng] > JSON represent

[jira] [Updated] (SPARK-11941) JSON representation of nested StructTypes could be more uniform

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11941: - Summary: JSON representation of nested StructTypes could be more uniform (was: JSON repr

[jira] [Commented] (SPARK-11941) JSON representation of nested StructTypes is incorrect

[ https://issues.apache.org/jira/browse/SPARK-11941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032889#comment-15032889 ] Michael Armbrust commented on SPARK-11941: -- While I can appreciate that this mig

[jira] [Commented] (SPARK-11966) Spark API for UDTFs

[ https://issues.apache.org/jira/browse/SPARK-11966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032877#comment-15032877 ] Michael Armbrust commented on SPARK-11966: -- Have you seen [explode|https://gith

[jira] [Updated] (SPARK-12030) Incorrect results when aggregate joined data

[ https://issues.apache.org/jira/browse/SPARK-12030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-12030: - Target Version/s: 1.6.0 Priority: Blocker (was: Critical) > Incorrect result

[jira] [Updated] (SPARK-11553) row.getInt(i) if row[i]=null returns 0

[ https://issues.apache.org/jira/browse/SPARK-11553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11553: - Labels: releasenotes (was: ) > row.getInt(i) if row[i]=null returns 0 >

[jira] [Commented] (SPARK-12032) Filter can't be pushed down to correct Join because of bad order of Join

[ https://issues.apache.org/jira/browse/SPARK-12032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15032403#comment-15032403 ] Michael Armbrust commented on SPARK-12032: -- The standard algorithm for join reor

[jira] [Resolved] (SPARK-11863) Unable to resolve order by if it contains mixture of aliases and real columns.

[ https://issues.apache.org/jira/browse/SPARK-11863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11863. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9961 [http

[jira] [Commented] (SPARK-12017) Java Doc Publishing Broken

[ https://issues.apache.org/jira/browse/SPARK-12017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15029153#comment-15029153 ] Michael Armbrust commented on SPARK-12017: -- /cc [~joshrosen] > Java Doc Publish

[jira] [Created] (SPARK-12017) Java Doc Publishing Broken

Michael Armbrust created SPARK-12017: Summary: Java Doc Publishing Broken Key: SPARK-12017 URL: https://issues.apache.org/jira/browse/SPARK-12017 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-11990) DataFrame recompute UDF in some situation.

[ https://issues.apache.org/jira/browse/SPARK-11990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11990. -- Resolution: Duplicate Fix Version/s: 1.6.0 This is already fixed in Spark 1.6 by

[jira] [Resolved] (SPARK-11926) unify GetStructField and GetInternalRowField

[ https://issues.apache.org/jira/browse/SPARK-11926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11926. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9909 [http

[jira] [Commented] (SPARK-9328) Netty IO layer should implement read timeouts

[ https://issues.apache.org/jira/browse/SPARK-9328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15025107#comment-15025107 ] Michael Armbrust commented on SPARK-9328: - [~joshrosen] is this actually a 1.6 blo

[jira] [Commented] (SPARK-9141) DataFrame recomputed instead of using cached parent.

[ https://issues.apache.org/jira/browse/SPARK-9141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15024927#comment-15024927 ] Michael Armbrust commented on SPARK-9141: - [~tianyi] please provide a reproduction

[jira] [Resolved] (SPARK-11942) fix encoder life cycle for CoGroup

[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11942. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9928 [http

[jira] [Updated] (SPARK-11942) fix encoder life cycle for CoGroup

[ https://issues.apache.org/jira/browse/SPARK-11942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11942: - Assignee: Wenchen Fan > fix encoder life cycle for CoGroup >

[jira] [Resolved] (SPARK-11913) support typed aggregate for complex buffer schema

[ https://issues.apache.org/jira/browse/SPARK-11913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11913. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9898 [http

[jira] [Resolved] (SPARK-11921) fix `nullable` of encoder schema

[ https://issues.apache.org/jira/browse/SPARK-11921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11921. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9906 [http

[jira] [Resolved] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11894. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9904 [http

[jira] [Updated] (SPARK-7539) Perf tests for Python MLlib

[ https://issues.apache.org/jira/browse/SPARK-7539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7539: Component/s: Tests > Perf tests for Python MLlib > --- > >

[jira] [Resolved] (SPARK-11908) Add NullType support to RowEncoder

[ https://issues.apache.org/jira/browse/SPARK-11908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11908. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9891 [http

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019203#comment-15019203 ] Michael Armbrust commented on SPARK-11894: -- I meant if you call `toDF()` on the

[jira] [Updated] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11894: - Target Version/s: 1.6.0 > Incorrect results are returned when using null > --

[jira] [Commented] (SPARK-11894) Incorrect results are returned when using null

[ https://issues.apache.org/jira/browse/SPARK-11894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15019191#comment-15019191 ] Michael Armbrust commented on SPARK-11894: -- What is the output as a DataFrame?

[jira] [Resolved] (SPARK-11890) Encoder errors logic breaks on Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11890. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9871 [http

[jira] [Resolved] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

[ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11889. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9870 [http

[jira] [Resolved] (SPARK-11636) Support as on Classes defined in the REPL

[ https://issues.apache.org/jira/browse/SPARK-11636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11636. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9825 [http

[jira] [Resolved] (SPARK-11716) UDFRegistration Drops Input Type Information

[ https://issues.apache.org/jira/browse/SPARK-11716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11716. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9868 [http

[jira] [Updated] (SPARK-11890) Encoder errors logic breaks on Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-11890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11890: - Description: {code} [error] /home/jenkins/workspace/Spark-Master-Scala211-Compile/sql/ca

[jira] [Created] (SPARK-11890) Encoder errors logic breaks on Scala 2.11

Michael Armbrust created SPARK-11890: Summary: Encoder errors logic breaks on Scala 2.11 Key: SPARK-11890 URL: https://issues.apache.org/jira/browse/SPARK-11890 Project: Spark Issue Type:

[jira] [Updated] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

[ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11889: - Target Version/s: 1.6.0 > Type inference in REPL broken for GroupedDataset.agg >

[jira] [Updated] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

[ https://issues.apache.org/jira/browse/SPARK-11889?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11889: - Component/s: SQL > Type inference in REPL broken for GroupedDataset.agg > ---

[jira] [Created] (SPARK-11889) Type inference in REPL broken for GroupedDataset.agg

Michael Armbrust created SPARK-11889: Summary: Type inference in REPL broken for GroupedDataset.agg Key: SPARK-11889 URL: https://issues.apache.org/jira/browse/SPARK-11889 Project: Spark

[jira] [Updated] (SPARK-11873) Regression for TPC-DS query 63 when used with decimal datatype and windows function

[ https://issues.apache.org/jira/browse/SPARK-11873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11873: - Issue Type: Improvement (was: Bug) > Regression for TPC-DS query 63 when used with decim

[jira] [Updated] (SPARK-11819) nice error message for missing encoder

[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11819: - Assignee: Wenchen Fan > nice error message for missing encoder >

[jira] [Resolved] (SPARK-11819) nice error message for missing encoder

[ https://issues.apache.org/jira/browse/SPARK-11819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11819. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9810 [http

[jira] [Updated] (SPARK-11876) [SQL] Support PrintSchema in DataSet APIs

[ https://issues.apache.org/jira/browse/SPARK-11876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11876: - Assignee: Xiao Li > [SQL] Support PrintSchema in DataSet APIs > -

[jira] [Resolved] (SPARK-11876) [SQL] Support PrintSchema in DataSet APIs

[ https://issues.apache.org/jira/browse/SPARK-11876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11876. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9855 [http

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014678#comment-15014678 ] Michael Armbrust commented on SPARK-11319: -- bq. It doesn't sound much like a hin

[jira] [Commented] (SPARK-11319) PySpark silently Accepts null values in non-nullable DataFrame fields.

[ https://issues.apache.org/jira/browse/SPARK-11319?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014535#comment-15014535 ] Michael Armbrust commented on SPARK-11319: -- Okay, the tone here is quickly veeri

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11778: - Assignee: Huaxin Gao > HiveContext.read.table does not support user-specified database na

[jira] [Resolved] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11778. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9773 [http

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11778: - Labels: releasenotes (was: ) > HiveContext.read.table does not support user-specified da

[jira] [Updated] (SPARK-11750) revert SPARK-11727 and code clean up

[ https://issues.apache.org/jira/browse/SPARK-11750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11750: - Assignee: Wenchen Fan > revert SPARK-11727 and code clean up > --

[jira] [Resolved] (SPARK-11750) revert SPARK-11727 and code clean up

[ https://issues.apache.org/jira/browse/SPARK-11750?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11750. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9726 [http

[jira] [Resolved] (SPARK-11848) [SQL] Support EXPLAIN in DataSet APIs

[ https://issues.apache.org/jira/browse/SPARK-11848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11848. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9832 [http

[jira] [Resolved] (SPARK-11633) HiveContext throws TreeNode Exception : Failed to Copy Node

[ https://issues.apache.org/jira/browse/SPARK-11633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11633. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9762 [http

[jira] [Commented] (SPARK-11855) Catalyst breaks backwards compatibility in branch-1.6

[ https://issues.apache.org/jira/browse/SPARK-11855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15014180#comment-15014180 ] Michael Armbrust commented on SPARK-11855: -- Hey, very sorry for the confusion he

[jira] [Commented] (SPARK-11838) Spark SQL query fragment RDD reuse

[ https://issues.apache.org/jira/browse/SPARK-11838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012701#comment-15012701 ] Michael Armbrust commented on SPARK-11838: -- As I said to [~markhamstra] offline,

[jira] [Updated] (SPARK-10420) Implementing Reactive Streams based Spark Streaming Receiver

[ https://issues.apache.org/jira/browse/SPARK-10420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10420: - Target Version/s: (was: 1.6.0) > Implementing Reactive Streams based Spark Streaming Re

[jira] [Resolved] (SPARK-11637) Alias do not work with udf with * parameter

[ https://issues.apache.org/jira/browse/SPARK-11637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11637. -- Resolution: Duplicate Fix Version/s: 1.6.0 This is fixed. Please reopen if you

[jira] [Updated] (SPARK-7465) DAG visualization: RDD dependencies not always shown

[ https://issues.apache.org/jira/browse/SPARK-7465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7465: Target Version/s: (was: 1.6.0) > DAG visualization: RDD dependencies not always shown > --

[jira] [Updated] (SPARK-7471) DAG visualization: show call site information

[ https://issues.apache.org/jira/browse/SPARK-7471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7471: Target Version/s: (was: 1.6.0) > DAG visualization: show call site information > -

[jira] [Updated] (SPARK-7271) Redesign shuffle interface for binary processing

[ https://issues.apache.org/jira/browse/SPARK-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7271: Target Version/s: 1.7.0 (was: 1.6.0) > Redesign shuffle interface for binary processing > -

[jira] [Updated] (SPARK-7200) Tungsten test suites should fail if memory leak is detected

[ https://issues.apache.org/jira/browse/SPARK-7200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7200: Component/s: Tests > Tungsten test suites should fail if memory leak is detected > -

[jira] [Updated] (SPARK-10364) Support Parquet logical type TIMESTAMP_MILLIS

[ https://issues.apache.org/jira/browse/SPARK-10364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10364: - Target Version/s: (was: 1.6.0) > Support Parquet logical type TIMESTAMP_MILLIS > --

[jira] [Updated] (SPARK-10366) Support Parquet logical type DATE

[ https://issues.apache.org/jira/browse/SPARK-10366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10366: - Target Version/s: (was: 1.6.0) > Support Parquet logical type DATE > --

[jira] [Updated] (SPARK-8716) Write tests for executor shared cache feature

[ https://issues.apache.org/jira/browse/SPARK-8716?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8716: Component/s: Tests > Write tests for executor shared cache feature > ---

[jira] [Resolved] (SPARK-11392) GroupedIterator's hasNext is not idempotent

[ https://issues.apache.org/jira/browse/SPARK-11392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11392. -- Resolution: Won't Fix Given we don't want to materialize the whole group, I think this

[jira] [Updated] (SPARK-6377) Set the number of map output partitions for Exchange operator automatically based on the size of input tables and the reduce-side operation.

[ https://issues.apache.org/jira/browse/SPARK-6377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-6377: Target Version/s: (was: 1.6.0) > Set the number of map output partitions for Exchange oper

[jira] [Updated] (SPARK-7025) Create a Java-friendly input source API

[ https://issues.apache.org/jira/browse/SPARK-7025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7025: Target Version/s: 2.0.0 (was: 1.6.0) > Create a Java-friendly input source API > --

[jira] [Updated] (SPARK-7457) Perf test for ALS.recommendAll

[ https://issues.apache.org/jira/browse/SPARK-7457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-7457: Component/s: Tests > Perf test for ALS.recommendAll > -- > >

[jira] [Updated] (SPARK-10340) Use S3 bulk listing for S3-backed Hive tables

[ https://issues.apache.org/jira/browse/SPARK-10340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10340: - Target Version/s: (was: 1.6.0) > Use S3 bulk listing for S3-backed Hive tables > --

[jira] [Updated] (SPARK-11262) Unit test for gradient, loss layers, memory management for multilayer perceptron

[ https://issues.apache.org/jira/browse/SPARK-11262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11262: - Component/s: Tests > Unit test for gradient, loss layers, memory management for multilaye

[jira] [Updated] (SPARK-8447) Test external shuffle service with all shuffle managers

[ https://issues.apache.org/jira/browse/SPARK-8447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-8447: Component/s: Tests > Test external shuffle service with all shuffle managers > -

[jira] [Updated] (SPARK-10359) Enumerate Spark's dependencies in a file and diff against it for new pull requests

[ https://issues.apache.org/jira/browse/SPARK-10359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10359: - Target Version/s: (was: 1.6.0) > Enumerate Spark's dependencies in a file and diff agai

[jira] [Commented] (SPARK-11323) Add History Service Provider to service application histories from YARN timeline server

[ https://issues.apache.org/jira/browse/SPARK-11323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012168#comment-15012168 ] Michael Armbrust commented on SPARK-11323: -- Are we still trying to get this, [SP

[jira] [Updated] (SPARK-9359) Support IntervalType for Parquet

[ https://issues.apache.org/jira/browse/SPARK-9359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9359: Target Version/s: (was: 1.6.0) > Support IntervalType for Parquet > --

[jira] [Updated] (SPARK-9346) Conversion is applied three times on partitioned data sources that require conversion

[ https://issues.apache.org/jira/browse/SPARK-9346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-9346: Target Version/s: (was: 1.6.0) > Conversion is applied three times on partitioned data sou

[jira] [Updated] (SPARK-11028) When planning queries without partial aggregation support, we should try to use TungstenAggregate.

[ https://issues.apache.org/jira/browse/SPARK-11028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11028: - Target Version/s: (was: 1.6.0) > When planning queries without partial aggregation supp

[jira] [Updated] (SPARK-11095) Simplify Netty RPC implementation by using a separate thread pool for each endpoint

[ https://issues.apache.org/jira/browse/SPARK-11095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11095: - Target Version/s: 2.0.0 (was: 1.6.0) > Simplify Netty RPC implementation by using a sepa

[jira] [Updated] (SPARK-10620) Look into whether accumulator mechanism can replace TaskMetrics

[ https://issues.apache.org/jira/browse/SPARK-10620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10620: - Target Version/s: 2.0.0 (was: 1.6.0) > Look into whether accumulator mechanism can repla

[jira] [Updated] (SPARK-11735) Add a check in the constructor of SqlContext to make sure the SparkContext is not stopped

[ https://issues.apache.org/jira/browse/SPARK-11735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11735: - Target Version/s: (was: 1.6.0) > Add a check in the constructor of SqlContext to make s

[jira] [Updated] (SPARK-11778) HiveContext.read.table does not support user-specified database names

[ https://issues.apache.org/jira/browse/SPARK-11778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11778: - Priority: Critical (was: Minor) > HiveContext.read.table does not support user-specified

[jira] [Updated] (SPARK-10665) Connect the local iterators with the planner

[ https://issues.apache.org/jira/browse/SPARK-10665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-10665: - Target Version/s: (was: 1.6.0) > Connect the local iterators with the planner > ---

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15012137#comment-15012137 ] Michael Armbrust commented on SPARK-9427: - What is the status here? Are we actual

[jira] [Updated] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11795: - Assignee: Wenchen Fan > org.apache.spark.sql.AnalysisException: Can't extract value from

[jira] [Resolved] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11795. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9792 [http

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Assignee: Wenchen Fan > Let UDF to handle null value > > >

[jira] [Resolved] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11725. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9770 [http

[jira] [Updated] (SPARK-11725) Let UDF to handle null value

[ https://issues.apache.org/jira/browse/SPARK-11725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11725: - Labels: releasenotes (was: ) > Let UDF to handle null value > --

[jira] [Resolved] (SPARK-11803) Dataset self join returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-11803. -- Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 9806 [http

[jira] [Updated] (SPARK-11803) Dataset self join returns incorrect result

[ https://issues.apache.org/jira/browse/SPARK-11803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11803: - Assignee: Wenchen Fan > Dataset self join returns incorrect result >

[jira] [Updated] (SPARK-11795) org.apache.spark.sql.AnalysisException: Can't extract value from a#12

[ https://issues.apache.org/jira/browse/SPARK-11795?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust updated SPARK-11795: - Priority: Critical (was: Major) > org.apache.spark.sql.AnalysisException: Can't extract

<    4   5   6   7   8   9   10   11   12   13   >