[jira] [Updated] (SPARK-9431) TimeIntervalType for for time intervals

[ https://issues.apache.org/jira/browse/SPARK-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9431: --- Priority: Critical (was: Major) > TimeIntervalType for for time intervals > -

[jira] [Updated] (SPARK-9133) Add and Subtract should support date/timestamp and interval type

[ https://issues.apache.org/jira/browse/SPARK-9133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-9133: --- Assignee: Davies Liu > Add and Subtract should support date/timestamp and interval type >

[jira] [Updated] (SPARK-9205) Test added in SPARK-8470 failing for Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9205: -- Affects Version/s: 1.5.0 > Test added in SPARK-8470 failing for Scala 2.11 > ---

[jira] [Created] (SPARK-9431) TimeIntervalType for for time intervals

Reynold Xin created SPARK-9431: -- Summary: TimeIntervalType for for time intervals Key: SPARK-9431 URL: https://issues.apache.org/jira/browse/SPARK-9431 Project: Spark Issue Type: New Feature

[jira] [Commented] (SPARK-9205) Test added in SPARK-8470 failing for Scala 2.11

[ https://issues.apache.org/jira/browse/SPARK-9205?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645574#comment-14645574 ] Josh Rosen commented on SPARK-9205: --- This is still failing as of today (July 28). > Tes

[jira] [Updated] (SPARK-8119) HeartbeatReceiver should not adjust application executor resources

[ https://issues.apache.org/jira/browse/SPARK-8119?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-8119: -- Labels: backport-needed (was: ) > HeartbeatReceiver should not adjust application executor resources >

[jira] [Updated] (SPARK-8943) CalendarIntervalType for time intervals

[ https://issues.apache.org/jira/browse/SPARK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8943: --- Description: This is an umbrella ticket for adding a new CalendarIntervalType, internally stored as t

[jira] [Assigned] (SPARK-9430) Rename IntervalType to CalendarInterval

[ https://issues.apache.org/jira/browse/SPARK-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9430: --- Assignee: Apache Spark > Rename IntervalType to CalendarInterval > --

[jira] [Commented] (SPARK-9127) Codegen of Random may fail to compile

[ https://issues.apache.org/jira/browse/SPARK-9127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645571#comment-14645571 ] Josh Rosen commented on SPARK-9127: --- Is this still a problem? > Codegen of Random may f

[jira] [Assigned] (SPARK-9430) Rename IntervalType to CalendarInterval

[ https://issues.apache.org/jira/browse/SPARK-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9430: --- Assignee: (was: Apache Spark) > Rename IntervalType to CalendarInterval > ---

[jira] [Commented] (SPARK-9430) Rename IntervalType to CalendarInterval

[ https://issues.apache.org/jira/browse/SPARK-9430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645572#comment-14645572 ] Apache Spark commented on SPARK-9430: - User 'rxin' has created a pull request for this

[jira] [Updated] (SPARK-8943) CalendarIntervalType for time intervals

[ https://issues.apache.org/jira/browse/SPARK-8943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-8943: --- Summary: CalendarIntervalType for time intervals (was: IntervalType for time intervals) > CalendarIn

[jira] [Commented] (SPARK-7355) FlakyTest - o.a.s.DriverSuite

[ https://issues.apache.org/jira/browse/SPARK-7355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645565#comment-14645565 ] Josh Rosen commented on SPARK-7355: --- Is this still flaky? Can we close this JIRA to try

[jira] [Commented] (SPARK-9271) Concurrency bug triggered by partition predicate push-down

[ https://issues.apache.org/jira/browse/SPARK-9271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645562#comment-14645562 ] Josh Rosen commented on SPARK-9271: --- Do you remember how partcols1 was failing? I wonder

[jira] [Commented] (SPARK-9228) Adjust Spark SQL Configs

[ https://issues.apache.org/jira/browse/SPARK-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645564#comment-14645564 ] Josh Rosen commented on SPARK-9228: --- We should also rename the public "spark.unsafe.*" c

[jira] [Created] (SPARK-9430) Rename IntervalType to CalendarInterval

Reynold Xin created SPARK-9430: -- Summary: Rename IntervalType to CalendarInterval Key: SPARK-9430 URL: https://issues.apache.org/jira/browse/SPARK-9430 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-8919) Add @since tags to mllib.recommendation

[ https://issues.apache.org/jira/browse/SPARK-8919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-8919: - Assignee: Vinod KC > Add @since tags to mllib.recommendation > --- > >

[jira] [Updated] (SPARK-9411) Make page size configurable

[ https://issues.apache.org/jira/browse/SPARK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-9411: - Component/s: Spark Core > Make page size configurable > --- > > Ke

[jira] [Assigned] (SPARK-9370) Support DecimalType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9370: --- Assignee: (was: Apache Spark) > Support DecimalType in UnsafeRow > --

[jira] [Assigned] (SPARK-9370) Support DecimalType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9370: --- Assignee: Apache Spark > Support DecimalType in UnsafeRow >

[jira] [Resolved] (SPARK-9416) Yarn logs say that Spark Python job has succeeded even though job has failed in Yarn cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-9416. -- Resolution: Duplicate > Yarn logs say that Spark Python job has succeeded even though job has failed >

[jira] [Commented] (SPARK-9370) Support DecimalType in UnsafeRow

[ https://issues.apache.org/jira/browse/SPARK-9370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645526#comment-14645526 ] Apache Spark commented on SPARK-9370: - User 'viirya' has created a pull request for th

[jira] [Created] (SPARK-9429) TriangleCount: job aborted due to stage failure

YangBaoxing created SPARK-9429: -- Summary: TriangleCount: job aborted due to stage failure Key: SPARK-9429 URL: https://issues.apache.org/jira/browse/SPARK-9429 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

[ https://issues.apache.org/jira/browse/SPARK-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-9423. Resolution: Invalid > Why do every other spark comiter keep suggesting to use spark-submit s

[jira] [Commented] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

[ https://issues.apache.org/jira/browse/SPARK-9423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645495#comment-14645495 ] Patrick Wendell commented on SPARK-9423: This is not a valid issue for JIRA (we us

[jira] [Closed] (SPARK-9303) Decimal should use java.math.Decimal directly instead of via Scala wrapper

[ https://issues.apache.org/jira/browse/SPARK-9303?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin closed SPARK-9303. -- Resolution: Won't Fix Target Version/s: (was: 1.5.0) Marking this as won't fix since we are

[jira] [Resolved] (SPARK-9281) Parse literals as decimal in SQL

[ https://issues.apache.org/jira/browse/SPARK-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9281. Resolution: Fixed Fix Version/s: 1.5.0 > Parse literals as decimal in SQL > -

[jira] [Resolved] (SPARK-9398) Add unit test for null inputs for date functions

[ https://issues.apache.org/jira/browse/SPARK-9398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9398. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7725 [https://github.com/

[jira] [Created] (SPARK-9428) Add unit test for null inputs for string functions

Yijie Shen created SPARK-9428: - Summary: Add unit test for null inputs for string functions Key: SPARK-9428 URL: https://issues.apache.org/jira/browse/SPARK-9428 Project: Spark Issue Type: Sub-ta

[jira] [Comment Edited] (SPARK-9396) Spark yarn allocator does not call "removeContainerRequest" for allocated Container requests, resulting in bloated ask[] toYarn RM.

[ https://issues.apache.org/jira/browse/SPARK-9396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14643822#comment-14643822 ] prakhar jauhari edited comment on SPARK-9396 at 7/29/15 5:35 AM: ---

[jira] [Commented] (SPARK-9427) Add expression functions in SparkR

[ https://issues.apache.org/jira/browse/SPARK-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645464#comment-14645464 ] Yu Ishikawa commented on SPARK-9427: I'll work this issue. > Add expression functions

[jira] [Created] (SPARK-9427) Add expression functions in SparkR

Yu Ishikawa created SPARK-9427: -- Summary: Add expression functions in SparkR Key: SPARK-9427 URL: https://issues.apache.org/jira/browse/SPARK-9427 Project: Spark Issue Type: Sub-task C

[jira] [Resolved] (SPARK-9419) ShuffleMemoryManager and MemoryStore should track memory on a per-task, not per-thread, basis

[ https://issues.apache.org/jira/browse/SPARK-9419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9419. Resolution: Fixed Fix Version/s: 1.5.0 > ShuffleMemoryManager and MemoryStore should track me

[jira] [Resolved] (SPARK-8599) Improve non-deterministic expression handling

[ https://issues.apache.org/jira/browse/SPARK-8599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8599. Resolution: Fixed Assignee: Wenchen Fan Fix Version/s: 1.5.0 > Improve non-determini

[jira] [Resolved] (SPARK-9083) If order by clause has non-deterministic expressions, we should add a project to materialize results of these expressions

[ https://issues.apache.org/jira/browse/SPARK-9083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9083. Resolution: Fixed Fix Version/s: 1.5.0 > If order by clause has non-deterministic expressions

[jira] [Resolved] (SPARK-8608) After initializing a DataFrame with random columns and a seed, df.show should return same value

[ https://issues.apache.org/jira/browse/SPARK-8608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8608. Resolution: Fixed Fix Version/s: 1.5.0 > After initializing a DataFrame with random columns a

[jira] [Resolved] (SPARK-8609) After initializing a DataFrame with random columns and a seed, ordering by that random column should return same sorted order

[ https://issues.apache.org/jira/browse/SPARK-8609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8609. Resolution: Fixed Fix Version/s: 1.5.0 > After initializing a DataFrame with random columns a

[jira] [Commented] (SPARK-9404) UnsafeArrayData

[ https://issues.apache.org/jira/browse/SPARK-9404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645435#comment-14645435 ] Wenchen Fan commented on SPARK-9404: I have a new idea about the encoding. Since array

[jira] [Commented] (SPARK-9333) Add `registerTable` method to hivecontext

[ https://issues.apache.org/jira/browse/SPARK-9333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645424#comment-14645424 ] Kuldeep commented on SPARK-9333: Yes i can confirm this. I am using `SQuirreL SQL Client`

[jira] [Assigned] (SPARK-8005) Support INPUT__FILE__NAME virtual column

[ https://issues.apache.org/jira/browse/SPARK-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8005: --- Assignee: Apache Spark > Support INPUT__FILE__NAME virtual column > -

[jira] [Commented] (SPARK-8005) Support INPUT__FILE__NAME virtual column

[ https://issues.apache.org/jira/browse/SPARK-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645422#comment-14645422 ] Apache Spark commented on SPARK-8005: - User 'JDrit' has created a pull request for thi

[jira] [Assigned] (SPARK-8005) Support INPUT__FILE__NAME virtual column

[ https://issues.apache.org/jira/browse/SPARK-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8005: --- Assignee: (was: Apache Spark) > Support INPUT__FILE__NAME virtual column > --

[jira] [Commented] (SPARK-9288) Improve test speed

[ https://issues.apache.org/jira/browse/SPARK-9288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645406#comment-14645406 ] Jihun Kang commented on SPARK-9288: --- +1 on this issue. VersionSuite test also takes long

[jira] [Updated] (SPARK-9426) Job page DAG visualization is not shown

[ https://issues.apache.org/jira/browse/SPARK-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Or updated SPARK-9426: - Attachment: Screen Shot 2015-07-28 at 7.03.09 PM.png > Job page DAG visualization is not shown > -

[jira] [Created] (SPARK-9426) Job page DAG visualization is not shown

Andrew Or created SPARK-9426: Summary: Job page DAG visualization is not shown Key: SPARK-9426 URL: https://issues.apache.org/jira/browse/SPARK-9426 Project: Spark Issue Type: Bug Compo

[jira] [Resolved] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-9422. - Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7737 [https://github.com/apac

[jira] [Updated] (SPARK-6129) Create MLlib metrics user guide with algorithm definitions and complete code examples.

[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6129: - Shepherd: Sean Owen > Create MLlib metrics user guide with algorithm definitions and complete code

[jira] [Updated] (SPARK-6129) Create MLlib metrics user guide with algorithm definitions and complete code examples.

[ https://issues.apache.org/jira/browse/SPARK-6129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6129: - Assignee: Seth Hendrickson > Create MLlib metrics user guide with algorithm definitions and comple

[jira] [Commented] (SPARK-4352) Incorporate locality preferences in dynamic allocation requests

[ https://issues.apache.org/jira/browse/SPARK-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645333#comment-14645333 ] Saisai Shao commented on SPARK-4352: Hi [~tgraves], to be clear the original way of se

[jira] [Commented] (SPARK-4300) Race condition during SparkWorker shutdown

[ https://issues.apache.org/jira/browse/SPARK-4300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645331#comment-14645331 ] Alex Liu commented on SPARK-4300: - We find this issue still exists in 1.3.1 {code} ERROR

[jira] [Assigned] (SPARK-8742) Improve SparkR error messages for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8742: --- Assignee: Apache Spark > Improve SparkR error messages for DataFrame API > --

[jira] [Commented] (SPARK-8742) Improve SparkR error messages for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645322#comment-14645322 ] Apache Spark commented on SPARK-8742: - User 'falaki' has created a pull request for th

[jira] [Assigned] (SPARK-8742) Improve SparkR error messages for DataFrame API

[ https://issues.apache.org/jira/browse/SPARK-8742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8742: --- Assignee: (was: Apache Spark) > Improve SparkR error messages for DataFrame API > ---

[jira] [Resolved] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9421. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7736 [https://github.com/

[jira] [Commented] (SPARK-9411) Make page size configurable

[ https://issues.apache.org/jira/browse/SPARK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645295#comment-14645295 ] Apache Spark commented on SPARK-9411: - User 'JoshRosen' has created a pull request for

[jira] [Resolved] (SPARK-9418) Use sort-merge join as the default shuffle join

[ https://issues.apache.org/jira/browse/SPARK-9418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9418. Resolution: Fixed Fix Version/s: 1.5.0 > Use sort-merge join as the default shuffle join > --

[jira] [Assigned] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9056: --- Assignee: (was: Apache Spark) > Rename configuration `spark.streaming.minRememberDuration

[jira] [Commented] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645272#comment-14645272 ] Apache Spark commented on SPARK-9056: - User 'sabhyankar' has created a pull request fo

[jira] [Assigned] (SPARK-9056) Rename configuration `spark.streaming.minRememberDuration` to `spark.streaming.fileStream.minRememberDuration`

[ https://issues.apache.org/jira/browse/SPARK-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9056: --- Assignee: Apache Spark > Rename configuration `spark.streaming.minRememberDuration` to > `sp

[jira] [Issue Comment Deleted] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] nirav patel updated SPARK-4492: --- Comment: was deleted (was: There are many reasons users don't want to use 'spark-submit' script so pl

[jira] [Commented] (SPARK-4492) Exception when following SimpleApp tutorial java.lang.ClassNotFoundException: org.apache.spark.deploy.yarn.YarnSparkHadoopUtil

[ https://issues.apache.org/jira/browse/SPARK-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645258#comment-14645258 ] nirav patel commented on SPARK-4492: There are many reasons users don't want to use 's

[jira] [Resolved] (SPARK-9420) Move expressions in sql/core package to catalyst.

[ https://issues.apache.org/jira/browse/SPARK-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-9420. Resolution: Fixed Fix Version/s: 1.5.0 > Move expressions in sql/core package to catalyst. >

[jira] [Assigned] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9384: --- Assignee: Apache Spark > Easier setting of executor and driver classpath > --

[jira] [Commented] (SPARK-8917) Add @since tags to mllib.linalg

[ https://issues.apache.org/jira/browse/SPARK-8917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645248#comment-14645248 ] Yu Ishikawa commented on SPARK-8917: Please assign this issue to me. > Add @since tag

[jira] [Commented] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645250#comment-14645250 ] Mark Grover commented on SPARK-9384: FYI: Opened WIP pull request: https://github.com/

[jira] [Commented] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645249#comment-14645249 ] Apache Spark commented on SPARK-9384: - User 'markgrover' has created a pull request fo

[jira] [Assigned] (SPARK-9384) Easier setting of executor and driver classpath

[ https://issues.apache.org/jira/browse/SPARK-9384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9384: --- Assignee: (was: Apache Spark) > Easier setting of executor and driver classpath > ---

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645232#comment-14645232 ] Joseph K. Bradley commented on SPARK-9246: -- Please go ahead! The code cutoff for

[jira] [Updated] (SPARK-5561) Generalize PeriodicGraphCheckpointer for RDDs

[ https://issues.apache.org/jira/browse/SPARK-5561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-5561: - Shepherd: Xiangrui Meng > Generalize PeriodicGraphCheckpointer for RDDs >

[jira] [Created] (SPARK-9424) Document recent Parquet changes in Spark 1.5

Cheng Lian created SPARK-9424: - Summary: Document recent Parquet changes in Spark 1.5 Key: SPARK-9424 URL: https://issues.apache.org/jira/browse/SPARK-9424 Project: Spark Issue Type: Documentatio

[jira] [Created] (SPARK-9425) Support DecimalType in UnsafeRow

Davies Liu created SPARK-9425: - Summary: Support DecimalType in UnsafeRow Key: SPARK-9425 URL: https://issues.apache.org/jira/browse/SPARK-9425 Project: Spark Issue Type: Bug Components

[jira] [Commented] (SPARK-9246) DistributedLDAModel predict top docs per topic

[ https://issues.apache.org/jira/browse/SPARK-9246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645201#comment-14645201 ] Meihua Wu commented on SPARK-9246: -- [~josephkb] I would like to work on this. > Distrib

[jira] [Updated] (SPARK-9411) Make page size configurable

[ https://issues.apache.org/jira/browse/SPARK-9411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen updated SPARK-9411: -- Description: We need to make page sizes configurable so we can reduce them in unit tests and increase t

[jira] [Assigned] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9422: --- Assignee: Apache Spark (was: Yin Huai) > Remove the placeholder attributes used in the aggre

[jira] [Created] (SPARK-9423) Why do every other spark comiter keep suggesting to use spark-submit script

nirav patel created SPARK-9423: -- Summary: Why do every other spark comiter keep suggesting to use spark-submit script Key: SPARK-9423 URL: https://issues.apache.org/jira/browse/SPARK-9423 Project: Spark

[jira] [Commented] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645168#comment-14645168 ] Apache Spark commented on SPARK-9422: - User 'yhuai' has created a pull request for thi

[jira] [Assigned] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

[ https://issues.apache.org/jira/browse/SPARK-9422?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9422: --- Assignee: Yin Huai (was: Apache Spark) > Remove the placeholder attributes used in the aggre

[jira] [Resolved] (SPARK-9393) Fix several error-handling bugs in ScriptTransform operator

[ https://issues.apache.org/jira/browse/SPARK-9393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josh Rosen resolved SPARK-9393. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7710 [https://github.com/

[jira] [Commented] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645165#comment-14645165 ] Apache Spark commented on SPARK-9421: - User 'JoshRosen' has created a pull request for

[jira] [Assigned] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9421: --- Assignee: Josh Rosen (was: Apache Spark) > Fix null-handling bug in UnsafeRow.getDouble, get

[jira] [Created] (SPARK-9422) Remove the placeholder attributes used in the aggregation buffers

Yin Huai created SPARK-9422: --- Summary: Remove the placeholder attributes used in the aggregation buffers Key: SPARK-9422 URL: https://issues.apache.org/jira/browse/SPARK-9422 Project: Spark Issue

[jira] [Assigned] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

[ https://issues.apache.org/jira/browse/SPARK-9421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9421: --- Assignee: Apache Spark (was: Josh Rosen) > Fix null-handling bug in UnsafeRow.getDouble, get

[jira] [Created] (SPARK-9421) Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType)

Josh Rosen created SPARK-9421: - Summary: Fix null-handling bug in UnsafeRow.getDouble, getFloat(), and get(ordinal, dataType) Key: SPARK-9421 URL: https://issues.apache.org/jira/browse/SPARK-9421 Project:

[jira] [Resolved] (SPARK-9247) Use BytesToBytesMap in unsafe broadcast join

[ https://issues.apache.org/jira/browse/SPARK-9247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-9247. --- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7592 [https://github.com/

[jira] [Commented] (SPARK-3270) Spark API for Application Extensions

[ https://issues.apache.org/jira/browse/SPARK-3270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645131#comment-14645131 ] Steve Ash commented on SPARK-3270: -- I would like each executor to have some singletons th

[jira] [Updated] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-7685: - Target Version/s: 1.5.0 Priority: Critical (was: Major) > Handle high imbalanced data

[jira] [Assigned] (SPARK-7685) Handle high imbalanced data and apply weights to different samples in Logistic Regression

[ https://issues.apache.org/jira/browse/SPARK-7685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] DB Tsai reassigned SPARK-7685: -- Assignee: DB Tsai (was: Shuo Xiang) > Handle high imbalanced data and apply weights to different sampl

[jira] [Assigned] (SPARK-9420) Move expressions in sql/core package to catalyst.

[ https://issues.apache.org/jira/browse/SPARK-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9420: --- Assignee: Reynold Xin (was: Apache Spark) > Move expressions in sql/core package to catalyst

[jira] [Commented] (SPARK-9420) Move expressions in sql/core package to catalyst.

[ https://issues.apache.org/jira/browse/SPARK-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645122#comment-14645122 ] Apache Spark commented on SPARK-9420: - User 'rxin' has created a pull request for this

[jira] [Assigned] (SPARK-9420) Move expressions in sql/core package to catalyst.

[ https://issues.apache.org/jira/browse/SPARK-9420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-9420: --- Assignee: Apache Spark (was: Reynold Xin) > Move expressions in sql/core package to catalyst

[jira] [Created] (SPARK-9420) Move expressions in sql/core package to catalyst.

Reynold Xin created SPARK-9420: -- Summary: Move expressions in sql/core package to catalyst. Key: SPARK-9420 URL: https://issues.apache.org/jira/browse/SPARK-9420 Project: Spark Issue Type: Sub-t

[jira] [Updated] (SPARK-6517) Bisecting k-means clustering

[ https://issues.apache.org/jira/browse/SPARK-6517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-6517: - Summary: Bisecting k-means clustering (was: Implement the Algorithm of Hierarchical Clustering)

[jira] [Resolved] (SPARK-7105) Support model save/load in Python's GaussianMixture

[ https://issues.apache.org/jira/browse/SPARK-7105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-7105. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7617 [https://githu

[jira] [Resolved] (SPARK-8003) Support SPARK__PARTITION__ID in SQL

[ https://issues.apache.org/jira/browse/SPARK-8003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-8003. Resolution: Fixed Fix Version/s: 1.5.0 > Support SPARK__PARTITION__ID in SQL > --

[jira] [Resolved] (SPARK-9391) Support minus, dot, and intercept operators in SparkR RFormula

[ https://issues.apache.org/jira/browse/SPARK-9391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng resolved SPARK-9391. -- Resolution: Fixed Fix Version/s: 1.5.0 Issue resolved by pull request 7707 [https://githu

[jira] [Commented] (SPARK-9416) Yarn logs say that Spark Python job has succeeded even though job has failed in Yarn cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645049#comment-14645049 ] Elkhan Dadashov commented on SPARK-9416: Yes, you are right these are same bugs. T

[jira] [Commented] (SPARK-9392) Dataframe drop should work on unresolved columns

[ https://issues.apache.org/jira/browse/SPARK-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645025#comment-14645025 ] Michael Armbrust commented on SPARK-9392: - Today, we don't resolve the columns tha

[jira] [Commented] (SPARK-9392) Dataframe drop should work on unresolved columns

[ https://issues.apache.org/jira/browse/SPARK-9392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14645022#comment-14645022 ] Mike Dusenberry commented on SPARK-9392: Hi [~marmbrus]. Yes, can you provide som

[jira] [Commented] (SPARK-9196) DatetimeExpressionsSuite: function current_timestamp is flaky

[ https://issues.apache.org/jira/browse/SPARK-9196?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644999#comment-14644999 ] Reynold Xin commented on SPARK-9196: I talked with Michael more offline. Here's the re

[jira] [Commented] (SPARK-9416) Yarn logs say that Spark Python job has succeeded even though job has failed in Yarn cluster mode

[ https://issues.apache.org/jira/browse/SPARK-9416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14644996#comment-14644996 ] Sean Owen commented on SPARK-9416: -- Looks like a duplicate of SPARK-7736 > Yarn logs say

  1   2   3   >