[jira] [Updated] (SPARK-10935) Avito Context Ad Clicks

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10935: -- Description: >From [~kpl...@gmail.com]: I would love to do Avito Context Ad Clicks - https://

[jira] [Updated] (SPARK-10935) Avito Context Ad Clicks

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10935: -- Description: >From [~kpl...@gmail.com]: > I would love to do Avito Context Ad Clicks - > http

[jira] [Updated] (SPARK-10935) Avito Context Ad Clicks

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10935: -- Description: >From [~kpl...@gmail.com]: > I would love to do Avito Context Ad Clicks - > http

[jira] [Created] (SPARK-10935) Avito Context Ad Clicks

2015-10-05 Thread Xiangrui Meng (JIRA)
Xiangrui Meng created SPARK-10935: - Summary: Avito Context Ad Clicks Key: SPARK-10935 URL: https://issues.apache.org/jira/browse/SPARK-10935 Project: Spark Issue Type: Sub-task Comp

[jira] [Commented] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944122#comment-14944122 ] Apache Spark commented on SPARK-10934: -- User 'cloud-fan' has created a pull request

[jira] [Assigned] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10934: Assignee: Apache Spark > hashCode of unsafe array may crush >

[jira] [Commented] (SPARK-10513) Springleaf Marketing Response

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944121#comment-14944121 ] Xiangrui Meng commented on SPARK-10513: --- Any updates? > Springleaf Marketing Respo

[jira] [Assigned] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10934: Assignee: (was: Apache Spark) > hashCode of unsafe array may crush > -

[jira] [Updated] (SPARK-10382) Make example code in user guide testable

2015-10-05 Thread Xiangrui Meng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiangrui Meng updated SPARK-10382: -- Assignee: (was: Xiangrui Meng) > Make example code in user guide testable > ---

[jira] [Created] (SPARK-10934) hashCode of unsafe array may crush

2015-10-05 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-10934: --- Summary: hashCode of unsafe array may crush Key: SPARK-10934 URL: https://issues.apache.org/jira/browse/SPARK-10934 Project: Spark Issue Type: Bug Co

[jira] [Commented] (SPARK-10685) Misaligned data with RDD.zip and DataFrame.withColumn after repartition

2015-10-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944112#comment-14944112 ] Davies Liu commented on SPARK-10685: [~jdanbrown] The zip after repartition (or shuff

[jira] [Commented] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-10-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944108#comment-14944108 ] Reynold Xin commented on SPARK-10868: - [~MartinSenne] this makes sense, and shouldn't

[jira] [Commented] (SPARK-10685) Misaligned data with RDD.zip and DataFrame.withColumn after repartition

2015-10-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944093#comment-14944093 ] Josh Rosen commented on SPARK-10685: [~jdanbrown], if the zip after repartition probl

[jira] [Created] (SPARK-10933) Spark SQL Joins should have option to fail query when row multiplication is encountered

2015-10-05 Thread Stephen Link (JIRA)
Stephen Link created SPARK-10933: Summary: Spark SQL Joins should have option to fail query when row multiplication is encountered Key: SPARK-10933 URL: https://issues.apache.org/jira/browse/SPARK-10933

[jira] [Commented] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944069#comment-14944069 ] Apache Spark commented on SPARK-10932: -- User 'JoshRosen' has created a pull request

[jira] [Assigned] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10932: Assignee: Josh Rosen (was: Apache Spark) > Port two minor changes to release packaging sc

[jira] [Assigned] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10932: Assignee: Apache Spark (was: Josh Rosen) > Port two minor changes to release packaging sc

[jira] [Created] (SPARK-10932) Port two minor changes to release packaging scripts back into Spark repo

2015-10-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-10932: -- Summary: Port two minor changes to release packaging scripts back into Spark repo Key: SPARK-10932 URL: https://issues.apache.org/jira/browse/SPARK-10932 Project: Spark

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944056#comment-14944056 ] Narine Kokhlikyan commented on SPARK-9318: -- I asked other ppl to try this and the

[jira] [Reopened] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2015-10-05 Thread Robert Beauchemin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Beauchemin reopened SPARK-10066: --- This problem reappears with Spark 1.5.1. Same HDP/Hive setup and config. > Can't create

[jira] [Commented] (SPARK-10066) Can't create HiveContext with spark-shell or spark-sql on snapshot

2015-10-05 Thread Robert Beauchemin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944049#comment-14944049 ] Robert Beauchemin commented on SPARK-10066: --- This problem reappeared in Spark 1

[jira] [Comment Edited] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Deborah Siegel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944007#comment-14944007 ] Deborah Siegel edited comment on SPARK-9318 at 10/5/15 9:00 PM:

[jira] [Comment Edited] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Deborah Siegel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944007#comment-14944007 ] Deborah Siegel edited comment on SPARK-9318 at 10/5/15 9:01 PM:

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-05 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944010#comment-14944010 ] Matt Cheah commented on SPARK-10877: Is it possible that this error is JVM or platfor

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Deborah Siegel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944007#comment-14944007 ] Deborah Siegel commented on SPARK-9318: --- not sure about the fix. I tried this on 1.5

[jira] [Comment Edited] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-05 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944002#comment-14944002 ] Matt Cheah edited comment on SPARK-10877 at 10/5/15 8:48 PM: -

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-05 Thread Matt Cheah (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14944002#comment-14944002 ] Matt Cheah commented on SPARK-10877: Can you turn off assertions when you spawn the s

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943988#comment-14943988 ] Narine Kokhlikyan commented on SPARK-9318: -- printSchema is showing up correctly f

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943986#comment-14943986 ] Narine Kokhlikyan commented on SPARK-9318: -- Hi [~dsiegel], thanks for checking it

[jira] [Created] (SPARK-10931) PySpark ML Models should contain Param values

2015-10-05 Thread Joseph K. Bradley (JIRA)
Joseph K. Bradley created SPARK-10931: - Summary: PySpark ML Models should contain Param values Key: SPARK-10931 URL: https://issues.apache.org/jira/browse/SPARK-10931 Project: Spark Issue

[jira] [Commented] (SPARK-10913) Add attach() function for DataFrame

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943974#comment-14943974 ] Apache Spark commented on SPARK-10913: -- User 'adrian555' has created a pull request

[jira] [Assigned] (SPARK-10913) Add attach() function for DataFrame

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10913: Assignee: Apache Spark > Add attach() function for DataFrame > ---

[jira] [Assigned] (SPARK-10913) Add attach() function for DataFrame

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10913: Assignee: (was: Apache Spark) > Add attach() function for DataFrame >

[jira] [Created] (SPARK-10930) History "Stages" page "duration" can be confusing

2015-10-05 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-10930: - Summary: History "Stages" page "duration" can be confusing Key: SPARK-10930 URL: https://issues.apache.org/jira/browse/SPARK-10930 Project: Spark Issue Typ

[jira] [Commented] (SPARK-10877) Assertions fail straightforward DataFrame job due to word alignment

2015-10-05 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943956#comment-14943956 ] Jason C Lee commented on SPARK-10877: - I ran your SparkFilterByKeyTest.scala from spa

[jira] [Updated] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-10929: - Description: We are executing 20 Spark SQL jobs in parallel using Spark Job Server and h

[jira] [Updated] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-10929: - Description: We are executing 20 Spark SQL jobs in parallel using Spark Job Server and h

[jira] [Created] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
Naden Franciscus created SPARK-10929: Summary: Tungsten fails to acquire memory writing to HDFS Key: SPARK-10929 URL: https://issues.apache.org/jira/browse/SPARK-10929 Project: Spark Issu

[jira] [Updated] (SPARK-10929) Tungsten fails to acquire memory writing to HDFS

2015-10-05 Thread Naden Franciscus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Naden Franciscus updated SPARK-10929: - Priority: Blocker (was: Major) > Tungsten fails to acquire memory writing to HDFS >

[jira] [Resolved] (SPARK-10585) only copy data once when generate unsafe projection

2015-10-05 Thread Davies Liu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu resolved SPARK-10585. Resolution: Fixed Fix Version/s: 1.6.0 Issue resolved by pull request 8747 [https://github.c

[jira] [Commented] (SPARK-10863) Method coltypes() to return the R column types of a DataFrame

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943921#comment-14943921 ] Apache Spark commented on SPARK-10863: -- User 'olarayej' has created a pull request f

[jira] [Commented] (SPARK-9963) ML RandomForest cleanup: replace predictNodeIndex with predictImpl

2015-10-05 Thread Amey Chaugule (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943904#comment-14943904 ] Amey Chaugule commented on SPARK-9963: -- Is this still WIP or has the PR been abandone

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943868#comment-14943868 ] Reynold Xin edited comment on SPARK-10474 at 10/5/15 7:21 PM: -

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943868#comment-14943868 ] Reynold Xin commented on SPARK-10474: - Also please attach the "explain" of the query

[jira] [Commented] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943865#comment-14943865 ] Reynold Xin commented on SPARK-10474: - I'm fairly sure you are hitting a different is

[jira] [Commented] (SPARK-10914) Incorrect empty join sets

2015-10-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943855#comment-14943855 ] Wenchen Fan commented on SPARK-10914: - hi [~benm], I can't reproduce this bug on spar

[jira] [Comment Edited] (SPARK-10474) TungstenAggregation cannot acquire memory for pointer array after switching to sort-based

2015-10-05 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14939808#comment-14939808 ] Reynold Xin edited comment on SPARK-10474 at 10/5/15 7:05 PM: -

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Deborah Siegel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943810#comment-14943810 ] Deborah Siegel commented on SPARK-9318: --- Narine, just want to offer that I haven't r

[jira] [Assigned] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8654: --- Assignee: Apache Spark > Analysis exception when using "NULL IN (...)": invalid cast > --

[jira] [Assigned] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-8654: --- Assignee: (was: Apache Spark) > Analysis exception when using "NULL IN (...)": invalid ca

[jira] [Commented] (SPARK-8654) Analysis exception when using "NULL IN (...)": invalid cast

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943814#comment-14943814 ] Apache Spark commented on SPARK-8654: - User 'dilipbiswal' has created a pull request f

[jira] [Commented] (SPARK-10928) Spark Mesos finegrain mode with single core CPUs, rendered useless

2015-10-05 Thread Ravi Sanwal (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943789#comment-14943789 ] Ravi Sanwal commented on SPARK-10928: - I guess its not a major issue because these ki

[jira] [Created] (SPARK-10928) Spark Mesos finegrain mode with single core CPUs, rendered useless

2015-10-05 Thread Ravi Sanwal (JIRA)
Ravi Sanwal created SPARK-10928: --- Summary: Spark Mesos finegrain mode with single core CPUs, rendered useless Key: SPARK-10928 URL: https://issues.apache.org/jira/browse/SPARK-10928 Project: Spark

[jira] [Commented] (SPARK-9318) Add `merge` as synonym for join

2015-10-05 Thread Narine Kokhlikyan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-9318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943784#comment-14943784 ] Narine Kokhlikyan commented on SPARK-9318: -- Hi all, [~shivaram], [~falaki], I a

[jira] [Commented] (SPARK-10927) Spark history uses the application name instead of the ID

2015-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943776#comment-14943776 ] Jean-Baptiste Onofré commented on SPARK-10927: -- Sorry about that. Yes, now,

[jira] [Updated] (SPARK-10927) Spark history uses the application name instead of the ID

2015-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated SPARK-10927: - Description: Setting spark.eventLog.enabled to true, and a folder location for s

[jira] [Commented] (SPARK-10792) Spark + YARN – executor is not re-created

2015-10-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943709#comment-14943709 ] Steve Loughran commented on SPARK-10792: you can't stop executors from "never dyi

[jira] [Commented] (SPARK-10847) Pyspark - DataFrame - Optional Metadata with `None` triggers cryptic failure

2015-10-05 Thread Jason C Lee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943670#comment-14943670 ] Jason C Lee commented on SPARK-10847: - You're welcome! > Pyspark - DataFrame - Optio

[jira] [Commented] (SPARK-10927) Spark history uses the application name instead of the ID

2015-10-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943674#comment-14943674 ] Sean Owen commented on SPARK-10927: --- Duplicate of https://issues.apache.org/jira/browse

[jira] [Assigned] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10855: Assignee: Apache Spark > Add a JDBC dialect for Apache Derby > --

[jira] [Assigned] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10855: Assignee: (was: Apache Spark) > Add a JDBC dialect for Apache Derby > ---

[jira] [Commented] (SPARK-10855) Add a JDBC dialect for Apache Derby

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943653#comment-14943653 ] Apache Spark commented on SPARK-10855: -- User 'rick-ibm' has created a pull request f

[jira] [Created] (SPARK-10927) Spark history uses the application name instead of the ID

2015-10-05 Thread JIRA
Jean-Baptiste Onofré created SPARK-10927: Summary: Spark history uses the application name instead of the ID Key: SPARK-10927 URL: https://issues.apache.org/jira/browse/SPARK-10927 Project: Spa

[jira] [Commented] (SPARK-10926) Refactor ContextCleaner to allow weak reference cleaning to be done outside of the driver

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943591#comment-14943591 ] Apache Spark commented on SPARK-10926: -- User 'mccheah' has created a pull request fo

[jira] [Assigned] (SPARK-10926) Refactor ContextCleaner to allow weak reference cleaning to be done outside of the driver

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10926: Assignee: (was: Apache Spark) > Refactor ContextCleaner to allow weak reference cleani

[jira] [Assigned] (SPARK-10926) Refactor ContextCleaner to allow weak reference cleaning to be done outside of the driver

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10926: Assignee: Apache Spark > Refactor ContextCleaner to allow weak reference cleaning to be do

[jira] [Created] (SPARK-10926) Refactor ContextCleaner to allow weak reference cleaning to be done outside of the driver

2015-10-05 Thread Matt Cheah (JIRA)
Matt Cheah created SPARK-10926: -- Summary: Refactor ContextCleaner to allow weak reference cleaning to be done outside of the driver Key: SPARK-10926 URL: https://issues.apache.org/jira/browse/SPARK-10926

[jira] [Issue Comment Deleted] (SPARK-10617) Leap year miscalculated in sql query

2015-10-05 Thread Alex Rovner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alex Rovner updated SPARK-10617: Comment: was deleted (was: https://github.com/apache/spark/pull/8980) > Leap year miscalculated in

[jira] [Assigned] (SPARK-10617) Leap year miscalculated in sql query

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10617: Assignee: Apache Spark > Leap year miscalculated in sql query > --

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-05 Thread Alex Rovner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943519#comment-14943519 ] Alex Rovner commented on SPARK-10617: - https://github.com/apache/spark/pull/8980 > L

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943522#comment-14943522 ] Apache Spark commented on SPARK-10617: -- User 'alexrovner' has created a pull request

[jira] [Assigned] (SPARK-10617) Leap year miscalculated in sql query

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10617: Assignee: (was: Apache Spark) > Leap year miscalculated in sql query > ---

[jira] [Commented] (SPARK-5783) Include filename, line number in eventlog-parsing error message

2015-10-05 Thread Michael England (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943426#comment-14943426 ] Michael England commented on SPARK-5783: Interesting, thanks Sean. > Include file

[jira] [Resolved] (SPARK-5783) Include filename, line number in eventlog-parsing error message

2015-10-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-5783. -- Resolution: Fixed Assignee: Ryan Williams Fix Version/s: 1.4.0 1.3.2

[jira] [Issue Comment Deleted] (SPARK-5783) Include filename, line number in eventlog-parsing error message

2015-10-05 Thread arnab chatterjee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] arnab chatterjee updated SPARK-5783: Comment: was deleted (was: Similar issue here on spark 1.3.1. Any update on this pull reques

[jira] [Commented] (SPARK-5783) Include filename, line number in eventlog-parsing error message

2015-10-05 Thread Michael England (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943419#comment-14943419 ] Michael England commented on SPARK-5783: Similar issue here on spark 1.3.1. Any up

[jira] [Commented] (SPARK-5783) Include filename, line number in eventlog-parsing error message

2015-10-05 Thread arnab chatterjee (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943417#comment-14943417 ] arnab chatterjee commented on SPARK-5783: - Similar issue here on spark 1.3.1. Any

[jira] [Commented] (SPARK-10797) RDD's coalesce should not write out the temporary key

2015-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943411#comment-14943411 ] Zoltán Zvara commented on SPARK-10797: -- On a simple repartitioning of {{(Int, String

[jira] [Commented] (SPARK-6823) Add a model.matrix like capability to DataFrames (modelDataFrame)

2015-10-05 Thread Deborah Siegel (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6823?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943410#comment-14943410 ] Deborah Siegel commented on SPARK-6823: --- does SPARK-9681 address RFormula supporting

[jira] [Commented] (SPARK-10792) Spark + YARN – executor is not re-created

2015-10-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943407#comment-14943407 ] Daniel Darabos commented on SPARK-10792: I've edited the priority, the title, and

[jira] [Comment Edited] (SPARK-10792) Spark + YARN – executor is not re-created

2015-10-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943405#comment-14943405 ] Daniel Darabos edited comment on SPARK-10792 at 10/5/15 2:17 PM: --

[jira] [Updated] (SPARK-10792) Spark + YARN – executor is not re-created

2015-10-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Darabos updated SPARK-10792: --- Priority: Critical (was: Minor) Component/s: (was: Streaming) Summary: Spa

[jira] [Commented] (SPARK-10792) Spark streaming + YARN – executor is not re-created on machine restart

2015-10-05 Thread Daniel Darabos (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943405#comment-14943405 ] Daniel Darabos commented on SPARK-10792: I work with Andras and can now substanti

[jira] [Assigned] (SPARK-10797) RDD's coalesce should not write out the temporary key

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10797: Assignee: (was: Apache Spark) > RDD's coalesce should not write out the temporary key

[jira] [Commented] (SPARK-10797) RDD's coalesce should not write out the temporary key

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943369#comment-14943369 ] Apache Spark commented on SPARK-10797: -- User 'ehnalis' has created a pull request fo

[jira] [Assigned] (SPARK-10797) RDD's coalesce should not write out the temporary key

2015-10-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-10797: Assignee: Apache Spark > RDD's coalesce should not write out the temporary key > -

[jira] [Commented] (SPARK-10797) RDD's coalesce should not write out the temporary key

2015-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-10797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943366#comment-14943366 ] Zoltán Zvara commented on SPARK-10797: -- I think we have the following options to sol

[jira] [Commented] (SPARK-10923) Spark handling parallel requests

2015-10-05 Thread Tarek Abouzeid (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943342#comment-14943342 ] Tarek Abouzeid commented on SPARK-10923: oh , sorry , thanks > Spark handling p

[jira] [Updated] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexis Seigneurin updated SPARK-10925: -- Attachment: (was: Photo 05-10-2015 14 31 16.jpg) > Exception when joining DataFrame

[jira] [Updated] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexis Seigneurin updated SPARK-10925: -- Attachment: Photo 05-10-2015 14 31 16.jpg > Exception when joining DataFrames > ---

[jira] [Comment Edited] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943318#comment-14943318 ] Alexis Seigneurin edited comment on SPARK-10925 at 10/5/15 12:44 PM: --

[jira] [Updated] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexis Seigneurin updated SPARK-10925: -- Attachment: Photo 05-10-2015 14 31 16.jpg The workflow. > Exception when joining DataF

[jira] [Created] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Alexis Seigneurin (JIRA)
Alexis Seigneurin created SPARK-10925: - Summary: Exception when joining DataFrames Key: SPARK-10925 URL: https://issues.apache.org/jira/browse/SPARK-10925 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-10925) Exception when joining DataFrames

2015-10-05 Thread Alexis Seigneurin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexis Seigneurin updated SPARK-10925: -- Attachment: TestCase2.scala > Exception when joining DataFrames > -

[jira] [Commented] (SPARK-10617) Leap year miscalculated in sql query

2015-10-05 Thread Alex Rovner (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943300#comment-14943300 ] Alex Rovner commented on SPARK-10617: - Good catch! Looks like there is a bug in DateT

[jira] [Updated] (SPARK-10919) Assosiation rules class should return the support of each rule

2015-10-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-10919: -- Component/s: MLlib > Assosiation rules class should return the support of each rule > -

[jira] [Comment Edited] (SPARK-6404) Call broadcast() in each interval for spark streaming programs.

2015-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943143#comment-14943143 ] Kåre Blakstad edited comment on SPARK-6404 at 10/5/15 10:42 AM:

[jira] [Comment Edited] (SPARK-6404) Call broadcast() in each interval for spark streaming programs.

2015-10-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-6404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943143#comment-14943143 ] Kåre Blakstad edited comment on SPARK-6404 at 10/5/15 10:41 AM:

[jira] [Updated] (SPARK-10868) monotonicallyIncreasingId() supports offset for indexing

2015-10-05 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-10868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Martin Senne updated SPARK-10868: - Description: With SPARK-7135 and https://github.com/apache/spark/pull/5709 `monotonicallyIncreas

[jira] [Commented] (SPARK-7135) Expression for monotonically increasing IDs

2015-10-05 Thread Martin Senne (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14943151#comment-14943151 ] Martin Senne commented on SPARK-7135: - @[~rxin]: Please see my description in SPARK-10

<    1   2   3   >