[jira] [Commented] (SPARK-12675) Executor dies because of ClassCastException and causes timeout

2016-04-05 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-12675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226366#comment-15226366 ] Zoltán Zvara commented on SPARK-12675: -- Similar problem on YARN: {code} Caused by:

[jira] [Resolved] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian resolved SPARK-14404. Resolution: Not A Bug The scheme of {{FakeFileSystem}} is randomly generated, so it doesn't interfe

[jira] [Created] (SPARK-14405) broadcast variables can cause lots of warning messages on shutdown

2016-04-05 Thread Thomas Graves (JIRA)
Thomas Graves created SPARK-14405: - Summary: broadcast variables can cause lots of warning messages on shutdown Key: SPARK-14405 URL: https://issues.apache.org/jira/browse/SPARK-14405 Project: Spark

[jira] [Created] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Cheng Lian (JIRA)
Cheng Lian created SPARK-14404: -- Summary: HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it Key: SPARK-14404 URL: https://issues.apache.org/jira/browse/SPARK-14404 Pr

[jira] [Commented] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226227#comment-15226227 ] Apache Spark commented on SPARK-14404: -- User 'liancheng' has created a pull request

[jira] [Assigned] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14404: Assignee: Apache Spark (was: Cheng Lian) > HDFSMetadataLogSuite overrides Hadoop FileSyst

[jira] [Assigned] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14404: Assignee: Cheng Lian (was: Apache Spark) > HDFSMetadataLogSuite overrides Hadoop FileSyst

[jira] [Updated] (SPARK-14404) HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't recover it

2016-04-05 Thread Cheng Lian (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-14404: --- Component/s: SQL > HDFSMetadataLogSuite overrides Hadoop FileSystem implementation but doesn't > rec

[jira] [Commented] (SPARK-2183) Avoid loading/shuffling data twice in self-join query

2016-04-05 Thread Justin Uang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226141#comment-15226141 ] Justin Uang commented on SPARK-2183: Yup, we're hitting this as well > Avoid loading/

[jira] [Commented] (SPARK-14222) Remove jackson-module-scala dependency or cross-publish Jackson for Scala 2.12

2016-04-05 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14222?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226036#comment-15226036 ] Steve Loughran commented on SPARK-14222: you'd be taking on maintenance and suppo

[jira] [Assigned] (SPARK-14370) Avoid creating duplicate ids in OnlineLDAOptimizer

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14370: Assignee: Apache Spark > Avoid creating duplicate ids in OnlineLDAOptimizer >

[jira] [Assigned] (SPARK-14370) Avoid creating duplicate ids in OnlineLDAOptimizer

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14370: Assignee: (was: Apache Spark) > Avoid creating duplicate ids in OnlineLDAOptimizer > -

[jira] [Commented] (SPARK-14370) Avoid creating duplicate ids in OnlineLDAOptimizer

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226017#comment-15226017 ] Apache Spark commented on SPARK-14370: -- User 'pravingadakh' has created a pull reque

[jira] [Comment Edited] (SPARK-14379) Review spark.ml parity for recommendation

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226013#comment-15226013 ] Nick Pentreath edited comment on SPARK-14379 at 4/5/16 10:06 AM: --

[jira] [Commented] (SPARK-14379) Review spark.ml parity for recommendation

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226013#comment-15226013 ] Nick Pentreath commented on SPARK-14379: As per SPARK-13857, the missing methods

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15226001#comment-15226001 ] Sean Owen commented on SPARK-14402: --- Yeah, here's the Hive reference: https://cwiki.ap

[jira] [Updated] (SPARK-14402) initcap UDF doesn't match Hive/Oracle behavior in lowercasing rest of string

2016-04-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14402: -- Summary: initcap UDF doesn't match Hive/Oracle behavior in lowercasing rest of string (was: UTF8String

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225996#comment-15225996 ] Dongjoon Hyun commented on SPARK-14402: --- I will investigate on moving that code. I

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225988#comment-15225988 ] Dongjoon Hyun commented on SPARK-14402: --- When I search the code, the only usage of

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225985#comment-15225985 ] Sean Owen commented on SPARK-14402: --- Oh I see. That's a more specific and probably legi

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Dongjoon Hyun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225983#comment-15225983 ] Dongjoon Hyun commented on SPARK-14402: --- Oh. that could be possible. Thank you, @sr

[jira] [Created] (SPARK-14403) the dag of a stage may has too many same chid cluster, and result to gc

2016-04-05 Thread meiyoula (JIRA)
meiyoula created SPARK-14403: Summary: the dag of a stage may has too many same chid cluster, and result to gc Key: SPARK-14403 URL: https://issues.apache.org/jira/browse/SPARK-14403 Project: Spark

[jira] [Assigned] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14402: Assignee: Apache Spark > UTF8String.toTitleCase should return non-first letters in lowerca

[jira] [Assigned] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14402: Assignee: (was: Apache Spark) > UTF8String.toTitleCase should return non-first letters

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225977#comment-15225977 ] Apache Spark commented on SPARK-14402: -- User 'dongjoon-hyun' has created a pull requ

[jira] [Assigned] (SPARK-14379) Review spark.ml parity for recommendation

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-14379: -- Assignee: Nick Pentreath > Review spark.ml parity for recommendation > ---

[jira] [Commented] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-05 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225969#comment-15225969 ] Prashant Sharma commented on SPARK-14401: - Later on I also added a feature in the

[jira] [Updated] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-14402: -- Priority: Minor (was: Major) > UTF8String.toTitleCase should return non-first letters in lowercase >

[jira] [Commented] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225967#comment-15225967 ] Sean Owen commented on SPARK-14402: --- Title case just means each word starts with an upp

[jira] [Commented] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-05 Thread Prashant Sharma (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225964#comment-15225964 ] Prashant Sharma commented on SPARK-14401: - Minimally https://github.com/sbt/sbt-p

[jira] [Assigned] (SPARK-13857) Feature parity for ALS ML with MLLIB

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Pentreath reassigned SPARK-13857: -- Assignee: Nick Pentreath > Feature parity for ALS ML with MLLIB >

[jira] [Reopened] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell reopened SPARK-14348: --- > Support native execution of SHOW TBLPROPERTIES command > --

[jira] [Resolved] (SPARK-14348) Support native execution of SHOW TBLPROPERTIES command

2016-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-14348. --- Resolution: Resolved > Support native execution of SHOW TBLPROPERTIES command > -

[jira] [Commented] (SPARK-14392) CountVectorizer Estimator should include binary toggle Param

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225952#comment-15225952 ] Nick Pentreath commented on SPARK-14392: I think the param should actually be mov

[jira] [Resolved] (SPARK-14349) Issue Error Messages for Unsupported Operations in SQL Context.

2016-04-05 Thread Herman van Hovell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hovell resolved SPARK-14349. --- Resolution: Resolved Assignee: Xiao Li Target Version/s: 2.0.0

[jira] [Created] (SPARK-14402) UTF8String.toTitleCase should return non-first letters in lowercase

2016-04-05 Thread Dongjoon Hyun (JIRA)
Dongjoon Hyun created SPARK-14402: - Summary: UTF8String.toTitleCase should return non-first letters in lowercase Key: SPARK-14402 URL: https://issues.apache.org/jira/browse/SPARK-14402 Project: Spark

[jira] [Commented] (SPARK-14367) spark.memory.useLegacyMode=true in 1.6 does not yield the same memory behavior as Spark 1.3

2016-04-05 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225909#comment-15225909 ] Sean Owen commented on SPARK-14367: --- The current function that would determine this val

[jira] [Commented] (SPARK-13211) StreamingContext throws NoSuchElementException when created from non-existent checkpoint directory

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225886#comment-15225886 ] Apache Spark commented on SPARK-13211: -- User 'srowen' has created a pull request for

[jira] [Closed] (SPARK-14395) remove some unused code in REPL module

2016-04-05 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan closed SPARK-14395. --- Resolution: Invalid > remove some unused code in REPL module > --

[jira] [Commented] (SPARK-13792) Limit logging of bad records

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225835#comment-15225835 ] Apache Spark commented on SPARK-13792: -- User 'maropu' has created a pull request for

[jira] [Assigned] (SPARK-13792) Limit logging of bad records

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13792: Assignee: (was: Apache Spark) > Limit logging of bad records > ---

[jira] [Assigned] (SPARK-13792) Limit logging of bad records

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13792: Assignee: Apache Spark > Limit logging of bad records > > >

[jira] [Commented] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-05 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225827#comment-15225827 ] Josh Rosen commented on SPARK-14401: By the way, one of my main motivators for being

[jira] [Assigned] (SPARK-13944) Separate out local linear algebra as a standalone module without Spark dependency

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13944: Assignee: DB Tsai (was: Apache Spark) > Separate out local linear algebra as a standalone

[jira] [Commented] (SPARK-13944) Separate out local linear algebra as a standalone module without Spark dependency

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225825#comment-15225825 ] Apache Spark commented on SPARK-13944: -- User 'dbtsai' has created a pull request for

[jira] [Created] (SPARK-14401) Merge our sbt-pom-reader changes upstream

2016-04-05 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-14401: -- Summary: Merge our sbt-pom-reader changes upstream Key: SPARK-14401 URL: https://issues.apache.org/jira/browse/SPARK-14401 Project: Spark Issue Type: Improvement

[jira] [Assigned] (SPARK-13944) Separate out local linear algebra as a standalone module without Spark dependency

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-13944: Assignee: Apache Spark (was: DB Tsai) > Separate out local linear algebra as a standalone

[jira] [Updated] (SPARK-14344) saveAsParquetFile creates _metafile even when disabled

2016-04-05 Thread Kashish Jain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kashish Jain updated SPARK-14344: - Affects Version/s: 1.3.1 > saveAsParquetFile creates _metafile even when disabled > -

[jira] [Commented] (SPARK-14344) saveAsParquetFile creates _metafile even when disabled

2016-04-05 Thread Kashish Jain (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225823#comment-15225823 ] Kashish Jain commented on SPARK-14344: -- Thanks for the info. I didn't have the setup

[jira] [Commented] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225810#comment-15225810 ] Nick Pentreath commented on SPARK-13629: Ah you're right - we should actually jus

[jira] [Comment Edited] (SPARK-13629) Add binary toggle Param to CountVectorizer

2016-04-05 Thread Nick Pentreath (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-13629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15225810#comment-15225810 ] Nick Pentreath edited comment on SPARK-13629 at 4/5/16 7:18 AM: ---

[jira] [Assigned] (SPARK-14399) Remove unnecessary excludes from POMs

2016-04-05 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-14399?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-14399: Assignee: Apache Spark (was: Josh Rosen) > Remove unnecessary excludes from POMs > --

<    1   2   3