[jira] [Reopened] (SPARK-2742) The variable inputFormatInfo and inputFormatMap never used

2014-08-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-2742: Oops - I closed accidentially The variable inputFormatInfo and inputFormatMap never used

[jira] [Resolved] (SPARK-1779) Warning when spark.storage.memoryFraction is not between 0 and 1

2014-08-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1779. Resolution: Fixed Fixed via: https://github.com/apache/spark/pull/714 Warning when

[jira] [Resolved] (SPARK-2859) Update url of Kryo project in related docs

2014-08-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2859. Resolution: Fixed Fix Version/s: 1.1.0 1.0.3 Issue resolved by

[jira] [Updated] (SPARK-2380) Support displaying accumulator contents in the web UI

2014-08-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2380: --- Fix Version/s: 1.1.0 Support displaying accumulator contents in the web UI

[jira] [Resolved] (SPARK-2380) Support displaying accumulator contents in the web UI

2014-08-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2380. Resolution: Fixed Resolved by: https://github.com/apache/spark/pull/1309 Support

[jira] [Created] (SPARK-2868) Support named accumulators in Python

2014-08-05 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2868: -- Summary: Support named accumulators in Python Key: SPARK-2868 URL: https://issues.apache.org/jira/browse/SPARK-2868 Project: Spark Issue Type: New

[jira] [Created] (SPARK-2882) Spark build no longer checks local maven cache for dependencies

2014-08-06 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2882: -- Summary: Spark build no longer checks local maven cache for dependencies Key: SPARK-2882 URL: https://issues.apache.org/jira/browse/SPARK-2882 Project: Spark

[jira] [Commented] (SPARK-2678) `Spark-submit` overrides user application options

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088103#comment-14088103 ] Patrick Wendell commented on SPARK-2678: Fixed in 1.1.0 via:

[jira] [Updated] (SPARK-2678) `Spark-submit` overrides user application options

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2678: --- Target Version/s: 1.1.0, 1.0.3 (was: 1.1.0) `Spark-submit` overrides user application

[jira] [Created] (SPARK-2884) Create binary builds in parallel with release script

2014-08-06 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2884: -- Summary: Create binary builds in parallel with release script Key: SPARK-2884 URL: https://issues.apache.org/jira/browse/SPARK-2884 Project: Spark Issue

[jira] [Resolved] (SPARK-2566) Update ShuffleWriteMetrics as data is written

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2566. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1481

[jira] [Resolved] (SPARK-2879) Use HTTPS to access Maven Central and other repos

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2879. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Sean Owen Closed via:

[jira] [Updated] (SPARK-2887) RDD.countApproxDistinct() is wrong when RDD has more one partition

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2887: --- Fix Version/s: 1.1.0 RDD.countApproxDistinct() is wrong when RDD has more one partition

[jira] [Commented] (SPARK-2887) RDD.countApproxDistinct() is wrong when RDD has more one partition

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088814#comment-14088814 ] Patrick Wendell commented on SPARK-2887: I merged this into 1.1 - [~davies] could

[jira] [Commented] (SPARK-2887) RDD.countApproxDistinct() is wrong when RDD has more one partition

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14088819#comment-14088819 ] Patrick Wendell commented on SPARK-2887: Actually I looked back and I don't think

[jira] [Resolved] (SPARK-2887) RDD.countApproxDistinct() is wrong when RDD has more one partition

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2887. Resolution: Fixed RDD.countApproxDistinct() is wrong when RDD has more one partition

[jira] [Updated] (SPARK-2887) RDD.countApproxDistinct() is wrong when RDD has more one partition

2014-08-06 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2887: --- Affects Version/s: (was: 1.0.2) (was: 0.9.1)

[jira] [Created] (SPARK-2899) Doc generation is not working in new SBT Build

2014-08-07 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2899: -- Summary: Doc generation is not working in new SBT Build Key: SPARK-2899 URL: https://issues.apache.org/jira/browse/SPARK-2899 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-2905) spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2905. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1835

[jira] [Updated] (SPARK-2905) spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2905: --- Assignee: Oleg Danilov spark-sql shows 'sbin' instead of 'bin' in the 'usage' string

[jira] [Resolved] (SPARK-2880) spark-submit processes app cmdline options

2014-08-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2880. Resolution: Duplicate I believe this is a dup of SPARK-2687. Feel free to re-open it if

[jira] [Created] (SPARK-2924) Remove use of default arguments where disallowed by 2.11

2014-08-08 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-2924: -- Summary: Remove use of default arguments where disallowed by 2.11 Key: SPARK-2924 URL: https://issues.apache.org/jira/browse/SPARK-2924 Project: Spark

[jira] [Updated] (SPARK-2924) Remove use of default arguments where disallowed by 2.11

2014-08-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2924: --- Priority: Blocker (was: Major) Target Version/s: 1.1.0 Remove use of default

[jira] [Resolved] (SPARK-2635) Fix race condition at SchedulerBackend.isReady in standalone mode

2014-08-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2635. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1525

[jira] [Updated] (SPARK-2635) Fix race condition at SchedulerBackend.isReady in standalone mode

2014-08-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2635: --- Assignee: Zhihui Fix race condition at SchedulerBackend.isReady in standalone mode

[jira] [Resolved] (SPARK-2861) Doc comment of DoubleRDDFunctions.histogram is incorrect

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2861. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1786

[jira] [Updated] (SPARK-2861) Doc comment of DoubleRDDFunctions.histogram is incorrect

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2861: --- Assignee: Chandan Kumar Doc comment of DoubleRDDFunctions.histogram is incorrect

[jira] [Commented] (SPARK-2944) sc.makeRDD doesn't distribute partitions evenly

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091699#comment-14091699 ] Patrick Wendell commented on SPARK-2944: Hey [~mengxr], do you know how the

[jira] [Commented] (SPARK-2931) getAllowedLocalityLevel() throws ArrayIndexOutOfBoundsException

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091700#comment-14091700 ] Patrick Wendell commented on SPARK-2931: [~matei] Hey Matei - IIRC you looked at

[jira] [Commented] (SPARK-2945) Allow specifying num of executors in the context configuration

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091701#comment-14091701 ] Patrick Wendell commented on SPARK-2945: Hey [~roji] I believe this already exists

[jira] [Resolved] (SPARK-1766) Move reduceByKey definitions next to each other in PairRDDFunctions

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-1766. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Chris Cope

[jira] [Resolved] (SPARK-2894) spark-shell doesn't accept flags

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2894. Resolution: Duplicate spark-shell doesn't accept flags

[jira] [Commented] (SPARK-2894) spark-shell doesn't accept flags

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14091996#comment-14091996 ] Patrick Wendell commented on SPARK-2894: I closed this in favor of SPARK-2678

[jira] [Updated] (SPARK-2678) `Spark-submit` overrides user application options

2014-08-09 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2678: --- Assignee: Kousuke Saruta (was: Cheng Lian) `Spark-submit` overrides user application

[jira] [Commented] (SPARK-2912) Jenkins should include the commit hash in his messages

2014-08-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14092435#comment-14092435 ] Patrick Wendell commented on SPARK-2912: Hey Michael - I believe [~nchammas] is

[jira] [Updated] (SPARK-2717) BasicBlockFetchIterator#next should log when it gets stuck

2014-08-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2717: --- Priority: Major (was: Blocker) BasicBlockFetchIterator#next should log when it gets stuck

[jira] [Updated] (SPARK-2717) BasicBlockFetchIterator#next should log when it gets stuck

2014-08-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2717: --- Priority: Critical (was: Major) BasicBlockFetchIterator#next should log when it gets stuck

[jira] [Updated] (SPARK-2931) getAllowedLocalityLevel() throws ArrayIndexOutOfBoundsException

2014-08-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2931: --- Target Version/s: 1.1.0 getAllowedLocalityLevel() throws ArrayIndexOutOfBoundsException

[jira] [Updated] (SPARK-2931) getAllowedLocalityLevel() throws ArrayIndexOutOfBoundsException

2014-08-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2931: --- Fix Version/s: (was: 1.1.0) getAllowedLocalityLevel() throws

[jira] [Created] (SPARK-3020) Print completed indices rather than tasks in web UI

2014-08-13 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3020: -- Summary: Print completed indices rather than tasks in web UI Key: SPARK-3020 URL: https://issues.apache.org/jira/browse/SPARK-3020 Project: Spark Issue

[jira] [Commented] (SPARK-3024) CLI interface to Driver

2014-08-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3024?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096541#comment-14096541 ] Patrick Wendell commented on SPARK-3024: Hey Jeff - mind giving a bit more color

[jira] [Created] (SPARK-3025) Allow JDBC clients to set a fair scheduler pool

2014-08-13 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3025: -- Summary: Allow JDBC clients to set a fair scheduler pool Key: SPARK-3025 URL: https://issues.apache.org/jira/browse/SPARK-3025 Project: Spark Issue

[jira] [Updated] (SPARK-3026) Provide a good error message if JDBC server is used but Spark is not compiled with -Pthriftserver

2014-08-13 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3026?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3026: --- Priority: Critical (was: Major) Provide a good error message if JDBC server is used but

[jira] [Created] (SPARK-3026) Provide a good error message if JDBC server is used but Spark is not compiled with -Pthriftserver

2014-08-13 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3026: -- Summary: Provide a good error message if JDBC server is used but Spark is not compiled with -Pthriftserver Key: SPARK-3026 URL:

[jira] [Commented] (SPARK-3028) sparkEventToJson should support SparkListenerExecutorMetricsUpdate

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096689#comment-14096689 ] Patrick Wendell commented on SPARK-3028: I think we intentionally do not intend to

[jira] [Comment Edited] (SPARK-3028) sparkEventToJson should support SparkListenerExecutorMetricsUpdate

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14096689#comment-14096689 ] Patrick Wendell edited comment on SPARK-3028 at 8/14/14 7:20 AM:

[jira] [Commented] (SPARK-3050) Spark program running with 1.0.2 jar cannot run against a 1.0.1 cluster

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14097947#comment-14097947 ] Patrick Wendell commented on SPARK-3050: Hi [~mkim] - when you launch jobs in

[jira] [Resolved] (SPARK-3050) Spark program running with 1.0.2 jar cannot run against a 1.0.1 cluster

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3050. Resolution: Not a Problem I think the issue here is just needing to use the newer version

[jira] [Updated] (SPARK-3050) Spark program running with 1.0.2 jar cannot run against a 1.0.1 cluster

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3050: --- Priority: Major (was: Critical) Spark program running with 1.0.2 jar cannot run against a

[jira] [Commented] (SPARK-2858) Default log4j file no longer seems to work

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098148#comment-14098148 ] Patrick Wendell commented on SPARK-2858: What I mean is that when I don't include

[jira] [Updated] (SPARK-2858) Default log4j configuration no longer seems to work

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2858: --- Summary: Default log4j configuration no longer seems to work (was: Default log4j file no

[jira] [Resolved] (SPARK-2912) Jenkins should include the commit hash in his messages

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2912. Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 1816

[jira] [Resolved] (SPARK-2955) Test code fails to compile with mvn compile without install

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2955. Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 1879

[jira] [Updated] (SPARK-2955) Test code fails to compile with mvn compile without install

2014-08-14 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2955: --- Assignee: Sean Owen Test code fails to compile with mvn compile without install

[jira] [Commented] (SPARK-3061) Maven build fails in Windows OS

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098223#comment-14098223 ] Patrick Wendell commented on SPARK-3061: At this time, I'm not sure we intend to

[jira] [Resolved] (SPARK-2931) getAllowedLocalityLevel() throws ArrayIndexOutOfBoundsException

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2931. Resolution: Fixed Fix Version/s: 1.1.0 Assignee: Josh Rosen This was fixed

[jira] [Resolved] (SPARK-2865) Potential deadlock: tasks could hang forever waiting to fetch a remote block even though most tasks finish

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2865. Resolution: Fixed I believe this has been resolved by virtue of other patches to the

[jira] [Resolved] (SPARK-2924) Remove use of default arguments where disallowed by 2.11

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2924. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1704

[jira] [Commented] (SPARK-1828) Created forked version of hive-exec that doesn't bundle other dependencies

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098752#comment-14098752 ] Patrick Wendell commented on SPARK-1828: Maxim - I think what you are pointing out

[jira] [Updated] (SPARK-3028) sparkEventToJson should support SparkListenerExecutorMetricsUpdate

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3028: --- Assignee: Sandy Ryza sparkEventToJson should support SparkListenerExecutorMetricsUpdate

[jira] [Resolved] (SPARK-3028) sparkEventToJson should support SparkListenerExecutorMetricsUpdate

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3028. Resolution: Fixed Fix Version/s: 1.1.0 Issue resolved by pull request 1961

[jira] [Comment Edited] (SPARK-2858) Default log4j configuration no longer seems to work

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14098148#comment-14098148 ] Patrick Wendell edited comment on SPARK-2858 at 8/15/14 8:48 PM:

[jira] [Updated] (SPARK-3075) Expose a way for users to parse event logs

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3075: --- Target Version/s: 1.2.0 Fix Version/s: (was: 1.2.0) Expose a way for users to

[jira] [Updated] (SPARK-2532) Fix issues with consolidated shuffle

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2532: --- Target Version/s: 1.2.0 (was: 1.1.0) Fix issues with consolidated shuffle

[jira] [Updated] (SPARK-2977) Fix handling of short shuffle manager names in ShuffleBlockManager

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2977: --- Priority: Critical (was: Major) Fix handling of short shuffle manager names in

[jira] [Updated] (SPARK-2044) Pluggable interface for shuffles

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2044: --- Target Version/s: 1.2.0 (was: 1.1.0) Pluggable interface for shuffles

[jira] [Commented] (SPARK-2044) Pluggable interface for shuffles

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099136#comment-14099136 ] Patrick Wendell commented on SPARK-2044: A lot of this has been fixed in 1.1 so I

[jira] [Updated] (SPARK-2585) Remove special handling of Hadoop JobConf

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2585: --- Target Version/s: 1.2.0 (was: 1.1.0) Remove special handling of Hadoop JobConf

[jira] [Updated] (SPARK-2546) Configuration object thread safety issue

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2546: --- Target Version/s: 1.2.0 (was: 1.1.0) Configuration object thread safety issue

[jira] [Commented] (SPARK-2585) Remove special handling of Hadoop JobConf

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2585?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099234#comment-14099234 ] Patrick Wendell commented on SPARK-2585: Unfortunately after a lot of effort we

[jira] [Commented] (SPARK-2546) Configuration object thread safety issue

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099239#comment-14099239 ] Patrick Wendell commented on SPARK-2546: Hey Andrew I think due to us cutting

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2914: --- Priority: Blocker (was: Major) spark.*.extraJavaOptions are evaluated too many times

[jira] [Updated] (SPARK-2914) spark.*.extraJavaOptions are evaluated too many times

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2914: --- Priority: Critical (was: Blocker) spark.*.extraJavaOptions are evaluated too many times

[jira] [Updated] (SPARK-3025) Allow JDBC clients to set a fair scheduler pool

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3025: --- Priority: Blocker (was: Major) Allow JDBC clients to set a fair scheduler pool

[jira] [Created] (SPARK-3079) Hive build should depend on parquet serdes

2014-08-15 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3079: -- Summary: Hive build should depend on parquet serdes Key: SPARK-3079 URL: https://issues.apache.org/jira/browse/SPARK-3079 Project: Spark Issue Type: Bug

[jira] [Updated] (SPARK-3015) Removing broadcast in quick successions causes Akka timeout

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3015: --- Assignee: Andrew Or Removing broadcast in quick successions causes Akka timeout

[jira] [Resolved] (SPARK-3015) Removing broadcast in quick successions causes Akka timeout

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3015. Resolution: Fixed Issue resolved by pull request 1931

[jira] [Commented] (SPARK-3015) Removing broadcast in quick successions causes Akka timeout

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099517#comment-14099517 ] Patrick Wendell commented on SPARK-3015: [~andrewor] I changed Affects version/s

[jira] [Resolved] (SPARK-2916) [MLlib] While running regression tests with dense vectors of length greater than 1000, the treeAggregate blows up after several iterations

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2916. Resolution: Fixed Fixed by virtue of SPARK-3015 [MLlib] While running regression tests

[jira] [Updated] (SPARK-3015) Removing broadcast in quick successions causes Akka timeout

2014-08-15 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3015: --- Affects Version/s: (was: 1.0.2) 1.1.0 Removing broadcast in

[jira] [Resolved] (SPARK-3076) Gracefully report build timeouts in Jenkins

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3076. Resolution: Fixed Fix Version/s: 1.2.0 Issue resolved by pull request 1974

[jira] [Updated] (SPARK-3076) Gracefully report build timeouts in Jenkins

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3076?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3076: --- Assignee: Nicholas Chammas Gracefully report build timeouts in Jenkins

[jira] [Resolved] (SPARK-2977) Fix handling of short shuffle manager names in ShuffleBlockManager

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2977. Resolution: Fixed Fix handling of short shuffle manager names in ShuffleBlockManager

[jira] [Resolved] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2878. Resolution: Fixed Fixed by SPARK-3046 via: https://github.com/apache/spark/pull/1972

[jira] [Updated] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2878: --- Fix Version/s: 1.1.0 Inconsistent Kryo serialisation with custom Kryo Registrator

[jira] [Updated] (SPARK-2878) Inconsistent Kryo serialisation with custom Kryo Registrator

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2878: --- Fix Version/s: 1.0.3 Inconsistent Kryo serialisation with custom Kryo Registrator

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099849#comment-14099849 ] Patrick Wendell commented on SPARK-2881: Actually since this uses a static system

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-16 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14099857#comment-14099857 ] Patrick Wendell commented on SPARK-2881: I filed a bug to have snappy deal with

[jira] [Updated] (SPARK-2608) scheduler backend create executor launch command not correctly

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2608: --- Fix Version/s: (was: 1.1.0) scheduler backend create executor launch command not

[jira] [Updated] (SPARK-2608) scheduler backend create executor launch command not correctly

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2608: --- Component/s: (was: Spark Core) Mesos scheduler backend create executor

[jira] [Updated] (SPARK-2608) scheduler backend create executor launch command not correctly

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2608: --- Target Version/s: 1.1.0 scheduler backend create executor launch command not correctly

[jira] [Updated] (SPARK-2608) Mesos scheduler backend create executor launch command not correctly

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2608: --- Summary: Mesos scheduler backend create executor launch command not correctly (was:

[jira] [Updated] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2881: --- Target Version/s: 1.2.0 (was: 1.1.0) Snappy is now default codec - could lead to conflicts

[jira] [Updated] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2881: --- Fix Version/s: 1.1.0 Snappy is now default codec - could lead to conflicts since uses /tmp

[jira] [Commented] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14100164#comment-14100164 ] Patrick Wendell commented on SPARK-2881: Okay I've merged a change in branch-1.1

[jira] [Updated] (SPARK-3092) Always include the thriftserver when -Phive is enabled.

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3092: --- Target Version/s: 1.1.0 Always include the thriftserver when -Phive is enabled.

[jira] [Created] (SPARK-3092) Always include the thriftserver when -Phive is enabled.

2014-08-17 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-3092: -- Summary: Always include the thriftserver when -Phive is enabled. Key: SPARK-3092 URL: https://issues.apache.org/jira/browse/SPARK-3092 Project: Spark

[jira] [Updated] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2881: --- Fix Version/s: 1.2.0 Snappy is now default codec - could lead to conflicts since uses /tmp

[jira] [Resolved] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-2881. Resolution: Fixed Snappy is now default codec - could lead to conflicts since uses /tmp

[jira] [Updated] (SPARK-2881) Snappy is now default codec - could lead to conflicts since uses /tmp

2014-08-17 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-2881: --- Target Version/s: (was: 1.2.0) Snappy is now default codec - could lead to conflicts

<    5   6   7   8   9   10   11   12   13   14   >