[jira] [Resolved] (SPARK-7406) Add tooltips for Scheduling Delay, Processing Time and Total Delay in Streaming WebUI

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7406. Resolution: Fixed Add tooltips for Scheduling Delay, Processing Time and Total Delay in

[jira] [Reopened] (SPARK-7406) Add tooltips for Scheduling Delay, Processing Time and Total Delay in Streaming WebUI

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7406: Add tooltips for Scheduling Delay, Processing Time and Total Delay in Streaming WebUI

[jira] [Reopened] (SPARK-7528) Java compatibility of RankingMetrics

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7528: Java compatibility of RankingMetrics

[jira] [Reopened] (SPARK-7015) Multiclass to Binary Reduction

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7015: Multiclass to Binary Reduction -- Key:

[jira] [Resolved] (SPARK-7528) Java compatibility of RankingMetrics

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7528. Resolution: Fixed Java compatibility of RankingMetrics

[jira] [Resolved] (SPARK-7015) Multiclass to Binary Reduction

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7015. Resolution: Fixed Multiclass to Binary Reduction --

[jira] [Reopened] (SPARK-7552) Close files correctly when iteration is finished in WAL recovery

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7552: Close files correctly when iteration is finished in WAL recovery

[jira] [Resolved] (SPARK-7592) Resolution set to Pending Closed when using PR merge script

2015-05-12 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7592. Resolution: Fixed Fix Version/s: 1.4.0 Resolution set to Pending Closed when using

[jira] [Resolved] (SPARK-7508) JettyUtils-generated servlets to log report all errors

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7508. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Steve Loughran

[jira] [Commented] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539245#comment-14539245 ] Patrick Wendell commented on SPARK-7296: Actually maybe there is a chance we can

[jira] [Comment Edited] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539240#comment-14539240 ] Patrick Wendell edited comment on SPARK-7296 at 5/12/15 4:53 AM:

[jira] [Updated] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7296: --- Target Version/s: 1.5.0 (was: 1.4.0) Timeline view for Stage page

[jira] [Commented] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539240#comment-14539240 ] Patrick Wendell commented on SPARK-7296: Personally not sure I have time to review

[jira] [Updated] (SPARK-7296) Timeline view for Stage page

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7296: --- Target Version/s: 1.4.0, 1.5.0 (was: 1.5.0) Timeline view for Stage page

[jira] [Commented] (SPARK-7531) Install GPG on Jenkins machines

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14539097#comment-14539097 ] Patrick Wendell commented on SPARK-7531: Yep - that one should work. I've actually

[jira] [Resolved] (SPARK-7538) Kafka stream fails: java.lang.NoClassDefFound com/yammer/metrics/core/Gauge

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7538. Resolution: Fixed This was a cross post from the mailing list. The poster closed the thread

[jira] [Resolved] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-11 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7520. Resolution: Fixed Fix Version/s: 1.4.0 All green - awesome thanks [~shaneknapp]!

[jira] [Created] (SPARK-7531) Install GPG on Jenkins machines

2015-05-11 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7531: -- Summary: Install GPG on Jenkins machines Key: SPARK-7531 URL: https://issues.apache.org/jira/browse/SPARK-7531 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537530#comment-14537530 ] Patrick Wendell commented on SPARK-7520: Sounds good - thanks man. This build will

[jira] [Created] (SPARK-7521) Allow all required release credentials to be specified with env vars

2015-05-10 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7521: -- Summary: Allow all required release credentials to be specified with env vars Key: SPARK-7521 URL: https://issues.apache.org/jira/browse/SPARK-7521 Project:

[jira] [Comment Edited] (SPARK-7462) By default retain group by columns in aggregate

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537494#comment-14537494 ] Patrick Wendell edited comment on SPARK-7462 at 5/11/15 2:08 AM:

[jira] [Created] (SPARK-7520) Install Jekyll On Jenkins Machines

2015-05-10 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7520: -- Summary: Install Jekyll On Jenkins Machines Key: SPARK-7520 URL: https://issues.apache.org/jira/browse/SPARK-7520 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-7462) By default retain group by columns in aggregate

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14537494#comment-14537494 ] Patrick Wendell commented on SPARK-7462: [~rxin] since this is a user facing

[jira] [Assigned] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reassigned SPARK-1517: -- Assignee: Patrick Wendell Publish nightly snapshots of documentation, maven

[jira] [Updated] (SPARK-1517) Publish nightly snapshots of documentation, maven artifacts, and binary builds

2015-05-10 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1517: --- Target Version/s: (was: 1.4.0) Publish nightly snapshots of documentation, maven

[jira] [Updated] (SPARK-7484) Support passing jdbc connection properties for dataframe.createJDBCTable and insertIntoJDBC

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7484: --- Issue Type: Improvement (was: Bug) Support passing jdbc connection properties for

[jira] [Updated] (SPARK-7435) Make DataFrame.show() consistent with that of Scala and pySpark

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7435: --- Priority: Critical (was: Blocker) Make DataFrame.show() consistent with that of Scala and

[jira] [Resolved] (SPARK-7393) How to improve Spark SQL performance?

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7393. Resolution: Invalid Hi - thanks for giving feedback on your use of Spark SQL. This type of

[jira] [Updated] (SPARK-6961) Cannot save data to parquet files when executing from Windows from a Maven Project

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6961: --- Priority: Critical (was: Blocker) Cannot save data to parquet files when executing from

[jira] [Resolved] (SPARK-3454) Expose JSON representation of data shown in WebUI

2015-05-08 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3454. Resolution: Fixed Expose JSON representation of data shown in WebUI

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7436: --- Component/s: Deploy Cannot implement nor use custom StandaloneRecoveryModeFactory

[jira] [Updated] (SPARK-7436) Cannot implement nor use custom StandaloneRecoveryModeFactory implementations

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7436: --- Target Version/s: 1.3.2, 1.4.0 Cannot implement nor use custom StandaloneRecoveryModeFactory

[jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532980#comment-14532980 ] Patrick Wendell commented on SPARK-4105: [~bherta] can you give a bit more

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532980#comment-14532980 ] Patrick Wendell edited comment on SPARK-4105 at 5/7/15 4:46 PM:

[jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle

2015-05-07 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14532980#comment-14532980 ] Patrick Wendell edited comment on SPARK-4105 at 5/7/15 4:47 PM:

[jira] [Commented] (SPARK-7310) SparkSubmit does not escape for java options and ^ won't work

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529017#comment-14529017 ] Patrick Wendell commented on SPARK-7310: Ping [~andrewor14], IIRC there was a lot

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Assignee: Shixiong Zhu RpcCallContext.sender has a different name from the original sender's

[jira] [Updated] (SPARK-7348) DAG visualization: add links to RDD page

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7348: --- Issue Type: Improvement (was: Bug) DAG visualization: add links to RDD page

[jira] [Updated] (SPARK-7349) DAG visualization: add legend to explain the content

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7349: --- Issue Type: Improvement (was: Bug) DAG visualization: add legend to explain the content

[jira] [Updated] (SPARK-7347) DAG visualization: add hover to RDDs on job page

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7347: --- Issue Type: Improvement (was: Bug) DAG visualization: add hover to RDDs on job page

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Target Version/s: 1.4.0 RpcCallContext.sender has a different name from the original

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Fix Version/s: (was: 1.3.2) (was: 1.4.0) RpcCallContext.sender

[jira] [Commented] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14529011#comment-14529011 ] Patrick Wendell commented on SPARK-7332: I do not think this can affect version

[jira] [Updated] (SPARK-7332) RpcCallContext.sender has a different name from the original sender's name

2015-05-05 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7332: --- Affects Version/s: (was: 1.3.1) 1.4.0 RpcCallContext.sender has a

[jira] [Updated] (SPARK-7286) Precedence of operator not behaving properly

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7286: --- Priority: Critical (was: Major) Precedence of operator not behaving properly

[jira] [Updated] (SPARK-7236) AkkaUtils askWithReply sleeps indefinitely when a timeout exception is thrown

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7236: --- Priority: Critical (was: Trivial) AkkaUtils askWithReply sleeps indefinitely when a timeout

[jira] [Commented] (SPARK-1437) Jenkins should build with Java 6

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14526474#comment-14526474 ] Patrick Wendell commented on SPARK-1437: Hey [~shaneknapp] we had punted on this

[jira] [Updated] (SPARK-1437) Jenkins should build with Java 6

2015-05-04 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-1437: --- Assignee: shane knapp Jenkins should build with Java 6

[jira] [Resolved] (SPARK-7121) ClosureCleaner does not handle nesting properly

2015-05-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7121. Resolution: Fixed Fix Version/s: 1.4.0 ClosureCleaner does not handle nesting

[jira] [Resolved] (SPARK-7120) ClosureCleaner lacks documentation

2015-05-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7120. Resolution: Fixed Fix Version/s: 1.4.0 ClosureCleaner lacks documentation

[jira] [Updated] (SPARK-7315) Flaky Test: WriteAheadLogBackedBlockRDDSuite

2015-05-02 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7315?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7315: --- Component/s: Tests Flaky Test: WriteAheadLogBackedBlockRDDSuite

[jira] [Resolved] (SPARK-3444) Provide a way to easily change the log level in the Spark shell while running

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3444. Resolution: Fixed Fix Version/s: 1.4.0 Provide a way to easily change the log level

[jira] [Updated] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7304: --- Assignee: Rajendra Include $@ in call to mvn in make-distribution.sh

[jira] [Resolved] (SPARK-7304) Include $@ in call to mvn in make-distribution.sh

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7304?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7304. Resolution: Fixed Fix Version/s: 1.4.0 Include $@ in call to mvn in

[jira] [Resolved] (SPARK-7260) Support changing Spark's log level programatically

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7260. Resolution: Duplicate Support changing Spark's log level programatically

[jira] [Resolved] (SPARK-7291) Fix a flaky test in AkkaRpcEnvSuite

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7291. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Shixiong Zhu Fix a flaky

[jira] [Resolved] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7287. Resolution: Fixed Fix Version/s: 1.4.0 Flaky test: o.a.s.deploy.SparkSubmitSuite

[jira] [Resolved] (SPARK-7306) SPARK-7224 broke build with jdk6

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7306. Resolution: Fixed Fix Version/s: 1.4.0 Fixed by reverting SPARK-7224 SPARK-7224

[jira] [Reopened] (SPARK-7224) Mock repositories for testing with --packages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7224: This was reopened due to SPARK-7306 Mock repositories for testing with --packages

[jira] [Reopened] (SPARK-7287) Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-7287: I had to reopen this due to SPARK-7306 Flaky test: o.a.s.deploy.SparkSubmitSuite --packages

[jira] [Created] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7292: -- Summary: Provide operator to truncate lineage without persisting RDD's Key: SPARK-7292 URL: https://issues.apache.org/jira/browse/SPARK-7292 Project: Spark

[jira] [Created] (SPARK-7296) Timeline view for Stage page

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7296: -- Summary: Timeline view for Stage page Key: SPARK-7296 URL: https://issues.apache.org/jira/browse/SPARK-7296 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7297) Make timeline more discoverable

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7297: -- Summary: Make timeline more discoverable Key: SPARK-7297 URL: https://issues.apache.org/jira/browse/SPARK-7297 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-7298) Harmonize style of new UI visualizations

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7298: -- Summary: Harmonize style of new UI visualizations Key: SPARK-7298 URL: https://issues.apache.org/jira/browse/SPARK-7298 Project: Spark Issue Type:

[jira] [Updated] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-3468: --- Summary: Provide timeline view in Job UI pages (was: Provide timeline view in Job and Stage

[jira] [Created] (SPARK-7293) Report memory used in aggregations and joins

2015-05-01 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7293: -- Summary: Report memory used in aggregations and joins Key: SPARK-7293 URL: https://issues.apache.org/jira/browse/SPARK-7293 Project: Spark Issue Type:

[jira] [Commented] (SPARK-7292) Provide operator to truncate lineage without persisting RDD's

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522919#comment-14522919 ] Patrick Wendell commented on SPARK-7292: Yes, this would mean sacrificing fault

[jira] [Updated] (SPARK-7297) Make timeline more discoverable

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7297: --- Assignee: Patrick Wendell Make timeline more discoverable ---

[jira] [Comment Edited] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522946#comment-14522946 ] Patrick Wendell edited comment on SPARK-3468 at 5/1/15 8:38 AM:

[jira] [Resolved] (SPARK-3468) Provide timeline view in Job UI pages

2015-05-01 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-3468. Resolution: Fixed Fix Version/s: 1.4.0 Thanks for the contribution [~sarutak]

[jira] [Updated] (SPARK-7224) Mock repositories for testing with --packages

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7224: --- Target Version/s: 1.3.2, 1.4.0 Not that I've disabled the test in master and 1.3 branches.

[jira] [Resolved] (SPARK-7224) Mock repositories for testing with --packages

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7224. Resolution: Fixed Fix Version/s: 1.4.0 Target Version/s: 1.4.0 (was:

[jira] [Resolved] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6971. Resolution: Fixed Fix Version/s: 1.4.0 Each Jenkins build should use a distinct

[jira] [Updated] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-6971: --- Assignee: Patrick Wendell Each Jenkins build should use a distinct Zinc port

[jira] [Commented] (SPARK-6971) Each Jenkins build should use a distinct Zinc port

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14522151#comment-14522151 ] Patrick Wendell commented on SPARK-6971: I took care of this for the master and

[jira] [Reopened] (SPARK-4123) Show dependency changes in pull requests

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-4123: Hey [~boyork] and [~srowen] this has been consistently messing up and showing strange results.

[jira] [Updated] (SPARK-4123) Show dependency changes in pull requests

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-4123: --- Fix Version/s: (was: 1.4.0) Show dependency changes in pull requests

[jira] [Resolved] (SPARK-6479) Create external block store API

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-6479. Resolution: Fixed Fix Version/s: 1.4.0 Assignee: Zhan Zhang Create

[jira] [Reopened] (SPARK-5213) Pluggable SQL Parser Support

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5213: I believe this introduced a build break so I reopened it

[jira] [Reopened] (SPARK-5342) Allow long running Spark apps to run on secure YARN/HDFS

2015-04-30 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell reopened SPARK-5342: I had to revert this patch because it broke old Hadoop versions

[jira] [Resolved] (SPARK-7205) Support local ivy cache in --packages

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-7205. Resolution: Fixed Assignee: Burak Yavuz Support local ivy cache in --packages

[jira] [Updated] (SPARK-7213) Exception while copying Hadoop config files due to permission issues

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7213: --- Component/s: YARN Exception while copying Hadoop config files due to permission issues

[jira] [Updated] (SPARK-7224) Mock repositories for testing with --packages

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7224: --- Assignee: Burak Yavuz Mock repositories for testing with --packages

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520058#comment-14520058 ] Patrick Wendell commented on SPARK-7230: I think this is a good idea. We should

[jira] [Updated] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7233: --- Priority: Critical (was: Major) ClosureCleaner#clean blocks concurrent job submitter

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520202#comment-14520202 ] Patrick Wendell commented on SPARK-7233: Thanks this is a great find. As a simple

[jira] [Created] (SPARK-7260) Support changing Spark's log level programatically

2015-04-29 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7260: -- Summary: Support changing Spark's log level programatically Key: SPARK-7260 URL: https://issues.apache.org/jira/browse/SPARK-7260 Project: Spark Issue

[jira] [Created] (SPARK-7261) Change default log level to WARN in the REPL

2015-04-29 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7261: -- Summary: Change default log level to WARN in the REPL Key: SPARK-7261 URL: https://issues.apache.org/jira/browse/SPARK-7261 Project: Spark Issue Type:

[jira] [Updated] (SPARK-7237) Many user provided closures are not actually cleaned

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7237: --- Component/s: Spark Core Many user provided closures are not actually cleaned

[jira] [Commented] (SPARK-7233) ClosureCleaner#clean blocks concurrent job submitter threads

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520368#comment-14520368 ] Patrick Wendell commented on SPARK-7233: I think we should just create a lazy val

[jira] [Commented] (SPARK-7261) Change default log level to WARN in the REPL

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520467#comment-14520467 ] Patrick Wendell commented on SPARK-7261: Yeah, but SPARK-7260 is super simple, I

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520478#comment-14520478 ] Patrick Wendell commented on SPARK-7230: Yeah the goal is absolutely to support

[jira] [Updated] (SPARK-7228) SparkR public API for 1.4 release

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-7228: --- Priority: Blocker (was: Critical) SparkR public API for 1.4 release

[jira] [Comment Edited] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520635#comment-14520635 ] Patrick Wendell edited comment on SPARK-7230 at 4/30/15 1:13 AM:

[jira] [Commented] (SPARK-7230) Make RDD API private in SparkR for Spark 1.4

2015-04-29 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14520635#comment-14520635 ] Patrick Wendell commented on SPARK-7230: Yes - removing API's is really difficult

[jira] [Created] (SPARK-7204) Call sites in UI are not accurate for DataFrame operations

2015-04-28 Thread Patrick Wendell (JIRA)
Patrick Wendell created SPARK-7204: -- Summary: Call sites in UI are not accurate for DataFrame operations Key: SPARK-7204 URL: https://issues.apache.org/jira/browse/SPARK-7204 Project: Spark

[jira] [Commented] (SPARK-7180) SerializationDebugger fails with ArrayOutOfBoundsException

2015-04-28 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14516536#comment-14516536 ] Patrick Wendell commented on SPARK-7180: /cc [~rxin] SerializationDebugger fails

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514862#comment-14514862 ] Patrick Wendell commented on SPARK-7108: I see - when I wrote that, I meant it to

[jira] [Commented] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514822#comment-14514822 ] Patrick Wendell commented on SPARK-7108: Yes - the case I'm referring to is the

[jira] [Comment Edited] (SPARK-7108) spark.local.dir is no longer honored in Standalone mode

2015-04-27 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-7108?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14514822#comment-14514822 ] Patrick Wendell edited comment on SPARK-7108 at 4/27/15 7:50 PM:

<    1   2   3   4   5   6   7   8   9   10   >