[jira] [Commented] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-6084?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341746#comment-14341746 ] Nicholas Chammas commented on SPARK-6084: - cc [~pwendell], [~andrewor14] I haven'

[jira] [Created] (SPARK-6084) spark-shell broken on Windows

2015-02-28 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-6084: --- Summary: spark-shell broken on Windows Key: SPARK-6084 URL: https://issues.apache.org/jira/browse/SPARK-6084 Project: Spark Issue Type: Bug C

[jira] [Commented] (SPARK-5312) Use sbt to detect new or changed public classes in PRs

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335573#comment-14335573 ] Nicholas Chammas commented on SPARK-5312: - It's something to consider I guess. Spa

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5971: Description: Right now, spark-ec2 can only launch Spark clusters that use the standalone ma

[jira] [Updated] (SPARK-5971) Add Mesos support to spark-ec2

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5971: Summary: Add Mesos support to spark-ec2 (was: Add support for launching Spark-on-Mesos clus

[jira] [Created] (SPARK-5971) Add support for launching Spark-on-Mesos clusters to spark-ec2

2015-02-24 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5971: --- Summary: Add support for launching Spark-on-Mesos clusters to spark-ec2 Key: SPARK-5971 URL: https://issues.apache.org/jira/browse/SPARK-5971 Project: Spark

[jira] [Commented] (SPARK-3674) Add support for launching YARN clusters in spark-ec2

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335199#comment-14335199 ] Nicholas Chammas commented on SPARK-3674: - There is an open PR for this here: http

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335074#comment-14335074 ] Nicholas Chammas commented on SPARK-3850: - Ah I see. I'm fine with closing this is

[jira] [Updated] (SPARK-3850) Scala style: disallow trailing spaces

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3850: Description: Background discussions: * https://github.com/apache/spark/pull/2619 * http://a

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

2015-02-24 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14335045#comment-14335045 ] Nicholas Chammas commented on SPARK-3850: - I guess the root is the [Style Guide|h

[jira] [Comment Edited] (SPARK-3850) Scala style: disallow trailing spaces

2015-02-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334351#comment-14334351 ] Nicholas Chammas edited comment on SPARK-3850 at 2/24/15 5:16 AM: --

[jira] [Commented] (SPARK-5312) Use sbt to detect new or changed public classes in PRs

2015-02-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5312?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334355#comment-14334355 ] Nicholas Chammas commented on SPARK-5312: - Yeah, this is not a priority really. I

[jira] [Commented] (SPARK-4123) Show new dependencies added in pull requests

2015-02-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334352#comment-14334352 ] Nicholas Chammas commented on SPARK-4123: - Go ahead! I haven't done anything for t

[jira] [Commented] (SPARK-3850) Scala style: disallow trailing spaces

2015-02-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14334351#comment-14334351 ] Nicholas Chammas commented on SPARK-3850: - {quote} enabled="false" {quote} Per th

[jira] [Updated] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

2015-02-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5944: Target Version/s: 1.2.2 > Python release docs say SNAPSHOT + Author is missing > ---

[jira] [Commented] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

2015-02-23 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14333496#comment-14333496 ] Nicholas Chammas commented on SPARK-5944: - I'm not sure, but I think [here in the

[jira] [Updated] (SPARK-1050) Investigate AnyRefMap

2015-02-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1050: Target Version/s: 1.4.0 Since Spark can now be built with Scala 2.11, I believe this issue c

[jira] [Commented] (SPARK-1001) Memory leak when reading sequence file and then sorting

2015-02-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332444#comment-14332444 ] Nicholas Chammas commented on SPARK-1001: - It's probably tough given how long ago

[jira] [Commented] (SPARK-765) Test suite should run Spark example programs

2015-02-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332438#comment-14332438 ] Nicholas Chammas commented on SPARK-765: Seems like a good idea. [~joshrosen] I ass

[jira] [Commented] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

2015-02-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332394#comment-14332394 ] Nicholas Chammas commented on SPARK-5944: - cc [~davies], [~joshrosen] > Python re

[jira] [Created] (SPARK-5944) Python release docs say SNAPSHOT + Author is missing

2015-02-22 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5944: --- Summary: Python release docs say SNAPSHOT + Author is missing Key: SPARK-5944 URL: https://issues.apache.org/jira/browse/SPARK-5944 Project: Spark Issu

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2015-02-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14332303#comment-14332303 ] Nicholas Chammas commented on SPARK-3821: - For those wanting to use the work being

[jira] [Resolved] (SPARK-4958) Bake common tools like ganglia into Spark AMI

2015-02-22 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-4958. - Resolution: Duplicate Fix Version/s: (was: 1.3.0) Closing this as a duplicate o

[jira] [Updated] (SPARK-5923) Very slow query when using Oracle hive metastore and table has lots of partitions

2015-02-21 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5923: Component/s: SQL > Very slow query when using Oracle hive metastore and table has lots of

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-20 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14329771#comment-14329771 ] Nicholas Chammas commented on SPARK-5629: - [~florianverhein] - Hmm... Thinking abo

[jira] [Commented] (SPARK-5879) spary_ec2.py should expose/return master and slave lists (e.g. write to file)

2015-02-19 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14328639#comment-14328639 ] Nicholas Chammas commented on SPARK-5879: - If you just need the master address, yo

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325372#comment-14325372 ] Nicholas Chammas commented on SPARK-5629: - YAML is not part of the Python standard

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325346#comment-14325346 ] Nicholas Chammas commented on SPARK-5629: - For example, you run: {code} $ spark-e

[jira] [Commented] (SPARK-925) Allow ec2 scripts to load default options from a json file

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325334#comment-14325334 ] Nicholas Chammas commented on SPARK-925: Here's an example of what a spark-ec2 {{co

[jira] [Commented] (SPARK-925) Allow ec2 scripts to load default options from a json file

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14325317#comment-14325317 ] Nicholas Chammas commented on SPARK-925: I would prefer a format that is more human

[jira] [Commented] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324888#comment-14324888 ] Nicholas Chammas commented on SPARK-5629: - cc [~joshrosen] / [~shivaram] I see th

[jira] [Updated] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Description: You can launch multiple clusters using spark-ec2. At some point, you might just

[jira] [Updated] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Description: You can launch multiple clusters using spark-ec2. At some point, you might just

[jira] [Updated] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Description: You can launch multiple clusters using spark-ec2. At some point, you might just

[jira] [Updated] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Description: You can launch multiple clusters using spark-ec2. At some point, you might just

[jira] [Updated] (SPARK-5865) Add doc warnings for methods that return local data structures

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5865: Description: We should include a note in the doc string for any method that collects an RDD

[jira] [Updated] (SPARK-5627) Enhance spark-ec2 to return machine-readable output

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5627: Summary: Enhance spark-ec2 to return machine-readable output (was: Enhance spark-ec2 for so

[jira] [Updated] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5627: Description: There are some cases where users may want to programmatically invoke {{spark-e

[jira] [Updated] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5627: Description: There are some cases where users may want to programmatically invoke {{spark-e

[jira] [Updated] (SPARK-5629) Add spark-ec2 action to return info about an existing cluster

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5629: Summary: Add spark-ec2 action to return info about an existing cluster (was: Add spark-ec2

[jira] [Updated] (SPARK-5865) Add doc warnings for methods that return local data structures

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5865: Summary: Add doc warnings for methods that return local data structures (was: Add doc warni

[jira] [Commented] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324717#comment-14324717 ] Nicholas Chammas commented on SPARK-5627: - cc [~joshrosen] / [~shivaram] > Enhanc

[jira] [Commented] (SPARK-5627) Enhance spark-ec2 for some programmatic use cases

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5627?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324716#comment-14324716 ] Nicholas Chammas commented on SPARK-5627: - I think a good way to offer this might

[jira] [Commented] (SPARK-925) Allow ec2 scripts to load default options from a json file

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324708#comment-14324708 ] Nicholas Chammas commented on SPARK-925: Formatting side comment: You can surround

[jira] [Updated] (SPARK-5851) spark_ec2.py ssh failure retry handling not always appropriate

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5851: Description: The following function doesn't distinguish between the ssh failing (e.g. presu

[jira] [Commented] (SPARK-5851) spark_ec2.py ssh failure retry handling not always appropriate

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324694#comment-14324694 ] Nicholas Chammas commented on SPARK-5851: - Yeah, that's a good catch. Have you run

[jira] [Updated] (SPARK-5851) spark_ec2.py ssh failure retry handling not always appropriate

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5851: Description: The following function doesn't distinguish between the ssh failing (e.g. presu

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Target Version/s: 1.2.2 Fix Version/s: (was: 1.2.2) > Add option to return spark-

[jira] [Updated] (SPARK-5851) spark_ec2.py ssh failure retry handling not always appropriate

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5851: Description: The following function doesn't distinguish between the ssh failing (e.g. presu

[jira] [Comment Edited] (SPARK-925) Allow ec2 scripts to load default options from a json file

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321810#comment-14321810 ] Nicholas Chammas edited comment on SPARK-925 at 2/17/15 6:53 PM:

[jira] [Updated] (SPARK-5711) Sort Shuffle performance issues about using AppendOnlyMap for large data sets

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5711: Component/s: Shuffle > Sort Shuffle performance issues about using AppendOnlyMap for large d

[jira] [Updated] (SPARK-5856) In Maven build script, launch Zinc with more memory

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5856: Component/s: Build > In Maven build script, launch Zinc with more memory > -

[jira] [Updated] (SPARK-5763) Sort-based Groupby and Join to resolve skewed data

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5763: Component/s: Spark Core Shuffle > Sort-based Groupby and Join to resolve sk

[jira] [Updated] (SPARK-5708) Add Slf4jSink to Spark Metrics Sink

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5708: Component/s: Spark Core > Add Slf4jSink to Spark Metrics Sink >

[jira] [Commented] (SPARK-5865) Add doc warnings for methods that collect an RDD to the driver

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14324631#comment-14324631 ] Nicholas Chammas commented on SPARK-5865: - cc [~rxin], [~pwendell], [~joshrosen]:

[jira] [Created] (SPARK-5865) Add doc warnings for methods that collect an RDD to the driver

2015-02-17 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5865: --- Summary: Add doc warnings for methods that collect an RDD to the driver Key: SPARK-5865 URL: https://issues.apache.org/jira/browse/SPARK-5865 Project: Spark

[jira] [Resolved] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

2015-02-17 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-5749. - Resolution: Fixed Fixed by: https://github.com/apache/spark/pull/4561 [~andrewor14] - Wha

[jira] [Commented] (SPARK-5637) Expose spark_ec2 as as StarCluster Plugin

2015-02-15 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321811#comment-14321811 ] Nicholas Chammas commented on SPARK-5637: - OK, so I watched [the intro video for

[jira] [Commented] (SPARK-925) Allow ec2 scripts to load default options from a json file

2015-02-15 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321810#comment-14321810 ] Nicholas Chammas commented on SPARK-925: Loading config from a file seems like a go

[jira] [Commented] (SPARK-5813) Spark-ec2: Switch to OracleJDK

2015-02-15 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14321807#comment-14321807 ] Nicholas Chammas commented on SPARK-5813: - Given the above discussion, this seems

[jira] [Commented] (SPARK-3821) Develop an automated way of creating Spark images (AMI, Docker, and others)

2015-02-13 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14320905#comment-14320905 ] Nicholas Chammas commented on SPARK-3821: - If you want Java 8 alongside 7, you can

[jira] [Commented] (SPARK-5765) word split problem in run-example and compute-classpath

2015-02-12 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14318869#comment-14318869 ] Nicholas Chammas commented on SPARK-5765: - FWIW [~srowen], the last time I had thi

[jira] [Updated] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

2015-02-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5749: Issue Type: Bug (was: Sub-task) Parent: (was: SPARK-5747) > Fix Bash word split

[jira] [Created] (SPARK-5749) Fix Bash word splitting bugs in compute-classpath.sh

2015-02-11 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5749: --- Summary: Fix Bash word splitting bugs in compute-classpath.sh Key: SPARK-5749 URL: https://issues.apache.org/jira/browse/SPARK-5749 Project: Spark Issu

[jira] [Updated] (SPARK-5747) Review all Bash scripts for word splitting bugs

2015-02-11 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5747: Description: Triggered by [this discussion|http://apache-spark-developers-list.1001551.n3.n

[jira] [Created] (SPARK-5747) Review all Bash scripts for word splitting bugs

2015-02-11 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5747: --- Summary: Review all Bash scripts for word splitting bugs Key: SPARK-5747 URL: https://issues.apache.org/jira/browse/SPARK-5747 Project: Spark Issue Typ

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313271#comment-14313271 ] Nicholas Chammas commented on SPARK-5676: - Yeah, AFAIK it has nothing to do with M

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313254#comment-14313254 ] Nicholas Chammas commented on SPARK-5676: - It ended up in Mesos because [Spark its

[jira] [Commented] (SPARK-5676) License missing from spark-ec2 repo

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313214#comment-14313214 ] Nicholas Chammas commented on SPARK-5676: - [~srowen] - I don't think it's appropri

[jira] [Commented] (SPARK-1805) Error launching cluster when master and slave machines are of different virtualization types

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14313079#comment-14313079 ] Nicholas Chammas commented on SPARK-1805: - I've created a PR to catch this error e

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312878#comment-14312878 ] Nicholas Chammas commented on SPARK-3044: - I use RSS plenty to track companies, pe

[jira] [Commented] (SPARK-3044) Create RSS feed for Spark News

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14312854#comment-14312854 ] Nicholas Chammas commented on SPARK-3044: - [~rxin] / [~pwendell] Is there anyone a

[jira] [Commented] (SPARK-5685) Show warning when users open text files compressed with non-splittable algorithms like gzip

2015-02-09 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311931#comment-14311931 ] Nicholas Chammas commented on SPARK-5685: - [~joshrosen] - What do you think of add

[jira] [Created] (SPARK-5685) Show warning when users open text files compressed with non-splittable algorithms like gzip

2015-02-09 Thread Nicholas Chammas (JIRA)
Nicholas Chammas created SPARK-5685: --- Summary: Show warning when users open text files compressed with non-splittable algorithms like gzip Key: SPARK-5685 URL: https://issues.apache.org/jira/browse/SPARK-5685

[jira] [Commented] (SPARK-3431) Parallelize Scala/Java test execution

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311135#comment-14311135 ] Nicholas Chammas commented on SPARK-3431: - [~srowen] - Have you tried anything rec

[jira] [Issue Comment Deleted] (SPARK-5524) Remove messy dependencies to log4j

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5524: Comment: was deleted (was: Oh my bad. Thanks for the correction.) > Remove messy dependenci

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311121#comment-14311121 ] Nicholas Chammas commented on SPARK-5524: - Oh my bad. Thanks for the correction.

[jira] [Commented] (SPARK-5524) Remove messy dependencies to log4j

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311122#comment-14311122 ] Nicholas Chammas commented on SPARK-5524: - Oh my bad. Thanks for the correction.

[jira] [Updated] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5668: Labels: starter (was: ) > spark_ec2.py region parameter could be either mandatory or its va

[jira] [Commented] (SPARK-5628) Add option to return spark-ec2 version

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311055#comment-14311055 ] Nicholas Chammas commented on SPARK-5628: - We still need a backport to 1.2.2 for t

[jira] [Commented] (SPARK-5668) spark_ec2.py region parameter could be either mandatory or its value displayed

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311054#comment-14311054 ] Nicholas Chammas commented on SPARK-5668: - This sounds good to me, Miguel. I've be

[jira] [Updated] (SPARK-4383) Delay scheduling doesn't work right when jobs have tasks with different locality levels

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4383: Component/s: Scheduler > Delay scheduling doesn't work right when jobs have tasks with diffe

[jira] [Updated] (SPARK-1142) Allow adding jars on app submission, outside of code

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1142: Component/s: Spark Submit > Allow adding jars on app submission, outside of code > -

[jira] [Updated] (SPARK-5156) Priority queue for cross application scheduling

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5156: Component/s: Scheduler > Priority queue for cross application scheduling > -

[jira] [Updated] (SPARK-5080) Expose more cluster resource information to user

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5080: Component/s: Spark Core > Expose more cluster resource information to user > ---

[jira] [Updated] (SPARK-5524) Remove messy dependencies to log4j

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5524: Component/s: Build > Remove messy dependencies to log4j > --

[jira] [Updated] (SPARK-4808) Spark fails to spill with small number of large objects

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4808: Component/s: Spark Core > Spark fails to spill with small number of large objects >

[jira] [Commented] (SPARK-5363) Spark 1.2 freeze without error notification

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14311050#comment-14311050 ] Nicholas Chammas commented on SPARK-5363: - [~TJKlein] - Can you provide more infor

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5175: Component/s: (was: Spark Core) Streaming > bug in updating counters whe

[jira] [Updated] (SPARK-5363) Spark 1.2 freeze without error notification

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5363: Component/s: PySpark > Spark 1.2 freeze without error notification > ---

[jira] [Updated] (SPARK-5175) bug in updating counters when starting multiple workers/supervisors in actor-based receiver

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5175: Component/s: Spark Core > bug in updating counters when starting multiple workers/supervisor

[jira] [Updated] (SPARK-5259) Fix endless retry stage by add task equal() and hashcode() to avoid stage.pendingTasks not empty while stage map output is available

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5259: Component/s: Spark Core > Fix endless retry stage by add task equal() and hashcode() to avoi

[jira] [Updated] (SPARK-1061) allow Hadoop RDDs to be read w/ a partitioner

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-1061: Component/s: Spark Core > allow Hadoop RDDs to be read w/ a partitioner > --

[jira] [Updated] (SPARK-5664) Restore stty settings when exiting for launching spark-shell from SBT

2015-02-07 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5664: Component/s: Build > Restore stty settings when exiting for launching spark-shell from SBT >

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Labels: backport-needed (was: ) > Add option to return spark-ec2 version >

[jira] [Updated] (SPARK-5628) Add option to return spark-ec2 version

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-5628: Fix Version/s: 1.2.2 > Add option to return spark-ec2 version >

[jira] [Updated] (SPARK-3956) Python API for Distributed Matrix

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3956: Component/s: PySpark > Python API for Distributed Matrix > -

[jira] [Updated] (SPARK-3600) RDD[Double] doesn't use primitive arrays for caching

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3600: Component/s: Spark Core > RDD[Double] doesn't use primitive arrays for caching > ---

[jira] [Updated] (SPARK-4024) Remember user preferences for metrics to show in the UI

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4024?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4024: Component/s: Web UI > Remember user preferences for metrics to show in the UI >

[jira] [Updated] (SPARK-3246) Support weighted SVMWithSGD for classification of unbalanced dataset

2015-02-06 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3246: Component/s: MLlib > Support weighted SVMWithSGD for classification of unbalanced dataset >

<    3   4   5   6   7   8   9   10   11   12   >