[jira] [Commented] (SPARK-1555) enable ec2/spark_ec2.py to stop/delete cluster non-interactively

[ https://issues.apache.org/jira/browse/SPARK-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272597#comment-14272597 ] Nicholas Chammas commented on SPARK-1555: - [~joshrosen]'s workaround is precisely

[jira] [Resolved] (SPARK-5086) Specifying the master instance type

[ https://issues.apache.org/jira/browse/SPARK-5086?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-5086. - Resolution: Duplicate Thanks for reporting this. I believe this is a duplicate of

[jira] [Commented] (SPARK-4399) Support multiple cloud providers

[ https://issues.apache.org/jira/browse/SPARK-4399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272589#comment-14272589 ] Nicholas Chammas commented on SPARK-4399: - Now that [Spark

[jira] [Commented] (SPARK-1204) EC2 scripts upload private key

[ https://issues.apache.org/jira/browse/SPARK-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272600#comment-14272600 ] Nicholas Chammas commented on SPARK-1204: - cc [~shivaram] Do you know off the top

[jira] [Commented] (SPARK-1302) httpd doesn't start in spark-ec2 (cc2.8xlarge)

[ https://issues.apache.org/jira/browse/SPARK-1302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272605#comment-14272605 ] Nicholas Chammas commented on SPARK-1302: - There is an open PR by [~fredcons] here

[jira] [Commented] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272585#comment-14272585 ] Nicholas Chammas commented on SPARK-5008: - cc [~shivaram] [~brdwrd] - What was

[jira] [Commented] (SPARK-4778) PySpark Json and groupByKey broken

[ https://issues.apache.org/jira/browse/SPARK-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272591#comment-14272591 ] Brad Willard commented on SPARK-4778: - You can close as can not reproduce. I've

[jira] [Commented] (SPARK-1422) Add scripts for launching Spark on Google Compute Engine

[ https://issues.apache.org/jira/browse/SPARK-1422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272590#comment-14272590 ] Nicholas Chammas commented on SPARK-1422: - We have [a package for launching Spark

[jira] [Commented] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272593#comment-14272593 ] Brad Willard commented on SPARK-5008: - Yes. 1.1.1 was fine. — Sent from Mailbox On

[jira] [Commented] (SPARK-1532) provide option for more restrictive firewall rule in ec2/spark_ec2.py

[ https://issues.apache.org/jira/browse/SPARK-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272601#comment-14272601 ] Nicholas Chammas commented on SPARK-1532: - I believe this capability is now

[jira] [Resolved] (SPARK-2528) Default spark-ec2 security group permissions are too open

[ https://issues.apache.org/jira/browse/SPARK-2528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-2528. - Resolution: Duplicate Default spark-ec2 security group permissions are too open

[jira] [Commented] (SPARK-5056) Implementing Clara k-medoids clustering algorithm for large datasets

[ https://issues.apache.org/jira/browse/SPARK-5056?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272458#comment-14272458 ] Tomislav Milinovic commented on SPARK-5056: --- Partitioning Around Medoids (PAM)

[jira] [Commented] (SPARK-4778) PySpark Json and groupByKey broken

[ https://issues.apache.org/jira/browse/SPARK-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272587#comment-14272587 ] Nicholas Chammas commented on SPARK-4778: - Also, though the environment is on EC2,

[jira] [Updated] (SPARK-4778) PySpark Json and groupByKey broken

[ https://issues.apache.org/jira/browse/SPARK-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-4778: Component/s: (was: EC2) PySpark Json and groupByKey broken

[jira] [Resolved] (SPARK-2649) EC2: Ganglia-httpd broken on hvm based machines like r3.4xlarge

[ https://issues.apache.org/jira/browse/SPARK-2649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-2649. - Resolution: Duplicate This issue appears to be a duplicate of [SPARK-1302]. Feel free to

[jira] [Resolved] (SPARK-4778) PySpark Json and groupByKey broken

[ https://issues.apache.org/jira/browse/SPARK-4778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-4778. - Resolution: Cannot Reproduce PySpark Json and groupByKey broken

[jira] [Commented] (SPARK-2396) Spark EC2 scripts fail when trying to log in to EC2 instances

[ https://issues.apache.org/jira/browse/SPARK-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272596#comment-14272596 ] Nicholas Chammas commented on SPARK-2396: - [~enraged_ginger] - Can you confirm

[jira] [Commented] (SPARK-1555) enable ec2/spark_ec2.py to stop/delete cluster non-interactively

[ https://issues.apache.org/jira/browse/SPARK-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272615#comment-14272615 ] Nicholas Chammas commented on SPARK-1555: - The other thing to consider, if we

[jira] [Resolved] (SPARK-4925) Publish Spark SQL hive-thriftserver maven artifact

[ https://issues.apache.org/jira/browse/SPARK-4925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4925. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Issue resolved by

[jira] [Updated] (SPARK-5088) Use spark-class for running executors directly on mesos

[ https://issues.apache.org/jira/browse/SPARK-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jongyoul Lee updated SPARK-5088: Summary: Use spark-class for running executors directly on mesos (was: Use spark-class for running

[jira] [Created] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

Nicholas Chammas created SPARK-5189: --- Summary: Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master Key: SPARK-5189 URL: https://issues.apache.org/jira/browse/SPARK-5189

[jira] [Commented] (SPARK-5189) Reorganize EC2 scripts so that nodes can be provisioned independent of Spark master

[ https://issues.apache.org/jira/browse/SPARK-5189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272660#comment-14272660 ] Nicholas Chammas commented on SPARK-5189: - cc [~joshrosen] and [~shivaram] - What

[jira] [Resolved] (SPARK-4574) Adding support for defining schema in foreign DDL commands.

[ https://issues.apache.org/jira/browse/SPARK-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4574. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3431

[jira] [Resolved] (SPARK-4943) Parsing error for query with table name having dot

[ https://issues.apache.org/jira/browse/SPARK-4943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4943. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Issue resolved by

[jira] [Resolved] (SPARK-4963) SchemaRDD.sample may return wrong results

[ https://issues.apache.org/jira/browse/SPARK-4963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4963. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3827

[jira] [Resolved] (SPARK-5187) CACHE TABLE AS SELECT fails with Hive UDFs

[ https://issues.apache.org/jira/browse/SPARK-5187?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5187. - Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 Issue resolved by

[jira] [Comment Edited] (SPARK-4922) Support dynamic allocation for coarse-grained Mesos

[ https://issues.apache.org/jira/browse/SPARK-4922?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14268826#comment-14268826 ] Jongyoul Lee edited comment on SPARK-4922 at 1/10/15 6:04 PM: --

[jira] [Resolved] (SPARK-5029) Enable from follow multiple brackets

[ https://issues.apache.org/jira/browse/SPARK-5029?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-5029. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3853

[jira] [Created] (SPARK-5190) Allow spark listeners to be added before spark context gets initialized.

Kostas Sakellis created SPARK-5190: -- Summary: Allow spark listeners to be added before spark context gets initialized. Key: SPARK-5190 URL: https://issues.apache.org/jira/browse/SPARK-5190 Project:

[jira] [Commented] (SPARK-5049) ParquetTableScan always prepends the values of partition columns in output rows irrespective of the order of the partition columns in the original SELECT query

[ https://issues.apache.org/jira/browse/SPARK-5049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272748#comment-14272748 ] Apache Spark commented on SPARK-5049: - User 'marmbrus' has created a pull request for

[jira] [Commented] (SPARK-4861) Refactory command in spark sql

[ https://issues.apache.org/jira/browse/SPARK-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272804#comment-14272804 ] Yin Huai commented on SPARK-4861: - [~scwf] Seems org.apache.spark.sql.hive.DescribeCommand

[jira] [Created] (SPARK-5192) Parquet fails to parse schemas contains '\r'

cen yuhai created SPARK-5192: Summary: Parquet fails to parse schemas contains '\r' Key: SPARK-5192 URL: https://issues.apache.org/jira/browse/SPARK-5192 Project: Spark Issue Type: Bug

[jira] [Resolved] (SPARK-5032) MimaExcludes should not exclude GraphX

[ https://issues.apache.org/jira/browse/SPARK-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5032. Resolution: Fixed Fix Version/s: 1.3.0 MimaExcludes should not exclude GraphX

[jira] [Resolved] (SPARK-4692) Support ! boolean logic operator like NOT

[ https://issues.apache.org/jira/browse/SPARK-4692?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4692. - Resolution: Fixed Fix Version/s: 1.3.0 Issue resolved by pull request 3555

[jira] [Resolved] (SPARK-5181) inaccurate log when WAL is disabled

[ https://issues.apache.org/jira/browse/SPARK-5181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das resolved SPARK-5181. -- Resolution: Fixed Fix Version/s: 1.2.1 1.3.0 inaccurate log when WAL

[jira] [Resolved] (SPARK-4871) show sql statement in spark ui when run sql use spark-sql

[ https://issues.apache.org/jira/browse/SPARK-4871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Michael Armbrust resolved SPARK-4871. - Resolution: Fixed Issue resolved by pull request 3718

[jira] [Commented] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272830#comment-14272830 ] Shivaram Venkataraman commented on SPARK-5008: -- Hmm I think

[jira] [Created] (SPARK-5191) Pyspark: scheduler hangs when importing a standalone pyspark app

Daniel Liu created SPARK-5191: - Summary: Pyspark: scheduler hangs when importing a standalone pyspark app Key: SPARK-5191 URL: https://issues.apache.org/jira/browse/SPARK-5191 Project: Spark

[jira] [Resolved] (SPARK-1204) EC2 scripts upload private key

[ https://issues.apache.org/jira/browse/SPARK-1204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-1204. - Resolution: Fixed Fix Version/s: 0.9.0 Resolving this issue per Shivaram's

[jira] [Commented] (SPARK-5008) Persistent HDFS does not recognize EBS Volumes

[ https://issues.apache.org/jira/browse/SPARK-5008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14272846#comment-14272846 ] Nicholas Chammas commented on SPARK-5008: - Though I'm not too familiar with this