[jira] [Updated] (SPARK-5297) File Streams do not work with custom key/values

2015-01-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Saisai Shao updated SPARK-5297: --- Priority: Major (was: Minor) File Streams do not work with custom key/values

[jira] [Commented] (SPARK-5246) spark/spark-ec2.py cannot start Spark master in VPC if local DNS name does not resolve

2015-01-18 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282107#comment-14282107 ] Nicholas Chammas commented on SPARK-5246: - [~shivaram] - Should this issue be

[jira] [Commented] (SPARK-4689) Unioning 2 SchemaRDDs should return a SchemaRDD in Python, Scala, and Java

2015-01-18 Thread Bibudh Lahiri (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-4689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282119#comment-14282119 ] Bibudh Lahiri commented on SPARK-4689: -- I have added the following override method to

[jira] [Comment Edited] (SPARK-1532) provide option for more restrictive firewall rule in ec2/spark_ec2.py

2015-01-18 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-1532?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282103#comment-14282103 ] Nicholas Chammas edited comment on SPARK-1532 at 1/19/15 3:15 AM:

[jira] [Updated] (SPARK-3650) Triangle Count handles reverse edges incorrectly

2015-01-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-3650: --- Target Version/s: 1.3.0 Affects Version/s: 1.2.0 Triangle Count handles reverse edges

[jira] [Commented] (SPARK-5297) File Streams do not work with custom key/values

2015-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282217#comment-14282217 ] Apache Spark commented on SPARK-5297: - User 'jerryshao' has created a pull request for

[jira] [Commented] (SPARK-5022) Change VectorUDT to object

2015-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282177#comment-14282177 ] Apache Spark commented on SPARK-5022: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-5288) Stabilize Spark SQL data type API followup

2015-01-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282186#comment-14282186 ] Reynold Xin commented on SPARK-5288: Maybe we can just expose the leaf types, and hide

[jira] [Updated] (SPARK-3244) Add fate sharing across related files in Jenkins

2015-01-18 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas updated SPARK-3244: Component/s: (was: Spark Core) Project Infra Add fate sharing across

[jira] [Commented] (SPARK-3244) Add fate sharing across related files in Jenkins

2015-01-18 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282105#comment-14282105 ] Nicholas Chammas commented on SPARK-3244: - [~andrewor14] - I updated the

[jira] [Created] (SPARK-5314) java.lang.OutOfMemoryError in SparkSQL with GROUP BY

2015-01-18 Thread Alex Baretta (JIRA)
Alex Baretta created SPARK-5314: --- Summary: java.lang.OutOfMemoryError in SparkSQL with GROUP BY Key: SPARK-5314 URL: https://issues.apache.org/jira/browse/SPARK-5314 Project: Spark Issue Type:

[jira] [Commented] (SPARK-5314) java.lang.OutOfMemoryError in SparkSQL with GROUP BY

2015-01-18 Thread Alex Baretta (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282213#comment-14282213 ] Alex Baretta commented on SPARK-5314: - Per Akhil's comment on the dev list, SET

[jira] [Commented] (SPARK-5297) File Streams do not work with custom key/values

2015-01-18 Thread Saisai Shao (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282077#comment-14282077 ] Saisai Shao commented on SPARK-5297: Hi [~sowen], I think this issue is the same as

[jira] [Resolved] (SPARK-2396) Spark EC2 scripts fail when trying to log in to EC2 instances

2015-01-18 Thread Nicholas Chammas (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-2396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Chammas resolved SPARK-2396. - Resolution: Cannot Reproduce Resolving this issue as Cannot Reproduce. Feel free to

[jira] [Commented] (SPARK-5246) spark/spark-ec2.py cannot start Spark master in VPC if local DNS name does not resolve

2015-01-18 Thread Shivaram Venkataraman (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5246?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282117#comment-14282117 ] Shivaram Venkataraman commented on SPARK-5246: -- Yes - this can be resolved.

[jira] [Commented] (SPARK-5052) com.google.common.base.Optional binary has a wrong method signatures

2015-01-18 Thread Mohamed Fawzy Abd El Aziz (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281698#comment-14281698 ] Mohamed Fawzy Abd El Aziz commented on SPARK-5052: -- Is there any progress

[jira] [Updated] (SPARK-5249) In SparkConf accept value with Any type and perform string conversion

2015-01-18 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell updated SPARK-5249: --- Summary: In SparkConf accept value with Any type and perform string conversion (was: Added

[jira] [Created] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2015-01-18 Thread Josh Rosen (JIRA)
Josh Rosen created SPARK-5311: - Summary: EventLoggingListener throws exception if log directory does not exist Key: SPARK-5311 URL: https://issues.apache.org/jira/browse/SPARK-5311 Project: Spark

[jira] [Commented] (SPARK-5249) In SparkConf accept value with Any type and perform string conversion

2015-01-18 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282062#comment-14282062 ] Patrick Wendell commented on SPARK-5249: I also updated the title to reflect what

[jira] [Resolved] (SPARK-5249) Added setX functions to set a Boolean, Int, Float and Double parameters with a specialized function.

2015-01-18 Thread Patrick Wendell (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Patrick Wendell resolved SPARK-5249. Resolution: Won't Fix Per discussion on the issue we've decided to just ask users to

[jira] [Commented] (SPARK-5311) EventLoggingListener throws exception if log directory does not exist

2015-01-18 Thread Josh Rosen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14282063#comment-14282063 ] Josh Rosen commented on SPARK-5311: --- /cc [~vanzin] EventLoggingListener throws

[jira] [Comment Edited] (SPARK-3694) Allow printing object graph of tasks/RDD's with a debug flag

2015-01-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281700#comment-14281700 ] Reynold Xin edited comment on SPARK-3694 at 1/18/15 9:00 AM: -

[jira] [Updated] (SPARK-5308) MD5 for 1.2.0 release in not proper

2015-01-18 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-5308: --- Description:

[jira] [Commented] (SPARK-3381) DecisionTree: eliminate bins for unordered features

2015-01-18 Thread Manoj Kumar (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281820#comment-14281820 ] Manoj Kumar commented on SPARK-3381: Hi, I would like to work on this, but preferably

[jira] [Updated] (SPARK-5309) Reduce Binary/String conversion overhead when reading/writing Parquet files

2015-01-18 Thread MIchael Davies (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] MIchael Davies updated SPARK-5309: -- Description: Converting between Parquet Binary and Java Strings can form a significant

[jira] [Created] (SPARK-5309) Reduce Binary/String conversion overhead when reading/writing Parquet files

2015-01-18 Thread MIchael Davies (JIRA)
MIchael Davies created SPARK-5309: - Summary: Reduce Binary/String conversion overhead when reading/writing Parquet files Key: SPARK-5309 URL: https://issues.apache.org/jira/browse/SPARK-5309 Project:

[jira] [Created] (SPARK-5308) MD5 for 1.2.0 release in not proper

2015-01-18 Thread Kuldeep (JIRA)
Kuldeep created SPARK-5308: -- Summary: MD5 for 1.2.0 release in not proper Key: SPARK-5308 URL: https://issues.apache.org/jira/browse/SPARK-5308 Project: Spark Issue Type: Bug Components:

[jira] [Commented] (SPARK-5257) SparseVector indices must be non-negative

2015-01-18 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281811#comment-14281811 ] Apache Spark commented on SPARK-5257: - User 'MechCoder' has created a pull request for

[jira] [Commented] (SPARK-5302) Add support for SQLContext partition columns

2015-01-18 Thread Bob Tiernay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5302?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281832#comment-14281832 ] Bob Tiernay commented on SPARK-5302: This may be a duplicate of SPARK-5182. Add

[jira] [Commented] (SPARK-5182) Partitioning support for tables created by the data source API

2015-01-18 Thread Bob Tiernay (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281841#comment-14281841 ] Bob Tiernay commented on SPARK-5182: Is this intended for {{SQLContext}},

[jira] [Updated] (SPARK-5308) MD5 for 1.2.0 release in not proper

2015-01-18 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-5308: --- Description:

[jira] [Updated] (SPARK-5308) MD5 for 1.2.0 release in not proper

2015-01-18 Thread Kuldeep (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kuldeep updated SPARK-5308: --- Description:

[jira] [Commented] (SPARK-3694) Allow printing object graph of tasks/RDD's with a debug flag

2015-01-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-3694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281700#comment-14281700 ] Reynold Xin commented on SPARK-3694: Sorry I didn't see this ticket before I submitted

[jira] [Resolved] (SPARK-5279) Use java.math.BigDecimal as the exposed Decimal type

2015-01-18 Thread Reynold Xin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin resolved SPARK-5279. Resolution: Fixed Fix Version/s: 1.3.0 Assignee: Reynold Xin Use

[jira] [Assigned] (SPARK-5299) Is http://www.apache.org/dist/spark/KEYS out of date?

2015-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen reassigned SPARK-5299: Assignee: Patrick Wendell The releases are signed with 9555 DAB9 1FFA 8A15 D092 5B87 B1A9 1F00

[jira] [Created] (SPARK-5310) Update SQL programming guide for 1.3

2015-01-18 Thread Reynold Xin (JIRA)
Reynold Xin created SPARK-5310: -- Summary: Update SQL programming guide for 1.3 Key: SPARK-5310 URL: https://issues.apache.org/jira/browse/SPARK-5310 Project: Spark Issue Type: Sub-task

[jira] [Updated] (SPARK-5308) MD5 for 1.2.0 release in not proper

2015-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-5308: - Priority: Minor (was: Major) I see that the {{create-release.sh}} script makes an MD5 hash with {{gpg

[jira] [Commented] (SPARK-5297) File Streams do not work with custom key/values

2015-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281899#comment-14281899 ] Sean Owen commented on SPARK-5297: -- I don't see that this has anything to do with custom

[jira] [Updated] (SPARK-5041) hive-exec jar should be generated with JDK 6

2015-01-18 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5041?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated SPARK-5041: -- Labels: jdk1.7 maven (was: maven) hive-exec jar should be generated with JDK 6

[jira] [Commented] (SPARK-5052) com.google.common.base.Optional binary has a wrong method signatures

2015-01-18 Thread Elmer Garduno (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281965#comment-14281965 ] Elmer Garduno commented on SPARK-5052: -- The pull request is waiting for an admin to

[jira] [Commented] (SPARK-5308) MD5 for 1.2.0 release in not proper

2015-01-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-5308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14281958#comment-14281958 ] Sean Owen commented on SPARK-5308: -- Hm, well {{md5sum ... | cut -f1 -d' '}} looks like it