[jira] [Created] (SPARK-18042) OutputWriter needs to return the path of the file written

Reynold Xin created SPARK-18042: --- Summary: OutputWriter needs to return the path of the file written Key: SPARK-18042 URL: https://issues.apache.org/jira/browse/SPARK-18042 Project: Spark Issue

[jira] [Updated] (SPARK-18042) OutputWriter needs to return the path of the file written

[ https://issues.apache.org/jira/browse/SPARK-18042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18042: Description: Without this we won't be able to actually use the normal OutputWriter in streaming.

[jira] [Commented] (SPARK-18042) OutputWriter needs to return the path of the file written

[ https://issues.apache.org/jira/browse/SPARK-18042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594353#comment-15594353 ] Apache Spark commented on SPARK-18042: -- User 'rxin' has created a pull request for t

[jira] [Assigned] (SPARK-18042) OutputWriter needs to return the path of the file written

[ https://issues.apache.org/jira/browse/SPARK-18042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18042: Assignee: Reynold Xin (was: Apache Spark) > OutputWriter needs to return the path of the

[jira] [Assigned] (SPARK-18042) OutputWriter needs to return the path of the file written

[ https://issues.apache.org/jira/browse/SPARK-18042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18042: Assignee: Apache Spark (was: Reynold Xin) > OutputWriter needs to return the path of the

[jira] [Updated] (SPARK-17924) Consolidate streaming and batch write path

[ https://issues.apache.org/jira/browse/SPARK-17924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-17924: Description: Structured streaming and normal SQL operation currently have two separate write path,

[jira] [Updated] (SPARK-18042) OutputWriter needs to return the path of the file written

[ https://issues.apache.org/jira/browse/SPARK-18042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin updated SPARK-18042: Description: This patch adds a new "path" method on OutputWriter that returns the path of the file

[jira] [Commented] (SPARK-15472) Add support for writing partitioned `csv`, `json`, `text` formats in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594369#comment-15594369 ] Reynold Xin commented on SPARK-15472: - This actually will be subsumed by SPARK-17924.

[jira] [Assigned] (SPARK-15472) Add support for writing partitioned `csv`, `json`, `text` formats in Structured Streaming

[ https://issues.apache.org/jira/browse/SPARK-15472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reynold Xin reassigned SPARK-15472: --- Assignee: Reynold Xin > Add support for writing partitioned `csv`, `json`, `text` formats in

[jira] [Commented] (SPARK-17829) Stable format for offset log

[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594371#comment-15594371 ] Reynold Xin commented on SPARK-17829: - I like option 3! (in reality it is a more gene

[jira] [Created] (SPARK-18043) Java example for Broadcasting

Akash Sethi created SPARK-18043: --- Summary: Java example for Broadcasting Key: SPARK-18043 URL: https://issues.apache.org/jira/browse/SPARK-18043 Project: Spark Issue Type: Task Compon

[jira] [Updated] (SPARK-18043) Java example for Broadcasting

[ https://issues.apache.org/jira/browse/SPARK-18043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akash Sethi updated SPARK-18043: Attachment: JavaBroadcastTest.java > Java example for Broadcasting > -

[jira] [Commented] (SPARK-18043) Java example for Broadcasting

[ https://issues.apache.org/jira/browse/SPARK-18043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594410#comment-15594410 ] Akash Sethi commented on SPARK-18043: - Broadcasting example is missing in from java e

[jira] [Comment Edited] (SPARK-18043) Java example for Broadcasting

[ https://issues.apache.org/jira/browse/SPARK-18043?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594410#comment-15594410 ] Akash Sethi edited comment on SPARK-18043 at 10/21/16 8:15 AM:

[jira] [Created] (SPARK-18044) FileStreamSource should not infer partitions in every batch

Wenchen Fan created SPARK-18044: --- Summary: FileStreamSource should not infer partitions in every batch Key: SPARK-18044 URL: https://issues.apache.org/jira/browse/SPARK-18044 Project: Spark Is

[jira] [Assigned] (SPARK-18044) FileStreamSource should not infer partitions in every batch

[ https://issues.apache.org/jira/browse/SPARK-18044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18044: Assignee: Apache Spark (was: Wenchen Fan) > FileStreamSource should not infer partitions

[jira] [Assigned] (SPARK-18044) FileStreamSource should not infer partitions in every batch

[ https://issues.apache.org/jira/browse/SPARK-18044?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18044: Assignee: Wenchen Fan (was: Apache Spark) > FileStreamSource should not infer partitions

[jira] [Commented] (SPARK-18044) FileStreamSource should not infer partitions in every batch

[ https://issues.apache.org/jira/browse/SPARK-18044?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594485#comment-15594485 ] Apache Spark commented on SPARK-18044: -- User 'cloud-fan' has created a pull request

[jira] [Resolved] (SPARK-17960) Upgrade to Py4J 0.10.4

[ https://issues.apache.org/jira/browse/SPARK-17960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17960. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15514 [https://github.co

[jira] [Updated] (SPARK-17960) Upgrade to Py4J 0.10.4

[ https://issues.apache.org/jira/browse/SPARK-17960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17960: -- Assignee: Jagadeesan A S > Upgrade to Py4J 0.10.4 > -- > > Key: SPA

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594517#comment-15594517 ] Sean Owen commented on SPARK-9219: -- {{mvn dependency:tree}} will be easier to read and mo

[jira] [Commented] (SPARK-17904) Add a wrapper function to install R packages on each executors.

[ https://issues.apache.org/jira/browse/SPARK-17904?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594539#comment-15594539 ] Piotr Smolinski commented on SPARK-17904: - My bad. It is about deploying the pack

[jira] [Created] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

Jiang Xingbo created SPARK-18045: Summary: Move `HiveDataFrameAnalyticsSuite` to package `sql` Key: SPARK-18045 URL: https://issues.apache.org/jira/browse/SPARK-18045 Project: Spark Issue Typ

[jira] [Created] (SPARK-18046) Spark gives error(Initial Job has not been accepted)

Farman Ali created SPARK-18046: -- Summary: Spark gives error(Initial Job has not been accepted) Key: SPARK-18046 URL: https://issues.apache.org/jira/browse/SPARK-18046 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-18046) Spark gives error(Initial Job has not been accepted)

[ https://issues.apache.org/jira/browse/SPARK-18046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-18046. --- Resolution: Invalid Target Version/s: (was: 2.0.0) Please read https://cwiki.apache.org/

[jira] [Commented] (SPARK-17906) MulticlassClassificationEvaluator support target label

[ https://issues.apache.org/jira/browse/SPARK-17906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594569#comment-15594569 ] zhengruifeng commented on SPARK-17906: -- Yes. I think it useful to expose metrics com

[jira] [Commented] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

[ https://issues.apache.org/jira/browse/SPARK-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594559#comment-15594559 ] Apache Spark commented on SPARK-18045: -- User 'jiangxb1987' has created a pull reques

[jira] [Assigned] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

[ https://issues.apache.org/jira/browse/SPARK-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18045: Assignee: Apache Spark > Move `HiveDataFrameAnalyticsSuite` to package `sql` > ---

[jira] [Commented] (SPARK-18041) activedrivers section in http:sparkMasterurl/json is missing Main class information

[ https://issues.apache.org/jira/browse/SPARK-18041?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594560#comment-15594560 ] Sean Owen commented on SPARK-18041: --- The ID identifies the driver right? Do you mean yo

[jira] [Assigned] (SPARK-18045) Move `HiveDataFrameAnalyticsSuite` to package `sql`

[ https://issues.apache.org/jira/browse/SPARK-18045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18045: Assignee: (was: Apache Spark) > Move `HiveDataFrameAnalyticsSuite` to package `sql` >

[jira] [Commented] (SPARK-17906) MulticlassClassificationEvaluator support target label

[ https://issues.apache.org/jira/browse/SPARK-17906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594570#comment-15594570 ] zhengruifeng commented on SPARK-17906: -- Yes. I think it useful to expose metrics com

[jira] [Commented] (SPARK-18022) java.lang.NullPointerException instead of real exception when saving DF to MySQL

[ https://issues.apache.org/jira/browse/SPARK-18022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594585#comment-15594585 ] Sean Owen commented on SPARK-18022: --- Yes, that code block should handle the case where

[jira] [Created] (SPARK-18047) Spark worker port should be greater than 1023

darion yaphet created SPARK-18047: - Summary: Spark worker port should be greater than 1023 Key: SPARK-18047 URL: https://issues.apache.org/jira/browse/SPARK-18047 Project: Spark Issue Type: B

[jira] [Commented] (SPARK-17906) MulticlassClassificationEvaluator support target label

[ https://issues.apache.org/jira/browse/SPARK-17906?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594607#comment-15594607 ] zhengruifeng commented on SPARK-17906: -- It seems that in that PR, we should first ob

[jira] [Updated] (SPARK-18047) Spark worker port should be greater than 1023

[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] darion yaphet updated SPARK-18047: -- Description: The port numbers in the range from 0 to 1023 are the well-known ports (system por

[jira] [Commented] (SPARK-17910) Allow users to update the comment of a column

[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594610#comment-15594610 ] Jiang Xingbo commented on SPARK-17910: -- [~yhuai] Seems we don't support `ALTER TABLE

[jira] [Commented] (SPARK-18047) Spark worker port should be greater than 1023

[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594612#comment-15594612 ] Sean Owen commented on SPARK-18047: --- You can just not specify those ports of course, an

[jira] [Updated] (SPARK-18043) Java example for Broadcasting

[ https://issues.apache.org/jira/browse/SPARK-18043?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18043: -- Flags: (was: Patch) Labels: (was: patch) Priority: Minor (was: Critical) Iss

[jira] [Commented] (SPARK-882) Have link for feedback/suggestions in docs

[ https://issues.apache.org/jira/browse/SPARK-882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594619#comment-15594619 ] Sean Owen commented on SPARK-882: - On second thought I'd just link to the https://cwiki.ap

[jira] [Updated] (SPARK-882) Have link for feedback/suggestions in docs

[ https://issues.apache.org/jira/browse/SPARK-882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-882: Priority: Minor (was: Major) > Have link for feedback/suggestions in docs >

[jira] [Issue Comment Deleted] (SPARK-17910) Allow users to update the comment of a column

[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiang Xingbo updated SPARK-17910: - Comment: was deleted (was: [~yhuai] Seems we don't support `ALTER TABLE CHANGE COLUMN` statements

[jira] [Commented] (SPARK-17910) Allow users to update the comment of a column

[ https://issues.apache.org/jira/browse/SPARK-17910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594623#comment-15594623 ] Jiang Xingbo commented on SPARK-17910: -- [~yhuai] Seems we don't support `ALTER TABL

[jira] [Assigned] (SPARK-18047) Spark worker port should be greater than 1023

[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18047: Assignee: Apache Spark > Spark worker port should be greater than 1023 > -

[jira] [Commented] (SPARK-18047) Spark worker port should be greater than 1023

[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594641#comment-15594641 ] Apache Spark commented on SPARK-18047: -- User 'darionyaphet' has created a pull reque

[jira] [Assigned] (SPARK-18047) Spark worker port should be greater than 1023

[ https://issues.apache.org/jira/browse/SPARK-18047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18047: Assignee: (was: Apache Spark) > Spark worker port should be greater than 1023 > --

[jira] [Commented] (SPARK-18039) ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced

[ https://issues.apache.org/jira/browse/SPARK-18039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594708#comment-15594708 ] Sean Owen commented on SPARK-18039: --- I am not sure I understand the scenario given this

[jira] [Commented] (SPARK-18046) Spark gives error(Initial Job has not been accepted)

[ https://issues.apache.org/jira/browse/SPARK-18046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594746#comment-15594746 ] Farman Ali commented on SPARK-18046: Please tell the link of amazon configuration for

[jira] [Resolved] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-13275. --- Resolution: Fixed Fix Version/s: 2.1.0 Issue resolved by pull request 15536 [https://github.co

[jira] [Updated] (SPARK-13275) With dynamic allocation, executors appear to be added before job starts

[ https://issues.apache.org/jira/browse/SPARK-13275?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-13275: -- Assignee: Alex Bozarth > With dynamic allocation, executors appear to be added before job starts >

[jira] [Resolved] (SPARK-17709) spark 2.0 join - column resolution error

[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17709. --- Resolution: Not A Problem Provisionally closing as not a problem, or possibly a duplicate, as of 2.0.

[jira] [Resolved] (SPARK-17908) Column names Corrupted in pysaprk dataframe groupBy

[ https://issues.apache.org/jira/browse/SPARK-17908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen resolved SPARK-17908. --- Resolution: Cannot Reproduce OK, provisionally closing as cannot reproduce > Column names Corrupted

[jira] [Updated] (SPARK-17898) --repositories needs username and password

[ https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-17898: -- Assignee: Sean Owen Priority: Trivial (was: Major) Issue Type: Documentation (was: Wish)

[jira] [Commented] (SPARK-17898) --repositories needs username and password

[ https://issues.apache.org/jira/browse/SPARK-17898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594773#comment-15594773 ] Apache Spark commented on SPARK-17898: -- User 'srowen' has created a pull request for

[jira] [Commented] (SPARK-2885) All-pairs similarity via DIMSUM

[ https://issues.apache.org/jira/browse/SPARK-2885?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594789#comment-15594789 ] Apache Spark commented on SPARK-2885: - User 'rezazadeh' has created a pull request for

[jira] [Created] (SPARK-18048) If expression behaves differently if true and false expression are interchanged in case of different data types.

Priyanka Garg created SPARK-18048: - Summary: If expression behaves differently if true and false expression are interchanged in case of different data types. Key: SPARK-18048 URL: https://issues.apache.org/jira/br

[jira] [Commented] (SPARK-18048) If expression behaves differently if true and false expression are interchanged in case of different data types.

[ https://issues.apache.org/jira/browse/SPARK-18048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594818#comment-15594818 ] Priyanka Garg commented on SPARK-18048: --- I am working on it. > If expression behav

[jira] [Commented] (SPARK-17709) spark 2.0 join - column resolution error

[ https://issues.apache.org/jira/browse/SPARK-17709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15594989#comment-15594989 ] Ashish Shrowty commented on SPARK-17709: [~sowen], [~smilegator] - I confirmed th

[jira] [Created] (SPARK-18049) Add missing tests for truePositiveRate and weightedTruePositiveRate

zhengruifeng created SPARK-18049: Summary: Add missing tests for truePositiveRate and weightedTruePositiveRate Key: SPARK-18049 URL: https://issues.apache.org/jira/browse/SPARK-18049 Project: Spark

[jira] [Assigned] (SPARK-18049) Add missing tests for truePositiveRate and weightedTruePositiveRate

[ https://issues.apache.org/jira/browse/SPARK-18049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18049: Assignee: Apache Spark > Add missing tests for truePositiveRate and weightedTruePositiveRa

[jira] [Assigned] (SPARK-18049) Add missing tests for truePositiveRate and weightedTruePositiveRate

[ https://issues.apache.org/jira/browse/SPARK-18049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18049: Assignee: (was: Apache Spark) > Add missing tests for truePositiveRate and weightedTru

[jira] [Commented] (SPARK-18049) Add missing tests for truePositiveRate and weightedTruePositiveRate

[ https://issues.apache.org/jira/browse/SPARK-18049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595007#comment-15595007 ] Apache Spark commented on SPARK-18049: -- User 'zhengruifeng' has created a pull reque

[jira] [Commented] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595098#comment-15595098 ] Chris Brown commented on SPARK-16606: - Hi [~sowen], I noticed your PR #14533 and am e

[jira] [Commented] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595112#comment-15595112 ] Sean Owen commented on SPARK-16606: --- Oops, yes I missed that. It's just a typo but wort

[jira] [Commented] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595124#comment-15595124 ] Apache Spark commented on SPARK-16606: -- User 'srowen' has created a pull request for

[jira] [Created] (SPARK-18050) spark 2.0.1 enable hive throw AlreadyExistsException(message:Database default already exists)

todd.chen created SPARK-18050: - Summary: spark 2.0.1 enable hive throw AlreadyExistsException(message:Database default already exists) Key: SPARK-18050 URL: https://issues.apache.org/jira/browse/SPARK-18050

[jira] [Updated] (SPARK-18050) spark 2.0.1 enable hive throw AlreadyExistsException(message:Database default already exists)

[ https://issues.apache.org/jira/browse/SPARK-18050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sean Owen updated SPARK-18050: -- Description: in spark 2.0.1 ,I enable hive support and when init the sqlContext ,throw a AlreadyExists

[jira] [Comment Edited] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595184#comment-15595184 ] Wenchen Fan edited comment on SPARK-17990 at 10/21/16 2:03 PM:

[jira] [Commented] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595184#comment-15595184 ] Wenchen Fan commented on SPARK-17990: - The root cause is that, hive table is not case

[jira] [Reopened] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aleksander Eskilson reopened SPARK-18016: - After digging through the stacktraces more closely, it appears that for certain very

[jira] [Commented] (SPARK-16606) Misleading warning for SparkContext.getOrCreate "WARN SparkContext: Use an existing SparkContext, some configuration may not take effect."

[ https://issues.apache.org/jira/browse/SPARK-16606?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595256#comment-15595256 ] Chris Brown commented on SPARK-16606: - Awesome, thanks! Just a typo, yes, but a signi

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595315#comment-15595315 ] Herman van Hovell commented on SPARK-18016: --- The java constant pool cannot hold

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595346#comment-15595346 ] Aleksander Eskilson commented on SPARK-18016: - Yep, understood. This would im

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595377#comment-15595377 ] Herman van Hovell commented on SPARK-18016: --- Yeah there are limitations. Splitt

[jira] [Created] (SPARK-18051) Custom PartitionCoalescer cause serialization exception

Weichen Xu created SPARK-18051: -- Summary: Custom PartitionCoalescer cause serialization exception Key: SPARK-18051 URL: https://issues.apache.org/jira/browse/SPARK-18051 Project: Spark Issue Typ

[jira] [Commented] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595424#comment-15595424 ] Yin Huai commented on SPARK-17990: -- btw, if possible, it will be good that hive tables a

[jira] [Commented] (SPARK-18051) Custom PartitionCoalescer cause serialization exception

[ https://issues.apache.org/jira/browse/SPARK-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595436#comment-15595436 ] Apache Spark commented on SPARK-18051: -- User 'WeichenXu123' has created a pull reque

[jira] [Assigned] (SPARK-18051) Custom PartitionCoalescer cause serialization exception

[ https://issues.apache.org/jira/browse/SPARK-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18051: Assignee: Apache Spark > Custom PartitionCoalescer cause serialization exception > ---

[jira] [Assigned] (SPARK-18051) Custom PartitionCoalescer cause serialization exception

[ https://issues.apache.org/jira/browse/SPARK-18051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18051: Assignee: (was: Apache Spark) > Custom PartitionCoalescer cause serialization exceptio

[jira] [Created] (SPARK-18052) Spark Job failing with org.apache.spark.rpc.RpcTimeoutException

Srikanth created SPARK-18052: Summary: Spark Job failing with org.apache.spark.rpc.RpcTimeoutException Key: SPARK-18052 URL: https://issues.apache.org/jira/browse/SPARK-18052 Project: Spark Issu

[jira] [Updated] (SPARK-18052) Spark Job failing with org.apache.spark.rpc.RpcTimeoutException

[ https://issues.apache.org/jira/browse/SPARK-18052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Srikanth updated SPARK-18052: - Attachment: sparkErrorLog.txt > Spark Job failing with org.apache.spark.rpc.RpcTimeoutException > ---

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595471#comment-15595471 ] Alberto Andreotti commented on SPARK-9219: -- Hello guys, I'm currently facing the

[jira] [Commented] (SPARK-18016) Code Generation: Constant Pool Past Limit for Wide/Nested Dataset

[ https://issues.apache.org/jira/browse/SPARK-18016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595479#comment-15595479 ] Aleksander Eskilson commented on SPARK-18016: - Thanks, yeah, I definitely rec

[jira] [Commented] (SPARK-17097) Pregel does not keep vertex state properly; fails to terminate

[ https://issues.apache.org/jira/browse/SPARK-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595521#comment-15595521 ] Jon Maurer commented on SPARK-17097: If ding's solution resolves the issue, should th

[jira] [Commented] (SPARK-5158) Allow for keytab-based HDFS security in Standalone mode

[ https://issues.apache.org/jira/browse/SPARK-5158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595524#comment-15595524 ] Ian Hummel commented on SPARK-5158: --- I'm running into this now and have done some diggin

[jira] [Commented] (SPARK-17097) Pregel does not keep vertex state properly; fails to terminate

[ https://issues.apache.org/jira/browse/SPARK-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595562#comment-15595562 ] Seth Bromberger commented on SPARK-17097: - OK by me. It's confusing behavior but

[jira] [Resolved] (SPARK-17097) Pregel does not keep vertex state properly; fails to terminate

[ https://issues.apache.org/jira/browse/SPARK-17097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Seth Bromberger resolved SPARK-17097. - Resolution: Not A Bug > Pregel does not keep vertex state properly; fails to terminate >

[jira] [Commented] (SPARK-17990) ALTER TABLE ... ADD PARTITION does not play nice with mixed-case partition column names

[ https://issues.apache.org/jira/browse/SPARK-17990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595569#comment-15595569 ] Michael Allman commented on SPARK-17990: The main problem as I see it is one of u

[jira] [Comment Edited] (SPARK-16216) CSV data source does not write date and timestamp correctly

[ https://issues.apache.org/jira/browse/SPARK-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595619#comment-15595619 ] Barry Becker edited comment on SPARK-16216 at 10/21/16 4:41 PM: ---

[jira] [Commented] (SPARK-16216) CSV data source does not write date and timestamp correctly

[ https://issues.apache.org/jira/browse/SPARK-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595619#comment-15595619 ] Barry Becker commented on SPARK-16216: -- If timezone is not specified, the date shoul

[jira] [Created] (SPARK-18053) ARRAY equality is broken in Spark 2.0

Cheng Lian created SPARK-18053: -- Summary: ARRAY equality is broken in Spark 2.0 Key: SPARK-18053 URL: https://issues.apache.org/jira/browse/SPARK-18053 Project: Spark Issue Type: Bug C

[jira] [Updated] (SPARK-18053) ARRAY equality is broken in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-18053: --- Labels: correctness (was: ) > ARRAY equality is broken in Spark 2.0 > --

[jira] [Updated] (SPARK-18053) ARRAY equality is broken in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cheng Lian updated SPARK-18053: --- Description: The following Spark shell reproduces this issue: {code} case class Test(a: Seq[Int]) Seq

[jira] [Assigned] (SPARK-18039) ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced

[ https://issues.apache.org/jira/browse/SPARK-18039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18039: Assignee: (was: Apache Spark) > ReceiverTracker run dummyjob too fast cause receiver s

[jira] [Commented] (SPARK-18039) ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced

[ https://issues.apache.org/jira/browse/SPARK-18039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595695#comment-15595695 ] Apache Spark commented on SPARK-18039: -- User 'Astralidea' has created a pull request

[jira] [Assigned] (SPARK-18039) ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced

[ https://issues.apache.org/jira/browse/SPARK-18039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18039: Assignee: Apache Spark > ReceiverTracker run dummyjob too fast cause receiver scheduling u

[jira] [Commented] (SPARK-18039) ReceiverTracker run dummyjob too fast cause receiver scheduling unbalaced

[ https://issues.apache.org/jira/browse/SPARK-18039?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595709#comment-15595709 ] astralidea commented on SPARK-18039: I have write a PR to slove & explain this proble

[jira] [Updated] (SPARK-18053) ARRAY equality is broken in Spark 2.0

[ https://issues.apache.org/jira/browse/SPARK-18053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davies Liu updated SPARK-18053: --- Assignee: Wenchen Fan > ARRAY equality is broken in Spark 2.0 > -

[jira] [Commented] (SPARK-17829) Stable format for offset log

[ https://issues.apache.org/jira/browse/SPARK-17829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595716#comment-15595716 ] Michael Armbrust commented on SPARK-17829: -- Yeah, I agree. I think it could be

[jira] [Created] (SPARK-18054) Unexpected error from UDF that gets an element of a vector: argument 1 requires vector type, however, '`_column_`' is of vector type

Barry Becker created SPARK-18054: Summary: Unexpected error from UDF that gets an element of a vector: argument 1 requires vector type, however, '`_column_`' is of vector type Key: SPARK-18054 URL: https://issues.

[jira] [Commented] (SPARK-9219) ClassCastException in instance of org.apache.spark.rdd.MapPartitionsRDD

[ https://issues.apache.org/jira/browse/SPARK-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15595770#comment-15595770 ] Nick Orka commented on SPARK-9219: -- Maybe it's better to create another JIRA ticket then,

  1   2   >