[jira] [Updated] (SPARK-19623) Take rows from DataFrame with empty first partition

2017-02-15 Thread Jaeboo Jung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jaeboo Jung updated SPARK-19623: Description: I use Spark 1.6.2 with 1 master and 6 workers. Assuming we have partitions having a

[jira] [Created] (SPARK-19623) Take rows from DataFrame with empty first partition

2017-02-15 Thread Jaeboo Jung (JIRA)
Jaeboo Jung created SPARK-19623: --- Summary: Take rows from DataFrame with empty first partition Key: SPARK-19623 URL: https://issues.apache.org/jira/browse/SPARK-19623 Project: Spark Issue

[jira] [Assigned] (SPARK-18285) approxQuantile in R support multi-column

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18285: Assignee: (was: Apache Spark) > approxQuantile in R support multi-column >

[jira] [Commented] (SPARK-18285) approxQuantile in R support multi-column

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869400#comment-15869400 ] Apache Spark commented on SPARK-18285: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Closed] (SPARK-19619) SparkR approxQuantile supports input multiple columns

2017-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang closed SPARK-19619. --- Resolution: Duplicate > SparkR approxQuantile supports input multiple columns >

[jira] [Assigned] (SPARK-18285) approxQuantile in R support multi-column

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-18285: Assignee: Apache Spark > approxQuantile in R support multi-column >

[jira] [Assigned] (SPARK-19622) Fix a http error in a paged table when using a `Go` button to search.

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19622: Assignee: Apache Spark > Fix a http error in a paged table when using a `Go` button to

[jira] [Assigned] (SPARK-19622) Fix a http error in a paged table when using a `Go` button to search.

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19622: Assignee: (was: Apache Spark) > Fix a http error in a paged table when using a `Go`

[jira] [Commented] (SPARK-19622) Fix a http error in a paged table when using a `Go` button to search.

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869389#comment-15869389 ] Apache Spark commented on SPARK-19622: -- User 'stanzhai' has created a pull request for this issue:

[jira] [Updated] (SPARK-19622) Fix a http error in a paged table when using a `Go` button to search.

2017-02-15 Thread StanZhai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] StanZhai updated SPARK-19622: - Attachment: screenshot-1.png > Fix a http error in a paged table when using a `Go` button to search. >

[jira] [Created] (SPARK-19622) Fix a http error in a paged table when using a `Go` button to search.

2017-02-15 Thread StanZhai (JIRA)
StanZhai created SPARK-19622: Summary: Fix a http error in a paged table when using a `Go` button to search. Key: SPARK-19622 URL: https://issues.apache.org/jira/browse/SPARK-19622 Project: Spark

[jira] [Commented] (SPARK-19594) StreamingQueryListener fails to handle QueryTerminatedEvent if more then one listeners exists

2017-02-15 Thread Eyal Zituny (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869368#comment-15869368 ] Eyal Zituny commented on SPARK-19594: - that will work but i will have to remove the "final" from the

[jira] [Created] (SPARK-19621) R Windows AppVeyor test should run CRAN checks

2017-02-15 Thread Felix Cheung (JIRA)
Felix Cheung created SPARK-19621: Summary: R Windows AppVeyor test should run CRAN checks Key: SPARK-19621 URL: https://issues.apache.org/jira/browse/SPARK-19621 Project: Spark Issue Type:

[jira] [Resolved] (SPARK-19618) Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

2017-02-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-19618. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16948

[jira] [Assigned] (SPARK-19618) Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

2017-02-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-19618: --- Assignee: Tejas Patil > Inconsistency wrt max. buckets allowed from Dataframe API vs SQL >

[jira] [Commented] (SPARK-19619) SparkR approxQuantile supports input multiple columns

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869337#comment-15869337 ] Felix Cheung commented on SPARK-19619: -- dup of SPARK-18285 > SparkR approxQuantile supports input

[jira] [Commented] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869336#comment-15869336 ] Apache Spark commented on SPARK-19620: -- User 'carsonwang' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19620: Assignee: Apache Spark > Incorrect exchange coordinator Id in physical plan >

[jira] [Assigned] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19620: Assignee: (was: Apache Spark) > Incorrect exchange coordinator Id in physical plan >

[jira] [Created] (SPARK-19620) Incorrect exchange coordinator Id in physical plan

2017-02-15 Thread Carson Wang (JIRA)
Carson Wang created SPARK-19620: --- Summary: Incorrect exchange coordinator Id in physical plan Key: SPARK-19620 URL: https://issues.apache.org/jira/browse/SPARK-19620 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

2017-02-15 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869314#comment-15869314 ] Tejas Patil commented on SPARK-19326: - > You might be able to just write an `if` case that checks

[jira] [Updated] (SPARK-19619) SparkR approxQuantile supports input multiple columns

2017-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-19619: Description: SparkR approxQuantile supports input multiple columns. (was: SparkR approxQuantile

[jira] [Assigned] (SPARK-19619) SparkR approxQuantile support multiple columns

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19619: Assignee: (was: Apache Spark) > SparkR approxQuantile support multiple columns >

[jira] [Assigned] (SPARK-19619) SparkR approxQuantile support multiple columns

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19619: Assignee: Apache Spark > SparkR approxQuantile support multiple columns >

[jira] [Updated] (SPARK-19619) SparkR approxQuantile supports input multiple columns

2017-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang updated SPARK-19619: Summary: SparkR approxQuantile supports input multiple columns (was: SparkR approxQuantile

[jira] [Commented] (SPARK-19619) SparkR approxQuantile support multiple columns

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869283#comment-15869283 ] Apache Spark commented on SPARK-19619: -- User 'yanboliang' has created a pull request for this issue:

[jira] [Created] (SPARK-19619) SparkR approxQuantile support multiple columns

2017-02-15 Thread Yanbo Liang (JIRA)
Yanbo Liang created SPARK-19619: --- Summary: SparkR approxQuantile support multiple columns Key: SPARK-19619 URL: https://issues.apache.org/jira/browse/SPARK-19619 Project: Spark Issue Type:

[jira] [Commented] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

2017-02-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869244#comment-15869244 ] Andrew Or commented on SPARK-19326: --- I would say it's a bad idea to make ExecutorAllocationManager talk

[jira] [Resolved] (SPARK-19603) Fix StreamingQuery explain command

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19603. -- Resolution: Fixed Fix Version/s: 2.2.0 2.1.1 > Fix StreamingQuery

[jira] [Commented] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

2017-02-15 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869112#comment-15869112 ] Tejas Patil commented on SPARK-19326: - Thanks for the info !! [~andrewor14] / [~kayousterhout] : I

[jira] [Commented] (SPARK-19399) R Coalesce on DataFrame and coalesce on column

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869067#comment-15869067 ] Apache Spark commented on SPARK-19399: -- User 'felixcheung' has created a pull request for this

[jira] [Assigned] (SPARK-16122) Spark History Server REST API missing an environment endpoint per application

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16122: Assignee: (was: Apache Spark) > Spark History Server REST API missing an environment

[jira] [Assigned] (SPARK-16122) Spark History Server REST API missing an environment endpoint per application

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16122?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-16122: Assignee: Apache Spark > Spark History Server REST API missing an environment endpoint

[jira] [Commented] (SPARK-16122) Spark History Server REST API missing an environment endpoint per application

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-16122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869062#comment-15869062 ] Apache Spark commented on SPARK-16122: -- User 'uncleGen' has created a pull request for this issue:

[jira] [Updated] (SPARK-19460) Update dataset used in R documentation, examples to reduce warning noise and confusions

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19460?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Felix Cheung updated SPARK-19460: - Yes- it's better to address the root issue with column name but it wouldn't hurt to avoid confusing

[jira] [Commented] (SPARK-19604) Log the start of every Python test

2017-02-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869023#comment-15869023 ] Yin Huai commented on SPARK-19604: -- It has been resolved by https://github.com/apache/spark/pull/16935.

[jira] [Resolved] (SPARK-19604) Log the start of every Python test

2017-02-15 Thread Yin Huai (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yin Huai resolved SPARK-19604. -- Resolution: Fixed Fix Version/s: 2.1.1 2.0.3 > Log the start of every Python

[jira] [Commented] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

2017-02-15 Thread Andrew Or (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15869020#comment-15869020 ] Andrew Or commented on SPARK-19326: --- Sorry for slipping on this. When I was implementing the feature

[jira] [Comment Edited] (SPARK-18113) Sending AskPermissionToCommitOutput failed, driver enter into task deadloop

2017-02-15 Thread xukun (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18113?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15867124#comment-15867124 ] xukun edited comment on SPARK-18113 at 2/16/17 1:58 AM: [~aash] According my

[jira] [Assigned] (SPARK-19618) Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19618: Assignee: (was: Apache Spark) > Inconsistency wrt max. buckets allowed from Dataframe

[jira] [Commented] (SPARK-19618) Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19618?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868963#comment-15868963 ] Apache Spark commented on SPARK-19618: -- User 'tejasapatil' has created a pull request for this

[jira] [Assigned] (SPARK-19618) Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19618: Assignee: Apache Spark > Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

[jira] [Created] (SPARK-19618) Inconsistency wrt max. buckets allowed from Dataframe API vs SQL

2017-02-15 Thread Tejas Patil (JIRA)
Tejas Patil created SPARK-19618: --- Summary: Inconsistency wrt max. buckets allowed from Dataframe API vs SQL Key: SPARK-19618 URL: https://issues.apache.org/jira/browse/SPARK-19618 Project: Spark

[jira] [Assigned] (SPARK-19617) Fix a case that a query may not stop due to HADOOP-14084

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19617: Assignee: Shixiong Zhu (was: Apache Spark) > Fix a case that a query may not stop due to

[jira] [Commented] (SPARK-19617) Fix a case that a query may not stop due to HADOOP-14084

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868913#comment-15868913 ] Apache Spark commented on SPARK-19617: -- User 'zsxwing' has created a pull request for this issue:

[jira] [Commented] (SPARK-19460) Update dataset used in R documentation, examples to reduce warning noise and confusions

2017-02-15 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868914#comment-15868914 ] Miao Wang commented on SPARK-19460: --- By the way, I remembered that you had discussion about fixing the

[jira] [Assigned] (SPARK-19617) Fix a case that a query may not stop due to HADOOP-14084

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19617?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19617: Assignee: Apache Spark (was: Shixiong Zhu) > Fix a case that a query may not stop due to

[jira] [Commented] (SPARK-19460) Update dataset used in R documentation, examples to reduce warning noise and confusions

2017-02-15 Thread Miao Wang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868911#comment-15868911 ] Miao Wang commented on SPARK-19460: --- Seems a lots of work. :) I can give a try. > Update dataset used

[jira] [Created] (SPARK-19617) Fix a case that a query may not stop due to HADOOP-14084

2017-02-15 Thread Shixiong Zhu (JIRA)
Shixiong Zhu created SPARK-19617: Summary: Fix a case that a query may not stop due to HADOOP-14084 Key: SPARK-19617 URL: https://issues.apache.org/jira/browse/SPARK-19617 Project: Spark

[jira] [Commented] (SPARK-19326) Speculated task attempts do not get launched in few scenarios

2017-02-15 Thread Tejas Patil (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868889#comment-15868889 ] Tejas Patil commented on SPARK-19326: - [~andrewor14] : Ping !! > Speculated task attempts do not get

[jira] [Comment Edited] (SPARK-18080) Locality Sensitive Hashing (LSH) Python API

2017-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868887#comment-15868887 ] Yanbo Liang edited comment on SPARK-18080 at 2/16/17 12:32 AM: --- [~josephkb]

[jira] [Resolved] (SPARK-18080) Locality Sensitive Hashing (LSH) Python API

2017-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yanbo Liang resolved SPARK-18080. - Resolution: Fixed Fix Version/s: 2.2.0 > Locality Sensitive Hashing (LSH) Python API >

[jira] [Commented] (SPARK-18080) Locality Sensitive Hashing (LSH) Python API

2017-02-15 Thread Yanbo Liang (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18080?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868887#comment-15868887 ] Yanbo Liang commented on SPARK-18080: - [~josephkb] I'm sorry that I did not notice that you are

[jira] [Resolved] (SPARK-19599) Clean up HDFSMetadataLog

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu resolved SPARK-19599. -- Resolution: Fixed Assignee: Shixiong Zhu Fix Version/s: 2.2.0

[jira] [Assigned] (SPARK-19554) YARN backend should use history server URL for tracking when UI is disabled

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19554: Assignee: (was: Apache Spark) > YARN backend should use history server URL for

[jira] [Assigned] (SPARK-19554) YARN backend should use history server URL for tracking when UI is disabled

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19554: Assignee: Apache Spark > YARN backend should use history server URL for tracking when UI

[jira] [Commented] (SPARK-19554) YARN backend should use history server URL for tracking when UI is disabled

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868843#comment-15868843 ] Apache Spark commented on SPARK-19554: -- User 'vanzin' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19616) weightCol and aggregationDepth should be improved for some SparkR APIs

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19616: Assignee: Apache Spark > weightCol and aggregationDepth should be improved for some

[jira] [Commented] (SPARK-19616) weightCol and aggregationDepth should be improved for some SparkR APIs

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868782#comment-15868782 ] Apache Spark commented on SPARK-19616: -- User 'wangmiao1981' has created a pull request for this

[jira] [Assigned] (SPARK-19616) weightCol and aggregationDepth should be improved for some SparkR APIs

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19616: Assignee: (was: Apache Spark) > weightCol and aggregationDepth should be improved for

[jira] [Created] (SPARK-19616) weightCol and aggregationDepth should be improved for some SparkR APIs

2017-02-15 Thread Miao Wang (JIRA)
Miao Wang created SPARK-19616: - Summary: weightCol and aggregationDepth should be improved for some SparkR APIs Key: SPARK-19616 URL: https://issues.apache.org/jira/browse/SPARK-19616 Project: Spark

[jira] [Updated] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..)

2017-02-15 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-19602: Attachment: (was: Design_ColResolution_JIRA19602.docx) > Unable to query using

[jira] [Updated] (SPARK-19602) Unable to query using the fully qualified column name of the form ( ..)

2017-02-15 Thread Sunitha Kambhampati (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sunitha Kambhampati updated SPARK-19602: Attachment: Design_ColResolution_JIRA19602.docx > Unable to query using the fully

[jira] [Created] (SPARK-19615) Provide Dataset union convenience for divergent schema

2017-02-15 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created SPARK-19615: Summary: Provide Dataset union convenience for divergent schema Key: SPARK-19615 URL: https://issues.apache.org/jira/browse/SPARK-19615 Project: Spark Issue

[jira] [Created] (SPARK-19614) add type-preserving null function

2017-02-15 Thread Nick Dimiduk (JIRA)
Nick Dimiduk created SPARK-19614: Summary: add type-preserving null function Key: SPARK-19614 URL: https://issues.apache.org/jira/browse/SPARK-19614 Project: Spark Issue Type: Improvement

[jira] [Commented] (SPARK-19497) dropDuplicates with watermark

2017-02-15 Thread sam elamin (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868736#comment-15868736 ] sam elamin commented on SPARK-19497: I would love to be able to help on this [~zsxwing], please do

[jira] [Commented] (SPARK-19610) multi line support for CSV

2017-02-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868699#comment-15868699 ] Hyukjin Kwon commented on SPARK-19610: -- Sure, let me try. Thanks for cc'ing me. > multi line

[jira] [Commented] (SPARK-19610) multi line support for CSV

2017-02-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868700#comment-15868700 ] Hyukjin Kwon commented on SPARK-19610: -- Sure, let me try. Thanks for cc'ing me. > multi line

[jira] [Issue Comment Deleted] (SPARK-19610) multi line support for CSV

2017-02-15 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-19610: - Comment: was deleted (was: Sure, let me try. Thanks for cc'ing me.) > multi line support for

[jira] [Commented] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868677#comment-15868677 ] Apache Spark commented on SPARK-19611: -- User 'budde' has created a pull request for this issue:

[jira] [Commented] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868666#comment-15868666 ] Apache Spark commented on SPARK-19611: -- User 'budde' has created a pull request for this issue:

[jira] [Created] (SPARK-19613) Flaky test: StateStoreRDDSuite.versioning and immutability

2017-02-15 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-19613: -- Summary: Flaky test: StateStoreRDDSuite.versioning and immutability Key: SPARK-19613 URL: https://issues.apache.org/jira/browse/SPARK-19613 Project: Spark

[jira] [Assigned] (SPARK-18937) Timezone support in CSV/JSON parsing

2017-02-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan reassigned SPARK-18937: --- Assignee: Takuya Ueshin > Timezone support in CSV/JSON parsing >

[jira] [Updated] (SPARK-19599) Clean up HDFSMetadataLog

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19599: - Description: SPARK-19464 removed support for Hadoop 2.5 and earlier, so we can do some cleanup

[jira] [Updated] (SPARK-19599) Clean up HDFSMetadataLog

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19599: - Description: SPARK-19464 removed support for Hadoop 2.5 and earlier, so we can do some cleanup

[jira] [Resolved] (SPARK-18937) Timezone support in CSV/JSON parsing

2017-02-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-18937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-18937. - Resolution: Fixed Fix Version/s: 2.2.0 Issue resolved by pull request 16750

[jira] [Updated] (SPARK-19599) Clean up HDFSMetadataLog

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19599: - Description: SPARK-19464 removed support for Hadoop 2.5 and earlier, so we can do some cleanup

[jira] [Updated] (SPARK-19599) Clean up HDFSMetadataLog

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19599: - Summary: Clean up HDFSMetadataLog (was: Clean up HDFSMetadataLog for Hadoop 2.6+) > Clean up

[jira] [Updated] (SPARK-19599) Clean up HDFSMetadataLog for Hadoop 2.6+

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shixiong Zhu updated SPARK-19599: - Description: SPARK-19464 removed support for Hadoop 2.5 and earlier, so we can do some cleanup

[jira] [Resolved] (SPARK-19329) after alter a datasource table's location to a not exist location and then insert data throw Exception

2017-02-15 Thread Xiao Li (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Li resolved SPARK-19329. - Resolution: Fixed Assignee: Song Jun Fix Version/s: 2.2.0 > after alter a datasource

[jira] [Commented] (SPARK-19612) Tests failing with timeout

2017-02-15 Thread Kay Ousterhout (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868565#comment-15868565 ] Kay Ousterhout commented on SPARK-19612: Does that mean we could potentially fix this by limiting

[jira] [Commented] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

2017-02-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868552#comment-15868552 ] Sean Owen commented on SPARK-17689: --- This is created by for example HDFS copy jobs to hold the files

[jira] [Commented] (SPARK-19612) Tests failing with timeout

2017-02-15 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868549#comment-15868549 ] Sean Owen commented on SPARK-19612: --- I think this happens when Jenkins is quite busy; it probably isn't

[jira] [Commented] (SPARK-19607) Finding QueryExecution that matches provided executionId

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868532#comment-15868532 ] Apache Spark commented on SPARK-19607: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-19584) Update Structured Streaming documentation to include Batch query description

2017-02-15 Thread Tathagata Das (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tathagata Das reassigned SPARK-19584: - Assignee: Tyson Condie > Update Structured Streaming documentation to include Batch

[jira] [Commented] (SPARK-19492) Dataset, filter and pattern matching on elements

2017-02-15 Thread Niek Bartholomeus (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19492?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868503#comment-15868503 ] Niek Bartholomeus commented on SPARK-19492: --- I'm having this issue since starting to use spark

[jira] [Created] (SPARK-19612) Tests failing with timeout

2017-02-15 Thread Kay Ousterhout (JIRA)
Kay Ousterhout created SPARK-19612: -- Summary: Tests failing with timeout Key: SPARK-19612 URL: https://issues.apache.org/jira/browse/SPARK-19612 Project: Spark Issue Type: Bug

[jira] [Commented] (SPARK-19594) StreamingQueryListener fails to handle QueryTerminatedEvent if more then one listeners exists

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868469#comment-15868469 ] Shixiong Zhu commented on SPARK-19594: -- I suggest that overriding "def postToAll(event: E)" and

[jira] [Commented] (SPARK-17689) _temporary files breaks the Spark SQL streaming job.

2017-02-15 Thread Shixiong Zhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-17689?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868466#comment-15868466 ] Shixiong Zhu commented on SPARK-17689: -- Just curious: who created "_temporary"? > _temporary files

[jira] [Commented] (SPARK-19455) Add option for case-insensitive Parquet field resolution

2017-02-15 Thread Adam Budde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19455?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868457#comment-15868457 ] Adam Budde commented on SPARK-19455: Closing this in favor of

[jira] [Closed] (SPARK-19455) Add option for case-insensitive Parquet field resolution

2017-02-15 Thread Adam Budde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde closed SPARK-19455. -- Resolution: Duplicate Closing in favor of https://issues.apache.org/jira/browse/SPARK-19611 > Add

[jira] [Assigned] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19611: Assignee: Apache Spark > Spark 2.1.0 breaks some Hive tables backed by case-sensitive

[jira] [Issue Comment Deleted] (SPARK-19455) Add option for case-insensitive Parquet field resolution

2017-02-15 Thread Adam Budde (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19455?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Adam Budde updated SPARK-19455: --- Comment: was deleted (was: Closing this in favor of

[jira] [Commented] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868458#comment-15868458 ] Apache Spark commented on SPARK-19611: -- User 'budde' has created a pull request for this issue:

[jira] [Assigned] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

2017-02-15 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-19611: Assignee: (was: Apache Spark) > Spark 2.1.0 breaks some Hive tables backed by

[jira] [Commented] (SPARK-19610) multi line support for CSV

2017-02-15 Thread Wenchen Fan (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868424#comment-15868424 ] Wenchen Fan commented on SPARK-19610: - [~hyukjin.kwon] do you have time to work on it? > multi line

[jira] [Created] (SPARK-19610) multi line support for CSV

2017-02-15 Thread Wenchen Fan (JIRA)
Wenchen Fan created SPARK-19610: --- Summary: multi line support for CSV Key: SPARK-19610 URL: https://issues.apache.org/jira/browse/SPARK-19610 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-19611) Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files

2017-02-15 Thread Adam Budde (JIRA)
Adam Budde created SPARK-19611: -- Summary: Spark 2.1.0 breaks some Hive tables backed by case-sensitive data files Key: SPARK-19611 URL: https://issues.apache.org/jira/browse/SPARK-19611 Project: Spark

[jira] [Commented] (SPARK-19568) Must include class/method documentation for CRAN check

2017-02-15 Thread Felix Cheung (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868376#comment-15868376 ] Felix Cheung commented on SPARK-19568: -- that would be great - it looks like nightly build is a

[jira] [Commented] (SPARK-12957) Derive and propagate data constrains in logical plan

2017-02-15 Thread Nick Dimiduk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-12957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15868366#comment-15868366 ] Nick Dimiduk commented on SPARK-12957: -- Filed SPARK-19609. IMHO, it would be another subtask on this

  1   2   >