[
https://issues.apache.org/jira/browse/SPARK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-19994:
Labels: correctness (was: )
> Wrong outputOrdering for right/full outer smj
>
[
https://issues.apache.org/jira/browse/SPARK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-19994:
Target Version/s: 2.1.1, 2.2.0
> Wrong outputOrdering for right/full outer smj
>
[
https://issues.apache.org/jira/browse/SPARK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-19994:
Affects Version/s: 2.0.2
2.1.0
> Wrong outputOrdering for right/full outer smj
>
[
https://issues.apache.org/jira/browse/SPARK-15790?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931580#comment-15931580
]
Apache Spark commented on SPARK-15790:
--
User 'ehsun7b' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931574#comment-15931574
]
Gaurav Shah commented on SPARK-18165:
-
anything that I can do to help for this feature ?
> Kinesis
[
https://issues.apache.org/jira/browse/SPARK-19990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931571#comment-15931571
]
Apache Spark commented on SPARK-19990:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18579:
Assignee: Apache Spark
> spark-csv strips whitespace (pyspark)
>
[
https://issues.apache.org/jira/browse/SPARK-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-18579:
Assignee: (was: Apache Spark)
> spark-csv strips whitespace (pyspark)
>
[
https://issues.apache.org/jira/browse/SPARK-18579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931567#comment-15931567
]
Apache Spark commented on SPARK-18579:
--
User 'HyukjinKwon' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931566#comment-15931566
]
Hyukjin Kwon commented on SPARK-19019:
--
Let me try to make a PR to backport this if this is
[
https://issues.apache.org/jira/browse/SPARK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19994:
Assignee: Apache Spark
> Wrong outputOrdering for right/full outer smj
>
[
https://issues.apache.org/jira/browse/SPARK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931546#comment-15931546
]
Apache Spark commented on SPARK-19994:
--
User 'wzhfy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-19994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19994:
Assignee: (was: Apache Spark)
> Wrong outputOrdering for right/full outer smj
>
[
https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931527#comment-15931527
]
Henry Zhang edited comment on SPARK-19019 at 3/19/17 2:00 AM:
--
Would also be
[
https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931527#comment-15931527
]
Henry Zhang commented on SPARK-19019:
-
Would also be interested in the answer to Maciej's question
[
https://issues.apache.org/jira/browse/SPARK-20014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sital Kedia updated SPARK-20014:
Description:
When the individual partition size in a spill is small,
mergeSpillsWithTransferTo
[
https://issues.apache.org/jira/browse/SPARK-20014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20014:
Assignee: Apache Spark
> Optimize mergeSpillsWithFileStream method
>
[
https://issues.apache.org/jira/browse/SPARK-20014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931499#comment-15931499
]
Apache Spark commented on SPARK-20014:
--
User 'sitalkedia' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-20014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20014:
Assignee: (was: Apache Spark)
> Optimize mergeSpillsWithFileStream method
>
[
https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-19237:
-
Description: When installing SparkR as a R package (install.packages) on
Windows, it will check
[
https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-19237:
-
Summary: SparkR package on Windows waiting for a long time when no java is
found launching
[
https://issues.apache.org/jira/browse/SPARK-19993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931497#comment-15931497
]
Apache Spark commented on SPARK-19993:
--
User 'dilipbiswal' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-19993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19993:
Assignee: (was: Apache Spark)
> Caching logical plans containing subquery expressions
[
https://issues.apache.org/jira/browse/SPARK-19993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19993:
Assignee: Apache Spark
> Caching logical plans containing subquery expressions does not
[
https://issues.apache.org/jira/browse/SPARK-19990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19990:
Assignee: Apache Spark
> Flaky test:
[
https://issues.apache.org/jira/browse/SPARK-19990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931496#comment-15931496
]
Apache Spark commented on SPARK-19990:
--
User 'windpiger' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-19990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19990:
Assignee: (was: Apache Spark)
> Flaky test:
[
https://issues.apache.org/jira/browse/SPARK-7146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931480#comment-15931480
]
François Garillot commented on SPARK-7146:
--
+1 to the Java interface & Scala traits in the
[
https://issues.apache.org/jira/browse/SPARK-19573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiao Li updated SPARK-19573:
Target Version/s: 2.2.0
> Make NaN/null handling consistent in approxQuantile
>
Felix Cheung created SPARK-20015:
Summary: Document R Structured Streaming (experimental) in R
vignettes and R & SS programming guide
Key: SPARK-20015
URL: https://issues.apache.org/jira/browse/SPARK-20015
[
https://issues.apache.org/jira/browse/SPARK-19654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung resolved SPARK-19654.
--
Resolution: Fixed
Fix Version/s: 2.2.0
Target Version/s: 2.2.0
> Structured
Sital Kedia created SPARK-20014:
---
Summary: Optimize mergeSpillsWithFileStream method
Key: SPARK-20014
URL: https://issues.apache.org/jira/browse/SPARK-20014
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Ash updated SPARK-19528:
---
Description:
when dynamic allocation is enabled, the external shuffle service is used for
maintain
[
https://issues.apache.org/jira/browse/SPARK-19970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19970:
Assignee: Apache Spark
> Table owner should be USER instead of PRINCIPAL in kerberized
[
https://issues.apache.org/jira/browse/SPARK-19970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19970:
Assignee: (was: Apache Spark)
> Table owner should be USER instead of PRINCIPAL in
[
https://issues.apache.org/jira/browse/SPARK-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931350#comment-15931350
]
Apache Spark commented on SPARK-18910:
--
User 'weiqingy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-12868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931351#comment-15931351
]
Apache Spark commented on SPARK-12868:
--
User 'weiqingy' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-19998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19998:
Assignee: (was: Apache Spark)
> BlockRDD block not found Exception add RDD id info
>
[
https://issues.apache.org/jira/browse/SPARK-19998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931325#comment-15931325
]
Apache Spark commented on SPARK-19998:
--
User 'jianran' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-19998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-19998:
Assignee: Apache Spark
> BlockRDD block not found Exception add RDD id info
>
[
https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-19237:
-
Summary: SparkR package waiting for a long time when no java is found
launching spark-submit
[
https://issues.apache.org/jira/browse/SPARK-19237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Felix Cheung updated SPARK-19237:
-
Component/s: Spark Core
> SparkR package waiting for a long time when no java is found launching
[
https://issues.apache.org/jira/browse/SPARK-20007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931310#comment-15931310
]
Felix Cheung commented on SPARK-20007:
--
+1 - also I've been meaning to add checks for data type
[
https://issues.apache.org/jira/browse/SPARK-19019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931288#comment-15931288
]
Maciej Szymkiewicz commented on SPARK-19019:
[~davies] Could it be backported to 1.6 and 2.0?
[
https://issues.apache.org/jira/browse/SPARK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20013:
Assignee: Apache Spark
> merge renameTable to alterTable in ExternalCatalog
>
[
https://issues.apache.org/jira/browse/SPARK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931282#comment-15931282
]
Apache Spark commented on SPARK-20013:
--
User 'windpiger' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-20013:
Assignee: (was: Apache Spark)
> merge renameTable to alterTable in ExternalCatalog
>
[
https://issues.apache.org/jira/browse/SPARK-19977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931280#comment-15931280
]
Sean Owen commented on SPARK-19977:
---
I don't think this enough information to act on this. If you can
[
https://issues.apache.org/jira/browse/SPARK-19519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-19519:
--
Priority: Major (was: Blocker)
Yes, don't set Blocker. I don't think this is clear. If you can
[
https://issues.apache.org/jira/browse/SPARK-19934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931278#comment-15931278
]
Sean Owen commented on SPARK-19934:
---
I am not sure this improves the comment. Yes, enough executors
[
https://issues.apache.org/jira/browse/SPARK-19930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-19930.
---
Resolution: Not A Problem
> table operator as an alternative to saveAsTable
>
[
https://issues.apache.org/jira/browse/SPARK-20012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931277#comment-15931277
]
Sean Owen commented on SPARK-20012:
---
I don't understand the problem from this description. The headers
[
https://issues.apache.org/jira/browse/SPARK-20013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Song Jun updated SPARK-20013:
-
Description:
Currently when we create / rename a managed table, we should get the
defaultTablePath for
[
https://issues.apache.org/jira/browse/SPARK-20008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-20008:
-
Affects Version/s: 2.2.0
> hiveContext.emptyDataFrame.except(hiveContext.emptyDataFrame).count()
[
https://issues.apache.org/jira/browse/SPARK-20008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931225#comment-15931225
]
Hyukjin Kwon commented on SPARK-20008:
--
I could reproduce this in the current master with
{code}
[
https://issues.apache.org/jira/browse/SPARK-20008?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon updated SPARK-20008:
-
Component/s: (was: Spark Core)
SQL
>
[
https://issues.apache.org/jira/browse/SPARK-20008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931224#comment-15931224
]
Hyukjin Kwon commented on SPARK-20008:
--
This was fine in 1.6.3 with {{ExceptExec}} too but this
[
https://issues.apache.org/jira/browse/SPARK-20008?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931221#comment-15931221
]
Hyukjin Kwon commented on SPARK-20008:
--
I just took a quick look. {{BroadcastNestedLoopJoin}} looks
[
https://issues.apache.org/jira/browse/SPARK-20001?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15930922#comment-15930922
]
Jeff Zhang edited comment on SPARK-20001 at 3/18/17 1:08 PM:
-
Thanks
Song Jun created SPARK-20013:
Summary: merge renameTable to alterTable in ExternalCatalog
Key: SPARK-20013
URL: https://issues.apache.org/jira/browse/SPARK-20013
Project: Spark
Issue Type: Bug
david cottrell created SPARK-20012:
--
Summary: spark.read.csv schemas effectively ignore headers
Key: SPARK-20012
URL: https://issues.apache.org/jira/browse/SPARK-20012
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931165#comment-15931165
]
Sean Owen commented on SPARK-19941:
---
I'm not sure I agree with that. If the app wants N executors, as
[
https://issues.apache.org/jira/browse/SPARK-20004?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931164#comment-15931164
]
Sean Owen commented on SPARK-20004:
---
I don't think the user is supposed to be able to change this app
[
https://issues.apache.org/jira/browse/SPARK-20005?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-20005:
--
Priority: Trivial (was: Minor)
Yeah, either that cell is set to 'nowrap' or something similar. Either
[
https://issues.apache.org/jira/browse/SPARK-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931153#comment-15931153
]
Sean Owen commented on SPARK-1:
---
Isn't this a JDK bug then? you show it's already fixed in a recent
[
https://issues.apache.org/jira/browse/SPARK-19644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931150#comment-15931150
]
Sean Owen commented on SPARK-19644:
---
I don't think there is evidence of a memory leak here. It's not
[
https://issues.apache.org/jira/browse/SPARK-20011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931136#comment-15931136
]
Sean Owen commented on SPARK-20011:
---
You don't need it assigned, just go ahead
> inconsistent
[
https://issues.apache.org/jira/browse/SPARK-20011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931132#comment-15931132
]
chris snow commented on SPARK-20011:
Ok, thanks. Can you please assign to me?
> inconsistent
[
https://issues.apache.org/jira/browse/SPARK-20011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-20011:
--
Priority: Trivial (was: Minor)
Yes, these are the same thing. go ahead.
> inconsistent terminology
chris snow created SPARK-20011:
--
Summary: inconsistent terminology in als api docs and tutorial
Key: SPARK-20011
URL: https://issues.apache.org/jira/browse/SPARK-20011
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15931115#comment-15931115
]
Guoqiang Li commented on SPARK-18890:
-
[~kayousterhout] done.
> Do all task serialization in
[
https://issues.apache.org/jira/browse/SPARK-19840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved SPARK-19840.
---
Resolution: Won't Fix
Later, this will be handled better by fixing permanent function
[
https://issues.apache.org/jira/browse/SPARK-19915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-19915:
-
Description: We only consider consecutive inner joinable items, thus
excluding cartesian
[
https://issues.apache.org/jira/browse/SPARK-19915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-19915:
-
Summary: Improve join reorder: Exclude cartesian product candidates to
reduce the search space
[
https://issues.apache.org/jira/browse/SPARK-19896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-19896:
---
Assignee: Takeshi Yamamuro
> toDS throws StackOverflowError if case classes have circular
[
https://issues.apache.org/jira/browse/SPARK-19896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19896.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 17318
[
https://issues.apache.org/jira/browse/SPARK-20010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-20010:
-
Description:
After sort merge join for inner join, now we only keep left key ordering.
However,
[
https://issues.apache.org/jira/browse/SPARK-20010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-20010:
-
Description:
After sort merge join for inner join, now we only keep left key ordering.
However,
[
https://issues.apache.org/jira/browse/SPARK-20010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-20010:
-
Description:
After sort merge join for inner join, now we only keep left key ordering.
However,
Zhenhua Wang created SPARK-20010:
Summary: Sort information is lost after sort merge join
Key: SPARK-20010
URL: https://issues.apache.org/jira/browse/SPARK-20010
Project: Spark
Issue Type:
[
https://issues.apache.org/jira/browse/SPARK-19915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-19915:
---
Assignee: Zhenhua Wang
> Improve join reorder: simplify cost evaluation, postpone column
[
https://issues.apache.org/jira/browse/SPARK-19915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19915.
-
Resolution: Fixed
Fix Version/s: 2.2.0
Issue resolved by pull request 17286
82 matches
Mail list logo