[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-21337.
--
Resolution: Cannot Reproduce
I am resolving this per above comment and I could not reproduce
[
https://issues.apache.org/jira/browse/SPARK-21100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21100.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18307
[
https://issues.apache.org/jira/browse/SPARK-21100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-21100:
---
Assignee: Andrew Ray
> Add summary method as alternative to describe that gives quartiles
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Description:
when there are large 'case when ' expressions in spark sql,the CodeGenerator
failed to
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Description:
when there are large 'case when ' expressions in spark sql,the CodeGenerator
failed to
[
https://issues.apache.org/jira/browse/SPARK-21343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078912#comment-16078912
]
Apache Spark commented on SPARK-21343:
--
User 'jinxing64' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21343:
Assignee: Apache Spark
> Refine the document for spark.reducer.maxReqSizeShuffleToMem
>
[
https://issues.apache.org/jira/browse/SPARK-21343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21343:
Assignee: (was: Apache Spark)
> Refine the document for
[
https://issues.apache.org/jira/browse/SPARK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-21083:
-
Summary: Do not remove correct stats when re-analyze (was: Consider
staleness when collecting
[
https://issues.apache.org/jira/browse/SPARK-21083?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhenhua Wang updated SPARK-21083:
-
Description:
1. When we first analyze without `noscan` and then analyze with `noscan`, the
[
https://issues.apache.org/jira/browse/SPARK-21348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duyanghao updated SPARK-21348:
--
Description:
There is a eventlog file in hdfs as below:
```
-rwxrwx--- 3 root supergroup 9634238709
[
https://issues.apache.org/jira/browse/SPARK-21348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duyanghao updated SPARK-21348:
--
Description:
There is a eventlog file in hdfs as below:
```
-rwxrwx--- 3 root supergroup 9634238709
[
https://issues.apache.org/jira/browse/SPARK-21348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
duyanghao updated SPARK-21348:
--
Description:
There is a eventlog file in hdfs as below:
```
-rwxrwx--- 3 root supergroup 9634238709
duyanghao created SPARK-21348:
-
Summary: Spark history Server load too slow when eventlog is large
Key: SPARK-21348
URL: https://issues.apache.org/jira/browse/SPARK-21348
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078837#comment-16078837
]
Bryan Cutler commented on SPARK-21190:
--
[~rxin] I was talking about 2 different things, sorry if I
[
https://issues.apache.org/jira/browse/SPARK-21341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078832#comment-16078832
]
Dongjoon Hyun commented on SPARK-21341:
---
Hi, [~zsellami].
For questions, you had better use dev
[
https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078827#comment-16078827
]
Dongjoon Hyun commented on SPARK-21344:
---
Also, this cannot be blocker because Spark 2.0.0 seems to
[
https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-21344:
--
Affects Version/s: 2.0.0
> BinaryType comparison does signed byte array comparison
>
[
https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078825#comment-16078825
]
Dongjoon Hyun commented on SPARK-21344:
---
Hi, [~shubhamc].
Thank you for reporting. I just change
[
https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-21344:
--
Priority: Major (was: Blocker)
> BinaryType comparison does signed byte array comparison
>
Vishwanath Lakkundi created SPARK-21347:
---
Summary: Performance issues with KryoSerializer
Key: SPARK-21347
URL: https://issues.apache.org/jira/browse/SPARK-21347
Project: Spark
Issue
John created SPARK-21346:
Summary: Spark does not use SSL for HTTP File Server and Broadcast
Server
Key: SPARK-21346
URL: https://issues.apache.org/jira/browse/SPARK-21346
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-20441:
-
Affects Version/s: (was: 2.2.0)
> Within the same streaming query, one
[
https://issues.apache.org/jira/browse/SPARK-20441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael Armbrust updated SPARK-20441:
-
Fix Version/s: 2.2.0
> Within the same streaming query, one StreamingRelation should
[
https://issues.apache.org/jira/browse/SPARK-21345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21345:
Assignee: Apache Spark
> SparkSessionBuilderSuite should clean up stopped sessions
>
[
https://issues.apache.org/jira/browse/SPARK-21345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21345:
Assignee: (was: Apache Spark)
> SparkSessionBuilderSuite should clean up stopped
[
https://issues.apache.org/jira/browse/SPARK-21345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078715#comment-16078715
]
Apache Spark commented on SPARK-21345:
--
User 'dongjoon-hyun' has created a pull request for this
[
https://issues.apache.org/jira/browse/SPARK-21307?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078698#comment-16078698
]
Apache Spark commented on SPARK-21307:
--
User 'gatorsmile' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun updated SPARK-21345:
--
Component/s: Tests
> SparkSessionBuilderSuite should clean up stopped sessions
>
Dongjoon Hyun created SPARK-21345:
-
Summary: SparkSessionBuilderSuite should clean up stopped sessions
Key: SPARK-21345
URL: https://issues.apache.org/jira/browse/SPARK-21345
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shubham Chopra updated SPARK-21344:
---
Priority: Blocker (was: Major)
> BinaryType comparison does signed byte array comparison
>
Shubham Chopra created SPARK-21344:
--
Summary: BinaryType comparison does signed byte array comparison
Key: SPARK-21344
URL: https://issues.apache.org/jira/browse/SPARK-21344
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-21344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Shubham Chopra updated SPARK-21344:
---
Description:
BinaryType used by Spark SQL defines ordering using signed byte comparisons.
[
https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078523#comment-16078523
]
Marcelo Vanzin commented on SPARK-21254:
I've re-opened this because right, there's no specific
[
https://issues.apache.org/jira/browse/SPARK-21254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin reopened SPARK-21254:
> History UI: Taking over 1 minute for initial page display
>
[
https://issues.apache.org/jira/browse/SPARK-18085?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078517#comment-16078517
]
Marcelo Vanzin commented on SPARK-18085:
[~rxin] this has been open with a specification document
[
https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Anirban Das closed SPARK-21331.
---
Resolution: Invalid
This was a version issue. I was using mllib 2.1.0 with spark 2.1.1.
>
[
https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078449#comment-16078449
]
Anirban Das commented on SPARK-21331:
-
Thanks for pointing it out. I feel stupid now, it was a
[
https://issues.apache.org/jira/browse/SPARK-21213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maria updated SPARK-21213:
--
Description: Support ANALYZE TABLE table PARTITION (key=value,...) COMPUTE
STATISTICS [NOSCAN] SQL command to
[
https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078395#comment-16078395
]
Satyajit varma edited comment on SPARK-20597 at 7/7/17 5:13 PM:
Hi
[
https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078395#comment-16078395
]
Satyajit varma edited comment on SPARK-20597 at 7/7/17 5:12 PM:
Hi
[
https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078395#comment-16078395
]
Satyajit varma commented on SPARK-20597:
Hi [~jlaskowski],
I am almost done, with the above
[
https://issues.apache.org/jira/browse/SPARK-20597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078395#comment-16078395
]
Satyajit varma edited comment on SPARK-20597 at 7/7/17 5:10 PM:
Hi
jin xing created SPARK-21343:
Summary: Refine the document for
spark.reducer.maxReqSizeShuffleToMem
Key: SPARK-21343
URL: https://issues.apache.org/jira/browse/SPARK-21343
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078254#comment-16078254
]
Apache Spark commented on SPARK-21342:
--
User 'jinxing64' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21342:
Assignee: Apache Spark
> Fix DownloadCallback to work well with RetryingBlockFetcher
>
[
https://issues.apache.org/jira/browse/SPARK-21342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21342:
Assignee: (was: Apache Spark)
> Fix DownloadCallback to work well with
jin xing created SPARK-21342:
Summary: Fix DownloadCallback to work well with
RetryingBlockFetcher
Key: SPARK-21342
URL: https://issues.apache.org/jira/browse/SPARK-21342
Project: Spark
Issue
[
https://issues.apache.org/jira/browse/SPARK-19358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-19358.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 16697
[
https://issues.apache.org/jira/browse/SPARK-19358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan reassigned SPARK-19358:
---
Assignee: Nan Zhu
> LiveListenerBus shall log the event name when dropping them due to a
Zied Sellami created SPARK-21341:
Summary: Spark 2.1.1: I want to be able to serialize wordVectors
on Word2VecModel
Key: SPARK-21341
URL: https://issues.apache.org/jira/browse/SPARK-21341
Project:
Jake Charland created SPARK-21340:
-
Summary: Bring PySpark MLLib evaluation metrics to parity with
Scala API
Key: SPARK-21340
URL: https://issues.apache.org/jira/browse/SPARK-21340
Project: Spark
Goran Blankendal created SPARK-21339:
Summary: spark-shell --packages option does not add jars to
classpath on windows
Key: SPARK-21339
URL: https://issues.apache.org/jira/browse/SPARK-21339
[
https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan resolved SPARK-21335.
-
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18559
[
https://issues.apache.org/jira/browse/SPARK-20870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077988#comment-16077988
]
Prashant Sharma commented on SPARK-20870:
-
Is it okay to use, https://github.com/scopt/scopt
[
https://issues.apache.org/jira/browse/SPARK-21228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077985#comment-16077985
]
Apache Spark commented on SPARK-21228:
--
User 'bogdanrdc' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21069:
Assignee: Apache Spark
> Add rate source to programming guide
>
[
https://issues.apache.org/jira/browse/SPARK-21069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21069:
Assignee: (was: Apache Spark)
> Add rate source to programming guide
>
[
https://issues.apache.org/jira/browse/SPARK-21069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077982#comment-16077982
]
Apache Spark commented on SPARK-21069:
--
User 'ScrapCodes' has created a pull request for this issue:
[
https://issues.apache.org/jira/browse/SPARK-21338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ostap Gonchar updated SPARK-21338:
--
Description:
org.apache.spark.sql.jdbc.JdbcDialect's method:
*def isCascadingTruncateTable():
[
https://issues.apache.org/jira/browse/SPARK-21328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077975#comment-16077975
]
Joe commented on SPARK-21328:
-
Hi Hyukjin Kwon,
Could you please provide your suggesions?
From: Hyukjin
Ostap Gonchar created SPARK-21338:
-
Summary: AggregatedDialect doesn't override
isCascadingTruncateTable() method
Key: SPARK-21338
URL: https://issues.apache.org/jira/browse/SPARK-21338
Project:
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077952#comment-16077952
]
Kazuaki Ishizaki commented on SPARK-21337:
--
In the master branch, I cannot see a huge dump and
[
https://issues.apache.org/jira/browse/SPARK-21285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Yanbo Liang resolved SPARK-21285.
-
Resolution: Fixed
Fix Version/s: 2.3.0
> VectorAssembler should report the column name
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Description:
when there are large 'case when ' expressions in spark sql,the CodeGenerator
failed to
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Description:
when there are large 'case when ' expressions in spark sql,the CodeGenerator
failed to
[
https://issues.apache.org/jira/browse/SPARK-21063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077812#comment-16077812
]
YANGFEIRAN commented on SPARK-21063:
https://stackoverflow.com/q/44434304/6547077 also following this
[
https://issues.apache.org/jira/browse/SPARK-21313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21313.
---
Resolution: Fixed
Fix Version/s: 2.3.0
Issue resolved by pull request 18539
[
https://issues.apache.org/jira/browse/SPARK-21313?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-21313:
-
Assignee: Jacek Laskowski
> ConsoleSink's string representation
>
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077730#comment-16077730
]
fengchaoge commented on SPARK-21337:
!http://example.com/image.png!
> SQL which has large ‘case
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Description:
when there are large 'case when ' expressions in spark sql,the CodeGenerator
failed to
[
https://issues.apache.org/jira/browse/SPARK-19680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077726#comment-16077726
]
Simon Kitching commented on SPARK-19680:
Cody: thanks very much for the feedback. For my current
[
https://issues.apache.org/jira/browse/SPARK-21337?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
fengchaoge updated SPARK-21337:
---
Description: java.util.concurrent.ExecutionException: java.lang.Exception:
failed to compile:
fengchaoge created SPARK-21337:
--
Summary: SQL which has large ‘case when’ expressions may cause
code generation beyond 64KB
Key: SPARK-21337
URL: https://issues.apache.org/jira/browse/SPARK-21337
[
https://issues.apache.org/jira/browse/SPARK-21331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077701#comment-16077701
]
Sean Owen commented on SPARK-21331:
---
I don't see evidence that the NPE is related to computeSVD. The
[
https://issues.apache.org/jira/browse/SPARK-20690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-20690:
Labels: (was: release-notes)
> Subqueries in FROM should have alias names
>
[
https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-21335:
Labels: release-notes (was: )
> support un-aliased subquery
> ---
>
>
[
https://issues.apache.org/jira/browse/SPARK-21335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Wenchen Fan updated SPARK-21335:
Description:
un-aliased subquery is supported by Spark SQL for a long time. Its semantic was
not
[
https://issues.apache.org/jira/browse/SPARK-20706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077691#comment-16077691
]
Raphael Roth commented on SPARK-20706:
--
[~sowen] I think this is quite significant, because when
[
https://issues.apache.org/jira/browse/SPARK-20706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Raphael Roth updated SPARK-20706:
-
Description:
In the following example, the definition of myMethod is not correctly updated:
[
https://issues.apache.org/jira/browse/SPARK-21336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21336:
Assignee: (was: Apache Spark)
> Revise rand comparison in BatchEvalPythonExecSuite
>
[
https://issues.apache.org/jira/browse/SPARK-21336?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-21336:
Assignee: Apache Spark
> Revise rand comparison in BatchEvalPythonExecSuite
>
[
https://issues.apache.org/jira/browse/SPARK-21336?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077646#comment-16077646
]
Apache Spark commented on SPARK-21336:
--
User 'gengliangwang' has created a pull request for this
83 matches
Mail list logo
