zengxl created SPARK-25961:
--
Summary: 处理数据倾斜时使用随机数不支持
Key: SPARK-25961
URL: https://issues.apache.org/jira/browse/SPARK-25961
Project: Spark
Issue Type: Bug
Components: SQL
Affects Ver
[
https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25921:
Assignee: (was: Apache Spark)
> Python worker reuse causes Barrier tasks to run witho
[
https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25921:
Assignee: Apache Spark
> Python worker reuse causes Barrier tasks to run without BarrierT
[
https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677954#comment-16677954
]
Apache Spark commented on SPARK-25921:
--
User 'xuanyuanking' has created a pull requ
[
https://issues.apache.org/jira/browse/SPARK-25921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16677959#comment-16677959
]
Apache Spark commented on SPARK-25921:
--
User 'xuanyuanking' has created a pull requ
Hyukjin Kwon created SPARK-25962:
Summary: Specify minimum versions for both pydocstyle and flake8
in 'lint-python' script
Key: SPARK-25962
URL: https://issues.apache.org/jira/browse/SPARK-25962
Proje
[
https://issues.apache.org/jira/browse/SPARK-25962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678034#comment-16678034
]
Apache Spark commented on SPARK-25962:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-25962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25962:
Assignee: (was: Apache Spark)
> Specify minimum versions for both pydocstyle and flak
[
https://issues.apache.org/jira/browse/SPARK-25962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25962:
Assignee: Apache Spark
> Specify minimum versions for both pydocstyle and flake8 in 'lint
[
https://issues.apache.org/jira/browse/SPARK-25962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678035#comment-16678035
]
Apache Spark commented on SPARK-25962:
--
User 'HyukjinKwon' has created a pull reque
[
https://issues.apache.org/jira/browse/SPARK-25904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid reassigned SPARK-25904:
Assignee: Imran Rashid
> Avoid allocating arrays too large for JVMs
> ---
[
https://issues.apache.org/jira/browse/SPARK-25904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Imran Rashid resolved SPARK-25904.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22818
[https://gi
Ohad Raviv created SPARK-25963:
--
Summary: Optimize generate followed by window
Key: SPARK-25963
URL: https://issues.apache.org/jira/browse/SPARK-25963
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-25963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678148#comment-16678148
]
Apache Spark commented on SPARK-25963:
--
User 'uzadude' has created a pull request f
[
https://issues.apache.org/jira/browse/SPARK-25963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25963:
Assignee: (was: Apache Spark)
> Optimize generate followed by window
> --
[
https://issues.apache.org/jira/browse/SPARK-25963?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25963:
Assignee: Apache Spark
> Optimize generate followed by window
> -
[
https://issues.apache.org/jira/browse/SPARK-25963?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678149#comment-16678149
]
Apache Spark commented on SPARK-25963:
--
User 'uzadude' has created a pull request f
Gengliang Wang created SPARK-25964:
--
Summary: Revise OrcReadBenchmark/DataSourceReadBenchmark case
names and execution instructions
Key: SPARK-25964
URL: https://issues.apache.org/jira/browse/SPARK-25964
[
https://issues.apache.org/jira/browse/SPARK-25964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678353#comment-16678353
]
Apache Spark commented on SPARK-25964:
--
User 'gengliangwang' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-25885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-25885:
-
Assignee: Artem Kupchinskiy
> HighlyCompressedMapStatus deserialization optimization
>
[
https://issues.apache.org/jira/browse/SPARK-25885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-25885.
---
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22894
[https://github.c
Gengliang Wang created SPARK-25965:
--
Summary: Add read benchmark for Avro
Key: SPARK-25965
URL: https://issues.apache.org/jira/browse/SPARK-25965
Project: Spark
Issue Type: Sub-task
[
https://issues.apache.org/jira/browse/SPARK-25964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25964:
Assignee: (was: Apache Spark)
> Revise OrcReadBenchmark/DataSourceReadBenchmark case
[
https://issues.apache.org/jira/browse/SPARK-25964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25964:
Assignee: Apache Spark
> Revise OrcReadBenchmark/DataSourceReadBenchmark case names and e
[
https://issues.apache.org/jira/browse/SPARK-25908?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen updated SPARK-25908:
--
Description:
There are many deprecated methods and classes in Spark. They _can_ be removed
in Spark 3
Alessandro Andrioni created SPARK-25966:
---
Summary: "EOF Reached the end of stream with bytes left to read"
while reading/writing to Parquets
Key: SPARK-25966
URL: https://issues.apache.org/jira/browse/SPARK-
[
https://issues.apache.org/jira/browse/SPARK-23050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
bharath kumar avusherla updated SPARK-23050:
Comment: was deleted
(was: [~ste...@apache.org], I can start working on it
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25958:
--
Description:
Following error happens on a heavy Spark job after 4 hours of runtime..
{
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678475#comment-16678475
]
Yuming Wang commented on SPARK-25966:
-
Thanks [~andrioni] Is there an easy way to re
Victor Sahin created SPARK-25967:
Summary: sql.functions.trim() should remove trailing and leading
tabs
Key: SPARK-25967
URL: https://issues.apache.org/jira/browse/SPARK-25967
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-25967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Victor Sahin updated SPARK-25967:
-
Description: sql.functions.trim removes only trailing and leading
whitespaces. Removing tabs as
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678527#comment-16678527
]
Xiao Li commented on SPARK-25966:
-
Do you still have the file that fail your job? Can yo
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678542#comment-16678542
]
Cheng Lian commented on SPARK-25966:
Hey, [~andrioni], if you still have the origina
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678542#comment-16678542
]
Cheng Lian edited comment on SPARK-25966 at 11/7/18 5:34 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678542#comment-16678542
]
Cheng Lian edited comment on SPARK-25966 at 11/7/18 5:34 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
shahid updated SPARK-25959:
---
Comment: was deleted
(was: Thanks. I will analyze the issue. )
> Difference in featureImportances results o
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678595#comment-16678595
]
Cheng Lian commented on SPARK-25966:
[~andrioni], just realized that I might misunde
[
https://issues.apache.org/jira/browse/SPARK-25967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678614#comment-16678614
]
kevin yu commented on SPARK-25967:
--
Hello Victor: You can specify the tabs as specified
[
https://issues.apache.org/jira/browse/SPARK-25967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678657#comment-16678657
]
Victor Sahin commented on SPARK-25967:
--
That is not very intuitive to manually spec
[
https://issues.apache.org/jira/browse/SPARK-25967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678657#comment-16678657
]
Victor Sahin edited comment on SPARK-25967 at 11/7/18 7:13 PM:
---
[
https://issues.apache.org/jira/browse/SPARK-25967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678700#comment-16678700
]
kevin yu commented on SPARK-25967:
--
Hello Victor: I see, by SQL2003 standard, the TRIM
[
https://issues.apache.org/jira/browse/SPARK-25966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678728#comment-16678728
]
Ryan Blue commented on SPARK-25966:
---
[~andrioni], were there any failed tasks or execu
[
https://issues.apache.org/jira/browse/SPARK-25897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Marcelo Vanzin resolved SPARK-25897.
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22909
[https:
[
https://issues.apache.org/jira/browse/SPARK-25956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678849#comment-16678849
]
Apache Spark commented on SPARK-25956:
--
User 'dbtsai' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-25925?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678861#comment-16678861
]
Adam Budde commented on SPARK-25925:
[~axenol] I would definitely support making the
[
https://issues.apache.org/jira/browse/SPARK-25956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678848#comment-16678848
]
Apache Spark commented on SPARK-25956:
--
User 'dbtsai' has created a pull request fo
[
https://issues.apache.org/jira/browse/SPARK-25956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25956:
Assignee: Apache Spark
> Make Scala 2.12 as default Scala version in Spark 3.0
>
[
https://issues.apache.org/jira/browse/SPARK-25956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25956:
Assignee: (was: Apache Spark)
> Make Scala 2.12 as default Scala version in Spark 3.0
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ruslan Dautkhanov updated SPARK-25958:
--
Issue Type: Bug (was: New Feature)
> error: [Errno 97] Address family not supported b
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678894#comment-16678894
]
Ruslan Dautkhanov commented on SPARK-25958:
---
We do have ipv6 disabled on our h
[
https://issues.apache.org/jira/browse/SPARK-25958?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16678894#comment-16678894
]
Ruslan Dautkhanov edited comment on SPARK-25958 at 11/7/18 10:35 PM:
-
[
https://issues.apache.org/jira/browse/SPARK-25676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679312#comment-16679312
]
Apache Spark commented on SPARK-25676:
--
User 'dongjoon-hyun' has created a pull req
[
https://issues.apache.org/jira/browse/SPARK-25955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Hyukjin Kwon resolved SPARK-25955.
--
Resolution: Fixed
Fix Version/s: 3.0.0
Issue resolved by pull request 22960
[https://gi
zhengruifeng created SPARK-25970:
Summary: Add Instrumentation to PrefixSpan
Key: SPARK-25970
URL: https://issues.apache.org/jira/browse/SPARK-25970
Project: Spark
Issue Type: Improvement
[
https://issues.apache.org/jira/browse/SPARK-24437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16679253#comment-16679253
]
David Vogelbacher commented on SPARK-24437:
---
[~eyalfa] There might be hundred
55 matches
Mail list logo