[
https://issues.apache.org/jira/browse/SPARK-39018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-39018:
---
Fix Version/s: 3.4.0
> Add support for YARN decommissioning when ESS is Disabled
> -
[
https://issues.apache.org/jira/browse/SPARK-39018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit resolved SPARK-39018.
Resolution: Fixed
> Add support for YARN decommissioning when ESS is Disabled
> --
Abhishek Dixit created SPARK-39024:
--
Summary: Add support for YARN decommissioning when ESS is Enabled
Key: SPARK-39024
URL: https://issues.apache.org/jira/browse/SPARK-39024
Project: Spark
Abhishek Dixit created SPARK-39018:
--
Summary: Add support for YARN decommissioning when ESS is Disabled
Key: SPARK-39018
URL: https://issues.apache.org/jira/browse/SPARK-39018
Project: Spark
[
https://issues.apache.org/jira/browse/SPARK-30835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17513813#comment-17513813
]
Abhishek Dixit commented on SPARK-30835:
A pull request for this issue:
[https:
[
https://issues.apache.org/jira/browse/SPARK-38448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-38448:
---
Parent: SPARK-38447
Issue Type: Sub-task (was: Task)
> Sending Available Resources
Abhishek Dixit created SPARK-38448:
--
Summary: Sending Available Resources in Yarn Cluster Information
to Spark Driver
Key: SPARK-38448
URL: https://issues.apache.org/jira/browse/SPARK-38448
Project:
Abhishek Dixit created SPARK-38447:
--
Summary: Using Available Resources in Yarn Cluster Information in
Spark Dynamic Allocation
Key: SPARK-38447
URL: https://issues.apache.org/jira/browse/SPARK-38447
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183762#comment-17183762
]
Abhishek Dixit commented on SPARK-32500:
Thanks [~JinxinTang] and [~hyukjin.kwon
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17169786#comment-17169786
]
Abhishek Dixit commented on SPARK-32500:
[~JinxinTang] [~rohitmishr1484]
_epoch
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-32500:
---
Attachment: Screen Shot 2020-07-26 at 6.50.39 PM.png
> Query and Batch Id not set for Struct
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17168423#comment-17168423
]
Abhishek Dixit commented on SPARK-32500:
[~rohitmishr1484]
I used the following
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-32500:
---
Description:
Query Id and Batch Id information is not available for jobs started by
structu
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-32500:
---
Summary: Query and Batch Id not set for Structured Streaming Jobs in case
of ForeachBatch in
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-32500:
---
Description:
Query Id and Batch Id information is not available for jobs started by
structu
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-32500:
---
Description:
Query Id and Batch Id information is not available for jobs started by
structu
[
https://issues.apache.org/jira/browse/SPARK-32500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-32500:
---
Attachment: Screen Shot 2020-07-30 at 9.04.21 PM.png
> Query and Batch Id not set for Struct
Abhishek Dixit created SPARK-32500:
--
Summary: Query and Batch Id not set for Structured Streaming Jobs
in case of ForeacgBatch in Pyspark
Key: SPARK-32500
URL: https://issues.apache.org/jira/browse/SPARK-32500
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17113035#comment-17113035
]
Abhishek Dixit commented on SPARK-31448:
[~tianshi] [~hyukjin.kwon]
Any update
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101626#comment-17101626
]
Abhishek Dixit edited comment on SPARK-31448 at 5/7/20, 12:34 PM:
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101626#comment-17101626
]
Abhishek Dixit edited comment on SPARK-31448 at 5/7/20, 12:33 PM:
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit reopened SPARK-31448:
Let me try to explain the problem more.
Please look at this code in pyspark/dataframe.py:
{
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17093079#comment-17093079
]
Abhishek Dixit commented on SPARK-31448:
Any update on this?
> Difference in St
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-31448:
---
Labels: pys (was: )
> Difference in Storage Levels used in cache() and persist() for pyspar
[
https://issues.apache.org/jira/browse/SPARK-31448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-31448:
---
Labels: (was: pys)
> Difference in Storage Levels used in cache() and persist() for pyspar
Abhishek Dixit created SPARK-31448:
--
Summary: Difference in Storage Levels used in cache() and
persist() for pyspark dataframes
Key: SPARK-31448
URL: https://issues.apache.org/jira/browse/SPARK-31448
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902382#comment-16902382
]
Abhishek Dixit edited comment on SPARK-28124 at 8/7/19 6:16 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16902382#comment-16902382
]
Abhishek Dixit edited comment on SPARK-28124 at 8/7/19 6:15 PM:
--
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit resolved SPARK-28124.
Resolution: Feedback Received
As suggested by [~gsomogyi], [~ste...@apache.org], [~zsxwing
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Affects Version/s: (was: 2.4.3)
3.0.0
> Faster S3 file source wit
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a S3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a S3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a S3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a s3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a s3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a s3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a s3 bucket has problems both in
ter
[
https://issues.apache.org/jira/browse/SPARK-28124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Abhishek Dixit updated SPARK-28124:
---
Description:
Using FileStreamSource to read files from a s3 bucket has problems both in
ter
Abhishek Dixit created SPARK-28124:
--
Summary: Faster S3 file source with SQS
Key: SPARK-28124
URL: https://issues.apache.org/jira/browse/SPARK-28124
Project: Spark
Issue Type: New Feature
39 matches
Mail list logo
