[
https://issues.apache.org/jira/browse/SPARK-39715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Maple updated SPARK-39715:
--------------------------
Description:
I run this sql
*select * from cm_dw.dwd_client_install where proc_date=20220707;*
and then see the SQL page , it shows the file size read: 2.1MB,it is right,the
file on my storage is 2.1MB,
but The Stages tab shows input size:4.3MB, I dont kown why it is not equal
2.1MB.
and I run this sql on spark 2.3.3, Stages tabs shows input size:2.1MB,also
right!
*!1.png!*
!2.png!
!3.png!
was:
I run this sql
*select * from cm_dw.dwd_client_install where proc_date=20220707;*
and then see the SQL page , it shows the file size read: 2.1MB,it is right,the
file on my storage is 2.1MB,
but The Stages tab shows input size:4.3MB, I dont kown why it is not equal
2.1MB.
and I run this sql on spark 2.3.3, Stages tabs shows input size:2.1MB,also
right!
*!1.png!*
!2.png!
> spark UI about file size read
> -----------------------------
>
> Key: SPARK-39715
> URL: https://issues.apache.org/jira/browse/SPARK-39715
> Project: Spark
> Issue Type: Bug
> Components: Input/Output
> Affects Versions: 3.2.1
> Reporter: Maple
> Priority: Minor
> Attachments: 1.png, 2.png, 3.png
>
>
> I run this sql
> *select * from cm_dw.dwd_client_install where proc_date=20220707;*
> and then see the SQL page , it shows the file size read: 2.1MB,it is
> right,the file on my storage is 2.1MB,
> but The Stages tab shows input size:4.3MB, I dont kown why it is not equal
> 2.1MB.
> and I run this sql on spark 2.3.3, Stages tabs shows input size:2.1MB,also
> right!
> *!1.png!*
>
> !2.png!
> !3.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
