[jira] [Assigned] (SPARK-25696) The storage memory displayed on spark Application UI is incorrect.
[
https://issues.apache.org/jira/browse/SPARK-25696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen reassigned SPARK-25696:
-
Docs Text: In Spark 3.0, the web UI and log statements now
consistently report units in KiB, MiB, etc, (i.e. multiples of 1024) rather
than KB and MB (i.e. multiples of 1000). For example, 1024000 bytes is now
displayed as 1000 KiB rather than 1024 KB.
Assignee: hantiantian
Target Version/s: 3.0.0
Labels: release-notes (was: )
Component/s: Web UI
Issue Type: Improvement (was: Bug)
(I'm marking this much more of an improvement than fix, as I believe the
displays were correct, but just in inconsistent units. There were a few log
statements that were incorrect, but nothing functional, it appears.)
> The storage memory displayed on spark Application UI is incorrect.
> --
>
> Key: SPARK-25696
> URL: https://issues.apache.org/jira/browse/SPARK-25696
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core, Web UI
>Affects Versions: 2.3.2
>Reporter: hantiantian
>Assignee: hantiantian
>Priority: Major
> Labels: release-notes
>
> In the reported heartbeat information, the unit of the memory data is bytes,
> which is converted by the formatBytes() function in the utils.js file before
> being displayed in the interface. The cardinality of the unit conversion in
> the formatBytes function is 1000, which should be 1024.
> function formatBytes(bytes, type)
> { if (type !== 'display') return bytes; if (bytes == 0) return '0.0 B';
> var k = 1000; var dm = 1; var sizes = ['B', 'KB', 'MB', 'GB', 'TB',
> 'PB', 'EB', 'ZB', 'YB']; var i = Math.floor(Math.log(bytes) /
> Math.log(k)); return parseFloat((bytes / Math.pow(k, i)).toFixed(dm)) + ' ' +
> sizes[i]; }
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-25696) The storage memory displayed on spark Application UI is incorrect.
[
https://issues.apache.org/jira/browse/SPARK-25696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25696:
Assignee: Apache Spark
> The storage memory displayed on spark Application UI is incorrect.
> --
>
> Key: SPARK-25696
> URL: https://issues.apache.org/jira/browse/SPARK-25696
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
>Affects Versions: 2.3.2
>Reporter: hantiantian
>Assignee: Apache Spark
>Priority: Major
>
> In the reported heartbeat information, the unit of the memory data is bytes,
> which is converted by the formatBytes() function in the utils.js file before
> being displayed in the interface. The base of the unit conversion in the
> formatBytes function is 1000, which should be 1024.
> function formatBytes(bytes, type) {
> if (type !== 'display') return bytes;
> if (bytes == 0) return '0.0 B';
> var k = 1000;
> var dm = 1;
> var sizes = ['B', 'KB', 'MB', 'GB', 'TB', 'PB', 'EB', 'ZB', 'YB'];
> var i = Math.floor(Math.log(bytes) / Math.log(k)); return
> parseFloat((bytes / Math.pow(k, i)).toFixed(dm)) + ' ' + sizes[i];
> }
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Assigned] (SPARK-25696) The storage memory displayed on spark Application UI is incorrect.
[
https://issues.apache.org/jira/browse/SPARK-25696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-25696:
Assignee: (was: Apache Spark)
> The storage memory displayed on spark Application UI is incorrect.
> --
>
> Key: SPARK-25696
> URL: https://issues.apache.org/jira/browse/SPARK-25696
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
>Affects Versions: 2.3.2
>Reporter: hantiantian
>Priority: Major
>
> In the reported heartbeat information, the unit of the memory data is bytes,
> which is converted by the formatBytes() function in the utils.js file before
> being displayed in the interface. The base of the unit conversion in the
> formatBytes function is 1000, which should be 1024.
> function formatBytes(bytes, type) {
> if (type !== 'display') return bytes;
> if (bytes == 0) return '0.0 B';
> var k = 1000;
> var dm = 1;
> var sizes = ['B', 'KB', 'MB', 'GB', 'TB', 'PB', 'EB', 'ZB', 'YB'];
> var i = Math.floor(Math.log(bytes) / Math.log(k)); return
> parseFloat((bytes / Math.pow(k, i)).toFixed(dm)) + ' ' + sizes[i];
> }
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
