[
https://issues.apache.org/jira/browse/SPARK-32517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17181641#comment-17181641
]
Dongjoon Hyun commented on SPARK-32517:
---------------------------------------
BTW, this is not a bug in a new code because `StorageLevel.DISK_ONLY_3`
succeeds in ARM cpu. In other words, this will be an existing ARM CPU bug in
`with replication as stream` code path and it's exposed by the change from
'local-cluster[2,1,1024]` to 'local-cluster[3,1,1024]`.
{code}
- caching on disk, replicated 3 (encryption = off)
- caching on disk, replicated 3 (encryption = off) (with replication as stream)
- caching on disk, replicated 3 (encryption = on)
- caching on disk, replicated 3 (encryption = on) (with replication as stream)
{code}
In this case, I'd like to recommend to file a new JIRA for that.
> Add StorageLevel.DISK_ONLY_3
> ----------------------------
>
> Key: SPARK-32517
> URL: https://issues.apache.org/jira/browse/SPARK-32517
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.1.0
> Reporter: Dongjoon Hyun
> Assignee: Dongjoon Hyun
> Priority: Major
> Fix For: 3.1.0
>
>
> This issue aims to add `StorageLevel.DISK_ONLY_3` as a built-in StorageLevel.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
