[
https://issues.apache.org/jira/browse/CRAIL-3?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16369885#comment-16369885
]
Animesh Trivedi commented on CRAIL-3:
-------------------------------------
Quick update: this behavior seem to come from `crail.storage.rdma.localmap`
setting. If this is set to TRUE then the files/indexes are lost. If this is set
to FALSE, things seems to work.
This behavior can also be reproduced by just generating TeraGen data with
multiple executor and cores.
> Directory index lost when writing
> ---------------------------------
>
> Key: CRAIL-3
> URL: https://issues.apache.org/jira/browse/CRAIL-3
> Project: Apache Crail
> Issue Type: Bug
> Reporter: Animesh Trivedi
> Priority: Critical
>
> The current master branch has a bug where writes under certain conditions
> (generating TPC-DS data from Spark) are lost. So when files are enumerated,
> files in certain sequence are missing. The last good branch that works is
> 2ff90be2acd6a08f44ef4ef42d8a3ff8cd50781e.
> This probably was introduced with the directory logic update done for the KV
> interface.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
