[
https://issues.apache.org/jira/browse/ORC-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656388#comment-17656388
]
deshanxiao commented on ORC-1343:
---------------------------------
[~dongjoon]
Now, I'm more inclined to completely remove orc.create.index support which is
only supported by java writer. Because it can be replaced by
orc.row.index.strinde=0.
Or set orc.row.index.strinde to 0 when orc.create.index=false. It will be more
conducive to the compatibility of multi-language Readers.
What do you think? [~dongjoon]
> Reading ORC files without index occurs error using latested spark
> -----------------------------------------------------------------
>
> Key: ORC-1343
> URL: https://issues.apache.org/jira/browse/ORC-1343
> Project: ORC
> Issue Type: Bug
> Affects Versions: 1.7.7, 1.8.1
> Reporter: Penglei Shi
> Priority: Major
> Attachments: image-2023-01-09-20-34-10-801.png,
> image-2023-01-09-20-43-43-682.png,
> my-java-create-index-false-row-index-10000-file.orc, my-without-index.orc
>
>
> https://issues.apache.org/jira/browse/ORC-1283 this issue has fixed the
> problem that ENABLE_INDEXES does not take effect. But without index, filters
> pushdown will occur error, this seems to be because of the code below in
> RecordReaderImpl.java
> {code:java}
> if (indexes[columnIx] == null) {
> throw new AssertionError("Index is not populated for " + columnIx);
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
