[
https://issues.apache.org/jira/browse/ORC-1343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17656091#comment-17656091
]
deshanxiao commented on ORC-1343:
---------------------------------
For java writer, if we set orc.create.index=false rowIndexStride=10000. It will
not create index.
Once we use the filter to read, it will failed whether it is an old version or
a new java version.
[^my-java-create-index-false-row-index-10000-file.orc]
!image-2023-01-09-20-43-43-682.png!
> Reading ORC files without index occurs error using latested spark
> -----------------------------------------------------------------
>
> Key: ORC-1343
> URL: https://issues.apache.org/jira/browse/ORC-1343
> Project: ORC
> Issue Type: Bug
> Affects Versions: 1.7.7, 1.8.1
> Reporter: Penglei Shi
> Priority: Major
> Attachments: image-2023-01-09-20-34-10-801.png,
> image-2023-01-09-20-43-43-682.png,
> my-java-create-index-false-row-index-10000-file.orc, my-without-index.orc
>
>
> https://issues.apache.org/jira/browse/ORC-1283 this issue has fixed the
> problem that ENABLE_INDEXES does not take effect. But without index, filters
> pushdown will occur error, this seems to be because of the code below in
> RecordReaderImpl.java
> {code:java}
> if (indexes[columnIx] == null) {
> throw new AssertionError("Index is not populated for " + columnIx);
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
