[jira] [Created] (PARQUET-1456) Use page index, ParquetFileReader throw ArrayIndexOutOfBoundsException

[yiming.xu (JIRA)]

yiming.xu created PARQUET-1456:
----------------------------------

             Summary: Use page index, ParquetFileReader throw 
ArrayIndexOutOfBoundsException
                 Key: PARQUET-1456
                 URL: https://issues.apache.org/jira/browse/PARQUET-1456
             Project: Parquet
          Issue Type: Bug
          Components: parquet-mr
            Reporter: yiming.xu


hi, We use page index to adaptive spark with master branch find a concurrent 
proble, class 
org.apache.parquet.internal.column.columnindex.ColumnIndexBuilder#build cached 
ColumnIndexBuilder but not lock it,

    PrimitiveTypeName typeName = type.getPrimitiveTypeName();
    ColumnIndexBuilder builder = BUILDERS.get(typeName);
    if (builder == null) {
      builder = createNewBuilder(type, Integer.MAX_VALUE);
      BUILDERS.put(typeName, builder);
    }



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)