[GitHub] [incubator-hudi] adamjoneill edited a comment on issue #1325: presto - querying nested object in parquet file created by hudi

[GitBox]

adamjoneill edited a comment on issue #1325: presto - querying nested object in 
parquet file created by hudi
URL: https://github.com/apache/incubator-hudi/issues/1325#issuecomment-585748045
 
 
   Futher update
   I've narrowed it down to the array on the nested object. 
   
   The following works when i place the following object on the kinesis stream
   
   ```
   const valueToUse = {
         ...order,
         tickets: {
           items: [],
         },
       };
   ```
   
   but when placed on the kinesis stream with an object in the array it fails
   
   ```
   const valueToUse = {
         ...order,
         tickets: {
           items: [
             {
               ticketType: {
                 id: 258815,
               },
             },
           ],
         },
       };
   ```
   
   error message and stack trace when running `select * from table`
   
   ```
   Query 20200213_131029_00032_hej8h failed: No value present
   java.util.NoSuchElementException: No value present
        at java.util.Optional.get(Optional.java:135)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readArray(ParquetReader.java:156)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:282)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readStruct(ParquetReader.java:193)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:276)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readStruct(ParquetReader.java:193)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:276)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readStruct(ParquetReader.java:193)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readColumnChunk(ParquetReader.java:276)
        at 
com.facebook.presto.parquet.reader.ParquetReader.readBlock(ParquetReader.java:268)
        at 
com.facebook.presto.hive.parquet.ParquetPageSource$ParquetBlockLoader.load(ParquetPageSource.java:247)
        at 
com.facebook.presto.hive.parquet.ParquetPageSource$ParquetBlockLoader.load(ParquetPageSource.java:225)
        at 
com.facebook.presto.spi.block.LazyBlock.assureLoaded(LazyBlock.java:283)
        at 
com.facebook.presto.spi.block.LazyBlock.getLoadedBlock(LazyBlock.java:274)
        at com.facebook.presto.spi.Page.getLoadedPage(Page.java:261)
        at 
com.facebook.presto.operator.TableScanOperator.getOutput(TableScanOperator.java:254)
        at com.facebook.presto.operator.Driver.processInternal(Driver.java:379)
        at 
com.facebook.presto.operator.Driver.lambda$processFor$8(Driver.java:283)
        at com.facebook.presto.operator.Driver.tryWithLock(Driver.java:675)
        at com.facebook.presto.operator.Driver.processFor(Driver.java:276)
        at 
com.facebook.presto.execution.SqlTaskExecution$DriverSplitRunner.processFor(SqlTaskExecution.java:1077)
        at 
com.facebook.presto.execution.executor.PrioritizedSplitRunner.process(PrioritizedSplitRunner.java:162)
        at 
com.facebook.presto.execution.executor.TaskExecutor$TaskRunner.run(TaskExecutor.java:483)
        at 
com.facebook.presto.$gen.Presto_0_227____20200211_134743_1.run(Unknown Source)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
   ```

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services