capkurmagati commented on issue #47:
URL: https://github.com/apache/arrow-rs/issues/47#issuecomment-901183449
I also encountered the issue when I using `InfluxDB IOx` and `MinIo`.
```
Aug 18 23:40:50.688 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
Aug 18 23:40:50.690 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Aug 18 23:40:50.690 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Aug 18 23:40:50.690 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Parquet reader thread terminated due to error: IoError(Os { code: 24, kind:
Other, message: "Too many open files" })
Aug 18 23:40:50.691 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Aug 18 23:40:50.691 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Aug 18 23:40:50.694 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Aug 18 23:40:50.694 ERROR panic_logging: thread 'IOx Query Executor Thread'
panicked at 'UNKNOWN',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
thread 'IOx Query Executor Thread' panicked at 'called `Result::unwrap()` on
an `Err` value: Os { code: 24, kind: Other, message: "Too many open files" }',
/Users/jason/.cargo/registry/src/github.com-1ecc6299db9ec823/parquet-5.2.0/src/util/io.rs:82:50
Aug 18 23:40:50.695 INFO influxdb_iox::influxdb_ioxd::rpc::flight:
err=Query { database_name: "local_database", source: DataFusionExecution {
source: ArrowError(ExternalError(CreatingParquetReader { source: IoError(Os {
code: 24, kind: Other, message: "Too many open files" }) })) } } msg="Error
handling Flight gRPC request"
```
Additional info:
The directory structure follows. Each directory has 1-3 parquet files.
```
s3cmd ls s3://sensors/1/local_database/data/cpu/
DIR
s3://sensors/1/local_database/data/cpu/2021-08-17 12:00:00/
DIR
s3://sensors/1/local_database/data/cpu/2021-08-17 13:00:00/
DIR
s3://sensors/1/local_database/data/cpu/2021-08-17 14:00:00/
DIR
s3://sensors/1/local_database/data/cpu/2021-08-17 15:00:00/
20+ more dirs...
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
