[jira] [Created] (ARROW-5182) [Rust] Create Arrow File writer

2019-04-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5182: - Summary: [Rust] Create Arrow File writer Key: ARROW-5182 URL: https://issues.apache.org/jira/browse/ARROW-5182 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-5181) [Rust] Create Arrow File reader

2019-04-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5181: - Summary: [Rust] Create Arrow File reader Key: ARROW-5181 URL: https://issues.apache.org/jira/browse/ARROW-5181 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-5180) [Rust] IPC Support

2019-04-17 Thread Neville Dipale (JIRA)
Neville Dipale created ARROW-5180: - Summary: [Rust] IPC Support Key: ARROW-5180 URL: https://issues.apache.org/jira/browse/ARROW-5180 Project: Apache Arrow Issue Type: New Feature C

[jira] [Created] (ARROW-5179) [Python] Return plain dicts, not OrderedDict, on Python 3.7+

2019-04-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5179: - Summary: [Python] Return plain dicts, not OrderedDict, on Python 3.7+ Key: ARROW-5179 URL: https://issues.apache.org/jira/browse/ARROW-5179 Project: Apache Arrow

[jira] [Created] (ARROW-5178) [Python] Allow creating Table from Python dict

2019-04-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5178: - Summary: [Python] Allow creating Table from Python dict Key: ARROW-5178 URL: https://issues.apache.org/jira/browse/ARROW-5178 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-5177) [Python] ParquetReader.read_column() doesn't check bounds

2019-04-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5177: - Summary: [Python] ParquetReader.read_column() doesn't check bounds Key: ARROW-5177 URL: https://issues.apache.org/jira/browse/ARROW-5177 Project: Apache Arrow

Re: ARROW-3191: Making ArrowBuf work with arbitrary memory

2019-04-17 Thread Jacques Nadeau
Are there any other general comments here? If not, let's get this done and merged. On Mon, Apr 15, 2019, 4:19 PM Siddharth Teotia wrote: > I believe reader/writer indexes are typically used when we send buffers > over the wire -- so may not be necessary for all users of ArrowBuf. I am > okay wi

Re: [pyarrow] Parquet page header size limit

2019-04-17 Thread shyam narayan singh
My mistake. The max is 16MB. So, if deserialisation fails, we keep trying until we hit the max, that works but not efficient. Looks like the custom page header is not deserialisable. Will keep digging. Thanks Shyam On Wed, Apr 17, 2019 at 11:56 AM shyam narayan singh < shyambits2...@gmail.com> w