[GitHub] [arrow] wgtmac commented on a diff in pull request #35825: GH-32723: [C++][Parquet] Add option to use LARGE* variants of binary types

[via GitHub]

wgtmac commented on code in PR #35825:
URL: https://github.com/apache/arrow/pull/35825#discussion_r1236213336


##########
cpp/src/parquet/arrow/arrow_reader_writer_test.cc:
##########
@@ -3862,6 +3919,17 @@ TEST(TestArrowReaderAdHoc, CorruptedSchema) {
   TryReadDataFile(path, ::arrow::StatusCode::IOError);
 }
 
+TEST(TestArrowParquet, LargeByteArray) {
+  auto path = test::get_data_file("chunked_string_map.parquet");
+  TryReadDataFile(path, ::arrow::StatusCode::NotImplemented);
+  ArrowReaderProperties reader_properties;
+  reader_properties.set_use_large_binary_variants(true);
+  reader_properties.set_read_dictionary(0, false);

Review Comment:
   Sorry I am not good at python and pyarrow. I did some research and found 
this doc: 
https://arrow.apache.org/docs/python/generated/pyarrow.parquet.write_table.html 
   
   Following code snippets may help:
   
   ```
   pq.write_table(table, 'example.parquet',
                  compression={'n_legs': 'snappy', 'animal': 'gzip'},
                  use_dictionary=['n_legs', 'animal'])
   
   pq.write_table(table, 'example.parquet',
                  column_encoding={'animal':'PLAIN'},
                  use_dictionary=False)
   ```



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org