[
https://issues.apache.org/jira/browse/ARROW-232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16296892#comment-16296892
]
ASF GitHub Bot commented on ARROW-232:
--------------------------------------
wesm closed pull request #1425: ARROW-232: [Python] Add unit test for writing
Parquet file from chunked table
URL: https://github.com/apache/arrow/pull/1425
This is a PR merged from a forked repository.
As GitHub hides the original diff on merge, it is displayed below for
the sake of provenance:
As this is a foreign pull request (from a fork), the diff is supplied
below (as it won't show otherwise due to GitHub magic):
diff --git a/python/pyarrow/tests/test_parquet.py
b/python/pyarrow/tests/test_parquet.py
index fc8c8f0c9..c2bb31c9b 100644
--- a/python/pyarrow/tests/test_parquet.py
+++ b/python/pyarrow/tests/test_parquet.py
@@ -118,6 +118,24 @@ def test_pandas_parquet_2_0_rountrip(tmpdir):
tm.assert_frame_equal(df, df_read)
+@parquet
+def test_chunked_table_write(tmpdir):
+ # ARROW-232
+ df = alltypes_sample(size=10)
+
+ # The nanosecond->ms conversion is a nuisance, so we just avoid it here
+ del df['datetime']
+
+ batch = pa.RecordBatch.from_pandas(df)
+ table = pa.Table.from_batches([batch] * 3)
+ _check_roundtrip(table, version='2.0')
+
+ df, _ = dataframe_with_lists()
+ batch = pa.RecordBatch.from_pandas(df)
+ table = pa.Table.from_batches([batch] * 3)
+ _check_roundtrip(table, version='2.0')
+
+
@parquet
def test_pandas_parquet_datetime_tz():
import pyarrow.parquet as pq
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> C++/Parquet: Support writing chunked arrays as part of a table
> ---------------------------------------------------------------
>
> Key: ARROW-232
> URL: https://issues.apache.org/jira/browse/ARROW-232
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C++
> Reporter: Uwe L. Korn
> Assignee: Wes McKinney
> Labels: pull-request-available
> Fix For: 0.9.0
>
>
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
