This is an automated email from the ASF dual-hosted git repository.
apitrou pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/parquet-testing.git
The following commit(s) were added to refs/heads/master by this push:
new acd375e ARROW-15184: Add delta-encoded Parquet files with and without
nulls (#21)
acd375e is described below
commit acd375eb86a81cd856476fca0f52ba6036a067ff
Author: Shan Huang <[email protected]>
AuthorDate: Fri Dec 31 01:53:02 2021 +0800
ARROW-15184: Add delta-encoded Parquet files with and without nulls (#21)
---
data/README.md | 2 +
data/delta_encoding_optional_column.md | 69 +++++++++++++++++
data/delta_encoding_optional_column.parquet | Bin 0 -> 11567 bytes
data/delta_encoding_optional_column_expect.csv | 101 +++++++++++++++++++++++++
data/delta_encoding_required_column.md | 71 +++++++++++++++++
data/delta_encoding_required_column.parquet | Bin 0 -> 13528 bytes
data/delta_encoding_required_column_expect.csv | 101 +++++++++++++++++++++++++
7 files changed, 344 insertions(+)
diff --git a/data/README.md b/data/README.md
index 3c5f15f..37f4289 100644
--- a/data/README.md
+++ b/data/README.md
@@ -23,6 +23,8 @@
|---|---|
| delta_byte_array.parquet | string columns with DELTA_BYTE_ARRAY encoding.
See [delta_byte_array.md](delta_byte_array.md) for details. |
| delta_binary_packed.parquet | INT32 and INT64 columns with
DELTA_BINARY_PACKED encoding. See
[delta_binary_packed.md](delta_binary_packed.md) for details. |
+| delta_encoding_required_column.parquet | required INT32 and STRING columns
with delta encoding. See
[delta_encoding_required_column.md](delta_encoding_required_column.md) for
details. |
+| delta_encoding_optional_column.parquet | optional INT64 and STRING columns
with delta encoding. See
[delta_encoding_optional_column.md](delta_encoding_optional_column.md) for
details. |
| nested_structs.rust.parquet | Used to test that the Rust Arrow reader can
lookup the correct field from a nested struct. See
[ARROW-11452](https://issues.apache.org/jira/browse/ARROW-11452) |
TODO: Document what each file is in the table above.
diff --git a/data/delta_encoding_optional_column.md
b/data/delta_encoding_optional_column.md
new file mode 100644
index 0000000..b0d4c9d
--- /dev/null
+++ b/data/delta_encoding_optional_column.md
@@ -0,0 +1,69 @@
+<!--
+ ~ Licensed to the Apache Software Foundation (ASF) under one
+ ~ or more contributor license agreements. See the NOTICE file
+ ~ distributed with this work for additional information
+ ~ regarding copyright ownership. The ASF licenses this file
+ ~ to you under the Apache License, Version 2.0 (the
+ ~ "License"); you may not use this file except in compliance
+ ~ with the License. You may obtain a copy of the License at
+ ~
+ ~ http://www.apache.org/licenses/LICENSE-2.0
+ ~
+ ~ Unless required by applicable law or agreed to in writing,
+ ~ software distributed under the License is distributed on an
+ ~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ ~ KIND, either express or implied. See the License for the
+ ~ specific language governing permissions and limitations
+ ~ under the License.
+ -->
+
+`delta_encoding_optional_column.parquet` is generated with parquet-mr version
1.10.0.
+The expected file contents are in `delta_encoding_optional_column_expect.csv`.
+
+All columns are optional. INT64 columns are DELTA_BINARY_PACKED-encoded and
STRING
+columns are DELTA_BYTE_ARRAY-encoded. Each column has 100 rows.
+
+Here is the file structure:
+```file:
file:/Users/pincheng/arrow/cpp/submodules/parquet-testing/data/delta_encoding_optional_column.parquet
+creator: parquet-mr version 1.10.0 (build
031a6654009e3b82020012a18434c582bd74c73a)
+
+file schema: hive_schema
+--------------------------------------------------------------------------------
+c_customer_sk: OPTIONAL INT64 R:0 D:1
+c_current_cdemo_sk: OPTIONAL INT64 R:0 D:1
+c_current_hdemo_sk: OPTIONAL INT64 R:0 D:1
+c_current_addr_sk: OPTIONAL INT64 R:0 D:1
+c_first_shipto_date_sk: OPTIONAL INT64 R:0 D:1
+c_first_sales_date_sk: OPTIONAL INT64 R:0 D:1
+c_birth_day: OPTIONAL INT64 R:0 D:1
+c_birth_month: OPTIONAL INT64 R:0 D:1
+c_birth_year: OPTIONAL INT64 R:0 D:1
+c_customer_id: OPTIONAL BINARY L:STRING R:0 D:1
+c_salutation: OPTIONAL BINARY L:STRING R:0 D:1
+c_first_name: OPTIONAL BINARY L:STRING R:0 D:1
+c_last_name: OPTIONAL BINARY L:STRING R:0 D:1
+c_preferred_cust_flag: OPTIONAL BINARY L:STRING R:0 D:1
+c_birth_country: OPTIONAL BINARY L:STRING R:0 D:1
+c_email_address: OPTIONAL BINARY L:STRING R:0 D:1
+c_last_review_date: OPTIONAL BINARY L:STRING R:0 D:1
+
+row group 1: RC:100 TS:9485 OFFSET:4
+--------------------------------------------------------------------------------
+c_customer_sk: INT64 UNCOMPRESSED DO:0 FPO:4 SZ:81/81/1.00 VC:100
ENC:DELTA_BINARY_PACKED ST:[min: 1, max: 100, num_nulls: 0]
+c_current_cdemo_sk: INT64 UNCOMPRESSED DO:0 FPO:85 SZ:358/358/1.00 VC:100
ENC:DELTA_BINARY_PACKED ST:[min: 8817, max: 1895444, num_nulls: 3]
+c_current_hdemo_sk: INT64 UNCOMPRESSED DO:0 FPO:443 SZ:311/311/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 37, max: 7135, num_nulls: 2]
+c_current_addr_sk: INT64 UNCOMPRESSED DO:0 FPO:754 SZ:353/353/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 571, max: 49388, num_nulls: 0]
+c_first_shipto_date_sk: INT64 UNCOMPRESSED DO:0 FPO:1107 SZ:297/297/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 2449130, max: 2452641, num_nulls: 1]
+c_first_sales_date_sk: INT64 UNCOMPRESSED DO:0 FPO:1404 SZ:297/297/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 2449010, max: 2452611, num_nulls: 1]
+c_birth_day: INT64 UNCOMPRESSED DO:0 FPO:1701 SZ:160/160/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 1, max: 30, num_nulls: 3]
+c_birth_month: INT64 UNCOMPRESSED DO:0 FPO:1861 SZ:146/146/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 1, max: 12, num_nulls: 3]
+c_birth_year: INT64 UNCOMPRESSED DO:0 FPO:2007 SZ:172/172/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 1925, max: 1991, num_nulls: 3]
+c_customer_id: BINARY UNCOMPRESSED DO:0 FPO:2179 SZ:976/976/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: AAAAAAAAABAAAAAA, max: AAAAAAAAPFAAAAAA,
num_nulls: 0]
+c_salutation: BINARY UNCOMPRESSED DO:0 FPO:3155 SZ:376/376/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: Dr., max: Sir, num_nulls: 3]
+c_first_name: BINARY UNCOMPRESSED DO:0 FPO:3531 SZ:694/694/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: Albert, max: William, num_nulls: 3]
+c_last_name: BINARY UNCOMPRESSED DO:0 FPO:4225 SZ:777/777/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: Baker, max: Young, num_nulls: 1]
+c_preferred_cust_flag: BINARY UNCOMPRESSED DO:0 FPO:5002 SZ:156/156/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: N, max: Y, num_nulls: 4]
+c_birth_country: BINARY UNCOMPRESSED DO:0 FPO:5158 SZ:1111/1111/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: AFGHANISTAN, max: WALLIS AND FUTUNA,
num_nulls: 4]
+c_email_address: BINARY UNCOMPRESSED DO:0 FPO:6269 SZ:2813/2813/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: [email protected], max:
[email protected], num_nulls: 3]
+c_last_review_date: BINARY UNCOMPRESSED DO:0 FPO:9082 SZ:407/407/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: 2452293, max: 2452644, num_nulls: 3]
+```
diff --git a/data/delta_encoding_optional_column.parquet
b/data/delta_encoding_optional_column.parquet
new file mode 100644
index 0000000..3b06caa
Binary files /dev/null and b/data/delta_encoding_optional_column.parquet differ
diff --git a/data/delta_encoding_optional_column_expect.csv
b/data/delta_encoding_optional_column_expect.csv
new file mode 100644
index 0000000..b767b92
--- /dev/null
+++ b/data/delta_encoding_optional_column_expect.csv
@@ -0,0 +1,101 @@
+"c_customer_sk","c_current_cdemo_sk","c_current_hdemo_sk","c_current_addr_sk","c_first_shipto_date_sk","c_first_sales_date_sk","c_birth_day","c_birth_month","c_birth_year","
c_customer_id","c_salutation","c_first_name","c_last_name","c_preferred_cust_flag","c_birth_country","c_email_address","c_last_review_date"
+"100","1254468","6370","6672","2449148","2449118","13","7","1958","AAAAAAAAEGAAAAAA","Ms.","Jeannette","Johnson","Y","BANGLADESH","[email protected]","2452635"
+"99","622676","2152","17228","2451687","2451657","9","12","1961","AAAAAAAADGAAAAAA","Sir","Austin","Tran","Y","NAMIBIA","[email protected]","2452437"
+"98","574977","1615","43853","2450894","2450864","23","6","1965","AAAAAAAACGAAAAAA","Dr.","David","Lewis","N","KIRIBATI","[email protected]","2452558"
+"97","418763","102","49041","2452467","2452437","19","5","1971","AAAAAAAABGAAAAAA","Mr.","Stewart","Ruffin","Y","MYANMAR","[email protected]","2452528"
+"96","1148074","6019","35611","2451505","2451475","22","10","1955","AAAAAAAAAGAAAAAA","Sir","Shaun","Lewis","N","NIGERIA","[email protected]","2452395"
+"95","796503","1663","16023","2452468","2452438","17","4","1943","AAAAAAAAPFAAAAAA","Ms.","Elizabeth","Hollingsworth","N","GREECE","[email protected]","2452584"
+"94","451893","1990","33287","2449553","2449523","14","5","1982","AAAAAAAAOFAAAAAA","Mr.","Craig","Byrd","Y","FRENCH
POLYNESIA","[email protected]","2452445"
+"93","647375","6229","35836","2449341","2449311","6","10","1927","AAAAAAAANFAAAAAA","Sir","Clyde","Williams","N","FRENCH
POLYNESIA","[email protected]","2452510"
+"92","953084","5771","35211","2452582","2452552","8","2","1973","AAAAAAAAMFAAAAAA","Miss","Crystal","Ryan","Y","ECUADOR","[email protected]","2452294"
+"91","827176","2441","14906","2450406","2450376","28","3","1962","AAAAAAAALFAAAAAA","Miss","Heather","White","Y","MARTINIQUE","[email protected]","2452295"
+"90","417827","5083","45139","2451494","2451464","7","5","1985","AAAAAAAAKFAAAAAA","Mr.","Nathan","Pond","Y","GUYANA","[email protected]","2452637"
+"89","694848","5383","26318","2451425","2451395","15","3","1981","AAAAAAAAJFAAAAAA","Mrs.","Helen","Macdonald","Y","DOMINICA","[email protected]","2452626"
+"88","495575","131","42687","2450991","2450961","20","8","1965","AAAAAAAAIFAAAAAA","Dr.","Phyllis","Horner","N","UZBEKISTAN","[email protected]","2452403"
+"87","1452824","1427","22030","2449404","2449374","2","7","1934","AAAAAAAAHFAAAAAA","Dr.","Kevin","White","N","BENIN","[email protected]","2452492"
+"86","1428237","6963","38442","2451560","2451530","21","10","1983","AAAAAAAAGFAAAAAA","Dr.","Marvin","Matlock","Y","BRUNEI
DARUSSALAM","[email protected]","2452633"
+"85","1293499","37","10575","2449868","2449838","30","10","1978","AAAAAAAAFFAAAAAA","Miss","Michele","Baldwin","Y","GEORGIA","[email protected]","2452491"
+"84","1250744","2821","40898","2449496","2449466","2","5","1964","AAAAAAAAEFAAAAAA","Mrs.","Ami","Montgomery","Y","JAMAICA","[email protected]","2452526"
+"83","976724","5574","40824","2451032","2451002","24","1","1943","AAAAAAAADFAAAAAA","Miss","Daisy","Flynn","N","NEW
ZEALAND","[email protected]","2452338"
+"82","75627","5081","30088","2450357","2450327","26","2","1947","AAAAAAAACFAAAAAA","Sir","Max","Mueller","N","IRAQ","[email protected]","2452303"
+"81","728917","388","48306","2452562","2452532","17","7","1940","AAAAAAAABFAAAAAA","Ms.","Jessica","Levesque","Y","ALBANIA","[email protected]","2452414"
+"80","1499808","3891","44727","2450558","2450528","21","12","1948","AAAAAAAAAFAAAAAA","Mrs.","Eleanor","Evans","N","C�TE
D'IVOIRE","[email protected]","2452413"
+"79","389494","3493","9539","2450863","2450833","10","6","1937","AAAAAAAAPEAAAAAA","Miss","Sandi","Tran","Y","FRENCH
GUIANA","[email protected]","2452644"
+"78","1092537","3677","7264","2449388","2449358","11","5","1940","AAAAAAAAOEAAAAAA","Ms.","Wanda","Davis","N","NETHERLANDS
ANTILLES","[email protected]","2452339"
+"77","915180","2167","37154","2451632","2451602","30","5","1931","AAAAAAAANEAAAAAA","Dr.","Darrin","Smith","N","UNITED
STATES","[email protected]","2452355"
+"76","526064","2054","9691","2451760","2451730","7","3","1946","AAAAAAAAMEAAAAAA","Mr.","Craig","Lowry","Y","WALLIS
AND FUTUNA","[email protected]","2452430"
+"75","1888603","143","37730","2451755","2451725","25","5","1925","AAAAAAAALEAAAAAA","Dr.","Annie","Grant","Y","TUVALU","[email protected]","2452401"
+"74","1434225","347","15269","2452641","2452611","19","2","1953","AAAAAAAAKEAAAAAA","Sir","Eric","Woods","Y","SAINT
LUCIA","[email protected]","2452584"
+"73","425740","431","48369","2449133","2449103","17","4","1956","AAAAAAAAJEAAAAAA","Mr.","David","Vasquez","N","ISRAEL","[email protected]","2452489"
+"72","1608738","6364","26390","2451700","2451670","21","3","1937","AAAAAAAAIEAAAAAA","Dr.","Bradley","Barry","Y","TAJIKISTAN","[email protected]","2452601"
+"71","1292064","2257","42450","2450248","2450218","4","11","1967","AAAAAAAAHEAAAAAA","Mr.","Roderick","Rogers","N","OMAN","[email protected]","2452462"
+"70","1460929","5492","48102","2451944","2451914","7","12","1963","AAAAAAAAGEAAAAAA","Sir","James","Smith","N","KUWAIT","[email protected]","2452342"
+"69","971368","4167","9366","2450154","2450124","15","1","1950","AAAAAAAAFEAAAAAA","Sir","Steven","Mcclellan","Y","NEPAL","[email protected]","2452340"
+"68","779965","6069","16126","2451936","2451906","20","8","1928","AAAAAAAAEEAAAAAA","Dr.","Arthur","Troy","Y","LUXEMBOURG","[email protected]","2452542"
+"67","1118294","2032","24970","2452033","2452003","27","10","1948","AAAAAAAADEAAAAAA","Dr.","Gerald","Thomas","N","NORWAY","[email protected]","2452414"
+"66","747190","6036","42882","2449294","2449264","8","9","1950","AAAAAAAACEAAAAAA","Ms.","Julie","Chester","N","HONG
KONG","[email protected]","2452375"
+"65","1778884","2234","37584","2451898","2451868","18","9","1991","AAAAAAAABEAAAAAA","Dr.","Rodney","Taft","N","VIRGIN
ISLANDS, U.S.","[email protected]","2452353"
+"64","1260191","6284","25930","2452379","2452349","27","6","1941","AAAAAAAAAEAAAAAA","Dr.","Michael","Frye","N","CAPE
VERDE","[email protected]","2452426"
+"63","1790374","2445","9716","2450179","2450149","26","4","1943","AAAAAAAAPDAAAAAA","Dr.","Frank","Morton","N","EGYPT","[email protected]","2452425"
+"62","821787","4700","28413","2451854","2451824","1","6","1973","AAAAAAAAODAAAAAA","Mr.","Matthew","Brown","Y","KOREA,
REPUBLIC OF","[email protected]","2452319"
+"61","1620078","6683","11688","2451136","2451106","6","5","1978","AAAAAAAANDAAAAAA","Sir","Joseph","White","Y","SENEGAL","[email protected]","2452462"
+"60","1179671","3200","44282","2449714","2449684","15","7","1990","AAAAAAAAMDAAAAAA","Ms.","Dollie","Thao","N","SWITZERLAND","[email protected]","2452407"
+"59","1895444","4787","45683","2451157","2451127","6","1","1947","AAAAAAAALDAAAAAA","Miss","Melanie","Morrison","N","HUNGARY","[email protected]","2452530"
+"58","528756","6879","14155","2451386","2451356","29","2","1988","AAAAAAAAKDAAAAAA","Mr.","Cecil","Peterman","Y","ICELAND","[email protected]","2452447"
+"57","752932","128","571","2449741","2449711","10","3","1961","AAAAAAAAJDAAAAAA","Mr.","Travis","Melendez","Y","AFGHANISTAN","[email protected]","2452606"
+"56","344460","3092","2524","2451424","2451394","29","1","1960","AAAAAAAAIDAAAAAA","Miss","Pamela","Delgado","N","GUERNSEY","[email protected]","2452334"
+"55","783093","1151","23256","2451539","2451509","12","8","1933","AAAAAAAAHDAAAAAA","Dr.","Beryl","Thomason","N","UNITED
KINGDOM","[email protected]","2452380"
+"54","380102","2381","40660","2449980","2449950","3","2","1940","AAAAAAAAGDAAAAAA","Ms.","Donna","King","Y","TUNISIA","[email protected]","2452446"
+"53","1597348","7017","43439","2451820","2451790","23","9","1950","AAAAAAAAFDAAAAAA","Mr.","Paul","Higgins","Y","GABON","[email protected]","2452447"
+"52","534808","4768","27128","2451421","2451391","1","4","1982","AAAAAAAAEDAAAAAA","Mrs.","Wendy","Colley","N","FRENCH
GUIANA","[email protected]","2452553"
+"51","532799","6920","10688","2452390","2452360","5","10","1926","AAAAAAAADDAAAAAA","Dr.","David","Nieves","N","CHRISTMAS
ISLAND","[email protected]","2452570"
+"50","759177","72","32567","2449384","2449354","24","11","1965","AAAAAAAACDAAAAAA","Mr.","Christopher","Eller","N","AUSTRALIA","[email protected]","2452520"
+"49","936800","1514","20581","2449364","2449334","13","6","1961","AAAAAAAABDAAAAAA","Mr.","Steven","Venable","N","NETHERLANDS
ANTILLES","[email protected]","2452350"
+"48","8817","311","38252","2449531","2449501","15","9","1961","AAAAAAAAADAAAAAA","Ms.","Jill","Jackson","N","LUXEMBOURG","[email protected]","2452575"
+"47","1634314","5368","38469","2449165","2449135","3","12","1982","AAAAAAAAPCAAAAAA","Mr.","Luis","Young","N","BRUNEI
DARUSSALAM","[email protected]","2452586"
+"46","843672","4729","21386","2451857","2451827","13","4","1990","AAAAAAAAOCAAAAAA","Mrs.","Jane","Stephenson","Y","TURKEY","[email protected]","2452301"
+"45","1036174","2399","19777","2451118","2451088","5",,,"AAAAAAAANCAAAAAA",,,"Hammonds",,"NIGER",,
+"44","497758","5427","32296","2449750","2449720","7","12","1932","AAAAAAAAMCAAAAAA","Miss","Mabel","Richmond","Y","CAMBODIA","[email protected]","2452333"
+"43","385562","3676","43743","2451705","2451675","5","12","1965","AAAAAAAALCAAAAAA","Mr.","William","Warner","Y","GUAM","[email protected]","2452537"
+"42","1867377","3327","11277","2449869","2449839","17","1","1950","AAAAAAAAKCAAAAAA","Dr.","Deborah","Burton","N","COMOROS","[email protected]","2452498"
+"41","941420","5068","18316","2449989","2449959","26","6","1939","AAAAAAAAJCAAAAAA","Miss","Maxine","Carlson","N","ISLE
OF MAN","[email protected]","2452464"
+"40","1795301",,"21045","2451159",,"26",,"1942","AAAAAAAAICAAAAAA",,"Jacqueline","Hatfield",,,,
+"39","1617182","4013","22844","2452131","2452101","14","12","1951","AAAAAAAAHCAAAAAA","Sir","Neil","Cox","N","ECUADOR","[email protected]","2452586"
+"38","766645","3879","36360","2450323","2450293","30","3","1939","AAAAAAAAGCAAAAAA","Mrs.","Ha","Carpenter","Y","PARAGUAY","[email protected]","2452351"
+"37","827972","2281","12943","2449848","2449818","9","1","1949","AAAAAAAAFCAAAAAA","Dr.","Dwight","Schneider","Y","RUSSIAN
FEDERATION","[email protected]","2452293"
+"36","655414","2223","26585","2449222","2449192","29","11","1968","AAAAAAAAECAAAAAA","Dr.","Anthony","Fisher","N","KYRGYZSTAN","[email protected]","2452470"
+"35","339036","2057","32231","2451937","2451907","19","6","1953","AAAAAAAADCAAAAAA","Dr.","Marie","Peterson","N","KIRIBATI","[email protected]","2452581"
+"34",,,"37501","2452192","2452162",,,,"AAAAAAAACCAAAAAA",,,"Woods",,,"[email protected]","2452408"
+"33","1680761","5823","32438","2451572","2451542","25","3","1958","AAAAAAAABCAAAAAA","Mrs.","Donna","Betts","Y","FRANCE","[email protected]","2452455"
+"32","1369589","6163","48290","2449471","2449441","2","8","1927","AAAAAAAAACAAAAAA","Dr.","Kenneth","Wood","N","MOLDOVA,
REPUBLIC OF","[email protected]","2452510"
+"31","1275120","5724","7128","2452054","2452024","13","6","1964","AAAAAAAAPBAAAAAA","Dr.","William","Craig","N","SPAIN","[email protected]","2452336"
+"30","84232","5869","45459","2449916","2449886","4","7","1956","AAAAAAAAOBAAAAAA","Dr.","Pamela","Luna","Y","GUAM","[email protected]","2452410"
+"29","1634269","1204","44139","2452216","2452186","25","8","1973","AAAAAAAANBAAAAAA","Ms.","Margaret","Collins","Y","NETHERLANDS
ANTILLES","[email protected]","2452496"
+"28","889961","897","33480","2452615","2452585","17","8","1959","AAAAAAAAMBAAAAAA","Miss","Edith","Hernandez","Y","C�TE
D'IVOIRE","[email protected]","2452631"
+"27","111621","835","16096","2450611","2450581","7","3","1972","AAAAAAAALBAAAAAA","Dr.","Shawn","Prather","N","PUERTO
RICO","[email protected]","2452353"
+"26","230278","1242","28206","2449816","2449786","14","6","1991","AAAAAAAAKBAAAAAA","Ms.","Monique","Baker","N","MOROCCO","[email protected]","2452356"
+"25","476176","3278","25933","2449246","2449216","6","10","1973","AAAAAAAAJBAAAAAA","Miss","Nancy","Mccormick","N","BAHAMAS","[email protected]","2452425"
+"24","17113","1102","14291","2450098","2450068","6","6","1951","AAAAAAAAIBAAAAAA","Dr.","Paul","Morris","Y","GUINEA-BISSAU","[email protected]","2452499"
+"23",,"2107","686","2451012","2450982",,"5",,"AAAAAAAAHBAAAAAA","Sir",,"Garrison","N",,"[email protected]",
+"22","490494","4504","40467","2451465","2451435","21","12","1991","AAAAAAAAGBAAAAAA","Sir","Victor","Martinez","N","CAYMAN
ISLANDS","[email protected]","2452529"
+"21","442697","6538","25979","2451827","2451797","18","5","1956","AAAAAAAAFBAAAAAA","Miss","Naomi","Barnett","N","BAHAMAS","[email protected]","2452433"
+"20","1185612","89","38966","2450965","2450935","17","5","1976","AAAAAAAAEBAAAAAA","Mr.","Stanton","Dallas","Y","SWITZERLAND","[email protected]","2452334"
+"19","1161742","4238","45581","2449580","2449550","20","10","1978","AAAAAAAADBAAAAAA","Dr.","Andre","Moore","N","NICARAGUA","[email protected]","2452576"
+"18","1361151","6580","18456","2450041","2450011","1","9","1950","AAAAAAAACBAAAAAA","Sir","Brad","Lynch","Y","URUGUAY","[email protected]","2452549"
+"17","707524","3876","2228","2451068","2451038","23","12","1972","AAAAAAAABBAAAAAA","Dr.","Lee","Stovall","N","PHILIPPINES","[email protected]","2452454"
+"16","1196373","3014","29302","2451346","2451316","24","12","1933","AAAAAAAAABAAAAAA","Dr.","Margie","Browning","N","PHILIPPINES","[email protected]","2452573"
+"15",,"134","30469",,"2449010",,"12","1969","AAAAAAAAPAAAAAAA","Ms.","Tonya",,,,,"2452376"
+"14","929344","892","6440","2450318","2450288","30","3","1937","AAAAAAAAOAAAAAAA","Mr.","Jack","Wilcox","N","SLOVENIA","[email protected]","2452641"
+"13","1128748","2777","14006","2449658","2449628","1","3","1970","AAAAAAAANAAAAAAA","Mrs.","Rosalinda","Grimes","N","UKRAINE","[email protected]","2452616"
+"12","502141","6577","47366","2451039","2451009","2","6","1956","AAAAAAAAMAAAAAAA","Ms.","Margaret","Farias","N","TURKMENISTAN","[email protected]","2452634"
+"11","1114415","6807","47999","2452288","2452258","18","12","1963","AAAAAAAALAAAAAAA","Ms.","Betty","Williams","N","BURKINA
FASO","[email protected]","2452398"
+"10","1207553","5143","19580","2451353","2451323","15","10","1973","AAAAAAAAKAAAAAAA","Ms.","Albert","Brunson","N","JORDAN","[email protected]","2452641"
+"9","1168667","1404","49388","2452275","2452245","26","10","1966","AAAAAAAAJAAAAAAA","Sir","Karl","Gilbert","N","MONTSERRAT","[email protected]","2452454"
+"8","1215897","2471","16598","2449406","2449376","26","12","1938","AAAAAAAAIAAAAAAA","Sir","Ollie","Shipman","N","KOREA,
REPUBLIC OF","[email protected]","2452334"
+"7","68377","3219","44814","2451438","2451408","24","4","1985","AAAAAAAAHAAAAAAA","Ms.","Fonda","Wiles","Y","GAMBIA","[email protected]","2452360"
+"6","213219","6374","27082","2451883","2451853","4","12","1925","AAAAAAAAGAAAAAAA","Ms.","Brunilda","Sharp","N","SURINAME","[email protected]","2452430"
+"5","953372","4470","36368","2449438","2449408","8","5","1956","AAAAAAAAFAAAAAAA","Sir","Robert","Moran","N","FIJI","[email protected]","2452469"
+"4","1703214","3986","39558","2450030","2450000","7","6","1983","AAAAAAAAEAAAAAAA","Dr.","Michael","White","N","MEXICO","[email protected]","2452361"
+"3","1473522","6247","48572","2449130","2449100","18","9","1979","AAAAAAAADAAAAAAA","Miss","Latisha","Hamilton","N","NIUE","[email protected]","2452313"
+"2","819667","1461","31655","2452318","2452288","9","4","1966","AAAAAAAACAAAAAAA","Dr.","Amy","Moses","Y","TOGO","[email protected]","2452318"
+"1","980124","7135","32946","2452238","2452208","9","12","1936","AAAAAAAABAAAAAAA","Mr.","Javier","Lewis","Y","CHILE","[email protected]","2452508"
diff --git a/data/delta_encoding_required_column.md
b/data/delta_encoding_required_column.md
new file mode 100644
index 0000000..b68c0aa
--- /dev/null
+++ b/data/delta_encoding_required_column.md
@@ -0,0 +1,71 @@
+<!--
+ ~ Licensed to the Apache Software Foundation (ASF) under one
+ ~ or more contributor license agreements. See the NOTICE file
+ ~ distributed with this work for additional information
+ ~ regarding copyright ownership. The ASF licenses this file
+ ~ to you under the Apache License, Version 2.0 (the
+ ~ "License"); you may not use this file except in compliance
+ ~ with the License. You may obtain a copy of the License at
+ ~
+ ~ http://www.apache.org/licenses/LICENSE-2.0
+ ~
+ ~ Unless required by applicable law or agreed to in writing,
+ ~ software distributed under the License is distributed on an
+ ~ "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ ~ KIND, either express or implied. See the License for the
+ ~ specific language governing permissions and limitations
+ ~ under the License.
+ -->
+
+`delta_encoding_required_column.parquet` is generated with parquet-mr version
1.12.1.
+The expected file contents are in `delta_encoding_required_column_expect.csv`.
+
+All columns are required. INT32 columns are DELTA_BINARY_PACKED-encoded and
STRING
+columns are DELTA_BYTE_ARRAY-encoded. Each column has 100 rows.
+
+Here is the file structure:
+```file:
file:/Users/pincheng/arrow/cpp/submodules/parquet-testing/data/delta_encoding_required_column.parquet
+creator: parquet-mr version 1.12.1 (build
2a5c06c58fa987f85aa22170be14d927d5ff6e7d)
+extra: org.apache.spark.version = 3.2.0
+extra: org.apache.spark.sql.parquet.row.metadata =
{"type":"struct","fields":[{"name":"c_customer_sk:","type":"integer","nullable":false,"metadata":{}},{"name":"c_current_cdemo_sk:","type":"integer","nullable":false,"metadata":{}},{"name":"c_current_hdemo_sk:","type":"integer","nullable":false,"metadata":{}},{"name":"c_current_addr_sk:","type":"integer","nullable":false,"metadata":{}},{"name":"c_first_shipto_date_sk:","type":"integer","nullable":false,"metadata":{}},{"na
[...]
+
+file schema: spark_schema
+--------------------------------------------------------------------------------
+c_customer_sk: : REQUIRED INT32 R:0 D:0
+c_current_cdemo_sk: : REQUIRED INT32 R:0 D:0
+c_current_hdemo_sk: : REQUIRED INT32 R:0 D:0
+c_current_addr_sk: : REQUIRED INT32 R:0 D:0
+c_first_shipto_date_sk: : REQUIRED INT32 R:0 D:0
+c_first_sales_date_sk: : REQUIRED INT32 R:0 D:0
+c_birth_day: : REQUIRED INT32 R:0 D:0
+c_birth_month: : REQUIRED INT32 R:0 D:0
+c_birth_year: : REQUIRED INT32 R:0 D:0
+c_customer_id: : REQUIRED BINARY L:STRING R:0 D:0
+c_salutation: : REQUIRED BINARY L:STRING R:0 D:0
+c_first_name: : REQUIRED BINARY L:STRING R:0 D:0
+c_last_name: : REQUIRED BINARY L:STRING R:0 D:0
+c_preferred_cust_flag: : REQUIRED BINARY L:STRING R:0 D:0
+c_birth_country: : REQUIRED BINARY L:STRING R:0 D:0
+c_email_address: : REQUIRED BINARY L:STRING R:0 D:0
+c_last_review_date: : REQUIRED BINARY L:STRING R:0 D:0
+
+row group 1: RC:100 TS:9229 OFFSET:4
+--------------------------------------------------------------------------------
+c_customer_sk: : INT32 UNCOMPRESSED DO:0 FPO:4 SZ:50/50/1.00 VC:100
ENC:DELTA_BINARY_PACKED ST:[min: 1, max: 105, num_nulls: 0]
+c_current_cdemo_sk: : INT32 UNCOMPRESSED DO:0 FPO:54 SZ:388/388/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 8817, max: 1895444, num_nulls: 0]
+c_current_hdemo_sk: : INT32 UNCOMPRESSED DO:0 FPO:442 SZ:261/261/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 37, max: 7135, num_nulls: 0]
+c_current_addr_sk: : INT32 UNCOMPRESSED DO:0 FPO:703 SZ:307/307/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 464, max: 49388, num_nulls: 0]
+c_first_shipto_date_sk: : INT32 UNCOMPRESSED DO:0 FPO:1010 SZ:247/247/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 2449130, max: 2452641, num_nulls: 0]
+c_first_sales_date_sk: : INT32 UNCOMPRESSED DO:0 FPO:1257 SZ:247/247/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 2449100, max: 2452611, num_nulls: 0]
+c_birth_day: : INT32 UNCOMPRESSED DO:0 FPO:1504 SZ:131/131/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 1, max: 30, num_nulls: 0]
+c_birth_month: : INT32 UNCOMPRESSED DO:0 FPO:1635 SZ:115/115/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 1, max: 12, num_nulls: 0]
+c_birth_year: : INT32 UNCOMPRESSED DO:0 FPO:1750 SZ:144/144/1.00
VC:100 ENC:DELTA_BINARY_PACKED ST:[min: 1925, max: 1991, num_nulls: 0]
+c_customer_id: : BINARY UNCOMPRESSED DO:0 FPO:1894 SZ:933/933/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: AAAAAAAAABAAAAAA, max: AAAAAAAAPFAAAAAA,
num_nulls: 0]
+c_salutation: : BINARY UNCOMPRESSED DO:0 FPO:2827 SZ:378/378/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: Dr., max: Sir, num_nulls: 0]
+c_first_name: : BINARY UNCOMPRESSED DO:0 FPO:3205 SZ:707/707/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: Albert, max: William, num_nulls: 0]
+c_last_name: : BINARY UNCOMPRESSED DO:0 FPO:3912 SZ:751/751/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: Baker, max: Young, num_nulls: 0]
+c_preferred_cust_flag: : BINARY UNCOMPRESSED DO:0 FPO:4663 SZ:154/154/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: N, max: Y, num_nulls: 0]
+c_birth_country: : BINARY UNCOMPRESSED DO:0 FPO:4817 SZ:1154/1154/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: AFGHANISTAN, max: WALLIS AND FUTUNA,
num_nulls: 0]
+c_email_address: : BINARY UNCOMPRESSED DO:0 FPO:5971 SZ:2857/2857/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: [email protected], max:
[email protected], num_nulls: 0]
+c_last_review_date: : BINARY UNCOMPRESSED DO:0 FPO:8828 SZ:405/405/1.00
VC:100 ENC:DELTA_BYTE_ARRAY ST:[min: 2452293, max: 2452644, num_nulls: 0]
+```
diff --git a/data/delta_encoding_required_column.parquet
b/data/delta_encoding_required_column.parquet
new file mode 100644
index 0000000..5b63b21
Binary files /dev/null and b/data/delta_encoding_required_column.parquet differ
diff --git a/data/delta_encoding_required_column_expect.csv
b/data/delta_encoding_required_column_expect.csv
new file mode 100644
index 0000000..1d5fa2d
--- /dev/null
+++ b/data/delta_encoding_required_column_expect.csv
@@ -0,0 +1,101 @@
+"c_customer_sk","c_current_cdemo_sk","c_current_hdemo_sk","c_current_addr_sk","c_first_shipto_date_sk","c_first_sales_date_sk","c_birth_day","c_birth_month","c_birth_year","
c_customer_id","c_salutation","c_first_name","c_last_name","c_preferred_cust_flag","c_birth_country","c_email_address","c_last_review_date"
+"105","949850","383","46916","2452463","2452433","14","1","1945","AAAAAAAAJGAAAAAA","Dr.","Frank","Strain","Y","VIRGIN
ISLANDS, U.S.","[email protected]","2452378"
+"104","1090695","3116","25490","2450355","2450325","29","11","1936","AAAAAAAAIGAAAAAA","Dr.","Benjamin","Johnson","Y","BAHRAIN","[email protected]","2452499"
+"103","1659630","5909","33035","2451586","2451556","3","5","1947","AAAAAAAAHGAAAAAA","Dr.","James","Porter","N","AFGHANISTAN","[email protected]","2452359"
+"102","1250712","1207","4149","2450198","2450168","9","8","1937","AAAAAAAAGGAAAAAA","Ms.","Jodi","Silva","N","CANADA","[email protected]","2452443"
+"101","1730669","4190","464","2450159","2450129","7","5","1951","AAAAAAAAFGAAAAAA","Dr.","Jeffrey","Bruce","N","MAURITANIA","[email protected]","2452590"
+"100","1254468","6370","6672","2449148","2449118","13","7","1958","AAAAAAAAEGAAAAAA","Ms.","Jeannette","Johnson","Y","BANGLADESH","[email protected]","2452635"
+"99","622676","2152","17228","2451687","2451657","9","12","1961","AAAAAAAADGAAAAAA","Sir","Austin","Tran","Y","NAMIBIA","[email protected]","2452437"
+"98","574977","1615","43853","2450894","2450864","23","6","1965","AAAAAAAACGAAAAAA","Dr.","David","Lewis","N","KIRIBATI","[email protected]","2452558"
+"97","418763","102","49041","2452467","2452437","19","5","1971","AAAAAAAABGAAAAAA","Mr.","Stewart","Ruffin","Y","MYANMAR","[email protected]","2452528"
+"96","1148074","6019","35611","2451505","2451475","22","10","1955","AAAAAAAAAGAAAAAA","Sir","Shaun","Lewis","N","NIGERIA","[email protected]","2452395"
+"95","796503","1663","16023","2452468","2452438","17","4","1943","AAAAAAAAPFAAAAAA","Ms.","Elizabeth","Hollingsworth","N","GREECE","[email protected]","2452584"
+"94","451893","1990","33287","2449553","2449523","14","5","1982","AAAAAAAAOFAAAAAA","Mr.","Craig","Byrd","Y","FRENCH
POLYNESIA","[email protected]","2452445"
+"93","647375","6229","35836","2449341","2449311","6","10","1927","AAAAAAAANFAAAAAA","Sir","Clyde","Williams","N","FRENCH
POLYNESIA","[email protected]","2452510"
+"92","953084","5771","35211","2452582","2452552","8","2","1973","AAAAAAAAMFAAAAAA","Miss","Crystal","Ryan","Y","ECUADOR","[email protected]","2452294"
+"91","827176","2441","14906","2450406","2450376","28","3","1962","AAAAAAAALFAAAAAA","Miss","Heather","White","Y","MARTINIQUE","[email protected]","2452295"
+"90","417827","5083","45139","2451494","2451464","7","5","1985","AAAAAAAAKFAAAAAA","Mr.","Nathan","Pond","Y","GUYANA","[email protected]","2452637"
+"89","694848","5383","26318","2451425","2451395","15","3","1981","AAAAAAAAJFAAAAAA","Mrs.","Helen","Macdonald","Y","DOMINICA","[email protected]","2452626"
+"88","495575","131","42687","2450991","2450961","20","8","1965","AAAAAAAAIFAAAAAA","Dr.","Phyllis","Horner","N","UZBEKISTAN","[email protected]","2452403"
+"87","1452824","1427","22030","2449404","2449374","2","7","1934","AAAAAAAAHFAAAAAA","Dr.","Kevin","White","N","BENIN","[email protected]","2452492"
+"86","1428237","6963","38442","2451560","2451530","21","10","1983","AAAAAAAAGFAAAAAA","Dr.","Marvin","Matlock","Y","BRUNEI
DARUSSALAM","[email protected]","2452633"
+"85","1293499","37","10575","2449868","2449838","30","10","1978","AAAAAAAAFFAAAAAA","Miss","Michele","Baldwin","Y","GEORGIA","[email protected]","2452491"
+"84","1250744","2821","40898","2449496","2449466","2","5","1964","AAAAAAAAEFAAAAAA","Mrs.","Ami","Montgomery","Y","JAMAICA","[email protected]","2452526"
+"83","976724","5574","40824","2451032","2451002","24","1","1943","AAAAAAAADFAAAAAA","Miss","Daisy","Flynn","N","NEW
ZEALAND","[email protected]","2452338"
+"82","75627","5081","30088","2450357","2450327","26","2","1947","AAAAAAAACFAAAAAA","Sir","Max","Mueller","N","IRAQ","[email protected]","2452303"
+"81","728917","388","48306","2452562","2452532","17","7","1940","AAAAAAAABFAAAAAA","Ms.","Jessica","Levesque","Y","ALBANIA","[email protected]","2452414"
+"80","1499808","3891","44727","2450558","2450528","21","12","1948","AAAAAAAAAFAAAAAA","Mrs.","Eleanor","Evans","N","C�TE
D'IVOIRE","[email protected]","2452413"
+"79","389494","3493","9539","2450863","2450833","10","6","1937","AAAAAAAAPEAAAAAA","Miss","Sandi","Tran","Y","FRENCH
GUIANA","[email protected]","2452644"
+"78","1092537","3677","7264","2449388","2449358","11","5","1940","AAAAAAAAOEAAAAAA","Ms.","Wanda","Davis","N","NETHERLANDS
ANTILLES","[email protected]","2452339"
+"77","915180","2167","37154","2451632","2451602","30","5","1931","AAAAAAAANEAAAAAA","Dr.","Darrin","Smith","N","UNITED
STATES","[email protected]","2452355"
+"76","526064","2054","9691","2451760","2451730","7","3","1946","AAAAAAAAMEAAAAAA","Mr.","Craig","Lowry","Y","WALLIS
AND FUTUNA","[email protected]","2452430"
+"75","1888603","143","37730","2451755","2451725","25","5","1925","AAAAAAAALEAAAAAA","Dr.","Annie","Grant","Y","TUVALU","[email protected]","2452401"
+"74","1434225","347","15269","2452641","2452611","19","2","1953","AAAAAAAAKEAAAAAA","Sir","Eric","Woods","Y","SAINT
LUCIA","[email protected]","2452584"
+"73","425740","431","48369","2449133","2449103","17","4","1956","AAAAAAAAJEAAAAAA","Mr.","David","Vasquez","N","ISRAEL","[email protected]","2452489"
+"72","1608738","6364","26390","2451700","2451670","21","3","1937","AAAAAAAAIEAAAAAA","Dr.","Bradley","Barry","Y","TAJIKISTAN","[email protected]","2452601"
+"71","1292064","2257","42450","2450248","2450218","4","11","1967","AAAAAAAAHEAAAAAA","Mr.","Roderick","Rogers","N","OMAN","[email protected]","2452462"
+"70","1460929","5492","48102","2451944","2451914","7","12","1963","AAAAAAAAGEAAAAAA","Sir","James","Smith","N","KUWAIT","[email protected]","2452342"
+"69","971368","4167","9366","2450154","2450124","15","1","1950","AAAAAAAAFEAAAAAA","Sir","Steven","Mcclellan","Y","NEPAL","[email protected]","2452340"
+"68","779965","6069","16126","2451936","2451906","20","8","1928","AAAAAAAAEEAAAAAA","Dr.","Arthur","Troy","Y","LUXEMBOURG","[email protected]","2452542"
+"67","1118294","2032","24970","2452033","2452003","27","10","1948","AAAAAAAADEAAAAAA","Dr.","Gerald","Thomas","N","NORWAY","[email protected]","2452414"
+"66","747190","6036","42882","2449294","2449264","8","9","1950","AAAAAAAACEAAAAAA","Ms.","Julie","Chester","N","HONG
KONG","[email protected]","2452375"
+"65","1778884","2234","37584","2451898","2451868","18","9","1991","AAAAAAAABEAAAAAA","Dr.","Rodney","Taft","N","VIRGIN
ISLANDS, U.S.","[email protected]","2452353"
+"64","1260191","6284","25930","2452379","2452349","27","6","1941","AAAAAAAAAEAAAAAA","Dr.","Michael","Frye","N","CAPE
VERDE","[email protected]","2452426"
+"63","1790374","2445","9716","2450179","2450149","26","4","1943","AAAAAAAAPDAAAAAA","Dr.","Frank","Morton","N","EGYPT","[email protected]","2452425"
+"62","821787","4700","28413","2451854","2451824","1","6","1973","AAAAAAAAODAAAAAA","Mr.","Matthew","Brown","Y","KOREA,
REPUBLIC OF","[email protected]","2452319"
+"61","1620078","6683","11688","2451136","2451106","6","5","1978","AAAAAAAANDAAAAAA","Sir","Joseph","White","Y","SENEGAL","[email protected]","2452462"
+"60","1179671","3200","44282","2449714","2449684","15","7","1990","AAAAAAAAMDAAAAAA","Ms.","Dollie","Thao","N","SWITZERLAND","[email protected]","2452407"
+"59","1895444","4787","45683","2451157","2451127","6","1","1947","AAAAAAAALDAAAAAA","Miss","Melanie","Morrison","N","HUNGARY","[email protected]","2452530"
+"58","528756","6879","14155","2451386","2451356","29","2","1988","AAAAAAAAKDAAAAAA","Mr.","Cecil","Peterman","Y","ICELAND","[email protected]","2452447"
+"57","752932","128","571","2449741","2449711","10","3","1961","AAAAAAAAJDAAAAAA","Mr.","Travis","Melendez","Y","AFGHANISTAN","[email protected]","2452606"
+"56","344460","3092","2524","2451424","2451394","29","1","1960","AAAAAAAAIDAAAAAA","Miss","Pamela","Delgado","N","GUERNSEY","[email protected]","2452334"
+"55","783093","1151","23256","2451539","2451509","12","8","1933","AAAAAAAAHDAAAAAA","Dr.","Beryl","Thomason","N","UNITED
KINGDOM","[email protected]","2452380"
+"54","380102","2381","40660","2449980","2449950","3","2","1940","AAAAAAAAGDAAAAAA","Ms.","Donna","King","Y","TUNISIA","[email protected]","2452446"
+"53","1597348","7017","43439","2451820","2451790","23","9","1950","AAAAAAAAFDAAAAAA","Mr.","Paul","Higgins","Y","GABON","[email protected]","2452447"
+"52","534808","4768","27128","2451421","2451391","1","4","1982","AAAAAAAAEDAAAAAA","Mrs.","Wendy","Colley","N","FRENCH
GUIANA","[email protected]","2452553"
+"51","532799","6920","10688","2452390","2452360","5","10","1926","AAAAAAAADDAAAAAA","Dr.","David","Nieves","N","CHRISTMAS
ISLAND","[email protected]","2452570"
+"50","759177","72","32567","2449384","2449354","24","11","1965","AAAAAAAACDAAAAAA","Mr.","Christopher","Eller","N","AUSTRALIA","[email protected]","2452520"
+"49","936800","1514","20581","2449364","2449334","13","6","1961","AAAAAAAABDAAAAAA","Mr.","Steven","Venable","N","NETHERLANDS
ANTILLES","[email protected]","2452350"
+"48","8817","311","38252","2449531","2449501","15","9","1961","AAAAAAAAADAAAAAA","Ms.","Jill","Jackson","N","LUXEMBOURG","[email protected]","2452575"
+"47","1634314","5368","38469","2449165","2449135","3","12","1982","AAAAAAAAPCAAAAAA","Mr.","Luis","Young","N","BRUNEI
DARUSSALAM","[email protected]","2452586"
+"46","843672","4729","21386","2451857","2451827","13","4","1990","AAAAAAAAOCAAAAAA","Mrs.","Jane","Stephenson","Y","TURKEY","[email protected]","2452301"
+"44","497758","5427","32296","2449750","2449720","7","12","1932","AAAAAAAAMCAAAAAA","Miss","Mabel","Richmond","Y","CAMBODIA","[email protected]","2452333"
+"43","385562","3676","43743","2451705","2451675","5","12","1965","AAAAAAAALCAAAAAA","Mr.","William","Warner","Y","GUAM","[email protected]","2452537"
+"42","1867377","3327","11277","2449869","2449839","17","1","1950","AAAAAAAAKCAAAAAA","Dr.","Deborah","Burton","N","COMOROS","[email protected]","2452498"
+"41","941420","5068","18316","2449989","2449959","26","6","1939","AAAAAAAAJCAAAAAA","Miss","Maxine","Carlson","N","ISLE
OF MAN","[email protected]","2452464"
+"39","1617182","4013","22844","2452131","2452101","14","12","1951","AAAAAAAAHCAAAAAA","Sir","Neil","Cox","N","ECUADOR","[email protected]","2452586"
+"38","766645","3879","36360","2450323","2450293","30","3","1939","AAAAAAAAGCAAAAAA","Mrs.","Ha","Carpenter","Y","PARAGUAY","[email protected]","2452351"
+"37","827972","2281","12943","2449848","2449818","9","1","1949","AAAAAAAAFCAAAAAA","Dr.","Dwight","Schneider","Y","RUSSIAN
FEDERATION","[email protected]","2452293"
+"36","655414","2223","26585","2449222","2449192","29","11","1968","AAAAAAAAECAAAAAA","Dr.","Anthony","Fisher","N","KYRGYZSTAN","[email protected]","2452470"
+"35","339036","2057","32231","2451937","2451907","19","6","1953","AAAAAAAADCAAAAAA","Dr.","Marie","Peterson","N","KIRIBATI","[email protected]","2452581"
+"33","1680761","5823","32438","2451572","2451542","25","3","1958","AAAAAAAABCAAAAAA","Mrs.","Donna","Betts","Y","FRANCE","[email protected]","2452455"
+"32","1369589","6163","48290","2449471","2449441","2","8","1927","AAAAAAAAACAAAAAA","Dr.","Kenneth","Wood","N","MOLDOVA,
REPUBLIC OF","[email protected]","2452510"
+"31","1275120","5724","7128","2452054","2452024","13","6","1964","AAAAAAAAPBAAAAAA","Dr.","William","Craig","N","SPAIN","[email protected]","2452336"
+"30","84232","5869","45459","2449916","2449886","4","7","1956","AAAAAAAAOBAAAAAA","Dr.","Pamela","Luna","Y","GUAM","[email protected]","2452410"
+"29","1634269","1204","44139","2452216","2452186","25","8","1973","AAAAAAAANBAAAAAA","Ms.","Margaret","Collins","Y","NETHERLANDS
ANTILLES","[email protected]","2452496"
+"28","889961","897","33480","2452615","2452585","17","8","1959","AAAAAAAAMBAAAAAA","Miss","Edith","Hernandez","Y","C�TE
D'IVOIRE","[email protected]","2452631"
+"27","111621","835","16096","2450611","2450581","7","3","1972","AAAAAAAALBAAAAAA","Dr.","Shawn","Prather","N","PUERTO
RICO","[email protected]","2452353"
+"26","230278","1242","28206","2449816","2449786","14","6","1991","AAAAAAAAKBAAAAAA","Ms.","Monique","Baker","N","MOROCCO","[email protected]","2452356"
+"25","476176","3278","25933","2449246","2449216","6","10","1973","AAAAAAAAJBAAAAAA","Miss","Nancy","Mccormick","N","BAHAMAS","[email protected]","2452425"
+"24","17113","1102","14291","2450098","2450068","6","6","1951","AAAAAAAAIBAAAAAA","Dr.","Paul","Morris","Y","GUINEA-BISSAU","[email protected]","2452499"
+"22","490494","4504","40467","2451465","2451435","21","12","1991","AAAAAAAAGBAAAAAA","Sir","Victor","Martinez","N","CAYMAN
ISLANDS","[email protected]","2452529"
+"21","442697","6538","25979","2451827","2451797","18","5","1956","AAAAAAAAFBAAAAAA","Miss","Naomi","Barnett","N","BAHAMAS","[email protected]","2452433"
+"20","1185612","89","38966","2450965","2450935","17","5","1976","AAAAAAAAEBAAAAAA","Mr.","Stanton","Dallas","Y","SWITZERLAND","[email protected]","2452334"
+"19","1161742","4238","45581","2449580","2449550","20","10","1978","AAAAAAAADBAAAAAA","Dr.","Andre","Moore","N","NICARAGUA","[email protected]","2452576"
+"18","1361151","6580","18456","2450041","2450011","1","9","1950","AAAAAAAACBAAAAAA","Sir","Brad","Lynch","Y","URUGUAY","[email protected]","2452549"
+"17","707524","3876","2228","2451068","2451038","23","12","1972","AAAAAAAABBAAAAAA","Dr.","Lee","Stovall","N","PHILIPPINES","[email protected]","2452454"
+"16","1196373","3014","29302","2451346","2451316","24","12","1933","AAAAAAAAABAAAAAA","Dr.","Margie","Browning","N","PHILIPPINES","[email protected]","2452573"
+"14","929344","892","6440","2450318","2450288","30","3","1937","AAAAAAAAOAAAAAAA","Mr.","Jack","Wilcox","N","SLOVENIA","[email protected]","2452641"
+"13","1128748","2777","14006","2449658","2449628","1","3","1970","AAAAAAAANAAAAAAA","Mrs.","Rosalinda","Grimes","N","UKRAINE","[email protected]","2452616"
+"12","502141","6577","47366","2451039","2451009","2","6","1956","AAAAAAAAMAAAAAAA","Ms.","Margaret","Farias","N","TURKMENISTAN","[email protected]","2452634"
+"11","1114415","6807","47999","2452288","2452258","18","12","1963","AAAAAAAALAAAAAAA","Ms.","Betty","Williams","N","BURKINA
FASO","[email protected]","2452398"
+"10","1207553","5143","19580","2451353","2451323","15","10","1973","AAAAAAAAKAAAAAAA","Ms.","Albert","Brunson","N","JORDAN","[email protected]","2452641"
+"9","1168667","1404","49388","2452275","2452245","26","10","1966","AAAAAAAAJAAAAAAA","Sir","Karl","Gilbert","N","MONTSERRAT","[email protected]","2452454"
+"8","1215897","2471","16598","2449406","2449376","26","12","1938","AAAAAAAAIAAAAAAA","Sir","Ollie","Shipman","N","KOREA,
REPUBLIC OF","[email protected]","2452334"
+"7","68377","3219","44814","2451438","2451408","24","4","1985","AAAAAAAAHAAAAAAA","Ms.","Fonda","Wiles","Y","GAMBIA","[email protected]","2452360"
+"6","213219","6374","27082","2451883","2451853","4","12","1925","AAAAAAAAGAAAAAAA","Ms.","Brunilda","Sharp","N","SURINAME","[email protected]","2452430"
+"5","953372","4470","36368","2449438","2449408","8","5","1956","AAAAAAAAFAAAAAAA","Sir","Robert","Moran","N","FIJI","[email protected]","2452469"
+"4","1703214","3986","39558","2450030","2450000","7","6","1983","AAAAAAAAEAAAAAAA","Dr.","Michael","White","N","MEXICO","[email protected]","2452361"
+"3","1473522","6247","48572","2449130","2449100","18","9","1979","AAAAAAAADAAAAAAA","Miss","Latisha","Hamilton","N","NIUE","[email protected]","2452313"
+"2","819667","1461","31655","2452318","2452288","9","4","1966","AAAAAAAACAAAAAAA","Dr.","Amy","Moses","Y","TOGO","[email protected]","2452318"
+"1","980124","7135","32946","2452238","2452208","9","12","1936","AAAAAAAABAAAAAAA","Mr.","Javier","Lewis","Y","CHILE","[email protected]","2452508"
