Thanks! I will keep an eye on the repository. -Anuj
From: Ted Gooch <[email protected]> Reply-To: "[email protected]" <[email protected]> Date: Monday, April 1, 2019 at 8:43 AM To: "[email protected]" <[email protected]> Subject: Re: Examples on the Python support? No hard deadline yet, but it's high priority for me and some others here at Netflix. I'm just getting back to the office after being out for a couple of days, but I'll plan on updating this thread with an example script sometime today. On Sat, Mar 30, 2019, 11:51 PM Anuj Shah <[email protected]> wrote: Hi Ted, That sounds interesting. When can we expect the PR for reading iceberg dataset? Any ETA for it? Thanks, Anun Get Outlook for iOS<https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Faka.ms%2Fo0ukef&data=02%7C01%7Canushah%40adobe.com%7C0f5435cc931e4e1803b508d6b6b8be0a%7Cfa7b1b5a7b34438794aed2c178decee1%7C0%7C0%7C636897301917200471&sdata=PeSnYt90gq1CX9sR83KePTDphVSHfXRveySrLySKZSU%3D&reserved=0> ________________________________ From: Ted Gooch <[email protected]> Sent: Saturday, March 30, 2019 8:07 AM To: [email protected]<mailto:[email protected]> Subject: Re: Examples on the Python support? As Dan mentioned, the read path hasn't been implemented yet. We are in the process of building out the read path and will open a PR as soon as it's ready. We primarily use parquet and that will definitely be included. For now, the library's main functionality is reading the metadata. I'll put together an example script on how metadata reads work in the current implementation. -Ted On Fri, Mar 29, 2019, 3:56 PM Anuj Shah <[email protected]> wrote: Hi Daniel, I am trying to read parquet files. Thanks, Anuj From: Daniel Weeks <[email protected]<mailto:[email protected]>> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Friday, March 29, 2019 at 3:38 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Re: Examples on the Python support? Anuj, The current implementation of the python library supports accessing iceberg metadata (schema, etc) and scanning manifests, but does not include a read path. What types of files are you looking to read (parquet, avro, etc.)? -Dan On Fri, Mar 29, 2019, 10:38 AM Anuj Shah <[email protected]> wrote: Hi All, Any thoughts on the query below? 1. Would I be able to read the iceberg dataset? If not, what contributions need to be done? I am happy to contribute. Thanks, Anuj From: Anuj Shah <[email protected]> Reply-To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Date: Monday, March 25, 2019 at 4:39 PM To: "[email protected]<mailto:[email protected]>" <[email protected]<mailto:[email protected]>> Subject: Examples on the Python support? Hi All, I am interested in Ted Gooch (TGooch44) contributed python support for iceberg. I was looking at the code and wanted to try it out myself, for starter do you have any examples for it? Like reading and writing iceberg dataset? Thanks, Anuj
