Re: Parquet binary files in the code-base

2020-09-23 Thread Wail Alkowaileet
They are used as input files for external datasets On Wed, Sep 23, 2020, 09:24 Wail Alkowaileet wrote: > They are used for the integration test. > > On Tue, Sep 22, 2020, 22:44 Till Westmann wrote: > >> Hi Wail, >> >> Could you provide a bit of context how those binary files are used? >> >>

Re: Parquet binary files in the code-base

2020-09-23 Thread Wail Alkowaileet
They are used for the integration test. On Tue, Sep 22, 2020, 22:44 Till Westmann wrote: > Hi Wail, > > Could you provide a bit of context how those binary files are used? > > Cheers, > Till > > On 23 Sep 2020, at 0:24, Ian Maxon wrote: > > > I think generally we try to avoid it where possible

Re: Parquet binary files in the code-base

2020-09-22 Thread Ian Maxon
I think generally we try to avoid it where possible but it's hard to sometimes. IMO, as long as the file is small and changes very rarely, it's fine. If it's not maybe there's some way to generate it on the fly from a textual representation? On Tue, Sep 22, 2020 at 2:35 PM Wail Alkowaileet

Parquet binary files in the code-base

2020-09-22 Thread Wail Alkowaileet
Devs, Is it ok to have binary files (parquet files) as part of the code-base? -- *Regards,* Wail Alkowaileet