Re: Parquet binary files in the code-base
They are used as input files for external datasets On Wed, Sep 23, 2020, 09:24 Wail Alkowaileet wrote: > They are used for the integration test. > > On Tue, Sep 22, 2020, 22:44 Till Westmann wrote: > >> Hi Wail, >> >> Could you provide a bit of context how those binary files are used? >> >> Cheers, >> Till >> >> On 23 Sep 2020, at 0:24, Ian Maxon wrote: >> >> > I think generally we try to avoid it where possible but it's hard to >> > sometimes. IMO, as long as the file is small and changes very rarely, >> > it's fine. >> > If it's not maybe there's some way to generate it on the fly from a >> > textual representation? >> > >> > On Tue, Sep 22, 2020 at 2:35 PM Wail Alkowaileet >> > wrote: >> >> >> >> Devs, >> >> >> >> Is it ok to have binary files (parquet files) as part of the >> >> code-base? >> >> >> >> -- >> >> >> >> *Regards,* >> >> Wail Alkowaileet >> >
Re: Parquet binary files in the code-base
They are used for the integration test. On Tue, Sep 22, 2020, 22:44 Till Westmann wrote: > Hi Wail, > > Could you provide a bit of context how those binary files are used? > > Cheers, > Till > > On 23 Sep 2020, at 0:24, Ian Maxon wrote: > > > I think generally we try to avoid it where possible but it's hard to > > sometimes. IMO, as long as the file is small and changes very rarely, > > it's fine. > > If it's not maybe there's some way to generate it on the fly from a > > textual representation? > > > > On Tue, Sep 22, 2020 at 2:35 PM Wail Alkowaileet > > wrote: > >> > >> Devs, > >> > >> Is it ok to have binary files (parquet files) as part of the > >> code-base? > >> > >> -- > >> > >> *Regards,* > >> Wail Alkowaileet >
Re: Parquet binary files in the code-base
I think generally we try to avoid it where possible but it's hard to sometimes. IMO, as long as the file is small and changes very rarely, it's fine. If it's not maybe there's some way to generate it on the fly from a textual representation? On Tue, Sep 22, 2020 at 2:35 PM Wail Alkowaileet wrote: > > Devs, > > Is it ok to have binary files (parquet files) as part of the code-base? > > -- > > *Regards,* > Wail Alkowaileet
Parquet binary files in the code-base
Devs, Is it ok to have binary files (parquet files) as part of the code-base? -- *Regards,* Wail Alkowaileet