I don't know the support for the compression codecs in Javascript, but i
don't think anyone has attempted to implement them.

I couldn't find the compression feature listed on the library status docs
[1].

But we should add a line item for it.  Today, I think only C++ (and
libraries that bind to it) have compression implemented.  I think a new PR
for java was just opened in the last few days.

[1] https://arrow.apache.org/docs/status.html

On Thu, Dec 17, 2020 at 10:10 AM Andrew Clancy <[email protected]> wrote:

> So, I figured out the issue here - I had to remove compression from the
> pyarrow feather.write_feather(compression='uncompressed'). Is there any
> way to read a compressed feather file in arrow js?
> See the comment under the first answer here:
> https://stackoverflow.com/questions/64629670/how-to-write-a-pandas-dataframe-to-arrow-file/64648955#64648955
> I couldn't find anything in the arrow docs or notebooks on this - I'm
> assuming that's related to javascript compression libraries being so
> limited.
>
>
> On Mon, 14 Dec 2020 at 21:32, Andrew Clancy <[email protected]> wrote:
>
>> Hi all,
>>
>> I have a simple feather file created via a pandas to_feather with a
>> datetime64[ns] column, and cannot get timestamps in javascript
>> [email protected]
>>
>> See this notebook:
>> https://observablehq.com/@nite/apache-arrow-timestamp-investigation
>>
>> I'm guessing I'm missing something, has anyone got any suggestions, or
>> decent examples of reading a file created in pandas? I've seen in examples
>> of [email protected] where dates stored as an array of 2 ints.
>>
>> File was created with:
>>
>> import pandas as pd
>> pd.read_parquet('sample.parquet')
>> df.to_feather('sample-seconds.feather')
>>
>> Final Q: I'm assuming this is the best place for this question? Happy to
>> post elsewhere if there's any other forums, or if this should be a JIRA
>> ticket?
>>
>> Thanks!
>> Andy
>>
>

Reply via email to