mariosasko commented on PR #33925: URL: https://github.com/apache/arrow/pull/33925#issuecomment-1411183912
@jorisvandenbossche > I noticed that in the HuggingFace Datasets implementation, there is a [comment](https://github.com/huggingface/datasets/blob/5b793dd8c43bf6e85f165238becb3c64f6cd3ed0/src/datasets/features/features.py#L659-L660) about using variable instead of fixed size list array. That is resolved now, and it's fine to use fixed-size lists? Yes, the fixed-sized version seems to work now (requires `pyarrow>=10.0.0` to pass the tests). > I think none of the existing custom tensor extension type implementations have this (eg neither of Ray and HuggingFace Datasets have this. @mariosasko do you know if that has come up in HuggingFace?) No, that has yet to be requested on our side (so not super important for us right now). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
