[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-19 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16933897#comment-16933897 ] Wes McKinney commented on ARROW-1664: - I don't think that xarray is compatible with the Arrow

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932827#comment-16932827 ] Joris Van den Bossche commented on ARROW-1664: -- In general, xarray datasets/dataarrays do

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932813#comment-16932813 ] Antoine Pitrou commented on ARROW-1664: --- Ah, perhaps at some point we want to define a PyArrow

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Mitar (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932797#comment-16932797 ] Mitar commented on ARROW-1664: -- It is like extension of DataFrame to multiple dimensions. {quote}Xarray

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932790#comment-16932790 ] Antoine Pitrou commented on ARROW-1664: --- Does xarray have a Table-like or DataFrame-like concept?

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Mitar (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932788#comment-16932788 ] Mitar commented on ARROW-1664: -- I see. So why not also have then `pa.Table.from_xarray`? > [Python] Support

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932688#comment-16932688 ] Antoine Pitrou commented on ARROW-1664: --- > There is no special handling of Pandas DataFrame in

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Mitar (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932670#comment-16932670 ] Mitar commented on ARROW-1664: -- Nice. And so Arrow support for Pandas DataFrame is only through:

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932629#comment-16932629 ] Antoine Pitrou commented on ARROW-1664: --- In ARROW-3829 we added a Python protocol to allow

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932630#comment-16932630 ] Antoine Pitrou commented on ARROW-1664: --- See example in the PR:

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Mitar (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932606#comment-16932606 ] Mitar commented on ARROW-1664: -- As [~wesmckinn]  wrote: the idea is to get zero-copy reads. So serializing

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2019-09-18 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932601#comment-16932601 ] Antoine Pitrou commented on ARROW-1664: --- I'm not sure what the exact request is here. The way to

[jira] [Commented] (ARROW-1664) [Python] Support for xarray.DataArray and xarray.Dataset

2018-11-10 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16682614#comment-16682614 ] Wes McKinney commented on ARROW-1664: - You should be able to write serializers for use with