[jira] [Commented] (ARROW-3399) [Python] Cannot serialize numpy matrix object
[
https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814349#comment-16814349
]
Rok Mihevc commented on ARROW-3399:
---
CI tests now pass, let's discuss if this is a good idea and if implementation
is good enough.
> [Python] Cannot serialize numpy matrix object
> -
>
> Key: ARROW-3399
> URL: https://issues.apache.org/jira/browse/ARROW-3399
> Project: Apache Arrow
> Issue Type: Bug
>Affects Versions: 0.10.0
>Reporter: Mitar
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.14.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> This is a regression from 0.9.0 and happens with 0.10.0 with Python 3.6.5 on
> Linux.
> {code:java}
> from pyarrow import plasma
> import numpy
> import time
> import subprocess
> import os
> import signal
> m = numpy.matrix(numpy.array([[1, 2], [3, 4]]))
> process = subprocess.Popen(['plasma_store', '-m', '100', '-s',
> '/tmp/plasma', '-d', '/dev/shm'], stdout=subprocess.DEVNULL,
> stderr=subprocess.DEVNULL, encoding='utf8', preexec_fn=os.setpgrp)
> time.sleep(5)
> client = plasma.connect('/tmp/plasma', '', 0)
> try:
> client.put(m)
> finally:
> client.disconnect()
> os.killpg(os.getpgid(process.pid), signal.SIGTERM)
> {code}
> Error:
> {noformat}
> File "pyarrow/_plasma.pyx", line 397, in pyarrow._plasma.PlasmaClient.put
> File "pyarrow/serialization.pxi", line 338, in pyarrow.lib.serialize
> File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
> pyarrow.lib.ArrowNotImplementedError: This object exceeds the maximum
> recursion depth. It may contain itself recursively.{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-3399) [Python] Cannot serialize numpy matrix object
[
https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808201#comment-16808201
]
Rok Mihevc commented on ARROW-3399:
---
See [PR|https://github.com/apache/arrow/pull/4096].
> [Python] Cannot serialize numpy matrix object
> -
>
> Key: ARROW-3399
> URL: https://issues.apache.org/jira/browse/ARROW-3399
> Project: Apache Arrow
> Issue Type: Bug
>Affects Versions: 0.10.0
>Reporter: Mitar
>Priority: Major
> Labels: pull-request-available
> Fix For: 0.14.0
>
> Time Spent: 10m
> Remaining Estimate: 0h
>
> This is a regression from 0.9.0 and happens with 0.10.0 with Python 3.6.5 on
> Linux.
> {code:java}
> from pyarrow import plasma
> import numpy
> import time
> import subprocess
> import os
> import signal
> m = numpy.matrix(numpy.array([[1, 2], [3, 4]]))
> process = subprocess.Popen(['plasma_store', '-m', '100', '-s',
> '/tmp/plasma', '-d', '/dev/shm'], stdout=subprocess.DEVNULL,
> stderr=subprocess.DEVNULL, encoding='utf8', preexec_fn=os.setpgrp)
> time.sleep(5)
> client = plasma.connect('/tmp/plasma', '', 0)
> try:
> client.put(m)
> finally:
> client.disconnect()
> os.killpg(os.getpgid(process.pid), signal.SIGTERM)
> {code}
> Error:
> {noformat}
> File "pyarrow/_plasma.pyx", line 397, in pyarrow._plasma.PlasmaClient.put
> File "pyarrow/serialization.pxi", line 338, in pyarrow.lib.serialize
> File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
> pyarrow.lib.ArrowNotImplementedError: This object exceeds the maximum
> recursion depth. It may contain itself recursively.{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-3399) [Python] Cannot serialize numpy matrix object
[
https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807314#comment-16807314
]
Robert Nishihara commented on ARROW-3399:
-
Hi Mitar, can you submit your change as a PR? I suspect some minor
modifications will make it work and it will be easier to comment there. Also
please add a test.
> [Python] Cannot serialize numpy matrix object
> -
>
> Key: ARROW-3399
> URL: https://issues.apache.org/jira/browse/ARROW-3399
> Project: Apache Arrow
> Issue Type: Bug
>Affects Versions: 0.10.0
>Reporter: Mitar
>Priority: Major
> Fix For: 0.14.0
>
>
> This is a regression from 0.9.0 and happens with 0.10.0 with Python 3.6.5 on
> Linux.
> {code:java}
> from pyarrow import plasma
> import numpy
> import time
> import subprocess
> import os
> import signal
> m = numpy.matrix(numpy.array([[1, 2], [3, 4]]))
> process = subprocess.Popen(['plasma_store', '-m', '100', '-s',
> '/tmp/plasma', '-d', '/dev/shm'], stdout=subprocess.DEVNULL,
> stderr=subprocess.DEVNULL, encoding='utf8', preexec_fn=os.setpgrp)
> time.sleep(5)
> client = plasma.connect('/tmp/plasma', '', 0)
> try:
> client.put(m)
> finally:
> client.disconnect()
> os.killpg(os.getpgid(process.pid), signal.SIGTERM)
> {code}
> Error:
> {noformat}
> File "pyarrow/_plasma.pyx", line 397, in pyarrow._plasma.PlasmaClient.put
> File "pyarrow/serialization.pxi", line 338, in pyarrow.lib.serialize
> File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
> pyarrow.lib.ArrowNotImplementedError: This object exceeds the maximum
> recursion depth. It may contain itself recursively.{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (ARROW-3399) [Python] Cannot serialize numpy matrix object
[
https://issues.apache.org/jira/browse/ARROW-3399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806006#comment-16806006
]
Mitar commented on ARROW-3399:
--
This is still happening in 0.12.1.
I think this should be fixed because it will be quite some time before nobody
will be using matrix class anymore, even if it is deprecated.
> [Python] Cannot serialize numpy matrix object
> -
>
> Key: ARROW-3399
> URL: https://issues.apache.org/jira/browse/ARROW-3399
> Project: Apache Arrow
> Issue Type: Bug
>Affects Versions: 0.10.0
>Reporter: Mitar
>Priority: Major
>
> This is a regression from 0.9.0 and happens with 0.10.0 with Python 3.6.5 on
> Linux.
> {code:java}
> from pyarrow import plasma
> import numpy
> import time
> import subprocess
> import os
> import signal
> m = numpy.matrix(numpy.array([[1, 2], [3, 4]]))
> process = subprocess.Popen(['plasma_store', '-m', '100', '-s',
> '/tmp/plasma', '-d', '/dev/shm'], stdout=subprocess.DEVNULL,
> stderr=subprocess.DEVNULL, encoding='utf8', preexec_fn=os.setpgrp)
> time.sleep(5)
> client = plasma.connect('/tmp/plasma', '', 0)
> try:
> client.put(m)
> finally:
> client.disconnect()
> os.killpg(os.getpgid(process.pid), signal.SIGTERM)
> {code}
> Error:
> {noformat}
> File "pyarrow/_plasma.pyx", line 397, in pyarrow._plasma.PlasmaClient.put
> File "pyarrow/serialization.pxi", line 338, in pyarrow.lib.serialize
> File "pyarrow/error.pxi", line 89, in pyarrow.lib.check_status
> pyarrow.lib.ArrowNotImplementedError: This object exceeds the maximum
> recursion depth. It may contain itself recursively.{noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
