Re: [EXTERNAL] Cassandra Export error in COPY command
I tested dsbulk too. But there are many errors: "[1710949318] Error writing cancel request. This is not critical (the request will eventually time out server-side)." "Forcing termination of Connection[/127.0.0.1:9042-14, inFlight=1, closed=true]. This should not happen and is likely a bug, please report." I tried with "--executor.maxPerSecond 1000" and "--driver.socket.readTimeout 3600" options but errors didn't resolve. How can I export a table data? On Mon, Sep 23, 2019 at 6:30 AM Durity, Sean R wrote: > Copy command tries to export all rows in the table, not just the ones on > the node. It will eventually timeout if the table is large. It is really > built for something under 5 million rows or so. Dsbulk (from DataStax) is > great for this, if you are a customer. Otherwise, you will probably need to > write an extract of some kind. You can get keys from the sstables, then > dedupe, then export rows one by one using the keys (kind of painful). How > large is the table you are trying to export? > > > > Sean Durity > > > > *From:* Hossein Ghiyasi Mehr > *Sent:* Saturday, September 21, 2019 8:02 AM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] Cassandra Export error in COPY command > > > > Hi all members, > > I want to export (pk, another_int_column) from single node using COPY > command. But after about 1h 45m, I've got a lot of read errors: > > > > > > I tried this action many times but after maximum 2h, it failed with the > errors. > > > > Any idea may help me! > > Thanks. > > -- > > The information in this Internet Email is confidential and may be legally > privileged. It is intended solely for the addressee. Access to this Email > by anyone else is unauthorized. If you are not the intended recipient, any > disclosure, copying, distribution or any action taken or omitted to be > taken in reliance on it, is prohibited and may be unlawful. When addressed > to our clients any opinions or advice contained in this Email are subject > to the terms and conditions expressed in any applicable governing The Home > Depot terms of business or client engagement letter. The Home Depot > disclaims all responsibility and liability for the accuracy and content of > this attachment and for any damages or losses arising from any > inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other > items of a destructive nature, which may be contained in this attachment > and shall not be liable for direct, indirect, consequential or special > damages in connection with this e-mail message or its attachment. >
Re: [EXTERNAL] Cassandra Export error in COPY command
The table has more than 10 M rows. I used COPY command in a cluster with five machine for this table and everything was OK. I took a backup to a single machine using sstableloader. Now I want to extract rows using COPY command but I can't! On Mon, Sep 23, 2019 at 6:30 AM Durity, Sean R wrote: > Copy command tries to export all rows in the table, not just the ones on > the node. It will eventually timeout if the table is large. It is really > built for something under 5 million rows or so. Dsbulk (from DataStax) is > great for this, if you are a customer. Otherwise, you will probably need to > write an extract of some kind. You can get keys from the sstables, then > dedupe, then export rows one by one using the keys (kind of painful). How > large is the table you are trying to export? > > > > Sean Durity > > > > *From:* Hossein Ghiyasi Mehr > *Sent:* Saturday, September 21, 2019 8:02 AM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] Cassandra Export error in COPY command > > > > Hi all members, > > I want to export (pk, another_int_column) from single node using COPY > command. But after about 1h 45m, I've got a lot of read errors: > > > > > > I tried this action many times but after maximum 2h, it failed with the > errors. > > > > Any idea may help me! > > Thanks. > > -- > > The information in this Internet Email is confidential and may be legally > privileged. It is intended solely for the addressee. Access to this Email > by anyone else is unauthorized. If you are not the intended recipient, any > disclosure, copying, distribution or any action taken or omitted to be > taken in reliance on it, is prohibited and may be unlawful. When addressed > to our clients any opinions or advice contained in this Email are subject > to the terms and conditions expressed in any applicable governing The Home > Depot terms of business or client engagement letter. The Home Depot > disclaims all responsibility and liability for the accuracy and content of > this attachment and for any damages or losses arising from any > inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other > items of a destructive nature, which may be contained in this attachment > and shall not be liable for direct, indirect, consequential or special > damages in connection with this e-mail message or its attachment. >
RE: [EXTERNAL] Cassandra Export error in COPY command
Copy command tries to export all rows in the table, not just the ones on the node. It will eventually timeout if the table is large. It is really built for something under 5 million rows or so. Dsbulk (from DataStax) is great for this, if you are a customer. Otherwise, you will probably need to write an extract of some kind. You can get keys from the sstables, then dedupe, then export rows one by one using the keys (kind of painful). How large is the table you are trying to export? Sean Durity From: Hossein Ghiyasi Mehr Sent: Saturday, September 21, 2019 8:02 AM To: user@cassandra.apache.org Subject: [EXTERNAL] Cassandra Export error in COPY command Hi all members, I want to export (pk, another_int_column) from single node using COPY command. But after about 1h 45m, I've got a lot of read errors: [cid:image002.png@01D57199.74B91800] I tried this action many times but after maximum 2h, it failed with the errors. Any idea may help me! Thanks. The information in this Internet Email is confidential and may be legally privileged. It is intended solely for the addressee. Access to this Email by anyone else is unauthorized. If you are not the intended recipient, any disclosure, copying, distribution or any action taken or omitted to be taken in reliance on it, is prohibited and may be unlawful. When addressed to our clients any opinions or advice contained in this Email are subject to the terms and conditions expressed in any applicable governing The Home Depot terms of business or client engagement letter. The Home Depot disclaims all responsibility and liability for the accuracy and content of this attachment and for any damages or losses arising from any inaccuracies, errors, viruses, e.g., worms, trojan horses, etc., or other items of a destructive nature, which may be contained in this attachment and shall not be liable for direct, indirect, consequential or special damages in connection with this e-mail message or its attachment.
