Re: SSTableloader questions

2020-11-12 Thread Erick Ramirez
> > Can the sstableloader job run from outside a Cassandra node? or it has to > be run from inside Cassandra node. > Yes, I'm a fan of running sstableloader on a server that is not one of the nodes in the cluster. You can maximise the throughput by running multiple instances of sstableloader loadi

Re: SSTableloader questions

2020-11-12 Thread Jai Bheemsen Rao Dhanwada
Hello Erick, I have one more question. Can the sstableloader job run from outside a Cassandra node? or it has to be run from inside Cassandra node. When I tried it from the cassandra node it worked but when I try to run it from outside the cassandra cluster(a standalone machine which doesn't hav

Re: SSTableloader questions

2020-11-09 Thread Jai Bheemsen Rao Dhanwada
Thanks Erick, I will go through the posts and get back if I have any questions. On Mon, Nov 9, 2020 at 1:58 PM Erick Ramirez wrote: > A few months ago, I was asked a similar question so I wrote instructions > for this. It depends on whether the clusters are identical or not. The > posts define w

Re: SSTableloader questions

2020-11-09 Thread Erick Ramirez
A few months ago, I was asked a similar question so I wrote instructions for this. It depends on whether the clusters are identical or not. The posts define what "identical" means. If the source and target cluster are identical in configuration, follow the procedure here -- https://community.datas

Re: sstableloader - warning vs. failure?

2020-02-07 Thread James A. Robinson
Ok, thanks very much the answer! On Fri, Feb 7, 2020 at 9:00 PM Erick Ramirez wrote: > INFO [pool-1-thread-4] 2020-02-08 01:35:37,946 NoSpamLogger.java:91 - >> Maximum memory usage reached (536870912), cannot allocate chunk of 1048576 >> > > The message gets logged when SSTables are being cache

Re: sstableloader - warning vs. failure?

2020-02-07 Thread Erick Ramirez
> > INFO [pool-1-thread-4] 2020-02-08 01:35:37,946 NoSpamLogger.java:91 - > Maximum memory usage reached (536870912), cannot allocate chunk of 1048576 > The message gets logged when SSTables are being cached and the cache fills up faster than objects are evicted from it. Note that the message is

Re: sstableloader: How much does it actually need?

2020-02-07 Thread Reid Pinchback
ndra.apache.org" Subject: Re: sstableloader: How much does it actually need? Message from External Sender Yes you will have all the data in two nodes provided there is no mutation drop at node level or data is repaired For example if you data A,B,C and D. with RF=3 and 4 nodes (node1, nod

Re: sstableloader: How much does it actually need?

2020-02-06 Thread manish khandelwal
Yes you will have all the data in two nodes provided there is no mutation drop at node level or data is repaired For example if you data A,B,C and D. with RF=3 and 4 nodes (node1, node2, node3 and node4) Data A is in node1, node2 and node3 Data B is in node2, node3, and node4 Data C is in node3,

Re: sstableloader: How much does it actually need?

2020-02-06 Thread Voytek Jarnot
Been thinking about it, and I can't really see how with 4 nodes and RF=3, any 2 nodes would *not* have all the data; but am more than willing to learn. On the other thing: that's an attractive option, but in our case, the target cluster will likely come into use before the source-cluster data is a

Re: sstableloader: How much does it actually need?

2020-02-05 Thread Erick Ramirez
> > Another option is the DSE-bulk loader but it will require to convert to > csv/json (good option if you don't like to play with sstableloader and deal > to get all the sstables from all the nodes) > https://docs.datastax.com/en/dsbulk/doc/index.html > Thanks, Sergio. The DataStax Bulk Loader wa

Re: sstableloader: How much does it actually need?

2020-02-05 Thread Dor Laor
Another option is to use the Spark migrator, it reads a source CQL cluster and writes to another. It has a validation stage that compares a full scan and reports the diff: https://github.com/scylladb/scylla-migrator There are many more ways to clone a cluster. My main recommendation is to 'optimiz

Re: sstableloader: How much does it actually need?

2020-02-05 Thread Sergio
Another option is the DSE-bulk loader but it will require to convert to csv/json (good option if you don't like to play with sstableloader and deal to get all the sstables from all the nodes) https://docs.datastax.com/en/dsbulk/doc/index.html Cheers Sergio Il giorno mer 5 feb 2020 alle ore 16:56

Re: sstableloader: How much does it actually need?

2020-02-05 Thread Erick Ramirez
Unfortunately, there isn't a guarantee that 2 nodes alone will have the full copy of data. I'd rather not say "it depends". 😁 TIP: If the nodes in the target cluster have identical tokens allocated, you can just do a straight copy of the sstables node-for-node then do nodetool refresh. If the targ

Re: [EXTERNAL] Re: sstableloader & num_tokens change

2020-01-27 Thread Voytek Jarnot
; > > Sean Durity – Staff Systems Engineer, Cassandra > > > > *From:* Erick Ramirez > *Sent:* Friday, January 24, 2020 11:03 PM > *To:* user@cassandra.apache.org > *Subject:* [EXTERNAL] Re: sstableloader & num_tokens change > > > > > > If I may just

RE: [EXTERNAL] Re: sstableloader & num_tokens change

2020-01-27 Thread Durity, Sean R
original data size (or, origin RF * target RF), until compaction can run. Sean Durity – Staff Systems Engineer, Cassandra From: Erick Ramirez Sent: Friday, January 24, 2020 11:03 PM To: user@cassandra.apache.org Subject: [EXTERNAL] Re: sstableloader & num_tokens change If I may just loop this

Re: sstableloader & num_tokens change

2020-01-27 Thread Jean Carlo
Hello Concerning the original question, I agreed with @eric_ramirez, sstableloader is transparent for token allocation number. just for info @voytek, check this post out https://thelastpickle.com/blog/2019/02/21/set-up-a-cluster-with-even-token-distribution.html You lay be interested to now if yo

Re: sstableloader & num_tokens change

2020-01-24 Thread Erick Ramirez
On the subject of DSBulk, sstableloader is the tool of choice for this scenario. +1 to Sergio and I'm confirming that DSBulk is designed as a bulk loader for CSV/JSON formats. Cheers!

Re: sstableloader & num_tokens change

2020-01-24 Thread Erick Ramirez
> If I may just loop this back to the question at hand: > > I'm curious if there are any gotchas with using sstableloader to restore > snapshots taken from 256-token nodes into a cluster with 32-token (or your > preferred number of tokens) nodes (otherwise same # of nodes and same RF). > No, there

Re: sstableloader & num_tokens change

2020-01-24 Thread Voytek Jarnot
If I may just loop this back to the question at hand: I'm curious if there are any gotchas with using sstableloader to restore snapshots taken from 256-token nodes into a cluster with 32-token (or your preferred number of tokens) nodes (otherwise same # of nodes and same RF). On Fri, Jan 24, 2020

Re: sstableloader & num_tokens change

2020-01-24 Thread Sergio
https://docs.datastax.com/en/dsbulk/doc/dsbulk/reference/dsbulkLoad.html Just skimming through the docs I see examples by loading from CSV / JSON Maybe there is some other command or doc page that I am missing On Fri, Jan 24, 2020, 9:10 AM Nitan Kainth wrote: > Dsbulk works same as sstable

Re: sstableloader & num_tokens change

2020-01-24 Thread Nitan Kainth
Dsbulk works same as sstableloder. Regards, Nitan Cell: 510 449 9629 > On Jan 24, 2020, at 10:40 AM, Sergio wrote: > >  > I was wondering if that improvement for token allocation would work even with > just one rack. It should but I am not sure. > > Does Dsbulk support migration cluster to

Re: sstableloader & num_tokens change

2020-01-24 Thread Voytek Jarnot
Why? Seems to me that the old Cassandra -> CSV/JSON and CSV/JSON -> new Cassandra are unnecessary steps in my case. On Fri, Jan 24, 2020 at 10:34 AM Nitan Kainth wrote: > Instead of sstableloader consider dsbulk by datastax. > > On Fri, Jan 24, 2020 at 10:20 AM Reid Pinchback < > rpinchb...@trip

Re: sstableloader & num_tokens change

2020-01-24 Thread Sergio
I was wondering if that improvement for token allocation would work even with just one rack. It should but I am not sure. Does Dsbulk support migration cluster to cluster without CSV or JSON export? Thanks and Regards On Fri, Jan 24, 2020, 8:34 AM Nitan Kainth wrote: > Instead of sstableloader

Re: sstableloader & num_tokens change

2020-01-24 Thread Nitan Kainth
Instead of sstableloader consider dsbulk by datastax. On Fri, Jan 24, 2020 at 10:20 AM Reid Pinchback wrote: > Jon Haddad has previously made the case for num_tokens=4. His Accelerate > 2019 talk is available at: > > > > https://www.youtube.com/watch?v=swL7bCnolkU > > > > You might want to chec

Re: sstableloader & num_tokens change

2020-01-24 Thread Reid Pinchback
Jon Haddad has previously made the case for num_tokens=4. His Accelerate 2019 talk is available at: https://www.youtube.com/watch?v=swL7bCnolkU You might want to check that out. Also I think the amount of effort you put into evening out the token distribution increases as vnode count shrinks.

Re: [EXTERNAL] Re: Sstableloader

2019-05-30 Thread Goetz, Anthony
: Anthony Goetz Subject: [EXTERNAL] Re: Sstableloader Thank you Anthony and Jonathan. To add new ring it doesn't have to be same version of Cassandra right. For ex dse 5.12 which is 3.11.0 has stables with mc name and apache 3.11.3 also uses sstables name with mc . We should be still able to add

Re: Sstableloader

2019-05-30 Thread Rahul Reddy
SE DC > > > > Note: OpsCenter will stop working once you add OSS nodes. > > > > *From: *Jonathan Koppenhofer > *Reply-To: *Cassandra User List > *Date: *Wednesday, May 29, 2019 at 6:45 PM > *To: *Cassandra User List > *Subject: *[EXTERNAL] Re: Sstableloader &

Re: Sstableloader

2019-05-29 Thread Patrick Lee
add OSS nodes. > > > > *From: *Jonathan Koppenhofer > *Reply-To: *Cassandra User List > *Date: *Wednesday, May 29, 2019 at 6:45 PM > *To: *Cassandra User List > *Subject: *[EXTERNAL] Re: Sstableloader > > > > Has anyone tried to do a DC switch as a means to migra

Re: Sstableloader

2019-05-29 Thread Goetz, Anthony
User List Date: Wednesday, May 29, 2019 at 6:45 PM To: Cassandra User List Subject: [EXTERNAL] Re: Sstableloader Has anyone tried to do a DC switch as a means to migrate from Datastax to OSS? This would be the safest route as the ability to revert back to Datastax is easy. However, I'm curiou

Re: Sstableloader

2019-05-29 Thread Jonathan Koppenhofer
Has anyone tried to do a DC switch as a means to migrate from Datastax to OSS? This would be the safest route as the ability to revert back to Datastax is easy. However, I'm curious how the dse_system keyspace would be replicated to OSS using their custom Everywhere strategy. You may have to change

Re: Sstableloader

2019-05-29 Thread Nitan Kainth
If cassandra version is same, it should work Regards, Nitan Cell: 510 449 9629 > On May 28, 2019, at 4:21 PM, Rahul Reddy wrote: > > Hello, > > Does sstableloader works between datastax and Apache cassandra. I'm trying to > migrate dse 5.0.7 to Apache 3.11.1 ?

Re: Sstableloader

2019-05-29 Thread Alain RODRIGUEZ
Hello, I can't answer this question about the sstableloader (even though I think it should be ok). My understanding, even though I'm not really up to date with latest Datastax work, is that DSE uses a modified but compatible version of Cassandra, for everything that is not 'DSE feature' specifical

Re: sstableloader from dse 4.8.4 to apache cassandra 3.11.1

2018-06-19 Thread rajpal reddy
Never mind found it. its not a supported version. > On Jun 19, 2018, at 2:41 PM, rajpal reddy wrote: > > > Hello, > > I’m trying to use sstablloader from dse 4.8.4( 2.1.12) to apache 3.11.1, i’m > getting below error. but works fine when i use stableloader dse 5.1.2(apache > 3.11.0) > Could

Re: SSTableLoader Question

2018-02-19 Thread shalom sagges
Sounds good. Thanks for the explanation! On Sun, Feb 18, 2018 at 5:15 PM, Rahul Singh wrote: > If you don’t have access to the file you don’t have access to the file. > I’ve seen this issue several times. It’s he easiest low hanging fruit to > resolve. So figure it out and make sure that it’s C

Re: SSTableLoader Question

2018-02-18 Thread Rahul Singh
If you don’t have access to the file you don’t have access to the file. I’ve seen this issue several times. It’s he easiest low hanging fruit to resolve. So figure it out and make sure that it’s Cassandra.Cassandra from root to he Data folder and either run as root or sudo it. If it’s compacted

Re: SSTableLoader Question

2018-02-18 Thread shalom sagges
Not really sure with which user I ran it (root or cassandra), although I don't understand why a permission issue will generate a File not Found exception? And in general, what if a file is being streamed and got compacted before the streaming ended. Does Cassandra know how to handle this? Thanks!

Re: SSTableLoader Question

2018-02-18 Thread Rahul Singh
Check permissions maybe? Who owns the files vs. who is running sstableloader. -- Rahul Singh rahul.si...@anant.us Anant Corporation On Feb 18, 2018, 4:26 AM -0500, shalom sagges , wrote: > Hi All, > > C* version 2.0.14. > > I was loading some data to another cluster using SSTableLoader. The stre

Re: sstableloader making no progress

2017-02-14 Thread Simone Franzini
Adding to the above, each host shows the following log messages that, despite being at INFO level, appear like stack traces to me: 2017-02-13 15:09:22,166 INFO [STREAM-INIT-/10.128.X.Y:60306] StreamResultFuture.java:116 - [Stream #afe548d0-f230-11e6-bc5d-8f99f25bfcf7, ID#0] Received streaming pl

Re: [Marketing Mail] Re: [Marketing Mail] Re: sstableloader question

2016-10-12 Thread Osman YOZGATLIOGLU
Hello, It's about 2500 sstables worth 25TB of data. -t parameter doesn't change -t 1000 and -t 1 Most probably I face some limitation at target cluster. I'm preparing to split sstables and run up to ten parallel sstableloader sessions. Regards, Osman On 11-10-2016 21:46, Rajath Subramanyam

Re: [Marketing Mail] Re: sstableloader question

2016-10-11 Thread Rajath Subramanyam
How many sstables are you trying to load ? Running sstableloaders in parallel will help. Did you try setting the "-t" parameter and see if you are getting the expected throughput ? - Rajath Rajath Subramanyam On Mon, Oct 10, 2016 at 2:02 PM, Osman YOZGATLIOGLU < osman.y

Re: [Marketing Mail] Re: sstableloader question

2016-10-10 Thread Osman YOZGATLIOGLU
Hello, Thank you Adam and Rajath. I'll split input sstables and run parallel jobs for each. I tested this approach and run 3 parallel sstableloader job without -t parameter. I raised stream_throughput_outbound_megabits_per_sec parameter from 200 to 600 Mbit/sec at all of target nodes. But each

Re: sstableloader question

2016-10-10 Thread Rajath Subramanyam
Hi Osman, You cannot restart the streaming only to the failed nodes specifically. You can restart the sstableloader job itself. Compaction will eventually take care of the redundant rows. - Rajath Rajath Subramanyam On Sun, Oct 9, 2016 at 7:38 PM, Adam Hutson wrote:

Re: sstableloader question

2016-10-09 Thread Adam Hutson
It'll start over from the beginning. On Sunday, October 9, 2016, Osman YOZGATLIOGLU < osman.yozgatlio...@krontech.com> wrote: > Hello, > > I have running a sstableloader job. > Unfortunately some of nodes restarted since beginnig streaming. > I see streaming stop for those nodes. > Can I restart

Re: sstableloader

2016-08-17 Thread Jean Tremblay
Thank you for your answer Kai. On 17 Aug 2016, at 11:34 , Kai Wang mailto:dep...@gmail.com>> wrote: yes, you are correct. On Tue, Aug 16, 2016 at 2:37 PM, Jean Tremblay mailto:jean.tremb...@zen-innovations.com>> wrote: Hi, I’m using Cassandra 3.7. In the documentation for sstableloader I re

Re: sstableloader

2016-08-17 Thread Kai Wang
yes, you are correct. On Tue, Aug 16, 2016 at 2:37 PM, Jean Tremblay < jean.tremb...@zen-innovations.com> wrote: > Hi, > > I’m using Cassandra 3.7. > > In the documentation for sstableloader I read the following: > > << Note: To get the best throughput from SSTable loading, you can use > multiple

Re: sstableloader: Stream failed

2016-05-23 Thread Ralf Steppacher
Thanks for the hint! Indeed I could not telnet to the host. It was the listen_address that was not properly configured. Thanks again! Ralf > On 23.05.2016, at 21:01, Paulo Motta wrote: > > Can you telnet 10.211.55.8 7000? This is the port used for streaming > communication with the destinati

Re: sstableloader: Stream failed

2016-05-23 Thread Paulo Motta
Can you telnet 10.211.55.8 7000? This is the port used for streaming communication with the destination node. If not you should check what is the configured storage_port in the destination node and set that in the cassandra.yaml of the source node so it's picked up by sstableloader. 2016-05-23 10

Re: sstableloader throughput

2016-01-11 Thread Noorul Islam Kamal Malmiyoda
On Mon, Jan 11, 2016 at 10:25 PM, Jeff Jirsa wrote: > > Make sure streaming throughput isn’t throttled on the destination cluster. > How do I do that? Is stream_throughput_outbound_megabits_per_sec the attribute in cassandra.yaml. I think we can set that on the fly using nodetool setstreamthrou

Re: sstableloader throughput

2016-01-11 Thread Jeff Jirsa
Make sure streaming throughput isn’t throttled on the destination cluster. Stream from more machines (divide sstables between a bunch of machines, run in parallel). On 1/11/16, 5:21 AM, "Noorul Islam K M" wrote: > >I have a need to stream data to new cluster using sstableloader. I >spa

Re: sstableloader in version 2.0.14 doesn't honor thrift_framed_transport_size_in_mb set on server side

2015-08-14 Thread Prem Yadav
We had this issue when using hive on cassandra. We had to replace the thrift jar with our own patches. On Fri, Aug 14, 2015 at 5:27 PM, K F wrote: > While using sstableloader in 2.0.14 we have discovered that setting > the thrift_framed_transport_size_in_mb to 16 in cassandra.yaml doesn't > hono

Re: sstableloader "Could not retrieve endpoint ranges"

2015-06-26 Thread Mitch Gitman
I want to follow up on this thread to describe what I was able to get working. My goal was to switch a cluster to vnodes, in the process preserving the data for a single table, endpoints.endpoint_messages. Otherwise, I could afford to start from a clean slate. As should be apparent, I could also af

Re: sstableloader "Could not retrieve endpoint ranges"

2015-06-19 Thread Mitch Gitman
I checked the system.log for the Cassandra node that I did the jconsole JMX session against and which had the data to load. Lot of log output indicating that it's busy loading the files. Lot of stacktraces indicating a broken pipe. I have no reason to believe there are connectivity issues between t

Re: sstableloader "Could not retrieve endpoint ranges"

2015-06-19 Thread Mitch Gitman
Fabien, thanks for the reply. We do have Thrift enabled. From what I can tell, the "Could not retrieve endpoint ranges:" crops up under various circumstances. >From further reading on sstableloader, it occurred to me that it might be a safer bet to use the JMX StorageService bulkLoad command, cons

Re: sstableloader "Could not retrieve endpoint ranges"

2015-06-19 Thread Fabien Rousseau
Hi, I already got this error on a 2.1 clusters because thrift was disabled. So you should check that thrift is enabled and accessible from the sstableloader process. Hope this help Fabien Le 19 juin 2015 05:44, "Mitch Gitman" a Ʃcrit : > I'm using sstableloader to bulk-load a table from one cl

Re: sstableloader usage doubts

2015-06-09 Thread Robert Coli
On Tue, Jun 9, 2015 at 1:48 AM, ZeroUno wrote: > As far as I read from the docs, bootstrapping happens when adding a new > node to the cluster, but in my situation the nodes already exist, I'm only > adding data back into them. > If you don't have the contents of the system keyspace, there is a

Re: sstableloader usage doubts

2015-06-09 Thread ZeroUno
Il 08/06/15 20:11, Robert Coli ha scritto: On Mon, Jun 8, 2015 at 6:58 AM, ZeroUno mailto:zerozerouno...@gmail.com>> wrote: So... if I stop the two nodes on the first DC, restore their sstables' files, and then restart the nodes, nothing else needs to be done on the first DC? Be ca

Re: sstableloader usage doubts

2015-06-08 Thread Robert Coli
On Mon, Jun 8, 2015 at 6:58 AM, ZeroUno wrote: > So you mean that "refresh" needs to be used if the cluster is running, but > if I stopped cassandra while copying the sstables then refresh is useless? > So the error "No new SSTables were found" during my refresh attempt is due > to the fact that

Re: sstableloader usage doubts

2015-06-08 Thread ZeroUno
Il 05/06/15 22:40, Robert Coli ha scritto: On Fri, Jun 5, 2015 at 7:53 AM, Sebastian Estevez mailto:sebastian.este...@datastax.com>> wrote: Since you only restored one dc's sstables, you should be able to rebuild them on the second DC. Refresh means pick up new SSTables that have b

Re: sstableloader usage doubts

2015-06-05 Thread Robert Coli
On Fri, Jun 5, 2015 at 7:53 AM, Sebastian Estevez < sebastian.este...@datastax.com> wrote: > Since you only restored one dc's sstables, you should be able to rebuild > them on the second DC. > > Refresh means pick up new SSTables that have been directly added to the > data directory. > > Rebuild m

Re: sstableloader usage doubts

2015-06-05 Thread Sebastian Estevez
Since you only restored one dc's sstables, you should be able to rebuild them on the second DC. Refresh means pick up new SSTables that have been directly added to the data directory. Rebuild means stream data from other replicas to re create SSTables from scratch. On Jun 5, 2015 6:40 AM, "ZeroUn

Re: sstableloader usage doubts

2015-06-05 Thread ZeroUno
Il 04/06/15 19:50, Robert Coli ha scritto: http://www.pythian.com/blog/bulk-loading-options-for-cassandra/ Thank you Rob, but actually it doesn't matter to me which method is used, I can use both nodetool refresh or sstableloader, as long as they work! ;-) My problem here is that it looks

Re: sstableloader usage doubts

2015-06-05 Thread ZeroUno
Il 04/06/15 17:17, Sebastian Estevez ha scritto: If you have all the sstables for each node and no token range changes, you can just move the sstables to their spot in the data directory (rsync or w/e) and bring up your nodes. If you're already up you can use nodetool refresh to load the sstable

Re: sstableloader usage doubts

2015-06-04 Thread Robert Coli
On Thu, Jun 4, 2015 at 5:39 AM, ZeroUno wrote: > while defining backup and restore procedures for a Cassandra cluster I'm > trying to use sstableloader for restoring a snapshot from a backup, but I'm > not sure I fully understand the documentation on how it should be used. > http://www.pythian.c

Re: sstableloader usage doubts

2015-06-04 Thread Sebastian Estevez
You don't need sstable loader if your topology hasn't changed and you have all your sstables backed up for each node. SStableloader actually streams data to all the nodes in a ring (this is what OpsCenter backup restore does). So you can actually restore to a larger or smaller cluster or a cluster

Re: sstableloader and ttls

2014-08-18 Thread Yuki Morishita
sstableloader just loads given SSTables as they are. TTLed columns are sent and will be compacted at the destination node eventually. On Sat, Aug 16, 2014 at 4:28 AM, Erik Forsberg wrote: > Hi! > > If I use sstableloader to load data to a cluster, and the source > sstables contain some columns wh

Re: sstableloader prints nothing

2014-01-06 Thread Andrey Razumovsky
Hi Tyler, Sorry for late response - I create table using create table ip_lookup (ip varchar PRIMARY KEY, domains varchar); Thanks, Andrey 2013/12/26 Tyler Hobbs > > On Wed, Dec 25, 2013 at 11:29 AM, Andrey Razumovsky < > razumovsky.and...@gmail.com> wrote: > >> OK, I figured that out - turns

Re: SSTableloader

2013-12-26 Thread Robert Coli
On Thu, Dec 26, 2013 at 3:03 PM, varun allampalli wrote: > I am trying to load using SSTableloader with cassandra 1.2 version like a > million records. It streams very fast, but in the end its streaming gets > stuck at two three machines in the cluster, rest all are 100% done. > The fragility of

Re: sstableloader prints nothing

2013-12-26 Thread Tyler Hobbs
On Wed, Dec 25, 2013 at 11:29 AM, Andrey Razumovsky < razumovsky.and...@gmail.com> wrote: > OK, I figured that out - turns out that my sstables were in directory > but not in /. Would be great to > have a proper error message here.. I've opened a ticket to fix this: https://issues.apache.org/j

Re: sstableloader prints nothing

2013-12-25 Thread Andrey Razumovsky
OK, I figured that out - turns out that my sstables were in directory but not in /. Would be great to have a proper error message here.. However, I still can't import the data. The exception I get on server now looks like this: WARN [STREAM-IN-/127.0.1.1] 2013-12-25 18:20:09,686 StreamSession.j

Re: sstableloader does not support client encryption on Cassandra 2.0?

2013-11-19 Thread David Laube
Thank you Tyler. I took your advice and I have opened https://issues.apache.org/jira/browse/CASSANDRA-6378 Best regards, -David Laube On Nov 19, 2013, at 9:51 AM, Tyler Hobbs wrote: > I think this is just an oversight; would you mind opening a ticket here? > https://issues.apache.org/jira/bro

Re: sstableloader does not support client encryption on Cassandra 2.0?

2013-11-19 Thread Tyler Hobbs
I think this is just an oversight; would you mind opening a ticket here? https://issues.apache.org/jira/browse/CASSANDRA On Mon, Nov 18, 2013 at 12:37 PM, David Laube wrote: > Hi All, > > We have been testing backup/restore from one ring to another and we > recently stumbled upon an issue with

Re: sstableloader in Counter Columns

2013-11-11 Thread Aaron Morton
> After truncating and running sstableloader it was: > > [default@Sessions] get Counters[0]; > => (counter=EVENTS, value=4809758) > => (counter=ITEMS, value=382473) > => (counter=USERS, value=2571674) The expected value was 395930 and you got 382473 instead ? Was there any errors / warnings in th

Re: 'sstableloader' is not recognized as an internal or external command,

2013-04-23 Thread aaron morton
> Is sstableloader supported in windows, looking at the source it seems to be > unix shell file? Yup. If you would like to put together an sstableloader.bat file use the sstablekeys.bat file as a template but use org.apache.cassandra.tools.BulkLoader and the CASSANDRA_MAIN If you can get it w

RE: 'sstableloader' is not recognized as an internal or external command,

2013-04-22 Thread Viktor Jevdokimov
If your Cassandra cluster is on Linux, I believe that streaming is not supported in mixed environment, i.e. Cassandra nodes can't stream between Windows and Linux and sstableloader can't stream feom Windows to Linux. If your Cassandra also on Windows, just try to create bat file for sstableload

RE: sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
Thanks, that could help to consider migration of the cluster to a newer version. We'll check the difference. From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Wednesday, April 10, 2013 18:03 To: user@cassandra.apache.org Subject: Re: sstableloader throughput Yes. I did confirm

Re: sstableloader throughput

2013-04-10 Thread Edward Capriolo
wrote: > Rsync is not for our case. > > Is sstableloader for 1.2.x faster? > > > > From: Edward Capriolo [mailto:edlinuxg...@gmail.com] > Sent: Wednesday, April 10, 2013 15:52 > To: user@cassandra.apache.org > Subject: Re: sstableloader throughput > > Stables

RE: sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
Rsync is not for our case. Is sstableloader for 1.2.x faster? From: Edward Capriolo [mailto:edlinuxg...@gmail.com] Sent: Wednesday, April 10, 2013 15:52 To: user@cassandra.apache.org Subject: Re: sstableloader throughput Stables loader was slow in 1:0:x I had better luck with rsync. It was

Re: sstableloader throughput

2013-04-10 Thread Edward Capriolo
Stables loader was slow in 1:0:x I had better luck with rsync. It was not fixed in the 1.0.x series. On Wednesday, April 10, 2013, Viktor Jevdokimov < viktor.jevdoki...@adform.com> wrote: > Found https://issues.apache.org/jira/browse/CASSANDRA-3668 > > Weird. > > > > > > > > Best regards / Pagarbi

RE: sstableloader throughput

2013-04-10 Thread Viktor Jevdokimov
Found https://issues.apache.org/jira/browse/CASSANDRA-3668 Weird. Best regards / Pagarbiai Viktor Jevdokimov Senior Developer Email: viktor.jevdoki...@adform.com Phone: +370 5 212 3063, Fax +370 5 261 0453 J. Jasinskio 16C, LT-01112 Vilnius, Lithuania Follow

Re: sstableloader error

2012-08-28 Thread aaron morton
> WARN 21:41:15,200 Failed attempt 1 to connect to /10.245.28.232 to stream > null. Retrying in 2 ms. (java.net.ConnectException: Connection timed out) If you let sstable run does it complete ? > I am running cassandra on foreground. So, on all of the cassandra nodes i get > the below messag

RE: sstableloader 1.1 won't stream

2012-05-18 Thread Pieter Callewaert
rg Subject: Re: sstableloader 1.1 won't stream Pieter, Aaron, Any further progress on this? I'm running into the same issue, although in my case I'm trying to stream from Ubuntu 10.10 to a 2-node cluster (also Cassandra 1.1.0, and running on separate Ubuntu 10.10 hosts). Thanks

Re: sstableloader 1.1 won't stream

2012-05-17 Thread sj.climber
Pieter, Aaron, Any further progress on this? I'm running into the same issue, although in my case I'm trying to stream from Ubuntu 10.10 to a 2-node cluster (also Cassandra 1.1.0, and running on separate Ubuntu 10.10 hosts). Thanks in advance! -- View this message in context: http://cassandra-

Re: sstableloader 1.1 won't stream

2012-05-10 Thread aaron morton
leloader, does it still use the Cassandra.yaml or is it > completely independent? > > Kind regards > > -Original Message- > From: Pieter Callewaert [mailto:pieter.callewa...@be-mobile.be] > Sent: woensdag 9 mei 2012 17:41 > To: user@cassandra.apache.or

RE: sstableloader 1.1 won't stream

2012-05-10 Thread Pieter Callewaert
the Cassandra.yaml or is it completely independent? Kind regards -Original Message- From: Pieter Callewaert [mailto:pieter.callewa...@be-mobile.be] Sent: woensdag 9 mei 2012 17:41 To: user@cassandra.apache.org Subject: RE: sstableloader 1.1 won't stream I don't see any entr

RE: sstableloader 1.1 won't stream

2012-05-09 Thread Pieter Callewaert
Original Message- From: Sylvain Lebresne [mailto:sylv...@datastax.com] Sent: woensdag 9 mei 2012 10:45 To: user@cassandra.apache.org Subject: Re: sstableloader 1.1 won't stream Have you checked for errors in the servers' logs? -- Sylvain On Tue, May 8, 2012 at 1:24 PM, Pieter Call

Re: sstableloader 1.1 won't stream

2012-05-09 Thread Sylvain Lebresne
nal Message- > From: Benoit Perroud [mailto:ben...@noisette.ch] > Sent: maandag 7 mei 2012 22:21 > To: user@cassandra.apache.org > Subject: Re: sstableloader 1.1 won't stream > > You may want to upgrade all your nodes to 1.1. > > The streaming process connect to ever

RE: sstableloader 1.1 won't stream

2012-05-08 Thread Pieter Callewaert
I've updated all nodes to 1.1 but I keep getting the same problem... Any other thoughts about this? Kind regards, Pieter -Original Message- From: Benoit Perroud [mailto:ben...@noisette.ch] Sent: maandag 7 mei 2012 22:21 To: user@cassandra.apache.org Subject: Re: sstableloader 1.1

Re: sstableloader 1.1 won't stream

2012-05-07 Thread Benoit Perroud
You may want to upgrade all your nodes to 1.1. The streaming process connect to every living nodes of the cluster (you can explicitely diable some nodes), so all nodes need to speak 1.1. 2012/5/7 Pieter Callewaert : > Hi, > > > > I’m trying to upgrade our bulk load process in our testing env. >

RE: sstableloader throws storage_port error

2011-08-11 Thread Tom Davidson
.yaml listen and rpc ports could be the ports of other machines. -Original Message- From: Jonathan Ellis [mailto:jbel...@gmail.com] Sent: Thursday, August 11, 2011 6:04 PM To: user@cassandra.apache.org Subject: Re: sstableloader throws storage_port error "Unable to bind to address

Re: sstableloader throws storage_port error

2011-08-11 Thread Jonathan Ellis
ageService.initClient(StorageService.java:350) > > Ā Ā Ā  at > org.apache.cassandra.tools.BulkLoader$ExternalClient.init(BulkLoader.java:182) > > Ā Ā Ā  ... 2 more > > > > From: John Conwell [mailto:j...@iamjohn.me] > Sent: Tuesday, July 26, 2011 12:11 PM > To: user@ca

RE: sstableloader throws storage_port error

2011-08-11 Thread Tom Davidson
) ... 2 more From: John Conwell [mailto:j...@iamjohn.me] Sent: Tuesday, July 26, 2011 12:11 PM To: user@cassandra.apache.org Subject: Re: sstableloader throws storage_port error After much research and experimentation, I figured out how to get sstableloader running on the same machine as a

Re: sstableloader throws storage_port error

2011-07-26 Thread John Conwell
After much research and experimentation, I figured out how to get sstableloader running on the same machine as a live cassandra node instance. The key, as Jonathan stated is to configure sstableloader to use a different ipaddress than the running cassandra instance is using. To do this, I ran thi

Re: sstableloader throws storage_port error

2011-07-26 Thread John Conwell
If I have Cassandra already running on my machine, how do I configure sstableloader to run on a different IP (127.0.0.2). Also, does that mean in order to use sstableloader on the same machine as an running Cassandra node, I have to have two NIC cards? I looked around for any info about how to co

Re: sstableloader throws storage_port error

2011-07-25 Thread Jonathan Ellis
sstableloader uses gossip to discover the Cassandra ring, so you'll need to run it on a different IP (127.0.0.2 is fine). On Mon, Jul 25, 2011 at 2:41 PM, John Conwell wrote: > I'm trying to figure out how to use the sstableloader tool. Ā For my test I > have a single node cassandra instance runni