spout storm cassandra
Is there any way to consume inputs from Cassandra using a Storm spout? Thank you.
Cassandra - Storm
Hi all, Did anybody use Cassandra for the tuple storage in Storm? I have this scenario: I have a spout (getting messages from RabbitMQ) and I want to save all these messages in Cassandra using a bolt. What is the best choice regarding the connection to the DB? I have read about Hector API. I used it, but for now I wasn't able to add a new row in a column family. Any help would be appreciated. Regards, Vanessa.
Re: sstable loader
Hi,
I used this https://github.com/yukim/cassandra-bulkload-example/ (I have
modified BulkLoad.java for my needs) for the sstable loader and it works
ok. You can take a look, maybe it will help you.
Regards,
Vanessa.
On Mon, Mar 30, 2015 at 10:04 AM, Rahul Bhardwaj
rahul.bhard...@indiamart.com wrote:
Hi Amila ,
I tried your code. In which we made some modification accordingly like:
public class DataImportExample
{
static String filename;
public static void main(String[] args) throws IOException
{
filename = /root/perl_work/abc.csv;
BufferedReader reader = new BufferedReader(new
FileReader(filename));
String keyspace = mesh_glusr;
File directory = new File(keyspace);
if (!directory.exists()){
directory.mkdir();}
// random partitioner is created, u can give the partitioner as u
want
IPartitioner partitioner = new RandomPartitioner();
SSTableSimpleUnsortedWriter usersWriter = new
SSTableSimpleUnsortedWriter(
directory,partitioner,keyspace,test1,AsciiType.instance,null,64);
after compiling when we executed it with below command :
java -cp /root/perl_work DataImportExample
it throws below error:
Expecting URI in variable: [cassandra.config]. Please prefix the file
with file:/// for local files or file://server/ for remote files.
Aborting.
Fatal configuration error; unable to start. See log for stacktrace.
We are not able to find what went wrong , actually not good java
developer, so plz guide.
Regards:
Rahul Bhardwaj
On Fri, Mar 27, 2015 at 2:55 PM, Amila Paranawithana amila1...@gmail.com
wrote:
Hi,
This post[1] may be useful. But note that this was done with cassandra
older version. So there may be new way to do this.
[1].
http://amilaparanawithana.blogspot.com/2012/06/bulk-loading-external-data-to-cassandra.html
Thanks,
On Fri, Mar 27, 2015 at 11:40 AM, Rahul Bhardwaj
rahul.bhard...@indiamart.com wrote:
Hi All,
Can we use sstable loader for loading external flat file or csv file.
If yes , kindly share the steps or manual.
I need to put 40 million data into a table of around 70 columns
Regards:
Rahul Bhardwaj
Follow IndiaMART.com http://www.indiamart.com for latest updates on
this and more: https://plus.google.com/+indiamart
https://www.facebook.com/IndiaMART https://twitter.com/IndiaMART
Mobile Channel:
https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=668561641mt=8
https://play.google.com/store/apps/details?id=com.indiamart.m
http://m.indiamart.com/
https://www.youtube.com/watch?v=DzORNbeSXN8list=PL2o4J51MqpL0mbue6kzDa6eymLVUXtlR1index=2
Watch how IndiaMART Maximiser helped Mr. Khanna expand his business.
kyunki Kaam Yahin Banta Hai
https://www.youtube.com/watch?v=Q9fZ5ILY3w8feature=youtu.be!!!
--
*Amila Iroshani Paranawithana , **Senior Software Engineer* *,
AdroitLogic http://adroitlogic.org*
| ☎: +94779747398
| ✍: http://amilaparanawithana.blogspot.com
[image: Facebook] https://www.facebook.com/amila.paranawithana [image:
Twitter] https://twitter.com/AmilaPara [image: LinkedIn]
http://www.linkedin.com/profile/view?id=66289851trk=tab_pro [image:
Skype] amila.paranawithana
Follow IndiaMART.com http://www.indiamart.com for latest updates on
this and more: https://plus.google.com/+indiamart
https://www.facebook.com/IndiaMART https://twitter.com/IndiaMART
Mobile Channel:
https://itunes.apple.com/WebObjects/MZStore.woa/wa/viewSoftware?id=668561641mt=8
https://play.google.com/store/apps/details?id=com.indiamart.m
http://m.indiamart.com/
https://www.youtube.com/watch?v=DzORNbeSXN8list=PL2o4J51MqpL0mbue6kzDa6eymLVUXtlR1index=2
Watch how IndiaMART Maximiser helped Mr. Khanna expand his business.
kyunki Kaam Yahin Banta Hai
https://www.youtube.com/watch?v=Q9fZ5ILY3w8feature=youtu.be!!!
Re: Datastax Enterprise AMI EC2
Ok, thank you for your help! On Tue, Mar 24, 2015 at 11:59 PM, Nick Bailey n...@datastax.com wrote: This is a known issue with older versions of the AMI. Use the 2.5.1 version of the AMI (seehttps:// raw.githubusercontent.com/riptano/ComboAMI/2.5/ami_ids.json for the ids for your region). For a more detailed discussion of what's going wrong, see this StackExchange answer:http://stackoverflow.com/a/29174929 Sorry, for the inconvenience. It's a bug we are working on. On Tue, Mar 24, 2015 at 3:53 AM, Vanessa Gligor vanessagli...@gmail.com wrote: Hi, I tried to launch the datastax AMI using enterprise version following these steps: - I launched the AMI only with the Opscenter in a ec2 instance and then I have created a new Cluster containg 2 nodes - Cassanrda Solr. This scenario works just fine in South America (Sao Paulo). I tried to do the exact same thing, following the exact same steps, the same AMI in US East (N. Virginia), but it's not working and I don't know why. It gets this error: *Stop Errored: /usr/sbin/service dse stop failed* *Error Details* *Stop Errored: /usr/sbin/service dse stop failed* *exit status: 1* *stdout:* *log_daemon_msg is a shell function* *Cassandra 2.0 and later require Java 7 or later.* Or it gets blocked up somewhere at : Waiting for the agent to start Do you have any ideea about what is happening? Thank you very much! Vanessa.
Datastax Enterprise AMI EC2
Hi, I tried to launch the datastax AMI using enterprise version following these steps: - I launched the AMI only with the Opscenter in a ec2 instance and then I have created a new Cluster containg 2 nodes - Cassanrda Solr. This scenario works just fine in South America (Sao Paulo). I tried to do the exact same thing, following the exact same steps, the same AMI in US East (N. Virginia), but it's not working and I don't know why. It gets this error: *Stop Errored: /usr/sbin/service dse stop failed* *Error Details* *Stop Errored: /usr/sbin/service dse stop failed* *exit status: 1* *stdout:* *log_daemon_msg is a shell function* *Cassandra 2.0 and later require Java 7 or later.* Or it gets blocked up somewhere at : Waiting for the agent to start Do you have any ideea about what is happening? Thank you very much! Vanessa.
Re: DataStax Enterprise Amazon AMI Launch Error
I have used m3.medium and m3.large On Sat, Mar 14, 2015 at 2:36 AM, Patrick McFadin pmcfa...@gmail.com wrote: What size of instance are you using? It looks like you aren't at to get resources set up in time. On Thursday, March 12, 2015, Vanessa Gligor vanessagli...@gmail.com wrote: When I try to launch an EC2 Instance using DataStax community it's working, so I have the premission to create an EC2 instance. I want to have Cassandra and Solr as services installed on an VM. Thanks! On Thu, Mar 12, 2015 at 2:56 PM, Ali Akhtar ali.rac...@gmail.com wrote: Seems like its having trouble launching the other EC2 instances that you're requesting. You would need to provide it your AWS credentials for an account that has the permissions to create EC2 instances. Have you done that? If you just want to install cassandra on AWS, you might find this bash script useful: https://gist.github.com/aliakhtar/3649e412787034156cbb On Thu, Mar 12, 2015 at 5:14 PM, Vanessa Gligor vanessagli...@gmail.com wrote: I'm trying to launch a new instance of DataStax AMI on a EC2 Amazon instance. I tried this in 2 different regions (us-east and eu-west), using these AMIs: ami-ada2b6c4, ami-814ec2e8 (us-east) and ami-7f33cd08, ami-b2212dc6 (eu-west). I followed this documentation: http://www.datastax.com/documentation/datastax_enterprise/4.6/datastax_enterprise/install/installAMI.html So this is what I've done so far: 1. I've created a new security group (with those specific ports - I cannot upload the print screen because I have just created this account) 2. I've create a new key pair 3. I've launched the DataStax AMI with these configuration details: --clustername cluster --totalnodes 4 --version enterprise --username my_name --password my_password --searchnodes 2 (I have verified my credentials - I can login here http://debian.datastax.com/enterprise/ ) 4. After selecting the previous created security group key pair I launched the instance 5. I've connected to my DataStax Enterprise EC2 instance and this is the displayed log: Cluster started with these options: --clustername cluster --totalnodes 4 --version enterprise --username my_name --password --searchnodes 2 03/12/15-08:59:23 Reflector: Received 1 of 2 responses from: [u'172.31.34.171']... Exception seen in ds1_launcher.py. Please check ~/datastax_ami/ami.log for more info. Please visit and the ami.log shows these messages: [INFO] 03/12/15-08:59:23 Reflector: Received 1 of 2 responses from: [u'172.31.34.171'] [ERROR] EC2 is experiencing some issues and has not allocated all of the resources in under 10 minutes. Aborting the clustering of this reservation. Please try again. [ERROR] Exception seen in ds1_launcher.py: Traceback (most recent call last): File /home/ubuntu/datastax_ami/ds1_launcher.py, line 22, in initial_configurations ds2_configure.run() File /home/ubuntu/datastax_ami/ds2_configure.py, line 1135, in run File /home/ubuntu/datastax_ami/ds2_configure.py, line 57, in exit_path AttributeError: EC2 is experiencing some issues and has not allocated all of the resources in under 10 minutes. Aborting the clustering of this reservation. Please try again. Any suggestion on how to fix this problem? Thank you! Have a nice day, Vanessa.
Re: DataStax Enterprise Amazon AMI Launch Error
When I try to launch an EC2 Instance using DataStax community it's working, so I have the premission to create an EC2 instance. I want to have Cassandra and Solr as services installed on an VM. Thanks! On Thu, Mar 12, 2015 at 2:56 PM, Ali Akhtar ali.rac...@gmail.com wrote: Seems like its having trouble launching the other EC2 instances that you're requesting. You would need to provide it your AWS credentials for an account that has the permissions to create EC2 instances. Have you done that? If you just want to install cassandra on AWS, you might find this bash script useful: https://gist.github.com/aliakhtar/3649e412787034156cbb On Thu, Mar 12, 2015 at 5:14 PM, Vanessa Gligor vanessagli...@gmail.com wrote: I'm trying to launch a new instance of DataStax AMI on a EC2 Amazon instance. I tried this in 2 different regions (us-east and eu-west), using these AMIs: ami-ada2b6c4, ami-814ec2e8 (us-east) and ami-7f33cd08, ami-b2212dc6 (eu-west). I followed this documentation: http://www.datastax.com/documentation/datastax_enterprise/4.6/datastax_enterprise/install/installAMI.html So this is what I've done so far: 1. I've created a new security group (with those specific ports - I cannot upload the print screen because I have just created this account) 2. I've create a new key pair 3. I've launched the DataStax AMI with these configuration details: --clustername cluster --totalnodes 4 --version enterprise --username my_name --password my_password --searchnodes 2 (I have verified my credentials - I can login here http://debian.datastax.com/enterprise/ ) 4. After selecting the previous created security group key pair I launched the instance 5. I've connected to my DataStax Enterprise EC2 instance and this is the displayed log: Cluster started with these options: --clustername cluster --totalnodes 4 --version enterprise --username my_name --password --searchnodes 2 03/12/15-08:59:23 Reflector: Received 1 of 2 responses from: [u'172.31.34.171']... Exception seen in ds1_launcher.py. Please check ~/datastax_ami/ami.log for more info. Please visit and the ami.log shows these messages: [INFO] 03/12/15-08:59:23 Reflector: Received 1 of 2 responses from: [u'172.31.34.171'] [ERROR] EC2 is experiencing some issues and has not allocated all of the resources in under 10 minutes. Aborting the clustering of this reservation. Please try again. [ERROR] Exception seen in ds1_launcher.py: Traceback (most recent call last): File /home/ubuntu/datastax_ami/ds1_launcher.py, line 22, in initial_configurations ds2_configure.run() File /home/ubuntu/datastax_ami/ds2_configure.py, line 1135, in run File /home/ubuntu/datastax_ami/ds2_configure.py, line 57, in exit_path AttributeError: EC2 is experiencing some issues and has not allocated all of the resources in under 10 minutes. Aborting the clustering of this reservation. Please try again. Any suggestion on how to fix this problem? Thank you! Have a nice day, Vanessa.
DataStax Enterprise Amazon AMI Launch Error
I'm trying to launch a new instance of DataStax AMI on a EC2 Amazon instance. I tried this in 2 different regions (us-east and eu-west), using these AMIs: ami-ada2b6c4, ami-814ec2e8 (us-east) and ami-7f33cd08, ami-b2212dc6 (eu-west). I followed this documentation: http://www.datastax.com/documentation/datastax_enterprise/4.6/datastax_enterprise/install/installAMI.html So this is what I've done so far: 1. I've created a new security group (with those specific ports - I cannot upload the print screen because I have just created this account) 2. I've create a new key pair 3. I've launched the DataStax AMI with these configuration details: --clustername cluster --totalnodes 4 --version enterprise --username my_name --password my_password --searchnodes 2 (I have verified my credentials - I can login here http://debian.datastax.com/enterprise/ ) 4. After selecting the previous created security group key pair I launched the instance 5. I've connected to my DataStax Enterprise EC2 instance and this is the displayed log: Cluster started with these options: --clustername cluster --totalnodes 4 --version enterprise --username my_name --password --searchnodes 2 03/12/15-08:59:23 Reflector: Received 1 of 2 responses from: [u'172.31.34.171']... Exception seen in ds1_launcher.py. Please check ~/datastax_ami/ami.log for more info. Please visit and the ami.log shows these messages: [INFO] 03/12/15-08:59:23 Reflector: Received 1 of 2 responses from: [u'172.31.34.171'] [ERROR] EC2 is experiencing some issues and has not allocated all of the resources in under 10 minutes. Aborting the clustering of this reservation. Please try again. [ERROR] Exception seen in ds1_launcher.py: Traceback (most recent call last): File /home/ubuntu/datastax_ami/ds1_launcher.py, line 22, in initial_configurations ds2_configure.run() File /home/ubuntu/datastax_ami/ds2_configure.py, line 1135, in run File /home/ubuntu/datastax_ami/ds2_configure.py, line 57, in exit_path AttributeError: EC2 is experiencing some issues and has not allocated all of the resources in under 10 minutes. Aborting the clustering of this reservation. Please try again. Any suggestion on how to fix this problem? Thank you! Have a nice day, Vanessa.
