Cassandra - Pig integration

2014-07-31 Thread Akshay Ballarpure
Hello, I am trying to integrate cassandra into Hadoop and PIG and trying to load CSV file into Cassandra using PIG Script. Can someone help ? root@hadoop-1:/home/hduser/apache-cassandra-2.0.9/examples/pig# cat pigCasandra.pig data = LOAD 'example.csv' using PigStorage(',') AS (row_id:

Re: Cassandra - Pig integration

2014-07-31 Thread Kevin Burton
I think you need to send that details file for us to give you more information: /home/hduser/apache-cassandra-2.0.9/examples/pig/pig_1406808480077.log pig stores its runtime exceptions in a main details file that has the guts of the problem. Also, try posting to the pig user list. I'll tell

Re: Issue with cassandra-pig-thrift.transport and java.net.SocketException: Connection reset

2014-03-04 Thread Miguel Angel Martin junquera
hi all, After trying some things like: - tunning hadoop, - test with Cassandra 2.0.5 - test with cassandra 2.1 beta - increase memory in cassandra and hadoop, - upgrade and change instances in EC2 - increase number of threads - change type rpc server in

Issue with cassandra-pig-thrift.transport and java.net.SocketException: Connection reset

2014-02-27 Thread Miguel Angel Martin junquera
HI all, I trying to do a cogroup with five relations that I load from cassandra previously. In single node and local casandra testing environment the script works fine but when I try to execute in a cluster over AWS instances with only one slave in hadoop cluster and One seed cassandra node I

Re: Issue with cassandra-pig-thrift.transport and java.net.SocketException: Connection reset

2014-02-27 Thread Miguel Angel Martin junquera
I forgot I am using cassandra 2.04 , hadoop 1.2.1 and pig 0.12 Thanks 2014-02-27 17:29 GMT+01:00 Miguel Angel Martin junquera mianmarjun.mailingl...@gmail.com: HI all, I trying to do a cogroup with five relations that I load from cassandra previously. In single node and local casandra

cassandra + pig

2012-10-11 Thread William Oberman
I'm wondering how many people are using cassandra + pig out there? I recently went through the effort of validating things at a much higher level than I previously did(*), and found a few issues: https://issues.apache.org/jira/browse/CASSANDRA-4748 https://issues.apache.org/jira/browse/CASSANDRA

Re: cassandra + pig

2012-10-11 Thread Jeremy Hanna
, it sounds like there are some rough edges like you say. But issues that are reproducible on tickets for any problems are much appreciated and they will get addressed. On Oct 11, 2012, at 10:43 AM, William Oberman ober...@civicscience.com wrote: I'm wondering how many people are using cassandra

Re: cassandra + pig

2012-10-11 Thread William Oberman
there are some rough edges like you say. But issues that are reproducible on tickets for any problems are much appreciated and they will get addressed. On Oct 11, 2012, at 10:43 AM, William Oberman ober...@civicscience.com wrote: I'm wondering how many people are using cassandra + pig out there? I

Re: cassandra + pig

2012-10-11 Thread William Oberman
that are reproducible on tickets for any problems are much appreciated and they will get addressed. On Oct 11, 2012, at 10:43 AM, William Oberman ober...@civicscience.com wrote: I'm wondering how many people are using cassandra + pig out there? I recently went through the effort

Re: Source for Cassandra Pig and Hive

2012-05-02 Thread Paolo Bernardi
I think that your best bet is to look directly into the source tarball https://www.apache.org/dyn/closer.cgi?path=/cassandra/1.0.8/apache-cassandra-1.0.8-src.tar.gz or in the git repository http://git-wip-us.apache.org/repos/asf/cassandra.git Paolo On 05/02/12 01:12, rk vishu wrote: Hello

Re: Source for Cassandra Pig and Hive

2012-05-02 Thread Jeremy Hanna
The hive support is going to be integrated into the main source tree with this ticket: https://issues.apache.org/jira/browse/CASSANDRA-4131 You can go to https://github.com/riptano/hive to find the CassandraStorageHandler right now though. For 1.0.8, the CassandraStorage class for the Pig

Cassandra Pig with network topology and data centers.

2011-07-29 Thread Aaron Griffith
I currently have a 9 node cassandra cluster setup as follows: DC1: Six nodes DC2: Three nodes The tokens alternate between the two datacenters. I have hadoop installed as tasktracker/datanodes on the three cassandra nodes in DC2. There is another non cassandra node that is used as the hadoop

Re: Cassandra Pig with network topology and data centers.

2011-07-29 Thread Jake Luciani
Yes it's read repair you can lower the read repair chance to tune this. On Jul 29, 2011, at 6:31 PM, Aaron Griffith aaron.c.griff...@gmail.com wrote: I currently have a 9 node cassandra cluster setup as follows: DC1: Six nodes DC2: Three nodes The tokens alternate between the two

Re: Cassandra Pig with network topology and data centers.

2011-07-29 Thread Ryan King
It'd be great if we had different settings for inter- and intra-DC read repair. -ryan On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani jak...@gmail.com wrote: Yes it's read repair you can lower the read repair chance to tune this. On Jul 29, 2011, at 6:31 PM, Aaron Griffith

Re: Cassandra Pig with network topology and data centers.

2011-07-29 Thread Jeremy Hanna
fwiw - https://issues.apache.org/jira/browse/CASSANDRA-2970 thoughts? (please post on the ticket) On Jul 29, 2011, at 7:08 PM, Ryan King wrote: It'd be great if we had different settings for inter- and intra-DC read repair. -ryan On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani

Cassandra-Pig keyspace not found issue

2010-12-14 Thread Peter Davies
Pig seems to think my keyspace doesn't exist. I'm connecting to a remote cassandra instance configured in the environment variables PIG_RPC_PORT and PIG_INITIAL_ADDRESS (an ip address) I get the following backend logged output... **

Re: Cassandra + Pig + PHP

2010-10-06 Thread Petr Odut
Hi, PHP: I basicaly need to start pig program from a php script (via thrift or something..?) PIG: there is a LoadFunc that loads data from Cassandra, is there also a StoreFunc? On Tue, Oct 5, 2010 at 9:22 PM, Aaron Morton aa...@thelastpickle.comwrote: There is an example for pig in contrib/pig

Re: Cassandra + Pig + PHP

2010-10-06 Thread Jeff Zhang
Pig do not have thrift interface, But I believe you can create it. And another way I think is create a web service for your pig service, and call the web service in your php. On Wed, Oct 6, 2010 at 4:17 PM, Petr Odut petr.o...@gmail.com wrote: Hi, PHP: I basicaly need to start pig program

Re: Cassandra + Pig + PHP

2010-10-06 Thread Jeremy Hanna
PHP: I basicaly need to start pig program from a php script (via thrift or something..?) Can't you just execute a Pig script with PHP by calling Pig with a PHP exec function call? I'm not sure what you're trying to do with it, but that's one way you could do it. PIG: there is a LoadFunc

Re: Cassandra + Pig + PHP

2010-10-06 Thread Aaron Morton
AFAIK you can submit a pig job to the Hadoop job server via the pig command line interface. If you have not done so already have a read of the Hadoop Book it discusses pig as well http://bit.ly/9gGRyH Not sure how you go about monitoring the hadoop job though. There is support for hadoop to

Re: Cassandra + Pig + PHP

2010-10-06 Thread Jeremy Hanna
Yes - the HadoopSupport should be updated for the functionality that is added to 0.7. It's still a little in flux. There is an output format and output streaming support on trunk/0.7 beta2. The output format has a java example in the contrib/word_count example code. The output streaming,

Cassandra + Pig + PHP

2010-10-05 Thread Petr Odut
Is there any example / tutorial combining these technologies? Thanks -- Petr Odut [petr.o...@gmail.com]

Re: Cassandra + Pig + PHP

2010-10-05 Thread Aaron Morton
There is an example for pig in contrib/pig and a hadoop example in contrib/hadoop .What role did you want PHP to fill?AaronOn 06 Oct, 2010,at 06:05 AM, Petr Odut petr.o...@gmail.com wrote:Is there any example / tutorial combining these technologies?Thanks-- Petr Odut [petr.o...@gmail.com]

Cassandra Pig Framed Transport

2010-09-24 Thread Mark
How does one enable framed transport when using the pig loadfunc? Thanks

Re: Cassandra Pig

2010-09-24 Thread Mark
AM, Markstatic.void@gmail.com wrote: I am trying to run the Cassandra pig example but I keep receiving... org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias rows at org.apache.pig.PigServer.openIterator(PigServer.java:521

Re: Cassandra Pig Framed Transport

2010-09-24 Thread Jonathan Ellis
I don't think you can (although in 0.7 framed is the default for Pig like everything else). On Fri, Sep 24, 2010 at 2:14 PM, Mark static.void@gmail.com wrote:  How does one enable framed transport when using the pig loadfunc? Thanks -- Jonathan Ellis Project Chair, Apache Cassandra

Re: Cassandra Pig Framed Transport

2010-09-24 Thread Mark
I am using Pig v0.7 and Cassandra v0.6.5. The example that comes bundles up in Cassandra under contrib/pig uses unframed by default. When I use the default configuration for Cassandra then the Pig contrib works as expected. However when I change the configuration to framed then pig just

Re: Cassandra Pig

2010-09-13 Thread Asif Jan
Hi did you register cassandra jars with Pig. This seems like a class loading problem. aj On Sep 10, 2010, at 3:38 AM, Mark wrote: Does anyone know of any good tutorials for using Pig with Cassandra? I am trying do a basic load: rows = LOAD 'cassandra://Foo/Bar' USING

Cassandra Pig

2010-09-09 Thread Mark
Does anyone know of any good tutorials for using Pig with Cassandra? I am trying do a basic load: rows = LOAD 'cassandra://Foo/Bar' USING CassandraStorage(); but i keep getting this error. ERROR 1070: Could not resolve CassandraStorage using imports: [, org.apache.pig.builtin.,

Re: Cassandra Pig

2010-09-09 Thread Jeremy Hanna
Details of basic linkage are in the contrib/pig section of the Cassandra source in the readme. You should be able to run basic queries with just that. On Sep 9, 2010, at 8:38 PM, Mark static.void@gmail.com wrote: Does anyone know of any good tutorials for using Pig with Cassandra? I am

Cassandra Pig Integration

2010-06-30 Thread Mubarak Seyed
I am trying to query data using Pig 0.7.0, when i run contrib/pig/bin/pig_cassandra -x local filename.pig, i am getting an error ERROR 2117: Unexpected error when launching map reduce job. org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to open iterator for alias topnames