Hello,
I am trying to integrate cassandra into Hadoop and PIG and trying to load
CSV file into Cassandra using PIG Script. Can someone help ?
root@hadoop-1:/home/hduser/apache-cassandra-2.0.9/examples/pig# cat
pigCasandra.pig
data = LOAD 'example.csv' using PigStorage(',') AS (row_id:
I think you need to send that details file for us to give you more
information:
/home/hduser/apache-cassandra-2.0.9/examples/pig/pig_1406808480077.log
pig stores its runtime exceptions in a main details file that has the guts
of the problem.
Also, try posting to the pig user list.
I'll tell
hi all,
After trying some things like:
- tunning hadoop,
- test with Cassandra 2.0.5
- test with cassandra 2.1 beta
- increase memory in cassandra and hadoop,
- upgrade and change instances in EC2
- increase number of threads
- change type rpc server in
HI all,
I trying to do a cogroup with five relations that I load from cassandra
previously.
In single node and local casandra testing environment the script works fine
but when I try to execute in a cluster over AWS instances with only one
slave in hadoop cluster and One seed cassandra node I
I forgot I am using cassandra 2.04 , hadoop 1.2.1 and pig 0.12
Thanks
2014-02-27 17:29 GMT+01:00 Miguel Angel Martin junquera
mianmarjun.mailingl...@gmail.com:
HI all,
I trying to do a cogroup with five relations that I load from cassandra
previously.
In single node and local casandra
I'm wondering how many people are using cassandra + pig out there? I
recently went through the effort of validating things at a much higher
level than I previously did(*), and found a few issues:
https://issues.apache.org/jira/browse/CASSANDRA-4748
https://issues.apache.org/jira/browse/CASSANDRA
, it sounds like there are some
rough edges like you say. But issues that are reproducible on tickets for any
problems are much appreciated and they will get addressed.
On Oct 11, 2012, at 10:43 AM, William Oberman ober...@civicscience.com wrote:
I'm wondering how many people are using cassandra
there are
some rough edges like you say. But issues that are reproducible on tickets
for any problems are much appreciated and they will get addressed.
On Oct 11, 2012, at 10:43 AM, William Oberman ober...@civicscience.com
wrote:
I'm wondering how many people are using cassandra + pig out there? I
that are reproducible on tickets
for any problems are much appreciated and they will get addressed.
On Oct 11, 2012, at 10:43 AM, William Oberman ober...@civicscience.com
wrote:
I'm wondering how many people are using cassandra + pig out there? I
recently went through the effort
I think that your best bet is to look directly into the source tarball
https://www.apache.org/dyn/closer.cgi?path=/cassandra/1.0.8/apache-cassandra-1.0.8-src.tar.gz
or in the git repository
http://git-wip-us.apache.org/repos/asf/cassandra.git
Paolo
On 05/02/12 01:12, rk vishu wrote:
Hello
The hive support is going to be integrated into the main source tree with this
ticket:
https://issues.apache.org/jira/browse/CASSANDRA-4131
You can go to https://github.com/riptano/hive to find the
CassandraStorageHandler right now though.
For 1.0.8, the CassandraStorage class for the Pig
I currently have a 9 node cassandra cluster setup as follows:
DC1: Six nodes
DC2: Three nodes
The tokens alternate between the two datacenters.
I have hadoop installed as tasktracker/datanodes on the
three cassandra nodes in DC2.
There is another non cassandra node that is used as the hadoop
Yes it's read repair you can lower the read repair chance to tune this.
On Jul 29, 2011, at 6:31 PM, Aaron Griffith aaron.c.griff...@gmail.com wrote:
I currently have a 9 node cassandra cluster setup as follows:
DC1: Six nodes
DC2: Three nodes
The tokens alternate between the two
It'd be great if we had different settings for inter- and intra-DC read repair.
-ryan
On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani jak...@gmail.com wrote:
Yes it's read repair you can lower the read repair chance to tune this.
On Jul 29, 2011, at 6:31 PM, Aaron Griffith
fwiw - https://issues.apache.org/jira/browse/CASSANDRA-2970
thoughts? (please post on the ticket)
On Jul 29, 2011, at 7:08 PM, Ryan King wrote:
It'd be great if we had different settings for inter- and intra-DC read
repair.
-ryan
On Fri, Jul 29, 2011 at 5:06 PM, Jake Luciani
Pig seems to think my keyspace doesn't exist. I'm connecting to a remote
cassandra instance configured in the environment variables
PIG_RPC_PORT and PIG_INITIAL_ADDRESS
(an ip address)
I get the following backend logged output...
**
Hi,
PHP: I basicaly need to start pig program from a php script (via thrift or
something..?)
PIG: there is a LoadFunc that loads data from Cassandra, is there also a
StoreFunc?
On Tue, Oct 5, 2010 at 9:22 PM, Aaron Morton aa...@thelastpickle.comwrote:
There is an example for pig in contrib/pig
Pig do not have thrift interface, But I believe you can create it. And
another way I think is create a web service for your pig service, and
call the web service in your php.
On Wed, Oct 6, 2010 at 4:17 PM, Petr Odut petr.o...@gmail.com wrote:
Hi,
PHP: I basicaly need to start pig program
PHP: I basicaly need to start pig program from a php script (via thrift or
something..?)
Can't you just execute a Pig script with PHP by calling Pig with a PHP exec
function call? I'm not sure what you're trying to do with it, but that's one
way you could do it.
PIG: there is a LoadFunc
AFAIK you can submit a pig job to the Hadoop job server via the pig command
line interface. If you have not done so already have a read of the Hadoop Book
it discusses pig as well
http://bit.ly/9gGRyH
Not sure how you go about monitoring the hadoop job though.
There is support for hadoop to
Yes - the HadoopSupport should be updated for the functionality that is added
to 0.7. It's still a little in flux. There is an output format and output
streaming support on trunk/0.7 beta2. The output format has a java example in
the contrib/word_count example code. The output streaming,
Is there any example / tutorial combining these technologies?
Thanks
--
Petr Odut [petr.o...@gmail.com]
There is an example for pig in contrib/pig and a hadoop example in contrib/hadoop .What role did you want PHP to fill?AaronOn 06 Oct, 2010,at 06:05 AM, Petr Odut petr.o...@gmail.com wrote:Is there any example / tutorial combining these technologies?Thanks-- Petr Odut [petr.o...@gmail.com]
How does one enable framed transport when using the pig loadfunc?
Thanks
AM, Markstatic.void@gmail.com wrote:
I am trying to run the Cassandra pig example but I keep receiving...
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias rows
at org.apache.pig.PigServer.openIterator(PigServer.java:521
I don't think you can (although in 0.7 framed is the default for Pig
like everything else).
On Fri, Sep 24, 2010 at 2:14 PM, Mark static.void@gmail.com wrote:
How does one enable framed transport when using the pig loadfunc?
Thanks
--
Jonathan Ellis
Project Chair, Apache Cassandra
I am using Pig v0.7 and Cassandra v0.6.5. The example that comes
bundles up in Cassandra under contrib/pig uses unframed by default. When
I use the default configuration for Cassandra then the Pig contrib works
as expected. However when I change the configuration to framed then pig
just
Hi
did you register cassandra jars with Pig. This seems like a class
loading problem.
aj
On Sep 10, 2010, at 3:38 AM, Mark wrote:
Does anyone know of any good tutorials for using Pig with Cassandra?
I am trying do a basic load:
rows = LOAD 'cassandra://Foo/Bar' USING
Does anyone know of any good tutorials for using Pig with Cassandra?
I am trying do a basic load:
rows = LOAD 'cassandra://Foo/Bar' USING CassandraStorage();
but i keep getting this error.
ERROR 1070: Could not resolve CassandraStorage using imports: [,
org.apache.pig.builtin.,
Details of basic linkage are in the contrib/pig section of the
Cassandra source in the readme. You should be able to run basic
queries with just that.
On Sep 9, 2010, at 8:38 PM, Mark static.void@gmail.com wrote:
Does anyone know of any good tutorials for using Pig with Cassandra?
I am
I am trying to query data using Pig 0.7.0, when i run
contrib/pig/bin/pig_cassandra -x local filename.pig, i am getting an error
ERROR 2117: Unexpected error when launching map reduce job.
org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
open iterator for alias topnames
31 matches
Mail list logo