I am wondering if my pig script is correct? I took it from some of the
examples from the wiki:
raw = LOAD 'hbase://SESSION_TIMELINE1'
USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
's_t_mtx:*', '-loadKey true -limit 5')
AS (id:bytearray, s_t_mtx_map:map[]);
dump raw;
On Fri, Aug 10, 2012 at 6:01 PM, Mohit Anchlia <[email protected]>wrote:
> I am running basic pig script but it's failing. There is other job that
> loads data that works.
>
>
> Pig Stack Trace
> ---------------
> ERROR 2017: Internal error creating job configuration.
> org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1066: Unable to
> open iterator for alias raw
> at org.apache.pig.PigServer.openIterator(PigServer.java:900)
> at
> org.apache.pig.tools.grunt.GruntParser.processDump(GruntParser.java:655)
> at
> org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:303)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:188)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> at org.apache.pig.Main.run(Main.java:427)
> at org.apache.pig.Main.main(Main.java:108)
> Caused by: org.apache.pig.PigException: ERROR 1002: Unable to store alias
> raw
> at org.apache.pig.PigServer.storeEx(PigServer.java:999)
> at org.apache.pig.PigServer.store(PigServer.java:962)
> at org.apache.pig.PigServer.openIterator(PigServer.java:875)
> ... 7 more
> Caused by:
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> ERROR 2017: Internal error creating job configuration.
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:719)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:147)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1327)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1312)
> at org.apache.pig.PigServer.storeEx(PigServer.java:995)
> ... 9 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.parseZooCfg(ZKConfig.java:167)
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.makeZKProps(ZKConfig.java:69)
> at
> org.apache.hadoop.hbase.zookeeper.ZKConfig.getZKQuorumServersString(ZKConfig.java:250)
> at
> org.apache.hadoop.hbase.zookeeper.ZooKeeperWatcher.<init>(ZooKeeperWatcher.java:113)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getZooKeeperWatcher(HConnectionManager.java:1002)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.setupZookeeperTrackers(HConnectionManager.java:304)
> at
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.<init>(HConnectionManager.java:295)
> at
> org.apache.hadoop.hbase.client.HConnectionManager.getConnection(HConnectionManager.java:157)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:169)
> at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:147)
> at
> org.apache.pig.backend.hadoop.hbase.HBaseStorage.setLocation(HBaseStorage.java:449)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> ... 14 more
>
> raw = LOAD 'hbase://SESSION_TIMELINE1'
> USING org.apache.pig.backend.hadoop.hbase.HBaseStorage(
> 's_t_mtx:*', '-loadKey true -limit 5')
> AS (id:bytearray, s_t_mtx_map:map[]);
> dump raw;
> [root@dsdb4 mapr]# hbase shell
> HBase Shell; enter 'help<RETURN>' for list of supported commands.
> Type "exit<RETURN>" to leave the HBase Shell
> Version 0.90.6, rUnknown, Thu May 24 12:54:04 PDT 2012
> hbase(main):001:0> describe SESSION_TIMELINE1
> NameError: uninitialized constant SESSION_TIMELINE1
> hbase(main):002:0> describe 'SESSION_TIMELINE1'
> DESCRIPTION
> ENABLED
> {NAME => 'SESSION_TIMELINE1', FAMILIES => [{NAME => 'S_T_MTX',
> BLOOMFILTER => 'NONE', REPLICATION_SCOPE => '0', COMPRES true
> SION => 'LZO', VERSIONS => '1', TTL => '2147483647', BLOCKSIZE =>
> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]
> }
> 1 row(s) in 0.5750 seconds
>