[
https://issues.apache.org/jira/browse/PIG-2393?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Araceli Henley resolved PIG-2393.
---------------------------------
Resolution: Invalid
My bad, missed a type-o that was causing the error.
> Streaming with ship statement results in ERROR: 2017 Internal error creting
> job configuration
> ---------------------------------------------------------------------------------------------
>
> Key: PIG-2393
> URL: https://issues.apache.org/jira/browse/PIG-2393
> Project: Pig
> Issue Type: Bug
> Affects Versions: 0.9.2
> Environment: -bash-3.1$ hadoop version
> Hadoop 0.23.0.1111080202
> Subversion
> http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23.0/hadoop-common-project/hadoop-common
> -r 1196973
> Compiled by hadoopqa on Tue Nov 8 02:12:04 PST 2011
> From source with checksum 4e42b2d96c899a98a8ab8c7cc23f27ae
> -bash-3.1$ pig -version
> Apache Pig version 0.9.2.1111101150 (r1200499)
> compiled Nov 10 2011, 19:50:15
> Reporter: Araceli Henley
>
> TEST: This test is identical to Streaming_9 except that the full path with
> the namenode is specified.
> define CMD `perl PigStreamingDepend.pl` input(stdin)
> ship('/homes/user1/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/PigStreamingDepend.pl',
>
> '/homes/user1/pigtest/pigtest_next/pigharness/dist/pig_harness/libexec/PigTest/PigStreamingModule.pm');
> A = load
> 'dfs://namenode.yahoo.com:xxxx/user/hadoopqa/pig/tests/data/singlefile/studenttab10k';
> B = stream A through `perl PigStreaming.pl`;
> C = stream B through CMD as (name, age, gpa);
> D = foreach C generate name, age;
> store D into
> '/user/hadoopqa/pig/out/hadoopqa.1322769085/dotNext_Streaming_7.out';
> ERROR:
> Pig Stack Trace
> ---------------
> ERROR 2017: Internal error creating job configuration.
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobCreationException:
> ERROR 2017: Internal error creating job configuration.
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:726)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:258)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:149)
> at org.apache.pig.PigServer.launchPlan(PigServer.java:1314)
> at
> org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1299)
> at org.apache.pig.PigServer.execute(PigServer.java:1286)
> at org.apache.pig.PigServer.executeBatch(PigServer.java:360)
> at
> org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:131)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:192)
> at
> org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:164)
> at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:81)
> at org.apache.pig.Main.run(Main.java:561)
> at org.apache.pig.Main.main(Main.java:111)
> Caused by: java.io.IOException: No FileSystem for scheme: dfs
> at
> org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1933)
> at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:76)
> at
> org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:1970)
> at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1952)
> at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:268)
> at org.apache.hadoop.fs.Path.getFileSystem(Path.java:189)
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.setInputPaths(FileInputFormat.java:369)
> at
> org.apache.hadoop.mapreduce.lib.input.FileInputFormat.setInputPaths(FileInputFormat.java:338)
> at org.apache.pig.builtin.PigStorage.setLocation(PigStorage.java:219)
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.getJob(JobControlCompiler.java:382)
> ... 12 more
> ================================================================================
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
