Local mode for GroupBy followed by aggrete function results in ERROR: 2118
--------------------------------------------------------------------------
Key: PIG-2376
URL: https://issues.apache.org/jira/browse/PIG-2376
Project: Pig
Issue Type: Bug
Environment: Apache Pig version 0.9.2.1111101150 (r1200499)
compiled Nov 10 2011, 19:50:15
-bash-3.1$ hadoop version
Hadoop 0.23.0.1111080202
Subversion
http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.23.0/hadoop-common-project/hadoop-common
-r 1196973
Compiled by hadoopqa on Tue Nov 8 02:12:04 PST 2011
>From source with checksum 4e42b2d96c899a98a8ab8c7cc23f27ae
Reporter: Araceli Henley
Ran in LocalMode
The following test
a = load '/user/user1/pig/tests/data/singlefile/studenttab10k' as (name, age,
gpa);
b = group a by (name, age);
c = foreach b generate flatten(group), SUM(a.gpa);
store c into '/user/user1/pig/out/user1.1321317375/GroupAggFunc_12.out';
:
==============
Failed Jobs:
:==============
JobId Alias Feature Message Outputs
job_local_0001 a,b,c GROUP_BY,COMBINER Message:
org.apache.pig.backend.executionengine.ExecException: ERROR 2118: Input path
does not exist: file:/user/user1/pig/tests/data/singlefile/studenttab10k
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:282)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:445)
at
org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:462)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:360)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
at
org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
at
org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:233)
at java.lang.Thread.run(Thread.java:619)
Caused by: org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input
path does not exist: file:/user/user1/pig/tests/data/singlefile/studenttab10k
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:243)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigTextInputFormat.listStatus(PigTextInputFormat.java:36)
at
org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:269)
at
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigInputFormat.getSplits(PigInputFormat.java:270)
... 12 more
/user/user1/pig/out/user1.1321317375/GroupAggFunc_12.out,
Input(s):
Failed to read data from "/user/user1/pig/tests/data/singlefile/studenttab10k"
Output(s):
Failed to produce result in
"/user/user1/pig/out/user1.1321317375/GroupAggFunc_12.out"
File does exist from hdfs:
-rw-r--r-- 3 user1 hdfs 219190 2011-11-15 22:49
/user/user1/pig/tests/data/singlefile/studenttab10k
Failed tests:
GroupAggFunc_12 and GroupAggFunc_13
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
