[
https://issues.apache.org/jira/browse/PIG-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dieter Bogdoll updated PIG-4861:
--------------------------------
Description:
I tried to work through the pig tutorial and point 3) in the local mode doesn't
work for me.
Here is my stack trace:
2016-04-04 16:11:32,244 [Thread-12] INFO
org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= -
2016-04-04 16:11:32,250 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
io.sort.mb = 100
2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
data buffer = 79691776/99614720
2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
record buffer = 262144/327680
2016-04-04 16:11:32,374 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- HadoopJobId: job_local_0001
2016-04-04 16:11:32,376 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
2016-04-04 16:11:32,508 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
Starting flush of map output
2016-04-04 16:11:32,554 [Thread-12] WARN
org.apache.hadoop.mapred.LocalJobRunner - job_local_0001
java.io.IOException: Expecting a line not the end of stream
at org.apache.hadoop.fs.DF.parseExecResult(DF.java:109)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:179)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:329)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
at
org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1221)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1129)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:549)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:623)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
If necessary I could capture all stdout and stderr and attach it.
was:
I tried to work through the pig tutorial and point 3) in the local mode doesn't
work for me. Here is my stack trace:
2016-04-04 16:11:32,244 [Thread-12] INFO
org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with
processName=JobTracker, sessionId= -
2016-04-04 16:11:32,250 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
io.sort.mb = 100
2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
data buffer = 79691776/99614720
2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
record buffer = 262144/327680
2016-04-04 16:11:32,374 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- HadoopJobId: job_local_0001
2016-04-04 16:11:32,376 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
2016-04-04 16:11:32,508 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
Starting flush of map output
2016-04-04 16:11:32,554 [Thread-12] WARN
org.apache.hadoop.mapred.LocalJobRunner - job_local_0001
java.io.IOException: Expecting a line not the end of stream
at org.apache.hadoop.fs.DF.parseExecResult(DF.java:109)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:179)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
at
org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:329)
at
org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
at
org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1221)
at
org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1129)
at
org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:549)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:623)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> PigTutorial doesn't work on Windows
> -----------------------------------
>
> Key: PIG-4861
> URL: https://issues.apache.org/jira/browse/PIG-4861
> Project: Pig
> Issue Type: Bug
> Reporter: Dieter Bogdoll
> Assignee: ???
>
> I tried to work through the pig tutorial and point 3) in the local mode
> doesn't work for me.
> Here is my stack trace:
> 2016-04-04 16:11:32,244 [Thread-12] INFO
> org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with
> processName=JobTracker, sessionId= -
> 2016-04-04 16:11:32,250 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
> io.sort.mb = 100
> 2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
> data buffer = 79691776/99614720
> 2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
> record buffer = 262144/327680
> 2016-04-04 16:11:32,374 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - HadoopJobId: job_local_0001
> 2016-04-04 16:11:32,376 [main] INFO
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
> - 0% complete
> 2016-04-04 16:11:32,508 [Thread-12] INFO org.apache.hadoop.mapred.MapTask -
> Starting flush of map output
> 2016-04-04 16:11:32,554 [Thread-12] WARN
> org.apache.hadoop.mapred.LocalJobRunner - job_local_0001
> java.io.IOException: Expecting a line not the end of stream
> at org.apache.hadoop.fs.DF.parseExecResult(DF.java:109)
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:179)
> at org.apache.hadoop.util.Shell.run(Shell.java:134)
> at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
> at
> org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:329)
> at
> org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
> at
> org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
> at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1221)
> at
> org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1129)
> at
> org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:549)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:623)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
> at
> org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
> If necessary I could capture all stdout and stderr and attach it.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
