Author: thejas
Date: Tue Sep 24 20:26:20 2013
New Revision: 1525997
URL: http://svn.apache.org/r1525997
Log:
HIVE-4531: [WebHCat] Collecting task logs to hdfs - add missing files (Daniel
Dai via Thejas Nair)
Added:
hive/trunk/hcatalog/webhcat/svr/src/test/data/
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/hive/
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/hive/stderr
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/jar/
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/jar/stderr
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/pig/
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/pig/stderr
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/streaming/
hive/trunk/hcatalog/webhcat/svr/src/test/data/status/streaming/stderr
Added: hive/trunk/hcatalog/webhcat/svr/src/test/data/status/hive/stderr
URL:
http://svn.apache.org/viewvc/hive/trunk/hcatalog/webhcat/svr/src/test/data/status/hive/stderr?rev=1525997&view=auto
==============================================================================
--- hive/trunk/hcatalog/webhcat/svr/src/test/data/status/hive/stderr (added)
+++ hive/trunk/hcatalog/webhcat/svr/src/test/data/status/hive/stderr Tue Sep 24
20:26:20 2013
@@ -0,0 +1,35 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use
org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
+Logging initialized using configuration in
jar:file:/Users/daijy/hadoop-1.0.3/tmp/mapred/local/taskTracker/distcache/7168149899505899073_637041239_1133292873/localhost/apps/templeton/hive-0.10.0.tar.gz/hive-0.10.0/lib/hive-common-0.10.0.jar!/hive-log4j.properties
+Hive history file=/tmp/daijy/hive_job_log_daijy_201305091500_862342848.txt
+Total MapReduce jobs = 1
+Launching Job 1 out of 1
+Number of reduce tasks is set to 0 since there's no reduce operator
+Starting Job = job_201305091437_0012, Tracking URL =
http://localhost:50030/jobdetails.jsp?jobid=job_201305091437_0012
+Kill Command = /Users/daijy/hadoop-1.0.3/libexec/../bin/hadoop job -kill
job_201305091437_0012
+Hadoop job information for Stage-1: number of mappers: 0; number of reducers: 0
+2013-05-09 15:01:13,625 Stage-1 map = 0%, reduce = 0%
+2013-05-09 15:01:19,660 Stage-1 map = 100%, reduce = 100%
+Ended Job = job_201305091437_0012
+MapReduce Jobs Launched:
+Job 0: HDFS Read: 0 HDFS Write: 0 SUCCESS
+Total MapReduce CPU Time Spent: 0 msec
+OK
+Time taken: 26.187 seconds
Added: hive/trunk/hcatalog/webhcat/svr/src/test/data/status/jar/stderr
URL:
http://svn.apache.org/viewvc/hive/trunk/hcatalog/webhcat/svr/src/test/data/status/jar/stderr?rev=1525997&view=auto
==============================================================================
--- hive/trunk/hcatalog/webhcat/svr/src/test/data/status/jar/stderr (added)
+++ hive/trunk/hcatalog/webhcat/svr/src/test/data/status/jar/stderr Tue Sep 24
20:26:20 2013
@@ -0,0 +1,58 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+13/05/09 09:56:05 INFO input.FileInputFormat: Total input paths to process : 1
+13/05/09 09:56:05 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
+13/05/09 09:56:05 WARN snappy.LoadSnappy: Snappy native library not loaded
+13/05/09 09:56:05 INFO mapred.JobClient: Running job: job_201305090950_0004
+13/05/09 09:56:06 INFO mapred.JobClient: map 0% reduce 0%
+13/05/09 09:56:19 INFO mapred.JobClient: map 100% reduce 0%
+13/05/09 09:56:31 INFO mapred.JobClient: map 100% reduce 100%
+13/05/09 09:56:36 INFO mapred.JobClient: Job complete: job_201305090950_0004
+13/05/09 09:56:36 INFO mapred.JobClient: Counters: 26
+13/05/09 09:56:36 INFO mapred.JobClient: Job Counters
+13/05/09 09:56:36 INFO mapred.JobClient: Launched reduce tasks=1
+13/05/09 09:56:36 INFO mapred.JobClient: SLOTS_MILLIS_MAPS=12660
+13/05/09 09:56:36 INFO mapred.JobClient: Total time spent by all reduces
waiting after reserving slots (ms)=0
+13/05/09 09:56:36 INFO mapred.JobClient: Total time spent by all maps
waiting after reserving slots (ms)=0
+13/05/09 09:56:36 INFO mapred.JobClient: Launched map tasks=1
+13/05/09 09:56:36 INFO mapred.JobClient: Data-local map tasks=1
+13/05/09 09:56:36 INFO mapred.JobClient: SLOTS_MILLIS_REDUCES=10247
+13/05/09 09:56:36 INFO mapred.JobClient: File Output Format Counters
+13/05/09 09:56:36 INFO mapred.JobClient: Bytes Written=16
+13/05/09 09:56:36 INFO mapred.JobClient: FileSystemCounters
+13/05/09 09:56:36 INFO mapred.JobClient: FILE_BYTES_READ=38
+13/05/09 09:56:36 INFO mapred.JobClient: HDFS_BYTES_READ=127
+13/05/09 09:56:36 INFO mapred.JobClient: FILE_BYTES_WRITTEN=45519
+13/05/09 09:56:36 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=16
+13/05/09 09:56:36 INFO mapred.JobClient: File Input Format Counters
+13/05/09 09:56:36 INFO mapred.JobClient: Bytes Read=8
+13/05/09 09:56:36 INFO mapred.JobClient: Map-Reduce Framework
+13/05/09 09:56:36 INFO mapred.JobClient: Map output materialized bytes=38
+13/05/09 09:56:36 INFO mapred.JobClient: Map input records=2
+13/05/09 09:56:36 INFO mapred.JobClient: Reduce shuffle bytes=0
+13/05/09 09:56:36 INFO mapred.JobClient: Spilled Records=8
+13/05/09 09:56:36 INFO mapred.JobClient: Map output bytes=24
+13/05/09 09:56:36 INFO mapred.JobClient: Total committed heap usage
(bytes)=269619200
+13/05/09 09:56:36 INFO mapred.JobClient: Combine input records=4
+13/05/09 09:56:36 INFO mapred.JobClient: SPLIT_RAW_BYTES=119
+13/05/09 09:56:36 INFO mapred.JobClient: Reduce input records=4
+13/05/09 09:56:36 INFO mapred.JobClient: Reduce input groups=4
+13/05/09 09:56:36 INFO mapred.JobClient: Combine output records=4
+13/05/09 09:56:36 INFO mapred.JobClient: Reduce output records=4
+13/05/09 09:56:36 INFO mapred.JobClient: Map output records=4
Added: hive/trunk/hcatalog/webhcat/svr/src/test/data/status/pig/stderr
URL:
http://svn.apache.org/viewvc/hive/trunk/hcatalog/webhcat/svr/src/test/data/status/pig/stderr?rev=1525997&view=auto
==============================================================================
--- hive/trunk/hcatalog/webhcat/svr/src/test/data/status/pig/stderr (added)
+++ hive/trunk/hcatalog/webhcat/svr/src/test/data/status/pig/stderr Tue Sep 24
20:26:20 2013
@@ -0,0 +1,73 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+2013-04-18 14:54:45,945 [main] INFO org.apache.pig.Main - Apache Pig version
0.10.1 (r1426677) compiled Dec 28 2012, 16:46:13
+2013-04-18 14:54:45,946 [main] INFO org.apache.pig.Main - Logging error
messages to:
/Users/daijy/hadoop-1.0.3/tmp/mapred/local/taskTracker/daijy/jobcache/job_201304181449_0003/attempt_201304181449_0003_m_000000_0/work/pig_1366322085940.log
+2013-04-18 14:54:46,381 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to
hadoop file system at: hdfs://localhost:8020
+2013-04-18 14:54:46,512 [main] INFO
org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to
map-reduce job tracker at: localhost:9001
+2013-04-18 14:54:46,899 [main] INFO org.apache.pig.tools.pigstats.ScriptState
- Pig features used in the script: UNKNOWN
+2013-04-18 14:54:47,059 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File
concatenation threshold: 100 optimistic? false
+2013-04-18 14:54:47,082 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
- MR plan size before optimization: 1
+2013-04-18 14:54:47,083 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer
- MR plan size after optimization: 1
+2013-04-18 14:54:47,144 [main] INFO org.apache.pig.tools.pigstats.ScriptState
- Pig script settings are added to the job
+2013-04-18 14:54:47,159 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
- mapred.job.reduce.markreset.buffer.percent is not set, set to default 0.3
+2013-04-18 14:54:47,162 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
- creating jar file Job4814368788682413488.jar
+2013-04-18 14:54:50,051 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
- jar file Job4814368788682413488.jar created
+2013-04-18 14:54:50,065 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler
- Setting up single store job
+2013-04-18 14:54:50,093 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 1 map-reduce job(s) waiting for submission.
+2013-04-18 14:54:50,386 [Thread-7] INFO
org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to
process : 1
+2013-04-18 14:54:50,386 [Thread-7] INFO
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input
paths to process : 1
+2013-04-18 14:54:50,395 [Thread-7] WARN
org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library
for your platform... using builtin-java classes where applicable
+2013-04-18 14:54:50,395 [Thread-7] WARN
org.apache.hadoop.io.compress.snappy.LoadSnappy - Snappy native library not
loaded
+2013-04-18 14:54:50,397 [Thread-7] INFO
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input
paths (combined) to process : 1
+2013-04-18 14:54:50,594 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- HadoopJobId: job_201304181449_0004
+2013-04-18 14:54:50,595 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- More information at:
http://localhost:50030/jobdetails.jsp?jobid=job_201304181449_0004
+2013-04-18 14:54:50,597 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 0% complete
+2013-04-18 14:55:12,184 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 50% complete
+2013-04-18 14:55:20,743 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- 100% complete
+2013-04-18 14:55:20,744 [main] INFO
org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
+
+HadoopVersion PigVersion UserId StartedAt FinishedAt Features
+1.0.3 0.10.1 daijy 2013-04-18 14:54:47 2013-04-18 14:55:20 UNKNOWN
+
+Success!
+
+Job Stats (time in seconds):
+JobId Maps Reduces MaxMapTime MinMapTIme AvgMapTime
MaxReduceTime MinReduceTime AvgReduceTime Alias Feature Outputs
+job_201304181449_0004 1 0 6 6 6 0 0
0 a MAP_ONLY
hdfs://localhost:8020/tmp/temp416260498/tmp1616274076,
+
+Input(s):
+Successfully read 3 records (369 bytes) from:
"hdfs://localhost:8020/user/daijy/2.txt"
+
+Output(s):
+Successfully stored 3 records (33 bytes) in:
"hdfs://localhost:8020/tmp/temp416260498/tmp1616274076"
+
+Counters:
+Total records written : 3
+Total bytes written : 33
+Spillable Memory Manager spill count : 0
+Total bags proactively spilled: 0
+Total records proactively spilled: 0
+
+Job DAG:
+job_201304181449_0004
+
+
+2013-04-18 14:55:20,752 [main] INFO
org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher
- Success!
+2013-04-18 14:55:20,759 [main] INFO
org.apache.hadoop.mapreduce.lib.input.FileInputFormat - Total input paths to
process : 1
+2013-04-18 14:55:20,759 [main] INFO
org.apache.pig.backend.hadoop.executionengine.util.MapRedUtil - Total input
paths to process : 1
Added: hive/trunk/hcatalog/webhcat/svr/src/test/data/status/streaming/stderr
URL:
http://svn.apache.org/viewvc/hive/trunk/hcatalog/webhcat/svr/src/test/data/status/streaming/stderr?rev=1525997&view=auto
==============================================================================
--- hive/trunk/hcatalog/webhcat/svr/src/test/data/status/streaming/stderr
(added)
+++ hive/trunk/hcatalog/webhcat/svr/src/test/data/status/streaming/stderr Tue
Sep 24 20:26:20 2013
@@ -0,0 +1,33 @@
+/**
+ * Licensed to the Apache Software Foundation (ASF) under one
+ * or more contributor license agreements. See the NOTICE file
+ * distributed with this work for additional information
+ * regarding copyright ownership. The ASF licenses this file
+ * to you under the Apache License, Version 2.0 (the
+ * "License"); you may not use this file except in compliance
+ * with the License. You may obtain a copy of the License at
+ *
+ * http://www.apache.org/licenses/LICENSE-2.0
+ *
+ * Unless required by applicable law or agreed to in writing,
+ * software distributed under the License is distributed on an
+ * "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+ * KIND, either express or implied. See the License for the
+ * specific language governing permissions and limitations
+ * under the License.
+ */
+13/05/09 09:58:26 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
+13/05/09 09:58:26 WARN snappy.LoadSnappy: Snappy native library not loaded
+13/05/09 09:58:26 INFO mapred.FileInputFormat: Total input paths to process : 1
+13/05/09 09:58:26 INFO streaming.StreamJob: getLocalDirs():
[/Users/daijy/hadoop-1.0.3/tmp/mapred/local]
+13/05/09 09:58:26 INFO streaming.StreamJob: Running job: job_201305090950_0006
+13/05/09 09:58:26 INFO streaming.StreamJob: To kill this job, run:
+13/05/09 09:58:26 INFO streaming.StreamJob:
/Users/daijy/hadoop-1.0.3/libexec/../bin/hadoop job
-Dmapred.job.tracker=localhost:9001 -kill job_201305090950_0006
+13/05/09 09:58:26 INFO streaming.StreamJob: Tracking URL:
http://localhost:50030/jobdetails.jsp?jobid=job_201305090950_0006
+13/05/09 09:58:27 INFO streaming.StreamJob: map 0% reduce 0%
+13/05/09 09:58:39 INFO streaming.StreamJob: map 50% reduce 0%
+13/05/09 09:58:45 INFO streaming.StreamJob: map 100% reduce 0%
+13/05/09 09:58:48 INFO streaming.StreamJob: map 100% reduce 17%
+13/05/09 09:58:57 INFO streaming.StreamJob: map 100% reduce 100%
+13/05/09 09:59:03 INFO streaming.StreamJob: Job complete: job_201305090950_0006
+13/05/09 09:59:03 INFO streaming.StreamJob: Output: ooo4
