[jira] [Updated] (HIVE-2865) hive-config.sh should honor HIVE_HOME env

2012-03-19 Thread Ashutosh Chauhan (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2865:
---

Resolution: Fixed
Status: Resolved  (was: Patch Available)

 hive-config.sh should honor HIVE_HOME env 
 --

 Key: HIVE-2865
 URL: https://issues.apache.org/jira/browse/HIVE-2865
 Project: Hive
  Issue Type: Improvement
Affects Versions: 0.8.0
Reporter: Giridharan Kesavan
Assignee: Giridharan Kesavan
 Fix For: 0.9.0

 Attachments: HIVE-2865.patch


 hive-config.sh should honor HIVE_HOME env variable if set.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2864) If hive history file's directory doesn't exist don't crash

2012-03-19 Thread Namit Jain (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-2864:
-

  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Committed. Thanks Kevin

 If hive history file's directory doesn't exist don't crash
 --

 Key: HIVE-2864
 URL: https://issues.apache.org/jira/browse/HIVE-2864
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch


 Currently, if the history file's directory does not exist the Hive client 
 crashes.  Instead, since this is not a vital feature, it should just display 
 a warning to the user and continue without it.
 This will become more important once the directory becomes configurable, see:
 https://issues.apache.org/jira/browse/HIVE-1708

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2864) If hive history file's directory doesn't exist don't crash

2012-03-19 Thread Ashutosh Chauhan (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2864:
---

Fix Version/s: 0.9.0

 If hive history file's directory doesn't exist don't crash
 --

 Key: HIVE-2864
 URL: https://issues.apache.org/jira/browse/HIVE-2864
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Fix For: 0.9.0

 Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch


 Currently, if the history file's directory does not exist the Hive client 
 crashes.  Instead, since this is not a vital feature, it should just display 
 a warning to the user and continue without it.
 This will become more important once the directory becomes configurable, see:
 https://issues.apache.org/jira/browse/HIVE-1708

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2471) Add timestamp column to the partition stats table.

2012-03-19 Thread Phabricator (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13232764#comment-13232764
 ] 

Phabricator commented on HIVE-2471:
---

njain has accepted the revision HIVE-2471 [jira] Add timestamp column with 
index to the partition stats table..

  Running tests

REVISION DETAIL
  https://reviews.facebook.net/D2367

BRANCH
  svn


 Add timestamp column to the partition stats table.
 --

 Key: HIVE-2471
 URL: https://issues.apache.org/jira/browse/HIVE-2471
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, 
 HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch


 Occasionally, when entries are added to the partition stats table the program 
 is halted before it can delete those entries, by an exception, keyboard 
 interrupt, etc.  These build up to the point where the table gets very large, 
 and it hurts the performance of the update statement which is often called.  
 In order to fix this, I am adding a column to the table which is 
 auto-populated with the current timestamp.  This will allow us to create 
 scripts that go through periodically and clean out old entries from the table.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23

2012-03-19 Thread Carl Steinbach (Created) (JIRA)
TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
---

 Key: HIVE-2878
 URL: https://issues.apache.org/jira/browse/HIVE-2878
 Project: Hive
  Issue Type: Bug
  Components: Tests
Reporter: Carl Steinbach
Assignee: Carl Steinbach




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23

2012-03-19 Thread Carl Steinbach (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13232989#comment-13232989
 ] 

Carl Steinbach commented on HIVE-2878:
--

On Hadoop 0.20 the 'dfs -count' command outputs a fully qualified file location:

{noformat}
dfs -count /build/ql/test/data/warehouse/hbpartition;
   13  23380 
hdfs://localhost.localdomain:37780/tmp/hbsort/cf
{noformat}

But on 0.23 the file location is not qualified:

{noformat}
dfs -count /build/ql/test/data/warehouse/hbpartition;
   13  24792 /tmp/hbsort/cf
{noformat}

This is a causing a test failure in TestHBaseMinimrCliDriver.hbase_bulk.m


 TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
 ---

 Key: HIVE-2878
 URL: https://issues.apache.org/jira/browse/HIVE-2878
 Project: Hive
  Issue Type: Bug
  Components: Tests
Reporter: Carl Steinbach
Assignee: Carl Steinbach



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23

2012-03-19 Thread Carl Steinbach (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach updated HIVE-2878:
-

Affects Version/s: 0.8.1

 TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
 ---

 Key: HIVE-2878
 URL: https://issues.apache.org/jira/browse/HIVE-2878
 Project: Hive
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.8.1
Reporter: Carl Steinbach
Assignee: Carl Steinbach



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23

2012-03-19 Thread Carl Steinbach (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13232996#comment-13232996
 ] 

Carl Steinbach commented on HIVE-2878:
--

Note: This problem only affects the 0.8.x branch. Trunk already uses different 
code for masking test outputs that prevents this problem from occurring.

 TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
 ---

 Key: HIVE-2878
 URL: https://issues.apache.org/jira/browse/HIVE-2878
 Project: Hive
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.8.1
Reporter: Carl Steinbach
Assignee: Carl Steinbach



--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2878) TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23

2012-03-19 Thread Carl Steinbach (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2878?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach updated HIVE-2878:
-

Attachment: HIVE-2878.br08.1.patch.txt

 TestHBaseMinimrCliDriver hbase_bulk.m fails on 0.23
 ---

 Key: HIVE-2878
 URL: https://issues.apache.org/jira/browse/HIVE-2878
 Project: Hive
  Issue Type: Bug
  Components: Tests
Affects Versions: 0.8.1
Reporter: Carl Steinbach
Assignee: Carl Steinbach
 Attachments: HIVE-2878.br08.1.patch.txt




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Owen O'Malley updated HIVE-2879:


Component/s: Build Infrastructure

 Add rat target to build to look for missing license headers
 -

 Key: HIVE-2879
 URL: https://issues.apache.org/jira/browse/HIVE-2879
 Project: Hive
  Issue Type: Improvement
  Components: Build Infrastructure
Reporter: Owen O'Malley
Assignee: Owen O'Malley

 We should have a rat target that can generate an Apache RAT report. RAT is 
 used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Created) (JIRA)
Add rat target to build to look for missing license headers
-

 Key: HIVE-2879
 URL: https://issues.apache.org/jira/browse/HIVE-2879
 Project: Hive
  Issue Type: Improvement
Reporter: Owen O'Malley
Assignee: Owen O'Malley


We should have a rat target that can generate an Apache RAT report. RAT is 
used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Phabricator (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Phabricator updated HIVE-2879:
--

Attachment: HIVE-2879.D2373.1.patch

omalley requested code review of HIVE-2879 [jira] Add rat target to build to 
look for missing license headers.
Reviewers: JIRA

  Enter Revision Title

  Add rat target to look for missing license headers.

  We should have a rat target that can generate an Apache RAT report. RAT is 
used for finding missing license headers.

TEST PLAN
  EMPTY

REVISION DETAIL
  https://reviews.facebook.net/D2373

AFFECTED FILES
  build.xml
  ivy.xml
  ivy/libraries.properties

MANAGE HERALD DIFFERENTIAL RULES
  https://reviews.facebook.net/herald/view/differential/

WHY DID I GET THIS EMAIL?
  https://reviews.facebook.net/herald/transcript/5319/

Tip: use the X-Herald-Rules header to filter Herald messages in your client.


 Add rat target to build to look for missing license headers
 -

 Key: HIVE-2879
 URL: https://issues.apache.org/jira/browse/HIVE-2879
 Project: Hive
  Issue Type: Improvement
  Components: Build Infrastructure
Reporter: Owen O'Malley
Assignee: Owen O'Malley
 Attachments: HIVE-2879.D2373.1.patch


 We should have a rat target that can generate an Apache RAT report. RAT is 
 used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Commented] (HIVE-2879) Add rat target to build to look for missing license headers

2012-03-19 Thread Owen O'Malley (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13233026#comment-13233026
 ] 

Owen O'Malley commented on HIVE-2879:
-

I got the exclude patterns so that there are only 81 files being reported, most 
of which look like files that should have the header.

 Add rat target to build to look for missing license headers
 -

 Key: HIVE-2879
 URL: https://issues.apache.org/jira/browse/HIVE-2879
 Project: Hive
  Issue Type: Improvement
  Components: Build Infrastructure
Reporter: Owen O'Malley
Assignee: Owen O'Malley
 Attachments: HIVE-2879.D2373.1.patch


 We should have a rat target that can generate an Apache RAT report. RAT is 
 used for finding missing license headers.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Updated] (HIVE-2471) Add timestamp column to the partition stats table.

2012-03-19 Thread Namit Jain (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Namit Jain updated HIVE-2471:
-

  Resolution: Fixed
Hadoop Flags: Reviewed
  Status: Resolved  (was: Patch Available)

Committed. Thanks Kevin

 Add timestamp column to the partition stats table.
 --

 Key: HIVE-2471
 URL: https://issues.apache.org/jira/browse/HIVE-2471
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Attachments: HIVE-2471.1.patch.txt, HIVE-2471.D2367.1.patch, 
 HIVE-2471.D2367.2.patch, HIVE-2471.D2367.3.patch


 Occasionally, when entries are added to the partition stats table the program 
 is halted before it can delete those entries, by an exception, keyboard 
 interrupt, etc.  These build up to the point where the table gets very large, 
 and it hurts the performance of the update statement which is often called.  
 In order to fix this, I am adding a column to the table which is 
 auto-populated with the current timestamp.  This will allow us to create 
 scripts that go through periodically and clean out old entries from the table.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira




[jira] [Created] (HIVE-2880) Fail to create temporary directory when execute bucket map join

2012-03-19 Thread makiet (Created) (JIRA)
Fail to create temporary directory when execute bucket map join
---

 Key: HIVE-2880
 URL: https://issues.apache.org/jira/browse/HIVE-2880
 Project: Hive
  Issue Type: Bug
  Components: SQL
Affects Versions: 0.8.1
 Environment: Cluster with 4 PC: CPU Intel dual core 2.2Ghz, 2Gb ram, 
80G hdd, cent OS 5.0, NIC 100Mbps
1 of them: Namenode + 2nd namenode + job tracker + hive server (also Datanode 
and Task tracker)
3 of them: only datanode + task tracker
All of them could ssh password-less to each other and used the same user 
account: hduser
Reporter: makiet


I have 2 tables

CREATE TABLE data(calling STRING  COMMENT 'Calling number', 
volumn_download BIGINT COMMENT 'Volume download',
volumn_upload BIGINT COMMENT 'Volume upload')
PARTITIONED BY(ds STRING)
CLUSTERED BY (calling) INTO 100 BUCKETS;

CREATE TABLE sub(isdn STRING, sub_id STRING)
CLUSTERED BY (isdn) INTO 100 BUCKETS;

The DATA table has 15m records while SUB table only has 600k records.

The following SQL script were executed successfully:
select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join sub_bucket 
b on a.calling=b.isdn;

But when I used Bucket map join by setting: set hive.optimize.bucketmapjoin = 
true
the above SQL script failed
select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join sub_bucket 
b on a.calling=b.isdn;

hive set hive.optimize.bucketmapjoin = true;
hive select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join 
sub_bucket b on a.calling=b.isdn;
Total MapReduce jobs = 1
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use 
org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Execution log at: 
/tmp/hduser/hduser_20120320080909_8e6a3419-4d2c-4148-a0c9-166d051c8274.log
2012-03-20 08:09:34 Starting to launch local task to process map join; 
maximum memory = 932118528
2012-03-20 08:09:34 End of local task; Time Taken: 0.072 sec.
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Mapred Local Task Succeeded . Convert the Join into MapJoin
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
org.apache.hadoop.util.Shell$ExitCodeException: bash: line 0: cd: 
/u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_2012-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1:
 No such file or directory
tar: Cowardly refusing to create an empty archive
Try `tar --help' or `tar --usage' for more information.

at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
at org.apache.hadoop.util.Shell.run(Shell.java:182)
at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:   
  375)
at org.apache.hadoop.hive.common.FileUtils.tar(FileUtils.java:260)
at 
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:407   
  )
at 
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136   
  )
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.ja   
  va:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:2   
  55)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.   
  java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Job Submission failed with exception 
'org.apache.hadoop.util.Shell$ExitCodeExcep tion(bash: 
line 0: cd: /u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_201   
  
2-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1: No 
such  file or directory
tar: Cowardly refusing to create an empty archive
Try `tar --help' or `tar --usage' for more information.
)'
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at 

[jira] [Updated] (HIVE-2880) Fail to create temporary directory when execute bucket map join

2012-03-19 Thread makiet (Updated) (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

makiet updated HIVE-2880:
-

Description: 
I have 2 tables

CREATE TABLE data(calling STRING  COMMENT 'Calling number', 
volumn_download BIGINT COMMENT 'Volume download',
volumn_upload BIGINT COMMENT 'Volume upload')
PARTITIONED BY(ds STRING)
CLUSTERED BY (calling) INTO 100 BUCKETS;

CREATE TABLE sub(isdn STRING, sub_id STRING)
CLUSTERED BY (isdn) INTO 100 BUCKETS;

The DATA table has 15m records while SUB table only has 600k records.

The following SQL script were executed successfully:
select /*+ MAPJOIN(b) */ a.calling, b.sub_id from data a join sub b on 
a.calling=b.isdn;

But when I used Bucket map join by setting: set hive.optimize.bucketmapjoin = 
true
the above SQL script failed
select /*+ MAPJOIN(b) */ a.calling, b.sub_id from data a join sub b on 
a.calling=b.isdn;

hive set hive.optimize.bucketmapjoin = true;
hive select /*+ MAPJOIN(b) */ a.calling, b.sub_id from ggsn_bucket a join 
sub_bucket b on a.calling=b.isdn;
Total MapReduce jobs = 1
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use 
org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Execution log at: 
/tmp/hduser/hduser_20120320080909_8e6a3419-4d2c-4148-a0c9-166d051c8274.log
2012-03-20 08:09:34 Starting to launch local task to process map join; 
maximum memory = 932118528
2012-03-20 08:09:34 End of local task; Time Taken: 0.072 sec.
Execution completed successfully
Mapred Local Task Succeeded . Convert the Join into MapJoin
Mapred Local Task Succeeded . Convert the Join into MapJoin
Launching Job 1 out of 1
Number of reduce tasks is set to 0 since there's no reduce operator
org.apache.hadoop.util.Shell$ExitCodeException: bash: line 0: cd: 
/u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_2012-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1:
 No such file or directory
tar: Cowardly refusing to create an empty archive
Try `tar --help' or `tar --usage' for more information.

at org.apache.hadoop.util.Shell.runCommand(Shell.java:255)
at org.apache.hadoop.util.Shell.run(Shell.java:182)
at 
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:   
  375)
at org.apache.hadoop.hive.common.FileUtils.tar(FileUtils.java:260)
at 
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:407   
  )
at 
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136   
  )
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
at 
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.ja   
  va:57)
at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1332)
at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1123)
at org.apache.hadoop.hive.ql.Driver.run(Driver.java:931)
at 
org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:2   
  55)
at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:212)
at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:403)
at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:671)
at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:554)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.   
  java:39)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Job Submission failed with exception 
'org.apache.hadoop.util.Shell$ExitCodeException(bash: line 0: cd: 
/u01/app/hduser/hadoop-0.20.203.0/tempdir/hduser/hive_2012-03-20_08-09-27_810_1393729636696443501/-local-10002/HashTable-Stage-1:
 No such file or directory
tar: Cowardly refusing to create an empty archive
Try `tar --help' or `tar --usage' for more information.
)'
java.lang.IllegalArgumentException: Can not create a Path from an empty string
at org.apache.hadoop.fs.Path.checkPathArg(Path.java:82)
at org.apache.hadoop.fs.Path.init(Path.java:90)
at 
org.apache.hadoop.hive.ql.exec.Utilities.getHiveJobID(Utilities.java:   
  379)
at 
org.apache.hadoop.hive.ql.exec.Utilities.clearMapRedWork(Utilities.ja   
  va:192)
at 
org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:476   
  )
at 
org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:136   
  )
at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:133)
at 

[jira] [Commented] (HIVE-2864) If hive history file's directory doesn't exist don't crash

2012-03-19 Thread Hudson (Commented) (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13233105#comment-13233105
 ] 

Hudson commented on HIVE-2864:
--

Integrated in Hive-trunk-h0.21 #1321 (See 
[https://builds.apache.org/job/Hive-trunk-h0.21/1321/])
HIVE-2864 If hive history file's directory doesn't exist don't crash
(Kevin Wilfong via namit) (Revision 1302550)

 Result = SUCCESS
namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1302550
Files : 
* /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java


 If hive history file's directory doesn't exist don't crash
 --

 Key: HIVE-2864
 URL: https://issues.apache.org/jira/browse/HIVE-2864
 Project: Hive
  Issue Type: Improvement
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
 Fix For: 0.9.0

 Attachments: HIVE-2864.D2265.1.patch, HIVE-2864.D2265.2.patch


 Currently, if the history file's directory does not exist the Hive client 
 crashes.  Instead, since this is not a vital feature, it should just display 
 a warning to the user and continue without it.
 This will become more important once the directory becomes configurable, see:
 https://issues.apache.org/jira/browse/HIVE-1708

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira