Hudson nightly builds setup
I have setup three nightly Hive builds on the Apache hosted Hudson install, thanks to Dhruba for all the help. Builds, http://hudson.zones.apache.org/hudson/view/Hive/ Hive with hadoop 0.17 Hive with hadoop 0.18 Hive with hadoop 0.19 The builds are fairly simple right now, it only checks out the latest trunk and builds + runs tests against the Hadoop versions mentioned above. We could add Findbugs and Checkstyle checks. Especially findbugs is quite useful, similar to this: http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/violations/ It seems like testCliDriver_udf7 fails for all Hadoop versions and as we know input_3limit.q fails on 0.17. https://issues.apache.org/jira/browse/HIVE-286 http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/ https://issues.apache.org/jira/browse/HIVE-276 http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input3_limit/ /Johan
Re: Hudson nightly builds setup
Forgot to mention, a code coverage tool would also be handy to have. We use Cobertura at Last.fm, works fine, not sure if it would mean any licensing issues to use in Hive. Hadoop uses Clover, don't know much about it. /Johan Johan Oskarsson wrote: I have setup three nightly Hive builds on the Apache hosted Hudson install, thanks to Dhruba for all the help. Builds, http://hudson.zones.apache.org/hudson/view/Hive/ Hive with hadoop 0.17 Hive with hadoop 0.18 Hive with hadoop 0.19 The builds are fairly simple right now, it only checks out the latest trunk and builds + runs tests against the Hadoop versions mentioned above. We could add Findbugs and Checkstyle checks. Especially findbugs is quite useful, similar to this: http://hudson.zones.apache.org/hudson/view/Hadoop/job/Hadoop-trunk/violations/ It seems like testCliDriver_udf7 fails for all Hadoop versions and as we know input_3limit.q fails on 0.17. https://issues.apache.org/jira/browse/HIVE-286 http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/ https://issues.apache.org/jira/browse/HIVE-276 http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_input3_limit/ /Johan
Build failed in Hudson: Hive-trunk-h0.17 #2
See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/2/changes
--
[...truncated 16557 lines...]
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/logs/negative/unknown_column2.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/src/test/results/compiler/errors/unknown_column2.q.out
[junit] Done query: unknown_column2.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120622_190281438.txt
[junit] Begin query: unknown_column3.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/logs/negative/unknown_column3.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/src/test/results/compiler/errors/unknown_column3.q.out
[junit] Done query: unknown_column3.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120622_-1625892409.txt
[junit] Begin query: unknown_column4.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/logs/negative/unknown_column4.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/src/test/results/compiler/errors/unknown_column4.q.out
[junit] Done query: unknown_column4.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120622_-684704271.txt
[junit] Begin query: unknown_column5.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/logs/negative/unknown_column5.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/src/test/results/compiler/errors/unknown_column5.q.out
[junit] Done query: unknown_column5.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120622_-1586880073.txt
[junit] Begin query: unknown_column6.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/build/ql/test/logs/negative/unknown_column6.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/src/test/results/compiler/errors/unknown_column6.q.out
[junit] Done query: unknown_column6.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.17/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120622_-618478929.txt
[junit] Begin query: unknown_function1.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart
Build failed in Hudson: Hive-trunk-h0.19 #2
See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/2/changes
--
[...truncated 18616 lines...]
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column2.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column2.q.out
[junit] Done query: unknown_column2.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120723_-3054318.txt
[junit] Begin query: unknown_column3.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column3.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column3.q.out
[junit] Done query: unknown_column3.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120723_-1622910906.txt
[junit] Begin query: unknown_column4.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column4.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column4.q.out
[junit] Done query: unknown_column4.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120723_-511575734.txt
[junit] Begin query: unknown_column5.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column5.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column5.q.out
[junit] Done query: unknown_column5.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120723_-1091886748.txt
[junit] Begin query: unknown_column6.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column6.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column6.q.out
[junit] Done query: unknown_column6.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120723_-2087931540.txt
[junit] Begin query: unknown_function1.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart
Build failed in Hudson: Hive-trunk-h0.18 #3
See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/3/changes
--
[...truncated 19008 lines...]
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/logs/negative/unknown_column2.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/src/test/results/compiler/errors/unknown_column2.q.out
[junit] Done query: unknown_column2.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120523_-1537300570.txt
[junit] Begin query: unknown_column3.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/logs/negative/unknown_column3.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/src/test/results/compiler/errors/unknown_column3.q.out
[junit] Done query: unknown_column3.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120524_512569647.txt
[junit] Begin query: unknown_column4.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/logs/negative/unknown_column4.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/src/test/results/compiler/errors/unknown_column4.q.out
[junit] Done query: unknown_column4.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120524_-1834776398.txt
[junit] Begin query: unknown_column5.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/logs/negative/unknown_column5.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/src/test/results/compiler/errors/unknown_column5.q.out
[junit] Done query: unknown_column5.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120524_1151480918.txt
[junit] Begin query: unknown_column6.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/build/ql/test/logs/negative/unknown_column6.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/src/test/results/compiler/errors/unknown_column6.q.out
[junit] Done query: unknown_column6.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.18/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120524_-1965332424.txt
[junit] Begin query: unknown_function1.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart
Build failed in Hudson: Hive-trunk-h0.19 #1
See http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/1/changes
--
[...truncated 20169 lines...]
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column2.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column2.q.out
[junit] Done query: unknown_column2.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120318_-1602010568.txt
[junit] Begin query: unknown_column3.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column3.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column3.q.out
[junit] Done query: unknown_column3.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120318_1521768276.txt
[junit] Begin query: unknown_column4.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column4.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column4.q.out
[junit] Done query: unknown_column4.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120318_2072616492.txt
[junit] Begin query: unknown_column5.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column5.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column5.q.out
[junit] Done query: unknown_column5.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120318_1246904004.txt
[junit] Begin query: unknown_column6.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=12}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=11}
[junit] OK
[junit] Loading data to table srcpart partition {ds=2008-04-09, hr=12}
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table srcbucket
[junit] OK
[junit] Loading data to table src
[junit] OK
[junit] diff
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/build/ql/test/logs/negative/unknown_column6.q.out
http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/src/test/results/compiler/errors/unknown_column6.q.out
[junit] Done query: unknown_column6.q
[junit] Hive history
file=http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/ws/hive/ql/../build/ql/tmp/hive_job_log_hudson_200902120318_-1886642870.txt
[junit] Begin query: unknown_function1.q
[junit] Loading data to table srcpart partition {ds=2008-04-08, hr=11}
[junit] OK
[junit] Loading data to table srcpart
[jira] Created: (HIVE-287) [hive] distinct on multiple columns does not work
[hive] distinct on multiple columns does not work - Key: HIVE-287 URL: https://issues.apache.org/jira/browse/HIVE-287 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain The following query does not work: select count(distinct col1, col2) from Tbl -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-283) partition pruning not happening for uppercase table aliases
[ https://issues.apache.org/jira/browse/HIVE-283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo updated HIVE-283: --- Resolution: Fixed Fix Version/s: 0.2.0 Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) committed. partition pruning not happening for uppercase table aliases --- Key: HIVE-283 URL: https://issues.apache.org/jira/browse/HIVE-283 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Affects Versions: 0.2.0 Reporter: Venky Iyer Assignee: Ashish Thusoo Fix For: 0.2.0 Attachments: patch-283.txt With upper case aliases partition pruning breaks. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Created: (HIVE-288) Remove the old serde package
Remove the old serde package Key: HIVE-288 URL: https://issues.apache.org/jira/browse/HIVE-288 Project: Hadoop Hive Issue Type: Improvement Components: Serializers/Deserializers Affects Versions: 0.2.0, 0.3.0 Reporter: Zheng Shao It's not used by Hive any more. Users who need this [probably only inside Facebook] will move this code into their own source trees. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Server time zone !
Is there any 'Server's time zone' implementation inside Hive? For proper implementation of TIMESTAMP data type, this is necessay to translate from stored string type. I am focusing on MySQL 6.0 (with limited properties) for TIMESTAMP. http://dev.mysql.com/doc/refman/6.0/en/timestamp.html Thanks, Shyam
Re: Server time zone !
Not yet. I think JVM take the environment variable TZ for that purpose for all java-related functions. In build-common.xml you should find the following: env key=TZ value=US/Pacific/ This makes sure all current UDFs related to time/date are using the US/Pacific time zone. (Note: all these UDFs are operating on String and Integer types right now) Zheng On Thu, Feb 12, 2009 at 2:21 PM, Shyam Sarkar shyam_sar...@yahoo.comwrote: Is there any 'Server's time zone' implementation inside Hive? For proper implementation of TIMESTAMP data type, this is necessay to translate from stored string type. I am focusing on MySQL 6.0 (with limited properties) for TIMESTAMP. http://dev.mysql.com/doc/refman/6.0/en/timestamp.html Thanks, Shyam -- Yours, Zheng
RE: Server time zone !
You could just use the java.util.TimeZone to get the current timezone. Ashish -Original Message- From: Zheng Shao [mailto:zsh...@gmail.com] Sent: Thursday, February 12, 2009 2:31 PM To: hive-dev@hadoop.apache.org; shyam_sar...@yahoo.com Subject: Re: Server time zone ! Not yet. I think JVM take the environment variable TZ for that purpose for all java-related functions. In build-common.xml you should find the following: env key=TZ value=US/Pacific/ This makes sure all current UDFs related to time/date are using the US/Pacific time zone. (Note: all these UDFs are operating on String and Integer types right now) Zheng On Thu, Feb 12, 2009 at 2:21 PM, Shyam Sarkar shyam_sar...@yahoo.comwrote: Is there any 'Server's time zone' implementation inside Hive? For proper implementation of TIMESTAMP data type, this is necessay to translate from stored string type. I am focusing on MySQL 6.0 (with limited properties) for TIMESTAMP. http://dev.mysql.com/doc/refman/6.0/en/timestamp.html Thanks, Shyam -- Yours, Zheng
[jira] Commented: (HIVE-286) testCliDriver_udf7 fails
[ https://issues.apache.org/jira/browse/HIVE-286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12673098#action_12673098 ] Ashish Thusoo commented on HIVE-286: Seems to be related to precision? diff -a -I \(file:\)\|\(/tmp/.*\) /home/hudson/hudson-slave/workspace/Hive-trunk-h0.19/hive/build/ql/test/logs/clientpositive/udf7.q.out /home/hudson/hudson-slave/workspace/Hive-trunk-h0.19/hive/ql/src/test/results/clientpositive/udf7.q.out 77c77 1.0986122886681098NULLNULL1.0986122886681098 NULLNULL 1.5849625007211563 NULLNULL0.47712125471966244 NULLNULL 1.5849625007211563 NULLNULLNULL-1.07.38905609893065 8.0 8.0 0.125 8.0 2.0 NaN 1.0 --- 1.0986122886681096NULLNULL1.0986122886681096 NULLNULL 1.584962500721156 NULLNULL0.4771212547196623 NULLNULL 1.584962500721156 NULLNULLNULL-1.07.38905609893065 8.0 8.0 0.125 8.0 2.0 NaN 1.0 Exception: Client execution results dailed with error code = 1 testCliDriver_udf7 fails Key: HIVE-286 URL: https://issues.apache.org/jira/browse/HIVE-286 Project: Hadoop Hive Issue Type: Bug Components: Query Processor Environment: Ubuntu, Java6, Hadoop 0.17, 0.18 and 0.19 Reporter: Johan Oskarsson Priority: Blocker Fix For: 0.2.0 The org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_udf7 test fails. See this url for more information: http://hudson.zones.apache.org/hudson/job/Hive-trunk-h0.19/lastBuild/testReport/org.apache.hadoop.hive.cli/TestCliDriver/testCliDriver_udf7/ -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-276) input3_limit.q fails under 0.17
[ https://issues.apache.org/jira/browse/HIVE-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-276: -- Assignee: Ashish Thusoo input3_limit.q fails under 0.17 --- Key: HIVE-276 URL: https://issues.apache.org/jira/browse/HIVE-276 Project: Hadoop Hive Issue Type: Bug Reporter: Zheng Shao Assignee: Ashish Thusoo Attachments: HIVE-276.1.patch The plan ql/src/test/results/clientpositive/input3_limit.q.out shows that there are 2 map-reduce jobs: The first one is distributed and sorted as is specified by the query. The reducer side has LIMIT 20. The second one (single reducer job imposed by LIMIT 20) does not have the same sort order, so the final result is non-deterministic. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HIVE-276) input3_limit.q fails under 0.17
[ https://issues.apache.org/jira/browse/HIVE-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashish Thusoo reassigned HIVE-276: -- Assignee: Zheng Shao (was: Ashish Thusoo) sorry. I thought you were not working on this. input3_limit.q fails under 0.17 --- Key: HIVE-276 URL: https://issues.apache.org/jira/browse/HIVE-276 Project: Hadoop Hive Issue Type: Bug Reporter: Zheng Shao Assignee: Zheng Shao Attachments: HIVE-276.1.patch The plan ql/src/test/results/clientpositive/input3_limit.q.out shows that there are 2 map-reduce jobs: The first one is distributed and sorted as is specified by the query. The reducer side has LIMIT 20. The second one (single reducer job imposed by LIMIT 20) does not have the same sort order, so the final result is non-deterministic. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-79) Print number of rows inserted to table(s) when the query is finished.
[ https://issues.apache.org/jira/browse/HIVE-79?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Antony updated HIVE-79: -- Attachment: patch_79_3.txt 1. Added printing row count to output 2. Also added row count to Query hisory 3. Changing the the test outputs because fileSinkDesc changed. Added table Id to file Sink Descriptor. Print number of rows inserted to table(s) when the query is finished. -- Key: HIVE-79 URL: https://issues.apache.org/jira/browse/HIVE-79 Project: Hadoop Hive Issue Type: New Feature Components: Logging Reporter: Suresh Antony Assignee: Suresh Antony Priority: Minor Fix For: 0.2.0 Attachments: patch_79_1.txt, patch_79_2.txt, patch_79_3.txt It is good to print the number of rows inserted into each table at end of query. insert overwrite table tab1 select a.* from tab2 a where a.col1 = 10; This query can print something like: tab1 rows=100 -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-288) Remove the old serde package
[ https://issues.apache.org/jira/browse/HIVE-288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zheng Shao updated HIVE-288: Attachment: HIVE-288.1.patch Remove the old serde package Key: HIVE-288 URL: https://issues.apache.org/jira/browse/HIVE-288 Project: Hadoop Hive Issue Type: Improvement Components: Serializers/Deserializers Affects Versions: 0.2.0, 0.3.0 Reporter: Zheng Shao Attachments: HIVE-288.1.patch It's not used by Hive any more. Users who need this [probably only inside Facebook] will move this code into their own source trees. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.
Re: hive installation can't find my installed hadoop.
Hi Forbbs, You need to have access to the internet while building hive because it will try to download the hadoop distribution from the web. If you do not have access, you might still be able to do it. Please refer to the documentation of ivy. Zheng On Thu, Feb 12, 2009 at 10:39 PM, forbbs forbbs bbsexclus...@gmail.comwrote: I asked hive-user, but no replies. -- Forwarded message -- From: forbbs forbbs bbsexclus...@gmail.com Date: Mon, Feb 9, 2009 at 5:10 PM Subject: hive installation can't find my installed hadoop. To: hive-u...@hadoop.apache.org I got the source code by svn co http://svn.apache.org/repos/asf/hadoop/hive/trunk hive. When I run ant, it shows: .. [ivy:retrieve] module not found: hadoop#core;0.19.0 [ivy:retrieve] hadoop-resolver: tried [ivy:retrieve] -- artifact hadoop#core;0.19.0!hadoop.tar.gz(source): [ivy:retrieve] http://archive.apache.org/dist/hadoop/core/hadoop-0.19.0/hadoop-0.19.0.tar.gz [ivy:retrieve] :: [ivy:retrieve] :: UNRESOLVED DEPENDENCIES :: [ivy:retrieve] :: [ivy:retrieve] :: hadoop#core;0.19.0: not found [ivy:retrieve] :: [ivy:retrieve] [ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS .. There is hadoop 0.19.0 installed on this computer. And I have set the HADOOP_HOME and HADOOP_VERSION environment variable correctly. It seems that it can't find the installed hadoop, and try to download from the web. But this computer can't access Internet. -- Yours, Zheng
Re: hive installation can't find my installed hadoop.
Hey Zheng, When the 0.2 release is cut for Hive, will that also require access to the internet? Thanks, Jeff On Thu, Feb 12, 2009 at 11:09 PM, Zheng Shao zsh...@gmail.com wrote: Hi Forbbs, You need to have access to the internet while building hive because it will try to download the hadoop distribution from the web. If you do not have access, you might still be able to do it. Please refer to the documentation of ivy. Zheng On Thu, Feb 12, 2009 at 10:39 PM, forbbs forbbs bbsexclus...@gmail.comwrote: I asked hive-user, but no replies. -- Forwarded message -- From: forbbs forbbs bbsexclus...@gmail.com Date: Mon, Feb 9, 2009 at 5:10 PM Subject: hive installation can't find my installed hadoop. To: hive-u...@hadoop.apache.org I got the source code by svn co http://svn.apache.org/repos/asf/hadoop/hive/trunk hive. When I run ant, it shows: .. [ivy:retrieve] module not found: hadoop#core;0.19.0 [ivy:retrieve] hadoop-resolver: tried [ivy:retrieve] -- artifact hadoop#core;0.19.0!hadoop.tar.gz(source): [ivy:retrieve] http://archive.apache.org/dist/hadoop/core/hadoop-0.19.0/hadoop-0.19.0.tar.gz [ivy:retrieve] :: [ivy:retrieve] :: UNRESOLVED DEPENDENCIES :: [ivy:retrieve] :: [ivy:retrieve] :: hadoop#core;0.19.0: not found [ivy:retrieve] :: [ivy:retrieve] [ivy:retrieve] :: USE VERBOSE OR DEBUG MESSAGE LEVEL FOR MORE DETAILS .. There is hadoop 0.19.0 installed on this computer. And I have set the HADOOP_HOME and HADOOP_VERSION environment variable correctly. It seems that it can't find the installed hadoop, and try to download from the web. But this computer can't access Internet. -- Yours, Zheng
