[jira] [Commented] (HIVE-2646) Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs
[ https://issues.apache.org/jira/browse/HIVE-2646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271149#comment-13271149 ] Hudson commented on HIVE-2646: -- Integrated in Hive-0.9.1-SNAPSHOT-h0.21 #10 (See [https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/10/]) HIVE-2646 : merged in from trunk. Fix for LANG setting for test environment. (Thomas Weise via Ashutosh Chauhan) (Revision 1335774) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1335774 Files : * /hive/branches/branch-0.9 * /hive/branches/branch-0.9/build-common.xml Hive Ivy dependencies on Hadoop should depend on jars directly, not tarballs Key: HIVE-2646 URL: https://issues.apache.org/jira/browse/HIVE-2646 Project: Hive Issue Type: Bug Components: Build Infrastructure Affects Versions: 0.8.0 Reporter: Andrew Bayer Assignee: Andrew Bayer Priority: Critical Fix For: 0.10.0, 0.9.1 Attachments: HIVE-2646-fixtests.patch, HIVE-2646-fixtests.txt, HIVE-2646.D2133.1.patch, HIVE-2646.D2133.10.patch, HIVE-2646.D2133.11.patch, HIVE-2646.D2133.12.patch, HIVE-2646.D2133.13.patch, HIVE-2646.D2133.14.patch, HIVE-2646.D2133.15.patch, HIVE-2646.D2133.2.patch, HIVE-2646.D2133.3.patch, HIVE-2646.D2133.4.patch, HIVE-2646.D2133.5.patch, HIVE-2646.D2133.6.patch, HIVE-2646.D2133.7.patch, HIVE-2646.D2133.8.patch, HIVE-2646.D2133.9.patch, HIVE-2646.D2883.1.patch, HIVE-2646.D2883.2.patch, HIVE-2646.D2883.3.patch, HIVE-2646.diff.txt, HIVE-2646_LANG.patch The current Hive Ivy dependency logic for its Hadoop dependencies is problematic - depending on the tarball and extracting the jars from there, rather than depending on the jars directly. It'd be great if this was fixed to actually have the jar dependencies defined directly. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21 #10
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/10/changes Changes: [hashutosh] HIVE-2646 : merged in from trunk. Fix for LANG setting for test environment. (Thomas Weise via Ashutosh Chauhan) -- [...truncated 36537 lines...] [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2012-05-08_23-26-34_954_7821528827966187934/-mr-1 [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/10/artifact/hive/build/service/tmp/hive_job_log_hudson_201205082326_1896887206.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] Copying file: https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/ws/hive/data/files/kv1.txt [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (num int) [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: load data local inpath 'https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Output: default@testhivedrivertable [junit] Copying data from https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/ws/hive/data/files/kv1.txt [junit] Loading data to table default.testhivedrivertable [junit] POSTHOOK: query: load data local inpath 'https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: select * from testhivedrivertable limit 10 [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2012-05-08_23-26-40_635_2779749457828211963/-mr-1 [junit] POSTHOOK: query: select * from testhivedrivertable limit 10 [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2012-05-08_23-26-40_635_2779749457828211963/-mr-1 [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/10/artifact/hive/build/service/tmp/hive_job_log_hudson_201205082326_366515088.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (num int) [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/10/artifact/hive/build/service/tmp/hive_job_log_hudson_201205082326_631340555.txt [junit] Hive history file=https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/10/artifact/hive/build/service/tmp/hive_job_log_hudson_201205082326_2060626785.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK:
Re: Problems with Arc/Phabricator
Has the phabricator site stopped working for anyone else? As of today I'm
not longer able to view review requests. For example:
https://reviews.facebook.net/D3075
Produces the following output:
br /
bFatal error/b: Undefined class constant 'COMMITTED' in
b/var/www/reviews.facebook.net/phabricator/src/applications/differential/storage/revision/DifferentialRevision.php/b
on line b209/bbr /
UNRECOVERABLE FATAL ERROR
Undefined class constant #039;COMMITTED#039;
/var/www/reviews.facebook.net/phabricator/src/applications/differential/storage/revision/DifferentialRevision.php:209
┻━┻ ︵ ¯\_(ツ)_/¯ ︵ ┻━┻
Any help would be much appreciated.
Thanks.
Carl
On Tue, May 8, 2012 at 1:47 PM, Ashutosh Chauhan hashut...@apache.orgwrote:
Made some progress on using arc/phab on ubuntu. epriestley helped a ton
over at #phabricator irc channel. Thanks, Evan!
Now, able to make arc work on ubuntu, but seems like jira integration is
broken. Hit the following problem:
$arc diff —jira HIVE-3008
PHP Fatal error: Class 'ArcanistDifferentialRevisionRef' not found in
/home/ashutosh/workspace/.arc_jira_lib/arcanist/ArcJIRAConfiguration.php on
line 201
Fatal error: Class 'ArcanistDifferentialRevisionRef' not found in
/home/ashutosh/workspace/.arc_jira_lib/arcanist/ArcJIRAConfiguration.php on
line 201
Even with this error diff did get generated but it was not posted back on
jira. Evan is working on a patch to fix this.
He is also discussing with Facebook folks on how to tackle these issues in
long term. Discussion is going on at https://secure.phabricator.com/T1206
I will request people who are actively working on Hive to follow the
discussion on this ticket.
Thanks,
Ashutosh
On Thu, Apr 19, 2012 at 5:24 PM, Ashutosh Chauhan hashut...@apache.org
wrote:
Problem while using arc on ubuntu
$ arc patch D2871
ARC: Cannot mix P and A
UNIX: No such file or directory
Any ideas whats up there.
Thanks,
Ashutosh
On Thu, Apr 19, 2012 at 17:19, Edward Capriolo edlinuxg...@gmail.com
wrote:
Just throwing this out there. The phabricator IRC has more people and
is usually more active then Hive IRC.
#JustSaying...
On Thu, Apr 19, 2012 at 7:35 PM, Ashutosh Chauhan hashut...@apache.org
wrote:
Hit a new problem with arc today:
Fatal error: Uncaught exception 'Exception' with message 'Host
returned
HTTP/200, but invalid JSON data in response to a Conduit method call:
br /
bWarning/b: Unknown: POST Content-Length of 9079953 bytes exceeds
the
limit of 8388608 bytes in bUnknown/b on line b0/bbr /
for(;;);{result:null,error_code:ERR-INVALID-SESSION,error_info:Session
key is not present.}' in
/Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitFuture.php:48
Stack trace:
#0
/Users/ashutosh/work/hive/libphutil/src/future/proxy/FutureProxy.php(62):
ConduitFuture-didReceiveResult(Array)
#1
/Users/ashutosh/work/hive/libphutil/src/future/proxy/FutureProxy.php(39):
FutureProxy-getResult()
#2
/Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitClient.php(52):
FutureProxy-resolve()
#3
/Users/ashutosh/work/hive/arcanist/src/workflow/diff/ArcanistDiffWorkflow.php(341):
ConduitClient-callMethodSynchronous('differential.cr...', Array)
#4 /Users/ashutosh/work/hive/arcanist/scripts/arcanist.php(266):
ArcanistDiffWo in
/Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitFuture.php on
line 48
Any ideas how to solve this?
Thanks,
Ashutosh
On Wed, Apr 11, 2012 at 18:37, Edward Capriolo edlinuxg...@gmail.com
wrote:
I think the most practical solution is try and use arc/phab and then
if there is a problem fall back to Jira and do it the old way.
Edward
On Wed, Apr 11, 2012 at 7:17 PM, Carl Steinbach c...@cloudera.com
wrote:
+1 to switching over to Git.
As for the rest of the Phabricator/Gerrit/Reviewboard discussion, I
think
we should pick this up again at the contributor meeting on
Wednesday.
Thanks.
Carl
On Wed, Apr 11, 2012 at 12:19 PM, Ashutosh Chauhan
hashut...@apache.org
wrote:
+1 on moving away from arc/phabricator. It works great when it
works,
but
most of the time it doesnt work.
Ashutosh
On Wed, Apr 11, 2012 at 11:57, Owen O'Malley omal...@apache.org
wrote:
On Wed, Apr 11, 2012 at 11:48 AM, Edward Capriolo
edlinuxg...@gmail.com
wrote:
If we are going to switch from fabricator we just might as
well
go
back to not using anything. Review board was really clunky and
confusing.
I'm mostly +1 to that. If no one is supporting phabricator, then
it
won't work for long. Personally, I'd love it if we could move
Hive to
git completely. Has anyone used gerrit? The videos of it make it
look
better than sliced bread.
-- Owen
Re: Problems with Arc/Phabricator
Me too.
arc diff --trace
..
PHP Fatal error: Uncaught exception 'HTTPFutureResponseStatusHTTP'
with message '[HTTP/500]' in
/home/navis/bin/libphutil/src/future/http/base/BaseHTTPFuture.php:299
Stack trace:
#0 /home/navis/bin/libphutil/src/future/http/https/HTTPSFuture.php(95):
BaseHTTPFuture-parseRawHTTPResponse('HTTP/1.1 100 Co...')
#1 /home/navis/bin/libphutil/src/future/proxy/FutureProxy.php(34):
HTTPSFuture-isReady()
#2 /home/navis/bin/libphutil/src/conduit/client/ConduitClient.php(131):
FutureProxy-isReady()
#3 /home/navis/bin/libphutil/src/conduit/client/ConduitClient.php(52):
ConduitClient-callMethod('differential.cr...', Array)
#4 /home/navis/bin/arcanist/src/workflow/diff/ArcanistDiffWorkflow.php(324):
ConduitClient-callMethodSynchronous('differential.cr...', Array)
#5 /home/navis/bin/arcanist/scripts/arcanist.php(266):
ArcanistDiffWorkflow-run()
#6 {main}
thrown in /home/navis/bin/libphutil/src/future/http/base/BaseHTTPFuture.php
on line 299
2012/5/9 Carl Steinbach c...@cloudera.com:
Has the phabricator site stopped working for anyone else? As of today I'm
not longer able to view review requests. For example:
https://reviews.facebook.net/D3075
Produces the following output:
br /
bFatal error/b: Undefined class constant 'COMMITTED' in
b/var/www/reviews.facebook.net/phabricator/src/applications/differential/storage/revision/DifferentialRevision.php/b
on line b209/bbr /
UNRECOVERABLE FATAL ERROR
Undefined class constant #039;COMMITTED#039;
/var/www/reviews.facebook.net/phabricator/src/applications/differential/storage/revision/DifferentialRevision.php:209
┻━┻ ︵ ¯\_(ツ)_/¯ ︵ ┻━┻
Any help would be much appreciated.
Thanks.
Carl
On Tue, May 8, 2012 at 1:47 PM, Ashutosh Chauhan hashut...@apache.orgwrote:
Made some progress on using arc/phab on ubuntu. epriestley helped a ton
over at #phabricator irc channel. Thanks, Evan!
Now, able to make arc work on ubuntu, but seems like jira integration is
broken. Hit the following problem:
$arc diff —jira HIVE-3008
PHP Fatal error: Class 'ArcanistDifferentialRevisionRef' not found in
/home/ashutosh/workspace/.arc_jira_lib/arcanist/ArcJIRAConfiguration.php on
line 201
Fatal error: Class 'ArcanistDifferentialRevisionRef' not found in
/home/ashutosh/workspace/.arc_jira_lib/arcanist/ArcJIRAConfiguration.php on
line 201
Even with this error diff did get generated but it was not posted back on
jira. Evan is working on a patch to fix this.
He is also discussing with Facebook folks on how to tackle these issues in
long term. Discussion is going on at https://secure.phabricator.com/T1206
I will request people who are actively working on Hive to follow the
discussion on this ticket.
Thanks,
Ashutosh
On Thu, Apr 19, 2012 at 5:24 PM, Ashutosh Chauhan hashut...@apache.org
wrote:
Problem while using arc on ubuntu
$ arc patch D2871
ARC: Cannot mix P and A
UNIX: No such file or directory
Any ideas whats up there.
Thanks,
Ashutosh
On Thu, Apr 19, 2012 at 17:19, Edward Capriolo edlinuxg...@gmail.com
wrote:
Just throwing this out there. The phabricator IRC has more people and
is usually more active then Hive IRC.
#JustSaying...
On Thu, Apr 19, 2012 at 7:35 PM, Ashutosh Chauhan hashut...@apache.org
wrote:
Hit a new problem with arc today:
Fatal error: Uncaught exception 'Exception' with message 'Host
returned
HTTP/200, but invalid JSON data in response to a Conduit method call:
br /
bWarning/b: Unknown: POST Content-Length of 9079953 bytes exceeds
the
limit of 8388608 bytes in bUnknown/b on line b0/bbr /
for(;;);{result:null,error_code:ERR-INVALID-SESSION,error_info:Session
key is not present.}' in
/Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitFuture.php:48
Stack trace:
#0
/Users/ashutosh/work/hive/libphutil/src/future/proxy/FutureProxy.php(62):
ConduitFuture-didReceiveResult(Array)
#1
/Users/ashutosh/work/hive/libphutil/src/future/proxy/FutureProxy.php(39):
FutureProxy-getResult()
#2
/Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitClient.php(52):
FutureProxy-resolve()
#3
/Users/ashutosh/work/hive/arcanist/src/workflow/diff/ArcanistDiffWorkflow.php(341):
ConduitClient-callMethodSynchronous('differential.cr...', Array)
#4 /Users/ashutosh/work/hive/arcanist/scripts/arcanist.php(266):
ArcanistDiffWo in
/Users/ashutosh/work/hive/libphutil/src/conduit/client/ConduitFuture.php on
line 48
Any ideas how to solve this?
Thanks,
Ashutosh
On Wed, Apr 11, 2012 at 18:37, Edward Capriolo edlinuxg...@gmail.com
wrote:
I think the most practical solution is try and use arc/phab and then
if there is a problem fall back to Jira and do it the old way.
Edward
On Wed, Apr 11, 2012 at 7:17 PM, Carl Steinbach c...@cloudera.com
wrote:
+1 to switching over to Git.
As for the rest of the
Re: Problems with Arc/Phabricator
Regarding the reviews.facebook.net website, I tried just now and it seems to be working for me; here's a screenshot of what I get for https://reviews.facebook.net/D3075: http://i.imgur.com/umHlB.png JVS
Re: Problems with Arc/Phabricator
Hi John, Thanks for checking. I got the page to load again after clearing my browser's cache. Carl On Wed, May 9, 2012 at 12:17 AM, John Sichi jsi...@gmail.com wrote: Regarding the reviews.facebook.net website, I tried just now and it seems to be working for me; here's a screenshot of what I get for https://reviews.facebook.net/D3075: http://i.imgur.com/umHlB.png JVS
Re: Problems with Arc/Phabricator
Actually, I take that back. After logging in I'm now back to the original error message. On Wed, May 9, 2012 at 12:22 AM, Carl Steinbach c...@cloudera.com wrote: Hi John, Thanks for checking. I got the page to load again after clearing my browser's cache. Carl On Wed, May 9, 2012 at 12:17 AM, John Sichi jsi...@gmail.com wrote: Regarding the reviews.facebook.net website, I tried just now and it seems to be working for me; here's a screenshot of what I get for https://reviews.facebook.net/D3075: http://i.imgur.com/umHlB.png JVS
Re: Problems with Arc/Phabricator
Doesn't work for me either. I see error message. Ashutosh On Wed, May 9, 2012 at 12:24 AM, Carl Steinbach c...@cloudera.com wrote: Actually, I take that back. After logging in I'm now back to the original error message. On Wed, May 9, 2012 at 12:22 AM, Carl Steinbach c...@cloudera.com wrote: Hi John, Thanks for checking. I got the page to load again after clearing my browser's cache. Carl On Wed, May 9, 2012 at 12:17 AM, John Sichi jsi...@gmail.com wrote: Regarding the reviews.facebook.net website, I tried just now and it seems to be working for me; here's a screenshot of what I get for https://reviews.facebook.net/D3075: http://i.imgur.com/umHlB.png JVS
Re: Problems with Arc/Phabricator
Actually I was able to reproduce it...I had to be logged in to hit the problem. On Wed, May 9, 2012 at 12:17 AM, John Sichi jsi...@gmail.com wrote: Regarding the reviews.facebook.net website, I tried just now and it seems to be working for me; here's a screenshot of what I get for https://reviews.facebook.net/D3075: http://i.imgur.com/umHlB.png JVS
Build failed in Jenkins: Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false #11
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/ -- [...truncated 10108 lines...] [echo] Project: odbc [copy] Warning: https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/odbc/src/conf does not exist. ivy-resolve-test: [echo] Project: odbc ivy-retrieve-test: [echo] Project: odbc compile-test: [echo] Project: odbc create-dirs: [echo] Project: serde [copy] Warning: https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/serde/src/test/resources does not exist. init: [echo] Project: serde ivy-init-settings: [echo] Project: serde ivy-resolve: [echo] Project: serde [ivy:resolve] :: loading settings :: file = https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/ivy/ivysettings.xml [ivy:report] Processing https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/ivy/resolution-cache/org.apache.hive-hive-serde-default.xml to https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/ivy/report/org.apache.hive-hive-serde-default.html ivy-retrieve: [echo] Project: serde dynamic-serde: compile: [echo] Project: serde ivy-resolve-test: [echo] Project: serde ivy-retrieve-test: [echo] Project: serde compile-test: [echo] Project: serde [javac] Compiling 26 source files to https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/serde/test/classes [javac] Note: Some input files use or override a deprecated API. [javac] Note: Recompile with -Xlint:deprecation for details. [javac] Note: Some input files use unchecked or unsafe operations. [javac] Note: Recompile with -Xlint:unchecked for details. create-dirs: [echo] Project: service [copy] Warning: https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/service/src/test/resources does not exist. init: [echo] Project: service ivy-init-settings: [echo] Project: service ivy-resolve: [echo] Project: service [ivy:resolve] :: loading settings :: file = https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/ivy/ivysettings.xml [ivy:report] Processing https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/ivy/resolution-cache/org.apache.hive-hive-service-default.xml to https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/ivy/report/org.apache.hive-hive-service-default.html ivy-retrieve: [echo] Project: service compile: [echo] Project: service ivy-resolve-test: [echo] Project: service ivy-retrieve-test: [echo] Project: service compile-test: [echo] Project: service [javac] Compiling 2 source files to https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/service/test/classes test: [echo] Project: hive test-shims: [echo] Project: hive test-conditions: [echo] Project: shims gen-test: [echo] Project: shims create-dirs: [echo] Project: shims [copy] Warning: https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/shims/src/test/resources does not exist. init: [echo] Project: shims ivy-init-settings: [echo] Project: shims ivy-resolve: [echo] Project: shims [ivy:resolve] :: loading settings :: file = https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/ivy/ivysettings.xml [ivy:report] Processing https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/ivy/resolution-cache/org.apache.hive-hive-shims-default.xml to https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/ivy/report/org.apache.hive-hive-shims-default.html ivy-retrieve: [echo] Project: shims compile: [echo] Project: shims [echo] Building shims 0.20 build_shims: [echo] Project: shims [echo] Compiling https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/shims/src/common/java;/home/jenkins/jenkins-slave/workspace/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/hive/shims/src/0.20/java against hadoop 0.20.2 (https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/11/artifact/hive/build/hadoopcore/hadoop-0.20.2) ivy-init-settings: [echo] Project: shims ivy-resolve-hadoop-shim: [echo] Project: shims [ivy:resolve] :: loading settings :: file = https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21-keepgoing=false/ws/hive/ivy/ivysettings.xml ivy-retrieve-hadoop-shim: [echo] Project: shims [echo] Building shims 0.20S build_shims: [echo] Project: shims [echo] Compiling
[jira] [Updated] (HIVE-2956) [hive] Provide error message when using UDAF in the place of UDF instead of throwing NPE
[
https://issues.apache.org/jira/browse/HIVE-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kevin Wilfong updated HIVE-2956:
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed, thanks Navis.
[hive] Provide error message when using UDAF in the place of UDF instead of
throwing NPE
Key: HIVE-2956
URL: https://issues.apache.org/jira/browse/HIVE-2956
Project: Hive
Issue Type: Improvement
Reporter: Navis
Assignee: Navis
Priority: Trivial
Attachments: HIVE-2956.D2823.1.patch, HIVE-2956.D2823.2.patch,
HIVE-2956.D2823.3.patch
For example,
{code}
hive select distinct deptno, sum(deptno) from emp;
FAILED: Hive Internal Error: java.lang.NullPointerException(null)
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:214)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:767)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:888)
at
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:125)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode(TypeCheckProcFactory.java:165)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7755)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7713)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapGroupByOperator(SemanticAnalyzer.java:2793)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapAggr1MR(SemanticAnalyzer.java:3651)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:6125)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6762)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7531)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250)
{code}
Trivial.. but people always reports this confused by esoteric custom function
names.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2956) [hive] Provide error message when using UDAF in the place of UDF instead of throwing NPE
[
https://issues.apache.org/jira/browse/HIVE-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ashutosh Chauhan updated HIVE-2956:
---
Fix Version/s: 0.10.0
[hive] Provide error message when using UDAF in the place of UDF instead of
throwing NPE
Key: HIVE-2956
URL: https://issues.apache.org/jira/browse/HIVE-2956
Project: Hive
Issue Type: Improvement
Reporter: Navis
Assignee: Navis
Priority: Trivial
Fix For: 0.10.0
Attachments: HIVE-2956.D2823.1.patch, HIVE-2956.D2823.2.patch,
HIVE-2956.D2823.3.patch
For example,
{code}
hive select distinct deptno, sum(deptno) from emp;
FAILED: Hive Internal Error: java.lang.NullPointerException(null)
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:214)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:767)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:888)
at
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:125)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode(TypeCheckProcFactory.java:165)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7755)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7713)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapGroupByOperator(SemanticAnalyzer.java:2793)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapAggr1MR(SemanticAnalyzer.java:3651)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:6125)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6762)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7531)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250)
{code}
Trivial.. but people always reports this confused by esoteric custom function
names.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3012: - Status: Patch Available (was: Open) hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271677#comment-13271677 ] Namit Jain commented on HIVE-3012: -- https://reviews.facebook.net/D3099 hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-3012: -- Attachment: HIVE-3012.D3099.1.patch njain requested code review of HIVE-3012 [jira] hive custom scripts do not work well if the data contains new lines. Reviewers: JIRA https://issues.apache.org/jira/browse/HIVE-3012 HIVE-3012 hive custom scripts do not work well if the data contains new lines If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D3099 AFFECTED FILES data/scripts/newline.py common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ql/src/test/results/clientpositive/newline.q.out ql/src/test/queries/clientpositive/newline.q ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java ql/src/java/org/apache/hadoop/hive/ql/exec/TextRecordReader.java ql/src/java/org/apache/hadoop/hive/ql/exec/TextRecordWriter.java MANAGE HERALD DIFFERENTIAL RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/7047/ Tip: use the X-Herald-Rules header to filter Herald messages in your client. hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271703#comment-13271703 ] Phabricator commented on HIVE-3012: --- kevinwilfong has commented on the revision HIVE-3012 [jira] hive custom scripts do not work well if the data contains new lines. INLINE COMMENTS ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java:100-119 Rather than use methods here, wouldn't it be easier to just use a final static variable? E.g. static final byte[] newLineEscapeBytes = \\n.getBytes(); common/src/java/org/apache/hadoop/hive/conf/HiveConf.java:393 Could you add this to conf/hive-default.xml.template with a description of what it does? REVISION DETAIL https://reviews.facebook.net/D3099 hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-3013) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly
Namit Jain created HIVE-3013: Summary: TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly Key: HIVE-3013 URL: https://issues.apache.org/jira/browse/HIVE-3013 Project: Hive Issue Type: Bug Reporter: Namit Jain -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-3013) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly
[ https://issues.apache.org/jira/browse/HIVE-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-3013: Assignee: Namit Jain TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly -- Key: HIVE-3013 URL: https://issues.apache.org/jira/browse/HIVE-3013 Project: Hive Issue Type: Bug Reporter: Namit Jain Assignee: Namit Jain -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3013) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly
[ https://issues.apache.org/jira/browse/HIVE-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3013: - Attachment: hive.3013.1.patch TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly -- Key: HIVE-3013 URL: https://issues.apache.org/jira/browse/HIVE-3013 Project: Hive Issue Type: Bug Reporter: Namit Jain Assignee: Namit Jain Attachments: hive.3013.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3013) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly
[ https://issues.apache.org/jira/browse/HIVE-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-3013: - Status: Patch Available (was: Open) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly -- Key: HIVE-3013 URL: https://issues.apache.org/jira/browse/HIVE-3013 Project: Hive Issue Type: Bug Reporter: Namit Jain Assignee: Namit Jain Attachments: hive.3013.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3013) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly
[ https://issues.apache.org/jira/browse/HIVE-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271744#comment-13271744 ] Ashutosh Chauhan commented on HIVE-3013: @Namit, Since setting up debugging from eclipse requires few steps. It will also be good to have them documented at wiki for reference at https://cwiki.apache.org/confluence/display/Hive/HiveDeveloperFAQ With those steps documented we possibly have fewer breakages like this in future. TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly -- Key: HIVE-3013 URL: https://issues.apache.org/jira/browse/HIVE-3013 Project: Hive Issue Type: Bug Reporter: Namit Jain Assignee: Namit Jain Attachments: hive.3013.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3013) TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly
[ https://issues.apache.org/jira/browse/HIVE-3013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-3013: - Status: Open (was: Patch Available) @Namit: I get a bunch of missing required library errors after importing the project into Eclipse. Looks like eclipse-files/.classpath needs to be updated. TestCliDriver cannot be debugged with eclipse since hadoop_home is set wrongly -- Key: HIVE-3013 URL: https://issues.apache.org/jira/browse/HIVE-3013 Project: Hive Issue Type: Bug Reporter: Namit Jain Assignee: Namit Jain Attachments: hive.3013.1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271759#comment-13271759 ] Ashutosh Chauhan commented on HIVE-3012: This has been fixed upstream: https://issues.apache.org/jira/browse/HADOOP-7096 If thats there, do we still need this? hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Problems with Arc/Phabricator
I'm able to load reviews again, but haven't yet tried submitting a new one with Arc. Anyone else still experiencing problems? Out of curiosity, was this problem visible on the FB side? Did mentioning the issue on this list actually trigger the resolution? Thanks. Carl On Wed, May 9, 2012 at 1:54 AM, John Sichi jsi...@gmail.com wrote: Actually I was able to reproduce it...I had to be logged in to hit the problem. On Wed, May 9, 2012 at 12:17 AM, John Sichi jsi...@gmail.com wrote: Regarding the reviews.facebook.net website, I tried just now and it seems to be working for me; here's a screenshot of what I get for https://reviews.facebook.net/D3075: http://i.imgur.com/umHlB.png JVS
[jira] [Issue Comment Edited] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271759#comment-13271759 ] Ashutosh Chauhan edited comment on HIVE-3012 at 5/9/12 8:18 PM: This has been fixed upstream: HADOOP-7096 If thats there, do we still need this? was (Author: ashutoshc): This has been fixed upstream: https://issues.apache.org/jira/browse/HADOOP-7096 If thats there, do we still need this? hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
Jenkins build is back to normal : Hive-0.9.1-SNAPSHOT-h0.21 #11
See https://builds.apache.org/job/Hive-0.9.1-SNAPSHOT-h0.21/11/
[jira] [Updated] (HIVE-2757) hive can't find hadoop executor scripts without HADOOP_HOME set
[ https://issues.apache.org/jira/browse/HIVE-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Roman Shaposhnik updated HIVE-2757: --- Attachment: HIVE-2757-2.patch.txt hive can't find hadoop executor scripts without HADOOP_HOME set --- Key: HIVE-2757 URL: https://issues.apache.org/jira/browse/HIVE-2757 Project: Hive Issue Type: Bug Components: CLI Affects Versions: 0.8.0 Reporter: Roman Shaposhnik Attachments: HIVE-2757-2.patch.txt, HIVE-2757.D3075.1.patch, HIVE-2757.patch.txt, HIVE-2757.patch.txt, hive-2757.diff The trouble is that in Hadoop 0.23 HADOOP_HOME has been deprecated. I think it would be really nice if bin/hive can be modified to capture the which hadoop and pass that as a property into the JVM. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2757) hive can't find hadoop executor scripts without HADOOP_HOME set
[ https://issues.apache.org/jira/browse/HIVE-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271820#comment-13271820 ] Roman Shaposhnik commented on HIVE-2757: Attaching a patch that incorporated all the feedback from the reviews and also got tested. Attaching here since FB is broken. hive can't find hadoop executor scripts without HADOOP_HOME set --- Key: HIVE-2757 URL: https://issues.apache.org/jira/browse/HIVE-2757 Project: Hive Issue Type: Bug Components: CLI Affects Versions: 0.8.0 Reporter: Roman Shaposhnik Attachments: HIVE-2757-2.patch.txt, HIVE-2757.D3075.1.patch, HIVE-2757.patch.txt, HIVE-2757.patch.txt, hive-2757.diff The trouble is that in Hadoop 0.23 HADOOP_HOME has been deprecated. I think it would be really nice if bin/hive can be modified to capture the which hadoop and pass that as a property into the JVM. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271827#comment-13271827 ] Namit Jain commented on HIVE-3012: -- We still need it - a lot of hive clients are using a older hadoop version hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch, HIVE-3012.D3099.2.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-3012: -- Attachment: HIVE-3012.D3099.2.patch njain updated the revision HIVE-3012 [jira] hive custom scripts do not work well if the data contains new lines. Reviewers: JIRA Comments REVISION DETAIL https://reviews.facebook.net/D3099 AFFECTED FILES data/scripts/newline.py common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ql/src/test/results/clientpositive/newline.q.out ql/src/test/queries/clientpositive/newline.q ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java ql/src/java/org/apache/hadoop/hive/ql/exec/TextRecordReader.java ql/src/java/org/apache/hadoop/hive/ql/exec/TextRecordWriter.java To: JIRA, njain Cc: kevinwilfong hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch, HIVE-3012.D3099.2.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271829#comment-13271829 ] Namit Jain commented on HIVE-3012: -- comments addressed hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch, HIVE-3012.D3099.2.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-3012: -- Attachment: HIVE-3012.D3099.3.patch njain updated the revision HIVE-3012 [jira] hive custom scripts do not work well if the data contains new lines. Reviewers: JIRA comments REVISION DETAIL https://reviews.facebook.net/D3099 AFFECTED FILES conf/hive-default.xml.template data/scripts/newline.py common/src/java/org/apache/hadoop/hive/conf/HiveConf.java ql/src/test/results/clientpositive/newline.q.out ql/src/test/queries/clientpositive/newline.q ql/src/java/org/apache/hadoop/hive/ql/metadata/HiveUtils.java ql/src/java/org/apache/hadoop/hive/ql/exec/TextRecordReader.java ql/src/java/org/apache/hadoop/hive/ql/exec/TextRecordWriter.java To: JIRA, njain Cc: kevinwilfong hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch, HIVE-3012.D3099.2.patch, HIVE-3012.D3099.3.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3012) hive custom scripts do not work well if the data contains new lines
[ https://issues.apache.org/jira/browse/HIVE-3012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13271846#comment-13271846 ] Phabricator commented on HIVE-3012: --- kevinwilfong has accepted the revision HIVE-3012 [jira] hive custom scripts do not work well if the data contains new lines. +1 Running tests. REVISION DETAIL https://reviews.facebook.net/D3099 BRANCH svn To: JIRA, kevinwilfong, njain Cc: kevinwilfong hive custom scripts do not work well if the data contains new lines --- Key: HIVE-3012 URL: https://issues.apache.org/jira/browse/HIVE-3012 Project: Hive Issue Type: Improvement Reporter: Namit Jain Assignee: Namit Jain Attachments: HIVE-3012.D3099.1.patch, HIVE-3012.D3099.2.patch, HIVE-3012.D3099.3.patch If the data contain newline, it will be passed as is to the script. The script has no way of splitting the data based on the new line. An option should be added to hive to escape/unescape the new lines. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
should managed tables be visible outside hive?
Hi, I built Hive from the source code. When I try to create tables, I do not see anything in /user/hive/warehouse. However, the tables are created correctly. After loading data to a table, I get the following statement: Deleted hdfs://localhost:54310/user/hive/warehouse/test_2 Is that normal? Thank you in advance for your help, Mahsa
[jira] [Updated] (HIVE-2979) Implement INCLUDE_HADOOP_MAJOR_VERSION test macro
[ https://issues.apache.org/jira/browse/HIVE-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2979: --- Status: Patch Available (was: Open) Implement INCLUDE_HADOOP_MAJOR_VERSION test macro - Key: HIVE-2979 URL: https://issues.apache.org/jira/browse/HIVE-2979 Project: Hive Issue Type: Task Components: Testing Infrastructure Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2979.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2979) Implement INCLUDE_HADOOP_MAJOR_VERSION test macro
[ https://issues.apache.org/jira/browse/HIVE-2979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenxiao Luo updated HIVE-2979: --- Attachment: HIVE-2979.patch Implement INCLUDE_HADOOP_MAJOR_VERSION test macro - Key: HIVE-2979 URL: https://issues.apache.org/jira/browse/HIVE-2979 Project: Hive Issue Type: Task Components: Testing Infrastructure Reporter: Carl Steinbach Assignee: Zhenxiao Luo Attachments: HIVE-2979.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2956) [hive] Provide error message when using UDAF in the place of UDF instead of throwing NPE
[
https://issues.apache.org/jira/browse/HIVE-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13272032#comment-13272032
]
Hudson commented on HIVE-2956:
--
Integrated in Hive-trunk-h0.21 #1421 (See
[https://builds.apache.org/job/Hive-trunk-h0.21/1421/])
HIVE-2956 Provide error message when using UDAF in the place of UDF instead
of throwing NPE (navis via kevinwilfong) (Revision 1336284)
Result = SUCCESS
kevinwilfong :
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1336284
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/ErrorMsg.java
*
/hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/TypeCheckProcFactory.java
* /hive/trunk/ql/src/test/queries/clientnegative/udaf_invalid_place.q
* /hive/trunk/ql/src/test/queries/clientnegative/udtf_invalid_place.q
* /hive/trunk/ql/src/test/results/clientnegative/udaf_invalid_place.q.out
* /hive/trunk/ql/src/test/results/clientnegative/udtf_invalid_place.q.out
[hive] Provide error message when using UDAF in the place of UDF instead of
throwing NPE
Key: HIVE-2956
URL: https://issues.apache.org/jira/browse/HIVE-2956
Project: Hive
Issue Type: Improvement
Reporter: Navis
Assignee: Navis
Priority: Trivial
Fix For: 0.10.0
Attachments: HIVE-2956.D2823.1.patch, HIVE-2956.D2823.2.patch,
HIVE-2956.D2823.3.patch
For example,
{code}
hive select distinct deptno, sum(deptno) from emp;
FAILED: Hive Internal Error: java.lang.NullPointerException(null)
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.plan.ExprNodeGenericFuncDesc.newInstance(ExprNodeGenericFuncDesc.java:214)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.getXpathOrFuncExprNodeDesc(TypeCheckProcFactory.java:767)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory$DefaultExprProcessor.process(TypeCheckProcFactory.java:888)
at
org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:89)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:88)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.walk(DefaultGraphWalker.java:125)
at
org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:102)
at
org.apache.hadoop.hive.ql.parse.TypeCheckProcFactory.genExprNode(TypeCheckProcFactory.java:165)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7755)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genExprNodeDesc(SemanticAnalyzer.java:7713)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapGroupByOperator(SemanticAnalyzer.java:2793)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genGroupByPlanMapAggr1MR(SemanticAnalyzer.java:3651)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genBodyPlan(SemanticAnalyzer.java:6125)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genPlan(SemanticAnalyzer.java:6762)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:7531)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:250)
{code}
Trivial.. but people always reports this confused by esoteric custom function
names.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-1719) Move RegexSerDe out of hive-contrib and over to hive-serde
[ https://issues.apache.org/jira/browse/HIVE-1719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shreepadma Venugopalan updated HIVE-1719: - Attachment: HIVE-1719.3.patch.txt This patch makes the following changes, * Moves Regex SerDe to hive-serde * Deprecates Regex SerDe under hive-contrib. However the behavior of Regex Serde under hive-contrib is not altered in anyway. Additionally it alters the behavior of Regex SerDe under hive-serde in the following ways, * Raises an exception when the input pattern to Regex is null * Logs a warning when the # of matching groups don't match the # of cols * Deprecates the output.format.string This patch also improves coverage for regex serde under hive-serde by adding additional positive and negative test cases. Please note that the regex serde in the contrib module contains a deprecation warning, but its behavior is *not* altered in any way. Move RegexSerDe out of hive-contrib and over to hive-serde -- Key: HIVE-1719 URL: https://issues.apache.org/jira/browse/HIVE-1719 Project: Hive Issue Type: Task Components: Serializers/Deserializers Reporter: Carl Steinbach Assignee: Shreepadma Venugopalan Attachments: HIVE-1719.3.patch.txt, HIVE-1719.D3051.1.patch, HIVE-1719.D3051.2.patch RegexSerDe is as much a part of the standard Hive distribution as the other SerDes currently in hive-serde. I think we should move it over to the hive-serde module so that users don't have to go to the added effort of manually registering the contrib jar before using it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
