LIKE incorrectly transforms expression to regex (does not escape "+" and
possibly other special chars)
------------------------------------------------------------------------------------------------------
Key: HIVE-2620
URL: https://issues.apache.org/jira/browse/HIVE-2620
Project: Hive
Issue Type: Bug
Components: UDF
Reporter: Mitja Trampus
Whenever you have a LIKE expression that contains "|+" (the culprit) and "%"
(so it gets converted to regex), hive throws an exception that crashes the
whole job.
hive> select 'foo |+18| bar' like 'foo |+18% bar' from akramer_one_row;
FAILED: Error in semantic analysis: Line 1:7 Wrong arguments ''foo |+18% bar'':
org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute method
public org.apache.hadoop.io.BooleanWritable
org.apache.hadoop.hive.ql.udf.UDFLike.evaluate(org.apache.hadoop.io.Text,org.apache.hadoop.io.Text)
on object org.apache.hadoop.hive.ql.udf.UDFLike@292e2fba of class
org.apache.hadoop.hive.ql.udf.UDFLike with arguments {foo |+18|
bar:org.apache.hadoop.io.Text, foo |+% bar:org.apache.hadoop.io.Text} of size 2
Stack trace from the real world example with which I found this:
Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Unable to execute
method public org.apache.hadoop.io.BooleanWritable
org.apache.hadoop.hive.ql.udf.UDFLike.evaluate(org.apache.hadoop.io.Text,org.apache.hadoop.io.Text)
on object org.apache.hadoop.hive.ql.udf.UDFLike@4a7baf7d of class
org.apache.hadoop.hive.ql.udf.UDFLike with arguments {ewt.arkadaslar
pazartesinden sonra ozel escortlar sayfamızı zıyaret etcek lutfn kaba
dawranmıyalım escortlarımız resmlı olcak sız begenıceksınız escortunuzu
escortlarımı ıl ıl olacktır bılgnıze:org.apache.hadoop.io.Text,
%çıtıR%kızLar%escort%kızLarı%burda%|+%18%|%:org.apache.hadoop.io.Text} of size 2
at
org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:836)
at
org.apache.hadoop.hive.ql.udf.generic.GenericUDFBridge.evaluate(GenericUDFBridge.java:180)
at
org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.evaluate(ExprNodeGenericFuncEvaluator.java:163)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.updateAggregations(GroupByOperator.java:575)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:767)
at
org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:722)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:765)
at
org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:84)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:765)
at
org.apache.hadoop.hive.ql.exec.UnionOperator.processOp(UnionOperator.java:129)
at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:471)
at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:765)
at
org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:531)
... 5 more
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.GeneratedMethodAccessor32.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.hadoop.hive.ql.exec.FunctionRegistry.invoke(FunctionRegistry.java:812)
... 19 more
Caused by: java.util.regex.PatternSyntaxException: Dangling meta character '+'
near index 42
.*çıtıR.*kızLar.*escort.*kızLarı.*burda.*|+.*18.*|.*
^
at java.util.regex.Pattern.error(Pattern.java:1713)
at java.util.regex.Pattern.sequence(Pattern.java:1878)
at java.util.regex.Pattern.expr(Pattern.java:1752)
at java.util.regex.Pattern.compile(Pattern.java:1460)
at java.util.regex.Pattern.<init>(Pattern.java:1133)
at java.util.regex.Pattern.compile(Pattern.java:823)
at org.apache.hadoop.hive.ql.udf.UDFLike.evaluate(UDFLike.java:186)
... 23 more
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
