Hi Zuo, it looks like the filenames are different from what impalad looks for, for example libaes-deencrypt.651.7.so vs .libaes-deencrypt.651.7.so.crc (leading dot, trailing .crc). Are there more files in this directory or was that the full list you posted?
Cheers, Lars On Fri, Apr 22, 2016 at 3:00 AM, WANG Zuo (王佐) <[email protected]> wrote: > Hi, Lars > > SELinux is disabled on both machine. OS version is the same. And impalad > user has read permission. > > bjs0-3a4:root ~ $ ls /var/lib/impala/udfs/ -la > total 616 > drwxrwxrwx 2 impala impala 4096 Apr 21 13:00 . > drwxrwxrwx 6 impala impala 4096 Mar 26 20:14 .. > -rw-r--r-- 1 impala impala 16 Apr 21 11:24 > .libaes-deencrypt.651.0.so.crc > -rw-r--r-- 1 impala impala 16 Apr 21 11:25 > .libaes-deencrypt.651.1.so.crc > -rw-r--r-- 1 impala impala 101772 Apr 21 11:31 > .libaes-deencrypt.651.2.so.crc > -rw-r--r-- 1 impala impala 101772 Apr 21 11:37 > .libaes-deencrypt.651.3.so.crc > -rw-r--r-- 1 impala impala 101772 Apr 21 11:45 > .libaes-deencrypt.651.4.so.crc > -rw-r--r-- 1 impala impala 101772 Apr 21 11:47 > .libaes-deencrypt.651.5.so.crc > -rw-r--r-- 1 impala impala 101772 Apr 21 11:54 > .libaes-deencrypt.651.6.so.crc > -rw-r--r-- 1 impala impala 101772 Apr 21 13:00 > .libaes-deencrypt.651.7.so.crc > > Best Regards, > Zuo > > ------------------------------------------------------ > > Hi Zuo, > > Can you make sure that the user, which impalad runs as, has read > permissions on that file (/var/lib/impala/udfs/libaes-deencrypt.651.7.so)? > > Have you changed anything else except the cdh version? OS? SELinux? > > Best wishes, Lars > > On Thu, Apr 21, 2016 at 7:13 AM, WANG Zuo (王佐) <[email protected]> wrote: > > > Hi - > > > > I was able to register the UDF functions on cdh5.5.2, but failed to > > register it on cdh5.7.0. Could anybody help me to take a look? > > > > Here is the logs: > > 506 I0421 13:00:15.342900 886 lib-cache.cc:376] Adding lib cache entry: > > hdfs://bjs0-3a7.big1.lf.wanda.cn:8020/udf/libaes-deencrypt.so, local > > path: /var/lib/impala/udfs/libaes-deencrypt.6 > > 1507 I0421 13:00:15.401532 886 status.cc:112] Unable to load > > /var/lib/impala/udfs/libaes-deencrypt.651.7.so > > 1508 dlerror: /var/lib/impala/udfs/libaes-deencrypt.651.7.so: failed > > to map segment from shared object: Operation not permitted > > 1509 @ 0x7acb89 (unknown) > > 1510 @ 0xa93284 (unknown) > > 1511 @ 0x956f5a (unknown) > > 1512 @ 0x957772 (unknown) > > 1513 @ 0x957c2a (unknown) > > 1514 @ 0x9dcb95 (unknown) > > 1515 @ 0x7f39f7bbbd98 (unknown) > > 1516 I0421 13:00:15.401562 886 lib-cache.cc:242] Removing lib cache > > entry: hdfs://bjs0-3a7.big1.lf.wanda.cn:8020/udf/libaes-deencrypt.so, > > local path: /var/lib/impala/udfs/libaes-deencrypt > > 1517 I0421 13:00:15.404769 886 jni-util.cc:177] > > com.cloudera.impala.common.AnalysisException: Could not load binary: > > /udf/libaes-deencrypt.so > > 1518 Unable to load /var/lib/impala/udfs/libaes-deencrypt.651.7.so > > 1519 dlerror: /var/lib/impala/udfs/libaes-deencrypt.651.7.so: failed > > to map segment from shared object: Operation not permitted > > 1520 > > 1521 at > > com.cloudera.impala.catalog.Function.lookupSymbol(Function.java:419) > > 1522 at > > com.cloudera.impala.analysis.CreateUdfStmt.analyze(CreateUdfStmt.java:92) > > 1523 at > > > com.cloudera.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:354) > > 1524 at > > > com.cloudera.impala.analysis.AnalysisContext.analyze(AnalysisContext.java:329) > > 1525 at > > com.cloudera.impala.service.Frontend.analyzeStmt(Frontend.java:875) > > 1526 at > > com.cloudera.impala.service.Frontend.createExecRequest(Frontend.java:904) > > 1527 at > > > com.cloudera.impala.service.JniFrontend.createExecRequest(JniFrontend.java:141) > > 1528 I0421 13:00:15.413624 886 status.cc:112] AnalysisException: Could > > not load binary: /udf/libaes-deencrypt.so > > 1529 Unable to load /var/lib/impala/udfs/libaes-deencrypt.651.7.so > > 1530 dlerror: /var/lib/impala/udfs/libaes-deencrypt.651.7.so: failed > > to map segment from shared object: Operation not permitted > > 1531 > > 1532 @ 0x7acb89 (unknown) > > 1533 @ 0xab05f0 (unknown) > > 1534 @ 0x9d2ff4 (unknown) > > 1535 @ 0x9ecf1b (unknown) > > 1536 @ 0x9f3229 (unknown) > > 1537 @ 0xa32783 (unknown) > > 1538 @ 0xc0c125 (unknown) > > 1539 @ 0xc0f424 (unknown) > > 1540 @ 0x77a25c (unknown) > > 1541 @ 0x160b61b (unknown) > > 1542 @ 0x15f3289 (unknown) > > 1543 @ 0x93df49 (unknown) > > 1544 @ 0x93e9a2 (unknown) > > 1545 @ 0xafb4c7 (unknown) > > 1546 @ 0xafbdd4 (unknown) > > 1547 @ 0xd2f8aa (unknown) > > 1548 @ 0x7f39ff2e0dc5 start_thread > > 1549 @ 0x7f39fe19728d __clone > > > > > > Server version: impalad version 2.3.0-cdh5.5.2 RELEASE (build > > cc1125f10419a7269366f7f950f57b24b07acd64) > > [==========:21000] > show functions; > > Query: show functions > > +-------------+-----------------------------+ > > | return type | signature | > > +-------------+-----------------------------+ > > | STRING | aes_decrypt(STRING, STRING) | > > | STRING | aes_encrypt(STRING, STRING) | > > +-------------+-----------------------------+ > > > > > > Server version: impalad version 2.5.0-cdh5.7.0 RELEASE (build > > ad3f5adabedf56fe6bd9eea39147c067cc552703) > > [=============:21000] > create function udf.aes_encrypt(string,string) > > returns string location "/udf/libaes-deencrypt.so" > > symbol="AES_Encrypt"; > > Query: create function udf.aes_encrypt(string,string) returns string > > location "/udf/libaes-deencrypt.so" symbol="AES_Encrypt" > > ERROR: AnalysisException: Could not load binary: > > /udf/libaes-deencrypt.so Unable to load > > /var/lib/impala/udfs/libaes-deencrypt.651.7.so > > dlerror: /var/lib/impala/udfs/libaes-deencrypt.651.7.so: failed to map > > segment from shared object: Operation not permitted > > > > > > Best Regards, > > Zuo > > >
