https://bugzilla.wikimedia.org/show_bug.cgi?id=61279

       Web browser: ---
            Bug ID: 61279
           Summary: Hive stats not working
           Product: Analytics
           Version: unspecified
          Hardware: All
                OS: All
            Status: NEW
          Severity: normal
          Priority: Unprioritized
         Component: Kraken
          Assignee: wikibugs-l@lists.wikimedia.org
          Reporter: dvanli...@gmail.com
                CC: christ...@quelltextlich.at, dandree...@wikimedia.org,
                    dvanli...@gmail.com, o...@wikimedia.org,
                    tneg...@wikimedia.org
    Classification: Unclassified
   Mobile Platform: ---

When debugging query for Ironholds I encountered the following error when
running 

ADD JAR /usr/lib/hcatalog/share/hcatalog/hcatalog-core-0.5.0-cdh4.3.1.jar;

INSERT OVERWRITE TABLE diederik.distinct_ip SELECT distip FROM (SELECT ip AS
distip, COUNT(*) as count FROM wmf.webrequest_mobile WHERE year = 2014 AND
month = 1 AND day = 20 AND content_type IN ('text/html\;
charset=utf-8','text/html\; charset=iso-8859-1','text/html\;
charset=UTF-8','text/html') GROUP BY ip HAVING COUNT(*) >= 2) sub1 LIMIT 10000;

This is not a fatal error, the query finishes successful but it's probably good
to have stats on Hive usage :)
2014-02-12 18:37:51.085 GMT Thread[Thread-28,5,main]
java.io.FileNotFoundException: derby.log (Permission denied)
2014-02-12 18:37:51.161 GMT Thread[Thread-28,5,main] Cleanup action starting
java.sql.SQLException: Failed to create database 'TempStatsStore', see the next
exception for details.
    at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown
Source)
    at org.apache.derby.impl.jdbc.Util.newEmbedSQLException(Unknown Source)
    at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
    at org.apache.derby.impl.jdbc.EmbedConnection.createDatabase(Unknown
Source)
    at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
    at org.apache.derby.impl.jdbc.EmbedConnection30.<init>(Unknown Source)
    at org.apache.derby.impl.jdbc.EmbedConnection40.<init>(Unknown Source)
    at org.apache.derby.jdbc.Driver40.getNewEmbedConnection(Unknown Source)
    at org.apache.derby.jdbc.InternalDriver.connect(Unknown Source)
    at org.apache.derby.jdbc.AutoloadedDriver.connect(Unknown Source)
    at java.sql.DriverManager.getConnection(DriverManager.java:571)
    at java.sql.DriverManager.getConnection(DriverManager.java:233)
    at
org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsPublisher.init(JDBCStatsPublisher.java:265)
    at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:436)
    at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:138)
    at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:138)
    at
org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
    at org.apache.hadoop.hive.ql.exec.TaskRunner.run(TaskRunner.java:47)
Caused by: java.sql.SQLException: Failed to create database 'TempStatsStore',
see the next exception for details.
    at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown
Source)
    at
org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown
Source)
    ... 18 more
Caused by: java.sql.SQLException: Directory
/var/log/hadoop-mapreduce/TempStatsStore cannot be created.
    at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown
Source)
    at
org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown
Source)
    at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown
Source)
    at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
    at
org.apache.derby.impl.jdbc.TransactionResourceImpl.wrapInSQLException(Unknown
Source)
    at
org.apache.derby.impl.jdbc.TransactionResourceImpl.handleException(Unknown
Source)
    at org.apache.derby.impl.jdbc.EmbedConnection.handleException(Unknown
Source)
    ... 15 more
Caused by: ERROR XBM0H: Directory /var/log/hadoop-mapreduce/TempStatsStore
cannot be created.
    at org.apache.derby.iapi.error.StandardException.newException(Unknown
Source)
    at
org.apache.derby.impl.services.monitor.StorageFactoryService$9.run(Unknown
Source)
    at java.security.AccessController.doPrivileged(Native Method)
    at
org.apache.derby.impl.services.monitor.StorageFactoryService.createServiceRoot(Unknown
Source)
    at org.apache.derby.impl.services.monitor.BaseMonitor.bootService(Unknown
Source)
    at
org.apache.derby.impl.services.monitor.BaseMonitor.createPersistentService(Unknown
Source)
    at
org.apache.derby.iapi.services.monitor.Monitor.createPersistentService(Unknown
Source)
    ... 15 more

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to