I guess that will work for now. At some point I'm sure we'll want that feature. Anyways, made progress, but now I'm stuck again.
error from the falcon submit command is now: $ ./bin/falcon entity -submit -debug -type cluster -file /etc/falcon/cluster.xml Hadoop is installed, adding hadoop classpath to falcon classpath SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/lib/falcon-server/client/lib/falcon-cli-0.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/falcon-server/client/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] POST http://localhost:16444/api/entities/submit/cluster returned a response status of 400 Bad Request ERROR: Bad Request;eng/Current colo (default) is not eng ok, that seems straight forward... just need to check my runtime.properties files: Here is what I have for both server/prism runtime.properties: #### To configure falcon servers with prism #### #prism should have the following properties *.all.colos=eng *.falcon.eng.endpoint=http://localhost:15000 # falcon server should have the following properties *.current.colo=eng That looks good to me?? and my cluster.xml: <?xml version="1.0" encoding="UTF-8"?> <!-- https://falcon.apache.org/EntitySpecification.html#Cluster_Specification --> <cluster colo="eng" description="test cluster" name="hdpt" xmlns="uri:falcon:cluster:0.1" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";> <interfaces> ... </interfaces> ... </cluster> Again, colo=eng? I tried specifying the -colo eng flag on the falcon CLI, but it complains that's not valid. prism logs: 2017-01-06 10:49:38,838 DEBUG - [352083716@qtp-771418758-0 - 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner/127.0.0.1 performed request http://localhost:16444/api/options?user.name=aaron_turner (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86) 2017-01-06 10:49:38,839 INFO - [352083716@qtp-771418758-0 - 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:16444/api/options?user.name=aaron_turner (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) 2017-01-06 10:49:38,839 INFO - [352083716@qtp-771418758-0 - 6f5eb00b-836d-4575-bb58-ef723fcbc741:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:16444/api/options?user.name=aaron_turner (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) 2017-01-06 10:49:38,843 DEBUG - [352083716@qtp-771418758-0 - 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner/127.0.0.1 performed request http://localhost:16444/api/options?user.name=aaron_turner&user.name=aaron_turner (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86) 2017-01-06 10:49:38,844 INFO - [352083716@qtp-771418758-0 - 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:16444/api/options?user.name=aaron_turner&user.name=aaron_turner (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) 2017-01-06 10:49:38,844 INFO - [352083716@qtp-771418758-0 - 693cda15-070c-4bc9-84af-cff6f7ca577e:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:16444/api/options?user.name=aaron_turner&user.name=aaron_turner (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) 2017-01-06 10:49:39,202 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Logging in aaron_turner (CurrentUser:65) 2017-01-06 10:49:39,202 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Request from authenticated user: aaron_turner, URL=/api/entities/submit/cluster, doAs user: null (FalconAuthenticationFilter:185) 2017-01-06 10:49:39,207 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Parsed Entity: hdpt (EntityParser:94) 2017-01-06 10:49:39,207 DEBUG - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo=eng&; (HTTPChannel:96) 2017-01-06 10:49:39,209 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore (SecureHTTPChannel:56) 2017-01-06 10:49:39,325 ERROR - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Request failed: 400 (HTTPChannel:123) 2017-01-06 10:49:39,329 ERROR - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Request failed (HTTPChannel:131) org.apache.falcon.FalconWebException at org.apache.falcon.FalconWebException.newAPIException(FalconWebException.java:62) at org.apache.falcon.FalconWebException.newAPIException(FalconWebException.java:54) at org.apache.falcon.resource.channel.HTTPChannel.invoke(HTTPChannel.java:124) at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$2.doExecute(SchedulableEntityManagerProxy.java:176) at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$EntityProxy.execute(SchedulableEntityManagerProxy.java:841) at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit_aroundBody2(SchedulableEntityManagerProxy.java:178) at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy$AjcClosure3.run(SchedulableEntityManagerProxy.java:1) at org.aspectj.runtime.reflect.JoinPointImpl.proceed(JoinPointImpl.java:149) at org.apache.falcon.aspect.AbstractFalconAspect.logAroundMonitored(AbstractFalconAspect.java:51) at org.apache.falcon.resource.proxy.SchedulableEntityManagerProxy.submit(SchedulableEntityManagerProxy.java:156) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at com.sun.jersey.spi.container.JavaMethodInvokerFactory$1.invoke(JavaMethodInvokerFactory.java:60) at com.sun.jersey.server.impl.model.method.dispatch.AbstractResourceMethodDispatchProvider$TypeOutInvoker._dispatch(AbstractResourceMethodDispatchProvider.java:185) at com.sun.jersey.server.impl.model.method.dispatch.ResourceJavaMethodDispatcher.dispatch(ResourceJavaMethodDispatcher.java:75) at com.sun.jersey.server.impl.uri.rules.HttpMethodRule.accept(HttpMethodRule.java:288) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.ResourceClassRule.accept(ResourceClassRule.java:108) at com.sun.jersey.server.impl.uri.rules.RightHandPathRule.accept(RightHandPathRule.java:147) at com.sun.jersey.server.impl.uri.rules.RootResourceClassesRule.accept(RootResourceClassesRule.java:84) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1469) at com.sun.jersey.server.impl.application.WebApplicationImpl._handleRequest(WebApplicationImpl.java:1400) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1349) at com.sun.jersey.server.impl.application.WebApplicationImpl.handleRequest(WebApplicationImpl.java:1339) at com.sun.jersey.spi.container.servlet.WebComponent.service(WebComponent.java:416) at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:537) at com.sun.jersey.spi.container.servlet.ServletContainer.service(ServletContainer.java:699) at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) at org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:511) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1221) at org.apache.falcon.security.FalconAuthorizationFilter.doFilter(FalconAuthorizationFilter.java:108) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.falcon.security.FalconAuthenticationFilter$2.doFilter(FalconAuthenticationFilter.java:188) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:622) at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:574) at org.apache.falcon.security.FalconAuthenticationFilter.doFilter(FalconAuthenticationFilter.java:197) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.falcon.security.FalconAuditFilter.doFilter(FalconAuditFilter.java:64) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.apache.falcon.security.HostnameFilter.doFilter(HostnameFilter.java:82) at org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) at org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) at org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) at org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) at org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:767) at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) at org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) at org.mortbay.jetty.Server.handle(Server.java:326) at org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) at org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) at org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) at org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) 2017-01-06 10:49:39,330 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ {Action:submit, Dimensions:{colo=NULL, entityType=cluster}, Status: FAILED, Time-taken:126927782 ns} (METRIC:38) 2017-01-06 10:49:39,330 ERROR - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:aaron_turner:POST//entities/submit/cluster] ~ Exception in sending Notification from EmailNotificationPlugin:java.lang.NullPointerException (EmailNotificationPlugin:71) 2017-01-06 10:49:39,331 DEBUG - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner/127.0.0.1 performed request http://localhost:16444/api/entities/submit/cluster (127.0.0.1) at time 2017-01-06T18:49Z (FalconAuditFilter:86) 2017-01-06 10:49:39,331 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:16444/api/entities/submit/cluster (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) 2017-01-06 10:49:39,331 INFO - [352083716@qtp-771418758-0 - 92f2ac46-dc50-4ec8-ba9b-e3977cdab9f7:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:16444/api/entities/submit/cluster (127.0.0.1) at 2017-01-06T18:49Z (AUDIT:48) server logs: 2017-01-06 10:55:07,924 INFO - [1234586997@qtp-1262548561-0 - 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:aaron_turner:POST//sync/submit/cluster] ~ Logging in aaron_turner (CurrentUser:65) 2017-01-06 10:55:07,924 INFO - [1234586997@qtp-1262548561-0 - 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:aaron_turner:POST//sync/submit/cluster] ~ Request from authenticated user: aaron_turner, URL=/secure/sync/submit/cluster?colo=eng&&user.name=aaron_turner, doAs user: null (FalconAuthenticationFilter:185) 2017-01-06 10:55:07,925 DEBUG - [1234586997@qtp-1262548561-0 - 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner/127.0.0.1 performed request http://localhost:15000/secure/sync/submit/cluster?colo=eng&&user.name=aaron_turner (127.0.0.1) at time 2017-01-06T18:55Z (FalconAuditFilter:86) 2017-01-06 10:55:07,925 INFO - [1234586997@qtp-1262548561-0 - 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:15000/secure/sync/submit/cluster?colo=eng&&user.name=aaron_turner (127.0.0.1) at 2017-01-06T18:55Z (AUDIT:48) 2017-01-06 10:55:07,926 INFO - [1234586997@qtp-1262548561-0 - 7cfdfb26-83c4-40c8-889c-13ff938d7ffd:] ~ Audit: aaron_turner@127.0.0.1 performed http://localhost:15000/secure/sync/submit/cluster?colo=eng&&user.name=aaron_turner (127.0.0.1) at 2017-01-06T18:55Z (AUDIT:48) I'm guessing the prism backtrace is significant, but I don't see a smoking gun in the server log which explains what is going on. If I connect to tcp/15000 I can login as "aaron_turner" in the falcon server web UI just fine. -- Aaron Turner https://synfin.net/ Twitter: @synfinatic Those who would give up essential Liberty, to purchase a little temporary Safety, deserve neither Liberty nor Safety. -- Benjamin Franklin On Thu, Jan 5, 2017 at 7:11 PM, Pallavi Rao <pallavi....@inmobi.com> wrote: > Aaron, > If you don't plan to use the graph API, you can disable MetadataMappingService > (by commenting out that line) in the startup.properties as a work-around. > > On Thu, Jan 5, 2017 at 11:48 PM, Aaron Turner <synfina...@gmail.com> wrote: > >> Ok, I think I see what my problem is. >> >> First, my falcon-prism/conf/runtime.properties had: >> >> prism.falcon.local.endpoint=http://localhost:16444 >> >> which pointed back at itself, not: >> >> prism.falcon.local.endpoint=http://localhost:15000 >> >> which points at falcon server. So I fixed that and restarted >> falcon-prism. Now I get a different error: >> >> POST http://localhost:16444/api/entities/submit/cluster returned a >> response status of 400 Bad Request >> ERROR: Bad Request;local/org.apache.falcon.FalconException::org. >> apache.falcon.FalconException: >> <html> >> <head> >> <meta http-equiv="Content-Type" content="text/html; charset=ISO-8859-1"/> >> <title>Error 503 SERVICE_UNAVAILABLE</title> >> </head> >> <body> >> <h2>HTTP ERROR: 503</h2> >> <p>Problem accessing /secure/sync/submit/cluster. Reason: >> <pre> SERVICE_UNAVAILABLE</pre></p> >> <hr /><i><small>Powered by Jetty://</small></i> >> >> The prism.application.log now says it's trying to talk to falcon-server: >> >> 2017-01-05 10:12:53,952 DEBUG - [352083716@qtp-771418758-0 - >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: >> POST//entities/submit/cluster] >> ~ Executing http://localhost:15000/secure/sync/submit/cluster?colo=local&; >> (HTTPChannel:96) >> 2017-01-05 10:12:53,953 INFO - [352083716@qtp-771418758-0 - >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: >> POST//entities/submit/cluster] >> ~ Configuring client with /usr/lib/falcon-prism/conf/prism.keystore >> (SecureHTTPChannel:56) >> 2017-01-05 10:12:54,033 ERROR - [352083716@qtp-771418758-0 - >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: >> POST//entities/submit/cluster] >> ~ Request failed: 503 (HTTPChannel:127) >> 2017-01-05 10:12:54,035 ERROR - [352083716@qtp-771418758-0 - >> 9149b35e-3554-4775-bbd3-5ce30761ead8:aaron_turner: >> POST//entities/submit/cluster] >> ~ Request failed (HTTPChannel:134) >> >> Trying in my browser to connect to tcp/15000 gives me the same 503 >> error. So I went looking in the falcon.application.log for what the >> problem is: >> >> >> 2017-01-05 10:09:05,551 INFO - [main:] ~ Initializing graph db >> (MetadataMappingService:143) >> 2017-01-05 10:09:05,610 INFO - [main:] ~ The HBase version >> 1.2.0-cdh5.8.2 is not explicitly supported by Titan. Loading Titan's >> compatibility layer for its most recent supported HBase version (1.1) >> (HBaseCompatLoader:57) >> >> <snip> >> >> 2017-01-05 10:09:05,832 WARN - [main:] ~ >> hbase.regionserver.global.memstore.upperLimit is deprecated by >> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55) >> 2017-01-05 10:09:06,084 WARN - [main:] ~ The short-circuit local >> reads feature cannot be used because libhadoop cannot be loaded. >> (DomainSocketFactory:117) >> 2017-01-05 10:09:06,088 INFO - [main:] ~ Set a new configuration for >> the first time. (N:110) >> 2017-01-05 10:09:06,119 INFO - [main:] ~ mapred.task.id is >> deprecated. Instead, use mapreduce.task.attempt.id (deprecation:1174) >> 2017-01-05 10:09:06,120 INFO - [main:] ~ Scheduling statistics report >> every 2000 millisecs (u:110) >> 2017-01-05 10:09:06,120 INFO - [main:] ~ Initialized the distributed >> file system (ThrottledDistributedFileSystem:110) >> 2017-01-05 10:09:06,421 INFO - [main:] ~ hadoop.native.lib is >> deprecated. Instead, use io.native.lib.available (deprecation:1174) >> 2017-01-05 10:09:06,514 WARN - [main:] ~ >> hbase.regionserver.global.memstore.upperLimit is deprecated by >> hbase.regionserver.global.memstore.size (HeapMemorySizeUtil:55) >> 2017-01-05 10:09:06,521 ERROR - [main:] ~ Failed to initialize service >> org.apache.falcon.metadata.MetadataMappingService >> (ServiceInitializer:49) >> java.lang.RuntimeException: GraphFactory could not instantiate this >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory]. >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50) >> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB( >> MetadataMappingService.java:146) >> at org.apache.falcon.metadata.MetadataMappingService.init( >> MetadataMappingService.java:113) >> at org.apache.falcon.service.ServiceInitializer.initialize( >> ServiceInitializer.java:47) >> at org.apache.falcon.listener.ContextStartupListener.contextInitialized( >> ContextStartupListener.java:56) >> at org.mortbay.jetty.handler.ContextHandler.startContext( >> ContextHandler.java:550) >> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136) >> at org.mortbay.jetty.webapp.WebAppContext.startContext( >> WebAppContext.java:1282) >> at org.mortbay.jetty.handler.ContextHandler.doStart( >> ContextHandler.java:519) >> at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) >> at org.mortbay.component.AbstractLifeCycle.start( >> AbstractLifeCycle.java:50) >> at org.mortbay.jetty.handler.HandlerWrapper.doStart( >> HandlerWrapper.java:130) >> at org.mortbay.jetty.Server.doStart(Server.java:224) >> at org.mortbay.component.AbstractLifeCycle.start( >> AbstractLifeCycle.java:50) >> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58) >> at org.apache.falcon.FalconServer.main(FalconServer.java:118) >> Caused by: java.lang.reflect.InvocationTargetException >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at sun.reflect.NativeMethodAccessorImpl.invoke( >> NativeMethodAccessorImpl.java:62) >> at sun.reflect.DelegatingMethodAccessorImpl.invoke( >> DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45) >> ... 15 more >> Caused by: java.lang.NoSuchMethodError: >> org.apache.hadoop.hbase.HTableDescriptor.addFamily( >> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/ >> HTableDescriptor; >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1. >> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49) >> at com.thinkaurelius.titan.diskstorage.hbase. >> HBaseStoreManager.createTable(HBaseStoreManager.java:728) >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. >> ensureTableExists(HBaseStoreManager.java:711) >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. >> getLocalKeyPartition(HBaseStoreManager.java:511) >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. >> getDeployment(HBaseStoreManager.java:352) >> at com.thinkaurelius.titan.diskstorage.hbase. >> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395) >> at com.thinkaurelius.titan.graphdb.configuration. >> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276) >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93) >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73) >> ... 20 more >> 2017-01-05 10:09:06,524 ERROR - [main:] ~ Failed startup of context >> org.mortbay.jetty.webapp.WebAppContext@6caf7803{/,/usr/ >> lib/falcon-server/server/webapp/falcon} >> (log:87) >> java.lang.RuntimeException: org.apache.falcon.FalconException: >> java.lang.RuntimeException: GraphFactory could not instantiate this >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory]. >> at org.apache.falcon.listener.ContextStartupListener.contextInitialized( >> ContextStartupListener.java:59) >> at org.mortbay.jetty.handler.ContextHandler.startContext( >> ContextHandler.java:550) >> at org.mortbay.jetty.servlet.Context.startContext(Context.java:136) >> at org.mortbay.jetty.webapp.WebAppContext.startContext( >> WebAppContext.java:1282) >> at org.mortbay.jetty.handler.ContextHandler.doStart( >> ContextHandler.java:519) >> at org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:499) >> at org.mortbay.component.AbstractLifeCycle.start( >> AbstractLifeCycle.java:50) >> at org.mortbay.jetty.handler.HandlerWrapper.doStart( >> HandlerWrapper.java:130) >> at org.mortbay.jetty.Server.doStart(Server.java:224) >> at org.mortbay.component.AbstractLifeCycle.start( >> AbstractLifeCycle.java:50) >> at org.apache.falcon.util.EmbeddedServer.start(EmbeddedServer.java:58) >> at org.apache.falcon.FalconServer.main(FalconServer.java:118) >> Caused by: org.apache.falcon.FalconException: >> java.lang.RuntimeException: GraphFactory could not instantiate this >> Graph implementation [com.thinkaurelius.titan.core.TitanFactory]. >> at org.apache.falcon.service.ServiceInitializer.initialize( >> ServiceInitializer.java:50) >> at org.apache.falcon.listener.ContextStartupListener.contextInitialized( >> ContextStartupListener.java:56) >> ... 11 more >> Caused by: java.lang.RuntimeException: GraphFactory could not >> instantiate this Graph implementation >> [com.thinkaurelius.titan.core.TitanFactory]. >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:50) >> at org.apache.falcon.metadata.MetadataMappingService.initializeGraphDB( >> MetadataMappingService.java:146) >> at org.apache.falcon.metadata.MetadataMappingService.init( >> MetadataMappingService.java:113) >> at org.apache.falcon.service.ServiceInitializer.initialize( >> ServiceInitializer.java:47) >> ... 12 more >> Caused by: java.lang.reflect.InvocationTargetException >> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) >> at sun.reflect.NativeMethodAccessorImpl.invoke( >> NativeMethodAccessorImpl.java:62) >> at sun.reflect.DelegatingMethodAccessorImpl.invoke( >> DelegatingMethodAccessorImpl.java:43) >> at java.lang.reflect.Method.invoke(Method.java:498) >> at com.tinkerpop.blueprints.GraphFactory.open(GraphFactory.java:45) >> ... 15 more >> Caused by: java.lang.NoSuchMethodError: >> org.apache.hadoop.hbase.HTableDescriptor.addFamily( >> Lorg/apache/hadoop/hbase/HColumnDescriptor;)Lorg/apache/hadoop/hbase/ >> HTableDescriptor; >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseCompat1_1. >> addColumnFamilyToTableDescriptor(HBaseCompat1_1.java:49) >> at com.thinkaurelius.titan.diskstorage.hbase. >> HBaseStoreManager.createTable(HBaseStoreManager.java:728) >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. >> ensureTableExists(HBaseStoreManager.java:711) >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. >> getLocalKeyPartition(HBaseStoreManager.java:511) >> at com.thinkaurelius.titan.diskstorage.hbase.HBaseStoreManager. >> getDeployment(HBaseStoreManager.java:352) >> at com.thinkaurelius.titan.diskstorage.hbase. >> HBaseStoreManager.getFeatures(HBaseStoreManager.java:395) >> at com.thinkaurelius.titan.graphdb.configuration. >> GraphDatabaseConfiguration.<init>(GraphDatabaseConfiguration.java:1276) >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:93) >> at com.thinkaurelius.titan.core.TitanFactory.open(TitanFactory.java:73) >> ... 20 more >> 2017-01-05 10:09:06,525 INFO - [main:] ~ Started >> SocketConnector@0.0.0.0:15000 (log:67) >> 2017-01-05 10:14:04,983 INFO - [Thread-16:] ~ config.location is set, >> using: /usr/lib/falcon-server/conf/runtime.properties >> (ApplicationProperties:120) >> 2017-01-05 10:14:04,983 INFO - [Thread-16:] ~ Initializing >> org.apache.falcon.util.RuntimeProperties properties with domain falcon >> (ApplicationProperties:156) >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ >> feed.retry.policy=exp-backoff (ApplicationProperties:162) >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ >> feed.retry.frequency=minutes(5) (ApplicationProperties:162) >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ >> workflow.status.retry.count=30 (ApplicationProperties:162) >> 2017-01-05 10:14:04,983 DEBUG - [Thread-16:] ~ >> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=* >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.late.allowed=true >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> webservices.default.results.per.page=10 (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> feed.retry.onTimeout=false (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> falcon.jms.notification.enabled=true (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> falcon.retention.keep.instances.beyond.validity=true >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> feed.late.policy=exp-backoff (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ current.colo=local >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ domain=falcon >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> feed.late.frequency=hours(3) (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> falcon.skip.dryrun=false (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ feed.retry.attempts=3 >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 DEBUG - [Thread-16:] ~ >> falcon.service.ProxyUserService.proxyuser.#USER#.groups=* >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,984 INFO - [Thread-16:] ~ config.location is set, >> using: /usr/lib/falcon-server/conf/runtime.properties >> (ApplicationProperties:120) >> 2017-01-05 10:14:04,985 INFO - [Thread-16:] ~ Initializing >> org.apache.falcon.util.RuntimeProperties properties with domain falcon >> (ApplicationProperties:156) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> feed.retry.policy=exp-backoff (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> feed.retry.frequency=minutes(5) (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> workflow.status.retry.count=30 (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> falcon.service.ProxyUserService.proxyuser.#USER#.hosts=* >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.late.allowed=true >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> webservices.default.results.per.page=10 (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> feed.retry.onTimeout=false (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> falcon.jms.notification.enabled=true (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> falcon.retention.keep.instances.beyond.validity=true >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> feed.late.policy=exp-backoff (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ current.colo=local >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ domain=falcon >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> feed.late.frequency=hours(3) (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> falcon.skip.dryrun=false (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ feed.retry.attempts=3 >> (ApplicationProperties:162) >> 2017-01-05 10:14:04,985 DEBUG - [Thread-16:] ~ >> falcon.service.ProxyUserService.proxyuser.#USER#.groups=* >> (ApplicationProperties:162) >> >> So it appears my problem is that CDH5.8.2 is shipping a more recent >> version of Hbase then Titan supports? Not sure if there is a work >> around or should I switch to BerkeleyDB? >> > > -- > _____________________________________________________________ > The information contained in this communication is intended solely for the > use of the individual or entity to whom it is addressed and others > authorized to receive it. It may contain confidential or legally privileged > information. If you are not the intended recipient you are hereby notified > that any disclosure, copying, distribution or taking any action in reliance > on the contents of this information is strictly prohibited and may be > unlawful. If you have received this communication in error, please notify > us immediately by responding to this email and then delete it from your > system. The firm is neither liable for the proper and complete transmission > of the information contained in this communication nor for any delay in its > receipt.
