the profiler.properties file is the properties file for the flux topology.
CONFIG_GET interacts with the config for the profiler in zookeeper.
Typically that's kept in $METRON_HOME/config/zookeeper/profiler.json and
it's described in
https://github.com/apache/incubator-metron/tree/master/metron-analytics/metron-profiler
Are you sure you've pushed the profiler config to zookeeper?
On Wed, Apr 5, 2017 at 12:21 PM, Laurens Vets <laur...@daemon.be> wrote:
> I'm still having issues. I copied the metron-management-0.3.1.jar over to
> /usr/metron/0.3.1/lib and now "profilerConfig := CONFIG_GET("PROFILER")"
> works. However, when I type "profilerConfig", it's empty.
>
> The file "/usr/metron/0.3.1/config/profiler.properties" exists and has
> content. I would think that "profilerConfig" shows _something_?
>
>
> On 2017-04-04 15:46, Nick Allen wrote:
>
> The management functions, including CONFIG_GET, do not get deployed
> automatically right now. Copy the jar from the metron-management project
> to your VM at /usr/metron/0.3.1/lib then restart the REPL.
>
> On Apr 4, 2017 6:42 PM, "Laurens Vets" <laur...@daemon.be> wrote:
>
>> I'm doing the Metron reference application and I get stuck at Profiling
>> Your Streams.
>>
>> This works:
>> $ /usr/hdp/current/hbase-client/bin/hbase shell
>> hbase(main):001:0> create 'profiler', 'P'
>>
>> However, the next command fails:
>>
>> [root@node1 ~]# /usr/metron/0.3.1/bin/stellar -z node1:2181
>> SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
>> SLF4J: Defaulting to no-operation (NOP) logger implementation
>> SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for
>> further details.
>> Stellar, Go!
>> Please note that functions are loading lazily in the background and will
>> be unavailable until loaded fully.
>> {es.clustername=metron, es.ip=node1, es.port=9300,
>> es.date.format=yyyy.MM.dd.HH, parser.error.topic=indexing}
>> [Stellar]>>> Functions loaded, you may refer to functions now...
>> profilerConfig := CONFIG_GET("PROFILER")
>> [!] Unable to resolve function named 'CONFIG_GET'. Valid functions are
>> IS_DATE,MONTH,IS_DOMAIN,FORMAT,TRIM,WEEK_OF_MONTH,JOIN,MAP_G
>> ET,TO_INTEGER,OUTLIER_MAD_SCORE,YEAR,WEEK_OF_YEAR,PROTOCOL_
>> TO_NAME,ENDS_WITH,GET_FIRST,FILL_LEFT,STATS_MAX,DOMAIN_TO_
>> TLD,PROFILE_FIXED,TO_STRING,DOMAIN_REMOVE_SUBDOMAINS,HLLP_
>> MERGE,HLLP_CARDINALITY,BLOOM_MERGE,STARTS_WITH,STATS_
>> KURTOSIS,STATS_SUM_SQUARES,DOMAIN_REMOVE_TLD,STATS_INIT,
>> SYSTEM_ENV_GET,ENRICHMENT_GET,STATS_SD,HLLP_INIT,GEO_GET,
>> STATS_COUNT,GET,HLLP_ADD,IS_INTEGER,DAY_OF_WEEK,STATS_BIN,
>> IS_EMPTY,IS_EMAIL,MAP_EXISTS,DAY_OF_YEAR,REGEXP_MATCH,
>> PROFILE_WINDOW,TO_LOWER,STATS_SKEWNESS,ENRICHMENT_EXISTS,
>> URL_TO_PORT,DAY_OF_MONTH,LENGTH,GET_LAST,IN_SUBNET,
>> FILL_RIGHT,SPLIT,MAAS_MODEL_APPLY,ABS,STATS_POPULATION_
>> VARIANCE,SYSTEM_PROPERTY_GET,STATS_VARIANCE,STATS_ADD,TO_
>> UPPER,OUTLIER_MAD_STATE_MERGE,TO_EPOCH_TIMESTAMP,MAAS_GET_
>> ENDPOINT,BLOOM_EXISTS,BIN,STATS_QUADRATIC_MEAN,BLOOM_
>> INIT,BLOOM_ADD,URL_TO_PATH,STATS_GEOMETRIC_MEAN,OUTLIER_
>> MAD_ADD,URL_TO_PROTOCOL,STATS_MIN,URL_TO_HOST,TO_FLOAT,
>> STATS_SUM_LOGS,IS_URL,STATS_SUM,IS_IP,TO_LO
>> NG,STATS_MERGE,STATS_MEAN,STATS_PERCENTILE,STRING_ENTROPY,TO
>> _DOUBLE,PROFILE_GET
>> org.apache.metron.common.dsl.ParseException: Unable to resolve function
>> named 'CONFIG_GET'. Valid functions are IS_DATE,MONTH,IS_DOMAIN,FORMAT
>> ,TRIM,WEEK_OF_MONTH,JOIN,MAP_GET,TO_INTEGER,OUTLIER_MAD_SCOR
>> E,YEAR,WEEK_OF_YEAR,PROTOCOL_TO_NAME,ENDS_WITH,GET_FIRST,
>> FILL_LEFT,STATS_MAX,DOMAIN_TO_TLD,PROFILE_FIXED,TO_STRING,
>> DOMAIN_REMOVE_SUBDOMAINS,HLLP_MERGE,HLLP_CARDINALITY,BLOOM_
>> MERGE,STARTS_WITH,STATS_KURTOSIS,STATS_SUM_SQUARES,
>> DOMAIN_REMOVE_TLD,STATS_INIT,SYSTEM_ENV_GET,ENRICHMENT_GET,
>> STATS_SD,HLLP_INIT,GEO_GET,STATS_COUNT,GET,HLLP_ADD,IS_
>> INTEGER,DAY_OF_WEEK,STATS_BIN,IS_EMPTY,IS_EMAIL,MAP_EXISTS,
>> DAY_OF_YEAR,REGEXP_MATCH,PROFILE_WINDOW,TO_LOWER,STATS_
>> SKEWNESS,ENRICHMENT_EXISTS,URL_TO_PORT,DAY_OF_MONTH,
>> LENGTH,GET_LAST,IN_SUBNET,FILL_RIGHT,SPLIT,MAAS_MODEL_
>> APPLY,ABS,STATS_POPULATION_VARIANCE,SYSTEM_PROPERTY_GET,
>> STATS_VARIANCE,STATS_ADD,TO_UPPER,OUTLIER_MAD_STATE_MERGE,
>> TO_EPOCH_TIMESTAMP,MAAS_GET_ENDPOINT,BLOOM_EXISTS,BIN,
>> STATS_QUADRATIC_MEAN,BLOOM_INIT,BLOOM_ADD,URL_TO_PATH,
>> STATS_GEOMETRIC_MEAN,OUTLIER_MAD_ADD,URL_TO_PROTOCOL,STATS_
>> MIN,URL_TO_HOST,TO_FLOAT,STATS_SUM_LOGS,IS_URL,STATS_SUM,IS_IP,TO_LO
>> NG,STATS_MERGE,STATS_MEAN,STATS_PERCENTILE,STRING_ENTROPY,TO
>> _DOUBLE,PROFILE_GET
>> at org.apache.metron.common.stellar.StellarCompiler.resolveFunc
>> tion(StellarCompiler.java:302)
>> at org.apache.metron.common.stellar.StellarCompiler.exitTransfo
>> rmationFunc(StellarCompiler.java:261)
>> at org.apache.metron.common.stellar.generated.StellarParser$Tra
>> nsformationFuncContext.exitRule(StellarParser.java:1689)
>> at org.antlr.v4.runtime.Parser.triggerExitRuleEvent(Parser.java
>> :422)
>> at org.antlr.v4.runtime.Parser.exitRule(Parser.java:632)
>> at org.apache.metron.common.stellar.generated.StellarParser.tra
>> nsformation(StellarParser.java:160)
>> at org.apache.metron.common.stellar.BaseStellarProcessor.parse(
>> BaseStellarProcessor.java:126)
>> at org.apache.metron.common.stellar.shell.StellarExecutor.execu
>> te(StellarExecutor.java:287)
>> at org.apache.metron.common.stellar.shell.StellarShell.executeS
>> tellar(StellarShell.java:361)
>> at org.apache.metron.common.stellar.shell.StellarShell.handleSt
>> ellar(StellarShell.java:264)
>> at org.apache.metron.common.stellar.shell.StellarShell.execute(
>> StellarShell.java:400)
>> at org.jboss.aesh.console.AeshProcess.run(AeshProcess.java:53)
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool
>> Executor.java:1142)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo
>> lExecutor.java:617)
>> at java.lang.Thread.run(Thread.java:745)
>> Caused by: java.lang.IllegalStateException: Unknown function:
>> `CONFIG_GET`
>> at org.apache.metron.common.dsl.functions.resolver.BaseFunction
>> Resolver.apply(BaseFunctionResolver.java:106)
>> at org.apache.metron.common.dsl.functions.resolver.BaseFunction
>> Resolver.apply(BaseFunctionResolver.java:47)
>> at org.apache.metron.common.stellar.StellarCompiler.resolveFunc
>> tion(StellarCompiler.java:297)
>> ... 14 more
>> [Stellar]>>>
>>
>> Any idea what might be going on here? Did the function change name or
>> something?
>
>
>
