[
https://issues.apache.org/jira/browse/METRON-674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15838562#comment-15838562
]
Justin Leet commented on METRON-674:
------------------------------------
http://storm.apache.org/releases/1.0.1/storm-hdfs.html
Per the docs, the format is
{code}
{prefix}{componentId}-{taskId}-{rotationNum}-{timestamp}{extension}
{code}
Given a file like:
enrichment-null-0-0-1484752251563.json
The null field is componentId. I'd have to dig into why it's actually null
though.
> Archived Telemetry Filenames in HDFS Contain 'Null'
> ---------------------------------------------------
>
> Key: METRON-674
> URL: https://issues.apache.org/jira/browse/METRON-674
> Project: Metron
> Issue Type: Bug
> Affects Versions: 0.3.0
> Reporter: Nick Allen
> Priority: Minor
>
> When running "Quick Dev", I have noticed that all of the archived telemetry
> files in HDFS contain null in the name.
> {code}
> [root@node1 0.3.0]# hdfs dfs -ls /apps/metron/indexing/indexed/*
> Found 2 items
> -rw-r--r-- 1 storm hadoop 644753 2017-01-19 17:47
> /apps/metron/indexing/indexed/bro/enrichment-null-0-0-1484847868551.json
> -rw-r--r-- 1 storm hadoop 14107767 2017-01-19 18:46
> /apps/metron/indexing/indexed/bro/enrichment-null-0-0-1484848728527.json
> Found 5 items
> -rwxrwxrwx 1 storm hadoop 205699 2017-01-16 21:57
> /apps/metron/indexing/indexed/snort/enrichment-null-0-0-1484603710250.json
> -rwxrwxrwx 1 storm hadoop 5773871 2017-01-17 14:34
> /apps/metron/indexing/indexed/snort/enrichment-null-0-0-1484603925156.json
> -rwxrwxrwx 1 storm hadoop 253870 2017-01-17 13:43
> /apps/metron/indexing/indexed/snort/enrichment-null-0-0-1484660437793.json
> -rwxrwxrwx 1 storm hadoop 24023035 2017-01-17 19:45
> /apps/metron/indexing/indexed/snort/enrichment-null-0-0-1484660672723.json
> -rwxrwxrwx 1 storm hadoop 2063857 2017-01-17 19:02
> /apps/metron/indexing/indexed/snort/enrichment-null-0-0-1484679265343.json
> Found 147 items
> -rwxrwxrwx 1 storm hadoop 18199681 2017-01-18 16:35
> /apps/metron/indexing/indexed/yaf/enrichment-null-0-0-1484752251563.json
> -rwxrwxrwx 1 storm hadoop 216895 2017-01-19 17:47
> /apps/metron/indexing/indexed/yaf/enrichment-null-0-0-1484846918122.json
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
