[
https://issues.apache.org/jira/browse/GRIFFIN-306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16983163#comment-16983163
]
Shao commented on GRIFFIN-306:
------------------------------
[~chitralverma]
Thank you for your reply.
I mean hdfs file, not hive table， and i'm using FileBasedDataConnector.
For example, myfie in the following path, and everyday a directory:
hdfs://localhost:8020/griffin/data/batch/data2Measure/#YYYYMMdd#/myfile.txt
If the date is 20191127 it will be :
hdfs://localhost:8020/griffin/data/batch/data2Measure/20191127/myfile.txt
If the date is 20191128 it will be :
hdfs://localhost:8020/griffin/data/batch/data2Measure/20191128/myfile.txt
If the job can convert the #YYYYMMdd# string when it runs everytime, so we can
measure everyday's file automatically.
> FileBasedDataConnector doesn't translate the date in the paths
> --------------------------------------------------------------
>
> Key: GRIFFIN-306
> URL: https://issues.apache.org/jira/browse/GRIFFIN-306
> Project: Griffin
> Issue Type: Bug
> Reporter: Shao
> Priority: Major
>
> I have date string "#YYYYMMdd" and "#HH#" in mypaths, but they did not
> convert to the specific date when running my job.
> my paths like this:
> "paths":[
>
> "hdfs://localhost:8020/griffin/data/batch/demo_src/dt=#YYYYMMdd#/hour=#HH#/demo_src"
> ]
> Thank you.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
