JackyYangPassion opened a new issue, #570:
URL: https://github.com/apache/incubator-hugegraph-toolchain/issues/570

   ### Search before asking
   
   - [X] I had searched in the 
[feature](https://github.com/apache/incubator-hugegraph-toolchain/issues?q=is%3Aissue+label%3A%22Feature%22)
 and found no similar feature requirement.
   
   
   ### Feature Description (功能描述)
   
   Loader support file name with prefix for hdfs source
   
   when read data warehouse file, There will be some _success empty files, 
etc., and you need to specify the file name prefix.
   
   struct.json
   
   ```
   {
       "vertices":[
           {
               "label":"user",
               "input":{
                   "type":"hdfs",
                   "path":"hdfs:///vertex/louvain_user_vertex/part-*",
                   "compression":"PARQUET",
                   "core_site_path":"/conf/core-site.xml",
                   "hdfs_site_path":"/conf/hdfs-site.xml",
                   "header":[
                       "user_id"
                   ],
                   "charset":"UTF-8",
                   "skipped_line":{
                       "regex":"(^#|^//).*"
                   }
               },
               "id":"user_id",
               "null_values":[
                   "NULL",
                   "null",
                   ""
               ]
           }
       ]
   }
   
   ```
   
   
   
   
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to