Takako Shimamoto created DRILL-7014: ---------------------------------------
Summary: Format plugin for LTSV files Key: DRILL-7014 URL: https://issues.apache.org/jira/browse/DRILL-7014 Project: Apache Drill Issue Type: New Feature Components: Storage - Other Affects Versions: 1.15.0 Reporter: Takako Shimamoto I would like to contribute [this plugin|https://github.com/bizreach/drill-ltsv-plugin] to Drill. h4. Abstract storage-plugins-override.conf {code:json} "storage":{ dfs: { type: "file", connection: "file:///", formats: { "ltsv": { "type": "ltsv", "extensions": [ "ltsv" ] } }, enabled: true } } {code} sample.ltsv {code} time:30/Nov/2016:00:55:08 +0900 host:xxx.xxx.xxx.xxx forwardedfor:- req:GET /v1/xxx HTTP/1.1 status:200 size:4968 referer:- ua:Java/1.8.0_131 reqtime:2.532 apptime:2.532 vhost:api.example.com time:30/Nov/2016:00:56:37 +0900 host:xxx.xxx.xxx.xxx forwardedfor:- req:GET /v1/yyy HTTP/1.1 status:200 size:412 referer:- ua:Java/1.8.0_201 reqtime:3.580 apptime:3.580 vhost:api.example.com {code} Run query {code:sh} root@1805183e9b65:/apache-drill-1.15.0# ./bin/drill-embedded Apache Drill 1.15.0 "Drill must go on." 0: jdbc:drill:zk=local> SELECT * FROM dfs.`/apache-drill-1.15.0/sample-data/sample.ltsv` WHERE reqtime > 3.0; +-----------------------------+------------------+---------------+-----------------------+---------+-------+----------+-----------------+----------+----------+------------------+ | time | host | forwardedfor | req | status | size | referer | ua | reqtime | apptime | vhost | +-----------------------------+------------------+---------------+-----------------------+---------+-------+----------+-----------------+----------+----------+------------------+ | 30/Nov/2016:00:56:37 +0900 | xxx.xxx.xxx.xxx | - | GET /v1/yyy HTTP/1.1 | 200 | 412 | - | Java/1.8.0_201 | 3.580 | 3.580 | api.example.com | +-----------------------------+------------------+---------------+-----------------------+---------+-------+----------+-----------------+----------+----------+------------------+ 1 row selected (6.074 seconds) 0: jdbc:drill:zk=local> {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)