[jira] [Assigned] (DRILL-4364) Image Metadata Format Plugin
[
https://issues.apache.org/jira/browse/DRILL-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Pritesh Maker reassigned DRILL-4364:
Assignee: Akihiko Kusanagi (was: Kunal Khatua)
> Image Metadata Format Plugin
>
>
> Key: DRILL-4364
> URL: https://issues.apache.org/jira/browse/DRILL-4364
> Project: Apache Drill
> Issue Type: New Feature
> Components: Storage - Other
>Reporter: Akihiko Kusanagi
>Assignee: Akihiko Kusanagi
>Priority: Major
> Labels: doc-impacting
> Fix For: 1.14.0
>
>
> Support querying of metadata in various image formats. This plugin leverages
> [metadata-extractor|https://github.com/drewnoakes/metadata-extractor]. This
> plugin is especially useful when querying on a large number of image files
> stored in a distributed file system without building metadata repository in
> advance.
> This plugin supports the following file formats.
> * JPEG, TIFF, PSD, PNG, BMP, GIF, ICO, PCX, WAV, AVI, WebP, MOV, MP4, EPS
> * Camera Raw: ARW (Sony), CRW/CR2 (Canon), NEF (Nikon), ORF (Olympus), RAF
> (FujiFilm), RW2 (Panasonic), RWL (Leica), SRW (Samsung), X3F (Foveon)
> This plugin enables to read the following metadata.
> * Exif, IPTC, XMP, JFIF / JFXX, ICC Profiles, Photoshop fields, PNG
> properties, BMP properties, GIF properties, ICO properties, PCX properties,
> WAV properties, AVI properties, WebP properties, QuickTime properties, MP4
> properties, EPS properties
> Since each type of metadata has a different set of fields, the plugin returns
> a set of commonly-used fields such as the image width, height and bits per
> pixels for ease of use.
> *Examples:*
> Querying on a JPEG file with the property descriptive: true
> {noformat}
> 0: jdbc:drill:zk=local> select FileName, * from
> dfs.`4349313028_f69ffa0257_o.jpg`;
> +--+--+--+++-+--+--+---++---+--+--++---++-+-+--+--+--++--+-+---+---+--+-+--+
> | FileName | FileSize | FileDateTime | Format | PixelWidth | PixelHeight |
> BitsPerPixel | DPIWidth | DPIHeight | Orientaion | ColorMode | HasAlpha |
> Duration | VideoCodec | FrameRate | AudioCodec | AudioSampleSize |
> AudioSampleRate | JPEG | JFIF | ExifIFD0 | ExifSubIFD | Interoperability |
> GPS | ExifThumbnail | Photoshop | IPTC | Huffman | FileType |
> +--+--+--+++-+--+--+---++---+--+--++---++-+-+--+--+--++--+-+---+---+--+-+--+
> | 4349313028_f69ffa0257_o.jpg | 257213 bytes | Fri Mar 09 12:09:34 +08:00
> 2018 | JPEG | 1199 | 800 | 24 | 96 | 96 | Unknown (0) | RGB | false |
> 00:00:00 | Unknown | 0 | Unknown | 0 | 0 |
> {"CompressionType":"Baseline","DataPrecision":"8 bits","ImageHeight":"800
> pixels","ImageWidth":"1199 pixels","NumberOfComponents":"3","Component1":"Y
> component: Quantization table 0, Sampling factors 2 horiz/2
> vert","Component2":"Cb component: Quantization table 1, Sampling factors 1
> horiz/1 vert","Component3":"Cr component: Quantization table 1, Sampling
> factors 1 horiz/1 vert"} |
> {"Version":"1.1","ResolutionUnits":"inch","XResolution":"96
> dots","YResolution":"96
> dots","ThumbnailWidthPixels":"0","ThumbnailHeightPixels":"0"} |
> {"Software":"Picasa 3.0"} |
> {"ExifVersion":"2.10","UniqueImageID":"d65e93b836d15a0c5e041e6b7258c76e"} |
> {"InteroperabilityIndex":"Unknown ()","InteroperabilityVersion":"1.00"} |
> {"GPSVersionID":".022","GPSLatitudeRef":"N","GPSLatitude":"47° 32'
> 15.98\"","GPSLongitudeRef":"W","GPSLongitude":"-122° 2'
> 6.37\"","GPSAltitudeRef":"Sea level","GPSAltitude":"0 metres"} |
> {"Compression":"JPEG (old-style)","XResolution":"72 dots per
> inch","YResolution":"72 dots per
> inch","ResolutionUnit":"Inch","ThumbnailOffset":"414
> bytes","ThumbnailLength":"7213 bytes"} | {} |
> {"Keywords":"135;2002;issaquah;police car;wa;washington"} |
> {"NumberOfTables":"4 Huffman tables"} |
> {"DetectedFileTypeName":"JPEG","DetectedFileTypeLongName":"Joint Photographic
> Experts
> Group","DetectedMIMEType":"image/jpeg","ExpectedFileNameExtension":"jpg"} |
>
[jira] [Assigned] (DRILL-4364) Image Metadata Format Plugin
[
https://issues.apache.org/jira/browse/DRILL-4364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kunal Khatua reassigned DRILL-4364:
---
Assignee: Kunal Khatua
> Image Metadata Format Plugin
>
>
> Key: DRILL-4364
> URL: https://issues.apache.org/jira/browse/DRILL-4364
> Project: Apache Drill
> Issue Type: New Feature
> Components: Storage - Other
>Reporter: Akihiko Kusanagi
>Assignee: Kunal Khatua
>Priority: Major
>
> Support querying of metadata in various image formats. This plugin leverages
> [metadata-extractor|https://github.com/drewnoakes/metadata-extractor]. This
> plugin is especially useful when querying on a large number of image files
> stored in a distributed file system without building metadata repository in
> advance.
> This plugin supports the following file formats.
> * JPEG, TIFF, PSD, PNG, BMP, GIF, ICO, PCX, WAV, AVI, WebP, MOV, MP4, EPS
> * Camera Raw: ARW (Sony), CRW/CR2 (Canon), NEF (Nikon), ORF (Olympus), RAF
> (FujiFilm), RW2 (Panasonic), RWL (Leica), SRW (Samsung), X3F (Foveon)
> This plugin enables to read the following metadata.
> * Exif, IPTC, XMP, JFIF / JFXX, ICC Profiles, Photoshop fields, PNG
> properties, BMP properties, GIF properties, ICO properties, PCX properties,
> WAV properties, AVI properties, WebP properties, QuickTime properties, MP4
> properties, EPS properties
> Since each type of metadata has a different set of fields, the plugin returns
> a set of commonly-used fields such as the image width, height and bits per
> pixels for ease of use.
> *Examples:*
> Querying on a JPEG file with the property descriptive: true
> {noformat}
> 0: jdbc:drill:zk=local> select FileName, * from
> dfs.`4349313028_f69ffa0257_o.jpg`;
> +--+--+--+++-+--+--+---++---+--+--++---++-+-+--+--+--++--+-+---+---+--+-+--+
> | FileName | FileSize | FileDateTime | Format | PixelWidth | PixelHeight |
> BitsPerPixel | DPIWidth | DPIHeight | Orientaion | ColorMode | HasAlpha |
> Duration | VideoCodec | FrameRate | AudioCodec | AudioSampleSize |
> AudioSampleRate | JPEG | JFIF | ExifIFD0 | ExifSubIFD | Interoperability |
> GPS | ExifThumbnail | Photoshop | IPTC | Huffman | FileType |
> +--+--+--+++-+--+--+---++---+--+--++---++-+-+--+--+--++--+-+---+---+--+-+--+
> | 4349313028_f69ffa0257_o.jpg | 257213 bytes | Fri Mar 09 12:09:34 +08:00
> 2018 | JPEG | 1199 | 800 | 24 | 96 | 96 | Unknown (0) | RGB | false |
> 00:00:00 | Unknown | 0 | Unknown | 0 | 0 |
> {"CompressionType":"Baseline","DataPrecision":"8 bits","ImageHeight":"800
> pixels","ImageWidth":"1199 pixels","NumberOfComponents":"3","Component1":"Y
> component: Quantization table 0, Sampling factors 2 horiz/2
> vert","Component2":"Cb component: Quantization table 1, Sampling factors 1
> horiz/1 vert","Component3":"Cr component: Quantization table 1, Sampling
> factors 1 horiz/1 vert"} |
> {"Version":"1.1","ResolutionUnits":"inch","XResolution":"96
> dots","YResolution":"96
> dots","ThumbnailWidthPixels":"0","ThumbnailHeightPixels":"0"} |
> {"Software":"Picasa 3.0"} |
> {"ExifVersion":"2.10","UniqueImageID":"d65e93b836d15a0c5e041e6b7258c76e"} |
> {"InteroperabilityIndex":"Unknown ()","InteroperabilityVersion":"1.00"} |
> {"GPSVersionID":".022","GPSLatitudeRef":"N","GPSLatitude":"47° 32'
> 15.98\"","GPSLongitudeRef":"W","GPSLongitude":"-122° 2'
> 6.37\"","GPSAltitudeRef":"Sea level","GPSAltitude":"0 metres"} |
> {"Compression":"JPEG (old-style)","XResolution":"72 dots per
> inch","YResolution":"72 dots per
> inch","ResolutionUnit":"Inch","ThumbnailOffset":"414
> bytes","ThumbnailLength":"7213 bytes"} | {} |
> {"Keywords":"135;2002;issaquah;police car;wa;washington"} |
> {"NumberOfTables":"4 Huffman tables"} |
> {"DetectedFileTypeName":"JPEG","DetectedFileTypeLongName":"Joint Photographic
> Experts
> Group","DetectedMIMEType":"image/jpeg","ExpectedFileNameExtension":"jpg"} |
> +--+--+--+++-+--+--+---++---+--+--++---++-+-+--+--+--++--+-+---+---+--+-+--+
> 1 row selected (0.229 seconds)
> {noformat}
