Which steps and checks does Drill perform when creating a view?

When creating a view on a directory structure with a large number of 
directories and JSON files in each directory, the view creation takes 5-7 
seconds on small cluster.

From a few tests it seems that Drill will verify Hive tables and columns being 
used in a view. 

For the JSON docs in the DFS it does verify the storage plugin and the 
directory it is being pointed at.
If the directory is empty the view creation does fail.
Drill does not seem to verify if the maps (specified in the view) in JSON files 
are present, likely due to the convention to assign null to non existent maps 
(still need to dig deeper on this topic on the conventions being used for 
complex data types)

Thx

—Andries
 

Reply via email to