Drill Hangout 2015-08-04
Attendees: Daniel, Khurram, Neeraja, Vicky, Kris, Aman, Parth, Andries,
Jinfeng, Anas
- Insert and drop
- read isolation during insert into, Aman suggested snapshot level
- have to have some kind of lock manager
- locking on the dot drill file
- should this locking talk to other external programs working with Drill
used by Drill?
- Jason - why is this the lock necessary?
- we want to merge schemas in a dot drill file, avoid gather schemas
from a lot of separate files
- insert feature will be broken into phases
- this needs to handle schema changes to be consistent with the rest of
Drill
- partition pruning is not working for some expressions
- we will only fix for cast
- Jinfeng thinks this should be easy enough
- handling unknown types in parquet or other external systems
- should we fail actively, or should we give data back in varbinary
- sould people have to wait for a release to handle new data types
- storage plugin writers should have a clear idea about how to handle these
cases
- Jason will send a message to the list about this
- test framework
- Rahul is working on publishing it to a public repository
- this will include instructions on how to set up the tests on your own
hardware
