arina-ielchiieva opened a new pull request #2060: DRILL-7706: Implement Drill 
RDBMS Metastore
URL: https://github.com/apache/drill/pull/2060
 
 
   # [DRILL-7706](https://issues.apache.org/jira/browse/DRILL-7706): Implement 
Drill RDBMS Metastore
   
   ## Description
   
   Currently Drill has only one Metastore implementation based on Iceberg 
tables. Iceberg tables are file based storage that supports concurrent writes / 
reads but required to be placed on distributed file system.
   
   This PR aims to implement Drill RDBMS Metastore which will store Drill 
Metastore metadata in the database of the user's choice. Currently, PostgreSQL 
and MySQL databases are supported, others might work as well but no testing was 
done. Also out of box for demonstration / testing purposes Drill will setup 
SQLite file based embedded database but this is only applicable for Drill in 
embedded mode.
   
   1. Fix issue with undeterministic execution of batch update / delete 
statements, now they will be executed in the same order as they were added.
   2. Abstracted Metastore common test classes to be used by different 
Metastore implementations.
   3. Added drill-metastore-override-example.conf with example of Drill 
Metastore configuration.
   4. Replaced list of metadata types which are required to be passed during 
read / write operations with set to avoid possible duplicates.
   5. Add RDBMS Metastore implementation, README.md and unit tests.
   
   ## Documentation
   RDBMS Metastore section should be added: 
http://drill.apache.org/docs/using-drill-metastore/
   
   ## Testing
   Ran all unit tests, Functional & Advanced. Tested manually with SQLite, 
PostgreSQL, MySQL.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

Reply via email to