willbarrett opened a new issue #8874: [SIP-33] Proposal for Removing SQLite Support for Metadata Databases URL: https://github.com/apache/incubator-superset/issues/8874 ## [SIP] Proposal for Removing SQLite Support for Metadata Databases ### Motivation Historically, SQLite has been used as a starting point for development for new contributors to Superset. While the need for an easy onramp still exists, I believe that it is fully covered by the new Docker compose file contributed by Craig Rueda. Deprecating SQLite will encourage `docker-compose` as a primary starting point for new contributors to the project. SQLite support causes multiple pain points for developers, including bad migration practices with unnecessary batch of migrations and database schema drift due to SQLite’s inability to alter constraints on existing tables. Issues contributed to Github referenced below which indicate that SQLite is in some instances being used in a production-like environment. This is a strong anti-pattern that we would like to avoid that makes supporting Superset in the community more difficult. ### Proposed Change Immediate: * Add logging to indicate SQLite’s deprecation in the next version release * Add release notes in the upgrading.md file relating to deprecation * Announce deprecation on the mailing lists and in Slack * Update documentation to recommend Docker Compose with Postgres for new users In 2 minor versions: * Update configuration to use a Postgres database by default * Update the build matrix to stop building Superset against SQLite * Update Cypress test configuration to use Postgres instead of SQLite * Add release notes in the upgrading.md file relating to removal * Announce removal on the mailing lists and in Slack ### New or Changed Public Interfaces Support for SQLite as a metadata database will be officially removed. SQLite may still be usable, but it will not be supported in future Alembic migrations. ### Migration Plan and Compatibility Users who leverage SQLite in production will be required to migrate their data to a different supported metadata database, either MySQL or Postgres. This can be accomplished via third-party tools. ### Rejected Alternatives The primary other option is not deprecating SQLite and not removing it from the build matrix. This is really a binary decision.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
