GitHub user Haseeb702 added a comment to the discussion: Feature Request: Bulk import of all tables/views in a database as Superset datasets, and allow filtering by database when creating charts
Hi, my team at the University of Toronto are able to pick this work up as a part of our open source group project. Looking over the proposed scope and steps, I think adding a bulk registration workflow makes sense. Based on the current flow, after selecting a single table in the dataset we have the option to "create and explore". When adding the ability to import datasets in bulk we would let users select multiple tables from the dropdown without retrying it every time. As an initial option, we would make this a synchronous workflow, and detect when multiple tables are selected via a checklist in the UI. A new query would be made, mimicking the single processing query currently available. Instead of creating multiple charts (as the workflow currently does), the V1 of this feature should just create the datasets, without routing users to the "create chart" page. Our proposed idea includes: - UI changes to allow multiselect via a checklist / select all - New API endpoint that calls the current one repeatedly, with new error handling/validation - New submit button that shows "create datasets" instead of "create and explore" when selecting multiple tables - New screen that shows the result of creating multiple datasets (with messages informing users of the number of failures, successes, etc) - New test files/validations ensuring correct behaviour As we continue, we may be able to incorporate more of the functionality above as well. This includes progress tracking, auto skip-detection, generating default metrics and options to overwrite/sync existing DBs. GitHub link: https://github.com/apache/superset/discussions/35645#discussioncomment-19186365 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
