devikaaaa33 opened a new issue, #32846:
URL: https://github.com/apache/superset/issues/32846
### Bug description
Hi Team,
We are upgrading superset from version 4.0.2 to 4.1.1 and facing an issue
with DB migration
1. taken DB restore of version 4.0.2 and restored it on new db cretaed for
version 4.1.1
2. Performed Application deployment via argocd.
3. All pods came up
4. Init-db job is failing with below error.
Can someone please lookinto this and provide a workaround?
INFO [alembic.env] Starting the migration scripts.
INFO [alembic.runtime.migration] Context impl PostgresqlImpl.
INFO [alembic.runtime.migration] Will assume transactional DDL.
INFO [alembic.env] Migration scripts completed. Duration: 00:00:00
Initializing roles...
Loaded your LOCAL configuration at [/app/superset/superset_config.py]
2025-03-25 08:54:12,594:INFO:superset.initialization:Setting database
isolation level to READ COMMITTED
2025-03-25 08:54:16,414:INFO:superset.security.manager:Syncing role
definition
2025-03-25 08:54:16,495:INFO:superset.security.manager:Syncing Admin perms
2025-03-25 08:54:16,500:INFO:superset.security.manager:Syncing Alpha perms
2025-03-25 08:54:16,511:INFO:superset.security.manager:Syncing Gamma perms
2025-03-25 08:54:16,520:INFO:superset.security.manager:Syncing sql_lab perms
2025-03-25 08:54:16,531:INFO:superset.security.manager:Fetching a set of all
perms to lookup which ones are missing
2025-03-25 08:54:16,539:INFO:superset.security.manager:Creating missing
datasource permissions.
Traceback (most recent call last):
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py",
line 1910, in _execute_context
self.dialect.do_execute(
File
"/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line
736, in do_execute
cursor.execute(statement, parameters)
psycopg2.errors.UndefinedColumn: column tables.catalog_perm does not exist
LINE 1: ...s_perm, tables.schema_perm AS tables_schema_perm, tables.cat...
^
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/app/superset/utils/decorators.py", line 259, in wrapped
result = func(*args, **kwargs)
File "/app/superset/cli/main.py", line 68, in init
security_manager.sync_role_definitions()
File "/app/superset/security/manager.py", line 1070, in
sync_role_definitions
self.create_missing_perms()
File "/app/superset/security/manager.py", line 1018, in
create_missing_perms
datasources = SqlaTable.get_all_datasources()
File "/app/superset/connectors/sqla/models.py", line 1955, in
get_all_datasources
return qry.all()
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py",
line 2773, in all
return self._iter().all()
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/query.py",
line 2916, in _iter
result = self.session.execute(
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/orm/session.py",
line 1717, in execute
result = conn._execute_20(statement, params or {}, execution_options)
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py",
line 1710, in _execute_20
return meth(self, args_10style, kwargs_10style, execution_options)
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/sql/elements.py",
line 334, in _execute_on_connection
return connection._execute_clauseelement(
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py",
line 1577, in _execute_clauseelement
ret = self._execute_context(
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py",
line 1953, in _execute_context
self._handle_dbapi_exception(
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py",
line 2134, in _handle_dbapi_exception
util.raise_(
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/util/compat.py",
line 211, in raise_
raise exception
File "/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/base.py",
line 1910, in _execute_context
self.dialect.do_execute(
File
"/usr/local/lib/python3.10/site-packages/sqlalchemy/engine/default.py", line
736, in do_execute
cursor.execute(statement, parameters)
sqlalchemy.exc.ProgrammingError: (psycopg2.errors.UndefinedColumn) column
tables.catalog_perm does not exist
LINE 1: ...s_perm, tables.schema_perm AS tables_schema_perm, tables.cat...
^
[SQL: SELECT tables.uuid AS tables_uuid, tables.created_on AS
tables_created_on, tables.changed_on AS tables_changed_on, tables.id AS
tables_id, tables.description AS tables_description, tables.default_endpoint AS
tables_default_endpoint, tables.is_featured AS tables_is_featured,
tables.filter_select_enabled AS tables_filter_select_enabled, tables."offset"
AS tables_offset, tables.cache_timeout AS tables_cache_timeout, tables.params
AS tables_params, tables.perm AS tables_perm, tables.schema_perm AS
tables_schema_perm, tables.catalog_perm AS tables_catalog_perm,
tables.is_managed_externally AS tables_is_managed_externally,
tables.external_url AS tables_external_url, tables.table_name AS
tables_table_name, tables.main_dttm_col AS tables_main_dttm_col,
tables.database_id AS tables_database_id, tables.fetch_values_predicate AS
tables_fetch_values_predicate, tables.schema AS tables_schema, tables.catalog
AS tables_catalog, tables.sql AS tables_sql, tables.is_sqllab_view AS
tables_is_s
qllab_view, tables.template_params AS tables_template_params, tables.extra AS
tables_extra, tables.normalize_columns AS tables_normalize_columns,
tables.always_filter_main_dttm AS tables_always_filter_main_dttm,
tables.created_by_fk AS tables_created_by_fk, tables.changed_by_fk AS
tables_changed_by_fk
FROM tables
WHERE tables.is_sqllab_view = false]
(Background on this error at: https://sqlalche.me/e/14/f405)
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/bin/superset", line 8, in <module>
sys.exit(superset())
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1157,
in __call__
return self.main(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1078,
in main
rv = self.invoke(ctx)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1688,
in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 1434,
in invoke
return ctx.invoke(self.callback, **ctx.params)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in
invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line
33, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/flask/cli.py", line 358, in
decorator
return __ctx.invoke(f, *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in
invoke
return __callback(*args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/decorators.py", line
33, in new_func
return f(get_current_context(), *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/flask/cli.py", line 358, in
decorator
return __ctx.invoke(f, *args, **kwargs)
File "/usr/local/lib/python3.10/site-packages/click/core.py", line 783, in
invoke
return __callback(*args, **kwargs)
File "/app/superset/utils/decorators.py", line 266, in wrapped
return on_error(ex)
File "/app/superset/utils/decorators.py", line 234, in on_error
raise reraise() from ex
sqlalchemy.exc.SQLAlchemyError: ()
### Screenshots/recordings
_No response_
### Superset version
master / latest-dev
### Python version
3.9
### Node version
16
### Browser
Chrome
### Additional context
_No response_
### Checklist
- [ ] I have searched Superset docs and Slack and didn't find a solution to
my problem.
- [ ] I have searched the GitHub issue tracker and didn't find a similar bug
report.
- [ ] I have checked Superset's logs for errors and if I found a relevant
Python stacktrace, I included it here as text in the "additional context"
section.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
