mikebridge commented on code in PR #44834: URL: https://github.com/apache/superset/pull/44834#discussion_r4151378735
########## superset-core/src/superset_core/semantic_layers/metadata.py: ########## @@ -0,0 +1,174 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + +"""Optional provider metadata acquisition and host publication interfaces.""" + +from __future__ import annotations + +from abc import ABC, abstractmethod +from collections.abc import Callable +from dataclasses import dataclass, field +from typing import Any, get_args, Literal, Protocol, TypeAlias + +# The host passes a finite absolute time.monotonic() deadline in this process. Review Comment: Added `remaining_budget` in fa0de7b60c: it rejects non-finite, expired and over-300-second budgets with `deadline`, including accidental epoch timestamps. The documented five-minute ceiling is a sanity guard, not a default. Examples use it; the host stack now adopts it without extending its 30-second operation budget. Boundary, expiry, injected-clock and zero-time tests pass. ########## superset-core/src/superset_core/semantic_layers/metadata.py: ########## @@ -0,0 +1,174 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + +"""Optional provider metadata acquisition and host publication interfaces.""" + +from __future__ import annotations + +from abc import ABC, abstractmethod +from collections.abc import Callable +from dataclasses import dataclass, field +from typing import Any, get_args, Literal, Protocol, TypeAlias + +# The host passes a finite absolute time.monotonic() deadline in this process. +CatalogLoader: TypeAlias = Callable[[float], str] +MetadataRefreshErrorCategory: TypeAlias = Literal[ + "unsupported", + "configuration", + "in_progress", + "configuration_changed", + "upstream", + "invalid_payload", + "deadline", + "unavailable", + "indeterminate", +] + + +@dataclass(frozen=True) +class CatalogSnapshot: + """Carry one validated observation and its captured cache identity. + + The provider supplies canonical JSON in payload. The host assigns a nonempty, + opaque, scope-qualified cache_token for each successful publication, including + unchanged discovery. observed_at is a UTC RFC3339 source-observation time for + display, not a cache creation/expiry time or an ordering authority. + """ + + payload: str = field(repr=False) + cache_token: str = field(repr=False) + observed_at: str + + def __post_init__(self) -> None: + if not isinstance(self.payload, str): + raise TypeError("Catalog payload must be a string") + if not isinstance(self.cache_token, str): + raise TypeError("Catalog cache_token must be a string") + if not isinstance(self.observed_at, str): + raise TypeError("Catalog observed_at must be a string") + if not self.cache_token: + raise ValueError("Catalog cache token must not be empty") + if not self.observed_at: + raise ValueError("Catalog observed_at must not be empty") + + +@dataclass(frozen=True) +class MetadataRefreshResult: + """Report a confirmed publication and its immutable observation. + + Unchanged compares discovery payloads, not complete upstream metric + definitions. Changed includes installation without a prior observation. + An indeterminate publication must raise an error instead of returning success. + """ + + status: Literal["changed", "unchanged"] + snapshot: CatalogSnapshot + + def __post_init__(self) -> None: + if self.status not in ("changed", "unchanged"): + raise ValueError("Unknown metadata refresh result status") Review Comment: Added the `CatalogSnapshot` type check in fa0de7b60c. Five invalid snapshot cases failed before the change and pass with fixed-message `TypeError` rejection. The SDK suite passes 92 tests; downstream API tests construct real snapshots and also pass. ########## superset-core/src/superset_core/semantic_layers/metadata.py: ########## @@ -0,0 +1,174 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. + +"""Optional provider metadata acquisition and host publication interfaces.""" + +from __future__ import annotations + +from abc import ABC, abstractmethod +from collections.abc import Callable +from dataclasses import dataclass, field +from typing import Any, get_args, Literal, Protocol, TypeAlias + +# The host passes a finite absolute time.monotonic() deadline in this process. +CatalogLoader: TypeAlias = Callable[[float], str] +MetadataRefreshErrorCategory: TypeAlias = Literal[ + "unsupported", + "configuration", + "in_progress", + "configuration_changed", + "upstream", + "invalid_payload", + "deadline", + "unavailable", Review Comment: Added the three category definitions in fa0de7b60c: `configuration_changed` retires an operation whose authorized scope changed; `invalid_payload` rejects unusable catalog metadata; `unavailable` identifies host storage/coordination failure, while `upstream` identifies acquisition failure at the provider's remote service. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
