iodone commented on PR #3185: URL: https://github.com/apache/incubator-kyuubi/pull/3185#issuecomment-1217408709
> It seems Kyuubi can provide a way for Spark extensions to inject event to Kyuubi event, so we can always unify the Spark event into Kyuubi event. Maybe something like user can get KyuubiSparkSession by `KyuubiSparkSession.get` in Spark extension. What do you think ? @iodone @yaooqinn @pan3793 @turboFei With this design, there are cases where the bottom layer depends on the top layer event？ > Let's clean the way 1 first, I think 2 is better and can still be improved In some scenarios the user submits SQL only to get the lineage information and does not execute it. Just like `PlanOnlyMode`, we can output only the lineage information. In this case we have to implement the lineage extraction capability in Kyuubi Spark Engine. This implement can reuse the way 1. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
