GitHub user aicam added a comment to the discussion: Proposal - Supporting user-provided ML models in workflows
Thanks @bobbai00 , regarding your questions 1- To ensure security, we create a S3 proxy in file-service (check [file-service/src/main/scala/org/apache/texera/service/util/S3ProxyServlet.scala](https://github.com/aicam/texera/pull/11/changes#diff-ac7739e406e655cceceee23df9841b66c9af08e07704d6798e98db53bfa9af88)), and GeeseFS thinks our S3 proxy is the exact LakeFS but in fact, we authorize requests, GeeseFS sends user JWT token as S3_access_secret since it only support S3 authorization, and we use it to determine if user has access to the model 2- Yes, we ran a test and deployed application on local Kubernetes and used S3 bucket on AWS and everything worked. But it was much slower which is expected due to network bandwidth. GitHub link: https://github.com/apache/texera/discussions/6616#discussioncomment-17936590 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
