nadav-har-tzvi commented on a change in pull request #58: documentation for pyspark sdk URL: https://github.com/apache/incubator-amaterasu/pull/58#discussion_r299124932
########## File path: docs/docs/frameworks.md ########## @@ -41,13 +41,145 @@ Amaterasu supports different processing frameworks to be executed. Amaterasu fra # Amaterasu Frameworks +## Python +Apache Amaterasu supports the following types of Python workloads: + +1. PySpark workload ([See below](#pyspark)) + +2. Pandas workload + +3. Generic Python workload + +Each workload type has a dedicated Apache Amaterasu SDK. +The Apache Amaterasu SDK is available in PyPI and can be installed as follows: +```bash +pip install apache-amaterasu Review comment: No, at least not now. There was an issue with actually connecting the parts. Currently all of the SDKs sit under the apache-amaterasu package. Let's put it as a task for later to see how to dismantle this. (the main issue was to provide a sensible SDK, it is ugly if you have to do "from amaterasu_pyspark import runtime", it is better to have it as "from amaterasu.pysaprk import runtime", but that requires some more research into how to make it possible via some kind of plugin architecture or something of the sort. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
