tgravescs commented on a change in pull request #28085: [SPARK-29641][PYTHON][CORE] Stage Level Sched: Add python api's and tests URL: https://github.com/apache/spark/pull/28085#discussion_r404221962
########## File path: python/pyspark/__init__.py ########## @@ -55,6 +55,12 @@ from pyspark.accumulators import Accumulator, AccumulatorParam from pyspark.broadcast import Broadcast from pyspark.resourceinformation import ResourceInformation +from pyspark.taskresourcerequest import TaskResourceRequest +from pyspark.executorresourcerequest import ExecutorResourceRequest +from pyspark.taskresourcerequests import TaskResourceRequests +from pyspark.executorresourcerequests import ExecutorResourceRequests +from pyspark.resourceprofilebuilder import ResourceProfileBuilder +from pyspark.resourceprofile import ResourceProfile Review comment: how about putting them all into a resource module that way its similar to the scala side with org.apache.spark.resource. ? Or were you talking about actually combining the files? then assume here we coudl do from pyspark.resource import * ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
