[ https://issues.apache.org/jira/browse/SPARK-40092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
t oo updated SPARK-40092: ------------------------- Description: my docker file is very big with pyspark can i remove dis files below if i don't use 'ML'? 14M /usr/local/lib/python3.10/site-packages/pyspark/jars/breeze_2.12-1.2.jar 5.9M /usr/local/lib/python3.10/site-packages/pyspark/jars/spark-mllib_2.12-3.3.0.jar was: my docker file is very big with pyspark can i remove dis file below if i don't use 'spark streaming'? 35M /usr/local/lib/python3.10/site-packages/pyspark/jars/rocksdbjni-6.20.3.jar > is breeze required if not using ML? > ----------------------------------- > > Key: SPARK-40092 > URL: https://issues.apache.org/jira/browse/SPARK-40092 > Project: Spark > Issue Type: Question > Components: Deploy > Affects Versions: 3.3.0 > Reporter: t oo > Priority: Major > > my docker file is very big with pyspark > can i remove dis files below if i don't use 'ML'? > 14M > /usr/local/lib/python3.10/site-packages/pyspark/jars/breeze_2.12-1.2.jar > 5.9M > /usr/local/lib/python3.10/site-packages/pyspark/jars/spark-mllib_2.12-3.3.0.jar -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org