[
https://issues.apache.org/jira/browse/SPARK-40092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
t oo updated SPARK-40092:
-------------------------
Description:
my docker file is very big with pyspark
can i remove dis files below if i don't use 'ML'?
14M /usr/local/lib/python3.10/site-packages/pyspark/jars/breeze_2.12-1.2.jar
5.9M
/usr/local/lib/python3.10/site-packages/pyspark/jars/spark-mllib_2.12-3.3.0.jar
was:
my docker file is very big with pyspark
can i remove dis file below if i don't use 'spark streaming'?
35M
/usr/local/lib/python3.10/site-packages/pyspark/jars/rocksdbjni-6.20.3.jar
> is breeze required if not using ML?
> -----------------------------------
>
> Key: SPARK-40092
> URL: https://issues.apache.org/jira/browse/SPARK-40092
> Project: Spark
> Issue Type: Question
> Components: Deploy
> Affects Versions: 3.3.0
> Reporter: t oo
> Priority: Major
>
> my docker file is very big with pyspark
> can i remove dis files below if i don't use 'ML'?
> 14M
> /usr/local/lib/python3.10/site-packages/pyspark/jars/breeze_2.12-1.2.jar
> 5.9M
> /usr/local/lib/python3.10/site-packages/pyspark/jars/spark-mllib_2.12-3.3.0.jar
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
