Sean Owen commented on SPARK-20327:

I think the point is, without reflection, using 3.x+ APIs with 2.x results in 
complete failures at runtime because classes won't link. You can't even present 
an error. 

This isn't Hadoop-specific; this is how you have to deal with handling multiple 
incompatible APIs at the same time in the JVM in general.

> Add CLI support for YARN custom resources, like GPUs
> ----------------------------------------------------
>                 Key: SPARK-20327
>                 URL: https://issues.apache.org/jira/browse/SPARK-20327
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Shell, Spark Submit
>    Affects Versions: 2.1.0
>            Reporter: Daniel Templeton
>            Priority: Major
>              Labels: newbie
> YARN-3926 adds the ability for administrators to configure custom resources, 
> like GPUs.  This JIRA is to add support to Spark for requesting resources 
> other than CPU virtual cores and memory.  See YARN-3926.

This message was sent by Atlassian JIRA

To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org

Reply via email to