[
https://issues.apache.org/jira/browse/BEAM-10257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Kyle Weaver resolved BEAM-10257.
--------------------------------
Fix Version/s: 2.24.0
Resolution: Fixed
> Add option defaults for Spark Python tests
> ------------------------------------------
>
> Key: BEAM-10257
> URL: https://issues.apache.org/jira/browse/BEAM-10257
> Project: Beam
> Issue Type: Improvement
> Components: runner-spark
> Reporter: Kyle Weaver
> Assignee: Kyle Weaver
> Priority: P3
> Labels: portability-spark
> Fix For: 2.24.0
>
> Time Spent: 40m
> Remaining Estimate: 0h
>
> I want to run a single Spark Python test:
> python -m apache_beam.runners.portability.spark_runner_test
> SparkRunnerTest.test_metrics
> But I get this error:
> TypeError: expected str, bytes or os.PathLike object, not NoneType
> Turns out spark_job_server_jar isn't set, and there's no default value. We
> should set a default.
> We should also change the default environment type to LOOPBACK for basic
> testing purposes because it requires the least setup.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
