chamikaramj commented on issue #22533:
URL: https://github.com/apache/beam/issues/22533#issuecomment-1201473386
Detailed instructions to reproduce using an existing Apache Beam release.
# Install Apache Beam 2.40.0
$ mkdir test_env
$ python -m venv test_env/
$ . ./test_env/bin/activate
$ pip install apache-beam[gcp]==2.40.0
# pip freeze
# (if gRPC version is not 1.48.0 uninstall and install version 1.48.0 to
test or build from source).
# Run the test
$ export BOOTSTRAP_SERVER="dummy_broker"
$ export PROJECT=dummyproject
$ export TEMP_LOCATION=gs://dummybucket/tmp
$ export REGION="us-central1"
$ export JOB_NAME="kafka-taxi-`date +%Y%m%d-%H%M%S`"
$ export NUM_WORKERS="5"
$ python -m apache_beam.examples.kafkataxi.kafka_taxi \
--runner DataflowRunner \
--temp_location $TEMP_LOCATION \
--project $PROJECT \
--region $REGION \
--num_workers $NUM_WORKERS \
--job_name $JOB_NAME \
--bootstrap_servers $BOOTSTRAP_SERVER
You'll notice that the test get stuck at the "subprocess.Popen" call at
below location (right after the log at the line "Starting service with...").
https://github.com/apache/beam/blob/e5e3cb25ca4fc2e31c10eb3dbda8289c6bfc7140/sdks/python/apache_beam/utils/subprocess_server.py#L117
If you try the same test with gRPC version 1.47.0 the test will proceed (but
note that the test will still fail at a later location since we provided dummy
parameters above).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
