[
https://issues.apache.org/jira/browse/BEAM-4223?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16502805#comment-16502805
]
María GH edited comment on BEAM-4223 at 6/13/18 8:15 AM:
---------------------------------------------------------
I ran it locally with Dataflow today and I was able to pull messages sent with
the Java injector via
{noformat}
$ gcloud alpha pubsub subscriptions pull
--project=google.com:deft-testing-integration
projects/google.com:clouddfe/subscriptions/leader_board-mariagh-sub-1
--auto-ack --limit 1000
{noformat}
but nothing appeared read in PubSub:
https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-05_00_51_29-14166534973167145023?project=google.com:clouddfe&organizationId=433637338589
nothing read in the Dataflow UI could be the UI not properly displaying it, but
I also checked and nothing showed up in the BigQuery tables.
was (Author: mariagh):
I ran it locally with Dataflow today and I was able to pull messages sent with
the Java injector via
{noformat}
$ gcloud alpha pubsub subscriptions pull
--project=google.com:deft-testing-integration
projects/google.com:clouddfe/subscriptions/leader_board-mariagh-sub-1
--auto-ack --limit 1000
{noformat}
but nothing appeared read in PubSub:
https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-06-05_00_51_29-14166534973167145023?project=google.com:clouddfe&organizationId=433637338589
> game_stats.py not working with the DataflowRunner
> -------------------------------------------------
>
> Key: BEAM-4223
> URL: https://issues.apache.org/jira/browse/BEAM-4223
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Affects Versions: 2.4.0
> Reporter: María GH
> Priority: Minor
>
> Command used:
> python apache_beam/examples/complete/game/game_stats.py \
> --project=google.com:clouddfe \
> --topic projects/google.com:clouddfe/topics/leader_board\-$USER-topic-1 \
> --dataset ${USER}_bq_dataset \
> --runner DataflowRunner \
> --temp_location gs://<...> \
> --sdk_location /<...>/dist/apache-beam-2.5.0.dev0.tar.gz
>
> BigQuery at:
> [https://bigquery.cloud.google.com/dataset/google.com:clouddfe:mariagh_bq_dataset?pli=1]
> Nothing gets output to game_stats_sessions.
>
> Job:
> https://pantheon.corp.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-04-30_12_56_57-10424752922445606094?project=google.com:clouddfe
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)