See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/89/display/redirect?page=changes>
Changes: [APryor] Correct a typo in documentation [robertwb] [BEAM-9577] Small fixes to portable runner staging. [robertwb] [BEAM-9768] Gradle command for Python ULR. [ehudm] [BEAM-9737] Don't use docker create option -u [github] [BEAM-9674] Don't specify selected fields when fetching BigQuery table [github] [BEAM-9650] Cleanup documentation on side inputs patterns (#11415) [github] [BEAM-8646] Fix external environment on OS X as well. (#11431) [github] [BEAM-9743] Fix TFRecordCodec to try harder to read/write (#11397) [github] Updates and clarifications on type safety. (#11449) [github] [BEAM-3836] Enable dynamic splitting/checkpointing within the Java SDK [github] [BEAM-8872] Support split at fraction for OffsetRangeTracker (#11418) ------------------------------------------ [...truncated 277.88 KB...] INFO 2020-04-18 15:02:49 +0000 master-replica-0 loss = 12.058289, step = 7101 (0.211 sec) INFO 2020-04-18 15:02:49 +0000 master-replica-0 global_step/sec: 465.605 INFO 2020-04-18 15:02:49 +0000 master-replica-0 loss = 10.206604, step = 7201 (0.215 sec) INFO 2020-04-18 15:02:49 +0000 master-replica-0 global_step/sec: 481.904 INFO 2020-04-18 15:02:49 +0000 master-replica-0 loss = 14.783527, step = 7301 (0.208 sec) INFO 2020-04-18 15:02:50 +0000 master-replica-0 global_step/sec: 481.118 INFO 2020-04-18 15:02:50 +0000 master-replica-0 loss = 11.069302, step = 7401 (0.208 sec) INFO 2020-04-18 15:02:50 +0000 master-replica-0 global_step/sec: 478.506 INFO 2020-04-18 15:02:50 +0000 master-replica-0 loss = 18.613235, step = 7501 (0.209 sec) INFO 2020-04-18 15:02:50 +0000 master-replica-0 global_step/sec: 473.947 INFO 2020-04-18 15:02:50 +0000 master-replica-0 loss = 10.232683, step = 7601 (0.211 sec) INFO 2020-04-18 15:02:50 +0000 master-replica-0 global_step/sec: 473.276 INFO 2020-04-18 15:02:50 +0000 master-replica-0 loss = 15.328085, step = 7701 (0.211 sec) INFO 2020-04-18 15:02:50 +0000 master-replica-0 global_step/sec: 484.91 INFO 2020-04-18 15:02:50 +0000 master-replica-0 loss = 13.056836, step = 7801 (0.206 sec) INFO 2020-04-18 15:02:51 +0000 master-replica-0 global_step/sec: 485.661 INFO 2020-04-18 15:02:51 +0000 master-replica-0 loss = 13.530502, step = 7901 (0.206 sec) INFO 2020-04-18 15:02:51 +0000 master-replica-0 Saving checkpoints for 7992 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-18 15:02:54 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-18 15:02:54 +0000 master-replica-0 global_step/sec: 29.2098 INFO 2020-04-18 15:02:54 +0000 master-replica-0 loss = 12.056596, step = 8001 (3.423 sec) INFO 2020-04-18 15:02:54 +0000 master-replica-0 global_step/sec: 468.452 INFO 2020-04-18 15:02:54 +0000 master-replica-0 loss = 13.197481, step = 8101 (0.214 sec) INFO 2020-04-18 15:02:54 +0000 master-replica-0 global_step/sec: 462.423 INFO 2020-04-18 15:02:54 +0000 master-replica-0 loss = 11.0653925, step = 8201 (0.216 sec) INFO 2020-04-18 15:02:55 +0000 master-replica-0 global_step/sec: 465.984 INFO 2020-04-18 15:02:55 +0000 master-replica-0 loss = 10.673388, step = 8301 (0.215 sec) INFO 2020-04-18 15:02:55 +0000 master-replica-0 global_step/sec: 475.079 INFO 2020-04-18 15:02:55 +0000 master-replica-0 loss = 13.3438835, step = 8401 (0.211 sec) INFO 2020-04-18 15:02:55 +0000 master-replica-0 global_step/sec: 473.254 INFO 2020-04-18 15:02:55 +0000 master-replica-0 loss = 15.319138, step = 8501 (0.212 sec) INFO 2020-04-18 15:02:55 +0000 master-replica-0 global_step/sec: 478.994 INFO 2020-04-18 15:02:55 +0000 master-replica-0 loss = 15.164669, step = 8601 (0.209 sec) INFO 2020-04-18 15:02:56 +0000 master-replica-0 global_step/sec: 460.895 INFO 2020-04-18 15:02:56 +0000 master-replica-0 loss = 14.968837, step = 8701 (0.217 sec) INFO 2020-04-18 15:02:56 +0000 master-replica-0 global_step/sec: 457.817 INFO 2020-04-18 15:02:56 +0000 master-replica-0 loss = 13.234479, step = 8801 (0.218 sec) INFO 2020-04-18 15:02:56 +0000 master-replica-0 global_step/sec: 467.797 INFO 2020-04-18 15:02:56 +0000 master-replica-0 loss = 13.244083, step = 8901 (0.214 sec) INFO 2020-04-18 15:02:56 +0000 master-replica-0 Saving checkpoints for 8991 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-18 15:02:59 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-18 15:03:00 +0000 master-replica-0 global_step/sec: 28.2626 INFO 2020-04-18 15:03:00 +0000 master-replica-0 loss = 12.488724, step = 9001 (3.538 sec) INFO 2020-04-18 15:03:00 +0000 master-replica-0 global_step/sec: 470.952 INFO 2020-04-18 15:03:00 +0000 master-replica-0 loss = 17.661911, step = 9101 (0.212 sec) INFO 2020-04-18 15:03:00 +0000 master-replica-0 global_step/sec: 475.346 INFO 2020-04-18 15:03:00 +0000 master-replica-0 loss = 17.071224, step = 9201 (0.211 sec) INFO 2020-04-18 15:03:00 +0000 master-replica-0 global_step/sec: 475.479 INFO 2020-04-18 15:03:00 +0000 master-replica-0 loss = 12.921253, step = 9301 (0.210 sec) INFO 2020-04-18 15:03:00 +0000 master-replica-0 global_step/sec: 480.46 INFO 2020-04-18 15:03:00 +0000 master-replica-0 loss = 12.560972, step = 9401 (0.208 sec) INFO 2020-04-18 15:03:01 +0000 master-replica-0 global_step/sec: 488.544 INFO 2020-04-18 15:03:01 +0000 master-replica-0 loss = 11.63537, step = 9501 (0.205 sec) INFO 2020-04-18 15:03:01 +0000 master-replica-0 global_step/sec: 482.66 INFO 2020-04-18 15:03:01 +0000 master-replica-0 loss = 14.486891, step = 9601 (0.207 sec) INFO 2020-04-18 15:03:01 +0000 master-replica-0 global_step/sec: 477.256 INFO 2020-04-18 15:03:01 +0000 master-replica-0 loss = 14.137644, step = 9701 (0.210 sec) INFO 2020-04-18 15:03:01 +0000 master-replica-0 global_step/sec: 483.482 INFO 2020-04-18 15:03:01 +0000 master-replica-0 loss = 15.809562, step = 9801 (0.207 sec) INFO 2020-04-18 15:03:01 +0000 master-replica-0 global_step/sec: 480.146 INFO 2020-04-18 15:03:01 +0000 master-replica-0 loss = 9.228783, step = 9901 (0.208 sec) INFO 2020-04-18 15:03:02 +0000 master-replica-0 Saving checkpoints for 9990 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-18 15:03:05 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-18 15:03:05 +0000 master-replica-0 Saving checkpoints for 10000 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-18 15:03:08 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-18 15:03:09 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f9c295f3390>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f9c295f3390>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f9c29510990>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f9c29510990>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510d50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510d50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510d10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510d10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510dd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510dd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510e50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c29510e50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c2951e2d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c2951e2d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f9c293330d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f9c293330d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:09 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f9c295f3390>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f9c295f3390>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:11 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-04-18 15:03:11 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-04-18 15:03:11 +0000 master-replica-0 Done calling model_fn. INFO 2020-04-18 15:03:11 +0000 master-replica-0 Starting evaluation at 2020-04-18T15:03:11Z INFO 2020-04-18 15:03:11 +0000 master-replica-0 Graph was finalized. INFO 2020-04-18 15:03:11 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-18 15:03:12 +0000 master-replica-0 Running local_init_op. INFO 2020-04-18 15:03:12 +0000 master-replica-0 Done running local_init_op. INFO 2020-04-18 15:03:13 +0000 master-replica-0 Evaluation [100/1000] INFO 2020-04-18 15:03:13 +0000 master-replica-0 Evaluation [200/1000] INFO 2020-04-18 15:03:13 +0000 master-replica-0 Evaluation [300/1000] INFO 2020-04-18 15:03:13 +0000 master-replica-0 Evaluation [400/1000] INFO 2020-04-18 15:03:13 +0000 master-replica-0 Evaluation [500/1000] INFO 2020-04-18 15:03:14 +0000 master-replica-0 Evaluation [600/1000] INFO 2020-04-18 15:03:14 +0000 master-replica-0 Evaluation [700/1000] INFO 2020-04-18 15:03:14 +0000 master-replica-0 Evaluation [800/1000] INFO 2020-04-18 15:03:14 +0000 master-replica-0 Evaluation [900/1000] INFO 2020-04-18 15:03:14 +0000 master-replica-0 Evaluation [1000/1000] INFO 2020-04-18 15:03:15 +0000 master-replica-0 Finished evaluation at 2020-04-18-15:03:15 INFO 2020-04-18 15:03:15 +0000 master-replica-0 Saving dict for global step 10000: accuracy = 0.81885, accuracy_baseline = 0.818525, auc = 0.91817915, auc_precision_recall = 0.60117817, average_loss = 0.3278253, global_step = 10000, label/mean = 0.181475, loss = 13.113012, precision = 0.8095238, prediction/mean = 0.18597855, recall = 0.0023419203 INFO 2020-04-18 15:03:15 +0000 master-replica-0 Saving 'checkpoint_path' summary for global step 10000: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-18 15:03:15 +0000 master-replica-0 Performing the final export in the end of training. WARNING 2020-04-18 15:03:16 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING 2020-04-18 15:03:16 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-18 15:03:16 +0000 master-replica-0 value: "\n\t\n\007Const:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-04-18 15:03:16 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-18 15:03:16 +0000 master-replica-0 value: "\n\013\n\tConst_1:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-04-18 15:03:16 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore WARNING 2020-04-18 15:03:16 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py:230: The name tf.saved_model.constants.ASSETS_KEY is deprecated. Please use tf.saved_model.ASSETS_KEY instead. INFO 2020-04-18 15:03:16 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f9c640a0350>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f9c640a0350>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f9c2ad14950>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f9c2ad14950>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3ad0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3ad0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3e10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3e10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3e90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3e90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3d50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3d50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3dd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c4c5f3dd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f9c640a0a90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f9c640a0a90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:17 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f9c2ad14f50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f9c2ad14f50>>: AssertionError: Bad argument number for Name: 3, expecting 4 INFO 2020-04-18 15:03:18 +0000 master-replica-0 Done calling model_fn. WARNING 2020-04-18 15:03:18 +0000 master-replica-0 From /usr/local/lib/python2.7/dist-packages/tensorflow/python/saved_model/signature_def_utils_impl.py:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version. WARNING 2020-04-18 15:03:18 +0000 master-replica-0 Instructions for updating: WARNING 2020-04-18 15:03:18 +0000 master-replica-0 This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info. INFO 2020-04-18 15:03:18 +0000 master-replica-0 Signatures INCLUDED in export for Eval: None INFO 2020-04-18 15:03:18 +0000 master-replica-0 Signatures INCLUDED in export for Classify: ['serving_default', 'classification'] INFO 2020-04-18 15:03:18 +0000 master-replica-0 Signatures INCLUDED in export for Regress: ['regression'] INFO 2020-04-18 15:03:18 +0000 master-replica-0 Signatures INCLUDED in export for Predict: ['predict'] INFO 2020-04-18 15:03:18 +0000 master-replica-0 Signatures INCLUDED in export for Train: None INFO 2020-04-18 15:03:18 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-18 15:03:19 +0000 master-replica-0 Assets added to graph. INFO 2020-04-18 15:03:20 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1587222195/assets INFO 2020-04-18 15:03:23 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1587222195/saved_model.pb INFO 2020-04-18 15:03:25 +0000 master-replica-0 Loss for final step: 13.397189. WARNING 2020-04-18 15:03:25 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_model_analysis/eval_saved_model/export.py:474: export_all_saved_models (from tensorflow_estimator.contrib.estimator.python.estimator.export) is deprecated and will be removed after 2018-12-03. WARNING 2020-04-18 15:03:25 +0000 master-replica-0 Instructions for updating: WARNING 2020-04-18 15:03:25 +0000 master-replica-0 Use estimator.experimental_export_all_saved_models WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-18 15:03:26 +0000 master-replica-0 value: "\n\t\n\007Const:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-18 15:03:26 +0000 master-replica-0 value: "\n\013\n\tConst_1:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-04-18 15:03:26 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore INFO 2020-04-18 15:03:26 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f9c28ca1c90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f9c28ca1c90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f9c28ca1d90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f9c28ca1d90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30190>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30190>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e304d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e304d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30450>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30450>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30550>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30550>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30790>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f9c28e30790>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:26 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f9c28ca1c50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f9c28ca1c50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:27 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f9c28ca1f90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f9c28ca1f90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-18 15:03:28 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-04-18 15:03:28 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-04-18 15:03:28 +0000 master-replica-0 Done calling model_fn. INFO 2020-04-18 15:03:28 +0000 master-replica-0 Signatures INCLUDED in export for Eval: ['eval'] INFO 2020-04-18 15:03:28 +0000 master-replica-0 Signatures INCLUDED in export for Classify: None INFO 2020-04-18 15:03:28 +0000 master-replica-0 Signatures INCLUDED in export for Regress: None INFO 2020-04-18 15:03:28 +0000 master-replica-0 Signatures INCLUDED in export for Predict: None INFO 2020-04-18 15:03:28 +0000 master-replica-0 Signatures INCLUDED in export for Train: None WARNING 2020-04-18 15:03:28 +0000 master-replica-0 Export includes no default signature! INFO 2020-04-18 15:03:28 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-18 15:03:29 +0000 master-replica-0 Assets added to graph. INFO 2020-04-18 15:03:30 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1587222205/assets INFO 2020-04-18 15:03:33 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1587222205/saved_model.pb INFO 2020-04-18 15:03:34 +0000 master-replica-0 Module completed; cleaning up. INFO 2020-04-18 15:03:34 +0000 master-replica-0 Clean up finished. INFO 2020-04-18 15:03:34 +0000 master-replica-0 Task completed successfully. endTime: '2020-04-18T15:06:39' jobId: chicago_taxi_trainer_20200418_145906 startTime: '2020-04-18T15:00:05' state: SUCCEEDED Eval model dir: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200418-143552/chicago_taxi_output/trainer_output/working_dir/eval_model_dir <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. process_tfma.py:102: FutureWarning: ReadFromBigQuery is experimental. | 'CleanData' >> <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1631: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_model_analysis/slicer/slicer.py>:407: BeamDeprecationWarning: RemoveDuplicates is deprecated since 2.12. Use Distinct instead. | 'IncrementCounter' >> beam.Map(increment_counter)) warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md warning: check: missing required meta-data: url warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter. ERROR:grpc._channel:Exception iterating requests! Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 195, in consume_request_iterator request = next(request_iterator) File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/artifact_service.py";,> line 316, in __next__ raise self._queue.get() _MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.UNIMPLEMENTED details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService" debug_error_string = "{"created":"@1587222418.059219072","description":"Error received from peer ipv4:127.0.0.1:8098","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}" > ERROR:root:java.lang.IllegalStateException: No container running for id 2a59968eae622156a0a4139dec16a73f1a4ff4be588b3c60466c0778475019d0 Traceback (most recent call last): File "process_tfma.py", line 191, in <module> main() File "process_tfma.py", line 187, in main project=known_args.metric_reporting_project) File "process_tfma.py", line 127, in process_tfma result.wait_until_finish() File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 571, in wait_until_finish (self._job_id, self._state, self._last_error_message())) RuntimeError: Pipeline chicago-taxi-tfdv-20200418-143552_a7d36006-2ca2-4ba3-83bd-c79a22f650fa failed in state FAILED: java.lang.IllegalStateException: No container running for id 2a59968eae622156a0a4139dec16a73f1a4ff4be588b3c60466c0778475019d0 > Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 39m 15s 6 actionable tasks: 5 executed, 1 up-to-date Publishing build scan... https://gradle.com/s/yoj2vfntynrke Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
