See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/262/display/redirect?page=changes>
Changes: [ehudm] [BEAM-8466] Make strip_iterable more strict [amaliujia] add 2.20.0 blog post [amaliujia] add a known issue [kamil.wasilewski] [BEAM-8671] Migrate Load Tests to Python 3.7 [lcwik] [BEAM-2939] Update unbounded source as SDF wrapper to resume [pabloem] Fixing type names for BQ Avro Tools [lcwik] fixup! Fix spotbugs warning [kcweaver] [BEAM-9756] Nexmark: only use --region in Dataflow. [lcwik] [BEAM-9577] Fix test to create urls from paths which are compatible with [thw] Fix py37-lint [thw] Maven compatible publish repository authentication via settings.xml [pabloem] Removing underscore from _ReadFromBigQuery to make it external. It [kamil.wasilewski] Remove outdated doc for ReadFromBigQuery transform [ehudm] [BEAM-9119] Disable flaky test [github] [BEAM-8889] add gRPC suport in GCS connector (behind an [amaliujia] fixup! update 2.20.0 date [github] [BEAM-9729, BEAM-8486] Runner-side bundle registration cleanup. (#11358) [github] Add new release 2.20.0 to beam website (#11285) [jkw] Fix typo [github] Merge pull request #11151 from [BEAM-9468] Hl7v2 io [echauchot] Add GBK load tests script for spark structured streaming runner [echauchot] Add CoGBK load tests script for spark structured streaming runner [echauchot] Add Combine load tests script for spark structured streaming runner [echauchot] Add Pardo load tests script for spark structured streaming runner ------------------------------------------ [...truncated 201.74 KB...] INFO 2020-04-16 15:05:13 +0000 master-replica-0 global_step/sec: 483.947 INFO 2020-04-16 15:05:13 +0000 master-replica-0 loss = 17.535917, step = 6701 (0.206 sec) INFO 2020-04-16 15:05:13 +0000 master-replica-0 global_step/sec: 489.519 INFO 2020-04-16 15:05:13 +0000 master-replica-0 loss = 15.906481, step = 6801 (0.204 sec) INFO 2020-04-16 15:05:14 +0000 master-replica-0 global_step/sec: 482.964 INFO 2020-04-16 15:05:14 +0000 master-replica-0 loss = 16.071018, step = 6901 (0.207 sec) INFO 2020-04-16 15:05:14 +0000 master-replica-0 Saving checkpoints for 6993 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-16 15:05:18 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-16 15:05:18 +0000 master-replica-0 global_step/sec: 23.7502 INFO 2020-04-16 15:05:18 +0000 master-replica-0 loss = 14.595896, step = 7001 (4.211 sec) INFO 2020-04-16 15:05:18 +0000 master-replica-0 global_step/sec: 452.677 INFO 2020-04-16 15:05:18 +0000 master-replica-0 loss = 13.745755, step = 7101 (0.221 sec) INFO 2020-04-16 15:05:18 +0000 master-replica-0 global_step/sec: 472.108 INFO 2020-04-16 15:05:18 +0000 master-replica-0 loss = 14.895653, step = 7201 (0.212 sec) INFO 2020-04-16 15:05:19 +0000 master-replica-0 global_step/sec: 462.914 INFO 2020-04-16 15:05:19 +0000 master-replica-0 loss = 18.93036, step = 7301 (0.216 sec) INFO 2020-04-16 15:05:19 +0000 master-replica-0 global_step/sec: 438.328 INFO 2020-04-16 15:05:19 +0000 master-replica-0 loss = 15.099951, step = 7401 (0.228 sec) INFO 2020-04-16 15:05:19 +0000 master-replica-0 global_step/sec: 440.449 INFO 2020-04-16 15:05:19 +0000 master-replica-0 loss = 14.385462, step = 7501 (0.227 sec) INFO 2020-04-16 15:05:19 +0000 master-replica-0 global_step/sec: 457.17 INFO 2020-04-16 15:05:19 +0000 master-replica-0 loss = 16.118269, step = 7601 (0.219 sec) INFO 2020-04-16 15:05:19 +0000 master-replica-0 global_step/sec: 465.35 INFO 2020-04-16 15:05:19 +0000 master-replica-0 loss = 12.005362, step = 7701 (0.215 sec) INFO 2020-04-16 15:05:20 +0000 master-replica-0 global_step/sec: 448.497 INFO 2020-04-16 15:05:20 +0000 master-replica-0 loss = 14.13669, step = 7801 (0.223 sec) INFO 2020-04-16 15:05:20 +0000 master-replica-0 global_step/sec: 456.375 INFO 2020-04-16 15:05:20 +0000 master-replica-0 loss = 12.825304, step = 7901 (0.219 sec) INFO 2020-04-16 15:05:20 +0000 master-replica-0 Saving checkpoints for 7992 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-16 15:05:24 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-16 15:05:24 +0000 master-replica-0 global_step/sec: 25.6367 INFO 2020-04-16 15:05:24 +0000 master-replica-0 loss = 16.003841, step = 8001 (3.901 sec) INFO 2020-04-16 15:05:24 +0000 master-replica-0 global_step/sec: 474.768 INFO 2020-04-16 15:05:24 +0000 master-replica-0 loss = 14.895735, step = 8101 (0.211 sec) INFO 2020-04-16 15:05:24 +0000 master-replica-0 global_step/sec: 475.941 INFO 2020-04-16 15:05:24 +0000 master-replica-0 loss = 17.460863, step = 8201 (0.210 sec) INFO 2020-04-16 15:05:24 +0000 master-replica-0 global_step/sec: 487.335 INFO 2020-04-16 15:05:24 +0000 master-replica-0 loss = 11.805189, step = 8301 (0.205 sec) INFO 2020-04-16 15:05:25 +0000 master-replica-0 global_step/sec: 472.565 INFO 2020-04-16 15:05:25 +0000 master-replica-0 loss = 16.334782, step = 8401 (0.212 sec) INFO 2020-04-16 15:05:25 +0000 master-replica-0 global_step/sec: 481.57 INFO 2020-04-16 15:05:25 +0000 master-replica-0 loss = 18.037941, step = 8501 (0.208 sec) INFO 2020-04-16 15:05:25 +0000 master-replica-0 global_step/sec: 468.414 INFO 2020-04-16 15:05:25 +0000 master-replica-0 loss = 12.490861, step = 8601 (0.213 sec) INFO 2020-04-16 15:05:25 +0000 master-replica-0 global_step/sec: 476.979 INFO 2020-04-16 15:05:25 +0000 master-replica-0 loss = 14.816982, step = 8701 (0.210 sec) INFO 2020-04-16 15:05:25 +0000 master-replica-0 global_step/sec: 478.261 INFO 2020-04-16 15:05:25 +0000 master-replica-0 loss = 16.388287, step = 8801 (0.209 sec) INFO 2020-04-16 15:05:26 +0000 master-replica-0 global_step/sec: 480.801 INFO 2020-04-16 15:05:26 +0000 master-replica-0 loss = 13.089823, step = 8901 (0.208 sec) INFO 2020-04-16 15:05:26 +0000 master-replica-0 Saving checkpoints for 8991 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-16 15:05:30 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-16 15:05:30 +0000 master-replica-0 global_step/sec: 23.5938 INFO 2020-04-16 15:05:30 +0000 master-replica-0 loss = 14.778786, step = 9001 (4.238 sec) INFO 2020-04-16 15:05:30 +0000 master-replica-0 global_step/sec: 458.695 INFO 2020-04-16 15:05:30 +0000 master-replica-0 loss = 16.622938, step = 9101 (0.218 sec) INFO 2020-04-16 15:05:30 +0000 master-replica-0 global_step/sec: 450.942 INFO 2020-04-16 15:05:30 +0000 master-replica-0 loss = 16.206886, step = 9201 (0.222 sec) INFO 2020-04-16 15:05:31 +0000 master-replica-0 global_step/sec: 462.569 INFO 2020-04-16 15:05:31 +0000 master-replica-0 loss = 14.8528385, step = 9301 (0.216 sec) INFO 2020-04-16 15:05:31 +0000 master-replica-0 global_step/sec: 444.642 INFO 2020-04-16 15:05:31 +0000 master-replica-0 loss = 14.272907, step = 9401 (0.225 sec) INFO 2020-04-16 15:05:31 +0000 master-replica-0 global_step/sec: 448.976 INFO 2020-04-16 15:05:31 +0000 master-replica-0 loss = 13.245745, step = 9501 (0.223 sec) INFO 2020-04-16 15:05:31 +0000 master-replica-0 global_step/sec: 456.713 INFO 2020-04-16 15:05:31 +0000 master-replica-0 loss = 15.431953, step = 9601 (0.219 sec) INFO 2020-04-16 15:05:31 +0000 master-replica-0 global_step/sec: 450.682 INFO 2020-04-16 15:05:31 +0000 master-replica-0 loss = 16.27299, step = 9701 (0.222 sec) INFO 2020-04-16 15:05:32 +0000 master-replica-0 global_step/sec: 459.494 INFO 2020-04-16 15:05:32 +0000 master-replica-0 loss = 13.279086, step = 9801 (0.218 sec) INFO 2020-04-16 15:05:32 +0000 master-replica-0 global_step/sec: 459.177 INFO 2020-04-16 15:05:32 +0000 master-replica-0 loss = 15.693743, step = 9901 (0.218 sec) INFO 2020-04-16 15:05:32 +0000 master-replica-0 Saving checkpoints for 9990 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-16 15:05:36 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-16 15:05:36 +0000 master-replica-0 Saving checkpoints for 10000 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-16 15:05:39 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-16 15:05:39 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-16 15:05:39 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f01b0b30390>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f01b0b30390>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-16 15:05:39 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f01b0a4d990>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f01b0a4d990>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4dd50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4dd50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4dd10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4dd10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4ddd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4ddd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4de50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a4de50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a5b2d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01b0a5b2d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f01b0acac90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f01b0acac90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:40 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f01b0a4dd50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f01b0a4dd50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:42 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-04-16 15:05:42 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-04-16 15:05:42 +0000 master-replica-0 Done calling model_fn. INFO 2020-04-16 15:05:42 +0000 master-replica-0 Starting evaluation at 2020-04-16T15:05:42Z INFO 2020-04-16 15:05:42 +0000 master-replica-0 Graph was finalized. INFO 2020-04-16 15:05:42 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-16 15:05:42 +0000 master-replica-0 Running local_init_op. INFO 2020-04-16 15:05:42 +0000 master-replica-0 Done running local_init_op. INFO 2020-04-16 15:05:43 +0000 master-replica-0 Evaluation [100/1000] INFO 2020-04-16 15:05:44 +0000 master-replica-0 Evaluation [200/1000] INFO 2020-04-16 15:05:44 +0000 master-replica-0 Evaluation [300/1000] INFO 2020-04-16 15:05:44 +0000 master-replica-0 Evaluation [400/1000] INFO 2020-04-16 15:05:44 +0000 master-replica-0 Evaluation [500/1000] INFO 2020-04-16 15:05:44 +0000 master-replica-0 Evaluation [600/1000] INFO 2020-04-16 15:05:45 +0000 master-replica-0 Evaluation [700/1000] INFO 2020-04-16 15:05:45 +0000 master-replica-0 Evaluation [800/1000] INFO 2020-04-16 15:05:45 +0000 master-replica-0 Evaluation [900/1000] INFO 2020-04-16 15:05:45 +0000 master-replica-0 Evaluation [1000/1000] INFO 2020-04-16 15:05:46 +0000 master-replica-0 Finished evaluation at 2020-04-16-15:05:46 INFO 2020-04-16 15:05:46 +0000 master-replica-0 Saving dict for global step 10000: accuracy = 0.815725, accuracy_baseline = 0.72064996, auc = 0.9425865, auc_precision_recall = 0.78399277, average_loss = 0.3609826, global_step = 10000, label/mean = 0.27935, loss = 14.439303, precision = 0.78928953, prediction/mean = 0.27863294, recall = 0.4642921 INFO 2020-04-16 15:05:46 +0000 master-replica-0 Saving 'checkpoint_path' summary for global step 10000: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-16 15:05:46 +0000 master-replica-0 Performing the final export in the end of training. WARNING 2020-04-16 15:05:47 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING 2020-04-16 15:05:47 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-16 15:05:47 +0000 master-replica-0 value: "\n\013\n\tConst_5:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-04-16 15:05:47 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-16 15:05:47 +0000 master-replica-0 value: "\n\013\n\tConst_7:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-04-16 15:05:47 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore WARNING 2020-04-16 15:05:47 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py:230: The name tf.saved_model.constants.ASSETS_KEY is deprecated. Please use tf.saved_model.ASSETS_KEY instead. INFO 2020-04-16 15:05:47 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-16 15:05:47 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f01b1d06b90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f01b1d06b90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-16 15:05:47 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f01b1cbf510>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f01b1cbf510>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378ad0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378ad0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378e10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378e10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378e90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378e90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378d50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378d50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378dd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f01f0378dd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f01b1cfe990>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f01b1cfe990>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:48 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f01b1d06890>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f01b1d06890>>: AssertionError: Bad argument number for Name: 3, expecting 4 INFO 2020-04-16 15:05:49 +0000 master-replica-0 Done calling model_fn. WARNING 2020-04-16 15:05:49 +0000 master-replica-0 From /usr/local/lib/python2.7/dist-packages/tensorflow/python/saved_model/signature_def_utils_impl.py:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version. WARNING 2020-04-16 15:05:49 +0000 master-replica-0 Instructions for updating: WARNING 2020-04-16 15:05:49 +0000 master-replica-0 This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info. INFO 2020-04-16 15:05:49 +0000 master-replica-0 Signatures INCLUDED in export for Eval: None INFO 2020-04-16 15:05:49 +0000 master-replica-0 Signatures INCLUDED in export for Classify: ['serving_default', 'classification'] INFO 2020-04-16 15:05:49 +0000 master-replica-0 Signatures INCLUDED in export for Regress: ['regression'] INFO 2020-04-16 15:05:49 +0000 master-replica-0 Signatures INCLUDED in export for Predict: ['predict'] INFO 2020-04-16 15:05:49 +0000 master-replica-0 Signatures INCLUDED in export for Train: None INFO 2020-04-16 15:05:49 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-16 15:05:50 +0000 master-replica-0 Assets added to graph. INFO 2020-04-16 15:05:51 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1587049546/assets INFO 2020-04-16 15:05:54 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1587049546/saved_model.pb INFO 2020-04-16 15:05:56 +0000 master-replica-0 Loss for final step: 13.865149. WARNING 2020-04-16 15:05:56 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_model_analysis/eval_saved_model/export.py:474: export_all_saved_models (from tensorflow_estimator.contrib.estimator.python.estimator.export) is deprecated and will be removed after 2018-12-03. WARNING 2020-04-16 15:05:56 +0000 master-replica-0 Instructions for updating: WARNING 2020-04-16 15:05:56 +0000 master-replica-0 Use estimator.experimental_export_all_saved_models WARNING 2020-04-16 15:05:57 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-16 15:05:57 +0000 master-replica-0 value: "\n\013\n\tConst_5:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-04-16 15:05:57 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-16 15:05:57 +0000 master-replica-0 value: "\n\013\n\tConst_7:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-04-16 15:05:57 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore INFO 2020-04-16 15:05:57 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-16 15:05:57 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f018ff00c90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f018ff00c90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-16 15:05:57 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f018ff00d90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f018ff00d90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-16 15:05:57 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b190>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b190>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:58 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b4d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b4d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:58 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b450>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b450>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:58 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b550>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b550>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:58 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b790>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f020808b790>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:58 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f018ff00c50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f018ff00c50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:05:58 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f018ff00fd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f018ff00fd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-16 15:06:00 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-04-16 15:06:00 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-04-16 15:06:00 +0000 master-replica-0 Done calling model_fn. INFO 2020-04-16 15:06:00 +0000 master-replica-0 Signatures INCLUDED in export for Eval: ['eval'] INFO 2020-04-16 15:06:00 +0000 master-replica-0 Signatures INCLUDED in export for Classify: None INFO 2020-04-16 15:06:00 +0000 master-replica-0 Signatures INCLUDED in export for Regress: None INFO 2020-04-16 15:06:00 +0000 master-replica-0 Signatures INCLUDED in export for Predict: None INFO 2020-04-16 15:06:00 +0000 master-replica-0 Signatures INCLUDED in export for Train: None WARNING 2020-04-16 15:06:00 +0000 master-replica-0 Export includes no default signature! INFO 2020-04-16 15:06:00 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-16 15:06:00 +0000 master-replica-0 Assets added to graph. INFO 2020-04-16 15:06:02 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1587049556/assets INFO 2020-04-16 15:06:05 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1587049556/saved_model.pb INFO 2020-04-16 15:06:07 +0000 master-replica-0 Module completed; cleaning up. INFO 2020-04-16 15:06:07 +0000 master-replica-0 Clean up finished. INFO 2020-04-16 15:06:07 +0000 master-replica-0 Task completed successfully. endTime: '2020-04-16T15:09:33' jobId: chicago_taxi_trainer_20200416_150129 startTime: '2020-04-16T15:02:28' state: SUCCEEDED Eval model dir: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200416-142813/chicago_taxi_output/trainer_output/working_dir/eval_model_dir <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. process_tfma.py:102: FutureWarning: ReadFromBigQuery is experimental. | 'CleanData' >> <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1630: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/tensorflow_model_analysis/slicer/slicer.py>:407: BeamDeprecationWarning: RemoveDuplicates is deprecated since 2.12. Use Distinct instead. | 'IncrementCounter' >> beam.Map(increment_counter)) WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter. warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md warning: check: missing required meta-data: url warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied Traceback (most recent call last): File "process_tfma.py", line 191, in <module> main() File "process_tfma.py", line 187, in main project=known_args.metric_reporting_project) File "process_tfma.py", line 127, in process_tfma result.wait_until_finish() File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/build/gradleenv/-194514014/local/lib/python2.7/site-packages/apache_beam/runners/dataflow/dataflow_runner.py";,> line 1633, in wait_until_finish self) apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error: A setup error was detected in chicago-taxi-tfdv-2020041-04160809-3l32-harness-tpq6. Please refer to the worker-startup log for detailed information. > Task :sdks:python:test-suites:dataflow:py2:chicagoTaxiExample FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Dataflow/ws/src/sdks/python/test-suites/dataflow/py2/build.gradle'> line: 170 * What went wrong: Execution failed for task ':sdks:python:test-suites:dataflow:py2:chicagoTaxiExample'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 52m 16s 6 actionable tasks: 6 executed Publishing build scan... https://gradle.com/s/7pvsrz2qucsqu Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
