See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/29/display/redirect?page=changes>
Changes: [github] Change static Map fields in ReflectUtils to be concurrent [iemejia] [BEAM-8561] Add ThriftIO to support IO for Thrift files ------------------------------------------ [...truncated 263.69 KB...] INFO 2020-02-18 15:03:18 +0000 master-replica-0 global_step/sec: 479.589 INFO 2020-02-18 15:03:18 +0000 master-replica-0 loss = 10.093229, step = 6801 (0.208 sec) INFO 2020-02-18 15:03:18 +0000 master-replica-0 global_step/sec: 475.371 INFO 2020-02-18 15:03:18 +0000 master-replica-0 loss = 12.986282, step = 6901 (0.211 sec) INFO 2020-02-18 15:03:18 +0000 master-replica-0 Saving checkpoints for 6993 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-02-18 15:03:22 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-02-18 15:03:22 +0000 master-replica-0 global_step/sec: 24.4651 INFO 2020-02-18 15:03:22 +0000 master-replica-0 loss = 11.95684, step = 7001 (4.087 sec) INFO 2020-02-18 15:03:23 +0000 master-replica-0 global_step/sec: 480.196 INFO 2020-02-18 15:03:23 +0000 master-replica-0 loss = 14.701466, step = 7101 (0.208 sec) INFO 2020-02-18 15:03:23 +0000 master-replica-0 global_step/sec: 452.102 INFO 2020-02-18 15:03:23 +0000 master-replica-0 loss = 11.626099, step = 7201 (0.221 sec) INFO 2020-02-18 15:03:23 +0000 master-replica-0 global_step/sec: 467.576 INFO 2020-02-18 15:03:23 +0000 master-replica-0 loss = 13.966995, step = 7301 (0.214 sec) INFO 2020-02-18 15:03:23 +0000 master-replica-0 global_step/sec: 471.331 INFO 2020-02-18 15:03:23 +0000 master-replica-0 loss = 12.444869, step = 7401 (0.212 sec) INFO 2020-02-18 15:03:23 +0000 master-replica-0 global_step/sec: 477.393 INFO 2020-02-18 15:03:23 +0000 master-replica-0 loss = 12.67998, step = 7501 (0.209 sec) INFO 2020-02-18 15:03:24 +0000 master-replica-0 global_step/sec: 464.663 INFO 2020-02-18 15:03:24 +0000 master-replica-0 loss = 12.587551, step = 7601 (0.215 sec) INFO 2020-02-18 15:03:24 +0000 master-replica-0 global_step/sec: 477.792 INFO 2020-02-18 15:03:24 +0000 master-replica-0 loss = 14.595097, step = 7701 (0.209 sec) INFO 2020-02-18 15:03:24 +0000 master-replica-0 global_step/sec: 479.764 INFO 2020-02-18 15:03:24 +0000 master-replica-0 loss = 10.718349, step = 7801 (0.208 sec) INFO 2020-02-18 15:03:24 +0000 master-replica-0 global_step/sec: 485.209 INFO 2020-02-18 15:03:24 +0000 master-replica-0 loss = 12.996382, step = 7901 (0.206 sec) INFO 2020-02-18 15:03:24 +0000 master-replica-0 Saving checkpoints for 7992 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-02-18 15:03:28 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-02-18 15:03:28 +0000 master-replica-0 global_step/sec: 26.9725 INFO 2020-02-18 15:03:28 +0000 master-replica-0 loss = 13.241816, step = 8001 (3.707 sec) INFO 2020-02-18 15:03:28 +0000 master-replica-0 global_step/sec: 464.692 INFO 2020-02-18 15:03:28 +0000 master-replica-0 loss = 10.543923, step = 8101 (0.215 sec) INFO 2020-02-18 15:03:28 +0000 master-replica-0 global_step/sec: 470.469 INFO 2020-02-18 15:03:28 +0000 master-replica-0 loss = 12.081933, step = 8201 (0.213 sec) INFO 2020-02-18 15:03:29 +0000 master-replica-0 global_step/sec: 472.077 INFO 2020-02-18 15:03:29 +0000 master-replica-0 loss = 12.32383, step = 8301 (0.212 sec) INFO 2020-02-18 15:03:29 +0000 master-replica-0 global_step/sec: 475.943 INFO 2020-02-18 15:03:29 +0000 master-replica-0 loss = 13.779585, step = 8401 (0.210 sec) INFO 2020-02-18 15:03:29 +0000 master-replica-0 global_step/sec: 468.618 INFO 2020-02-18 15:03:29 +0000 master-replica-0 loss = 16.236927, step = 8501 (0.213 sec) INFO 2020-02-18 15:03:29 +0000 master-replica-0 global_step/sec: 476.861 INFO 2020-02-18 15:03:29 +0000 master-replica-0 loss = 15.248022, step = 8601 (0.210 sec) INFO 2020-02-18 15:03:29 +0000 master-replica-0 global_step/sec: 457.168 INFO 2020-02-18 15:03:29 +0000 master-replica-0 loss = 13.246435, step = 8701 (0.219 sec) INFO 2020-02-18 15:03:30 +0000 master-replica-0 global_step/sec: 478.156 INFO 2020-02-18 15:03:30 +0000 master-replica-0 loss = 10.619361, step = 8801 (0.209 sec) INFO 2020-02-18 15:03:30 +0000 master-replica-0 global_step/sec: 472.529 INFO 2020-02-18 15:03:30 +0000 master-replica-0 loss = 17.119728, step = 8901 (0.211 sec) INFO 2020-02-18 15:03:30 +0000 master-replica-0 Saving checkpoints for 8991 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-02-18 15:03:34 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-02-18 15:03:34 +0000 master-replica-0 global_step/sec: 25.8933 INFO 2020-02-18 15:03:34 +0000 master-replica-0 loss = 12.781147, step = 9001 (3.862 sec) INFO 2020-02-18 15:03:34 +0000 master-replica-0 global_step/sec: 477.404 INFO 2020-02-18 15:03:34 +0000 master-replica-0 loss = 11.487883, step = 9101 (0.210 sec) INFO 2020-02-18 15:03:34 +0000 master-replica-0 global_step/sec: 463.988 INFO 2020-02-18 15:03:34 +0000 master-replica-0 loss = 14.577345, step = 9201 (0.216 sec) INFO 2020-02-18 15:03:34 +0000 master-replica-0 global_step/sec: 474.042 INFO 2020-02-18 15:03:34 +0000 master-replica-0 loss = 17.089725, step = 9301 (0.211 sec) INFO 2020-02-18 15:03:35 +0000 master-replica-0 global_step/sec: 466.489 INFO 2020-02-18 15:03:35 +0000 master-replica-0 loss = 12.670345, step = 9401 (0.215 sec) INFO 2020-02-18 15:03:35 +0000 master-replica-0 global_step/sec: 477.154 INFO 2020-02-18 15:03:35 +0000 master-replica-0 loss = 16.677345, step = 9501 (0.209 sec) INFO 2020-02-18 15:03:35 +0000 master-replica-0 global_step/sec: 476.014 INFO 2020-02-18 15:03:35 +0000 master-replica-0 loss = 11.708326, step = 9601 (0.210 sec) INFO 2020-02-18 15:03:35 +0000 master-replica-0 global_step/sec: 467.39 INFO 2020-02-18 15:03:35 +0000 master-replica-0 loss = 13.517459, step = 9701 (0.214 sec) INFO 2020-02-18 15:03:35 +0000 master-replica-0 global_step/sec: 483.178 INFO 2020-02-18 15:03:35 +0000 master-replica-0 loss = 10.856136, step = 9801 (0.207 sec) INFO 2020-02-18 15:03:36 +0000 master-replica-0 global_step/sec: 479.18 INFO 2020-02-18 15:03:36 +0000 master-replica-0 loss = 15.54731, step = 9901 (0.209 sec) INFO 2020-02-18 15:03:36 +0000 master-replica-0 Saving checkpoints for 9990 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-02-18 15:03:40 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-02-18 15:03:40 +0000 master-replica-0 Saving checkpoints for 10000 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-02-18 15:03:44 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-02-18 15:03:44 +0000 master-replica-0 Calling model_fn. WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f3cc7f6ec90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f3cc7f6ec90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f3cc7eb22d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f3cc7eb22d0>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2690>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2690>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb29d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb29d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2950>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2950>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2a50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2a50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2c90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7eb2c90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:44 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f3cc7f35690>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f3cc7f35690>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:45 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f3cc7f6e8d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f3cc7f6e8d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:46 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-02-18 15:03:46 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-02-18 15:03:46 +0000 master-replica-0 Done calling model_fn. INFO 2020-02-18 15:03:46 +0000 master-replica-0 Starting evaluation at 2020-02-18T15:03:46Z INFO 2020-02-18 15:03:46 +0000 master-replica-0 Graph was finalized. INFO 2020-02-18 15:03:46 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-02-18 15:03:47 +0000 master-replica-0 Running local_init_op. INFO 2020-02-18 15:03:47 +0000 master-replica-0 Done running local_init_op. INFO 2020-02-18 15:03:48 +0000 master-replica-0 Evaluation [100/1000] INFO 2020-02-18 15:03:48 +0000 master-replica-0 Evaluation [200/1000] INFO 2020-02-18 15:03:48 +0000 master-replica-0 Evaluation [300/1000] INFO 2020-02-18 15:03:49 +0000 master-replica-0 Evaluation [400/1000] INFO 2020-02-18 15:03:49 +0000 master-replica-0 Evaluation [500/1000] INFO 2020-02-18 15:03:49 +0000 master-replica-0 Evaluation [600/1000] INFO 2020-02-18 15:03:49 +0000 master-replica-0 Evaluation [700/1000] INFO 2020-02-18 15:03:49 +0000 master-replica-0 Evaluation [800/1000] INFO 2020-02-18 15:03:50 +0000 master-replica-0 Evaluation [900/1000] INFO 2020-02-18 15:03:50 +0000 master-replica-0 Evaluation [1000/1000] INFO 2020-02-18 15:03:50 +0000 master-replica-0 Finished evaluation at 2020-02-18-15:03:50 INFO 2020-02-18 15:03:50 +0000 master-replica-0 Saving dict for global step 10000: accuracy = 0.7994, accuracy_baseline = 0.797825, auc = 0.91819584, auc_precision_recall = 0.6315862, average_loss = 0.34332395, global_step = 10000, label/mean = 0.202175, loss = 13.732958, precision = 0.7647059, prediction/mean = 0.20168981, recall = 0.011252628 INFO 2020-02-18 15:03:50 +0000 master-replica-0 Saving 'checkpoint_path' summary for global step 10000: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-02-18 15:03:51 +0000 master-replica-0 Performing the final export in the end of training. WARNING 2020-02-18 15:03:52 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING 2020-02-18 15:03:52 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-02-18 15:03:52 +0000 master-replica-0 value: "\n\013\n\tConst_1:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-02-18 15:03:52 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-02-18 15:03:52 +0000 master-replica-0 value: "\n\013\n\tConst_2:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-02-18 15:03:52 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore WARNING 2020-02-18 15:03:52 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py:230: The name tf.saved_model.constants.ASSETS_KEY is deprecated. Please use tf.saved_model.ASSETS_KEY instead. INFO 2020-02-18 15:03:52 +0000 master-replica-0 Calling model_fn. WARNING 2020-02-18 15:03:52 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f3d041a4e90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f3d041a4e90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-02-18 15:03:52 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f3d28522b50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f3d28522b50>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-02-18 15:03:52 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca410>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca410>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:52 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca750>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca750>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:53 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca6d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca6d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:53 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca7d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047ca7d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:53 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047caa10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3d047caa10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:53 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f3d041a6590>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f3d041a6590>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:03:53 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f3d04191fd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f3d04191fd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 INFO 2020-02-18 15:03:54 +0000 master-replica-0 Done calling model_fn. WARNING 2020-02-18 15:03:54 +0000 master-replica-0 From /usr/local/lib/python2.7/dist-packages/tensorflow/python/saved_model/signature_def_utils_impl.py:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version. WARNING 2020-02-18 15:03:54 +0000 master-replica-0 Instructions for updating: WARNING 2020-02-18 15:03:54 +0000 master-replica-0 This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info. INFO 2020-02-18 15:03:54 +0000 master-replica-0 Signatures INCLUDED in export for Eval: None INFO 2020-02-18 15:03:54 +0000 master-replica-0 Signatures INCLUDED in export for Classify: ['serving_default', 'classification'] INFO 2020-02-18 15:03:54 +0000 master-replica-0 Signatures INCLUDED in export for Regress: ['regression'] INFO 2020-02-18 15:03:54 +0000 master-replica-0 Signatures INCLUDED in export for Predict: ['predict'] INFO 2020-02-18 15:03:54 +0000 master-replica-0 Signatures INCLUDED in export for Train: None INFO 2020-02-18 15:03:54 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-02-18 15:03:54 +0000 master-replica-0 Assets added to graph. INFO 2020-02-18 15:03:56 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1582038231/assets INFO 2020-02-18 15:04:00 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1582038231/saved_model.pb INFO 2020-02-18 15:04:01 +0000 master-replica-0 Loss for final step: 19.42323. WARNING 2020-02-18 15:04:02 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_model_analysis/eval_saved_model/export.py:474: export_all_saved_models (from tensorflow_estimator.contrib.estimator.python.estimator.export) is deprecated and will be removed after 2018-12-03. WARNING 2020-02-18 15:04:02 +0000 master-replica-0 Instructions for updating: WARNING 2020-02-18 15:04:02 +0000 master-replica-0 Use estimator.experimental_export_all_saved_models WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-02-18 15:04:03 +0000 master-replica-0 value: "\n\013\n\tConst_1:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-02-18 15:04:03 +0000 master-replica-0 value: "\n\013\n\tConst_2:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-02-18 15:04:03 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore INFO 2020-02-18 15:04:03 +0000 master-replica-0 Calling model_fn. WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f3cc7c095d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f3cc7c095d0>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f3cc7c096d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f3cc7c096d0>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09a90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09a90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09dd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09dd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09e50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09e50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:03 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09d10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09d10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:04 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09d90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f3cc7c09d90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:04 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f3cc7bdc8d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f3cc7bdc8d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:04 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f3cc7c09c90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f3cc7c09c90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-02-18 15:04:05 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-02-18 15:04:05 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-02-18 15:04:05 +0000 master-replica-0 Done calling model_fn. INFO 2020-02-18 15:04:05 +0000 master-replica-0 Signatures INCLUDED in export for Eval: ['eval'] INFO 2020-02-18 15:04:05 +0000 master-replica-0 Signatures INCLUDED in export for Classify: None INFO 2020-02-18 15:04:05 +0000 master-replica-0 Signatures INCLUDED in export for Regress: None INFO 2020-02-18 15:04:05 +0000 master-replica-0 Signatures INCLUDED in export for Predict: None INFO 2020-02-18 15:04:05 +0000 master-replica-0 Signatures INCLUDED in export for Train: None WARNING 2020-02-18 15:04:05 +0000 master-replica-0 Export includes no default signature! INFO 2020-02-18 15:04:05 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-02-18 15:04:06 +0000 master-replica-0 Assets added to graph. INFO 2020-02-18 15:04:07 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1582038242/assets INFO 2020-02-18 15:04:10 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1582038242/saved_model.pb INFO 2020-02-18 15:04:12 +0000 master-replica-0 Module completed; cleaning up. INFO 2020-02-18 15:04:12 +0000 master-replica-0 Clean up finished. INFO 2020-02-18 15:04:12 +0000 master-replica-0 Task completed successfully. endTime: '2020-02-18T15:07:43' jobId: chicago_taxi_trainer_20200218_145951 startTime: '2020-02-18T15:00:38' state: SUCCEEDED Eval model dir: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200218-143709/chicago_taxi_output/trainer_output/working_dir/eval_model_dir <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. process_tfma.py:102: FutureWarning: _ReadFromBigQuery is experimental. | 'CleanData' >> <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1655: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_model_analysis/slicer/slicer.py>:407: BeamDeprecationWarning: RemoveDuplicates is deprecated since 2.12. Use Distinct instead. | 'IncrementCounter' >> beam.Map(increment_counter)) warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md warning: check: missing required meta-data: url warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied ./run_chicago.sh: line 204: 1012 Terminated python process_tfma.py --big_query_table bigquery-public-data.chicago_taxi_trips.taxi_trips --schema_file ${SCHEMA_PATH} --eval_model_dir ${LAST_EVAL_MODEL_DIR} --project ${GCP_PROJECT} --region us-central1 --temp_location ${GCS_BUCKET}/${JOB_ID}/tmp/ --experiments shuffle_mode=auto --job_name ${JOB_ID} --save_main_session --runner ${RUNNER} --max_eval_rows=${MAX_ROWS} --publish_to_big_query=true --metrics_dataset='beam_performance' --metrics_table='chicago_taxi_process_tfma'${METRICS_TABLE_SUFFIX} --metric_reporting_project ${GCP_PROJECT} --setup_file ./setup.py ${PIPELINE_OPTIONS} > Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=b108717b-071f-456a-9f8a-9375dec2f5d5, currentDir=<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 16775 log file: /home/jenkins/.gradle/daemon/5.2.1/daemon-16775.out.log ----- Last 20 lines from daemon log file - daemon-16775.out.log ----- FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'. > Process 'command 'sh'' finished with non-zero exit value 143 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 33m 49s 6 actionable tasks: 5 executed, 1 up-to-date ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
