See <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/88/display/redirect?page=changes>
Changes: [huangry] Include user distritribution into metric-dedicated validate runner test. [huangry] update inline comment. [huangry] To allow only assert on committed metrics, bypassing the attempted ones. [huangry] Use distribution matcher for testing. [kcweaver] [BEAM-9765] Exclude module-info.class from vendored Calcite. [pabloem] [BEAM-9769] Ensuring JSON is the default export format for BQ sink [github] [BEAM-9678] Create Go SDK introduction kata (#11340) [github] Merge pull request #11436: Document Beam Schemas (forked PR) [github] [BEAM-9648]: DirectRunner should return null on timeout (#11275) [github] [BEAM-5379] Ignore go.sum files in RAT checks [github] [BEAM-5605, BEAM-2939] Add support for FnApiDoFnRunner to handle split ------------------------------------------ [...truncated 279.98 KB...] INFO 2020-04-17 15:01:02 +0000 master-replica-0 loss = 16.034332, step = 7101 (0.213 sec) INFO 2020-04-17 15:01:02 +0000 master-replica-0 global_step/sec: 483.283 INFO 2020-04-17 15:01:02 +0000 master-replica-0 loss = 13.073706, step = 7201 (0.207 sec) INFO 2020-04-17 15:01:02 +0000 master-replica-0 global_step/sec: 477.336 INFO 2020-04-17 15:01:02 +0000 master-replica-0 loss = 14.177048, step = 7301 (0.209 sec) INFO 2020-04-17 15:01:03 +0000 master-replica-0 global_step/sec: 493.17 INFO 2020-04-17 15:01:03 +0000 master-replica-0 loss = 12.064966, step = 7401 (0.203 sec) INFO 2020-04-17 15:01:03 +0000 master-replica-0 global_step/sec: 482.746 INFO 2020-04-17 15:01:03 +0000 master-replica-0 loss = 14.057527, step = 7501 (0.207 sec) INFO 2020-04-17 15:01:03 +0000 master-replica-0 global_step/sec: 487.284 INFO 2020-04-17 15:01:03 +0000 master-replica-0 loss = 22.463696, step = 7601 (0.205 sec) INFO 2020-04-17 15:01:03 +0000 master-replica-0 global_step/sec: 486.635 INFO 2020-04-17 15:01:03 +0000 master-replica-0 loss = 13.67794, step = 7701 (0.206 sec) INFO 2020-04-17 15:01:03 +0000 master-replica-0 global_step/sec: 470.972 INFO 2020-04-17 15:01:03 +0000 master-replica-0 loss = 11.598372, step = 7801 (0.212 sec) INFO 2020-04-17 15:01:04 +0000 master-replica-0 global_step/sec: 482.06 INFO 2020-04-17 15:01:04 +0000 master-replica-0 loss = 14.994375, step = 7901 (0.207 sec) INFO 2020-04-17 15:01:04 +0000 master-replica-0 Saving checkpoints for 7992 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-17 15:01:09 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-17 15:01:09 +0000 master-replica-0 global_step/sec: 18.8199 INFO 2020-04-17 15:01:09 +0000 master-replica-0 loss = 12.798683, step = 8001 (5.313 sec) INFO 2020-04-17 15:01:09 +0000 master-replica-0 global_step/sec: 483.708 INFO 2020-04-17 15:01:09 +0000 master-replica-0 loss = 14.810642, step = 8101 (0.207 sec) INFO 2020-04-17 15:01:09 +0000 master-replica-0 global_step/sec: 489.745 INFO 2020-04-17 15:01:09 +0000 master-replica-0 loss = 13.275084, step = 8201 (0.205 sec) INFO 2020-04-17 15:01:09 +0000 master-replica-0 global_step/sec: 475.948 INFO 2020-04-17 15:01:09 +0000 master-replica-0 loss = 12.522281, step = 8301 (0.209 sec) INFO 2020-04-17 15:01:10 +0000 master-replica-0 global_step/sec: 487.762 INFO 2020-04-17 15:01:10 +0000 master-replica-0 loss = 14.015915, step = 8401 (0.205 sec) INFO 2020-04-17 15:01:10 +0000 master-replica-0 global_step/sec: 483.244 INFO 2020-04-17 15:01:10 +0000 master-replica-0 loss = 16.100729, step = 8501 (0.207 sec) INFO 2020-04-17 15:01:10 +0000 master-replica-0 global_step/sec: 487.89 INFO 2020-04-17 15:01:10 +0000 master-replica-0 loss = 13.177616, step = 8601 (0.205 sec) INFO 2020-04-17 15:01:10 +0000 master-replica-0 global_step/sec: 475.916 INFO 2020-04-17 15:01:10 +0000 master-replica-0 loss = 12.029076, step = 8701 (0.210 sec) INFO 2020-04-17 15:01:11 +0000 master-replica-0 global_step/sec: 477.25 INFO 2020-04-17 15:01:11 +0000 master-replica-0 loss = 15.178659, step = 8801 (0.209 sec) INFO 2020-04-17 15:01:11 +0000 master-replica-0 global_step/sec: 493.588 INFO 2020-04-17 15:01:11 +0000 master-replica-0 loss = 15.092587, step = 8901 (0.203 sec) INFO 2020-04-17 15:01:11 +0000 master-replica-0 Saving checkpoints for 8991 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-17 15:01:14 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-17 15:01:14 +0000 master-replica-0 global_step/sec: 27.6967 INFO 2020-04-17 15:01:14 +0000 master-replica-0 loss = 14.126085, step = 9001 (3.611 sec) INFO 2020-04-17 15:01:15 +0000 master-replica-0 global_step/sec: 484.323 INFO 2020-04-17 15:01:15 +0000 master-replica-0 loss = 10.0229645, step = 9101 (0.206 sec) INFO 2020-04-17 15:01:15 +0000 master-replica-0 global_step/sec: 479.906 INFO 2020-04-17 15:01:15 +0000 master-replica-0 loss = 10.410576, step = 9201 (0.208 sec) INFO 2020-04-17 15:01:15 +0000 master-replica-0 global_step/sec: 494.386 INFO 2020-04-17 15:01:15 +0000 master-replica-0 loss = 14.098625, step = 9301 (0.202 sec) INFO 2020-04-17 15:01:15 +0000 master-replica-0 global_step/sec: 486.455 INFO 2020-04-17 15:01:15 +0000 master-replica-0 loss = 13.568629, step = 9401 (0.206 sec) INFO 2020-04-17 15:01:15 +0000 master-replica-0 global_step/sec: 497.245 INFO 2020-04-17 15:01:15 +0000 master-replica-0 loss = 17.617094, step = 9501 (0.201 sec) INFO 2020-04-17 15:01:16 +0000 master-replica-0 global_step/sec: 487.545 INFO 2020-04-17 15:01:16 +0000 master-replica-0 loss = 15.821669, step = 9601 (0.205 sec) INFO 2020-04-17 15:01:16 +0000 master-replica-0 global_step/sec: 482.204 INFO 2020-04-17 15:01:16 +0000 master-replica-0 loss = 16.382177, step = 9701 (0.207 sec) INFO 2020-04-17 15:01:16 +0000 master-replica-0 global_step/sec: 477.952 INFO 2020-04-17 15:01:16 +0000 master-replica-0 loss = 12.30253, step = 9801 (0.209 sec) INFO 2020-04-17 15:01:16 +0000 master-replica-0 global_step/sec: 487.208 INFO 2020-04-17 15:01:16 +0000 master-replica-0 loss = 18.66972, step = 9901 (0.205 sec) INFO 2020-04-17 15:01:16 +0000 master-replica-0 Saving checkpoints for 9990 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-17 15:01:20 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-17 15:01:20 +0000 master-replica-0 Saving checkpoints for 10000 into gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt. INFO 2020-04-17 15:01:25 +0000 master-replica-0 Skip the current checkpoint eval due to throttle secs (600 secs). INFO 2020-04-17 15:01:25 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-17 15:01:25 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f5a75d32390>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f5a75d32390>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-17 15:01:25 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f5a75c51990>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f5a75c51990>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51d50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51d50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51d10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51d10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51dd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51dd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51e50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c51e50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c5f2d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a75c5f2d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f5a75ccfc90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f5a75ccfc90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:26 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f5a75d32310>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f5a75d32310>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:28 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-04-17 15:01:28 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-04-17 15:01:28 +0000 master-replica-0 Done calling model_fn. INFO 2020-04-17 15:01:28 +0000 master-replica-0 Starting evaluation at 2020-04-17T15:01:28Z INFO 2020-04-17 15:01:28 +0000 master-replica-0 Graph was finalized. INFO 2020-04-17 15:01:28 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-17 15:01:28 +0000 master-replica-0 Running local_init_op. INFO 2020-04-17 15:01:28 +0000 master-replica-0 Done running local_init_op. INFO 2020-04-17 15:01:29 +0000 master-replica-0 Evaluation [100/1000] INFO 2020-04-17 15:01:29 +0000 master-replica-0 Evaluation [200/1000] INFO 2020-04-17 15:01:30 +0000 master-replica-0 Evaluation [300/1000] INFO 2020-04-17 15:01:30 +0000 master-replica-0 Evaluation [400/1000] INFO 2020-04-17 15:01:30 +0000 master-replica-0 Evaluation [500/1000] INFO 2020-04-17 15:01:30 +0000 master-replica-0 Evaluation [600/1000] INFO 2020-04-17 15:01:30 +0000 master-replica-0 Evaluation [700/1000] INFO 2020-04-17 15:01:31 +0000 master-replica-0 Evaluation [800/1000] INFO 2020-04-17 15:01:31 +0000 master-replica-0 Evaluation [900/1000] INFO 2020-04-17 15:01:31 +0000 master-replica-0 Evaluation [1000/1000] INFO 2020-04-17 15:01:31 +0000 master-replica-0 Finished evaluation at 2020-04-17-15:01:31 INFO 2020-04-17 15:01:31 +0000 master-replica-0 Saving dict for global step 10000: accuracy = 0.79905, accuracy_baseline = 0.798225, auc = 0.91148096, auc_precision_recall = 0.61230075, average_loss = 0.35250768, global_step = 10000, label/mean = 0.201775, loss = 14.1003065, precision = 0.72602737, prediction/mean = 0.20064993, recall = 0.0065667205 INFO 2020-04-17 15:01:32 +0000 master-replica-0 Saving 'checkpoint_path' summary for global step 10000: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-17 15:01:32 +0000 master-replica-0 Performing the final export in the end of training. WARNING 2020-04-17 15:01:33 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-17 15:01:33 +0000 master-replica-0 value: "\n\013\n\tConst_4:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-17 15:01:33 +0000 master-replica-0 value: "\n\013\n\tConst_5:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-04-17 15:01:33 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore WARNING 2020-04-17 15:01:33 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_transform/saved/saved_transform_io.py:230: The name tf.saved_model.constants.ASSETS_KEY is deprecated. Please use tf.saved_model.ASSETS_KEY instead. INFO 2020-04-17 15:01:33 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f5aa8577350>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f5aa8577350>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f5a7c33c950>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f5a7c33c950>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fad0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fad0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fe10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fe10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:33 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fe90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fe90>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:34 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fd50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fd50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:34 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fdd0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a8424fdd0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:34 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f5a7c361c50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f5a7c361c50>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:34 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f5a7c33cf50>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f5a7c33cf50>>: AssertionError: Bad argument number for Name: 3, expecting 4 INFO 2020-04-17 15:01:35 +0000 master-replica-0 Done calling model_fn. WARNING 2020-04-17 15:01:35 +0000 master-replica-0 From /usr/local/lib/python2.7/dist-packages/tensorflow/python/saved_model/signature_def_utils_impl.py:201: build_tensor_info (from tensorflow.python.saved_model.utils_impl) is deprecated and will be removed in a future version. WARNING 2020-04-17 15:01:35 +0000 master-replica-0 Instructions for updating: WARNING 2020-04-17 15:01:35 +0000 master-replica-0 This function will only be available through the v1 compatibility library as tf.compat.v1.saved_model.utils.build_tensor_info or tf.compat.v1.saved_model.build_tensor_info. INFO 2020-04-17 15:01:35 +0000 master-replica-0 Signatures INCLUDED in export for Eval: None INFO 2020-04-17 15:01:35 +0000 master-replica-0 Signatures INCLUDED in export for Classify: ['serving_default', 'classification'] INFO 2020-04-17 15:01:35 +0000 master-replica-0 Signatures INCLUDED in export for Regress: ['regression'] INFO 2020-04-17 15:01:35 +0000 master-replica-0 Signatures INCLUDED in export for Predict: ['predict'] INFO 2020-04-17 15:01:35 +0000 master-replica-0 Signatures INCLUDED in export for Train: None INFO 2020-04-17 15:01:35 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-17 15:01:35 +0000 master-replica-0 Assets added to graph. INFO 2020-04-17 15:01:36 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1587135692/assets INFO 2020-04-17 15:01:39 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/export/chicago-taxi/temp-1587135692/saved_model.pb INFO 2020-04-17 15:01:42 +0000 master-replica-0 Loss for final step: 16.739483. WARNING 2020-04-17 15:01:42 +0000 master-replica-0 From /root/.local/lib/python2.7/site-packages/tensorflow_model_analysis/eval_saved_model/export.py:474: export_all_saved_models (from tensorflow_estimator.contrib.estimator.python.estimator.export) is deprecated and will be removed after 2018-12-03. WARNING 2020-04-17 15:01:42 +0000 master-replica-0 Instructions for updating: WARNING 2020-04-17 15:01:42 +0000 master-replica-0 Use estimator.experimental_export_all_saved_models WARNING 2020-04-17 15:01:43 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-17 15:01:43 +0000 master-replica-0 value: "\n\013\n\tConst_4:0\022-vocab_compute_and_apply_vocabulary_vocabulary" WARNING 2020-04-17 15:01:43 +0000 master-replica-0 Expected binary or unicode string, got type_url: "type.googleapis.com/tensorflow.AssetFileDef" WARNING 2020-04-17 15:01:43 +0000 master-replica-0 value: "\n\013\n\tConst_5:0\022/vocab_compute_and_apply_vocabulary_1_vocabulary" INFO 2020-04-17 15:01:43 +0000 master-replica-0 Saver not created because there are no variables in the graph to restore INFO 2020-04-17 15:01:43 +0000 master-replica-0 Calling model_fn. WARNING 2020-04-17 15:01:43 +0000 master-replica-0 Entity <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f5a75341c90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _DNNModel.call of <tensorflow_estimator.python.estimator.canned.dnn._DNNModel object at 0x7f5a75341c90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-17 15:01:43 +0000 master-replica-0 Entity <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f5a75341d90>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method DenseFeatures.call of <tensorflow.python.feature_column.feature_column_v2.DenseFeatures object at 0x7f5a75341d90>>: AttributeError: 'module' object has no attribute 'Num' WARNING 2020-04-17 15:01:43 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a190>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a190>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:43 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a4d0>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a4d0>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a450>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a450>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a550>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a550>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:44 +0000 master-replica-0 Entity <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a790>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method Dense.call of <tensorflow.python.layers.core.Dense object at 0x7f5a7537a790>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:44 +0000 master-replica-0 Entity <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f5a84647490>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method LinearModel.call of <tensorflow.python.feature_column.feature_column_v2.LinearModel object at 0x7f5a84647490>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:44 +0000 master-replica-0 Entity <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f5a75341d10>> could not be transformed and will be executed as-is. Please report this to the AutgoGraph team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output. Cause: converting <bound method _LinearModelLayer.call of <tensorflow.python.feature_column.feature_column_v2._LinearModelLayer object at 0x7f5a75341d10>>: AssertionError: Bad argument number for Name: 3, expecting 4 WARNING 2020-04-17 15:01:46 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. WARNING 2020-04-17 15:01:46 +0000 master-replica-0 Trapezoidal rule is known to produce incorrect PR-AUCs; please switch to "careful_interpolation" instead. INFO 2020-04-17 15:01:46 +0000 master-replica-0 Done calling model_fn. INFO 2020-04-17 15:01:46 +0000 master-replica-0 Signatures INCLUDED in export for Eval: ['eval'] INFO 2020-04-17 15:01:46 +0000 master-replica-0 Signatures INCLUDED in export for Classify: None INFO 2020-04-17 15:01:46 +0000 master-replica-0 Signatures INCLUDED in export for Regress: None INFO 2020-04-17 15:01:46 +0000 master-replica-0 Signatures INCLUDED in export for Predict: None INFO 2020-04-17 15:01:46 +0000 master-replica-0 Signatures INCLUDED in export for Train: None WARNING 2020-04-17 15:01:46 +0000 master-replica-0 Export includes no default signature! INFO 2020-04-17 15:01:46 +0000 master-replica-0 Restoring parameters from gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/serving_model_dir/model.ckpt-10000 INFO 2020-04-17 15:01:46 +0000 master-replica-0 Assets added to graph. INFO 2020-04-17 15:01:47 +0000 master-replica-0 Assets written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1587135702/assets INFO 2020-04-17 15:01:50 +0000 master-replica-0 SavedModel written to: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/eval_model_dir/temp-1587135702/saved_model.pb INFO 2020-04-17 15:01:52 +0000 master-replica-0 Module completed; cleaning up. INFO 2020-04-17 15:01:52 +0000 master-replica-0 Clean up finished. INFO 2020-04-17 15:01:52 +0000 master-replica-0 Task completed successfully. endTime: '2020-04-17T15:06:26' jobId: chicago_taxi_trainer_20200417_145728 startTime: '2020-04-17T14:58:16' state: SUCCEEDED Eval model dir: gs://temp-storage-for-perf-tests/chicago-taxi/chicago-taxi-tfdv-20200417-143616/chicago_taxi_output/trainer_output/working_dir/eval_model_dir <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/__init__.py>:82: UserWarning: You are using Apache Beam with Python 2. New releases of Apache Beam will soon support Python 3 only. 'You are using Apache Beam with Python 2. ' WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/common.py>:51: The name tf.ConfigProto is deprecated. Please use tf.compat.v1.ConfigProto instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/beam/impl.py>:283: The name tf.SparseTensorValue is deprecated. Please use tf.compat.v1.SparseTensorValue instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:313: The name tf.VarLenFeature is deprecated. Please use tf.io.VarLenFeature instead. process_tfma.py:102: FutureWarning: ReadFromBigQuery is experimental. | 'CleanData' >> <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/io/gcp/bigquery.py>:1631: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported temp_location = pcoll.pipeline.options.view_as( WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:63: The name tf.SparseFeature is deprecated. Please use tf.io.SparseFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. WARNING:tensorflow:From <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_transform/tf_metadata/schema_utils.py>:110: The name tf.FixedLenFeature is deprecated. Please use tf.io.FixedLenFeature instead. <https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/tensorflow_model_analysis/slicer/slicer.py>:407: BeamDeprecationWarning: RemoveDuplicates is deprecated since 2.12. Use Distinct instead. | 'IncrementCounter' >> beam.Map(increment_counter)) warning: sdist: standard file not found: should have one of README, README.rst, README.txt, README.md warning: check: missing required meta-data: url warning: check: missing meta-data: either (author and author_email) or (maintainer and maintainer_email) must be supplied WARNING:root:Make sure that locally built Python SDK docker image has Python 2.7 interpreter. ERROR:grpc._channel:Exception iterating requests! Traceback (most recent call last): File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/grpc/_channel.py";,> line 195, in consume_request_iterator request = next(request_iterator) File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/artifact_service.py";,> line 316, in __next__ raise self._queue.get() _MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with: status = StatusCode.UNIMPLEMENTED details = "Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService" debug_error_string = "{"created":"@1587135996.751211010","description":"Error received from peer ipv4:127.0.0.1:8098","file":"src/core/lib/surface/call.cc","file_line":1056,"grpc_message":"Method not found: org.apache.beam.model.job_management.v1.ArtifactStagingService/ReverseArtifactRetrievalService","grpc_status":12}" > ERROR:root:java.lang.IllegalStateException: No container running for id 2aef8456d634e6704df45039b1f52ea6ab5b1a36cea0a3eda370d3d7800c127b Traceback (most recent call last): File "process_tfma.py", line 191, in <module> main() File "process_tfma.py", line 187, in main project=known_args.metric_reporting_project) File "process_tfma.py", line 127, in process_tfma result.wait_until_finish() File "<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/build/gradleenv/1866363813/local/lib/python2.7/site-packages/apache_beam/runners/portability/portable_runner.py";,> line 571, in wait_until_finish (self._job_id, self._state, self._last_error_message())) RuntimeError: Pipeline chicago-taxi-tfdv-20200417-143616_ba782a01-23fd-4c8a-a4d9-64bcba174954 failed in state FAILED: java.lang.IllegalStateException: No container running for id 2aef8456d634e6704df45039b1f52ea6ab5b1a36cea0a3eda370d3d7800c127b > Task :sdks:python:test-suites:portable:py2:chicagoTaxiExample FAILED FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Python_Chicago_Taxi_Flink/ws/src/sdks/python/test-suites/portable/py2/build.gradle'> line: 197 * What went wrong: Execution failed for task ':sdks:python:test-suites:portable:py2:chicagoTaxiExample'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 33m 37s 6 actionable tasks: 5 executed, 1 up-to-date Publishing build scan... https://gradle.com/s/gk7dcqttarmzm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
