See <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/1762/display/redirect?page=changes>
Changes: [ankurgoenka] Update dataflow container version to beam-master-20181116 ------------------------------------------ [...truncated 376.02 KB...] root: INFO: 2018-11-17T06:37:47.710Z: JOB_MESSAGE_DETAILED: Expanding GroupByKey operations into optimizable parts. root: INFO: 2018-11-17T06:37:47.749Z: JOB_MESSAGE_DETAILED: Lifting ValueCombiningMappingFns into MergeBucketsMappingFns root: INFO: 2018-11-17T06:37:47.821Z: JOB_MESSAGE_DEBUG: Annotating graph with Autotuner information. root: INFO: 2018-11-17T06:37:47.863Z: JOB_MESSAGE_DETAILED: Fusing adjacent ParDo, Read, Write, and Flatten operations root: INFO: 2018-11-17T06:37:47.902Z: JOB_MESSAGE_DETAILED: Unzipping flatten s10 for input s8.out root: INFO: 2018-11-17T06:37:47.937Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/GroupByKey/Reify, through flatten assert_that/Group/Flatten, into producer assert_that/Group/pair_with_0 root: INFO: 2018-11-17T06:37:47.974Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/Map(_merge_tagged_vals_under_key) into assert_that/Group/GroupByKey/GroupByWindow root: INFO: 2018-11-17T06:37:48.010Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Match into assert_that/Unkey root: INFO: 2018-11-17T06:37:48.045Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Unkey into assert_that/Group/Map(_merge_tagged_vals_under_key) root: INFO: 2018-11-17T06:37:48.079Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/GroupByWindow into assert_that/Group/GroupByKey/Read root: INFO: 2018-11-17T06:37:48.116Z: JOB_MESSAGE_DETAILED: Unzipping flatten s10-u13 for input s11-reify-value0-c11 root: INFO: 2018-11-17T06:37:48.150Z: JOB_MESSAGE_DETAILED: Fusing unzipped copy of assert_that/Group/GroupByKey/Write, through flatten s10-u13, into producer assert_that/Group/GroupByKey/Reify root: INFO: 2018-11-17T06:37:48.184Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/Reify into assert_that/Group/pair_with_1 root: INFO: 2018-11-17T06:37:48.220Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/GroupByKey/Write into assert_that/Group/GroupByKey/Reify root: INFO: 2018-11-17T06:37:48.254Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_0 into assert_that/Create/Read root: INFO: 2018-11-17T06:37:48.289Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/WindowInto(WindowIntoFn) into compute/compute root: INFO: 2018-11-17T06:37:48.322Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/Group/pair_with_1 into assert_that/ToVoidKey root: INFO: 2018-11-17T06:37:48.358Z: JOB_MESSAGE_DETAILED: Fusing consumer assert_that/ToVoidKey into assert_that/WindowInto(WindowIntoFn) root: INFO: 2018-11-17T06:37:48.392Z: JOB_MESSAGE_DETAILED: Fusing consumer compute/compute into start/Read root: INFO: 2018-11-17T06:37:48.420Z: JOB_MESSAGE_DEBUG: Workflow config is missing a default resource spec. root: INFO: 2018-11-17T06:37:48.451Z: JOB_MESSAGE_DEBUG: Adding StepResource setup and teardown to workflow graph. root: INFO: 2018-11-17T06:37:48.477Z: JOB_MESSAGE_DEBUG: Adding workflow start and stop steps. root: INFO: 2018-11-17T06:37:48.511Z: JOB_MESSAGE_DEBUG: Assigning stage ids. root: INFO: 2018-11-17T06:37:48.640Z: JOB_MESSAGE_DEBUG: Executing wait step start21 root: INFO: 2018-11-17T06:37:48.723Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Group/GroupByKey/Create root: INFO: 2018-11-17T06:37:48.760Z: JOB_MESSAGE_BASIC: Executing operation side/Read root: INFO: 2018-11-17T06:37:48.773Z: JOB_MESSAGE_DEBUG: Starting worker pool setup. root: INFO: 2018-11-17T06:37:48.805Z: JOB_MESSAGE_BASIC: Starting 1 workers in us-central1-b... root: INFO: 2018-11-17T06:37:48.837Z: JOB_MESSAGE_DEBUG: Value "side/Read.out" materialized. root: INFO: 2018-11-17T06:37:48.893Z: JOB_MESSAGE_DEBUG: Value "assert_that/Group/GroupByKey/Session" materialized. root: INFO: 2018-11-17T06:37:48.918Z: JOB_MESSAGE_BASIC: Executing operation compute/_UnpickledSideInput(Read.out.0) root: INFO: 2018-11-17T06:37:48.977Z: JOB_MESSAGE_BASIC: Executing operation assert_that/Create/Read+assert_that/Group/pair_with_0+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write root: INFO: 2018-11-17T06:37:49.014Z: JOB_MESSAGE_DEBUG: Value "compute/_UnpickledSideInput(Read.out.0).output" materialized. root: INFO: 2018-11-17T06:37:49.097Z: JOB_MESSAGE_BASIC: Executing operation start/Read+compute/compute+assert_that/WindowInto(WindowIntoFn)+assert_that/ToVoidKey+assert_that/Group/pair_with_1+assert_that/Group/GroupByKey/Reify+assert_that/Group/GroupByKey/Write root: INFO: 2018-11-17T06:37:57.618Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 0 based on the rate of progress in the currently running step(s). root: INFO: 2018-11-17T06:38:20.827Z: JOB_MESSAGE_DETAILED: Autoscaling: Raised the number of workers to 1 based on the rate of progress in the currently running step(s). root: INFO: 2018-11-17T06:38:20.864Z: JOB_MESSAGE_DETAILED: Autoscaling: Would further reduce the number of workers but reached the minimum number allowed for the job. root: INFO: 2018-11-17T06:40:17.044Z: JOB_MESSAGE_DETAILED: Workers have started successfully. root: INFO: 2018-11-17T06:40:17.157Z: JOB_MESSAGE_DETAILED: Workers have started successfully. oauth2client.transport: INFO: Refreshing due to a 401 (attempt 1/2) root: INFO: 2018-11-17T07:37:49.060Z: JOB_MESSAGE_ERROR: Workflow failed. Causes: The Dataflow job appears to be stuck because no worker activity has been seen in the last 1h. You can get help with Cloud Dataflow at https://cloud.google.com/dataflow/support. root: INFO: 2018-11-17T07:37:49.181Z: JOB_MESSAGE_BASIC: Cancel request is committed for workflow job: 2018-11-16_22_37_43-10887562078488269489. root: INFO: 2018-11-17T07:37:49.264Z: JOB_MESSAGE_DETAILED: Cleaning up. root: INFO: 2018-11-17T07:37:49.315Z: JOB_MESSAGE_DEBUG: Starting worker pool teardown. root: INFO: 2018-11-17T07:37:49.344Z: JOB_MESSAGE_BASIC: Stopping worker pool... root: INFO: 2018-11-17T07:39:34.946Z: JOB_MESSAGE_DETAILED: Autoscaling: Reduced the number of workers to 0 based on the rate of progress in the currently running step(s). root: INFO: 2018-11-17T07:39:34.986Z: JOB_MESSAGE_BASIC: Worker pool stopped. root: INFO: 2018-11-17T07:39:35.028Z: JOB_MESSAGE_DEBUG: Tearing down pending resources... root: INFO: Job 2018-11-16_22_37_43-10887562078488269489 is in state JOB_STATE_FAILED --------------------- >> end captured logging << --------------------- ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 16 tests in 4170.944s FAILED (errors=1) Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_30-11928403871115492806?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_37_18-7021978794200835495?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_30-6260175193531940496?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_37_13-10096837868830804787?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_29-4310477972260625538?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_37_43-10887562078488269489?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_29-3397902071753493955?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_37_58-14577315774272360813?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_28-15140681071124433912?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_36_57-4355175886001060179?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_29-1696482469796819267?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_37_17-9472100638832358572?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_29-18155088860437885518?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_36_28-16759742567477549539?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_30_30-8624179548713900290?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_22_36_49-8428068749292078681?project=apache-beam-testing. > Task :beam-sdks-python:validatesRunnerBatchTests FAILED :beam-sdks-python:validatesRunnerBatchTests (Thread[Task worker for ':',5,main]) completed. Took 1 hrs 9 mins 32.034 secs. :beam-sdks-python:validatesRunnerStreamingTests (Thread[Task worker for ':',5,main]) started. > Task :beam-sdks-python:validatesRunnerStreamingTests Caching disabled for task ':beam-sdks-python:validatesRunnerStreamingTests': Caching has not been enabled for the task Task ':beam-sdks-python:validatesRunnerStreamingTests' is not up-to-date because: Task has not declared any outputs despite executing actions. Starting process 'command 'sh''. Working directory: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python> Command: sh -c . <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/bin/activate> && ./scripts/run_integration_test.sh --test_opts "--nocapture --processes=8 --process-timeout=4500 --attr=ValidatesRunner,!sickbay-streaming" --streaming true --worker_jar <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.9.0-SNAPSHOT.jar> Successfully started process 'command 'sh'' ########################################################################### # Build pipeline options if not provided in --pipeline_opts from commandline if [[ -z $PIPELINE_OPTS ]]; then # Check that the script is running in a known directory. if [[ $PWD != *sdks/python* ]]; then echo 'Unable to locate Apache Beam Python SDK root directory' exit 1 fi # Go to the Apache Beam Python SDK root if [[ "*sdks/python" != $PWD ]]; then cd $(pwd | sed 's/sdks\/python.*/sdks\/python/') fi # Create a tarball if not exists if [[ $(find ${SDK_LOCATION}) ]]; then SDK_LOCATION=$(find ${SDK_LOCATION}) else python setup.py -q sdist SDK_LOCATION=$(find dist/apache-beam-*.tar.gz) fi # Install test dependencies for ValidatesRunner tests. echo "pyhamcrest" > postcommit_requirements.txt echo "mock" >> postcommit_requirements.txt # Options used to run testing pipeline on Cloud Dataflow Service. Also used for # running on DirectRunner (some options ignored). opts=( "--runner=$RUNNER" "--project=$PROJECT" "--staging_location=$GCS_LOCATION/staging-it" "--temp_location=$GCS_LOCATION/temp-it" "--output=$GCS_LOCATION/py-it-cloud/output" "--sdk_location=$SDK_LOCATION" "--requirements_file=postcommit_requirements.txt" "--num_workers=$NUM_WORKERS" "--sleep_secs=$SLEEP_SECS" ) # Add --streaming if provided if [[ "$STREAMING" = true ]]; then opts+=("--streaming") fi # Add --dataflow_worker_jar if provided if [[ ! -z "$WORKER_JAR" ]]; then opts+=("--dataflow_worker_jar=$WORKER_JAR") fi PIPELINE_OPTS=$(IFS=" " ; echo "${opts[*]}") fi pwd | sed 's/sdks\/python.*/sdks\/python/' find ${SDK_LOCATION} find ${SDK_LOCATION} IFS=" " ; echo "${opts[*]}" ########################################################################### # Run tests and validate that jobs finish successfully. echo ">>> RUNNING integration tests with pipeline options: $PIPELINE_OPTS" python setup.py nosetests \ --test-pipeline-options="$PIPELINE_OPTS" \ $TEST_OPTS >>> RUNNING integration tests with pipeline options: >>> --runner=TestDataflowRunner --project=apache-beam-testing >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-it >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-it >>> --output=gs://temp-storage-for-end-to-end-tests/py-it-cloud/output >>> --sdk_location=build/apache-beam.tar.gz >>> --requirements_file=postcommit_requirements.txt --num_workers=1 >>> --sleep_secs=20 --streaming >>> --dataflow_worker_jar=<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/runners/google-cloud-dataflow-java/worker/build/libs/beam-runners-google-cloud-dataflow-java-fn-api-worker-2.9.0-SNAPSHOT.jar> <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build/gradleenv/local/lib/python2.7/site-packages/setuptools/dist.py>:470: UserWarning: Normalizing '2.9.0.dev' to '2.9.0.dev0' normalized_version, running nosetests running egg_info writing requirements to apache_beam.egg-info/requires.txt writing apache_beam.egg-info/PKG-INFO writing top-level names to apache_beam.egg-info/top_level.txt writing dependency_links to apache_beam.egg-info/dependency_links.txt writing entry points to apache_beam.egg-info/entry_points.txt reading manifest file 'apache_beam.egg-info/SOURCES.txt' reading manifest template 'MANIFEST.in' warning: no files found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' writing manifest file 'apache_beam.egg-info/SOURCES.txt' <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/apache_beam/runners/dataflow/dataflow_runner.py>:800: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported options = pbegin.pipeline.options.view_as(DebugOptions) test_flatten_multiple_pcollections_having_multiple_consumers (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_multiple_empty_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_as_list_and_as_dict_side_inputs (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_undeclared_outputs (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_par_do_with_multiple_outputs_and_using_yield (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_par_do_with_multiple_outputs_and_using_return (apache_beam.transforms.ptransform_test.PTransformTest) ... ok test_as_list_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_dict_twice (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_singleton_with_different_defaults (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_default_value_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_as_singleton_without_unique_labels (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_empty_singleton_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_iterable_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok test_flattened_side_input (apache_beam.transforms.sideinputs_test.SideInputsTest) ... ok ---------------------------------------------------------------------- XML: <https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/nosetests.xml> ---------------------------------------------------------------------- Ran 14 tests in 927.601s OK Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_40_00-7790680914792818370?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_47_41-7409212406467762023?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_40_00-6789589073088999596?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_47_21-3188061482534302246?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_39_59-16919662903535559421?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_47_44-3028702862371489692?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_40_00-5531783053299650803?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_47_39-15507784984621186701?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_39_59-17242778800441333628?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_47_35-6612110147567713188?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_39_59-8155546320686062793?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_40_00-7195979902196034459?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_39_59-7854217518609539618?project=apache-beam-testing. Found: https://console.cloud.google.com/dataflow/jobsDetail/locations/us-central1/jobs/2018-11-16_23_47_35-1833055702488483795?project=apache-beam-testing. :beam-sdks-python:validatesRunnerStreamingTests (Thread[Task worker for ':',5,main]) completed. Took 15 mins 28.432 secs. FAILURE: Build failed with an exception. * Where: Build file '<https://builds.apache.org/job/beam_PostCommit_Py_VR_Dataflow/ws/src/sdks/python/build.gradle'> line: 330 * What went wrong: Execution failed for task ':beam-sdks-python:validatesRunnerBatchTests'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 5.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 1h 25m 40s 61 actionable tasks: 56 executed, 5 from cache Publishing build scan... https://gradle.com/s/wige2z7vbm3iq Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
