See <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/678/display/redirect?page=changes>
Changes: [timrobertson100] [BEAM-4861] Autocreate absent parent directories when doing an HDFS [timrobertson100] [BEAM-4861] Improve clarity around exceptions thrown in rename [vin1990] Endpoint host port configuration reset issue [vin1990] Endpoint host port configuration reset issue [vin1990] Fixes https://issues.apache.org/jira/browse/BEAM-3446. BaseReadFn to [vin1990] package private and typo fix [vin1990] Using mget with configurable batch size to increase efficiency of read [vin1990] fixing equality of batch size [vin1990] fixing order of test arguments, to fix [vin1990] Aggregating on per window, applyiong redis get on per window batch and [herohde] Fix Go index parsing in the face of runner-gernerated keys [herohde] Fix use of wrong key in Dataflow side input [timrobertson100] [BEAM-4861] Typo in comment [mxm] [BEAM-3089] Use Flink cluster parallelism if no parallelism provided [mxm] [flink] Revert default checkpointing mode to EXACTLY_ONCE [mxm] [flink] Use default value for checkpoint timeout [mxm] [flink] Set default master url to [auto] [mxm] [BEAM-3089] Test default values of FlinkPipelineOptions ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace <https://builds.apache.org/job/beam_PerformanceTests_AvroIOIT_HDFS/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 6d7cc57d88a422c2e8fbfdbc41bcbf68b73f4950 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 6d7cc57d88a422c2e8fbfdbc41bcbf68b73f4950 Commit message: "[BEAM-3286] Add Dataflow support for side input" > git rev-list --no-walk c49a97ecbf815b320926285dcddba993590e3073 # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [beam_PerformanceTests_AvroIOIT_HDFS] $ /bin/bash -xe /tmp/jenkins9120965464369815147.sh + gcloud container clusters get-credentials io-datastores --zone=us-central1-a --verbosity=debug DEBUG: (gcloud.container.clusters.get-credentials) timed out This may be due to network connectivity issues. Please check your network settings, and the status of the service you are trying to reach. Traceback (most recent call last): File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/calliope/cli.py", line 797, in Execute resources = calliope_command.Run(cli=self, args=args) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py", line 748, in Run self._parent_group.RunGroupFilter(tool_context, args) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py", line 689, in RunGroupFilter self._parent_group.RunGroupFilter(context, args) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/calliope/backend.py", line 690, in RunGroupFilter self._common_type().Filter(context, args) File "/usr/lib/google-cloud-sdk/lib/surface/container/__init__.py", line 71, in Filter context['api_adapter'] = api_adapter.NewAPIAdapter('v1') File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/container/api_adapter.py", line 143, in NewAPIAdapter return NewV1APIAdapter() File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/container/api_adapter.py", line 147, in NewV1APIAdapter return InitAPIAdapter('v1', V1Adapter) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/container/api_adapter.py", line 168, in InitAPIAdapter api_client = core_apis.GetClientInstance('container', api_version) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/apis.py", line 295, in GetClientInstance api_name, api_version, no_http, _CheckResponse, enable_resource_quota) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/api_lib/util/apis_internal.py", line 149, in _GetClientInstance http_client = http.Http(enable_resource_quota=enable_resource_quota) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/http.py", line 62, in Http creds = store.LoadIfEnabled() File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/store.py", line 278, in LoadIfEnabled return Load() File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/store.py", line 340, in Load account = properties.VALUES.core.account.Get() File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/properties.py", line 1582, in Get required) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/properties.py", line 1881, in _GetProperty value = _GetPropertyWithoutDefault(prop, properties_file) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/properties.py", line 1919, in _GetPropertyWithoutDefault value = callback() File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/store.py", line 217, in GetAccount return c_gce.Metadata().DefaultAccount() File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/gce.py", line 85, in DefaultAccount http_errors_to_ignore=(404,)) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/util/retry.py", line 289, in DecoratedFunction six.reraise(to_reraise[0], to_reraise[1], to_reraise[2]) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/util/retry.py", line 159, in TryFunc return func(*args, **kwargs), None File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/gce.py", line 44, in _ReadNoProxyWithCleanFailures return gce_read.ReadNoProxy(uri) File "/usr/lib/google-cloud-sdk/lib/googlecloudsdk/core/credentials/gce_read.py", line 56, in ReadNoProxy request, timeout=timeout_property).read() File "/usr/lib/python2.7/urllib2.py", line 429, in open response = self._open(req, data) File "/usr/lib/python2.7/urllib2.py", line 447, in _open '_open', req) File "/usr/lib/python2.7/urllib2.py", line 407, in _call_chain result = func(*args) File "/usr/lib/python2.7/urllib2.py", line 1228, in http_open return self.do_open(httplib.HTTPConnection, req) File "/usr/lib/python2.7/urllib2.py", line 1201, in do_open r = h.getresponse(buffering=True) File "/usr/lib/python2.7/httplib.py", line 1136, in getresponse response.begin() File "/usr/lib/python2.7/httplib.py", line 453, in begin version, status, reason = self._read_status() File "/usr/lib/python2.7/httplib.py", line 409, in _read_status line = self.fp.readline(_MAXLINE + 1) File "/usr/lib/python2.7/socket.py", line 480, in readline data = self._sock.recv(self._rbufsize) timeout: timed out ERROR: (gcloud.container.clusters.get-credentials) timed out This may be due to network connectivity issues. Please check your network settings, and the status of the service you are trying to reach. Build step 'Execute shell' marked build as failure
