Pull request #3356 updated Connecting to https://api.github.com using edgex-jenkins/****** (edgex-jenkins github personal access token) Connecting to https://api.github.com to check permissions of obtain list of weichou1229 for edgexfoundry/edgex-go Loading trusted files from base branch master at c419618f783e51adc3e0be9d68d8defacfb69d2d rather than 429abc1cb4aa7afc2083fdf669ed664eedfe3383 Obtained Jenkinsfile from c419618f783e51adc3e0be9d68d8defacfb69d2d Running in Durability level: PERFORMANCE_OPTIMIZED Loading library edgex-global-pipelines@stable Attempting to resolve stable from remote references... > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git ls-remote -h -t -- git@github.com:edgexfoundry/edgex-global-pipelines.git # timeout=10 Found match: refs/tags/stable revision 57ded3389ef25720063a8030e5c426a6b7ea5b20 Resolving tag commit... (remote references may be a lightweight tag or an annotated tag) > git rev-parse --is-inside-work-tree # timeout=10 Setting origin to git@github.com:edgexfoundry/edgex-global-pipelines.git > git config remote.origin.url git@github.com:edgexfoundry/edgex-global-pipelines.git # timeout=10 Fetching origin... Fetching upstream changes from origin > git --version # timeout=10 > git --version # 'git version 2.16.6' > git config --get remote.origin.url # timeout=10 using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --progress -- origin +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/tags/stable^{commit} # timeout=10 Resolved tag stable revision 57ded3389ef25720063a8030e5c426a6b7ea5b20 using credential edgex-jenkins-ssh > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@github.com:edgexfoundry/edgex-global-pipelines.git # timeout=10 Fetching with tags Fetching upstream changes from git@github.com:edgexfoundry/edgex-global-pipelines.git > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --progress -- git@github.com:edgexfoundry/edgex-global-pipelines.git +refs/pull/*:refs/remotes/origin/pr/* # timeout=10 Checking out Revision 57ded3389ef25720063a8030e5c426a6b7ea5b20 (stable) > git config core.sparsecheckout # timeout=10 > git checkout -f 57ded3389ef25720063a8030e5c426a6b7ea5b20 # timeout=10 Commit message: "Merge pull request #323 from siggiskulason/update-snap-build" > git remote # timeout=10 > git submodule init # timeout=10 > git submodule sync # timeout=10 > git config --get remote.origin.url # timeout=10 > git submodule init # timeout=10 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 > git config --get submodule.global-jjb.url # timeout=10 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 > git submodule update --init --recursive global-jjb # timeout=10 Excluding src/test/ from checkout of git git@github.com:edgexfoundry/edgex-global-pipelines.git so that shared library test code cannot be accessed by Pipelines. To remove this log message, move the test code outside of src/. To restore the previous behavior that allowed access to files in src/test/, pass -Dorg.jenkinsci.plugins.workflow.libs.SCMSourceRetriever.INCLUDE_SRC_TEST_IN_LIBRARIES=true to the java command used to start Jenkins. Loading library lf-pipelines@master Attempting to resolve master from remote references... > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git ls-remote -h -- git@github.com:lfit/releng-pipelines.git # timeout=10 Found match: refs/heads/master revision 46d8313d362d7075c0f562900eedc504c24ea18a using credential edgex-jenkins-ssh > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@github.com:lfit/releng-pipelines.git # timeout=10 Fetching without tags Fetching upstream changes from git@github.com:lfit/releng-pipelines.git > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --no-tags --progress -- git@github.com:lfit/releng-pipelines.git +refs/heads/*:refs/remotes/origin/* # timeout=10 Checking out Revision 46d8313d362d7075c0f562900eedc504c24ea18a (master) > git config core.sparsecheckout # timeout=10 > git checkout -f 46d8313d362d7075c0f562900eedc504c24ea18a # timeout=10 Commit message: "Fix lfParallelCostCapture env var name" > git remote # timeout=10 > git submodule init # timeout=10 > git submodule sync # timeout=10 > git config --get remote.origin.url # timeout=10 > git submodule init # timeout=10 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 > git config --get submodule.global-jjb.url # timeout=10 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 > git submodule update --init --recursive global-jjb # timeout=10 Excluding src/test/ from checkout of git git@github.com:lfit/releng-pipelines.git so that shared library test code cannot be accessed by Pipelines. To remove this log message, move the test code outside of src/. To restore the previous behavior that allowed access to files in src/test/, pass -Dorg.jenkinsci.plugins.workflow.libs.SCMSourceRetriever.INCLUDE_SRC_TEST_IN_LIBRARIES=true to the java command used to start Jenkins. [Pipeline] Start of Pipeline [Pipeline] echo ========================================================= [edgeXBuildGoParallel] RAW Config: [project:edgex-go, dockerFileGlobPath:cmd/**/Dockerfile, testScript:make test, buildScript:make build, publishSwaggerDocs:true, swaggerApiFolders:[openapi/v1, openapi/v2], buildSnap:true] ========================================================= [Pipeline] echo Setting up nodes based on requested architectures [[amd64, arm64]] [Pipeline] echo Nodes requested: [[centos7-docker-4c-2g, ubuntu18.04-docker-arm64-4c-16g]] [Pipeline] echo ========================================================= [edgeXBuildGoParallel] Pipeline Parameters: ========================================================= [Pipeline] echo MAVEN_SETTINGS: edgex-go-settings PROJECT: edgex-go USE_SEMVER: true TEST_SCRIPT: make test BUILD_SCRIPT: make build GO_VERSION: 1.15 DOCKER_BASE_IMAGE: nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base:1.15-alpine DOCKER_FILE_GLOB: cmd/**/Dockerfile DOCKER_IMAGE_NAME_PREFIX: docker- DOCKER_IMAGE_NAME_SUFFIX: -go DOCKER_BUILD_FILE_PATH: Dockerfile.build DOCKER_BUILD_CONTEXT: . DOCKER_REGISTRY_NAMESPACE: DOCKER_NEXUS_REPO: staging BUILD_DOCKER_IMAGE: true PUSH_DOCKER_IMAGE: true SEMVER_BUMP_LEVEL: pre GOPROXY: https://nexus3.edgexfoundry.org/repository/go-proxy/ PUBLISH_SWAGGER_DOCS: true SWAGGER_API_FOLDERS: openapi/v1 openapi/v2 BUILD_SNAP: true BUILD_FAILURE_NOTIFY_LIST: edgex-tsc-core@lists.edgexfoundry.org,edgex-tsc-devops@lists.edgexfoundry.org [Pipeline] node Still waiting to schedule task All nodes of label ‘centos7-docker-4c-2g’ are offline Running on prd-centos7-docker-4c-2g-467 in /w/workspace/edgexfoundry_edgex-go_PR-3356 [Pipeline] { [Pipeline] ws Running in /w/workspace/edgex-go/13 [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout using credential edgex-jenkins-ssh Cloning the remote Git repository Cloning repository git@github.com:edgexfoundry/edgex-go.git > git init /w/workspace/edgex-go/13 # timeout=10 Fetching upstream changes from git@github.com:edgexfoundry/edgex-go.git > git --version # timeout=10 > git --version # 'git version 2.24.3' using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --force --progress -- git@github.com:edgexfoundry/edgex-go.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git@github.com:edgexfoundry/edgex-go.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git@github.com:edgexfoundry/edgex-go.git # timeout=10 Fetching upstream changes from git@github.com:edgexfoundry/edgex-go.git using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --force --progress -- git@github.com:edgexfoundry/edgex-go.git +refs/pull/3356/head:refs/remotes/origin/PR-3356 +refs/heads/master:refs/remotes/origin/master # timeout=10 Merging remotes/origin/master commit c419618f783e51adc3e0be9d68d8defacfb69d2d into PR head commit 429abc1cb4aa7afc2083fdf669ed664eedfe3383 Merge succeeded, producing 429abc1cb4aa7afc2083fdf669ed664eedfe3383 Checking out Revision 429abc1cb4aa7afc2083fdf669ed664eedfe3383 (PR-3356) > git config core.sparsecheckout # timeout=10 > git checkout -f 429abc1cb4aa7afc2083fdf669ed664eedfe3383 # timeout=10 > git remote # timeout=10 > git config --get remote.origin.url # timeout=10 using GIT_SSH to set credentials SSH Credentials for GitHub > git merge c419618f783e51adc3e0be9d68d8defacfb69d2d # timeout=10 > git rev-parse HEAD^{commit} # timeout=10 > git config core.sparsecheckout # timeout=10 > git checkout -f 429abc1cb4aa7afc2083fdf669ed664eedfe3383 # timeout=10 Commit message: "feat: Add unit test for scheduler manager" First time build. Skipping changelog. [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] timestamps [Pipeline] { [Pipeline] timeout 09:07:22 Timeout set to expire in 6 hr 0 min [Pipeline] { [Pipeline] stage [Pipeline] { (Prepare) [Pipeline] script [Pipeline] { [Pipeline] withCredentials 09:07:23 Masking supported pattern matches of $GH_TOKEN_USR or $GH_TOKEN_PSW [Pipeline] { [Pipeline] withEnv [Pipeline] { [Pipeline] echo 09:07:23 ========================================================= 09:07:23 EdgeX Global Pipelines Version Info 09:07:23 ========================================================= [Pipeline] libraryResource [Pipeline] sh > git rev-list --no-walk 7f7afaeb25365cec08ac0c892c28647ec1a9ae43 # timeout=10 09:07:24 ------------------- 09:07:24 stable info: 09:07:24 ------------------- 09:07:24 Commited By: Ernesto Ojeda ernesto.ojeda@intel.com 09:07:24 Commit SHA: 57ded3389ef25720063a8030e5c426a6b7ea5b20 09:07:24 Message: update stable to v1.0.186 09:07:25 ------------------- 09:07:25 experimental info: 09:07:25 ------------------- 09:07:25 Commited By: **** collab-it+edgex@linuxfoundation.org 09:07:25 Commit SHA: d990d252097850d5d490fbb59df25296f5300d79 09:07:25 Message: update experimental to v1.0.188 [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // withCredentials [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar MAVEN_SETTINGS = edgex-go-settings [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar PROJECT = edgex-go [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar USE_SEMVER = true [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar TEST_SCRIPT = make test [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar BUILD_SCRIPT = make build [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar GO_VERSION = 1.15 [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_BASE_IMAGE = nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base:1.15-alpine [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_FILE_GLOB = cmd/**/Dockerfile [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_IMAGE_NAME_PREFIX = docker- [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_IMAGE_NAME_SUFFIX = -go [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_BUILD_FILE_PATH = Dockerfile.build [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_BUILD_CONTEXT = . [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_REGISTRY_NAMESPACE = [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar DOCKER_NEXUS_REPO = staging [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar BUILD_DOCKER_IMAGE = true [Pipeline] echo 09:07:25 [edgeXSetupEnvironment]: set envvar PUSH_DOCKER_IMAGE = true [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar SEMVER_BUMP_LEVEL = pre [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar GOPROXY = https://nexus3.edgexfoundry.org/repository/go-proxy/ [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar PUBLISH_SWAGGER_DOCS = true [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar SWAGGER_API_FOLDERS = openapi/v1 openapi/v2 [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar BUILD_SNAP = true [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar BUILD_FAILURE_NOTIFY_LIST = edgex-tsc-core@lists.edgexfoundry.org,edgex-tsc-devops@lists.edgexfoundry.org [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar GIT_BRANCH = PR-3356 [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar SEMVER_BRANCH = PR-3356 [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar GIT_BRANCH_CLEAN = PR-3356 [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar GIT_COMMIT = 429abc1cb4aa7afc2083fdf669ed664eedfe3383 [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar SHORT_GIT_COMMIT = 429abc1 [Pipeline] echo 09:07:26 [edgeXSetupEnvironment]: set envvar SEMVER_PRE_PREFIX = dev [Pipeline] withEnv [Pipeline] { [Pipeline] wrap 09:07:26 provisioning config files... 09:07:26 copy managed file [edgex-go-settings] to file:/w/workspace/edgex-go/13@tmp/config1962687459772859948tmp [Pipeline] { [Pipeline] libraryResource [Pipeline] sh 09:07:26 ---> docker-login.sh 09:07:26 nexus3.edgexfoundry.org:10001 09:07:26 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:07:26 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:07:26 Configure a credential helper to remove this warning. See 09:07:26 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:07:26 09:07:26 Login Succeeded 09:07:26 nexus3.edgexfoundry.org:10002 09:07:27 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:07:27 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:07:27 Configure a credential helper to remove this warning. See 09:07:27 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:07:27 09:07:27 Login Succeeded 09:07:27 nexus3.edgexfoundry.org:10003 09:07:27 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:07:27 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:07:27 Configure a credential helper to remove this warning. See 09:07:27 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:07:27 09:07:27 Login Succeeded 09:07:27 nexus3.edgexfoundry.org:10004 09:07:27 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:07:27 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:07:27 Configure a credential helper to remove this warning. See 09:07:27 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:07:27 09:07:27 Login Succeeded 09:07:27 docker.io 09:07:27 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:07:27 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:07:27 Configure a credential helper to remove this warning. See 09:07:27 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:07:27 09:07:27 Login Succeeded 09:07:27 ---> docker-login.sh ends [Pipeline] } 09:07:28 Deleting 1 temporary files [Pipeline] // wrap [Pipeline] } [Pipeline] // withEnv [Pipeline] sh 09:07:28 ++ ls cmd/core-command/Dockerfile cmd/core-data/Dockerfile cmd/core-metadata/Dockerfile cmd/security-bootstrapper/Dockerfile cmd/security-proxy-setup/Dockerfile cmd/security-secretstore-setup/Dockerfile cmd/support-notifications/Dockerfile cmd/support-scheduler/Dockerfile cmd/sys-mgmt-agent/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/core-command/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo core-command,cmd/core-command/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/core-data/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo core-data,cmd/core-data/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/core-metadata/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo core-metadata,cmd/core-metadata/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/security-bootstrapper/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo security-bootstrapper,cmd/security-bootstrapper/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/security-proxy-setup/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo security-proxy-setup,cmd/security-proxy-setup/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/security-secretstore-setup/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo security-secretstore-setup,cmd/security-secretstore-setup/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/support-notifications/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo support-notifications,cmd/support-notifications/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/support-scheduler/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo support-scheduler,cmd/support-scheduler/Dockerfile 09:07:28 + for file in '`ls cmd/**/Dockerfile`' 09:07:28 ++ dirname cmd/sys-mgmt-agent/Dockerfile 09:07:28 ++ cut -d/ -f2 09:07:28 + echo sys-mgmt-agent,cmd/sys-mgmt-agent/Dockerfile [Pipeline] echo 09:07:28 Generate Dockers from filesystem: [[image:docker-core-command-go, dockerfile:cmd/core-command/Dockerfile], [image:docker-core-data-go, dockerfile:cmd/core-data/Dockerfile], [image:docker-core-metadata-go, dockerfile:cmd/core-metadata/Dockerfile], [image:docker-security-bootstrapper-go, dockerfile:cmd/security-bootstrapper/Dockerfile], [image:docker-security-proxy-setup-go, dockerfile:cmd/security-proxy-setup/Dockerfile], [image:docker-security-secretstore-setup-go, dockerfile:cmd/security-secretstore-setup/Dockerfile], [image:docker-support-notifications-go, dockerfile:cmd/support-notifications/Dockerfile], [image:docker-support-scheduler-go, dockerfile:cmd/support-scheduler/Dockerfile], [image:docker-sys-mgmt-agent-go, dockerfile:cmd/sys-mgmt-agent/Dockerfile]] [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Semver Prep) [Pipeline] isUnix [Pipeline] sh 09:07:29 + docker inspect -f . nexus3.edgexfoundry.org:10004/edgex-devops/git-semver:latest 09:07:29 09:07:29 Error: No such object: nexus3.edgexfoundry.org:10004/edgex-devops/git-semver:latest [Pipeline] isUnix [Pipeline] sh 09:07:29 + docker pull nexus3.edgexfoundry.org:10004/edgex-devops/git-semver:latest 09:07:29 latest: Pulling from edgex-devops/git-semver 09:07:29 31603596830f: Pulling fs layer 09:07:29 2a8b12db71e7: Pulling fs layer 09:07:29 6ca5941a6612: Pulling fs layer 09:07:29 ecc8261a40a4: Pulling fs layer 09:07:29 ecc8261a40a4: Waiting 09:07:29 2a8b12db71e7: Download complete 09:07:29 31603596830f: Verifying Checksum 09:07:29 31603596830f: Download complete 09:07:29 ecc8261a40a4: Verifying Checksum 09:07:29 ecc8261a40a4: Download complete 09:07:29 6ca5941a6612: Verifying Checksum 09:07:29 6ca5941a6612: Download complete 09:07:30 31603596830f: Pull complete 09:07:30 2a8b12db71e7: Pull complete 09:07:31 6ca5941a6612: Pull complete 09:07:31 ecc8261a40a4: Pull complete 09:07:31 Digest: sha256:c336c3cb7d26c4f33e4bbf869d415e221d43967d83d6a5809e4cb0cc2a1e8fe7 09:07:31 Status: Downloaded newer image for nexus3.edgexfoundry.org:10004/edgex-devops/git-semver:latest 09:07:31 nexus3.edgexfoundry.org:10004/edgex-devops/git-semver:latest [Pipeline] withDockerContainer 09:07:31 prd-centos7-docker-4c-2g-467 does not seem to be running inside a container 09:07:31 $ docker run -t -d -u 1001:1001 -u 0:0 -v /etc/ssh:/etc/ssh -w /w/workspace/edgex-go/13 -v /w/workspace/edgex-go/13:/w/workspace/edgex-go/13:rw,z -v /w/workspace/edgex-go/13@tmp:/w/workspace/edgex-go/13@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** nexus3.edgexfoundry.org:10004/edgex-devops/git-semver:latest cat 09:07:34 $ docker top 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d -eo pid,comm [Pipeline] { [Pipeline] withEnv [Pipeline] { [Pipeline] sshagent 09:07:34 [ssh-agent] Using credentials edgex-jenkins (SSH Credentials for GitHub) 09:07:34 [ssh-agent] Looking for ssh-agent implementation... 09:07:34 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 09:07:34 $ docker exec 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d ssh-agent 09:07:34 SSH_AUTH_SOCK=/tmp/ssh-5BdswpDhz2On/agent.12 09:07:34 SSH_AGENT_PID=17 09:07:34 Running ssh-add (command line suppressed) 09:07:34 Identity added: /w/workspace/edgex-go/13@tmp/private_key_9201053008834898752.key (/w/workspace/edgex-go/13@tmp/private_key_9201053008834898752.key) 09:07:34 [ssh-agent] Started. [Pipeline] { [Pipeline] sh 09:07:35 + git tag --points-at HEAD [Pipeline] } 09:07:35 $ docker exec --env ******** --env ******** 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d ssh-agent -k 09:07:35 unset SSH_AUTH_SOCK; 09:07:35 unset SSH_AGENT_PID; 09:07:35 echo Agent pid 17 killed; 09:07:35 [ssh-agent] Stopped. [Pipeline] // sshagent [Pipeline] sshagent 09:07:35 [ssh-agent] Using credentials edgex-jenkins (SSH Credentials for GitHub) 09:07:35 [ssh-agent] Looking for ssh-agent implementation... 09:07:35 [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) 09:07:35 $ docker exec 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d ssh-agent 09:07:35 SSH_AUTH_SOCK=/tmp/ssh-INPGHDklE6Cl/agent.47 09:07:35 SSH_AGENT_PID=53 09:07:35 Running ssh-add (command line suppressed) 09:07:35 Identity added: /w/workspace/edgex-go/13@tmp/private_key_2088742533078209552.key (/w/workspace/edgex-go/13@tmp/private_key_2088742533078209552.key) 09:07:35 [ssh-agent] Started. [Pipeline] { [Pipeline] sh 09:07:36 + git semver init 09:07:36 # -> Open(): unable to determine branch for HEAD 09:07:36 # $GIT_DIR = /w/workspace/edgex-go/13/.git 09:07:36 # $GIT_WORK_TREE = /w/workspace/edgex-go/13 09:07:36 # $SEMVER_REMOTE_NAME = origin 09:07:36 # $SEMVER_USER_EMAIL = collab-it+edgex@linuxfoundation.org 09:07:36 # $SEMVER_USER_NAME = edgex-jenkins 09:07:36 # $SEMVER_BRANCH = PR-3356 09:07:36 # $SEMVER_TEMP = /tmp/semver-298280255 09:07:36 # git clone --branch semver git@github.com:edgexfoundry/edgex-go.git $SEMVER_TEMP 09:07:54 # '/tmp/semver-298280255' -> '/w/workspace/edgex-go/13/.semver' 09:07:54 # -> Force: false 09:07:54 # $SEMVER_DIR = /w/workspace/edgex-go/13/.semver [Pipeline] } 09:07:54 $ docker exec --env ******** --env ******** 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d ssh-agent -k 09:07:54 unset SSH_AUTH_SOCK; 09:07:54 unset SSH_AGENT_PID; 09:07:54 echo Agent pid 53 killed; 09:07:54 [ssh-agent] Stopped. [Pipeline] // sshagent [Pipeline] } [Pipeline] // withEnv [Pipeline] sh 09:07:55 + git semver [Pipeline] } 09:07:55 $ docker stop --time=1 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d 09:07:56 $ docker rm -f 4a06f4e0a7cc31e10f794df31bce083d71314a80ce516185a1b0fd894d02436d [Pipeline] // withDockerContainer [Pipeline] sh 09:07:57 + sudo chown -R jenkins:jenkins .semver [Pipeline] writeFile [Pipeline] stash 09:07:57 Stashed 1 file(s) [Pipeline] echo 09:07:57 [edgeXSemver]: initialized semver on version 0.0.0 [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Build) [Pipeline] parallel [Pipeline] { (Branch: amd64) [Pipeline] { (Branch: arm64) [Pipeline] stage [Pipeline] { (amd64) [Pipeline] stage [Pipeline] { (arm64) [Pipeline] node [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Prep) [Pipeline] script [Pipeline] { [Pipeline] sh 09:07:58 + sudo jq '. + {"registry-mirrors": ["https://nexus3.edgexfoundry.org:10001"], debug: false}' /etc/docker/daemon.json [Pipeline] sh 09:07:58 + sudo mv /tmp/daemon.json /etc/docker/daemon.json [Pipeline] sh 09:07:58 + sudo service docker restart 09:07:58 + true 09:07:58 Redirecting to /bin/systemctl restart docker.service [Pipeline] echo 09:07:59 ========================================================= 09:07:59 [edgeXBuildGoParallel] Building Code With image [nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base:1.15-alpine] 09:07:59 ========================================================= [Pipeline] isUnix [Pipeline] sh 09:07:59 + docker build -t ci-base-image-x86_64 -f Dockerfile.build --build-arg BASE=nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base:1.15-alpine . 09:08:03 Sending build context to Docker daemon 329.5MB 09:08:03 Step 1/6 : ARG BASE=golang:1.15-alpine3.12 09:08:03 Step 2/6 : FROM ${BASE} 09:08:03 1.15-alpine: Pulling from edgex-devops/edgex-golang-base 09:08:03 188c0c94c7c5: Pulling fs layer 09:08:03 0ef7d3d256c8: Pulling fs layer 09:08:03 de9db76c5a1d: Pulling fs layer 09:08:03 bca2f99d35d6: Pulling fs layer 09:08:03 93359f2a8cfa: Pulling fs layer 09:08:03 7c6f9722023f: Pulling fs layer 09:08:03 a35cf1a2eb13: Pulling fs layer 09:08:03 bca2f99d35d6: Waiting 09:08:03 93359f2a8cfa: Waiting 09:08:03 7c6f9722023f: Waiting 09:08:03 a35cf1a2eb13: Waiting 09:08:03 de9db76c5a1d: Download complete 09:08:03 0ef7d3d256c8: Download complete 09:08:03 93359f2a8cfa: Verifying Checksum 09:08:03 93359f2a8cfa: Download complete 09:08:03 7c6f9722023f: Verifying Checksum 09:08:03 7c6f9722023f: Download complete 09:08:03 188c0c94c7c5: Verifying Checksum 09:08:03 188c0c94c7c5: Download complete 09:08:03 188c0c94c7c5: Pull complete 09:08:03 0ef7d3d256c8: Pull complete 09:08:04 de9db76c5a1d: Pull complete 09:08:05 a35cf1a2eb13: Verifying Checksum 09:08:05 a35cf1a2eb13: Download complete 09:08:05 bca2f99d35d6: Download complete 09:08:11 bca2f99d35d6: Pull complete 09:08:11 93359f2a8cfa: Pull complete 09:08:11 7c6f9722023f: Pull complete 09:08:12 Still waiting to schedule task 09:08:12 All nodes of label ‘ubuntu18.04-docker-arm64-4c-16g’ are offline 09:08:15 a35cf1a2eb13: Pull complete 09:08:15 Digest: sha256:47e1832254f01ad1d18e03a79677f1a8325b9c763402aad95be204d7d7715f46 09:08:15 Status: Downloaded newer image for nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base:1.15-alpine 09:08:15 ---> a62c8e92a672 09:08:15 Step 3/6 : RUN apk add --update --no-cache make git curl bash zeromq-dev libsodium-dev pkgconfig build-base && ln -s /bin/touch /usr/bin/touch 09:08:15 ---> Running in 92ccdd3b5bde 09:08:16 fetch http://nl.alpinelinux.org/alpine/v3.12/main/x86_64/APKINDEX.tar.gz 09:08:16 fetch http://nl.alpinelinux.org/alpine/v3.12/community/x86_64/APKINDEX.tar.gz 09:08:17 (1/12) Installing libmagic (5.38-r0) 09:08:18 (2/12) Installing file (5.38-r0) 09:08:18 (3/12) Installing libc-dev (0.7.2-r3) 09:08:18 (4/12) Installing g++ (9.3.0-r2) 09:08:22 (5/12) Installing fortify-headers (1.1-r0) 09:08:22 (6/12) Installing patch (2.7.6-r6) 09:08:22 (7/12) Installing build-base (0.5-r2) 09:08:22 (8/12) Installing libsodium (1.0.18-r0) 09:08:22 (9/12) Installing pkgconf (1.7.2-r0) 09:08:22 (10/12) Installing libsodium-dev (1.0.18-r0) 09:08:22 (11/12) Installing libzmq (4.3.3-r0) 09:08:22 (12/12) Installing zeromq-dev (4.3.3-r0) 09:08:22 Executing busybox-1.31.1-r19.trigger 09:08:22 OK: 233 MiB in 51 packages 09:08:27 Removing intermediate container 92ccdd3b5bde 09:08:27 ---> 278f063f31e7 09:08:27 Step 4/6 : WORKDIR /edgex-go 09:08:27 ---> Running in d75817ffeb9b 09:08:27 Removing intermediate container d75817ffeb9b 09:08:27 ---> 4d44b8c471f3 09:08:27 Step 5/6 : COPY go.mod . 09:08:27 ---> d92f48c65e2d 09:08:27 Step 6/6 : RUN go mod download 09:08:27 ---> Running in 42caba9d97d4 09:08:49 Removing intermediate container 42caba9d97d4 09:08:49 ---> 581e3193a35f 09:08:49 Successfully built 581e3193a35f 09:08:49 Successfully tagged ci-base-image-x86_64:latest [Pipeline] isUnix [Pipeline] sh 09:08:49 + docker inspect -f . ci-base-image-x86_64 09:08:49 . [Pipeline] withDockerContainer 09:08:49 prd-centos7-docker-4c-2g-467 does not seem to be running inside a container 09:08:49 $ docker run -t -d -u 1001:1001 -u 0:0 -w /w/workspace/edgex-go/13 -v /w/workspace/edgex-go/13:/w/workspace/edgex-go/13:rw,z -v /w/workspace/edgex-go/13@tmp:/w/workspace/edgex-go/13@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** ci-base-image-x86_64 cat 09:08:50 $ docker top 22919ff4836eef2526b6a48b62a3fb03756ca64aafe0d74ec7d5ea5646a8b61f -eo pid,comm [Pipeline] { [Pipeline] sh 09:08:51 + go version 09:08:51 go version go1.15.5 linux/amd64 [Pipeline] } 09:08:51 $ docker stop --time=1 22919ff4836eef2526b6a48b62a3fb03756ca64aafe0d74ec7d5ea5646a8b61f 09:08:52 $ docker rm -f 22919ff4836eef2526b6a48b62a3fb03756ca64aafe0d74ec7d5ea5646a8b61f [Pipeline] // withDockerContainer [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Test) [Pipeline] script [Pipeline] { [Pipeline] isUnix [Pipeline] sh 09:08:52 + docker inspect -f . ci-base-image-x86_64 09:08:52 . [Pipeline] withDockerContainer 09:08:52 prd-centos7-docker-4c-2g-467 does not seem to be running inside a container 09:08:53 $ docker run -t -d -u 1001:1001 -u 0:0 -v /var/run/docker.sock:/var/run/docker.sock --privileged -w /w/workspace/edgex-go/13 -v /w/workspace/edgex-go/13:/w/workspace/edgex-go/13:rw,z -v /w/workspace/edgex-go/13@tmp:/w/workspace/edgex-go/13@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** ci-base-image-x86_64 cat 09:08:53 $ docker top 5ce49060d6831be53f9cc81c2f5c9d17a1535859b4b4ef8d642de67098d4d83d -eo pid,comm [Pipeline] { [Pipeline] echo 09:08:53 ========================================================= 09:08:53 [edgeXBuildGoParallel] Running Tests and Build... 09:08:53 ========================================================= [Pipeline] sh 09:08:54 + make test 09:08:54 GO111MODULE=on go test -race -coverprofile=coverage.out ./... 09:09:04 ? github.com/edgexfoundry/edgex-go [no test files] 09:09:14 # github.com/edgexfoundry/edgex-go/internal/pkg/v2/utils 09:09:14 internal/pkg/v2/utils/restaddress.go:77:12: address.ContentType undefined (type models.RESTAddress has no field or method ContentType) 09:09:14 internal/pkg/v2/utils/restaddress.go:78:10: address.ContentType undefined (type models.RESTAddress has no field or method ContentType) 09:09:14 internal/pkg/v2/utils/restaddress.go:80:45: address.ContentType undefined (type models.RESTAddress has no field or method ContentType) 09:09:14 internal/pkg/v2/utils/restaddress.go:83:18: undefined: clients.ContentLength 09:09:32 FAIL github.com/edgexfoundry/edgex-go/internal/core/command [build failed] 09:09:32 ok github.com/edgexfoundry/edgex-go/internal/core/command/v2/application 0.063s coverage: 19.8% of statements 09:09:32 FAIL github.com/edgexfoundry/edgex-go/internal/core/command/v2/controller/http [build failed] 09:09:32 FAIL github.com/edgexfoundry/edgex-go/internal/core/data [build failed] 09:09:32 ok github.com/edgexfoundry/edgex-go/internal/core/data/operators/reading 0.105s coverage: 100.0% of statements 09:09:32 ok github.com/edgexfoundry/edgex-go/internal/core/data/operators/value_descriptor 0.056s coverage: 100.0% of statements 09:09:32 FAIL github.com/edgexfoundry/edgex-go/internal/core/data/v2/application [build failed] 09:09:32 FAIL github.com/edgexfoundry/edgex-go/internal/core/data/v2/controller/http [build failed] 09:09:32 ok github.com/edgexfoundry/edgex-go/internal/core/data/v2/io 0.055s coverage: 78.9% of statements 09:09:32 FAIL github.com/edgexfoundry/edgex-go/internal/core/metadata [build failed] 09:09:32 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/addressable 0.091s coverage: 100.0% of statements 09:09:32 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/command 0.058s coverage: 100.0% of statements 09:09:33 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/device 0.151s coverage: 86.7% of statements 09:09:33 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/device_profile 0.146s coverage: 97.5% of statements 09:09:34 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/device_service 0.082s coverage: 78.3% of statements 09:09:34 FAIL github.com/edgexfoundry/edgex-go/internal/core/metadata/v2/controller/http [build failed] 09:09:34 ok github.com/edgexfoundry/edgex-go/internal/pkg/telemetry 0.052s coverage: 58.8% of statements 09:09:34 FAIL github.com/edgexfoundry/edgex-go/internal/pkg/v2/infrastructure/redis [build failed] 09:09:34 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command 0.062s coverage: 47.1% of statements 09:09:34 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/gate 0.077s coverage: 79.5% of statements 09:09:35 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/genpassword 0.085s coverage: 94.1% of statements 09:09:35 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/gethttpstatus 0.076s coverage: 96.3% of statements 09:09:35 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/help 0.062s coverage: 87.5% of statements 09:09:47 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/listen 11.076s coverage: 94.4% of statements 09:09:47 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/ping 0.056s coverage: 44.8% of statements 09:09:50 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/setupacl 13.224s coverage: 81.9% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/waitfor 23.095s coverage: 92.9% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/helper 0.033s coverage: 77.8% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/tcp 11.044s coverage: 87.2% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/help 0.054s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/adduser 0.065s coverage: 75.5% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/deluser 0.057s coverage: 80.8% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/jwt 0.089s coverage: 87.2% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/oauth2 0.072s coverage: 84.6% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/tls 0.101s coverage: 91.6% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/fileprovider 0.199s coverage: 64.4% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/fileprovider/mocks 0.050s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/kdf 0.045s coverage: 91.3% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/kdf/mocks 0.039s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/pipedhexreader 0.033s coverage: 73.7% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/pipedhexreader/mocks 0.025s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/proxy 0.307s coverage: 69.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/secretstore 0.114s coverage: 38.4% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/secretstore/secretsengine 0.040s coverage: 89.5% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/security/secretstore/tokenfilewriter 0.035s coverage: 84.8% of statements 09:10:00 FAIL github.com/edgexfoundry/edgex-go/internal/support/notifications [build failed] 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/support/notifications/operators/notification 0.050s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/support/notifications/operators/subscription 0.047s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/support/notifications/v2/application 0.049s coverage: 10.5% of statements 09:10:00 FAIL github.com/edgexfoundry/edgex-go/internal/support/notifications/v2/controller/http [build failed] 09:10:00 FAIL github.com/edgexfoundry/edgex-go/internal/support/scheduler [build failed] 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/support/scheduler/operators/interval 0.076s coverage: 99.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/support/scheduler/operators/intervalaction 0.066s coverage: 100.0% of statements 09:10:00 FAIL github.com/edgexfoundry/edgex-go/internal/support/scheduler/v2/application/scheduler [build failed] 09:10:00 FAIL github.com/edgexfoundry/edgex-go/internal/support/scheduler/v2/controller/http [build failed] 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/system 0.028s coverage: 0.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/system/agent/clients 0.038s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/system/agent/executor 0.045s coverage: 87.9% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/system/agent/response 0.033s coverage: 100.0% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/system/agent/setconfig 0.054s coverage: 28.1% of statements 09:10:00 ok github.com/edgexfoundry/edgex-go/internal/system/executor 0.044s coverage: 100.0% of statements 09:10:00 make: *** [Makefile:94: test] Error 2 [Pipeline] } 09:10:00 $ docker stop --time=1 5ce49060d6831be53f9cc81c2f5c9d17a1535859b4b4ef8d642de67098d4d83d 09:10:00 Running on prd-ubuntu18.04-docker-arm64-4c-16g-468 in /w/workspace/edgexfoundry_edgex-go_PR-3356 09:10:02 $ docker rm -f 5ce49060d6831be53f9cc81c2f5c9d17a1535859b4b4ef8d642de67098d4d83d [Pipeline] { [Pipeline] // withDockerContainer [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] ws 09:10:03 Running in /w/workspace/edgex-go/13 [Pipeline] { [Pipeline] // stage [Pipeline] stage [Pipeline] { (Docker Build) [Pipeline] checkout Stage "Docker Build" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Docker Push) Stage "Docker Push" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Snap) Stage "Snap" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // stage [Pipeline] } 09:10:03 Failed in branch amd64 09:10:08 using credential edgex-jenkins-ssh 09:10:08 Cloning the remote Git repository 09:10:08 Cloning repository git@github.com:edgexfoundry/edgex-go.git 09:10:08 > git init /w/workspace/edgex-go/13 # timeout=10 09:10:08 Fetching upstream changes from git@github.com:edgexfoundry/edgex-go.git 09:10:08 > git --version # timeout=10 09:10:08 > git --version # 'git version 2.17.1' 09:10:08 using GIT_SSH to set credentials SSH Credentials for GitHub 09:10:08 > git fetch --tags --progress -- git@github.com:edgexfoundry/edgex-go.git +refs/heads/*:refs/remotes/origin/* # timeout=10 09:10:36 Merging remotes/origin/master commit c419618f783e51adc3e0be9d68d8defacfb69d2d into PR head commit 429abc1cb4aa7afc2083fdf669ed664eedfe3383 09:10:36 Merge succeeded, producing 429abc1cb4aa7afc2083fdf669ed664eedfe3383 09:10:36 Checking out Revision 429abc1cb4aa7afc2083fdf669ed664eedfe3383 (PR-3356) 09:10:35 > git config remote.origin.url git@github.com:edgexfoundry/edgex-go.git # timeout=10 09:10:35 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 09:10:35 > git config remote.origin.url git@github.com:edgexfoundry/edgex-go.git # timeout=10 09:10:35 Fetching upstream changes from git@github.com:edgexfoundry/edgex-go.git 09:10:35 using GIT_SSH to set credentials SSH Credentials for GitHub 09:10:35 > git fetch --tags --progress -- git@github.com:edgexfoundry/edgex-go.git +refs/pull/3356/head:refs/remotes/origin/PR-3356 +refs/heads/master:refs/remotes/origin/master # timeout=10 09:10:36 > git config core.sparsecheckout # timeout=10 09:10:36 > git checkout -f 429abc1cb4aa7afc2083fdf669ed664eedfe3383 # timeout=10 09:10:36 > git remote # timeout=10 09:10:36 > git config --get remote.origin.url # timeout=10 09:10:36 using GIT_SSH to set credentials SSH Credentials for GitHub 09:10:36 > git merge c419618f783e51adc3e0be9d68d8defacfb69d2d # timeout=10 09:10:36 > git rev-parse HEAD^{commit} # timeout=10 09:10:36 > git config core.sparsecheckout # timeout=10 09:10:36 > git checkout -f 429abc1cb4aa7afc2083fdf669ed664eedfe3383 # timeout=10 09:10:40 Commit message: "feat: Add unit test for scheduler manager" [Pipeline] withEnv [Pipeline] { [Pipeline] withEnv [Pipeline] { [Pipeline] stage [Pipeline] { (Prep) [Pipeline] script [Pipeline] { [Pipeline] sh 09:10:42 + sudo jq . + {"registry-mirrors": ["https://nexus3.edgexfoundry.org:10001"], debug: false} /etc/docker/daemon.json [Pipeline] sh 09:10:42 + sudo mv /tmp/daemon.json /etc/docker/daemon.json [Pipeline] sh 09:10:43 + true 09:10:43 + sudo service docker restart [Pipeline] withEnv [Pipeline] { [Pipeline] wrap 09:10:45 provisioning config files... 09:10:45 copy managed file [edgex-go-settings] to file:/w/workspace/edgex-go/13@tmp/config4747555740716884893tmp [Pipeline] { [Pipeline] libraryResource [Pipeline] sh 09:10:46 ---> docker-login.sh 09:10:46 nexus3.edgexfoundry.org:10001 09:10:46 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:10:47 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:10:47 Configure a credential helper to remove this warning. See 09:10:47 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:10:47 09:10:47 Login Succeeded 09:10:47 nexus3.edgexfoundry.org:10002 09:10:47 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:10:47 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:10:47 Configure a credential helper to remove this warning. See 09:10:47 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:10:47 09:10:47 Login Succeeded 09:10:47 nexus3.edgexfoundry.org:10003 09:10:48 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:10:48 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:10:48 Configure a credential helper to remove this warning. See 09:10:48 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:10:48 09:10:48 Login Succeeded 09:10:48 nexus3.edgexfoundry.org:10004 09:10:48 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:10:49 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:10:49 Configure a credential helper to remove this warning. See 09:10:49 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:10:49 09:10:49 Login Succeeded 09:10:49 docker.io 09:10:49 WARNING! Using --password via the CLI is insecure. Use --password-stdin. 09:10:49 WARNING! Your password will be stored unencrypted in /home/jenkins/.docker/config.json. 09:10:49 Configure a credential helper to remove this warning. See 09:10:49 https://docs.docker.com/engine/reference/commandline/login/#credentials-store 09:10:49 09:10:49 Login Succeeded 09:10:49 ---> docker-login.sh ends [Pipeline] } 09:10:49 Deleting 1 temporary files [Pipeline] // wrap [Pipeline] } [Pipeline] // withEnv [Pipeline] unstash [Pipeline] echo 09:10:49 ========================================================= 09:10:49 [edgeXBuildGoParallel] Building Code With image [nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base-arm64:1.15-alpine] 09:10:49 ========================================================= [Pipeline] isUnix [Pipeline] sh 09:10:50 + docker build -t ci-base-image-arm64 -f Dockerfile.build --build-arg BASE=nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base-arm64:1.15-alpine . 09:10:52 Sending build context to Docker daemon 167.3MB 09:10:52 Step 1/6 : ARG BASE=golang:1.15-alpine3.12 09:10:52 Step 2/6 : FROM ${BASE} 09:10:52 1.15-alpine: Pulling from edgex-devops/edgex-golang-base-arm64 09:10:52 5f621e34cdf4: Pulling fs layer 09:10:52 a4357932f1b6: Pulling fs layer 09:10:52 18c013af1878: Pulling fs layer 09:10:52 00ac8860ef70: Pulling fs layer 09:10:52 63d7cb157983: Pulling fs layer 09:10:52 b116817d02f9: Pulling fs layer 09:10:52 745a02a5169b: Pulling fs layer 09:10:52 00ac8860ef70: Waiting 09:10:52 63d7cb157983: Waiting 09:10:52 b116817d02f9: Waiting 09:10:52 745a02a5169b: Waiting 09:10:52 18c013af1878: Download complete 09:10:52 a4357932f1b6: Download complete 09:10:52 63d7cb157983: Download complete 09:10:52 5f621e34cdf4: Verifying Checksum 09:10:52 5f621e34cdf4: Download complete 09:10:52 b116817d02f9: Verifying Checksum 09:10:52 b116817d02f9: Download complete 09:10:53 5f621e34cdf4: Pull complete 09:10:54 a4357932f1b6: Pull complete 09:10:54 18c013af1878: Pull complete 09:10:54 745a02a5169b: Verifying Checksum 09:10:54 745a02a5169b: Download complete 09:10:56 00ac8860ef70: Verifying Checksum 09:10:56 00ac8860ef70: Download complete 09:11:06 00ac8860ef70: Pull complete 09:11:06 63d7cb157983: Pull complete 09:11:07 b116817d02f9: Pull complete 09:11:11 745a02a5169b: Pull complete 09:11:11 Digest: sha256:df689100bc6b2f2091bc50e3ab30bcbb973ead998518226adecfd27d0a642918 09:11:11 Status: Downloaded newer image for nexus3.edgexfoundry.org:10003/edgex-devops/edgex-golang-base-arm64:1.15-alpine 09:11:11 ---> b7e6874047d6 09:11:11 Step 3/6 : RUN apk add --update --no-cache make git curl bash zeromq-dev libsodium-dev pkgconfig build-base && ln -s /bin/touch /usr/bin/touch 09:11:13 ---> Running in e07074e298ac 09:11:15 fetch http://nl.alpinelinux.org/alpine/v3.12/main/aarch64/APKINDEX.tar.gz 09:11:16 fetch http://nl.alpinelinux.org/alpine/v3.12/community/aarch64/APKINDEX.tar.gz 09:11:16 (1/12) Installing libmagic (5.38-r0) 09:11:16 (2/12) Installing file (5.38-r0) 09:11:16 (3/12) Installing libc-dev (0.7.2-r3) 09:11:17 (4/12) Installing g++ (9.3.0-r2) 09:11:25 (5/12) Installing fortify-headers (1.1-r0) 09:11:25 (6/12) Installing patch (2.7.6-r6) 09:11:25 (7/12) Installing build-base (0.5-r2) 09:11:25 (8/12) Installing libsodium (1.0.18-r0) 09:11:25 (9/12) Installing pkgconf (1.7.2-r0) 09:11:25 (10/12) Installing libsodium-dev (1.0.18-r0) 09:11:25 (11/12) Installing libzmq (4.3.3-r0) 09:11:26 (12/12) Installing zeromq-dev (4.3.3-r0) 09:11:26 Executing busybox-1.31.1-r19.trigger 09:11:26 OK: 217 MiB in 51 packages 09:11:29 Removing intermediate container e07074e298ac 09:11:29 ---> d9feb36660b5 09:11:29 Step 4/6 : WORKDIR /edgex-go 09:11:29 ---> Running in f6ed7cf5b277 09:11:30 Removing intermediate container f6ed7cf5b277 09:11:30 ---> 0279c0c04651 09:11:30 Step 5/6 : COPY go.mod . 09:11:31 ---> 70705a8b6402 09:11:31 Step 6/6 : RUN go mod download 09:11:31 ---> Running in 3fe606bf7ba2 09:11:57 Removing intermediate container 3fe606bf7ba2 09:11:57 ---> 8b2128379a9e 09:11:57 Successfully built 8b2128379a9e 09:11:57 Successfully tagged ci-base-image-arm64:latest [Pipeline] isUnix [Pipeline] sh 09:11:58 + docker inspect -f . ci-base-image-arm64 09:11:58 . [Pipeline] withDockerContainer 09:11:58 prd-ubuntu18.04-docker-arm64-4c-16g-468 does not seem to be running inside a container 09:11:58 $ docker run -t -d -u 1001:1001 -u 0:0 -w /w/workspace/edgex-go/13 -v /w/workspace/edgex-go/13:/w/workspace/edgex-go/13:rw,z -v /w/workspace/edgex-go/13@tmp:/w/workspace/edgex-go/13@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** ci-base-image-arm64 cat 09:12:00 $ docker top 5905e043da8f8506d9c845f553e8b189f501e340e9aef75582aceaa60f59b15d -eo pid,comm [Pipeline] { [Pipeline] sh 09:12:00 + go version 09:12:00 go version go1.15.5 linux/arm64 [Pipeline] } 09:12:00 $ docker stop --time=1 5905e043da8f8506d9c845f553e8b189f501e340e9aef75582aceaa60f59b15d 09:12:02 $ docker rm -f 5905e043da8f8506d9c845f553e8b189f501e340e9aef75582aceaa60f59b15d [Pipeline] // withDockerContainer [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Test) [Pipeline] script [Pipeline] { [Pipeline] isUnix [Pipeline] sh 09:12:03 + docker inspect -f . ci-base-image-arm64 09:12:03 . [Pipeline] withDockerContainer 09:12:03 prd-ubuntu18.04-docker-arm64-4c-16g-468 does not seem to be running inside a container 09:12:03 $ docker run -t -d -u 1001:1001 -u 0:0 -v /var/run/docker.sock:/var/run/docker.sock --privileged -w /w/workspace/edgex-go/13 -v /w/workspace/edgex-go/13:/w/workspace/edgex-go/13:rw,z -v /w/workspace/edgex-go/13@tmp:/w/workspace/edgex-go/13@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** ci-base-image-arm64 cat 09:12:05 $ docker top e142a141f406ccd5b4f54d1aef8c0e36c4c2da8733d37c799d622d9ac0b40710 -eo pid,comm [Pipeline] { [Pipeline] echo 09:12:05 ========================================================= 09:12:05 [edgeXBuildGoParallel] Running Tests and Build... 09:12:05 ========================================================= [Pipeline] sh 09:12:06 + make test 09:12:06 GO111MODULE=on go test -race -coverprofile=coverage.out ./... 09:12:28 ? github.com/edgexfoundry/edgex-go [no test files] 09:13:01 # github.com/edgexfoundry/edgex-go/internal/pkg/v2/utils 09:13:01 internal/pkg/v2/utils/restaddress.go:77:12: address.ContentType undefined (type models.RESTAddress has no field or method ContentType) 09:13:01 internal/pkg/v2/utils/restaddress.go:78:10: address.ContentType undefined (type models.RESTAddress has no field or method ContentType) 09:13:01 internal/pkg/v2/utils/restaddress.go:80:45: address.ContentType undefined (type models.RESTAddress has no field or method ContentType) 09:13:01 internal/pkg/v2/utils/restaddress.go:83:18: undefined: clients.ContentLength 09:13:40 FAIL github.com/edgexfoundry/edgex-go/internal/core/command [build failed] 09:13:41 ok github.com/edgexfoundry/edgex-go/internal/core/command/v2/application 0.133s coverage: 19.8% of statements 09:13:41 FAIL github.com/edgexfoundry/edgex-go/internal/core/command/v2/controller/http [build failed] 09:13:41 FAIL github.com/edgexfoundry/edgex-go/internal/core/data [build failed] 09:13:42 ok github.com/edgexfoundry/edgex-go/internal/core/data/operators/reading 0.139s coverage: 100.0% of statements 09:13:42 ok github.com/edgexfoundry/edgex-go/internal/core/data/operators/value_descriptor 0.137s coverage: 100.0% of statements 09:13:42 FAIL github.com/edgexfoundry/edgex-go/internal/core/data/v2/application [build failed] 09:13:42 FAIL github.com/edgexfoundry/edgex-go/internal/core/data/v2/controller/http [build failed] 09:13:44 ok github.com/edgexfoundry/edgex-go/internal/core/data/v2/io 0.172s coverage: 78.9% of statements 09:13:44 FAIL github.com/edgexfoundry/edgex-go/internal/core/metadata [build failed] 09:13:47 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/addressable 0.219s coverage: 100.0% of statements 09:13:47 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/command 0.141s coverage: 100.0% of statements 09:13:49 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/device 0.384s coverage: 86.7% of statements 09:13:50 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/device_profile 0.421s coverage: 97.5% of statements 09:13:51 ok github.com/edgexfoundry/edgex-go/internal/core/metadata/operators/device_service 0.277s coverage: 78.3% of statements 09:13:51 FAIL github.com/edgexfoundry/edgex-go/internal/core/metadata/v2/controller/http [build failed] 09:13:51 ok github.com/edgexfoundry/edgex-go/internal/pkg/telemetry 0.121s coverage: 58.8% of statements 09:13:51 FAIL github.com/edgexfoundry/edgex-go/internal/pkg/v2/infrastructure/redis [build failed] 09:13:52 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command 0.167s coverage: 47.1% of statements 09:13:54 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/gate 1.158s coverage: 79.5% of statements 09:13:54 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/genpassword 0.124s coverage: 94.1% of statements 09:13:54 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/gethttpstatus 0.142s coverage: 96.3% of statements 09:13:56 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/help 0.150s coverage: 87.5% of statements 09:14:08 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/listen 11.159s coverage: 94.4% of statements 09:14:08 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/ping 0.120s coverage: 44.8% of statements 09:14:12 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/setupacl 13.472s coverage: 81.9% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/command/waitfor 24.202s coverage: 92.9% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/helper 0.055s coverage: 77.8% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/bootstrapper/tcp 11.069s coverage: 87.2% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/help 0.108s coverage: 100.0% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/adduser 0.155s coverage: 75.5% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/deluser 0.134s coverage: 80.8% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/jwt 0.187s coverage: 87.2% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/oauth2 0.207s coverage: 84.6% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/config/command/proxy/tls 0.252s coverage: 91.6% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/fileprovider 0.549s coverage: 64.4% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/fileprovider/mocks 0.130s coverage: 100.0% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/kdf 0.079s coverage: 91.3% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/kdf/mocks 0.058s coverage: 100.0% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/pipedhexreader 0.072s coverage: 73.7% of statements 09:14:25 ok github.com/edgexfoundry/edgex-go/internal/security/pipedhexreader/mocks 0.064s coverage: 100.0% of statements 09:14:28 ok github.com/edgexfoundry/edgex-go/internal/security/proxy 0.886s coverage: 69.0% of statements 09:14:29 ok github.com/edgexfoundry/edgex-go/internal/security/secretstore 0.425s coverage: 38.4% of statements 09:14:29 ok github.com/edgexfoundry/edgex-go/internal/security/secretstore/secretsengine 0.097s coverage: 89.5% of statements 09:14:29 ok github.com/edgexfoundry/edgex-go/internal/security/secretstore/tokenfilewriter 0.110s coverage: 84.8% of statements 09:14:29 FAIL github.com/edgexfoundry/edgex-go/internal/support/notifications [build failed] 09:14:32 ok github.com/edgexfoundry/edgex-go/internal/support/notifications/operators/notification 0.144s coverage: 100.0% of statements 09:14:32 ok github.com/edgexfoundry/edgex-go/internal/support/notifications/operators/subscription 0.112s coverage: 100.0% of statements 09:14:32 ok github.com/edgexfoundry/edgex-go/internal/support/notifications/v2/application 0.139s coverage: 10.5% of statements 09:14:32 FAIL github.com/edgexfoundry/edgex-go/internal/support/notifications/v2/controller/http [build failed] 09:14:32 FAIL github.com/edgexfoundry/edgex-go/internal/support/scheduler [build failed] 09:14:36 ok github.com/edgexfoundry/edgex-go/internal/support/scheduler/operators/interval 0.201s coverage: 99.0% of statements 09:14:36 ok github.com/edgexfoundry/edgex-go/internal/support/scheduler/operators/intervalaction 0.155s coverage: 100.0% of statements 09:14:36 FAIL github.com/edgexfoundry/edgex-go/internal/support/scheduler/v2/application/scheduler [build failed] 09:14:36 FAIL github.com/edgexfoundry/edgex-go/internal/support/scheduler/v2/controller/http [build failed] 09:14:36 ok github.com/edgexfoundry/edgex-go/internal/system 0.047s coverage: 0.0% of statements 09:14:36 ok github.com/edgexfoundry/edgex-go/internal/system/agent/clients 0.064s coverage: 100.0% of statements 09:14:36 ok github.com/edgexfoundry/edgex-go/internal/system/agent/executor 0.080s coverage: 87.9% of statements 09:14:38 ok github.com/edgexfoundry/edgex-go/internal/system/agent/response 0.054s coverage: 100.0% of statements 09:14:38 ok github.com/edgexfoundry/edgex-go/internal/system/agent/setconfig 0.105s coverage: 28.1% of statements 09:14:39 ok github.com/edgexfoundry/edgex-go/internal/system/executor 0.078s coverage: 100.0% of statements 09:14:39 make: *** [Makefile:94: test] Error 2 [Pipeline] } 09:14:39 $ docker stop --time=1 e142a141f406ccd5b4f54d1aef8c0e36c4c2da8733d37c799d622d9ac0b40710 09:14:42 $ docker rm -f e142a141f406ccd5b4f54d1aef8c0e36c4c2da8733d37c799d622d9ac0b40710 [Pipeline] // withDockerContainer [Pipeline] } [Pipeline] // script [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Docker Build) Stage "Docker Build" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Docker Push) Stage "Docker Push" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage Post stage [Pipeline] libraryResource [Pipeline] sh 09:14:43 ---> job-cost.sh 09:14:43 lf-activate-venv(): INFO: Creating python3 venv at /tmp/venv-FPO6 09:15:22 lf-activate-venv(): INFO: Installing: zipp==1.1.0 python-openstackclient 09:16:59 lf-activate-venv(): INFO: Adding /tmp/venv-FPO6/bin to PATH 09:16:59 INFO: No Stack... 09:16:59 INFO: Retrieving Pricing Info for: lf-standard-4 09:16:59 INFO: Archiving Costs [Pipeline] sh 09:16:59 + cat /w/workspace/edgex-go/13/archives/cost.csv 09:16:59 + cut -d, -f6 [Pipeline] lock 09:17:00 Trying to acquire lock on [jenkins-edgexfoundry-edgex-go-PR-3356-13-stack-cost] 09:17:00 Resource [jenkins-edgexfoundry-edgex-go-PR-3356-13-stack-cost] did not exist. Created. 09:17:00 Lock acquired on [jenkins-edgexfoundry-edgex-go-PR-3356-13-stack-cost] [Pipeline] { [Pipeline] unstash [Pipeline] sh 09:17:00 + echo total: 0.20999999344348907 [Pipeline] stash 09:17:01 Stashed 1 file(s) [Pipeline] } 09:17:01 Lock released on resource [jenkins-edgexfoundry-edgex-go-PR-3356-13-stack-cost] [Pipeline] // lock [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // withEnv [Pipeline] } [Pipeline] // ws [Pipeline] } [Pipeline] // node [Pipeline] } [Pipeline] // stage [Pipeline] } 09:17:01 Failed in branch arm64 [Pipeline] // parallel [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (CodeCov) Stage "CodeCov" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Snyk Scan) Stage "Snyk Scan" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Publish Swagger) Stage "Publish Swagger" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Semver) Stage "Semver" skipped due to earlier failure(s) [Pipeline] stage [Pipeline] { (Tag) Stage "Semver" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Bump Pre-Release Version) Stage "Semver" skipped due to earlier failure(s) [Pipeline] } [Pipeline] // stage [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] stage [Pipeline] { (LF Post Build Actions) [Pipeline] libraryResource [Pipeline] sh 09:17:02 ---> sysstat.sh [Pipeline] libraryResource [Pipeline] sh 09:17:03 ---> package-listing.sh 09:17:03 ++ facter osfamily 09:17:03 ++ tr '[:upper:]' '[:lower:]' 09:17:03 + OS_FAMILY=redhat 09:17:03 + workspace=/w/workspace/edgex-go/13 09:17:03 + START_PACKAGES=/tmp/packages_start.txt 09:17:03 + END_PACKAGES=/tmp/packages_end.txt 09:17:03 + DIFF_PACKAGES=/tmp/packages_diff.txt 09:17:03 + PACKAGES=/tmp/packages_start.txt 09:17:03 + '[' /w/workspace/edgex-go/13 ']' 09:17:03 + PACKAGES=/tmp/packages_end.txt 09:17:03 + case "${OS_FAMILY}" in 09:17:03 + rpm -qa 09:17:03 + sort 09:17:08 + '[' -f /tmp/packages_start.txt ']' 09:17:08 + '[' -f /tmp/packages_end.txt ']' 09:17:08 + diff /tmp/packages_start.txt /tmp/packages_end.txt 09:17:08 + '[' /w/workspace/edgex-go/13 ']' 09:17:08 + mkdir -p /w/workspace/edgex-go/13/archives/ 09:17:08 + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/edgex-go/13/archives/ [Pipeline] echo 09:17:08 Launching container with: [--privileged -u 0:0 --net host -v /var/log/sa:/var/log/sa-host -v /var/log/secure:/var/log/secure -v /var/log/auth.log:/var/log/auth.log -v /w/workspace/edgex-go/13/facter-os:/facter-os -v /proc/uptime:/proc/uptime -v /run/cloud-init/result.json:/run/cloud-init/result.json] [Pipeline] sh 09:17:09 + facter operatingsystem [Pipeline] isUnix [Pipeline] sh 09:17:09 + docker inspect -f . nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine 09:17:09 09:17:09 Error: No such object: nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [Pipeline] isUnix [Pipeline] sh 09:17:09 + docker pull nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine 09:17:09 alpine: Pulling from edgex-lftools-log-publisher 09:17:09 df20fa9351a1: Pulling fs layer 09:17:09 36b3adc4ff6f: Pulling fs layer 09:17:09 8ad3a11d3b57: Pulling fs layer 09:17:09 46f8f816bc3b: Pulling fs layer 09:17:09 93b61091891f: Pulling fs layer 09:17:09 93b9cdb0e59b: Pulling fs layer 09:17:09 5e14af77c1be: Pulling fs layer 09:17:09 01666e4c0597: Pulling fs layer 09:17:09 aa168da1d23b: Pulling fs layer 09:17:09 46f8f816bc3b: Waiting 09:17:09 93b61091891f: Waiting 09:17:09 01666e4c0597: Waiting 09:17:09 93b9cdb0e59b: Waiting 09:17:09 5e14af77c1be: Waiting 09:17:09 aa168da1d23b: Waiting 09:17:09 36b3adc4ff6f: Verifying Checksum 09:17:09 36b3adc4ff6f: Download complete 09:17:10 46f8f816bc3b: Verifying Checksum 09:17:10 46f8f816bc3b: Download complete 09:17:10 df20fa9351a1: Verifying Checksum 09:17:10 df20fa9351a1: Download complete 09:17:10 93b9cdb0e59b: Verifying Checksum 09:17:10 93b9cdb0e59b: Download complete 09:17:10 93b61091891f: Verifying Checksum 09:17:10 93b61091891f: Download complete 09:17:10 5e14af77c1be: Verifying Checksum 09:17:10 5e14af77c1be: Download complete 09:17:10 01666e4c0597: Verifying Checksum 09:17:10 01666e4c0597: Download complete 09:17:10 df20fa9351a1: Pull complete 09:17:10 8ad3a11d3b57: Verifying Checksum 09:17:10 8ad3a11d3b57: Download complete 09:17:10 36b3adc4ff6f: Pull complete 09:17:11 8ad3a11d3b57: Pull complete 09:17:11 46f8f816bc3b: Pull complete 09:17:11 93b61091891f: Pull complete 09:17:12 93b9cdb0e59b: Pull complete 09:17:12 5e14af77c1be: Pull complete 09:17:12 01666e4c0597: Pull complete 09:17:13 aa168da1d23b: Verifying Checksum 09:17:13 aa168da1d23b: Download complete 09:17:19 aa168da1d23b: Pull complete 09:17:19 Digest: sha256:ac41798234670a79351fc13b8232b4dbeccc6fb1f122f5db5169d11b1762ca7c 09:17:19 Status: Downloaded newer image for nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine 09:17:19 nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [Pipeline] withDockerContainer 09:17:19 prd-centos7-docker-4c-2g-467 does not seem to be running inside a container 09:17:19 $ docker run -t -d -u 1001:1001 --privileged -u 0:0 --net host -v /var/log/sa:/var/log/sa-host -v /var/log/secure:/var/log/secure -v /var/log/auth.log:/var/log/auth.log -v /w/workspace/edgex-go/13/facter-os:/facter-os -v /proc/uptime:/proc/uptime -v /run/cloud-init/result.json:/run/cloud-init/result.json -w /w/workspace/edgex-go/13 -v /w/workspace/edgex-go/13:/w/workspace/edgex-go/13:rw,z -v /w/workspace/edgex-go/13@tmp:/w/workspace/edgex-go/13@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine cat 09:17:24 $ docker top 5d1d8a47bfdfba7e5045325528087b71cb26e75c7a51773993df37f06be1bfed -eo pid,comm [Pipeline] { [Pipeline] sh 09:17:24 + touch /tmp/pre-build-complete [Pipeline] sh 09:17:25 + mkdir -p /var/log/sa [Pipeline] sh 09:17:25 + ls /var/log/sa-host 09:17:25 + sadf -c /var/log/sa-host/sa16 09:17:25 file_magic: OK 09:17:25 HZ: Using current value: 100 09:17:25 file_header: OK 09:17:25 file_activity: A_CPU A_PCSW A_SWAP A_PAGE A_IO A_MEMORY A_HUGE A_KTABLES A_QUEUE A_SERIAL A_DISK A_NET_DEV A_NET_EDEV A_NET_NFS A_NET_NFSD A_NET_SOCK OK 09:17:25 Statistics: 09:17:25 HRHnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu... 09:17:25 File successfully converted to sysstat format version 12.2.1 09:17:25 + sadf -c /var/log/sa-host/sa23 09:17:25 file_magic: OK 09:17:25 HZ: Using current value: 100 09:17:25 file_header: OK 09:17:25 file_activity: A_CPU A_PCSW A_SWAP A_PAGE A_IO A_MEMORY A_HUGE A_KTABLES A_QUEUE A_SERIAL A_DISK A_NET_DEV A_NET_EDEV A_NET_NFS A_NET_NFSD A_NET_SOCK OK 09:17:25 Statistics: 09:17:25 Hnuu...uuuununununu... 09:17:25 File successfully converted to sysstat format version 12.2.1 [Pipeline] withEnv [Pipeline] { [Pipeline] configFileProvider 09:17:25 provisioning config files... 09:17:25 copy managed file [jenkins-log-archives-settings] to file:/w/workspace/edgex-go/13@tmp/config6600113169530754311tmp [Pipeline] { [Pipeline] echo 09:17:25 Running shell/create-netrc.sh [Pipeline] libraryResource [Pipeline] sh 09:17:26 ---> create-netrc.sh [Pipeline] } 09:17:26 Deleting 1 temporary files [Pipeline] // configFileProvider [Pipeline] echo 09:17:26 Running shell/python-tools-install.sh [Pipeline] libraryResource [Pipeline] sh 09:17:26 ---> python-tools-install.sh [Pipeline] echo 09:17:26 Running shell/sudo-logs.sh [Pipeline] libraryResource [Pipeline] sh 09:17:26 ---> sudo-logs.sh 09:17:26 Archiving 'sudo' log.. [Pipeline] unstash [Pipeline] echo 09:17:26 Running shell/job-cost.sh [Pipeline] libraryResource [Pipeline] sh 09:17:27 ---> job-cost.sh 09:17:27 lf-activate-venv: SKIPPING 09:17:27 DEBUG: total: 0.20999999344348907 09:17:27 INFO: Retrieving Stack Cost... 09:17:28 INFO: Retrieving Pricing Info for: v1-standard-2 09:17:28 INFO: Archiving Costs [Pipeline] echo 09:17:28 Running shell/logs-deploy.sh [Pipeline] libraryResource [Pipeline] sh 09:17:29 ---> logs-deploy.sh 09:17:29 lf-activate-venv: SKIPPING 09:17:29 INFO: Nexus URL https://nexus.edgexfoundry.org path production/vex-yul-edgex-jenkins-1/edgexfoundry/edgex-go/PR-3356/13 09:17:29 INFO: archiving workspace using pattern(s): 09:17:30 Archives upload complete. 09:17:30 INFO: archiving logs to Nexus 09:17:32 ---> uname -a: 09:17:32 Linux prd-centos7-docker-4c-2g-467.vexxhost.local 3.10.0-1160.6.1.el7.x86_64 #1 SMP Tue Nov 17 13:59:11 UTC 2020 x86_64 Linux 09:17:32 09:17:32 09:17:32 ---> lscpu: 09:17:32 Architecture: x86_64 09:17:32 CPU op-mode(s): 32-bit, 64-bit 09:17:32 Byte Order: Little Endian 09:17:32 Address sizes: 40 bits physical, 48 bits virtual 09:17:32 CPU(s): 4 09:17:32 On-line CPU(s) list: 0-3 09:17:32 Thread(s) per core: 1 09:17:32 Core(s) per socket: 1 09:17:32 Socket(s): 4 09:17:32 NUMA node(s): 1 09:17:32 Vendor ID: GenuineIntel 09:17:32 CPU family: 6 09:17:32 Model: 44 09:17:32 Model name: Westmere E56xx/L56xx/X56xx (IBRS update) 09:17:32 Stepping: 1 09:17:32 CPU MHz: 2933.436 09:17:32 BogoMIPS: 5866.87 09:17:32 Virtualization: VT-x 09:17:32 Hypervisor vendor: KVM 09:17:32 Virtualization type: full 09:17:32 L1d cache: 128 KiB 09:17:32 L1i cache: 128 KiB 09:17:32 L2 cache: 16 MiB 09:17:32 L3 cache: 64 MiB 09:17:32 NUMA node0 CPU(s): 0-3 09:17:32 Vulnerability Itlb multihit: KVM: Mitigation: Split huge pages 09:17:32 Vulnerability L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT disabled 09:17:32 Vulnerability Mds: Vulnerable: Clear CPU buffers attempted, no microcode; SMT Host state unknown 09:17:32 Vulnerability Meltdown: Mitigation; PTI 09:17:32 Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp 09:17:32 Vulnerability Spectre v1: Mitigation; Load fences, usercopy/swapgs barriers and __user pointer sanitization 09:17:32 Vulnerability Spectre v2: Mitigation; Full retpoline, IBPB 09:17:32 Vulnerability Srbds: Not affected 09:17:32 Vulnerability Tsx async abort: Not affected 09:17:32 Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc rep_good nopl xtopology eagerfpu pni pclmulqdq vmx ssse3 cx16 pcid sse4_1 sse4_2 x2apic popcnt tsc_deadline_timer aes hypervisor lahf_lm ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid tsc_adjust arat spec_ctrl intel_stibp 09:17:32 09:17:32 09:17:32 ---> nproc: 09:17:32 4 09:17:32 09:17:32 09:17:32 ---> df -h: 09:17:32 Filesystem Size Used Available Use% Mounted on 09:17:32 overlay 50.0G 8.2G 41.7G 16% / 09:17:32 tmpfs 64.0M 0 64.0M 0% /dev 09:17:32 tmpfs 918.7M 0 918.7M 0% /sys/fs/cgroup 09:17:32 shm 64.0M 0 64.0M 0% /dev/shm 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /facter-os 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /etc/resolv.conf 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /etc/hostname 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /etc/hosts 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /run/cloud-init/result.json 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /var/log/sa-host 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /var/log/secure 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /var/log/auth.log 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /w/workspace/edgex-go/13@tmp 09:17:32 /dev/vda1 50.0G 8.2G 41.7G 16% /w/workspace/edgex-go/13 09:17:32 09:17:32 09:17:32 ---> free -m: 09:17:32 total used free shared buff/cache available 09:17:32 Mem: 1837 786 139 0 910 958 09:17:32 Swap: 1023 3 1020 09:17:32 09:17:32 09:17:32 ---> ip addr: 09:17:32 1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1000 09:17:32 link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 09:17:32 inet 127.0.0.1/8 scope host lo 09:17:32 valid_lft forever preferred_lft forever 09:17:32 inet6 ::1/128 scope host 09:17:32 valid_lft forever preferred_lft forever 09:17:32 2: eth0: mtu 1458 qdisc pfifo_fast state UP qlen 1000 09:17:32 link/ether fa:16:3e:70:25:8f brd ff:ff:ff:ff:ff:ff 09:17:32 inet 10.30.123.186/23 brd 10.30.123.255 scope global dynamic eth0 09:17:32 valid_lft 85750sec preferred_lft 85750sec 09:17:32 inet6 fe80::f816:3eff:fe70:258f/64 scope link 09:17:32 valid_lft forever preferred_lft forever 09:17:32 3: docker0: mtu 1500 qdisc noqueue state DOWN 09:17:32 link/ether 02:42:ef:46:4f:10 brd ff:ff:ff:ff:ff:ff 09:17:32 inet 10.250.0.254/24 brd 10.250.0.255 scope global docker0 09:17:32 valid_lft forever preferred_lft forever 09:17:32 inet6 fe80::42:efff:fe46:4f10/64 scope link 09:17:32 valid_lft forever preferred_lft forever 09:17:32 09:17:32 09:17:32 ---> sar -b -r -n DEV: 09:17:32 Linux 3.10.0-1160.6.1.el7.x86_64 (centos-7-docker-5fbc1798-0377-b841-54c3-72bc41eda64a.vexxhost.lo) 04/16/21 _x86_64_ (4 CPU) 09:17:32 09:17:32 09:06:30 LINUX RESTART (4 CPU) 09:17:32 09:17:32 09:07:01 tps rtps wtps dtps bread/s bwrtn/s bdscd/s 09:17:32 09:08:01 134.89 58.64 76.24 0.00 9748.79 25583.13 0.00 09:17:32 09:09:01 342.53 145.64 196.89 0.00 6451.94 46547.26 0.00 09:17:32 09:10:01 123.51 40.70 82.81 0.00 2124.19 9915.66 0.00 09:17:32 09:11:01 11.92 1.96 9.96 0.00 255.48 992.19 0.00 09:17:32 09:12:01 0.18 0.00 0.18 0.00 0.00 1.70 0.00 09:17:32 09:13:01 1.32 0.93 0.38 0.00 50.77 5.68 0.00 09:17:32 09:14:01 0.35 0.00 0.35 0.00 0.00 3.36 0.00 09:17:32 09:15:01 0.38 0.00 0.38 0.00 0.00 4.45 0.00 09:17:32 09:16:01 0.30 0.00 0.30 0.00 0.00 3.10 0.00 09:17:32 09:17:01 0.25 0.00 0.25 0.00 0.00 2.48 0.00 09:17:32 Average: 61.15 24.61 36.54 0.00 1857.03 8250.03 0.00 09:17:32 09:17:32 09:07:01 kbmemfree kbavail kbmemused %memused kbbuffers kbcached kbcommit %commit kbactive kbinact kbdirty 09:17:32 09:08:01 67676 0 706124 37.53 2596 1105148 1480196 50.52 715632 891272 83824 09:17:32 09:09:01 164096 0 817792 43.46 1492 898164 1743348 59.50 602524 834860 29036 09:17:32 09:10:01 374316 0 767312 40.78 620 739296 1398664 47.73 504636 715024 24080 09:17:32 09:11:01 534220 0 716312 38.07 620 630392 1083972 36.99 480512 596040 12 09:17:32 09:12:01 539444 0 711080 37.79 620 630400 1071624 36.57 482088 593204 8 09:17:32 09:13:01 537544 0 711468 37.81 620 631912 1071696 36.58 479376 597816 12 09:17:32 09:14:01 537864 0 711148 37.80 620 631912 1071624 36.57 479012 597816 8 09:17:32 09:15:01 538020 0 710984 37.79 620 631920 1071624 36.57 479004 597824 8 09:17:32 09:16:01 538044 0 710956 37.79 620 631924 1071624 36.57 479132 597824 8 09:17:32 09:17:01 538020 0 710916 37.78 620 631988 1071624 36.57 479000 597840 24 09:17:32 Average: 436924 0 727409 38.66 905 716306 1213600 41.42 518092 661952 13702 09:17:32 09:17:32 09:07:01 IFACE rxpck/s txpck/s rxkB/s txkB/s rxcmp/s txcmp/s rxmcst/s %ifutil 09:17:32 09:08:01 eth0 1536.88 924.21 6383.24 167.93 0.00 0.00 0.00 0.00 09:17:32 09:08:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:08:01 docker0 306.45 504.92 42.59 2654.92 0.00 0.00 0.00 0.00 09:17:32 09:09:01 veth72b86c2 0.00 0.12 0.00 0.01 0.00 0.00 0.00 0.00 09:17:32 09:09:01 eth0 519.67 411.40 3733.62 60.02 0.00 0.00 0.00 0.00 09:17:32 09:09:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:09:01 docker0 159.28 216.45 11.00 844.94 0.00 0.00 0.00 0.00 09:17:32 09:10:01 veth72b86c2 1.65 1.66 0.13 0.13 0.00 0.00 0.00 0.00 09:17:32 09:10:01 eth0 23.79 12.30 18.90 8.83 0.00 0.00 0.00 0.00 09:17:32 09:10:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:10:01 docker0 1.65 1.65 0.11 0.13 0.00 0.00 0.00 0.00 09:17:32 09:11:01 eth0 1.78 1.23 1.46 0.60 0.00 0.00 0.00 0.00 09:17:32 09:11:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:11:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:12:01 eth0 0.10 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:17:32 09:12:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:12:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:13:01 eth0 0.30 0.27 0.14 0.08 0.00 0.00 0.00 0.00 09:17:32 09:13:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:13:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:14:01 eth0 0.10 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:17:32 09:14:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:14:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:15:01 eth0 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:17:32 09:15:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:15:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:16:01 eth0 0.08 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:17:32 09:16:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:16:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:17:01 eth0 0.13 0.08 0.01 0.01 0.00 0.00 0.00 0.00 09:17:32 09:17:01 lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 09:17:01 docker0 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 Average: eth0 207.94 134.64 1010.10 23.71 0.00 0.00 0.00 0.00 09:17:32 Average: lo 0.00 0.00 0.00 0.00 0.00 0.00 0.00 0.00 09:17:32 Average: docker0 46.59 72.12 5.36 349.46 0.00 0.00 0.00 0.00 09:17:32 09:17:32 09:17:32 ---> sar -P ALL: 09:17:32 Linux 3.10.0-1160.6.1.el7.x86_64 (centos-7-docker-5fbc1798-0377-b841-54c3-72bc41eda64a.vexxhost.lo) 04/16/21 _x86_64_ (4 CPU) 09:17:32 09:17:32 09:06:30 LINUX RESTART (4 CPU) 09:17:32 09:17:32 09:07:01 CPU %user %nice %system %iowait %steal %idle 09:17:32 09:08:01 all 21.76 0.00 6.34 2.24 0.20 69.46 09:17:32 09:08:01 0 16.49 0.00 9.31 4.39 0.17 69.63 09:17:32 09:08:01 1 21.41 0.00 5.71 1.56 0.21 71.12 09:17:32 09:08:01 2 25.56 0.00 5.17 2.06 0.19 67.03 09:17:32 09:08:01 3 23.51 0.00 5.22 0.99 0.22 70.06 09:17:32 09:09:01 all 14.43 0.00 9.48 6.01 0.27 69.80 09:17:32 09:09:01 0 13.21 0.00 9.35 2.92 0.30 74.21 09:17:32 09:09:01 1 14.60 0.00 9.35 6.58 0.28 69.19 09:17:32 09:09:01 2 14.30 0.00 10.18 6.50 0.24 68.78 09:17:32 09:09:01 3 15.61 0.00 9.04 8.04 0.26 67.04 09:17:32 09:10:01 all 48.33 0.00 11.45 3.20 0.20 36.82 09:17:32 09:10:01 0 48.86 0.00 11.39 2.73 0.21 36.81 09:17:32 09:10:01 1 47.55 0.00 11.70 2.89 0.21 37.65 09:17:32 09:10:01 2 48.63 0.00 11.02 4.14 0.18 36.03 09:17:32 09:10:01 3 48.28 0.00 11.70 3.02 0.19 36.81 09:17:32 09:11:01 all 0.23 0.00 0.25 0.28 0.00 99.23 09:17:32 09:11:01 0 0.10 0.00 0.22 1.07 0.00 98.61 09:17:32 09:11:01 1 0.60 0.00 0.22 0.02 0.02 99.15 09:17:32 09:11:01 2 0.12 0.00 0.30 0.02 0.00 99.57 09:17:32 09:11:01 3 0.10 0.00 0.27 0.03 0.00 99.60 09:17:32 09:12:01 all 0.11 0.00 0.05 0.00 0.00 99.84 09:17:32 09:12:01 0 0.07 0.00 0.07 0.00 0.00 99.87 09:17:32 09:12:01 1 0.33 0.00 0.05 0.00 0.02 99.60 09:17:32 09:12:01 2 0.02 0.00 0.05 0.00 0.00 99.93 09:17:32 09:12:01 3 0.02 0.00 0.03 0.00 0.00 99.95 09:17:32 09:13:01 all 0.16 0.00 0.04 0.00 0.01 99.78 09:17:32 09:13:01 0 0.03 0.00 0.07 0.02 0.02 99.87 09:17:32 09:13:01 1 0.53 0.00 0.03 0.00 0.02 99.42 09:17:32 09:13:01 2 0.05 0.00 0.05 0.00 0.02 99.88 09:17:32 09:13:01 3 0.02 0.00 0.02 0.00 0.00 99.97 09:17:32 09:14:01 all 0.15 0.00 0.03 0.00 0.00 99.81 09:17:32 09:14:01 0 0.03 0.00 0.05 0.00 0.00 99.92 09:17:32 09:14:01 1 0.52 0.00 0.03 0.00 0.00 99.45 09:17:32 09:14:01 2 0.03 0.00 0.03 0.00 0.00 99.93 09:17:32 09:14:01 3 0.02 0.00 0.02 0.00 0.02 99.95 09:17:32 09:15:01 all 0.15 0.00 0.03 0.00 0.00 99.81 09:17:32 09:15:01 0 0.05 0.00 0.03 0.00 0.00 99.92 09:17:32 09:15:01 1 0.50 0.00 0.02 0.00 0.00 99.48 09:17:32 09:15:01 2 0.02 0.00 0.03 0.00 0.00 99.95 09:17:32 09:15:01 3 0.05 0.00 0.05 0.00 0.00 99.90 09:17:32 09:16:01 all 0.15 0.00 0.03 0.00 0.00 99.83 09:17:32 09:16:01 0 0.02 0.00 0.02 0.00 0.00 99.97 09:17:32 09:16:01 1 0.52 0.00 0.02 0.00 0.00 99.47 09:17:32 09:16:01 2 0.02 0.00 0.03 0.00 0.00 99.95 09:17:32 09:16:01 3 0.03 0.00 0.03 0.00 0.00 99.93 09:17:32 09:17:01 all 0.15 0.00 0.03 0.00 0.00 99.82 09:17:32 09:17:01 0 0.52 0.00 0.03 0.00 0.00 99.45 09:17:32 09:17:01 1 0.02 0.00 0.02 0.00 0.00 99.97 09:17:32 09:17:01 2 0.03 0.00 0.02 0.00 0.00 99.95 09:17:32 09:17:01 3 0.05 0.00 0.05 0.00 0.00 99.90 09:17:32 Average: all 8.29 0.00 2.69 1.14 0.07 87.83 09:17:32 Average: 0 7.66 0.00 2.95 1.08 0.07 88.24 09:17:32 Average: 1 8.39 0.00 2.63 1.07 0.07 87.85 09:17:32 Average: 2 8.61 0.00 2.61 1.23 0.06 87.50 09:17:32 Average: 3 8.50 0.00 2.56 1.16 0.07 87.71 09:17:32 09:17:32 09:17:32