cherrycl commented: recheck Connecting to https://api.github.com using edgex-jenkins/****** (edgex-jenkins github personal access token) Connecting to https://api.github.com to check permissions of obtain list of lenny-intel for edgexfoundry/edgex-compose Obtained Jenkinsfile from e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0+0c62883c3eba94d12c26bcf9c8a04b4abf9fe530 (78128ce0382f482cd758cc7db77a95ffebe858ef) Running in Durability level: PERFORMANCE_OPTIMIZED Loading library edgex-global-pipelines@stable Attempting to resolve stable from remote references... > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git ls-remote -h -t -- git@github.com:edgexfoundry/edgex-global-pipelines.git # timeout=10 Found match: refs/tags/stable revision aa25fb65c2461e649b1a162fbf19ec71f4863fbd Resolving tag commit... (remote references may be a lightweight tag or an annotated tag) > git rev-parse --is-inside-work-tree # timeout=10 Setting origin to git@github.com:edgexfoundry/edgex-global-pipelines.git > git config remote.origin.url git@github.com:edgexfoundry/edgex-global-pipelines.git # timeout=10 Fetching origin... Fetching upstream changes from origin > git --version # timeout=10 > git --version # 'git version 2.16.6' > git config --get remote.origin.url # timeout=10 using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --progress -- origin +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/tags/stable^{commit} # timeout=10 Resolved tag stable revision aa25fb65c2461e649b1a162fbf19ec71f4863fbd using credential edgex-jenkins-ssh > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@github.com:edgexfoundry/edgex-global-pipelines.git # timeout=10 Fetching with tags Fetching upstream changes from git@github.com:edgexfoundry/edgex-global-pipelines.git > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --progress -- git@github.com:edgexfoundry/edgex-global-pipelines.git +refs/pull/*:refs/remotes/origin/pr/* # timeout=10 Checking out Revision aa25fb65c2461e649b1a162fbf19ec71f4863fbd (stable) > git config core.sparsecheckout # timeout=10 > git checkout -f aa25fb65c2461e649b1a162fbf19ec71f4863fbd # timeout=10 Commit message: "Merge pull request #336 from ernestojeda/golang-1.16" > git remote # timeout=10 > git submodule init # timeout=10 > git submodule sync # timeout=10 > git config --get remote.origin.url # timeout=10 > git submodule init # timeout=10 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 > git config --get submodule.global-jjb.url # timeout=10 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 > git submodule update --init --recursive global-jjb # timeout=10 Excluding src/test/ from checkout of git git@github.com:edgexfoundry/edgex-global-pipelines.git so that shared library test code cannot be accessed by Pipelines. To remove this log message, move the test code outside of src/. To restore the previous behavior that allowed access to files in src/test/, pass -Dorg.jenkinsci.plugins.workflow.libs.SCMSourceRetriever.INCLUDE_SRC_TEST_IN_LIBRARIES=true to the java command used to start Jenkins. Loading library lf-pipelines@master Attempting to resolve master from remote references... > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git ls-remote -h -- git@github.com:lfit/releng-pipelines.git # timeout=10 Found match: refs/heads/master revision 46d8313d362d7075c0f562900eedc504c24ea18a using credential edgex-jenkins-ssh > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url git@github.com:lfit/releng-pipelines.git # timeout=10 Fetching without tags Fetching upstream changes from git@github.com:lfit/releng-pipelines.git > git --version # timeout=10 > git --version # 'git version 2.16.6' using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --no-tags --progress -- git@github.com:lfit/releng-pipelines.git +refs/heads/*:refs/remotes/origin/* # timeout=10 Checking out Revision 46d8313d362d7075c0f562900eedc504c24ea18a (master) > git config core.sparsecheckout # timeout=10 > git checkout -f 46d8313d362d7075c0f562900eedc504c24ea18a # timeout=10 Commit message: "Fix lfParallelCostCapture env var name" > git remote # timeout=10 > git submodule init # timeout=10 > git submodule sync # timeout=10 > git config --get remote.origin.url # timeout=10 > git submodule init # timeout=10 > git config -f .gitmodules --get-regexp ^submodule\.(.+)\.url # timeout=10 > git config --get submodule.global-jjb.url # timeout=10 > git config -f .gitmodules --get submodule.global-jjb.path # timeout=10 > git submodule update --init --recursive global-jjb # timeout=10 Excluding src/test/ from checkout of git git@github.com:lfit/releng-pipelines.git so that shared library test code cannot be accessed by Pipelines. To remove this log message, move the test code outside of src/. To restore the previous behavior that allowed access to files in src/test/, pass -Dorg.jenkinsci.plugins.workflow.libs.SCMSourceRetriever.INCLUDE_SRC_TEST_IN_LIBRARIES=true to the java command used to start Jenkins. [Pipeline] Start of Pipeline [Pipeline] node Still waiting to schedule task Waiting for next available executor on ‘centos7-docker-4c-2g’ Running on prd-centos7-docker-4c-2g-3902 in /w/workspace/edgexfoundry_edgex-compose_PR-83 [Pipeline] { [Pipeline] stage [Pipeline] { (Declarative: Checkout SCM) [Pipeline] checkout using credential edgex-jenkins-ssh Cloning the remote Git repository Cloning repository git@github.com:edgexfoundry/edgex-compose.git > git init /w/workspace/edgexfoundry_edgex-compose_PR-83 # timeout=10 Fetching upstream changes from git@github.com:edgexfoundry/edgex-compose.git > git --version # timeout=10 > git --version # 'git version 2.24.3' using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --force --progress -- git@github.com:edgexfoundry/edgex-compose.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git@github.com:edgexfoundry/edgex-compose.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url git@github.com:edgexfoundry/edgex-compose.git # timeout=10 Fetching upstream changes from git@github.com:edgexfoundry/edgex-compose.git using GIT_SSH to set credentials SSH Credentials for GitHub > git fetch --tags --force --progress -- git@github.com:edgexfoundry/edgex-compose.git +refs/pull/83/head:refs/remotes/origin/PR-83 +refs/heads/master:refs/remotes/origin/master # timeout=10 Merging remotes/origin/master commit 0c62883c3eba94d12c26bcf9c8a04b4abf9fe530 into PR head commit e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0 Merge succeeded, producing e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0 Checking out Revision e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0 (PR-83) > git config core.sparsecheckout # timeout=10 > git checkout -f e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0 # timeout=10 > git remote # timeout=10 > git config --get remote.origin.url # timeout=10 using GIT_SSH to set credentials SSH Credentials for GitHub > git merge 0c62883c3eba94d12c26bcf9c8a04b4abf9fe530 # timeout=10 > git rev-parse HEAD^{commit} # timeout=10 > git config core.sparsecheckout # timeout=10 > git checkout -f e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0 # timeout=10 Commit message: "fix: Add command to V2 MQTT Broker for no-auth" > git rev-list --no-walk e2a26d97a09dfba4e4afc043cb7ee5678b48b4a0 # timeout=10 [Pipeline] } [Pipeline] // stage [Pipeline] withEnv [Pipeline] { [Pipeline] timestamps [Pipeline] { [Pipeline] timeout [2021-05-10T01:51:10.019Z] Timeout set to expire in 6 hr 0 min [Pipeline] { [Pipeline] stage [Pipeline] { (Smoke Tests) [Pipeline] build [2021-05-10T01:51:10.327Z] Scheduling project: EdgeX Foundry Project » edgex-taf-pipelines » smoke-test [2021-05-10T01:51:16.818Z] Starting building: EdgeX Foundry Project » edgex-taf-pipelines » smoke-test #362 [Pipeline] } [Pipeline] // stage [Pipeline] stage [Pipeline] { (Declarative: Post Actions) [Pipeline] stage [Pipeline] { (LF Post Build Actions) [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:12:48.142Z] ---> sysstat.sh [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:12:48.821Z] ---> package-listing.sh [2021-05-10T02:12:48.821Z] ++ tr '[:upper:]' '[:lower:]' [2021-05-10T02:12:48.821Z] ++ facter osfamily [2021-05-10T02:12:49.132Z] + OS_FAMILY=redhat [2021-05-10T02:12:49.132Z] + workspace=/w/workspace/edgexfoundry_edgex-compose_PR-83 [2021-05-10T02:12:49.132Z] + START_PACKAGES=/tmp/packages_start.txt [2021-05-10T02:12:49.132Z] + END_PACKAGES=/tmp/packages_end.txt [2021-05-10T02:12:49.132Z] + DIFF_PACKAGES=/tmp/packages_diff.txt [2021-05-10T02:12:49.132Z] + PACKAGES=/tmp/packages_start.txt [2021-05-10T02:12:49.132Z] + '[' /w/workspace/edgexfoundry_edgex-compose_PR-83 ']' [2021-05-10T02:12:49.132Z] + PACKAGES=/tmp/packages_end.txt [2021-05-10T02:12:49.132Z] + case "${OS_FAMILY}" in [2021-05-10T02:12:49.132Z] + rpm -qa [2021-05-10T02:12:49.132Z] + sort [2021-05-10T02:12:54.506Z] + '[' -f /tmp/packages_start.txt ']' [2021-05-10T02:12:54.506Z] + '[' -f /tmp/packages_end.txt ']' [2021-05-10T02:12:54.506Z] + diff /tmp/packages_start.txt /tmp/packages_end.txt [2021-05-10T02:12:54.506Z] + '[' /w/workspace/edgexfoundry_edgex-compose_PR-83 ']' [2021-05-10T02:12:54.506Z] + mkdir -p /w/workspace/edgexfoundry_edgex-compose_PR-83/archives/ [2021-05-10T02:12:54.506Z] + cp -f /tmp/packages_diff.txt /tmp/packages_end.txt /tmp/packages_start.txt /w/workspace/edgexfoundry_edgex-compose_PR-83/archives/ [Pipeline] echo [2021-05-10T02:12:54.522Z] Launching container with: [--privileged -u 0:0 --net host -v /var/log/sa:/var/log/sa-host -v /var/log/secure:/var/log/secure -v /var/log/auth.log:/var/log/auth.log -v /w/workspace/edgexfoundry_edgex-compose_PR-83/facter-os:/facter-os -v /proc/uptime:/proc/uptime -v /run/cloud-init/result.json:/run/cloud-init/result.json] [Pipeline] sh [2021-05-10T02:12:54.816Z] + facter operatingsystem [Pipeline] isUnix [Pipeline] sh [2021-05-10T02:12:55.469Z] + docker inspect -f . nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [2021-05-10T02:12:55.740Z] [2021-05-10T02:12:55.740Z] Error: No such object: nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [Pipeline] isUnix [Pipeline] sh [2021-05-10T02:12:56.057Z] + docker pull nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [2021-05-10T02:12:56.057Z] alpine: Pulling from edgex-lftools-log-publisher [2021-05-10T02:12:56.057Z] df20fa9351a1: Pulling fs layer [2021-05-10T02:12:56.057Z] 36b3adc4ff6f: Pulling fs layer [2021-05-10T02:12:56.057Z] 8ad3a11d3b57: Pulling fs layer [2021-05-10T02:12:56.057Z] 46f8f816bc3b: Pulling fs layer [2021-05-10T02:12:56.057Z] 93b61091891f: Pulling fs layer [2021-05-10T02:12:56.057Z] 93b9cdb0e59b: Pulling fs layer [2021-05-10T02:12:56.057Z] 5e14af77c1be: Pulling fs layer [2021-05-10T02:12:56.057Z] 01666e4c0597: Pulling fs layer [2021-05-10T02:12:56.057Z] aa168da1d23b: Pulling fs layer [2021-05-10T02:12:56.057Z] 93b9cdb0e59b: Waiting [2021-05-10T02:12:56.057Z] 5e14af77c1be: Waiting [2021-05-10T02:12:56.057Z] 01666e4c0597: Waiting [2021-05-10T02:12:56.057Z] aa168da1d23b: Waiting [2021-05-10T02:12:56.057Z] 46f8f816bc3b: Waiting [2021-05-10T02:12:56.057Z] 93b61091891f: Waiting [2021-05-10T02:12:56.057Z] 36b3adc4ff6f: Verifying Checksum [2021-05-10T02:12:56.057Z] 36b3adc4ff6f: Download complete [2021-05-10T02:12:56.057Z] 46f8f816bc3b: Download complete [2021-05-10T02:12:56.322Z] df20fa9351a1: Verifying Checksum [2021-05-10T02:12:56.322Z] 93b61091891f: Verifying Checksum [2021-05-10T02:12:56.322Z] 93b61091891f: Download complete [2021-05-10T02:12:56.322Z] 5e14af77c1be: Verifying Checksum [2021-05-10T02:12:56.322Z] 5e14af77c1be: Download complete [2021-05-10T02:12:56.322Z] 01666e4c0597: Verifying Checksum [2021-05-10T02:12:56.322Z] 01666e4c0597: Download complete [2021-05-10T02:12:56.587Z] 93b9cdb0e59b: Verifying Checksum [2021-05-10T02:12:56.587Z] 93b9cdb0e59b: Download complete [2021-05-10T02:12:56.587Z] df20fa9351a1: Pull complete [2021-05-10T02:12:56.857Z] 8ad3a11d3b57: Verifying Checksum [2021-05-10T02:12:56.857Z] 8ad3a11d3b57: Download complete [2021-05-10T02:12:56.857Z] 36b3adc4ff6f: Pull complete [2021-05-10T02:12:57.845Z] 8ad3a11d3b57: Pull complete [2021-05-10T02:12:58.120Z] 46f8f816bc3b: Pull complete [2021-05-10T02:12:58.710Z] 93b61091891f: Pull complete [2021-05-10T02:12:58.977Z] 93b9cdb0e59b: Pull complete [2021-05-10T02:12:59.242Z] 5e14af77c1be: Pull complete [2021-05-10T02:12:59.242Z] aa168da1d23b: Verifying Checksum [2021-05-10T02:12:59.242Z] aa168da1d23b: Download complete [2021-05-10T02:12:59.242Z] 01666e4c0597: Pull complete [2021-05-10T02:13:09.379Z] aa168da1d23b: Pull complete [2021-05-10T02:13:09.379Z] Digest: sha256:ac41798234670a79351fc13b8232b4dbeccc6fb1f122f5db5169d11b1762ca7c [2021-05-10T02:13:09.379Z] Status: Downloaded newer image for nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [2021-05-10T02:13:09.379Z] nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine [Pipeline] withDockerContainer [2021-05-10T02:13:09.581Z] prd-centos7-docker-4c-2g-3902 does not seem to be running inside a container [2021-05-10T02:13:09.666Z] $ docker run -t -d -u 1001:1001 --privileged -u 0:0 --net host -v /var/log/sa:/var/log/sa-host -v /var/log/secure:/var/log/secure -v /var/log/auth.log:/var/log/auth.log -v /w/workspace/edgexfoundry_edgex-compose_PR-83/facter-os:/facter-os -v /proc/uptime:/proc/uptime -v /run/cloud-init/result.json:/run/cloud-init/result.json -w /w/workspace/edgexfoundry_edgex-compose_PR-83 -v /w/workspace/edgexfoundry_edgex-compose_PR-83:/w/workspace/edgexfoundry_edgex-compose_PR-83:rw,z -v /w/workspace/edgexfoundry_edgex-compose_PR-83@tmp:/w/workspace/edgexfoundry_edgex-compose_PR-83@tmp:rw,z -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** -e ******** nexus3.edgexfoundry.org:10003/edgex-lftools-log-publisher:alpine cat [2021-05-10T02:13:12.810Z] $ docker top 43e5d3f038e07b07988ecadc3de9cc60dbbdf9b91fbc50fd64b2d83668e767dd -eo pid,comm [Pipeline] { [Pipeline] sh [2021-05-10T02:13:13.247Z] + touch /tmp/pre-build-complete [Pipeline] sh [2021-05-10T02:13:13.569Z] + mkdir -p /var/log/sa [Pipeline] sh [2021-05-10T02:13:13.886Z] + ls /var/log/sa-host [2021-05-10T02:13:13.886Z] + sadf -c /var/log/sa-host/sa10 [2021-05-10T02:13:13.886Z] file_magic: OK [2021-05-10T02:13:13.886Z] HZ: Using current value: 100 [2021-05-10T02:13:13.886Z] file_header: OK [2021-05-10T02:13:13.886Z] file_activity: A_CPU A_PCSW A_SWAP A_PAGE A_IO A_MEMORY A_HUGE A_KTABLES A_QUEUE A_SERIAL A_DISK A_NET_DEV A_NET_EDEV A_NET_NFS A_NET_NFSD A_NET_SOCK OK [2021-05-10T02:13:13.887Z] Statistics: [2021-05-10T02:13:13.887Z] HRHnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu...Hnuu...uuuununununu... [2021-05-10T02:13:13.887Z] File successfully converted to sysstat format version 12.2.1 [2021-05-10T02:13:13.887Z] + sadf -c /var/log/sa-host/sa23 [2021-05-10T02:13:13.887Z] file_magic: OK [2021-05-10T02:13:13.887Z] HZ: Using current value: 100 [2021-05-10T02:13:13.887Z] file_header: OK [2021-05-10T02:13:13.887Z] file_activity: A_CPU A_PCSW A_SWAP A_PAGE A_IO A_MEMORY A_HUGE A_KTABLES A_QUEUE A_SERIAL A_DISK A_NET_DEV A_NET_EDEV A_NET_NFS A_NET_NFSD A_NET_SOCK OK [2021-05-10T02:13:13.887Z] Statistics: [2021-05-10T02:13:13.887Z] Hnuu...uuuununununu... [2021-05-10T02:13:13.887Z] File successfully converted to sysstat format version 12.2.1 [Pipeline] withEnv [Pipeline] { [Pipeline] configFileProvider [2021-05-10T02:13:14.446Z] provisioning config files... [2021-05-10T02:13:14.518Z] copy managed file [jenkins-log-archives-settings] to file:/w/workspace/edgexfoundry_edgex-compose_PR-83@tmp/config2118363790212496490tmp [Pipeline] { [Pipeline] echo [2021-05-10T02:13:14.540Z] Running shell/create-netrc.sh [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:13:14.870Z] ---> create-netrc.sh [Pipeline] } [2021-05-10T02:13:14.889Z] Deleting 1 temporary files [Pipeline] // configFileProvider [Pipeline] echo [2021-05-10T02:13:14.902Z] Running shell/python-tools-install.sh [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:13:15.212Z] ---> python-tools-install.sh [Pipeline] echo [2021-05-10T02:13:15.234Z] Running shell/sudo-logs.sh [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:13:15.954Z] ---> sudo-logs.sh [2021-05-10T02:13:15.954Z] Archiving 'sudo' log.. [Pipeline] unstash [Pipeline] echo [2021-05-10T02:13:15.976Z] Running shell/job-cost.sh [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:13:16.278Z] ---> job-cost.sh [2021-05-10T02:13:16.279Z] lf-activate-venv: SKIPPING [2021-05-10T02:13:16.279Z] INFO: No Stack... [2021-05-10T02:13:17.676Z] INFO: Retrieving Pricing Info for: v1-standard-2 [2021-05-10T02:13:18.275Z] INFO: Archiving Costs [Pipeline] echo [2021-05-10T02:13:18.290Z] Running shell/logs-deploy.sh [Pipeline] libraryResource [Pipeline] sh [2021-05-10T02:13:18.589Z] ---> logs-deploy.sh [2021-05-10T02:13:18.589Z] lf-activate-venv: SKIPPING [2021-05-10T02:13:18.589Z] INFO: Nexus URL https://nexus.edgexfoundry.org path production/vex-yul-edgex-jenkins-1/edgexfoundry/edgex-compose/PR-83/3 [2021-05-10T02:13:18.589Z] INFO: archiving workspace using pattern(s): [2021-05-10T02:13:21.154Z] Archives upload complete. [2021-05-10T02:13:21.154Z] INFO: archiving logs to Nexus