[2025-08-21 11:36:14,772][ INFO][PID:1818337] Marking build as starting [2025-08-21 11:36:14,805][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:14,806][ INFO][PID:1818337] VM allocation process starts [2025-08-21 11:36:14,818][ INFO][PID:1818337] Trying to allocate VM: ResallocHost, ticket_id=3768, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-21 11:36:17,827][ INFO][PID:1818337] Allocated host ResallocHost, ticket_id=3768, hostname=2620:52:3:1:dead:beef:cafe:c180, name=copr_hv_x86_64_03_dev_00812288_20250821_113403, requested_tags=['copr_builder', 'arch_x86_64'] [2025-08-21 11:36:17,828][ INFO][PID:1818337] Allocating ssh connection to builder [2025-08-21 11:36:17,828][ INFO][PID:1818337] Checking that builder machine is OK [2025-08-21 11:36:17,893][ INFO][PID:1818337] Running remote command: copr-builder-ready fedora-43-x86_64 [2025-08-21 11:36:17,998][ INFO][PID:1818337] Red Hat subscription not needed for fedora-43-x86_64 Builder is ready to be used [2025-08-21 11:36:17,999][ INFO][PID:1818337] Filling build.info file with builder info [2025-08-21 11:36:17,999][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:18,000][ INFO][PID:1818337] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "praiskup", "project_name": "test-new-rpmbuild", "project_dirname": "test-new-rpmbuild", "submitter": "praiskup", "ended_on": null, "started_on": 1755776178.0001929, "submitted_on": null, "status": 3, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "2923008-fedora-43-x86_64", "build_id": 2923008, "package_name": "dummy-pkg", "package_version": "20250821_1335-1", "git_repo": "https://copr-dist-git-dev.fedorainfracloud.org/git/praiskup/test-new-rpmbuild/dummy-pkg", "git_hash": "8e464b61233b69477f2aea589476b272890a6f3a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "praiskup/test-new-rpmbuild--praiskup", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/test-new-rpmbuild/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/praiskup/test-new-rpmbuild", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/test-new-rpmbuild", "result_dir": "02923008-dummy-pkg", "built_packages": "", "id": 2923008, "mockchain_macros": { "copr_username": "praiskup", "copr_projectname": "test-new-rpmbuild", "vendor": "Fedora Project COPR (praiskup/test-new-rpmbuild)" } } ] } [2025-08-21 11:36:18,023][ INFO][PID:1818337] Sending fedora-messaging bus message in build.start [2025-08-21 11:36:18,423][ INFO][PID:1818337] Sending fedora-messaging bus message in chroot.start [2025-08-21 11:36:18,440][ INFO][PID:1818337] Starting remote build: copr-rpmbuild --verbose --drop-resultdir --task-url https://copr.stg.fedoraproject.org/backend/get-build-task/2923008-fedora-43-x86_64 --chroot fedora-43-x86_64 --detached [2025-08-21 11:36:18,770][ INFO][PID:1818337] The copr-rpmbuild seems started, per: stdout: stderr: [2025-08-21 11:36:18,771][ INFO][PID:1818337] Downloading the builder-live.log file, attempt 1 [2025-08-21 11:36:18,772][ INFO][PID:1818337] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 copr-rpmbuild-log [2025-08-21 11:36:23,778][ INFO][PID:1818337] Periodic builder liveness probe: alive [2025-08-21 11:36:23,778][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:28,780][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:33,783][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:38,785][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:43,786][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:48,787][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:53,789][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:36:58,789][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:03,790][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:08,792][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:13,794][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:18,795][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:23,796][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:28,797][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:33,798][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:38,800][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:43,801][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:48,803][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:53,804][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:37:58,805][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:03,807][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:08,810][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:13,811][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:18,813][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:23,814][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:28,816][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:33,817][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:38,823][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:43,825][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:48,826][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:53,827][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:38:58,828][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:03,829][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:08,830][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:13,831][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:18,833][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:23,834][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:28,836][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:33,837][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:38,838][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:43,839][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:48,840][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:53,841][ INFO][PID:1818337] Checking for cancel request [2025-08-21 11:39:53,842][ INFO][PID:1818337] calling cancel callback, and waiting [2025-08-21 11:39:54,056][ INFO][PID:1818337] Cancel request succeeded out: PID 2679 not found err: [2025-08-21 12:07:53,468][ ERROR][PID:1818337] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-21 12:08:03,476][WARNING][PID:1818337] SSH connection lost on #1 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-21 12:08:13,477][ INFO][PID:1818337] Downloading the builder-live.log file, attempt 2 [2025-08-21 12:08:13,480][ INFO][PID:1818337] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 copr-rpmbuild-log [2025-08-21 12:09:13,547][ ERROR][PID:1818337] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-21 12:09:23,548][WARNING][PID:1818337] SSH connection lost on #2 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-21 12:09:33,550][ INFO][PID:1818337] Downloading the builder-live.log file, attempt 3 [2025-08-21 12:09:33,551][ INFO][PID:1818337] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 copr-rpmbuild-log [2025-08-21 12:10:33,615][ ERROR][PID:1818337] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-21 12:10:43,616][WARNING][PID:1818337] SSH connection lost on #3 attempt, let's retry after 10s, Unable to finish after 1 SSH attempts [2025-08-21 12:10:53,617][ INFO][PID:1818337] Downloading the builder-live.log file, attempt 4 [2025-08-21 12:10:53,619][ INFO][PID:1818337] Popen command started: ssh -F /home/copr/.ssh/config mockbuilder@2620:52:3:1:dead:beef:cafe:c180 copr-rpmbuild-log [2025-08-21 12:11:53,682][ ERROR][PID:1818337] SSH connection lost on #1 attempt, let's retry after 10s, Connection broke. [2025-08-21 12:12:03,688][ ERROR][PID:1818337] Giving up for unstable SSH, failures: 1755778083.4763358, 1755778163.5488377, 1755778243.6162286, 1755778323.6886582 [2025-08-21 12:12:03,695][ ERROR][PID:1818337] Build was canceled [2025-08-21 12:12:03,695][ INFO][PID:1818337] Releasing VM back to pool [2025-08-21 12:12:03,713][WARNING][PID:1818337] Switching not-finished job state to 'failed' [2025-08-21 12:12:03,714][ INFO][PID:1818337] Worker failed build, took 2145.713693380356 [2025-08-21 12:12:03,715][ INFO][PID:1818337] Sending build state back to frontend: { "builds": [ { "timeout": 18000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": 2048, "enable_net": false, "project_owner": "praiskup", "project_name": "test-new-rpmbuild", "project_dirname": "test-new-rpmbuild", "submitter": "praiskup", "ended_on": 1755778323.7138863, "started_on": 1755776178.0001929, "submitted_on": null, "status": 0, "chroot": "fedora-43-x86_64", "arch": "x86_64", "buildroot_pkgs": [], "task_id": "2923008-fedora-43-x86_64", "build_id": 2923008, "package_name": "dummy-pkg", "package_version": "20250821_1335-1", "git_repo": "https://copr-dist-git-dev.fedorainfracloud.org/git/praiskup/test-new-rpmbuild/dummy-pkg", "git_hash": "8e464b61233b69477f2aea589476b272890a6f3a", "git_branch": null, "source_type": null, "source_json": null, "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": false, "sandbox": "praiskup/test-new-rpmbuild--praiskup", "results": null, "appstream": false, "allow_user_ssh": false, "ssh_public_keys": null, "storage": 0, "repos": [ { "baseurl": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/test-new-rpmbuild/fedora-43-x86_64/", "id": "copr_base", "name": "Copr repository", "priority": null } ], "background": false, "fedora_review": false, "isolation": "default", "repo_priority": null, "tags": [ "arch_x86_64" ], "with_opts": [], "without_opts": [], "destdir": "/var/lib/copr/public_html/results/praiskup/test-new-rpmbuild", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/praiskup/test-new-rpmbuild", "result_dir": "02923008-dummy-pkg", "built_packages": "", "id": 2923008, "mockchain_macros": { "copr_username": "praiskup", "copr_projectname": "test-new-rpmbuild", "vendor": "Fedora Project COPR (praiskup/test-new-rpmbuild)" } } ] } [2025-08-21 12:12:03,872][ INFO][PID:1818337] Sending fedora-messaging bus message in build.end [2025-08-21 12:12:03,916][ INFO][PID:1818337] Compressing /var/lib/copr/public_html/results/praiskup/test-new-rpmbuild/fedora-43-x86_64/02923008-dummy-pkg/builder-live.log by gzip [2025-08-21 12:12:03,918][ INFO][PID:1818337] Running command 'gzip /var/lib/copr/public_html/results/praiskup/test-new-rpmbuild/fedora-43-x86_64/02923008-dummy-pkg/builder-live.log' as PID 1947897 [2025-08-21 12:12:03,920][ INFO][PID:1818337] Finished after 0 seconds with exit code 0 (gzip /var/lib/copr/public_html/results/praiskup/test-new-rpmbuild/fedora-43-x86_64/02923008-dummy-pkg/builder-live.log) [2025-08-21 12:12:03,922][ INFO][PID:1818337] Compressing /var/lib/copr/public_html/results/praiskup/test-new-rpmbuild/fedora-43-x86_64/02923008-dummy-pkg/backend.log by gzip