[2026-04-15 22:56:46,043][ INFO][PID:2822847] Marking build as starting [2026-04-15 22:56:46,269][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:56:46,275][ INFO][PID:2822847] VM allocation process starts [2026-04-15 22:56:46,337][ INFO][PID:2822847] Trying to allocate VM: ResallocHost, ticket_id=3470, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:56:51,350][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:56:56,352][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:01,359][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:06,369][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:11,375][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:16,383][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:21,388][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:26,393][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:31,396][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:36,402][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:41,404][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:46,409][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:51,413][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:57:56,417][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:01,422][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:06,430][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:11,434][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:16,438][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:21,439][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:26,443][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:31,445][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:34,631][ INFO][PID:2822847] Allocated host ResallocHost, ticket_id=3470, hostname=54.166.239.133, name=aws_x86_64_spot_dev_02147548_20260415_225629, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:58:34,633][ INFO][PID:2822847] Allocating ssh connection to builder [2026-04-15 22:58:34,636][ INFO][PID:2822847] Checking that builder machine is OK [2026-04-15 22:58:35,053][ INFO][PID:2822847] Installed copr-rpmbuild version: 1.6 [2026-04-15 22:58:35,057][ ERROR][PID:2822847] Re-try request for task on 'ResallocHost, ticket_id=3470, hostname=54.166.239.133, name=aws_x86_64_spot_dev_02147548_20260415_225629, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 22:58:35,065][ INFO][PID:2822847] VM Release request [2026-04-15 22:58:35,113][ INFO][PID:2822847] Retry #1 (on other host) [2026-04-15 22:58:35,115][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:35,122][ INFO][PID:2822847] VM allocation process starts [2026-04-15 22:58:35,162][ INFO][PID:2822847] Trying to allocate VM: ResallocHost, ticket_id=3507, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:58:40,171][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:45,176][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:50,192][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:58:55,196][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:00,199][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:05,201][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:10,206][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:15,211][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:20,215][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:25,220][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:30,225][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:35,229][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:40,237][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:45,241][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:50,245][ INFO][PID:2822847] Checking for cancel request [2026-04-15 22:59:55,247][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:00,249][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:05,251][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:10,254][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:15,261][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:20,267][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:25,276][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:30,284][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:35,288][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:40,294][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:45,297][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:50,301][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:00:55,303][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:00,311][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:05,314][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:10,322][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:15,326][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:20,330][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:25,340][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:30,346][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:35,349][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:40,356][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:45,364][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:50,366][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:53,593][ INFO][PID:2822847] Allocated host ResallocHost, ticket_id=3507, hostname=140.211.168.169, name=copr_osuosl_p09_dev_02147553_20260415_225720, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:01:53,594][ INFO][PID:2822847] Allocating ssh connection to builder [2026-04-15 23:01:53,597][ INFO][PID:2822847] Checking that builder machine is OK [2026-04-15 23:01:54,940][ INFO][PID:2822847] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:01:54,947][ ERROR][PID:2822847] Re-try request for task on 'ResallocHost, ticket_id=3507, hostname=140.211.168.169, name=copr_osuosl_p09_dev_02147553_20260415_225720, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:01:54,949][ INFO][PID:2822847] VM Release request [2026-04-15 23:01:55,006][ INFO][PID:2822847] Retry #2 (on other host) [2026-04-15 23:01:55,010][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:55,015][ INFO][PID:2822847] VM allocation process starts [2026-04-15 23:01:55,051][ INFO][PID:2822847] Trying to allocate VM: ResallocHost, ticket_id=3580, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:01:58,126][ INFO][PID:2822847] Allocated host ResallocHost, ticket_id=3580, hostname=140.211.168.169, name=copr_osuosl_p09_dev_02147553_20260415_225720, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:01:58,131][ INFO][PID:2822847] Allocating ssh connection to builder [2026-04-15 23:01:58,137][ INFO][PID:2822847] Checking that builder machine is OK [2026-04-15 23:01:58,363][ INFO][PID:2822847] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:01:58,364][ ERROR][PID:2822847] Re-try request for task on 'ResallocHost, ticket_id=3580, hostname=140.211.168.169, name=copr_osuosl_p09_dev_02147553_20260415_225720, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:01:58,366][ INFO][PID:2822847] VM Release request [2026-04-15 23:01:58,398][ INFO][PID:2822847] Retry #3 (on other host) [2026-04-15 23:01:58,402][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:01:58,405][ INFO][PID:2822847] VM allocation process starts [2026-04-15 23:01:58,431][ INFO][PID:2822847] Trying to allocate VM: ResallocHost, ticket_id=3583, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:02:03,438][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:08,445][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:13,449][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:18,452][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:23,453][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:28,456][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:33,459][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:38,464][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:43,466][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:48,469][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:53,474][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:02:58,479][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:03,481][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:08,486][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:13,494][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:18,496][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:23,503][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:28,507][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:33,510][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:38,512][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:43,514][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:48,518][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:53,525][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:03:58,530][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:03,538][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:08,546][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:13,550][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:18,555][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:23,559][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:28,564][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:33,572][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:38,582][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:43,596][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:48,627][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:53,652][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:04:58,658][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:05:03,660][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:05:08,665][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:05:13,669][ INFO][PID:2822847] Checking for cancel request [2026-04-15 23:05:16,728][ INFO][PID:2822847] Allocated host ResallocHost, ticket_id=3583, hostname=2620:52:6:1161:dead:beef:cafe:c90a, name=vmhost_x86_04_dev_02147570_20260415_230152, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:05:16,732][ INFO][PID:2822847] Allocating ssh connection to builder [2026-04-15 23:05:16,734][ INFO][PID:2822847] Checking that builder machine is OK [2026-04-15 23:05:17,398][ INFO][PID:2822847] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:05:17,401][ ERROR][PID:2822847] Re-try request for task on 'ResallocHost, ticket_id=3583, hostname=2620:52:6:1161:dead:beef:cafe:c90a, name=vmhost_x86_04_dev_02147570_20260415_230152, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:05:17,402][ INFO][PID:2822847] VM Release request [2026-04-15 23:05:17,426][ ERROR][PID:2822847] Backend process error: Three host tried without success: {'54.166.239.133', '140.211.168.169', '2620:52:6:1161:dead:beef:cafe:c90a'} [2026-04-15 23:05:17,431][WARNING][PID:2822847] Switching not-finished job state to 'failed' [2026-04-15 23:05:17,432][ INFO][PID:2822847] Worker failed build, took 511.41413164138794 [2026-04-15 23:05:17,436][ INFO][PID:2822847] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": null, "enable_net": true, "project_owner": "@copr", "project_name": "TEST1776291979741322179DisableCreaterepoFalse", "project_dirname": "TEST1776291979741322179DisableCreaterepoFalse", "submitter": "frostyx", "ended_on": 1776294317.4310699, "started_on": 1776293806.0169382, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "2925239", "build_id": 2925239, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 1, "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/hello-2.8-1.src.rpm\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@copr/TEST1776291979741322179DisableCreaterepoFalse--frostyx", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "distributions_in_build": [], "distributions_in_project": [ "fedora-43" ], "destdir": "/var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1776291979741322179DisableCreaterepoFalse", "result_dir": "02925239", "built_packages": "", "tags": [ "arch_noarch" ], "id": 2925239, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "TEST1776291979741322179DisableCreaterepoFalse", "vendor": "Fedora Project COPR (@copr/TEST1776291979741322179DisableCreaterepoFalse)" } } ] } [2026-04-15 23:05:17,540][ INFO][PID:2822847] Sending fedora-messaging bus message in build.end [2026-04-15 23:05:19,701][ INFO][PID:2822847] Compressing /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/builder-live.log by gzip [2026-04-15 23:05:19,710][ INFO][PID:2822847] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/builder-live.log' as PID 2843715 [2026-04-15 23:05:19,715][ INFO][PID:2822847] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/builder-live.log: No such file or directory [2026-04-15 23:05:19,719][ ERROR][PID:2822847] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/builder-live.log [2026-04-15 23:05:19,722][ INFO][PID:2822847] Compressing /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/backend.log by gzip [2026-04-15 23:05:19,725][ INFO][PID:2822847] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776291979741322179DisableCreaterepoFalse/srpm-builds/02925239/backend.log' as PID 2843716