[2026-04-15 22:49:08,214][ INFO][PID:2803364] Marking build as starting [2026-04-15 22:49:08,364][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:08,371][ INFO][PID:2803364] VM allocation process starts [2026-04-15 22:49:08,432][ INFO][PID:2803364] Trying to allocate VM: ResallocHost, ticket_id=3279, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:49:13,438][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:18,441][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:23,450][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:28,455][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:33,470][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:38,478][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:43,481][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:48,485][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:53,491][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:49:58,494][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:03,497][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:08,500][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:13,503][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:18,507][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:23,515][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:28,519][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:33,523][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:36,731][ INFO][PID:2803364] Allocated host ResallocHost, ticket_id=3279, hostname=13.217.202.245, name=aws_x86_64_spot_dev_02147517_20260415_224839, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:50:36,731][ INFO][PID:2803364] Allocating ssh connection to builder [2026-04-15 22:50:36,733][ INFO][PID:2803364] Checking that builder machine is OK [2026-04-15 22:50:37,126][ INFO][PID:2803364] Installed copr-rpmbuild version: 1.6 [2026-04-15 22:50:37,128][ ERROR][PID:2803364] Re-try request for task on 'ResallocHost, ticket_id=3279, hostname=13.217.202.245, name=aws_x86_64_spot_dev_02147517_20260415_224839, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 22:50:37,130][ INFO][PID:2803364] VM Release request [2026-04-15 22:50:37,159][ INFO][PID:2803364] Retry #1 (on other host) [2026-04-15 22:50:37,161][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:37,165][ INFO][PID:2803364] VM allocation process starts [2026-04-15 22:50:37,200][ INFO][PID:2803364] Trying to allocate VM: ResallocHost, ticket_id=3292, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:50:40,232][ INFO][PID:2803364] Allocated host ResallocHost, ticket_id=3292, hostname=13.217.202.245, name=aws_x86_64_spot_dev_02147517_20260415_224839, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:50:40,233][ INFO][PID:2803364] Allocating ssh connection to builder [2026-04-15 22:50:40,233][ INFO][PID:2803364] Checking that builder machine is OK [2026-04-15 22:50:40,278][ INFO][PID:2803364] Installed copr-rpmbuild version: 1.6 [2026-04-15 22:50:40,278][ ERROR][PID:2803364] Re-try request for task on 'ResallocHost, ticket_id=3292, hostname=13.217.202.245, name=aws_x86_64_spot_dev_02147517_20260415_224839, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 22:50:40,281][ INFO][PID:2803364] VM Release request [2026-04-15 22:50:40,334][ INFO][PID:2803364] Retry #2 (on other host) [2026-04-15 22:50:40,335][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:40,336][ INFO][PID:2803364] VM allocation process starts [2026-04-15 22:50:40,382][ INFO][PID:2803364] Trying to allocate VM: ResallocHost, ticket_id=3294, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:50:45,387][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:50,389][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:50:55,391][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:00,394][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:05,396][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:10,405][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:15,407][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:20,417][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:25,423][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:30,432][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:35,438][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:40,446][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:45,448][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:50,450][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:51:55,453][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:00,455][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:05,459][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:10,463][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:15,470][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:20,474][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:25,476][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:30,480][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:35,488][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:40,500][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:45,505][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:50,507][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:55,509][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:58,730][ INFO][PID:2803364] Allocated host ResallocHost, ticket_id=3294, hostname=44.222.162.15, name=aws_x86_64_spot_dev_02147525_20260415_225035, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:52:58,732][ INFO][PID:2803364] Allocating ssh connection to builder [2026-04-15 22:52:58,733][ INFO][PID:2803364] Checking that builder machine is OK [2026-04-15 22:52:59,220][ INFO][PID:2803364] Installed copr-rpmbuild version: 1.6 [2026-04-15 22:52:59,225][ ERROR][PID:2803364] Re-try request for task on 'ResallocHost, ticket_id=3294, hostname=44.222.162.15, name=aws_x86_64_spot_dev_02147525_20260415_225035, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 22:52:59,227][ INFO][PID:2803364] VM Release request [2026-04-15 22:52:59,260][ INFO][PID:2803364] Retry #3 (on other host) [2026-04-15 22:52:59,263][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:52:59,264][ INFO][PID:2803364] VM allocation process starts [2026-04-15 22:52:59,294][ INFO][PID:2803364] Trying to allocate VM: ResallocHost, ticket_id=3342, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:53:04,299][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:09,305][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:14,315][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:19,331][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:24,336][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:29,341][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:34,343][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:39,345][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:44,347][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:49,351][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:54,354][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:53:59,358][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:54:04,361][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:54:09,367][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:54:14,373][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:54:19,381][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:54:24,388][ INFO][PID:2803364] Checking for cancel request [2026-04-15 22:54:27,508][ INFO][PID:2803364] Allocated host ResallocHost, ticket_id=3342, hostname=2620:52:6:1161:dead:beef:cafe:c903, name=vmhost_p09_04_dev_02147527_20260415_225100, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 22:54:27,510][ INFO][PID:2803364] Allocating ssh connection to builder [2026-04-15 22:54:27,511][ INFO][PID:2803364] Checking that builder machine is OK [2026-04-15 22:54:28,529][ INFO][PID:2803364] Installed copr-rpmbuild version: 1.6 [2026-04-15 22:54:28,530][ ERROR][PID:2803364] Re-try request for task on 'ResallocHost, ticket_id=3342, hostname=2620:52:6:1161:dead:beef:cafe:c903, name=vmhost_p09_04_dev_02147527_20260415_225100, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 22:54:28,532][ INFO][PID:2803364] VM Release request [2026-04-15 22:54:28,582][ ERROR][PID:2803364] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c903', '44.222.162.15', '13.217.202.245'} [2026-04-15 22:54:28,585][WARNING][PID:2803364] Switching not-finished job state to 'failed' [2026-04-15 22:54:28,586][ INFO][PID:2803364] Worker failed build, took 320.38246488571167 [2026-04-15 22:54:28,588][ INFO][PID:2803364] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": null, "enable_net": true, "project_owner": "@copr", "project_name": "TEST1776291979832981301ModuleHotfixes", "project_dirname": "TEST1776291979832981301ModuleHotfixes", "submitter": "frostyx", "ended_on": 1776293668.585493, "started_on": 1776293348.2030282, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "2925231", "build_id": 2925231, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 1, "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/hello-2.8-1.src.rpm\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@copr/TEST1776291979832981301ModuleHotfixes--frostyx", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "distributions_in_build": [], "distributions_in_project": [ "fedora-43" ], "destdir": "/var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1776291979832981301ModuleHotfixes", "result_dir": "02925231", "built_packages": "", "tags": [ "arch_noarch" ], "id": 2925231, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "TEST1776291979832981301ModuleHotfixes", "vendor": "Fedora Project COPR (@copr/TEST1776291979832981301ModuleHotfixes)" } } ] } [2026-04-15 22:54:28,702][ INFO][PID:2803364] Sending fedora-messaging bus message in build.end [2026-04-15 22:54:30,652][ INFO][PID:2803364] Compressing /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/builder-live.log by gzip [2026-04-15 22:54:30,659][ INFO][PID:2803364] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/builder-live.log' as PID 2816237 [2026-04-15 22:54:30,662][ INFO][PID:2803364] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/builder-live.log: No such file or directory [2026-04-15 22:54:30,663][ ERROR][PID:2803364] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/builder-live.log [2026-04-15 22:54:30,666][ INFO][PID:2803364] Compressing /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/backend.log by gzip [2026-04-15 22:54:30,672][ INFO][PID:2803364] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776291979832981301ModuleHotfixes/srpm-builds/02925231/backend.log' as PID 2816238