[2026-04-15 23:17:01,487][ INFO][PID:2874323] Marking build as starting [2026-04-15 23:17:01,569][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:01,585][ INFO][PID:2874323] VM allocation process starts [2026-04-15 23:17:01,661][ INFO][PID:2874323] Trying to allocate VM: ResallocHost, ticket_id=4055, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:17:06,666][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:11,670][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:16,675][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:21,680][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:26,683][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:31,687][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:36,693][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:41,696][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:46,698][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:51,700][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:17:56,703][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:01,714][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:06,717][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:11,720][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:16,726][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:21,727][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:26,730][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:31,733][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:36,738][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:41,742][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:46,744][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:49,908][ INFO][PID:2874323] Allocated host ResallocHost, ticket_id=4055, hostname=54.226.118.232, name=aws_x86_64_spot_dev_02147625_20260415_231641, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:18:49,908][ INFO][PID:2874323] Allocating ssh connection to builder [2026-04-15 23:18:49,909][ INFO][PID:2874323] Checking that builder machine is OK [2026-04-15 23:18:50,268][ INFO][PID:2874323] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:18:50,269][ ERROR][PID:2874323] Re-try request for task on 'ResallocHost, ticket_id=4055, hostname=54.226.118.232, name=aws_x86_64_spot_dev_02147625_20260415_231641, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:18:50,270][ INFO][PID:2874323] VM Release request [2026-04-15 23:18:50,279][ INFO][PID:2874323] Retry #1 (on other host) [2026-04-15 23:18:50,281][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:50,282][ INFO][PID:2874323] VM allocation process starts [2026-04-15 23:18:50,329][ INFO][PID:2874323] Trying to allocate VM: ResallocHost, ticket_id=4094, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:18:53,368][ INFO][PID:2874323] Allocated host ResallocHost, ticket_id=4094, hostname=54.226.118.232, name=aws_x86_64_spot_dev_02147625_20260415_231641, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:18:53,368][ INFO][PID:2874323] Allocating ssh connection to builder [2026-04-15 23:18:53,369][ INFO][PID:2874323] Checking that builder machine is OK [2026-04-15 23:18:53,422][ INFO][PID:2874323] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:18:53,424][ ERROR][PID:2874323] Re-try request for task on 'ResallocHost, ticket_id=4094, hostname=54.226.118.232, name=aws_x86_64_spot_dev_02147625_20260415_231641, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:18:53,424][ INFO][PID:2874323] VM Release request [2026-04-15 23:18:53,436][ INFO][PID:2874323] Retry #2 (on other host) [2026-04-15 23:18:53,438][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:18:53,440][ INFO][PID:2874323] VM allocation process starts [2026-04-15 23:18:53,486][ INFO][PID:2874323] Trying to allocate VM: ResallocHost, ticket_id=4095, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:18:58,489][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:03,491][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:08,492][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:13,495][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:18,499][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:23,501][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:28,504][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:33,508][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:38,511][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:43,516][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:48,518][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:53,521][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:19:58,524][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:03,527][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:08,533][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:13,538][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:18,542][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:23,550][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:28,551][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:33,558][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:38,564][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:41,676][ INFO][PID:2874323] Allocated host ResallocHost, ticket_id=4095, hostname=2620:52:6:1161:dead:beef:cafe:c904, name=vmhost_x86_04_dev_02147631_20260415_231804, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:20:41,677][ INFO][PID:2874323] Allocating ssh connection to builder [2026-04-15 23:20:41,681][ INFO][PID:2874323] Checking that builder machine is OK [2026-04-15 23:20:42,384][ INFO][PID:2874323] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:20:42,386][ ERROR][PID:2874323] Re-try request for task on 'ResallocHost, ticket_id=4095, hostname=2620:52:6:1161:dead:beef:cafe:c904, name=vmhost_x86_04_dev_02147631_20260415_231804, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:20:42,389][ INFO][PID:2874323] VM Release request [2026-04-15 23:20:42,451][ INFO][PID:2874323] Retry #3 (on other host) [2026-04-15 23:20:42,453][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:42,460][ INFO][PID:2874323] VM allocation process starts [2026-04-15 23:20:42,529][ INFO][PID:2874323] Trying to allocate VM: ResallocHost, ticket_id=4101, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:20:45,632][ INFO][PID:2874323] Allocated host ResallocHost, ticket_id=4101, hostname=2620:52:6:1161:dead:beef:cafe:c904, name=vmhost_x86_04_dev_02147631_20260415_231804, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:20:45,633][ INFO][PID:2874323] Allocating ssh connection to builder [2026-04-15 23:20:45,637][ INFO][PID:2874323] Checking that builder machine is OK [2026-04-15 23:20:45,777][ INFO][PID:2874323] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:20:45,782][ ERROR][PID:2874323] Re-try request for task on 'ResallocHost, ticket_id=4101, hostname=2620:52:6:1161:dead:beef:cafe:c904, name=vmhost_x86_04_dev_02147631_20260415_231804, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:20:45,786][ INFO][PID:2874323] VM Release request [2026-04-15 23:20:45,835][ INFO][PID:2874323] Retry #4 (on other host) [2026-04-15 23:20:45,837][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:45,840][ INFO][PID:2874323] VM allocation process starts [2026-04-15 23:20:45,886][ INFO][PID:2874323] Trying to allocate VM: ResallocHost, ticket_id=4102, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:20:50,899][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:20:55,902][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:00,904][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:05,906][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:10,909][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:15,912][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:20,918][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:25,920][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:30,922][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:35,924][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:40,927][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:45,931][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:50,933][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:21:55,935][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:22:00,938][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:22:05,941][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:22:10,943][ INFO][PID:2874323] Checking for cancel request [2026-04-15 23:22:14,100][ INFO][PID:2874323] Allocated host ResallocHost, ticket_id=4102, hostname=2620:52:6:1161:dead:beef:cafe:c900, name=vmhost_p09_01_dev_02147635_20260415_231843, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:22:14,101][ INFO][PID:2874323] Allocating ssh connection to builder [2026-04-15 23:22:14,102][ INFO][PID:2874323] Checking that builder machine is OK [2026-04-15 23:22:15,010][ INFO][PID:2874323] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:22:15,010][ ERROR][PID:2874323] Re-try request for task on 'ResallocHost, ticket_id=4102, hostname=2620:52:6:1161:dead:beef:cafe:c900, name=vmhost_p09_01_dev_02147635_20260415_231843, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:22:15,011][ INFO][PID:2874323] VM Release request [2026-04-15 23:22:15,072][ ERROR][PID:2874323] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c904', '2620:52:6:1161:dead:beef:cafe:c900', '54.226.118.232'} [2026-04-15 23:22:15,073][WARNING][PID:2874323] Switching not-finished job state to 'failed' [2026-04-15 23:22:15,074][ INFO][PID:2874323] Worker failed build, took 313.6069128513336 [2026-04-15 23:22:15,076][ INFO][PID:2874323] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": null, "enable_net": true, "project_owner": "@copr", "project_name": "TEST1776292405165025813-Architectures", "project_dirname": "TEST1776292405165025813-Architectures", "submitter": "frostyx", "ended_on": 1776295335.0738993, "started_on": 1776295021.4669864, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "2925264", "build_id": 2925264, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 1, "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/hello-2.8-1.src.rpm\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@copr/TEST1776292405165025813-Architectures--frostyx", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "distributions_in_build": [], "distributions_in_project": [ "epel-9", "fedora-43" ], "destdir": "/var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1776292405165025813-Architectures", "result_dir": "02925264", "built_packages": "", "tags": [ "arch_noarch" ], "id": 2925264, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "TEST1776292405165025813-Architectures", "vendor": "Fedora Project COPR (@copr/TEST1776292405165025813-Architectures)" } } ] } [2026-04-15 23:22:15,200][ INFO][PID:2874323] Sending fedora-messaging bus message in build.end [2026-04-15 23:22:17,731][ INFO][PID:2874323] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/builder-live.log by gzip [2026-04-15 23:22:17,739][ INFO][PID:2874323] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/builder-live.log' as PID 2886709 [2026-04-15 23:22:17,745][ INFO][PID:2874323] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/builder-live.log: No such file or directory [2026-04-15 23:22:17,747][ ERROR][PID:2874323] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/builder-live.log [2026-04-15 23:22:17,749][ INFO][PID:2874323] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/backend.log by gzip [2026-04-15 23:22:17,757][ INFO][PID:2874323] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405165025813-Architectures/srpm-builds/02925264/backend.log' as PID 2886710