[2026-04-15 23:14:10,022][ INFO][PID:2867193] Marking build as starting [2026-04-15 23:14:10,165][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:10,175][ INFO][PID:2867193] VM allocation process starts [2026-04-15 23:14:10,205][ INFO][PID:2867193] Trying to allocate VM: ResallocHost, ticket_id=3987, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:14:15,214][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:20,217][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:25,222][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:30,231][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:35,237][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:40,242][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:45,247][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:50,250][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:14:55,252][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:00,256][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:05,259][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:10,263][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:15,268][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:20,271][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:25,273][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:30,277][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:35,280][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:40,289][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:45,296][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:50,301][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:55,310][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:58,446][ INFO][PID:2867193] Allocated host ResallocHost, ticket_id=3987, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_04_dev_02147611_20260415_231328, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:15:58,447][ INFO][PID:2867193] Allocating ssh connection to builder [2026-04-15 23:15:58,447][ INFO][PID:2867193] Checking that builder machine is OK [2026-04-15 23:15:59,140][ INFO][PID:2867193] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:15:59,143][ ERROR][PID:2867193] Re-try request for task on 'ResallocHost, ticket_id=3987, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_04_dev_02147611_20260415_231328, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:15:59,144][ INFO][PID:2867193] VM Release request [2026-04-15 23:15:59,212][ INFO][PID:2867193] Retry #1 (on other host) [2026-04-15 23:15:59,217][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:15:59,220][ INFO][PID:2867193] VM allocation process starts [2026-04-15 23:15:59,270][ INFO][PID:2867193] Trying to allocate VM: ResallocHost, ticket_id=4039, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:16:04,277][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:09,281][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:14,287][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:19,296][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:24,300][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:29,302][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:34,307][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:39,312][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:44,316][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:49,319][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:54,323][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:16:59,327][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:04,330][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:09,333][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:14,336][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:19,341][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:24,345][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:29,348][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:34,353][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:39,359][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:44,363][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:47,625][ INFO][PID:2867193] Allocated host ResallocHost, ticket_id=4039, hostname=54.226.76.41, name=aws_aarch64_spot_dev_02147621_20260415_231533, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:17:47,625][ INFO][PID:2867193] Allocating ssh connection to builder [2026-04-15 23:17:47,627][ INFO][PID:2867193] Checking that builder machine is OK [2026-04-15 23:17:48,032][ INFO][PID:2867193] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:17:48,034][ ERROR][PID:2867193] Re-try request for task on 'ResallocHost, ticket_id=4039, hostname=54.226.76.41, name=aws_aarch64_spot_dev_02147621_20260415_231533, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:17:48,036][ INFO][PID:2867193] VM Release request [2026-04-15 23:17:48,064][ INFO][PID:2867193] Retry #2 (on other host) [2026-04-15 23:17:48,067][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:48,068][ INFO][PID:2867193] VM allocation process starts [2026-04-15 23:17:48,098][ INFO][PID:2867193] Trying to allocate VM: ResallocHost, ticket_id=4075, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:17:53,101][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:17:58,106][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:03,110][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:08,117][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:13,121][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:18,126][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:23,134][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:28,137][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:33,146][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:38,148][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:43,150][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:48,152][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:53,153][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:18:58,161][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:03,167][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:08,170][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:13,175][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:18,180][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:23,183][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:28,185][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:33,188][ INFO][PID:2867193] Checking for cancel request [2026-04-15 23:19:36,318][ INFO][PID:2867193] Allocated host ResallocHost, ticket_id=4075, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_01_dev_02147624_20260415_231638, requested_tags=['arch_noarch', 'copr_builder'] [2026-04-15 23:19:36,320][ INFO][PID:2867193] Allocating ssh connection to builder [2026-04-15 23:19:36,321][ INFO][PID:2867193] Checking that builder machine is OK [2026-04-15 23:19:36,888][ INFO][PID:2867193] Installed copr-rpmbuild version: 1.6 [2026-04-15 23:19:36,889][ ERROR][PID:2867193] Re-try request for task on 'ResallocHost, ticket_id=4075, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_01_dev_02147624_20260415_231638, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1 [2026-04-15 23:19:36,890][ INFO][PID:2867193] VM Release request [2026-04-15 23:19:36,905][ ERROR][PID:2867193] Backend process error: Three host tried without success: {'54.226.76.41', '2620:52:6:1161:dead:beef:cafe:c908', '2620:52:6:1161:dead:beef:cafe:c905'} [2026-04-15 23:19:36,909][WARNING][PID:2867193] Switching not-finished job state to 'failed' [2026-04-15 23:19:36,910][ INFO][PID:2867193] Worker failed build, took 326.89529967308044 [2026-04-15 23:19:36,912][ INFO][PID:2867193] Sending build state back to frontend: { "builds": [ { "timeout": 108000, "frontend_base_url": "https://copr.stg.fedoraproject.org", "memory_reqs": null, "enable_net": true, "project_owner": "@copr", "project_name": "TEST1776292405179016455-build-batches", "project_dirname": "TEST1776292405179016455-build-batches", "submitter": "frostyx", "ended_on": 1776295176.90934, "started_on": 1776294850.0140402, "submitted_on": null, "status": 0, "chroot": "srpm-builds", "arch": null, "buildroot_pkgs": null, "task_id": "2925262", "build_id": 2925262, "package_name": null, "package_version": null, "git_repo": null, "git_hash": null, "git_branch": null, "source_type": 1, "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/hello-2.8-1.src.rpm\"}", "pkg_name": null, "pkg_main_version": null, "pkg_epoch": null, "pkg_release": null, "srpm_url": null, "uses_devel_repo": null, "sandbox": "@copr/TEST1776292405179016455-build-batches--frostyx", "results": null, "appstream": false, "allow_user_ssh": null, "ssh_public_keys": null, "storage": null, "repos": [], "background": false, "distributions_in_build": [], "distributions_in_project": [ "fedora-43" ], "destdir": "/var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches", "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1776292405179016455-build-batches", "result_dir": "02925262", "built_packages": "", "tags": [ "arch_noarch" ], "id": 2925262, "mockchain_macros": { "copr_username": "@copr", "copr_projectname": "TEST1776292405179016455-build-batches", "vendor": "Fedora Project COPR (@copr/TEST1776292405179016455-build-batches)" } } ] } [2026-04-15 23:19:37,003][ INFO][PID:2867193] Sending fedora-messaging bus message in build.end [2026-04-15 23:19:39,122][ INFO][PID:2867193] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/builder-live.log by gzip [2026-04-15 23:19:39,126][ INFO][PID:2867193] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/builder-live.log' as PID 2880365 [2026-04-15 23:19:39,131][ INFO][PID:2867193] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/builder-live.log) stdout: stderr: gzip: /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/builder-live.log: No such file or directory [2026-04-15 23:19:39,133][ ERROR][PID:2867193] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/builder-live.log [2026-04-15 23:19:39,135][ INFO][PID:2867193] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/backend.log by gzip [2026-04-15 23:19:39,141][ INFO][PID:2867193] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405179016455-build-batches/srpm-builds/02925262/backend.log' as PID 2880366