[2026-04-15 22:57:47,856][  INFO][PID:2825186] Marking build as starting
[2026-04-15 22:57:47,997][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:57:48,001][  INFO][PID:2825186] VM allocation process starts
[2026-04-15 22:57:48,031][  INFO][PID:2825186] Trying to allocate VM: ResallocHost, ticket_id=3499, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 22:57:53,040][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:57:58,043][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:03,047][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:08,054][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:13,056][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:18,059][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:23,062][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:28,065][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:33,075][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:38,077][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:43,084][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:48,094][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:53,096][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:58:58,098][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:03,102][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:08,105][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:13,111][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:18,122][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:23,125][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:28,131][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:33,134][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:38,137][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:43,140][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:48,144][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:53,145][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 22:59:58,150][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:03,156][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:08,165][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:13,185][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:18,196][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:23,204][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:28,208][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:33,216][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:38,225][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:43,227][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:48,230][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:53,235][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:00:58,241][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:03,243][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:06,395][  INFO][PID:2825186] Allocated host ResallocHost, ticket_id=3499, hostname=3.95.28.120, name=aws_x86_64_spot_dev_02147557_20260415_225835, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:01:06,397][  INFO][PID:2825186] Allocating ssh connection to builder
[2026-04-15 23:01:06,399][  INFO][PID:2825186] Checking that builder machine is OK
[2026-04-15 23:01:06,855][  INFO][PID:2825186] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:01:06,860][ ERROR][PID:2825186] Re-try request for task on 'ResallocHost, ticket_id=3499, hostname=3.95.28.120, name=aws_x86_64_spot_dev_02147557_20260415_225835, requested_tags=['arch_x86_64', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:01:06,865][  INFO][PID:2825186] VM Release request
[2026-04-15 23:01:06,896][  INFO][PID:2825186] Retry #1 (on other host)
[2026-04-15 23:01:06,902][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:06,904][  INFO][PID:2825186] VM allocation process starts
[2026-04-15 23:01:06,966][  INFO][PID:2825186] Trying to allocate VM: ResallocHost, ticket_id=3566, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:01:11,975][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:16,977][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:21,985][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:26,987][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:31,993][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:37,001][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:42,011][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:47,012][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:52,016][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:01:57,022][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:02,024][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:07,026][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:12,038][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:17,040][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:22,044][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:27,049][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:32,051][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:37,056][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:42,061][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:47,073][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:52,075][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:02:57,081][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:02,086][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:07,089][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:12,092][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:17,095][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:22,102][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:27,105][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:32,110][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:37,117][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:42,119][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:47,122][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:52,129][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:03:57,134][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:02,138][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:07,143][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:12,149][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:17,153][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:22,156][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:25,420][  INFO][PID:2825186] Allocated host ResallocHost, ticket_id=3566, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:25,422][  INFO][PID:2825186] Allocating ssh connection to builder
[2026-04-15 23:04:25,423][  INFO][PID:2825186] Checking that builder machine is OK
[2026-04-15 23:04:26,043][  INFO][PID:2825186] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:04:26,045][ ERROR][PID:2825186] Re-try request for task on 'ResallocHost, ticket_id=3566, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:04:26,049][  INFO][PID:2825186] VM Release request
[2026-04-15 23:04:26,087][  INFO][PID:2825186] Retry #2 (on other host)
[2026-04-15 23:04:26,089][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:26,091][  INFO][PID:2825186] VM allocation process starts
[2026-04-15 23:04:26,148][  INFO][PID:2825186] Trying to allocate VM: ResallocHost, ticket_id=3658, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:29,196][  INFO][PID:2825186] Allocated host ResallocHost, ticket_id=3658, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:29,197][  INFO][PID:2825186] Allocating ssh connection to builder
[2026-04-15 23:04:29,203][  INFO][PID:2825186] Checking that builder machine is OK
[2026-04-15 23:04:29,308][  INFO][PID:2825186] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:04:29,309][ ERROR][PID:2825186] Re-try request for task on 'ResallocHost, ticket_id=3658, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:04:29,311][  INFO][PID:2825186] VM Release request
[2026-04-15 23:04:29,342][  INFO][PID:2825186] Retry #3 (on other host)
[2026-04-15 23:04:29,345][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:29,348][  INFO][PID:2825186] VM allocation process starts
[2026-04-15 23:04:29,386][  INFO][PID:2825186] Trying to allocate VM: ResallocHost, ticket_id=3660, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:32,444][  INFO][PID:2825186] Allocated host ResallocHost, ticket_id=3660, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:32,444][  INFO][PID:2825186] Allocating ssh connection to builder
[2026-04-15 23:04:32,445][  INFO][PID:2825186] Checking that builder machine is OK
[2026-04-15 23:04:32,539][  INFO][PID:2825186] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:04:32,540][ ERROR][PID:2825186] Re-try request for task on 'ResallocHost, ticket_id=3660, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:04:32,541][  INFO][PID:2825186] VM Release request
[2026-04-15 23:04:32,589][  INFO][PID:2825186] Retry #4 (on other host)
[2026-04-15 23:04:32,590][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:32,597][  INFO][PID:2825186] VM allocation process starts
[2026-04-15 23:04:32,645][  INFO][PID:2825186] Trying to allocate VM: ResallocHost, ticket_id=3662, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:37,651][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:38,772][  INFO][PID:2825186] Allocated host ResallocHost, ticket_id=3662, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:38,773][  INFO][PID:2825186] Allocating ssh connection to builder
[2026-04-15 23:04:38,776][  INFO][PID:2825186] Checking that builder machine is OK
[2026-04-15 23:04:38,908][  INFO][PID:2825186] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:04:38,908][ ERROR][PID:2825186] Re-try request for task on 'ResallocHost, ticket_id=3662, hostname=2620:52:6:1161:dead:beef:cafe:c905, name=vmhost_x86_02_dev_02147566_20260415_230129, requested_tags=['arch_x86_64', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:04:38,912][  INFO][PID:2825186] VM Release request
[2026-04-15 23:04:39,006][  INFO][PID:2825186] Retry #5 (on other host)
[2026-04-15 23:04:39,010][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:39,024][  INFO][PID:2825186] VM allocation process starts
[2026-04-15 23:04:39,112][  INFO][PID:2825186] Trying to allocate VM: ResallocHost, ticket_id=3664, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:04:44,131][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:49,140][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:54,150][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:04:59,162][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:04,166][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:09,169][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:14,174][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:19,181][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:24,183][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:29,185][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:34,191][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:39,196][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:44,207][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:49,209][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:54,217][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:05:59,221][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:04,232][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:09,242][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:14,246][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:19,252][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:24,256][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:29,262][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:34,264][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:39,265][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:44,268][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:49,271][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:54,274][  INFO][PID:2825186] Checking for cancel request
[2026-04-15 23:06:57,577][  INFO][PID:2825186] Allocated host ResallocHost, ticket_id=3664, hostname=2620:52:6:1161:dead:beef:cafe:c90b, name=vmhost_x86_04_dev_02147579_20260415_230419, requested_tags=['arch_x86_64', 'copr_builder']
[2026-04-15 23:06:57,579][  INFO][PID:2825186] Allocating ssh connection to builder
[2026-04-15 23:06:57,581][  INFO][PID:2825186] Checking that builder machine is OK
[2026-04-15 23:06:58,283][  INFO][PID:2825186] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:06:58,284][ ERROR][PID:2825186] Re-try request for task on 'ResallocHost, ticket_id=3664, hostname=2620:52:6:1161:dead:beef:cafe:c90b, name=vmhost_x86_04_dev_02147579_20260415_230419, requested_tags=['arch_x86_64', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:06:58,288][  INFO][PID:2825186] VM Release request
[2026-04-15 23:06:58,313][ ERROR][PID:2825186] Backend process error: Three host tried without success: {'3.95.28.120', '2620:52:6:1161:dead:beef:cafe:c90b', '2620:52:6:1161:dead:beef:cafe:c905'}
[2026-04-15 23:06:58,314][WARNING][PID:2825186] Switching not-finished job state to 'failed'
[2026-04-15 23:06:58,316][  INFO][PID:2825186] Worker failed build, took 550.4750163555145
[2026-04-15 23:06:58,319][  INFO][PID:2825186] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.stg.fedoraproject.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "frostyx",
            "project_name": "custom-1-TEST1776292405174821912",
            "project_dirname": "custom-1-TEST1776292405174821912",
            "submitter": "frostyx",
            "ended_on": 1776294418.3135273,
            "started_on": 1776293867.838511,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": "x86_64",
            "buildroot_pkgs": null,
            "task_id": "2925284",
            "build_id": 2925284,
            "package_name": "quick-package",
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 9,
            "source_json": "{\"script\": \"#! /bin/sh -x\\n\\nset -e\\n\\ngenerate_specfile()\\n{\\n    test -n \\\"$DESTDIR\\\" && mkdir -p \\\"$DESTDIR\\\"\\n\\n    test -n \\\"$BUILDDEPS\\\" && {\\n        for i in $BUILDDEPS; do\\n            rpm -q $i\\n        done\\n    }\\n\\n    if ${HOOK_PAYLOAD-false}; then\\n        test -f hook_payload\\n        test \\\"$(cat hook_payload)\\\" = \\\"{\\\\\\\"a\\\\\\\": \\\\\\\"b\\\\\\\"}\\\"\\n    else\\n        ! test -f hook_payload\\n    fi\\n\\ncat > \\\"${DESTDIR-.}\\\"/quick-package.spec <<\\\\EOF\\nName:           quick-package\\nVersion:        0\\nRelease:        0%{?dist}\\nSummary:        dummy package\\nLicense:        GPL\\nURL:            http://example.com/\\n\\n%{!?_pkgdocdir: %global _pkgdocdir %{_docdir}/%{name}-%{version}}\\n\\n%description\\nnothing\\n\\n\\n%install\\nmkdir -p $RPM_BUILD_ROOT/%{_pkgdocdir}\\necho \\\"this does nothing\\\" > $RPM_BUILD_ROOT/%{_pkgdocdir}/README\\n\\n\\n%files\\n%doc %{_pkgdocdir}/README\\n\\n\\n%changelog\\n* Thu Jun 05 2014 Pavel Raiskup <praiskup@redhat.com> - 0-1\\n- does nothing!\\nEOF\\n}\\nDESTDIR=rrr generate_specfile\\n\", \"chroot\": \"fedora-rawhide-x86_64\", \"builddeps\": null, \"resultdir\": \"rrr\", \"repos\": \"\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "frostyx/custom-1-TEST1776292405174821912--frostyx",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "distributions_in_build": [
                "fedora-rawhide"
            ],
            "distributions_in_project": [
                "fedora-rawhide"
            ],
            "destdir": "/var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912",
            "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/frostyx/custom-1-TEST1776292405174821912",
            "result_dir": "02925284",
            "built_packages": "",
            "tags": [
                "arch_x86_64"
            ],
            "id": 2925284,
            "mockchain_macros": {
                "copr_username": "frostyx",
                "copr_projectname": "custom-1-TEST1776292405174821912",
                "vendor": "Fedora Project COPR (frostyx/custom-1-TEST1776292405174821912)"
            }
        }
    ]
}
[2026-04-15 23:06:58,443][  INFO][PID:2825186] Sending fedora-messaging bus message in build.end
[2026-04-15 23:06:59,940][  INFO][PID:2825186] Compressing /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/builder-live.log by gzip
[2026-04-15 23:06:59,946][  INFO][PID:2825186] Running command 'gzip /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/builder-live.log' as PID 2848184
[2026-04-15 23:06:59,953][  INFO][PID:2825186] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/builder-live.log)
stdout:

stderr:
gzip: /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/builder-live.log: No such file or directory


[2026-04-15 23:06:59,954][ ERROR][PID:2825186] Unable to compress file /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/builder-live.log
[2026-04-15 23:06:59,958][  INFO][PID:2825186] Compressing /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/backend.log by gzip
[2026-04-15 23:06:59,968][  INFO][PID:2825186] Running command 'gzip /var/lib/copr/public_html/results/frostyx/custom-1-TEST1776292405174821912/srpm-builds/02925284/backend.log' as PID 2848185