[2026-04-15 23:18:27,249][  INFO][PID:2877827] Marking build as starting
[2026-04-15 23:18:27,387][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:18:27,397][  INFO][PID:2877827] VM allocation process starts
[2026-04-15 23:18:27,468][  INFO][PID:2877827] Trying to allocate VM: ResallocHost, ticket_id=4090, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:18:32,476][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:18:37,479][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:18:42,484][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:18:47,488][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:18:52,490][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:18:57,493][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:02,496][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:07,503][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:12,510][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:17,512][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:22,516][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:27,520][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:32,522][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:37,530][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:42,532][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:47,534][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:52,536][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:19:57,538][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:02,543][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:07,549][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:12,552][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:17,557][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:22,561][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:27,566][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:32,572][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:37,584][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:42,599][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:45,780][  INFO][PID:2877827] Allocated host ResallocHost, ticket_id=4090, hostname=2620:52:6:1161:dead:beef:cafe:c903, name=vmhost_p09_04_dev_02147626_20260415_231654, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:20:45,783][  INFO][PID:2877827] Allocating ssh connection to builder
[2026-04-15 23:20:45,783][  INFO][PID:2877827] Checking that builder machine is OK
[2026-04-15 23:20:46,901][  INFO][PID:2877827] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:20:46,901][ ERROR][PID:2877827] Re-try request for task on 'ResallocHost, ticket_id=4090, hostname=2620:52:6:1161:dead:beef:cafe:c903, name=vmhost_p09_04_dev_02147626_20260415_231654, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:20:46,908][  INFO][PID:2877827] VM Release request
[2026-04-15 23:20:46,963][  INFO][PID:2877827] Retry #1 (on other host)
[2026-04-15 23:20:46,970][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:46,977][  INFO][PID:2877827] VM allocation process starts
[2026-04-15 23:20:47,039][  INFO][PID:2877827] Trying to allocate VM: ResallocHost, ticket_id=4103, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:20:52,048][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:53,110][  INFO][PID:2877827] Allocated host ResallocHost, ticket_id=4103, hostname=2620:52:6:1161:dead:beef:cafe:c903, name=vmhost_p09_04_dev_02147626_20260415_231654, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:20:53,111][  INFO][PID:2877827] Allocating ssh connection to builder
[2026-04-15 23:20:53,112][  INFO][PID:2877827] Checking that builder machine is OK
[2026-04-15 23:20:53,223][  INFO][PID:2877827] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:20:53,225][ ERROR][PID:2877827] Re-try request for task on 'ResallocHost, ticket_id=4103, hostname=2620:52:6:1161:dead:beef:cafe:c903, name=vmhost_p09_04_dev_02147626_20260415_231654, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:20:53,226][  INFO][PID:2877827] VM Release request
[2026-04-15 23:20:53,250][  INFO][PID:2877827] Retry #2 (on other host)
[2026-04-15 23:20:53,254][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:20:53,259][  INFO][PID:2877827] VM allocation process starts
[2026-04-15 23:20:53,317][  INFO][PID:2877827] Trying to allocate VM: ResallocHost, ticket_id=4104, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:20:58,326][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:03,328][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:08,330][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:13,333][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:18,335][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:23,338][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:28,340][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:33,343][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:38,349][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:43,352][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:48,354][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:53,362][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:21:58,364][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:03,368][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:08,369][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:13,375][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:18,380][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:21,497][  INFO][PID:2877827] Allocated host ResallocHost, ticket_id=4104, hostname=100.53.220.236, name=aws_x86_64_spot_dev_02147643_20260415_232033, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:22:21,503][  INFO][PID:2877827] Allocating ssh connection to builder
[2026-04-15 23:22:21,505][  INFO][PID:2877827] Checking that builder machine is OK
[2026-04-15 23:22:21,983][  INFO][PID:2877827] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:22:21,988][ ERROR][PID:2877827] Re-try request for task on 'ResallocHost, ticket_id=4104, hostname=100.53.220.236, name=aws_x86_64_spot_dev_02147643_20260415_232033, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:22:21,995][  INFO][PID:2877827] VM Release request
[2026-04-15 23:22:22,038][  INFO][PID:2877827] Retry #3 (on other host)
[2026-04-15 23:22:22,041][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:22,047][  INFO][PID:2877827] VM allocation process starts
[2026-04-15 23:22:22,137][  INFO][PID:2877827] Trying to allocate VM: ResallocHost, ticket_id=4133, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:22:27,151][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:32,160][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:37,162][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:42,169][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:47,172][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:52,175][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:22:57,176][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:02,186][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:07,191][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:12,194][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:17,198][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:22,203][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:27,205][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:32,206][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:37,209][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:42,213][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:47,215][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:52,220][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:23:57,226][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:24:02,233][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:24:07,241][  INFO][PID:2877827] Checking for cancel request
[2026-04-15 23:24:10,554][  INFO][PID:2877827] Allocated host ResallocHost, ticket_id=4133, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_01_dev_02147647_20260415_232141, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:24:10,556][  INFO][PID:2877827] Allocating ssh connection to builder
[2026-04-15 23:24:10,564][  INFO][PID:2877827] Checking that builder machine is OK
[2026-04-15 23:24:11,295][  INFO][PID:2877827] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:24:11,297][ ERROR][PID:2877827] Re-try request for task on 'ResallocHost, ticket_id=4133, hostname=2620:52:6:1161:dead:beef:cafe:c908, name=vmhost_x86_01_dev_02147647_20260415_232141, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:24:11,306][  INFO][PID:2877827] VM Release request
[2026-04-15 23:24:11,367][ ERROR][PID:2877827] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c903', '100.53.220.236', '2620:52:6:1161:dead:beef:cafe:c908'}
[2026-04-15 23:24:11,372][WARNING][PID:2877827] Switching not-finished job state to 'failed'
[2026-04-15 23:24:11,377][  INFO][PID:2877827] Worker failed build, took 344.13497400283813
[2026-04-15 23:24:11,378][  INFO][PID:2877827] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.stg.fedoraproject.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@copr",
            "project_name": "TEST1776292405247643484Isolation",
            "project_dirname": "TEST1776292405247643484Isolation",
            "submitter": "frostyx",
            "ended_on": 1776295451.3721511,
            "started_on": 1776295107.2371771,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "2925268",
            "build_id": 2925268,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 1,
            "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/hello-2.8-1.src.rpm\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@copr/TEST1776292405247643484Isolation--frostyx",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "distributions_in_build": [],
            "distributions_in_project": [
                "fedora-43"
            ],
            "destdir": "/var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation",
            "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1776292405247643484Isolation",
            "result_dir": "02925268",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 2925268,
            "mockchain_macros": {
                "copr_username": "@copr",
                "copr_projectname": "TEST1776292405247643484Isolation",
                "vendor": "Fedora Project COPR (@copr/TEST1776292405247643484Isolation)"
            }
        }
    ]
}
[2026-04-15 23:24:11,583][  INFO][PID:2877827] Sending fedora-messaging bus message in build.end
[2026-04-15 23:24:16,269][  INFO][PID:2877827] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/builder-live.log by gzip
[2026-04-15 23:24:16,277][  INFO][PID:2877827] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/builder-live.log' as PID 2891481
[2026-04-15 23:24:16,284][  INFO][PID:2877827] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/builder-live.log)
stdout:

stderr:
gzip: /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/builder-live.log: No such file or directory


[2026-04-15 23:24:16,286][ ERROR][PID:2877827] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/builder-live.log
[2026-04-15 23:24:16,287][  INFO][PID:2877827] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/backend.log by gzip
[2026-04-15 23:24:16,290][  INFO][PID:2877827] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405247643484Isolation/srpm-builds/02925268/backend.log' as PID 2891482