[2026-04-15 23:11:39,102][  INFO][PID:2860786] Marking build as starting
[2026-04-15 23:11:39,276][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:11:39,287][  INFO][PID:2860786] VM allocation process starts
[2026-04-15 23:11:39,337][  INFO][PID:2860786] Trying to allocate VM: ResallocHost, ticket_id=3928, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:11:44,346][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:11:49,353][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:11:54,353][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:11:59,359][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:04,376][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:09,385][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:14,390][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:19,399][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:24,407][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:29,416][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:34,420][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:39,421][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:44,423][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:49,425][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:54,426][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:12:59,428][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:04,432][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:09,439][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:14,451][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:19,458][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:24,468][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:27,694][  INFO][PID:2860786] Allocated host ResallocHost, ticket_id=3928, hostname=2620:52:6:1161:dead:beef:cafe:c902, name=vmhost_p09_03_dev_02147598_20260415_230949, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:13:27,697][  INFO][PID:2860786] Allocating ssh connection to builder
[2026-04-15 23:13:27,700][  INFO][PID:2860786] Checking that builder machine is OK
[2026-04-15 23:13:28,871][  INFO][PID:2860786] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:13:28,874][ ERROR][PID:2860786] Re-try request for task on 'ResallocHost, ticket_id=3928, hostname=2620:52:6:1161:dead:beef:cafe:c902, name=vmhost_p09_03_dev_02147598_20260415_230949, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:13:28,879][  INFO][PID:2860786] VM Release request
[2026-04-15 23:13:28,918][  INFO][PID:2860786] Retry #1 (on other host)
[2026-04-15 23:13:28,920][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:28,926][  INFO][PID:2860786] VM allocation process starts
[2026-04-15 23:13:28,984][  INFO][PID:2860786] Trying to allocate VM: ResallocHost, ticket_id=3965, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:13:33,998][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:39,000][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:44,002][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:49,006][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:54,013][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:13:59,018][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:04,020][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:09,034][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:14,037][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:19,039][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:24,042][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:29,048][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:34,052][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:39,055][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:44,059][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:49,063][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:54,072][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:14:59,077][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:04,079][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:09,081][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:14,083][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:17,291][  INFO][PID:2860786] Allocated host ResallocHost, ticket_id=3965, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:17,293][  INFO][PID:2860786] Allocating ssh connection to builder
[2026-04-15 23:15:17,295][  INFO][PID:2860786] Checking that builder machine is OK
[2026-04-15 23:15:18,815][  INFO][PID:2860786] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:15:18,816][ ERROR][PID:2860786] Re-try request for task on 'ResallocHost, ticket_id=3965, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:15:18,817][  INFO][PID:2860786] VM Release request
[2026-04-15 23:15:18,874][  INFO][PID:2860786] Retry #2 (on other host)
[2026-04-15 23:15:18,876][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:18,881][  INFO][PID:2860786] VM allocation process starts
[2026-04-15 23:15:18,934][  INFO][PID:2860786] Trying to allocate VM: ResallocHost, ticket_id=4011, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:21,997][  INFO][PID:2860786] Allocated host ResallocHost, ticket_id=4011, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:21,998][  INFO][PID:2860786] Allocating ssh connection to builder
[2026-04-15 23:15:22,001][  INFO][PID:2860786] Checking that builder machine is OK
[2026-04-15 23:15:22,230][  INFO][PID:2860786] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:15:22,231][ ERROR][PID:2860786] Re-try request for task on 'ResallocHost, ticket_id=4011, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:15:22,231][  INFO][PID:2860786] VM Release request
[2026-04-15 23:15:22,272][  INFO][PID:2860786] Retry #3 (on other host)
[2026-04-15 23:15:22,278][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:22,285][  INFO][PID:2860786] VM allocation process starts
[2026-04-15 23:15:22,331][  INFO][PID:2860786] Trying to allocate VM: ResallocHost, ticket_id=4014, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:25,363][  INFO][PID:2860786] Allocated host ResallocHost, ticket_id=4014, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:25,364][  INFO][PID:2860786] Allocating ssh connection to builder
[2026-04-15 23:15:25,365][  INFO][PID:2860786] Checking that builder machine is OK
[2026-04-15 23:15:25,554][  INFO][PID:2860786] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:15:25,555][ ERROR][PID:2860786] Re-try request for task on 'ResallocHost, ticket_id=4014, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:15:25,557][  INFO][PID:2860786] VM Release request
[2026-04-15 23:15:25,575][  INFO][PID:2860786] Retry #4 (on other host)
[2026-04-15 23:15:25,576][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:25,577][  INFO][PID:2860786] VM allocation process starts
[2026-04-15 23:15:25,590][  INFO][PID:2860786] Trying to allocate VM: ResallocHost, ticket_id=4017, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:28,620][  INFO][PID:2860786] Allocated host ResallocHost, ticket_id=4017, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:28,621][  INFO][PID:2860786] Allocating ssh connection to builder
[2026-04-15 23:15:28,622][  INFO][PID:2860786] Checking that builder machine is OK
[2026-04-15 23:15:28,818][  INFO][PID:2860786] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:15:28,819][ ERROR][PID:2860786] Re-try request for task on 'ResallocHost, ticket_id=4017, hostname=140.211.168.12, name=copr_osuosl_p09_dev_02147602_20260415_231033, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:15:28,820][  INFO][PID:2860786] VM Release request
[2026-04-15 23:15:28,829][  INFO][PID:2860786] Retry #5 (on other host)
[2026-04-15 23:15:28,830][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:28,832][  INFO][PID:2860786] VM allocation process starts
[2026-04-15 23:15:28,888][  INFO][PID:2860786] Trying to allocate VM: ResallocHost, ticket_id=4020, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:15:33,891][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:38,896][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:43,898][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:48,910][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:53,912][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:15:58,916][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:03,917][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:08,920][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:13,927][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:18,929][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:23,931][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:28,934][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:33,939][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:38,944][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:43,950][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:48,953][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:53,960][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:16:58,964][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:03,968][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:08,971][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:13,978][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:18,982][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:23,986][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:28,988][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:33,993][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:38,997][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:44,001][  INFO][PID:2860786] Checking for cancel request
[2026-04-15 23:17:47,149][  INFO][PID:2860786] Allocated host ResallocHost, ticket_id=4020, hostname=2620:52:6:1161:dead:beef:cafe:c904, name=vmhost_x86_02_dev_02147619_20260415_231442, requested_tags=['arch_noarch', 'copr_builder']
[2026-04-15 23:17:47,150][  INFO][PID:2860786] Allocating ssh connection to builder
[2026-04-15 23:17:47,151][  INFO][PID:2860786] Checking that builder machine is OK
[2026-04-15 23:17:47,697][  INFO][PID:2860786] Installed copr-rpmbuild version: 1.6
[2026-04-15 23:17:47,698][ ERROR][PID:2860786] Re-try request for task on 'ResallocHost, ticket_id=4020, hostname=2620:52:6:1161:dead:beef:cafe:c904, name=vmhost_x86_02_dev_02147619_20260415_231442, requested_tags=['arch_noarch', 'copr_builder']': Minimum version for builder is 1.6.1
[2026-04-15 23:17:47,699][  INFO][PID:2860786] VM Release request
[2026-04-15 23:17:47,712][ ERROR][PID:2860786] Backend process error: Three host tried without success: {'2620:52:6:1161:dead:beef:cafe:c904', '140.211.168.12', '2620:52:6:1161:dead:beef:cafe:c902'}
[2026-04-15 23:17:47,712][WARNING][PID:2860786] Switching not-finished job state to 'failed'
[2026-04-15 23:17:47,713][  INFO][PID:2860786] Worker failed build, took 368.62313747406006
[2026-04-15 23:17:47,714][  INFO][PID:2860786] Sending build state back to frontend: {
    "builds": [
        {
            "timeout": 108000,
            "frontend_base_url": "https://copr.stg.fedoraproject.org",
            "memory_reqs": null,
            "enable_net": true,
            "project_owner": "@copr",
            "project_name": "TEST1776292405165911570-buildtag",
            "project_dirname": "TEST1776292405165911570-buildtag",
            "submitter": "frostyx",
            "ended_on": 1776295067.7126458,
            "started_on": 1776294699.0895083,
            "submitted_on": null,
            "status": 0,
            "chroot": "srpm-builds",
            "arch": null,
            "buildroot_pkgs": null,
            "task_id": "2925258",
            "build_id": 2925258,
            "package_name": null,
            "package_version": null,
            "git_repo": null,
            "git_hash": null,
            "git_branch": null,
            "source_type": 1,
            "source_json": "{\"url\": \"https://github.com/fedora-copr/copr-test-sources/raw/main/buildtag-0-0.src.rpm\"}",
            "pkg_name": null,
            "pkg_main_version": null,
            "pkg_epoch": null,
            "pkg_release": null,
            "srpm_url": null,
            "uses_devel_repo": null,
            "sandbox": "@copr/TEST1776292405165911570-buildtag--frostyx",
            "results": null,
            "appstream": false,
            "allow_user_ssh": null,
            "ssh_public_keys": null,
            "storage": null,
            "repos": [],
            "background": false,
            "distributions_in_build": [],
            "distributions_in_project": [
                "fedora-43"
            ],
            "destdir": "/var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag",
            "results_repo_url": "https://download.copr-dev.fedorainfracloud.org/results/@copr/TEST1776292405165911570-buildtag",
            "result_dir": "02925258",
            "built_packages": "",
            "tags": [
                "arch_noarch"
            ],
            "id": 2925258,
            "mockchain_macros": {
                "copr_username": "@copr",
                "copr_projectname": "TEST1776292405165911570-buildtag",
                "vendor": "Fedora Project COPR (@copr/TEST1776292405165911570-buildtag)"
            }
        }
    ]
}
[2026-04-15 23:17:47,771][  INFO][PID:2860786] Sending fedora-messaging bus message in build.end
[2026-04-15 23:17:49,396][  INFO][PID:2860786] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/builder-live.log by gzip
[2026-04-15 23:17:49,399][  INFO][PID:2860786] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/builder-live.log' as PID 2876437
[2026-04-15 23:17:49,402][  INFO][PID:2860786] Finished after 0 seconds with exit code 1 (gzip /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/builder-live.log)
stdout:

stderr:
gzip: /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/builder-live.log: No such file or directory


[2026-04-15 23:17:49,405][ ERROR][PID:2860786] Unable to compress file /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/builder-live.log
[2026-04-15 23:17:49,407][  INFO][PID:2860786] Compressing /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/backend.log by gzip
[2026-04-15 23:17:49,410][  INFO][PID:2860786] Running command 'gzip /var/lib/copr/public_html/results/@copr/TEST1776292405165911570-buildtag/srpm-builds/02925258/backend.log' as PID 2876439