almalinux gets stuck during `🕐 SSH connection (essential)` [no longer reproducible after restarting the host] · Issue #5628 · lima-vm/lima · GitHub
Skip to content

almalinux gets stuck during 🕐 SSH connection (essential) [no longer reproducible after restarting the host] #5628

Open

Description

@AkihiroSuda

https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260817.0.aarch64.qcow2 and https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20261012.0.aarch64.qcow2 gets stuck during booting:

$ limactl start --name alma-20260817 https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260817.0.aarch64.qcow2
? Creating an instance `alma-20260817` Proceed with the current configuration
INFO[0000] Starting the instance `alma-20260817` with internal VM driver `vz` 
INFO[0000] Attempting to download the image              arch=aarch64 digest= location="https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260817.0.aarch64.qcow2"
INFO[0000] Using cache `/Users/suda/Library/Caches/lima/download/by-url-sha256/87af649469b682f380e0d57e00c049d961ee712e1d5985546e0055e8dbbc64f5/imgconv/raw` 
INFO[0000] Resize instance alma-20260817's disk from 10GiB to 100GiB 
INFO[0000] [hostagent] hostagent socket created at /Users/suda/.lima/alma-20260817/ha.sock 
INFO[0000] [hostagent] Starting VZ (hint: to watch the boot progress, see `/Users/suda/.lima/alma-20260817/serial*.log`) 
INFO[0000] [hostagent] [VZ] - vm state change: running  
INFO[0007] [hostagent] Started vsock forwarder: 127.0.0.1:60809 -> vsock:22 on VM 
INFO[0007] [hostagent] Detected SSH server is listening on the vsock port; changed 127.0.0.1:60809 to proxy for the vsock port 
INFO[0008] SSH Local Port: 60809                        
( 1/7) 🕐 SSH connection (essential)

https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260526.0.aarch64.qcow2 boots but gets stuck during 🕐 Containerd binaries to be installed

$ limactl start --name alma-20260526 https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260526.0.aarch64.qcow2
? Creating an instance `alma-20260526` Proceed with the current configuration
INFO[0000] Starting the instance `alma-20260526` with internal VM driver `vz` 
INFO[0000] Attempting to download the image              arch=aarch64 digest= location="https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260526.0.aarch64.qcow2"
INFO[0000] Using cache `/Users/suda/Library/Caches/lima/download/by-url-sha256/d644a3de408106502ce4934ee3aafb68f1cb530d1098b43bc3df0c778530ad3b/imgconv/raw` 
INFO[0000] Resize instance alma-20260526's disk from 10GiB to 100GiB 
INFO[0001] [hostagent] hostagent socket created at /Users/suda/.lima/alma-20260526/ha.sock 
INFO[0001] [hostagent] Starting VZ (hint: to watch the boot progress, see `/Users/suda/.lima/alma-20260526/serial*.log`) 
INFO[0001] [hostagent] [VZ] - vm state change: running  
INFO[0007] [hostagent] Started vsock forwarder: 127.0.0.1:60793 -> vsock:22 on VM 
INFO[0007] [hostagent] Detected SSH server is listening on the vsock port; changed 127.0.0.1:60793 to proxy for the vsock port 
INFO[0008] SSH Local Port: 60793                        
( 1/7) ✅ SSH connection
( 2/7) ✅ User session to be ready for SSH
( 3/7) ✅ Persistent SSH ControlMaster
( 4/7) 🕐 Systemd to be availableINFO[0008] [hostagent] Guest agent is running           
INFO[0008] [hostagent] Time sync: guest agent is alive, starting time synchronization 
INFO[0008] [hostagent] Not forwarding TCP 0.0.0.0:22    
INFO[0008] [hostagent] Not forwarding TCP [::]:22       
INFO[0008] [hostagent] Forwarding UDP from 127.0.0.1:323 to 127.0.0.1:323 
INFO[0008] [hostagent] Forwarding UDP from [::1]:323 to 127.0.0.1:323 
INFO[0008] [hostagent] Not forwarding UDP 0.0.0.0:323   
INFO[0008] [hostagent] Not forwarding UDP 127.0.0.1:323 
( 4/7) ✅ Systemd to be available
( 5/7) 🕐 Containerd binaries to be installed
[root@lima-alma-20260526 ~]# tail -f  /var/log/cloud-init-output.log 
+ '[' -n ' iptables fuse3' ']'
+ dnf_install_flags='-y --setopt=install_weak_deps=False'
+ epel_install_flags=
+ grep -q 'Oracle Linux Server release 8' /etc/system-release
+ grep -q 'release 8' /etc/system-release
+ grep -q 'Oracle Linux Server release 9' /etc/system-release
+ grep -q 'Oracle Linux Server release 10' /etc/system-release
+ grep -q -E 'release (9|10)' /etc/system-release
+ dnf install -y --setopt=install_weak_deps=False epel-release
AlmaLinux 10 - AppStream                         18 kB/s | 2.7 MB     02:37    

Tested with the current master f6158fe (vz mode) on macOS 27.0.1.

This is NOT a duplicate of

Activity

  1. changed the title [-]almalinux template gets stuck during `🕐 SSH connection (essential)`[/-] [+]almalinux gets stuck during `🕐 SSH connection (essential)`[/+] on Oct 15, 2026
  2. added this to the v2.3.0 milestone on Oct 16, 2026
  3. AkihiroSuda commented on Oct 16, 2026

    @AkihiroSuda
    MemberAuthor

    It works after restarting the host 🤷

  4. changed the title [-]almalinux gets stuck during `🕐 SSH connection (essential)`[/-] [+]almalinux gets stuck during `🕐 SSH connection (essential)` [no longer reproducible after restarting the host][/+] on Oct 16, 2026
  5. unsuman commented on Oct 22, 2026

    @unsuman
    Member

    Failed to repro this (current master, macOS 27.0.1):

    ➜  lima git:(blockdevice-sudoers-digest) ✗ limactl start --name alma-20260817 https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260817.0.aarch64.qcow2
    ? Creating an instance `alma-20260817` Proceed with the current configuration
    INFO[0001] Starting the instance `alma-20260817` with internal VM driver `vz` 
    INFO[0001] Attempting to download the image              arch=aarch64 digest= location="https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260817.0.aarch64.qcow2"
    INFO[0002] Using cache `/Users/ansumansahoo/Library/Caches/lima/download/by-url-sha256/87af649469b682f380e0d57e00c049d961ee712e1d5985546e0055e8dbbc64f5/imgconv/raw` 
    INFO[0002] Resize instance alma-20260817's disk from 10GiB to 100GiB 
    INFO[0004] [hostagent] hostagent socket created at /Users/ansumansahoo/.lima/alma-20260817/ha.sock 
    INFO[0004] [hostagent] Starting VZ (hint: to watch the boot progress, see `/Users/ansumansahoo/.lima/alma-20260817/serial*.log`) 
    INFO[0004] [hostagent] [VZ] - vm state change: running  
    INFO[0005] [hostagent] gvproxy API request               component=services-api endpoint=/services/dhcp/leases method=GET outcome=success source=
    INFO[0013] [hostagent] Started vsock forwarder: 127.0.0.1:57980 -> vsock:22 on VM 
    INFO[0013] [hostagent] Detected SSH server is listening on the vsock port; changed 127.0.0.1:57980 to proxy for the vsock port 
    INFO[0013] [hostagent] gvproxy API request               component=services-api endpoint=/services/dhcp/leases method=GET outcome=success source=
    INFO[0013] [hostagent] gvproxy API request               component=services-api endpoint=/services/dns/add method=POST outcome=success source= zone=internal.
    INFO[0014] SSH Local Port: 57980                        
    ( 1/7) ✅ SSH connection
    ( 2/7) ✅ User session to be ready for SSH
    ( 3/7) ✅ Persistent SSH ControlMaster
    ( 4/7) ✅ Systemd to be available
    ( 5/7) 🕐 Containerd binaries to be installedINFO[0054] [hostagent] Guest agent is running           
    INFO[0054] [hostagent] Time sync: guest agent is alive, starting time synchronization 
    INFO[0054] [hostagent] Forwarding TCP from 127.0.0.1:37005 to 127.0.0.1:37005 
    INFO[0054] [hostagent] Not forwarding TCP 0.0.0.0:22    
    INFO[0054] [hostagent] Not forwarding TCP [::]:22       
    INFO[0054] [hostagent] Forwarding UDP from 127.0.0.1:323 to 127.0.0.1:323 
    INFO[0054] [hostagent] Forwarding UDP from [::1]:323 to 127.0.0.1:323 
    INFO[0054] [hostagent] Not forwarding UDP 0.0.0.0:323   
    INFO[0054] [hostagent] Not forwarding UDP 127.0.0.1:323 
    INFO[0054] [hostagent] Not forwarding UDP 0.0.0.0:323   
    INFO[0054] [hostagent] Not forwarding UDP 127.0.0.1:323 
    ( 5/7) ✅ Containerd binaries to be installed
    ( 6/7) ✅ Guest agent to be running
    ( 7/7) ✅ Boot scripts to be finished
    INFO[0061] READY. Run `limactl shell alma-20260817` to open the shell. 
    
    ➜  lima git:(blockdevice-sudoers-digest) ✗ limactl start --name alma-20260526 https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260526.0.aarch64.qcow2
    ? Creating an instance `alma-20260526` Proceed with the current configuration
    INFO[0001] Starting the instance `alma-20260526` with internal VM driver `vz` 
    INFO[0001] Attempting to download the image              arch=aarch64 digest= location="https://repo.almalinux.org/almalinux/10.2/cloud/aarch64/images/AlmaLinux-10-GenericCloud-10.2-20260526.0.aarch64.qcow2"
    INFO[0002] Using cache `/Users/ansumansahoo/Library/Caches/lima/download/by-url-sha256/d644a3de408106502ce4934ee3aafb68f1cb530d1098b43bc3df0c778530ad3b/imgconv/raw` 
    INFO[0002] Resize instance alma-20260526's disk from 10GiB to 100GiB 
    INFO[0004] [hostagent] hostagent socket created at /Users/ansumansahoo/.lima/alma-20260526/ha.sock 
    INFO[0004] [hostagent] Starting VZ (hint: to watch the boot progress, see `/Users/ansumansahoo/.lima/alma-20260526/serial*.log`) 
    INFO[0004] [hostagent] [VZ] - vm state change: running  
    INFO[0004] [hostagent] gvproxy API request               component=services-api endpoint=/services/dhcp/leases method=GET outcome=success source=
    INFO[0013] [hostagent] Started vsock forwarder: 127.0.0.1:58059 -> vsock:22 on VM 
    INFO[0013] [hostagent] Detected SSH server is listening on the vsock port; changed 127.0.0.1:58059 to proxy for the vsock port 
    INFO[0013] [hostagent] gvproxy API request               component=services-api endpoint=/services/dhcp/leases method=GET outcome=success source=
    INFO[0013] [hostagent] gvproxy API request               component=services-api endpoint=/services/dns/add method=POST outcome=success source= zone=internal.
    INFO[0014] SSH Local Port: 58059                        
    ( 1/7) ✅ SSH connection
    ( 2/7) ✅ User session to be ready for SSH
    ( 3/7) ✅ Persistent SSH ControlMaster
    ( 4/7) 🕐 Systemd to be availableINFO[0014] [hostagent] Guest agent is running           
    INFO[0014] [hostagent] Time sync: guest agent is alive, starting time synchronization 
    INFO[0014] [hostagent] Not forwarding TCP 0.0.0.0:22    
    INFO[0014] [hostagent] Not forwarding TCP [::]:22       
    INFO[0014] [hostagent] Forwarding UDP from 127.0.0.1:323 to 127.0.0.1:323 
    INFO[0014] [hostagent] Forwarding UDP from [::1]:323 to 127.0.0.1:323 
    INFO[0014] [hostagent] Not forwarding UDP 0.0.0.0:323   
    INFO[0014] [hostagent] Not forwarding UDP 127.0.0.1:323 
    INFO[0014] [hostagent] Not forwarding UDP 0.0.0.0:323   
    INFO[0014] [hostagent] Not forwarding UDP 127.0.0.1:323 
    ( 4/7) ✅ Systemd to be available
    ( 5/7) ✅ Containerd binaries to be installed
    ( 6/7) ✅ Guest agent to be running
    ( 7/7) 🕐 Boot scripts to be finishedINFO[0046] [hostagent] Forwarding TCP from 127.0.0.1:46347 to 127.0.0.1:46347 
    ( 7/7) ✅ Boot scripts to be finished
    INFO[0055] READY. Run `limactl shell alma-20260526` to open the shell.
    
  6. removed this from the v2.3.0 milestone on Oct 23, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions