Proxmox Stuck on Grub Bootloader, How do I connect and install via terminal?

[shawlz]

Hello, I'm new to using lima to run VM on MacOSX so apologies for the noob question.

The VM starts, but it's stuck at the grub bootloader, so I can't connect via SSH.

How do I do either of the following, please?

• Connect via Serial Port to kickstart the installation process?
• Connect via Display to VM?
• Any other ideas on how to run Proxmox

proxmox.yaml

arch: "x86_64"
images:
  - location: "file:///XXXXXXXproxmox-ve_8.3-1.iso" # Replace with the absolute path to your ISO
    arch: "x86_64"
    type: iso
cpu: 2
memory: "4GiB"
disk: "40GiB"
ssh:
  localPort: 60022
mounts:
  - location: "~"
    writable: false
boot:
  kernelCmdline: "console=ttyS0"
provision:
  - mode: system
    script: |
      #!/bin/bash
      echo "Custom VM provisioning"

serial.log

3h3h3hBdsDxe: failed to load Boot0001 "UEFI QEMU QEMU CD-ROM " from PciRoot(0x0)/Pci(0x1,0x0)/Scsi(0x0,0x0): Not Found
BdsDxe: loading Boot0002 "UEFI QEMU DVD-ROM QM00001 " from PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x0,0xFFFF,0x0)
BdsDxe: starting Boot0002 "UEFI QEMU DVD-ROM QM00001 " from PciRoot(0x0)/Pci(0x1F,0x2)/Sata(0x0,0xFFFF,0x0)
Welcome to GRUB!

^Merror: file `/EFI/' not found.
^Merror: no such device: /.disk/info.
^Merror: no such device: /.disk/mini-info.
^MGNU GRUB  version 2.06-13+pmx2

^M+----------------------------------------------------------------------------+||||||||||||||||||||||||+----------------------------------------------------------------------------+     Use the ^ and v keys to select which entry is highlighted.
^M      Press enter to boot the selected OS, `e' to edit the commands
^M      before booting or `c' for a command-line.                            *Install Proxmox VE (Graphical)                                              Install Proxmox VE (Terminal UI)                                            Install Proxmox VE (Terminal UI, Serial Console)                            Advanced Options

System Information
system_profiler SPSoftwareDataType SPHardwareDataType

Software:
    System Software Overview:
      System Version: macOS 14.6.1 (23G93)
      Kernel Version: Darwin 23.6.0
      Boot Volume: Macintosh HD
      Boot Mode: Normal
      Secure Virtual Memory: Enabled
      System Integrity Protection: Enabled

Hardware:

    Hardware Overview:
      Model Name: MacBook Pro
      Model Identifier: MacBookPro18,1
      Model Number: Z14W00105LL/A
      Chip: Apple M1 Pro
      Total Number of Cores: 10 (8 performance and 2 efficiency)
      Memory: 32 GB
      System Firmware Version: 10151.140.19
      OS Loader Version: 10151.140.19

[afbjorklund]

Any other ideas on how to run Proxmox

Proxmox VE is a virtualization solution (KVM) for bare-metal, so it seems to be of limited value to run it inside another hypervisor?

https://www.proxmox.com/en/proxmox-virtual-environment/overview (it sounds like a https://en.wikipedia.org/wiki/XY_problem)

Error itself seems to be related to UEFI, maybe it still requires BIOS?

EDIT: It does start OK in QEMU, so maybe the problem lies within VZ

[afbjorklund]

It could be a nice solution for running Lima instances on though, by using a local computer that is accessed over network...

• Libvirt driver, for hypervisors on remote machines  #2031

But Proxmox uses a custom REST API (as far as I know), not libvirt.

[shawlz]

Yes, I understand it's a virtualization solution for bare metal and my use case is purely for learning & experimentation.

I've been able to run Proxmox in VirtualBox & Parallels Desktop on an Intel MacBook Pro and tested a couple of things.

The reason I'm trying it on Lima is that I can't run Proxmox on VirtualBox or Parallels Desktop on my M1 Mackbook Pro which is my primary laptop, due to lack of support for Apple Silicon and the ARM architecture.

I noticed Lens desktop runs Kubernetes on Qemu successfully on M1 Macbook Pro and emulates the amd64 architecture, hence I'm thinking might be possible for me to run Proxmox via Lima.

[shawlz]

I think my main problem is my lack of understanding on how to connect to the serial console or any other interface and kickstart the installation process.

I've look into the documentation but can't seem to be able to find it. Please could you point me in the right direction?

[afbjorklund]

While you can't run KVM in emulation, you should be able to run Kubernetes on ARM or to run amd64 containers on ARM.

https://lima-vm.io/docs/config/multi-arch/ (getting Kubernetes to schedule amd64 on an arm64 node is an advanced topic)

[afbjorklund]

Unfortunately Kubernetes has the same issue due to their outdated tutorial, but I think they run it using kind?

https://kubernetes.io/docs/tutorials/kubernetes-basics/deploy-app/deploy-intro/ - using the same binfmt_misc

[afbjorklund]

The serial sockets are only documented here: https://lima-vm.io/docs/dev/internals/

[shawlz]

Thanks a lot

[shawlz]

Got it up and running! Thanks a lot again!

[jandubois]

Could you post a summary of what the problem was, and how you fixed it? So if somebody else comes to this discussion (e.g. via Google search), they also get the solution? Thanks!