I had the exact same issues when I was running the OS off an SD card. I'd give it another go with booting off a USB -> Sata adapter with an SSD attached.
I am assuming you can do this with umbrel?
reply
I know you can setup the RPI 4 to run 100% off of USB. Once that was setup you could install linux and install Umbrel on top of that.
reply