Yes, that's called "offline signing", and Electrum supports that -- even on Tails. Of course, the transaction (before being signed) needs to be created with knowledge of the UTXOs, so that part occurs on a device that is online, but your private key isn't needed for that part.

See also the following posts, found here on SN:

What Is A Partially Signed Bitcoin Transaction (PSBT)? #24779 https://thebitcoinmanual.com/articles/what-is-psbt

and

What Are Partially Signed Bitcoin Transactions (PSBTs)? #136109 https://river.com/learn/what-are-partially-signed-bitcoin-transactions-psbts