With this risk profile, I would suggest using Tails with a no KYC SIM or neighbors WiFi as your exit point, as it is what the Hosting might register from you. Of course they still can access the VPS. Paranoia is never ending, but this VPN use case is more Home intended.

BTW, thanks @ek for your contributions to the space!!!