You've got the right idea! My bank account's main purpose is for buying bitcoin.
But also food, groceries, bills.
But if you really hate banks, and want dollars, have cash in a safe.