Go for it, dude.

I can't believe I'm saying this -- given that my standard trope these days is "The most important think I learnt at Oxford is that you can have a PhD and still be an idiot -- but yeah, your situation is an awesome one. Unique/unusual and not at all generalizable to *university" for the broader public