The vast majority of the ATMs at least in the United States... require an account. In Europe it's a bit different especially Switzerland where you can buy Bitcoin no-kyc at the train stations.

In my experience the spread is ~15% so not great maybe it's better where you're at.