I connected to Alby and don't seem to have problems on amethyst.
You could try the new primal app. It seems to use less battery and memory for me, and the connect to Alby wallet works without issue.