I think people underestimate the ability of Bitcoin core developers. They can read, understand and test the SHA256 code as well as any NSA employee.
If there was a back door it would've been found. This is one fear I don't lose sleep over