It's not just the sun, the Earth's magnetic field is also weakening and shifting - hence all the auroras being observed at really low latitudes recently.
This affects the amount and the composition of the radiation/charged particles getting to Earth.