Sounds like you're frustrated with yourself. That feeling is one of the greatest things you might experience in life. Doesn't feel that way though, does it?
You're presented with a choice:
  1. Let that feeling exist in you every day here forward and suppress it.
  2. Change the actions you take every day and build yourself a life where that feeling exists no more.
In my very limited experience, some people can choose number 1 and accept it, the others simply can't.
There are no external factors at play, there are no answers from the outside world, there is no right path. All of what happens next is 100% your responsibility.
You already know all the answers.