Assess the regrets that you are feeling, and rectify what you can. If your regret is based on something you did that hurt another person, make amends. Clear the air and apologise to them.
Source: How to Overcome Regret @ eHow
Photo: I'm Sorry by Leyram Odacrem under Creative Commons license
