We want to punish the other person because we suffer. Then, we have anger in us; we have violence in us, just as they do. When we see that our suffering and anger are no different from their suffering and anger, we will behave more compassionately.
So understanding the other is understanding yourself and understanding yourself is understanding the other person. Everything must begin with you.