I've always suspected that Saffir cheated on Amren, and he realized the truth when Braith was born. That's why he stopped adventuring, because he knows that he can't trust his wife and he doesn't want to end up raising another wretched kid that isn't his. It gives a completely different perspective on some of his dialogue.
"Sometimes I miss the soldier's life, but when I hold my "daughter" in my arms, I know I made the right choice." (unsaid: "because that horrible girl is clearly the result of my leaving my wife alone")
"Listen, Braith... Why don't you talk to your mother about this, okay?"