Why does morale change between attacks on the same target?

I make an attack against a player and lose 2% morale. The next attack I make is against the same player and he is only down the 1 planet. I lose 6% morale.

This has happened 2 different times. What gives?

depends if it is a core system you are attacking