I just started playing last night and was doing the sparring with either the swordsmen,macemen, etc.  When the four characters come at you, if you happen to hit pause and come back only three will be there and the spar session will not finish.