I had this problem too, but i fixed it!!
You need to get the entire house pretty much well furnished. Beds, tables, chairs, CHESTS.
Anything that says 'Child's' you need to get in order for your family to move. As soon as I got the Children's chest i got the option to move my family, i then fast travelled to Lake View Manor and waited 24 hours to be sure. :P Worked just fine, they all appeared happy.
I also moved them from Honeyside. I don't think Breezehome would affect anything. Give this a shot :)