Pretty much my whole family is sick?

It might just be that your immune system is stronger and hasn't been affected by whatever bug is going around. As for the babies its really just luck since their immune system is still developing. Your best bet is to keep them as isolated as possible from the sick family members until they are better. Also sanitize items the babies come into contact with.