Add Yahoo as a preferred source to see more of our stories on Google. When do you give a baby their first bath? Your baby’s first bath actually isn’t a soak in the tub—it’s a sponge bath. Per Dr.