To prevent the baby from waking up hungry at night, it is recommended to delay the time of the last feeding before bedtime, ensuring the baby is well-fed and falls asleep peacefully.