My kids are 8, 6, 4, and 1 and we've had toddlers there since we took my oldest at around age 3. It 100% depends on the kid - some are going to be overstimulated and crazy, mine have always been big sleepers and were ready for stroller naps by 10am in addition to the regular afternoon nap at 2. We are militant about nap schedules, but did not go back to the hotel room for naps. too much FOMO, and they ended up falling asleep for an hour or two in the stroller anyway. Get grocery delivery/go somewhere and bring tons of toddler snacks. For big rides, we always left an adult with the toddler buckled in the stroller, because once they start running around it's game over and frankly they'll just get run over by a person or an ECV anyway. The toon town playground is the only place I felt ok having a small kid walking around.
Maybe this is an unpopular opinion, but basically we just did what we wanted to do, and there were enough "everybody" rides sprinkled in that the little kids don't get bored. Kids never like the things you think they will, and then they throw a tantrum and everyone is pissed because "we spent $200 for this and why don't you like mickey in real life when you love him at home???." So my advice would be don't plan your day around the baby, plan it around what you want to do and know it might just take a little longer than normal. there was always so much people watching my kids didn't care about being in the stroller most of the time.