Just back from Oasis of the Seas!

[Disbug]

I didn't drink any of that, but I know I saw hot water for tea, and dispensers for milk and orange juice. Not sure about chocolate milk.
Denise

"Iced tap water is available at any bar or restaurant.

Coffee (not specialty), hot tea, iced tea, hot chocolate, white milk, chocolate milk, flavored water, lemonade, juice (not fresh squeezed) is available at food locations. Milk and juice are primarily available at breakfast, but have asked staff and been able to get all day, especially in places like the Windjammer and Cafe Promenade"
(This is another cruiser's response...)

This is in-line with our experience. If you need chocolate milk, milk, or hot tea and don't see it ask someone at Windjammer or Cafe Promenade.