I worry about mine a bunch, all aspects, but this I don't worry too much about. You'll be able to tell if he's not getting enough. Trust me.
I bought some cows back in the summer (the rest as pairs fall '13) so I didn't know much about them, but I suppose this could happen to any of them, any age, on any given year. I had a cow calve and about three days later he was as poor as a snake. Obviously something was wrong, got them up and milked momma some, had SOME milk. Like you, I didn't know if it was enough and something wrong with the calf or what was up. I put them in the barn and poured the feed to her and good hay. Meanwhile, I got the calf on a bottle and he went right to it, like he was starving to death. Between me and her, we got him through a week or so of it until she came to her milk. He's growing like a weed now. Luckily, she was very easy to work with around him. I'd carry her feed in and bottle him right next to her. They are a lot easier to help when it seems they appreciate it and don't try to freight train you. :lol2:
I had one have some trouble last year. Trying to help them, and cow would try to eat me up. Couldn't really help like I wanted, didn't know what I could do or what I should do really. Lost the calf on a cold night. I have decided, after the pleasure of working with this last one, that they better raise one on their own, or let me help them. Otherwise somebody is gonna be putting them with bacon, cheese, mustard, onion, and pickles instead of back out with the bunch.
Good luck with your baby