You are right. In cold weather more nutrients go to the calf making the calf larger.
I don't think these cattle are getting enough mineral with what they have access to.
I would definitely put them on a loose mineral year-round, not a block.
Wondering if that might make the heifers weaker when trying to calve. I do know that the longer the you wait to pull a calf, the longer it takes her to breed back. We wouldn't wait more than an hour to help, and like gcreek says, observing thousands of births, you know when they need assistance.
You are much braver than me, breeding heifers to a Charolais bull.
Every year is different, for sure.
Good luck to you!