I do keep track of it, and it does play a part in my selection, but it's not the be-all-and-end-all... no single factor is. I had 2 smaller cows this year (4 year olds) have the 2 biggest calves, both steers, with ADG's of 3 and 3.125 lbs respectively... ADG's only really matter if you're buying them live... cow calf guys it's the raw weaning weight that matters, and as long as the cow can handle the bigger birthweight, she's putting money in the pocket.
The cow with the bigger steer had a pretty dinky heifer for the first attempt, but she was nicely put together, second calf was average weight and looked really nice, and hit a home run this time (115 lb bw, 625lb @ 172 days.. Her full brother is my homegrown bull.
The other did really well on the first calf and got a little thin doing it, second calf was smaller, and this years was my 4H hopeful, one of the nicest all-around steers I think we've ever had... he was 100 lb bw, 600@160 days
My worst performers were 2 of the first timers with heifer calves, both were around 1.5 lb/day, but both cows were very small cows as well (900 lb?) that come from good lines, I think they'll do better once they get their place settled in the pecking order and can actually eat their fill, the two other first timers were bigger and had steers, they were both around 2.1lb/day and "tougher" cows, bigger too by at least a frame score or two though as well
Overall, I think my average is about 2.5-2.75 lb/day.. no creep feed, no grain, no ralgrow, just grass, hay and milk (OK, salt and mineral)