In a good situation, I wouldn't care what the neighbors raised. Problem is our main farm joins 7 other properties. At present, 5 of those have cattle, and only 2 of those 5 actually are knowledgeable, and responsible. The other situations, are always a problem waiting to happen. Each of those 3 "farms" has around 10 head at most, with one just having one cow and one bull.
One place has near zero management. The poor cows literally push the fence down trying to lick on our cattle, presumably to get salt. The "owner" is afraid of them and uses a hotshot to keep them away. We and other neighbors end up each year with her cattle getting on our property, to which we have all of the responsibility of getting them up and out as well as fence repair.
It is literally a dangerous job as we often have her bulls to get in with our cattle. They are so wild and or aggressive that we have to usually hire somebody on horseback to rope them and load them.
The other situations aren't quite that problematic but the potential is still there because one has similar hands off management, but they do have enough grass to eat, problem there is the bull spends most of its time walking the fence trying to fight with ours, so that's just a matter of time until a bull gets in another field.
The other situation, is another newcomer to cattle like the others that knows it all, yet doesn't understand about the responsibility of fences.