I know that I don't have the expertise to give any educated information but what directly came to my mind is:
Could the fact that we observe and measure the symetric behavior is influenced already because the matter around is matter and not anti-matter.
Would we observe something similar in direction of matter when all around is anti-matter?
Would the symetric only occour when none of the opposite would be around?