Recently Mahony et al. 2010 reported five cases where more than one source from the Australia Telescope 20 GHz (AT20G) catalog falls within the 95% confidence ellipse of a Fermi source in the 1FGL catalog, rendering the association as ambiguous. To break this ambiguity, we have carried out a short series of Very Long Baseline Interferometry (VLBI) observations of each of the sources among the four pairs with declination above -40 degrees. The VLBI observations were carried out with the Deep Space Network’s intercontinental single baselines at 2, 8, and 32 GHz. The results from these observations provide additional information on the size of the emission region and therefore can be used as an important tool in improving the estimation of the probability of correct identification of the Fermi source. This is of course due to the fact that parsec-scale VLBI is sensitive to objects hosting compact jets, a strong characteristic of radio loud blazars.