No, because the voltmeter to be used to measure potential difference across the p-n junction must have a very high resistance as compared to junction resistance, which is nearly infinite, if not biased. Apart from it, there are no free charge carriers in the depletion region of p-n junction.