Ferroelectric surfaces can have very high surface charge densities that can be harnessed for manipulation of charged colloidal particles and soft matter in aqueous environments. Here, we report on the electrical double layer (EDL) formed by polarized ultrasmooth lead zirconium titanate (US-PZT) thin films in dilute electrolyte solutions. Using colloidal probe force microscopy (CPFM) measurements, we show that the ion distribution within the double layer can be changed by reversing the ferroelectric polarization state of US-PZT. The interaction force in dilute 1:1 electrolyte solution between the negatively charged probe and a positive surface charge (upward polarized) US-PZT thin film is attractive, while the interaction force is repulsive for a negative surface charge (downward polarized) film. We modeled these interactions with a constant-potential EDL model between dissimilar surfaces with the inclusion of a Stern layer. We report the surface potentials at the inner and outer-Helmholtz planes both for polarization states and for a range of ionic strength solutions. Effects of free-charge carriers, limitations of the analytical model, and effects of surface roughness are discussed.Keywords: colloidal probe force microscopy; electrolyte solution; interfacial forces; lead zirconium titante; PZT; surface charge;