Yes. This is generally fine, because the good bacteria you added, should be stronger than any spoilage bacteria, and should be able to dominate the fermentation. Just ensure the milk is completely covered during the ripening time, to avoid contamination.