To the bowl of a stand mixer, add the yeast, sugar, milk, heavy cream, crème fraîche, egg, butter, lemon zest and vanilla. Whisk to combine. Next add in the remaining dry ingredients and mix on medium with a dough hook attachment, until well combined.