To make the frosting, beat softened butter with an electric mixer over medium speed until smooth and creamy. Add in marshmallow creme and beat until combined. Finally add in the powdered sugar and vanilla, scraping down the sides of the bowl and mixing until smooth.