In a medium bowl, whisk together powdered sugar and cocoa powder. Slowly stir in milk and vanilla extract. Whisk until silky and smooth. If you need a touch more milk to make this a dippable glaze, add a bit more.
Dip doughnuts in chocolate glaze and let rest to harden slightly.