In a medium saucepan, combine sugar, cocoa and cornstarch.
Stir together milk, peanut butter and vanilla; add to sugar mixture.
Cook and stir over medium heat until thickened and bubbly.
Cook and stir 2 minutes more.
Remove from heat.
Pour into a bowl and cover surface with plastic wrap.
Chill until set or up to 24 hours.