The characers belong to the MS Gothic font set but setting PowerShell to use this (rather ugly) font still did not render correctly and instead displayed small hollow squares.
Ugh. What did I write? The console host was written then, which is why the PowerShell team wrote the ISE for v2. If you can’t contribute positively to the conversation, at least don’t troll.