https://connect.microsoft.com/VisualStudio/feedback/details/...
"System.Speech has a memory leak - by eoghanoh
Status: Closed as Won't Fix"
I see your work is based on http://hts.sp.nitech.ac.jp/ Can you tell us what are your changes?
Edit: I see HN already commented your work: