Thank Ahmed,
It is in DetectAnswerMachineActivity. I replaced it with QA. It has the same issue.
Since you said it may be the issue that Speech Server take to long time to load the gammar. I created the same grammar dymamically in the code. it works fine. So it is really the grammar loading issue.
The following was in the Code control before DetectAnswerMachineActivity
detectAnswerMachine.Grammar = new Grammar(new Uri("file://" + Path.Combine(Path.GetDirectoryName ApplicationHost.LocalPath.LocalPath),
"Grammars/OutboundEnglish.grxml")), "Detect");
Right now I replaced it with the following and it work fine.
detectAnswerMachine.Grammar = new Grammar(
new Microsoft.SpeechServer.Recognition.SrgsGrammar.SrgsDocument(
new Microsoft.SpeechServer.Recognition.SrgsGrammar.SrgsRule("Detect",
new Microsoft.SpeechServer.Recognition.SrgsGrammar.SrgsSemanticInterpretationTag("$.DetectedEntity = \"ANSWERING_MACHINE_RESPONSE\""),
new Microsoft.SpeechServer.Recognition.SrgsGrammar.SrgsItem(
new Microsoft.SpeechServer.Recognition.SrgsGrammar.SrgsOneOf(
new Microsoft.SpeechServer.Recognition.SrgsGrammar.SrgsItem("Hello"),
......