如何理解主动学习QnaMaker、botframework v4
How to understand active learning QnaMaker, botframework v4
我读过documents, and tried to run Active learning sample。我能理解程序是如何工作的。
文档参考了隐式反馈和显式反馈。我有两个问题。
我可以找到显式反馈代码。但是我不知道知识库什么时候会显示反馈。
隐式反馈代码在哪里？没有代码？我认为 Implicit feedback 和 Explicit feedback 的分数差不多。有什么区别？
因此，作为 docs on active learning 状态，隐式反馈 发生在
时
when a user question has multiple answers with scores that are very close,
而 显式反馈 是
时收到的反馈
client application asks the user which question is the correct question [and the user's selected question is used as explicit feedback
在哪里收集反馈
反馈是从用户和机器人之间的对话中收集的。
截至目前，未 在 qnamaker.ai 门户的测试面板中收集反馈。
我们在哪里可以看到通过主动学习生成的建议问题？
当 "enough" 收集一组问答对的反馈时，您将在 qnamaker.ai > 编辑
的门户中看到主动学习反馈
进一步主动学习说明
我将在下面的有关主动学习的线程中包含我的一篇帖子。 不过，我鼓励您阅读后来作为 Microsoft Docs 问题打开的 full thread on active learning，以查看包含的屏幕截图。
@Souvik04, follow the link to the Active Learning sample
bot
in the BotFramework-Samples repo for a example of how you can query
the QnA service from your bot with active learning enabled.
___ After conversing with the QnA team (Rohit is included in the conversation), here's a little more light regarding when you would
actually see the suggestions inside the portal at qnamaker.ai.
When there is a low confidence score difference between the top
answers, we collect weighted implicit and explicit
feedback
to cluster suggestions for any QnA ID.
=> When enough feedback is collected for any given suggestion, it will show in the KB.
More specifically, we cluster similar user queries to generate
suggestions. When minimum required feedback is collected, only then
will the suggestions show in the KB.
The QnA team wants to avoid publicly divulging the exact logic of what
exactly is the "minimum required feedback" and how often suggestions
are generated (besides, the team is working on improving and
optimizing the logic behind active learning as well)
--however to see suggestions appear in the qnamaker.ai portal:
* not only ensure that you've given the bot enough feedback
* but also give the back end "some time" to allow for the suggestions to appear in the portal.
Again, feedback is collected when your user types in a query that
returns answers from QnA that have confidence scores that are close
together.
It is also good to note that feedback is not collected in the Test
panel in the qnamaker.ai portal as of now. You will need to chat with
your bot via emulator or a channel to provide feedback to your bot
that it can use for active learning.
我读过documents, and tried to run Active learning sample。我能理解程序是如何工作的。
文档参考了隐式反馈和显式反馈。我有两个问题。
我可以找到显式反馈代码。但是我不知道知识库什么时候会显示反馈。
隐式反馈代码在哪里？没有代码？我认为 Implicit feedback 和 Explicit feedback 的分数差不多。有什么区别？
因此，作为 docs on active learning 状态，隐式反馈 发生在
时when a user question has multiple answers with scores that are very close,
而 显式反馈 是
时收到的反馈client application asks the user which question is the correct question [and the user's selected question is used as explicit feedback
在哪里收集反馈
反馈是从用户和机器人之间的对话中收集的。 截至目前，未 在 qnamaker.ai 门户的测试面板中收集反馈。
我们在哪里可以看到通过主动学习生成的建议问题？
当 "enough" 收集一组问答对的反馈时，您将在 qnamaker.ai > 编辑
的门户中看到主动学习反馈进一步主动学习说明
我将在下面的有关主动学习的线程中包含我的一篇帖子。 不过，我鼓励您阅读后来作为 Microsoft Docs 问题打开的 full thread on active learning，以查看包含的屏幕截图。
@Souvik04, follow the link to the Active Learning sample bot in the BotFramework-Samples repo for a example of how you can query the QnA service from your bot with active learning enabled. ___ After conversing with the QnA team (Rohit is included in the conversation), here's a little more light regarding when you would actually see the suggestions inside the portal at qnamaker.ai.
When there is a low confidence score difference between the top answers, we collect weighted implicit and explicit feedback to cluster suggestions for any QnA ID. => When enough feedback is collected for any given suggestion, it will show in the KB.
More specifically, we cluster similar user queries to generate suggestions. When minimum required feedback is collected, only then will the suggestions show in the KB.
The QnA team wants to avoid publicly divulging the exact logic of what exactly is the "minimum required feedback" and how often suggestions are generated (besides, the team is working on improving and optimizing the logic behind active learning as well) --however to see suggestions appear in the qnamaker.ai portal: * not only ensure that you've given the bot enough feedback * but also give the back end "some time" to allow for the suggestions to appear in the portal.
Again, feedback is collected when your user types in a query that returns answers from QnA that have confidence scores that are close together.
It is also good to note that feedback is not collected in the Test panel in the qnamaker.ai portal as of now. You will need to chat with your bot via emulator or a channel to provide feedback to your bot that it can use for active learning.