Watson Speech to Text API 中的说话人标签/二值化不 return

Question

我正在尝试通过 IBM watson 语音将说话者标签转为文本 api。在我的最终输出中，我希望它显示整个音频的文字记录、置信度和说话者标签。我的代码如下：

import json
from os.path import join, dirname
from ibm_watson import SpeechToTextV1
from ibm_watson.websocket import RecognizeCallback, AudioSource
import threading
from ibm_cloud_sdk_core.authenticators import IAMAuthenticator
import pandas as pd
authenticator = IAMAuthenticator('rXXXYYZZ')
service = SpeechToTextV1(authenticator=authenticator)
service.set_service_url('https://api.us-east.speech-to-text.watson.cloud.ibm.com')

models = service.list_models().get_result()
#print(json.dumps(models, indent=2))

model = service.get_model('en-US_BroadbandModel').get_result()
#print(json.dumps(model, indent=2))

with open(join(dirname('__file__'), 'testvoicejen.wav'),
          'rb') as audio_file:
#    print(json.dumps(
    output = service.recognize(
    audio=audio_file,
    speaker_labels=True,
    content_type='audio/wav',
    #timestamps=True,
    #word_confidence=True,
    model='en-US_NarrowbandModel',
    continuous=True).get_result(),
    indent=2
df = pd.DataFrame([i for elts in output for alts in elts['results'] for i in alts['alternatives']])

然而，df 的输出是：

df
Out[22]: 
                                          timestamps  ...                                         transcript
0  [[thank, 3.88, 4.04], [you, 4.04, 4.13], [for,...  ...  thank you for calling my name is Britney and h...
1  [[thank, 30.21, 30.56], [you, 30.56, 30.74], [...  ...  thank you %HESITATION and then %HESITATION you..

如您所见，我确实成功获得了文字记录，但是，我获得的不是说话人分类或标签，而是时间戳。演讲者标签如下所示：

from": 0.68,
      "to": 1.19,
      "speaker": 2

我如何得到这个？

Answer 1

当您打开 speaker_labels 时，您会自动获得 timestamps。如果您查看服务文档中的示例输出 - https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-output#speaker_labels

您会看到演讲者标签部分与备选方案/结果部分是分开的。您的代码仅解析结果/备选方案部分。要获得扬声器标签，您需要类似 -

df = pd.DataFrame([i for elts in output for i in elts['speaker_labels']])

Watson Speech to Text API 中的说话人标签/二值化不 return

Speaker label/ diarization does not return in Watson Speech to Text API

python

api

speech-recognition

ibm-watson