无法在 'AudioBufferSourceNode' 上设置 'buffer' 属性：无法将值转换为 'AudioBuffer'

Question

我正在尝试使用 socket.io 和媒体流在客户端之间实时发送音频。我能够记录，将该数据发送到服务器，然后再发送到不同的客户端。但是当我尝试将数组缓冲区转换为音频缓冲区然后将它们连接到音频输出设备时，我收到错误消息

Failed to set the 'buffer' property on 'AudioBufferSourceNode': Failed to convert value to 'AudioBuffer'.

我不明白为什么会这样。这是我的一些代码。

客户端

const socket = io();
const audioCtx = new AudioContext()
const audioC = new AudioContext()

    navigator.getUserMedia = navigator.getUserMedia || navigator.webkitGetUserMedia || navigator.mozGetUserMedia

    if (navigator.getUserMedia) {
      console.log('getUserMedia supported.')

      navigator.getUserMedia(
        { audio: true },
        stream => {
          const source = audioCtx.createMediaStreamSource(stream)
          const processor = audioCtx.createScriptProcessor(2048, 1, 1)

          source.connect(processor)
          processor.connect(audioCtx.destination)

          processor.onaudioprocess = e => {
            socket.emit('Voice', e.inputBuffer.getChannelData(0))
          }

          socket.on('Voice', msg => {
            const source = audioC.createBufferSource();
            source.buffer = msg;
            source.connect(audioC.destination);
            source.start()
          })
          audioCtx.resume()
        },
        err => console.error(err)
      )
    }

服务器端

//Server shit
const path = require('path');
const http = require('http');
const express = require('express');
const socketio = require('socket.io');
const { stringify } = require('querystring');
const { compileFunction } = require('vm');
const app = express();
const server = http.createServer(app);
const io = socketio(server);
app.use(express.static(path.join(__dirname, 'public')));
const PORT = 3000 || process.env.PORT;
server.listen(PORT,  console.log('Server is running on port 3000'))

//variables
var clients = [{}]
var rooms = [{}]

io.on('connection', (socket) => {

    socket.on('Voice', (msg) => {
        console.log(msg)
        socket.emit('Voice', msg)
    })

})

此时在代码中..

socket.on('Voice', msg => {
            const source = audioC.createBufferSource();
            source.buffer = msg;
            source.connect(audioC.destination);
            source.start()
          })

当我记录 msg 时，它给了我一个 arrayBuffer，然后我使用上面的过程将 arrayBuffer 转换为 audioBuffer，但它只给了我相同的错误消息。几天来我一直在用头撞墙来尝试解决这个问题，所以如果有人有解决方案，我会非常感激它。

Answer 1

您要发送的数据是 Float32Array.

的 channelData

socket.emit('Voice', e.inputBuffer.getChannelData(0))

我对 socket.io 不太熟悉，但我假设数据也以 Float32Array 的形式到达另一端。在这种情况下，您必须先使用该数据构建 AudioBuffer，然后才能将其与 AudioBufferSourceNode.

一起使用

const audioBuffer = new AudioBuffer({
    length: msg.length,
    sampleRate: sampleRateOfTheAudioContextOfTheSender
});

audioBuffer.copyToChannel(msg, 0, 0);

然后 audioBuffer 可以与 AudioBufferSourceNode 一起使用。

source.buffer = audioBuffer;

无法在 'AudioBufferSourceNode' 上设置 'buffer' 属性：无法将值转换为 'AudioBuffer'

Failed to set the 'buffer' property on 'AudioBufferSourceNode': Failed to convert value to 'AudioBuffer'

javascript

audio

socket.io

mediastream

web-audio-api