Hi Allen, <p>>>True, but there is one critical place where it's necessary to mix at> least two streams--when someone's trying to break into a stream. If speaker >>goes on and on and speaker B (or C, D, E, F...) wants to interject or >>interrupt, who do they do it without inband without mixing? > It doesn't have to be done that way. You can simply have the server > echo the voice streams back to the various clients. Leave the job of > mixing the sounds to the sound device (ex: DirectSound or sound > hardware) from multiple streams.Yes, but the notmal client doesn't have the bandwith for that. Audio should nearly cost no bandwith, because we have all the videostream that must also go over the connection. So Audio should perhaps not be more then 8 kbits. Not sure if this is posible, but this is a very importanbt issue.>>The 'obvious' solution seems to be run N processes to detect 'speech' >>or important audio content on the incoming N streams. Pick on or >>two that need output, then mix and recode them. > Again not recommended as it has a major impact on total latency of the > voice stream to decode, mix and recode at the server to only decode > again at the client.You can zip it ;-)).> Additionally you should never upstream voice from clients to the server > that aren't transmitting. You write code to detect transmission.Sure. So the server can detect if mixing is necessary. Best Regards, <p><p>Carsten --- >8 ---- List archives: http://www.xiph.org/archives/ Ogg project homepage: http://www.xiph.org/ogg/ To unsubscribe from this list, send a message to 'speex-dev-request@xiph.org' containing only the word 'unsubscribe' in the body. No subject is needed. Unsubscribe messages sent to the list will be ignored/filtered.
Sorry to drive this a little off from what you're discussing but do you think it would be a good idea to decode multiple speex streams and encode in another format (say, vorbis)? This is because I read on this mailing list that speex performance decreases noticeably when muliple voices are overlapped. Thank you! <p>--- >8 ---- List archives: http://www.xiph.org/archives/ Ogg project homepage: http://www.xiph.org/ogg/ To unsubscribe from this list, send a message to 'speex-dev-request@xiph.org' containing only the word 'unsubscribe' in the body. No subject is needed. Unsubscribe messages sent to the list will be ignored/filtered.
Jean-Marc Valin
2004-Aug-06 15:01 UTC
[speex-dev] Server based audio merge (speex to non-speex)
Le ven 21/11/2003 à 13:51, Massimo a écrit :> Sorry to drive this a little off from what you're discussing but do > you think it would be a good idea to decode multiple speex streams and > encode in another format (say, vorbis)? > This is because I read on this mailing list that speex performance > decreases noticeably when muliple voices are overlapped.I don't think so. It's not only a matter of quality here. Vorbis has a higher latency (variable frame size) and it not designed to handle packet loss gracefully. Jean-Marc -- Jean-Marc Valin, M.Sc.A., ing. jr. LABORIUS (http://www.gel.usherb.ca/laborius) Université de Sherbrooke, Québec, Canada -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 190 bytes Desc: Ceci est une partie de message numériquement signée Url : http://lists.xiph.org/pipermail/speex-dev/attachments/20031121/c3375958/signature-0001.pgp