search for: spx_sqrt

...It seems that using a different compiler (I assume the development is done with MSC) uncovers various issues with the floating point. Here is the second one I'm seeing - DOMAIN error from sqrt(). In the open_loop_nbest_pitch(), this line: g = DIV32(corr[i-start], 10+SHR32(MULT16_16(spx_sqrt(e0),spx_sqrt(energy[i-start]) ),6)); The values are: e0 is 7.2 i is 142, start is 17 energy [i-start] is -2.1004911E-015 Hope this information is enough to go on. Tia, .a -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.xiph.org/pipermail/speex-dev/a...

...with MSC) uncovers various issues with the floating point. No, all development is done on gcc/Linux. > Here is the second one I'm seeing - DOMAIN error from sqrt(). > > In the open_loop_nbest_pitch(), this line: > > g = DIV32(corr[i-start], 10 > +SHR32(MULT16_16(spx_sqrt(e0),spx_sqrt(energy[i-start])), 6)); change that to: g = DIV32(corr[i-start], 10+SHR32(MULT16_16(spx_sqrt(e0),spx_sqrt(1 +energy[i-start])),6)); (note the "1+" in the spx_sqrt) As for this appearing only on some version/compiler configurations, the only explanation is sheer luck (orde...

...2_t t1, t2, t3; + for(i=0;i<M;i++) { + w[i*n] = 0; + w[(i+1)*n-1] = 0; + for(j=1;j<n-1;j++) { + t1 = MULT16_16(SHR32(st->W[i*N+j*2],16), SHR32(st->W[i*N+j*2],15)); + t2 = MULT16_16(SHR32(st->W[i*N+j*2-1],16), SHR32(st->W[i*N+j*2-1],15)); + t3 = MULT16_16(100,spx_sqrt(ADD32(t1,t2))); + w[i*n+j] = SHR32(t3, WEIGHT_SHIFT); + } + } + } + break; default: speex_warning_int("Unknown speex_echo_ctl request: ", request); return -1; Index: libspeex/preprocess.c ===============================================================...

>> I think the residual echo estimation is fairly reliable but I do not know >> how to use this to improve Pframe and in that way solve our main problem >> with the gain during near end talk. > > How can you tell that the residual echo estimation is reliable? in any > case, I suspect that the whole Pframe idea might have to be revised > (i.e. computing it completely

...nk,st->gain_floor+N, st->gain_floor); + filterbank_compute_psd16(st->bnk,st->gain_floor+N, st->gain_floor); /* Compute gain according to the Ephraim-Malah algorithm -- linear frequency */ for (i=0;i<N;i++) @@ -933,7 +933,7 @@ tmp = MULT16_16_P15(p,spx_sqrt(SHL32(EXTEND32(st->gain[i]),15))) + MULT16_16_P15(SUB16(Q15_ONE,p),spx_sqrt(SHL32(EXTEND32(st->gain_floor[i]),15))); st->gain2[i]=SQR16_Q15(tmp); } - filterbank_compute_psd16(st->bank,st->gain2+N, st->gain2); + filterbank_compute_psd16(st->bnk,st->...