Displaying 8 results from an estimated 8 matches for "total_error_0".
Did you mean:
total_error_3
2004 Sep 10
2
An assembly optimization and fix
...s to FPU regs
- ; dword [esp] == last_error_0
- ; dword [esp + 4] == last_error_1
- ; dword [esp + 8] == last_error_2
- ; dword [esp + 12] == last_error_3
- ; eax == error
; ebx == &data[i]
; ecx == loop counter (i)
- ; edx == temp
- ; edi == save
; ebp == order
; mm0 == total_error_1:total_error_0
- ; mm1 == total_error_3:total_error_2
- ; mm2 == 0:total_error_4
- ; mm3/4 == 0:unpackarea
- ; mm5 == abs(error_1):abs(error_0)
- ; mm5 == abs(error_3):abs(error_2)
+ ; mm1 == total_error_2:total_error_3
+ ; mm2 == :total_error_4
+ ; mm3 == last_error_1:last_error_0
+ ; mm4 == last_error_2:last_er...
2014 Jul 02
2
uint64 -> double conversion
Anybody knows the reason for the following code
(you can see it in flac/decode.c, flac/encode.c, libFLAC/fixed.c and
libFLAC/stream_decoder.c) ?
#if defined _MSC_VER || defined __MINGW32__
/* with MSVC you have to spoon feed it the casting */
residual_bits_per_sample[0] = (FLAC__float)((total_error_0 > 0) ? log(M_LN2 * (FLAC__double)(FLAC__int64)total_error_0 / (FLAC__double)data_len) / M_LN2 : 0.0);
...
#else
residual_bits_per_sample[0] = (FLAC__float)((total_error_0 > 0) ? log(M_LN2 * (FLAC__double)total_error_0 / (FLAC__double)data_len) / M_LN2 : 0.0);
...
#endif
IOW:...
2004 Sep 10
2
Re: 0.9 problems
Matt Zimmerman <mdz@debian.org> wrote:
> 0.9. As I said, I was using an 8-bit sample,
Ah, that didn't quite register with me. I'm using a CD-style
44.1kHz/stereo/16-bit test file.
> to avoid dealing with endian issues in the file format. I don't
> know whether any of those exist or not.
I don't think so. 0.9 works fine on i386 (little) and sparc (big),
and
2004 Sep 10
2
Re: 0.9 problems
...; 0) ? log(M_LN2 * (real)(int64)total_error_3 / (real) data_len) / M_LN2 : 0.0);
residual_bits_per_sample[4] = (real)((data_len > 0) ? log(M_LN2 * (real)(int64)total_error_4 / (real) data_len) / M_LN2 : 0.0);
#else
- residual_bits_per_sample[0] = (real)((data_len > 0) ? log(M_LN2 * (real)total_error_0 / (real) data_len) / M_LN2 : 0.0);
- residual_bits_per_sample[1] = (real)((data_len > 0) ? log(M_LN2 * (real)total_error_1 / (real) data_len) / M_LN2 : 0.0);
- residual_bits_per_sample[2] = (real)((data_len > 0) ? log(M_LN2 * (real)total_error_2 / (real) data_len) / M_LN2 : 0.0);
- residua...
2012 Apr 05
2
[PATCH 2/2] V2: Use a single definition of MIN and MAX in sources
...f min
-#endif
-#define min(x,y) ((x) < (y)? (x) : (y))
-
#ifdef local_abs
#undef local_abs
#endif
@@ -242,11 +238,11 @@ unsigned FLAC__fixed_compute_best_predictor(const FLAC__int32 data[], unsigned d
error -= last_error_3; total_error_4 += local_abs(error); last_error_3 = save;
}
- if(total_error_0 < min(min(min(total_error_1, total_error_2), total_error_3), total_error_4))
+ if(total_error_0 < flac_min(flac_min(flac_min(total_error_1, total_error_2), total_error_3), total_error_4))
order = 0;
- else if(total_error_1 < min(min(total_error_2, total_error_3), total_error_4))
+ else...
2004 Sep 10
0
Re: 0.9 problems
.../16-bit test file.
I repeated my test with a 44.1kHz/stereo/16bit file. I get a floating point
exception when encoding at fixed.c:84. Decoding works fine for me.
The floating point exception occurs here:
84 residual_bits_per_sample[0] = (real)((data_len > 0) ? log(M_LN2 * (real)total_error_0 / (real) data_len) / M_LN2 : 0.0);
At the point of failure, the part inside the log() is zero, so the result of
the log is -inf. On i386, dividing -inf / M_LN2 seems to evaluate to zero,
while on alpha it gives a floating point exception. Here's a small test
program:
#include <math.h>...
2004 Sep 10
3
Re: 0.9 problems
...t 0.9 or CVS? While this clearly fixes a bug, 0.9 still dies
for me.
#0 0x1600692a8 in FLAC__fixed_compute_best_predictor (data=0x11fc,
data_len=1611182472, residual_bits_per_sample=0x0) at fixed.c:84
84 residual_bits_per_sample[0] = (real)((data_len > 0) ?
log(M_LN2 * (real)total_error_0 / (real) data_len) / M_LN2 : 0.0);
(gdb) bt
#0 0x1600692a8 in FLAC__fixed_compute_best_predictor (data=0x11fc,
data_len=1611182472, residual_bits_per_sample=0x0) at fixed.c:84
#1 0x160064808 in encoder_process_subframe_ (encoder=0x11ffb86f,
max_partition_order=301971032, verbatim_only...
2004 Sep 10
3
0.9 problems
On Sat, May 19, 2001 at 12:55:08AM -0400, Matt Zimmerman wrote:
> On Sat, May 19, 2001 at 02:05:14AM +0000, Christian Weisgerber wrote:
>
> > Problems in FLAC 0.9:
> >
> > - On alpha, flac immediately dumps core for both encoding and
> > decoding (FreeBSD/alpha).
>
> I have reproduced this on Debian/alpha as well. I will spend some time
> debugging it