Displaying 1 result from an estimated 1 matches for "max_value_of_residual".
2015 May 18
1
A condition in precompute_partition_info_sums_()
...634c60f475
has this:
if(FLAC__bitmath_ilog2(default_partition_samples) + bps + FLAC__MAX_EXTRA_RESIDUAL_BPS < 32)
The question is: why ... < 32, not ... <= 32 ?
Basically we want to know the number of bits that is necessary to represent
the value of (default_partition_samples * max_value_of_residual) product.
Let's assume that the bitness of the residual signal is N. The minimum value
is -2^(N-1), the max is 2^(N-1)-1. For the absolute value: max = 2^(N-1).
The number of bits in default_partition_samples is equal to
FLAC__bitmath_ilog2(default_partition_samples) + 1.
When we multipl...