search for: max_value_of_residu

Displaying 1 result from an estimated 1 matches for "max_value_of_residu".

Did you mean: max_value_of_residual
2015 May 18
1
A condition in precompute_partition_info_sums_()
...634c60f475 has this: if(FLAC__bitmath_ilog2(default_partition_samples) + bps + FLAC__MAX_EXTRA_RESIDUAL_BPS < 32) The question is: why ... < 32, not ... <= 32 ? Basically we want to know the number of bits that is necessary to represent the value of (default_partition_samples * max_value_of_residual) product. Let's assume that the bitness of the residual signal is N. The minimum value is -2^(N-1), the max is 2^(N-1)-1. For the absolute value: max = 2^(N-1). The number of bits in default_partition_samples is equal to FLAC__bitmath_ilog2(default_partition_samples) + 1. When we multi...