I observed the following behavior on 10.1-BETA1 r271683M (amd64): xzgrep doesn't search the complete file: $ seq 10000 | xz > seq.xz $ xzgrep -c . seq.xz 6775 Using regular grep works as expected: $ xzcat seq.xz | grep -c . 10000 Processing seems to stop after 32KB (uncompressed).
poyopoyo at puripuri.plala.or.jp
2014-Sep-27 16:11 UTC
xzgrep: incomplete results on larger files
This persists for at least 2.5 years. http://docs.FreeBSD.org/cgi/mid.cgi?86k43pb0sc.wl%poyopoyo (author Cc'd) At Sat, 20 Sep 2014 22:56:28 +0200, Stefan Ehmann wrote:> > I observed the following behavior on 10.1-BETA1 r271683M (amd64): > > xzgrep doesn't search the complete file: > $ seq 10000 | xz > seq.xz > $ xzgrep -c . seq.xz > 6775 > > Using regular grep works as expected: > $ xzcat seq.xz | grep -c . > 10000 > > Processing seems to stop after 32KB (uncompressed). >
On Sat, Sep 20, 2014, at 15:56, Stefan Ehmann wrote:> I observed the following behavior on 10.1-BETA1 r271683M (amd64): > > xzgrep doesn't search the complete file: > $ seq 10000 | xz > seq.xz > $ xzgrep -c . seq.xz > 6775 > > Using regular grep works as expected: > $ xzcat seq.xz | grep -c . > 10000 > > Processing seems to stop after 32KB (uncompressed). >Wow, this is bizarre... Compression with xz is getting more and more popular. This may have bit me a few times and I didn't even know it! I'll see what I can to do bring this to someone's attention.
On 29.09.2014 16:14, Mark Felder wrote:> > > On Sat, Sep 20, 2014, at 15:56, Stefan Ehmann wrote: >> I observed the following behavior on 10.1-BETA1 r271683M (amd64): >> >> xzgrep doesn't search the complete file: >> $ seq 10000 | xz > seq.xz >> $ xzgrep -c . seq.xz >> 6775 >> >> Using regular grep works as expected: >> $ xzcat seq.xz | grep -c . >> 10000 >> >> Processing seems to stop after 32KB (uncompressed). >> > > Wow, this is bizarre... Compression with xz is getting more and more > popular. This may have bit me a few times and I didn't even know it! > > I'll see what I can to do bring this to someone's attention.Any progress on this issue? Would have been nice if 10.1 included the patch and had a working xzgrep. But it's probably already a bit late for that.