Libguestfs - May 2018 - virt-builder download issues

I'm having trouble downloading templates (ubuntu-18.04, among others) using
virt-builder. The downloads get to about 50% (or 13, or 62) and then stall. wget
easily downloads the files quickly.

I'd be happy with working around this by manually placing the images in the
cache directory, but I can't seem to figure out the appropriate placement.
virt-builder doesn't find the cached file.

Please send help,
Thanks!

On Thu, May 24, 2018 at 08:25:49PM +0000, Alex Buchanan
wrote:
> I'm having trouble downloading templates (ubuntu-18.04, among
> others) using virt-builder. The downloads get to about 50% (or 13,
> or 62) and then stall. wget easily downloads the files quickly.
We recently moved over to a new server, and (unlike the previous one)
this should be reliable.

All that virt-builder is doing to download the files is running the
curl command:

https://github.com/libguestfs/libguestfs/blob/a4e3b7c0598370d8d068b21909da95b6031eb688/builder/downloader.ml#L115

Could there be a problem with curl?
> I'd be happy with working around this by manually placing the images
> in the cache directory, but I can't seem to figure out the
> appropriate placement. virt-builder doesn't find the cached file.
I don't really recommend this, but the filename is just
~/.cache/virt-builder/<os-version>.<arch>.<revision>
so as long as you get the filename right virt-builder should see it.

Rich.

-- 
Richard Jones, Virtualization Group, Red Hat http://people.redhat.com/~rjones
Read my programming and virtualization blog: http://rwmj.wordpress.com
virt-p2v converts physical machines to virtual machines.  Boot with a
live CD or over the network (PXE) and turn machines into KVM guests.
http://libguestfs.org/virt-v2v

Thanks Richard. I succeed with the manual caching trick, although I ran into
other issues with Ubuntu that blocked me.

I tried multiple versions of curl, libguestfs, and ubuntu, and I even built the
latest virt-builder source code, and still had download issues. Maybe I'll
try a different network next (google cloud perhaps).

I did have the same issue with wget one time, so I guess it's not specific
to curl, and I just got lucky? Shrug.



On 5/24/18, 1:45 PM, "Richard W.M. Jones" <rjones@redhat.com>
wrote:
>On Thu, May 24, 2018 at 08:25:49PM +0000, Alex Buchanan wrote:
>> I'm having trouble downloading templates (ubuntu-18.04, among
>> others) using virt-builder. The downloads get to about 50% (or 13,
>> or 62) and then stall. wget easily downloads the files quickly.
>
>We recently moved over to a new server, and (unlike the previous one)
>this should be reliable.
>
>All that virt-builder is doing to download the files is running the
>curl command:
>
>https://github.com/libguestfs/libguestfs/blob/a4e3b7c0598370d8d068b21909da95b6031eb688/builder/downloader.ml#L115
>
>Could there be a problem with curl?
>
>> I'd be happy with working around this by manually placing the
images
>> in the cache directory, but I can't seem to figure out the
>> appropriate placement. virt-builder doesn't find the cached file.
>
>I don't really recommend this, but the filename is just
>~/.cache/virt-builder/<os-version>.<arch>.<revision>
>so as long as you get the filename right virt-builder should see it.
>
>Rich.
>
>-- 
>Richard Jones, Virtualization Group, Red Hat
http://people.redhat.com/~rjones
>Read my programming and virtualization blog: http://rwmj.wordpress.com
>virt-p2v converts physical machines to virtual machines.  Boot with a
>live CD or over the network (PXE) and turn machines into KVM guests.
>http://libguestfs.org/virt-v2v