Joerg Sonnenberger via llvm-dev
2016-Feb-24 21:43 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via llvm-dev wrote:> 2) There is the cap on total repository size, which is in the neighborhood > of 1Gb [3]. A fresh checkout of test-suite clocks in at just over 3Gb. This > one actually is a problem.This is not really true. Individual pack files must be below 1GB, but the total repository can be much larger. That's true even for the free tiers. That said, it might be good idea to split the repository into modules to keep it managable. Joerg
Jonathan Roelofs via llvm-dev
2016-Feb-24 21:50 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
On 2/24/16 2:43 PM, Joerg Sonnenberger via llvm-dev wrote:> On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via llvm-dev wrote: >> 2) There is the cap on total repository size, which is in the neighborhood >> of 1Gb [3]. A fresh checkout of test-suite clocks in at just over 3Gb. This >> one actually is a problem. > > This is not really true.From the horse's mouth: "We recommend repositories be kept under 1GB each. This limit is easy to stay within if large files are kept out of the repository. If your repository exceeds 1GB, you might receive a polite email from GitHub Support requesting that you reduce the size of the repository to bring it back down."> Individual pack files must be below 1GB, but the total repository can > be much larger. That's true even for the free tiers. That said, it > might be good idea to split the repository into modules to keep it > managable. > > Joerg > _______________________________________________ > LLVM Developers mailing list > llvm-dev at lists.llvm.org > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev >-- Jon Roelofs jonathan at codesourcery.com CodeSourcery / Mentor Embedded
Mehdi Amini via llvm-dev
2016-Feb-24 22:30 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
> On Feb 24, 2016, at 1:43 PM, Joerg Sonnenberger via llvm-dev <llvm-dev at lists.llvm.org> wrote: > > On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via llvm-dev wrote: >> 2) There is the cap on total repository size, which is in the neighborhood >> of 1Gb [3]. A fresh checkout of test-suite clocks in at just over 3Gb. This >> one actually is a problem. > > This is not really true. Individual pack files must be below 1GB, but > the total repository can be much larger. That's true even for the free > tiers. That said, it might be good idea to split the repository into > modules to keep it managable. >I'm really in favor of a modular test-suite, splitting as much as possible the infrastructure with the individual suites, and making it super easy and convenient to assemble modular suites together. We already have the mechanism for "external" test-suite, it would just need to be first-class. i.e. I'd like to clone the test-suite, which would get me only the infrastructure but no test to run, and then easily say: "clone these test-suite and make them available: llvm, Halide, etc." which would clone them from separate repositories. And then list the available suite and quick runs over chosen ones. Just some thoughts... -- Mehdi
Joerg Sonnenberger via llvm-dev
2016-Feb-24 22:41 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
On Wed, Feb 24, 2016 at 02:50:48PM -0700, Jonathan Roelofs via llvm-dev wrote:> > > On 2/24/16 2:43 PM, Joerg Sonnenberger via llvm-dev wrote: > >On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via llvm-dev wrote: > >>2) There is the cap on total repository size, which is in the neighborhood > >>of 1Gb [3]. A fresh checkout of test-suite clocks in at just over 3Gb. This > >>one actually is a problem. > > > >This is not really true. > > From the horse's mouth: > > "We recommend repositories be kept under 1GB each. This limit is easy to > stay within if large files are kept out of the repository. If your > repository exceeds 1GB, you might receive a polite email from GitHub Support > requesting that you reduce the size of the repository to bring it back > down."I know what they write and I know what answer I got when I asked about it for NetBSD's git mirror. I certainly know that I have a repository larger than 1GB on github. Joerg
Chandler Carruth via llvm-dev
2016-Feb-25 02:23 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
On Wed, Feb 24, 2016 at 1:43 PM Joerg Sonnenberger via llvm-dev < llvm-dev at lists.llvm.org> wrote:> On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via llvm-dev > wrote: > > 2) There is the cap on total repository size, which is in the > neighborhood > > of 1Gb [3]. A fresh checkout of test-suite clocks in at just over 3Gb. > This > > one actually is a problem. > > This is not really true. Individual pack files must be below 1GB, but > the total repository can be much larger. That's true even for the free > tiers. That said, it might be good idea to split the repository into > modules to keep it managable. >We can also handle this lazily -- if and when it becomes a problem, we can re-factor the repo. I don't think we need to overthink this. Also, the Github folks might be willing to help. =]> > Joerg > _______________________________________________ > LLVM Developers mailing list > llvm-dev at lists.llvm.org > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev >-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20160225/1cfefb60/attachment.html>
Chandler Carruth via llvm-dev
2016-Feb-25 02:38 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
On Wed, Feb 24, 2016 at 2:30 PM Mehdi Amini via llvm-dev < llvm-dev at lists.llvm.org> wrote:> > > On Feb 24, 2016, at 1:43 PM, Joerg Sonnenberger via llvm-dev < > llvm-dev at lists.llvm.org> wrote: > > > > On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via llvm-dev > wrote: > >> 2) There is the cap on total repository size, which is in the > neighborhood > >> of 1Gb [3]. A fresh checkout of test-suite clocks in at just over 3Gb. > This > >> one actually is a problem. > > > > This is not really true. Individual pack files must be below 1GB, but > > the total repository can be much larger. That's true even for the free > > tiers. That said, it might be good idea to split the repository into > > modules to keep it managable. > > > > I'm really in favor of a modular test-suite, splitting as much as possible > the infrastructure with the individual suites, and making it super easy and > convenient to assemble modular suites together. We already have the > mechanism for "external" test-suite, it would just need to be first-class. > i.e. I'd like to clone the test-suite, which would get me only the > infrastructure but no test to run, and then easily say: "clone these > test-suite and make them available: llvm, Halide, etc." which would clone > them from separate repositories. And then list the available suite and > quick runs over chosen ones. > > Just some thoughts... >While I like a lot about this design, I'd like to also have a common location for a common set of these "modules" so that it is really easy for all of us to test the same stuff and talk about the same test failures. =] It also isn't the design we have today, and I'd rather not wait on it to exist. But if we ever do get here, none of my arguments above about why we should do this really apply to an isolated chunk of infrastructure. I'd be happy for that to live in LLVM's main repo, or anywhere else really. I'm mostly talking about the common collection of actual test suite stuff. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.llvm.org/pipermail/llvm-dev/attachments/20160225/513c38ae/attachment.html>
Hal Finkel via llvm-dev
2016-Feb-27 03:29 UTC
[llvm-dev] RFC: Move the test-suite LLVM project to GitHub?
----- Original Message -----> From: "Mehdi Amini via llvm-dev" <llvm-dev at lists.llvm.org> > To: "Joerg Sonnenberger" <joerg at britannica.bec.de> > Cc: llvm-dev at lists.llvm.org > Sent: Wednesday, February 24, 2016 4:30:42 PM > Subject: Re: [llvm-dev] RFC: Move the test-suite LLVM project to GitHub? > > > > On Feb 24, 2016, at 1:43 PM, Joerg Sonnenberger via llvm-dev > > <llvm-dev at lists.llvm.org> wrote: > > > > On Wed, Feb 24, 2016 at 02:20:24PM -0700, Jonathan Roelofs via > > llvm-dev wrote: > >> 2) There is the cap on total repository size, which is in the > >> neighborhood > >> of 1Gb [3]. A fresh checkout of test-suite clocks in at just over > >> 3Gb. This > >> one actually is a problem. > > > > This is not really true. Individual pack files must be below 1GB, > > but > > the total repository can be much larger. That's true even for the > > free > > tiers. That said, it might be good idea to split the repository > > into > > modules to keep it managable. > > > > I'm really in favor of a modular test-suite, splitting as much as > possible the infrastructure with the individual suites, and making > it super easy and convenient to assemble modular suites together. We > already have the mechanism for "external" test-suite, it would just > need to be first-class. > i.e. I'd like to clone the test-suite, which would get me only the > infrastructure but no test to run, and then easily say: "clone these > test-suite and make them available: llvm, Halide, etc." which would > clone them from separate repositories. And then list the available > suite and quick runs over chosen ones. > > Just some thoughts...As a longer-term goal, this sounds really nice. -Hal> > -- > Mehdi > > _______________________________________________ > LLVM Developers mailing list > llvm-dev at lists.llvm.org > http://lists.llvm.org/cgi-bin/mailman/listinfo/llvm-dev >-- Hal Finkel Assistant Computational Scientist Leadership Computing Facility Argonne National Laboratory