I am writing an app for basically internal use for a client for their billing process. There are a few large files which need to be uploaded or added to the system as in input to this process. I am wondering whether it would be better to set up ftp or whether rails running on any server (may be just Mongrel as this is an internal app that will probably have one or a few users max) would handle this file size gracefully? Does it simply have to do with the memory of the server or are there other factors? Since this is an internal process it does not have to be slick like something public facing, most important is reliability and the files getting uploaded right the first time. Thanks for input, David -- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.
Donald R. Ziesig
2011-Jan-12 00:07 UTC
Re: [ruby_on_rails] Large (300mb - 1gb) file uplods?
David, Check out paperclip. It will allow you to upload to and download from your local file system (or S3). In the local file system, it stores the docs in public/system. I am using it for smaller (up to 30Mb) files and using Pat Shaunessey''s version to save the data to db tables (not recommended for files of the magnitude you mentioned). It works fine and is really fast to incorporate into your code. Donz On 1/11/2011 6:54 PM, David Kahn wrote:> I am writing an app for basically internal use for a client for their > billing process. There are a few large files which need to be uploaded > or added to the system as in input to this process. I am wondering > whether it would be better to set up ftp or whether rails running on > any server (may be just Mongrel as this is an internal app that will > probably have one or a few users max) would handle this file size > gracefully? Does it simply have to do with the memory of the server or > are there other factors? Since this is an internal process it does not > have to be slick like something public facing, most important is > reliability and the files getting uploaded right the first time. > > Thanks for input, > > David > -- > You received this message because you are subscribed to the Google > Groups "Ruby on Rails: Talk" group. > To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To unsubscribe from this group, send email to > rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > For more options, visit this group at > http://groups.google.com/group/rubyonrails-talk?hl=en.-- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.
Sounds like something you''d want to offload. You might find some options in the links mentioned in this thread: http://groups.google.com/group/rubyonrails-talk/browse_thread/thread/e9e01054ca26e21b# On Jan 11, 6:54 pm, David Kahn <d...-rfEMNHKVqOwNic7Bib+Ti1W1rNmOCjRP@public.gmane.org> wrote:> I am writing an app for basically internal use for a client for their > billing process. There are a few large files which need to be uploaded or > added to the system as in input to this process.-- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.
On Tue, Jan 11, 2011 at 6:07 PM, Donald R. Ziesig <Donald-FWDIqG1pcu4dnm+yROfE0A@public.gmane.org> wrote:> David, > > Check out paperclip. It will allow you to upload to and download from your > local file system (or S3). In the local file system, it stores the docs in > public/system. I am using it for smaller (up to 30Mb) files and using Pat > Shaunessey''s version to save the data to db tables (not recommended for > files of the magnitude you mentioned). It works fine and is really fast to > incorporate into your code. >Thanks, that is probably at least worth a shot to see how it performs. I had not used it with files this size so was just curious if it was contraindicated.> > Donz > > > On 1/11/2011 6:54 PM, David Kahn wrote: > >> I am writing an app for basically internal use for a client for their >> billing process. There are a few large files which need to be uploaded or >> added to the system as in input to this process. I am wondering whether it >> would be better to set up ftp or whether rails running on any server (may be >> just Mongrel as this is an internal app that will probably have one or a few >> users max) would handle this file size gracefully? Does it simply have to do >> with the memory of the server or are there other factors? Since this is an >> internal process it does not have to be slick like something public facing, >> most important is reliability and the files getting uploaded right the first >> time. >> >> Thanks for input, >> >> David >> -- >> You received this message because you are subscribed to the Google Groups >> "Ruby on Rails: Talk" group. >> To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org >> To unsubscribe from this group, send email to >> rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org<rubyonrails-talk%2Bunsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org> >> . >> For more options, visit this group at >> http://groups.google.com/group/rubyonrails-talk?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Ruby on Rails: Talk" group. > To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To unsubscribe from this group, send email to > rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org<rubyonrails-talk%2Bunsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org> > . > For more options, visit this group at > http://groups.google.com/group/rubyonrails-talk?hl=en. > >-- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.
Ivan Nastyukhin
2011-Jan-13 21:42 UTC
Re: [ruby_on_rails] Large (300mb - 1gb) file uplods?
for large file i recommend use nginx_upload_module http://matthewhutchinson.net/2010/1/6/nginx-upload-module-with-paperclip-on-rails On Jan 12, 2011, at 3:48 AM, David Kahn wrote:> > > On Tue, Jan 11, 2011 at 6:07 PM, Donald R. Ziesig <Donald-FWDIqG1pcu4dnm+yROfE0A@public.gmane.org> wrote: > David, > > Check out paperclip. It will allow you to upload to and download from your local file system (or S3). In the local file system, it stores the docs in public/system. I am using it for smaller (up to 30Mb) files and using Pat Shaunessey''s version to save the data to db tables (not recommended for files of the magnitude you mentioned). It works fine and is really fast to incorporate into your code. > > Thanks, that is probably at least worth a shot to see how it performs. I had not used it with files this size so was just curious if it was contraindicated. > > > Donz > > > On 1/11/2011 6:54 PM, David Kahn wrote: > I am writing an app for basically internal use for a client for their billing process. There are a few large files which need to be uploaded or added to the system as in input to this process. I am wondering whether it would be better to set up ftp or whether rails running on any server (may be just Mongrel as this is an internal app that will probably have one or a few users max) would handle this file size gracefully? Does it simply have to do with the memory of the server or are there other factors? Since this is an internal process it does not have to be slick like something public facing, most important is reliability and the files getting uploaded right the first time. > > Thanks for input, > > David > -- > You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. > To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en. > > -- > You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. > To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en. > > > > -- > You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. > To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org > To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.-- You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com. For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en.