Other options include ruby''s WIN32OLE and DBI libraries. For the
former, you''ll have to be running on a machine w/excel installed.
You''d use the latter on a windows machine to read the spreadsheets in
via ODBC. Your connect string would be *something* like:
connection_string = "dbi:ADO:" +
"Provider=MSDASQL;" +
"Persist Security Info=False;" +
"Extended
Properties=\"dbq=c:/path/to/spreadsheet.xls\";"
HTH,
-Roy
-----Original Message-----
From: rubyonrails-talk-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
[mailto:rubyonrails-talk@googlegroups.com] On Behalf Of AN@S
Sent: Thursday, October 16, 2008 12:02 PM
To: Ruby on Rails: Talk
Cc: amer.jazaerly-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org;
anas.marrawi-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
Subject: [Rails] Importing / Parsing Large Excel Files ?
Hello,
I''m running into a project where a client has large Excel files
(60.000+ records per file) and he needs an application to import them into a
database to use this data for useful operations (reporting, calculations ..
etc).
I know about the available libraries:
http://raa.ruby-lang.org/project/parseexcel/
http://rubyforge.org/projects/spreadsheet/
http://rubyforge.org/projects/roo/
I''ve used parseexcel before but for small files. The point is that
parseexcel and spreadhsheet libraries have a reputation that they can''t
handle large excel files (I don''t know about ''roo'').
The guy here (http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby-
talk/223230) created some kind of a bridge between Ruby and Java to use
''JavaExcelAPI'' and it did work fine for him!
Has anyone tried importing large excel files with ruby? Do I really need to use
a Java library through a bridge to get my job done?
Personally I prefer to hire a Java developer to do that Excel importing module
than doing a bridge and correct me if I''m wrong.
What do you suggest guys? Is there some great ruby library to do the job that I
never heard of before? Or do you suggest some tweaks like parsing the Excel file
using ''parseexcel'' like 500 records or something at a time?
I''m kinda lost and I need your help
Regards
--~--~---------~--~----~------------~-------~--~----~
You received this message because you are subscribed to the Google Groups
"Ruby on Rails: Talk" group.
To post to this group, send email to
rubyonrails-talk-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
To unsubscribe from this group, send email to
rubyonrails-talk+unsubscribe@googlegroups.com
For more options, visit this group at
http://groups.google.com/group/rubyonrails-talk?hl=en
-~----------~----~----~----~------~----~------~--~---
I''m running a Linux machine, so I think WIN2OLE and DBI libraries are not an option. On Oct 16, 10:45 pm, "Pardee, Roy" <parde...-go57ItdSaco@public.gmane.org> wrote:> Other options include ruby''s WIN32OLE and DBI libraries. For the former, you''ll have to be running on a machine w/excel installed. You''d use the latter on a windows machine to read the spreadsheets in via ODBC. Your connect string would be *something* like: > > connection_string = "dbi:ADO:" + > "Provider=MSDASQL;" + > "Persist Security Info=False;" + > "Extended Properties=\"dbq=c:/path/to/spreadsheet.xls\";" > > HTH, > > -Roy > > -----Original Message----- > From: rubyonrails-talk-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org [mailto:rubyonrails-talk@googlegroups.com] On Behalf Of AN@S > Sent: Thursday, October 16, 2008 12:02 PM > To: Ruby on Rails: Talk > > Cc: amer.jazae...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org; anas.marr...-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org > Subject: [Rails] Importing / Parsing Large Excel Files ? > > Hello, > > I''m running into a project where a client has large Excel files (60.000+ records per file) and he needs an application to import them into a database to use this data for useful operations (reporting, calculations .. etc). > > I know about the available libraries: > > http://raa.ruby-lang.org/project/parseexcel/http://rubyforge.org/projects/spreadsheet/http://rubyforge.org/projects/roo/ > > I''ve used parseexcel before but for small files. The point is that parseexcel and spreadhsheet libraries have a reputation that they can''t handle large excel files (I don''t know about ''roo''). > The guy here (http://blade.nagaokaut.ac.jp/cgi-bin/scat.rb/ruby/ruby- > talk/223230) created some kind of a bridge between Ruby and Java to use ''JavaExcelAPI'' and it did work fine for him! > > Has anyone tried importing large excel files with ruby? Do I really need to use a Java library through a bridge to get my job done? > Personally I prefer to hire a Java developer to do that Excel importing module than doing a bridge and correct me if I''m wrong. > > What do you suggest guys? Is there some great ruby library to do the job that I never heard of before? Or do you suggest some tweaks like parsing the Excel file using ''parseexcel'' like 500 records or something at a time? > > I''m kinda lost and I need your help > > Regards--~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe@googlegroups.com For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en -~----------~----~----~----~------~----~------~--~---
Actually being on Linux does not prevent WIN2OLE and DBI if you use WINE.... You still need to install all the supporting software (in this case Excel). --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Ruby on Rails: Talk" group. To post to this group, send email to rubyonrails-talk-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org To unsubscribe from this group, send email to rubyonrails-talk+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org For more options, visit this group at http://groups.google.com/group/rubyonrails-talk?hl=en -~----------~----~----~----~------~----~------~--~---