search for: work_thread

I''m using backgroundrb to periodically download a large file via ftp from a remote location and then import it into the database. To perform the import, I was using the following: ActiveRecord::Base.connection.execute(%{load data infile ...;}) although on a file with 2.5 million records, this can take 5 minutes, which seems to tie up my rails application while this executes (even

Hi Ezra/skaar, Wow man, the exercise was worth it. The connection closed problem with socket as i mentioned in my earlier mails...completely disappeared, and now i can connect only once to the socket and keep reading..till end of its days. Literally impossible with older release of backgroundrb. This could also potentially solve the issues people were having with ActiveRecord. As i said

In short: how (if possible) would i go about arranging it so that i can instantiate a middleman and set a worker going from within a method in one of my models? or is this a weird thing to be wanting to do? ( My specific situation: I have an ''Image'' model in my application. An actual image file associated with the model is being stored on amazons s3 system.

When i call a worker method my browsers hangs until the task is finished. The same code works nicely in the background when inside the do_work method. Does this mean i can only start a task in background via the do_work method ? Or am i doing something wrong here ? regards tom -------------- next part -------------- An HTML attachment was scrubbed... URL:

...activesupport/lib/active_support/dependencies.rb:476:in `const_missing'' /Users/bryan/Workspace/sandbox/scraper-trunk/lib/workers/ envoyd_worker.rb:11:in `do_work'' /Users/bryan/Workspace/sandbox/scraper-trunk/vendor/plugins/ backgroundrb/server/lib/backgroundrb/worker.rb:55:in `work_thread'' /Users/bryan/Workspace/sandbox/scraper-trunk/vendor/plugins/ backgroundrb/server/lib/backgroundrb/worker.rb:69:in `work_thread'' /Users/bryan/Workspace/sandbox/scraper-trunk/vendor/plugins/ backgroundrb/server/lib/backgroundrb/worker.rb:67:in `work_thread''

...6) /usr/lib/ruby/1.8/rexml/xpath.rb:53:in `each'' 20070423-13:36:41 (8456) /usr/local/src/rails/434Wireless/lib/workers/ parser_worker.rb:376:in `do_work'' 20070423-13:36:41 (8456) /usr/local/src/rails/434Wireless/vendor/ plugins/backgroundrb/server/lib/backgroundrb/worker.rb:55:in `work_thread'' 20070423-13:36:41 (8456) /usr/local/src/rails/434Wireless/vendor/ plugins/backgroundrb/server/lib/backgroundrb/worker.rb:69:in `work_thread'' 20070423-13:36:41 (8456) /usr/local/src/rails/434Wireless/vendor/ plugins/backgroundrb/server/lib/backgroundrb/worker.rb:67:in `work_thread...

...k/rails+backgroundrb/lib/workers/menager_worker.rb:29:in `do_work'' /home/swistak/rails+backgroundrb/vendor/plugins/backgroundrb/server/lib/back groundrb/worker.rb:55:in `send'' /home/swistak/rails+backgroundrb/vendor/plugins/backgroundrb/server/lib/back groundrb/worker.rb:55:in `work_thread'' /home/swistak/rails+backgroundrb/vendor/plugins/backgroundrb/server/lib/back groundrb/worker.rb:69:in `call'' /home/swistak/rails+backgroundrb/vendor/plugins/backgroundrb/server/lib/back groundrb/worker.rb:69:in `work_thread'' /home/swistak/rails+backgroundrb/vendor/plug...

...6/config/../vendor/rails/activerecord/lib/active_record/base.rb:416:in `find'' /var/www/gorchie/releases/20061120100506/lib/workers/upload_process_worker.rb:14:in `do_work'' /var/www/gorchie/releases/20061120100506/vendor/plugins/backgroundrb/server/lib/backgroundrb/worker.rb:49:in `work_thread'' /var/www/gorchie/releases/20061120100506/vendor/plugins/backgroundrb/server/lib/backgroundrb/worker.rb:49:in `work_thread'' /usr/local/lib/ruby/1.8/drb/drb.rb:1552:in `perform_without_block'' /usr/local/lib/ruby/1.8/drb/drb.rb:1512:in `perform'' /usr/local/lib/ruby...

...39;' 20071109-17:30:20 (27238) /usr/local/hydra.mh2onyc.com/current/vendor/plugins/backgroundrb/server/ lib/backgroundrb/worker.rb:56:in `send'' 20071109-17:30:20 (27238) /usr/local/hydra.mh2onyc.com/current/vendor/plugins/backgroundrb/server/ lib/backgroundrb/worker.rb:56:in `work_thread'' 20071109-17:30:20 (27238) /usr/local/hydra.mh2onyc.com/current/vendor/plugins/backgroundrb/server/ lib/backgroundrb/worker.rb:70:in `call'' 20071109-17:30:20 (27238) /usr/local/hydra.mh2onyc.com/current/vendor/plugins/backgroundrb/server/ lib/backgroundrb/worker.rb:70:in...

Hi! My cron-based worker is being indeed invoked by backgroundRB at correct times. But... After several runs it can no longer find DB columns! The same query, which was running OK an hour ago starts to throw MySQL error about unkown column in where clause. If I restart backgroundrb it works for some time but stops working after several invocations. Has anyone epxerienced the similar beahviour?

Hello, I am trying to make DRb calls to a external server from a backgrounDRb worker, but I''m getting always the next exception when I make the remote call. > ERROR: > drbunix:///tmp/backgroundrb.11175/experimenter_worker_3e899de945f0803a82cd257cfac316d0_0_0.0738904928422051 > - #<Errno::ENOENT: No such file or directory - >

Hi All, It might be lack of sleep, but I am struggling to accurately limit our pool size. It seems like I can specify it on the server with the -s command line option and also on the client via the YAML pool_size. Is that right? Which one wins? Our problem is that we are getting about 40 threads on each backgroundrb box and it''s flooring our db and each bgrb box. We want around 8.

Hi all I''m experiencing something strange with a :job_key, it took me a very long time to find out a worker wasn''t doing it''s job because of the name of my job_key. The first one I tried was :make_kohier, and with that name (and lot''s of other ones) I can''t get the worker to work. I do get my key in return, but the job doesn''t start

Hi , I was wondering if anyone else has tried to use the Timeout::timeout method in a backgroundrb Worker and had Timeout raise an exception after the allotted amount of time . I ask because i have written a test script to make sure Timeout would work . I have tested the script by directly feeding it to ruby with : $ ruby test_script.rb and piping the script to the rails console: $