Displaying 20 results from an estimated 8000 matches similar to: "worker cleanup"
2007 Dec 19
6
thread_pooling sleeping
I''m trying to run a single worker that could perform a periodic task
for a given user.
>From a controller, I imagine something like:
def start_job
MiddleMan.ask_work(:worker => :foo_worker, :worker_method => :perform_task,
:data => { :user_id = current_user.id })
end
def check_job
@status = MiddleMan.ask_status(:worker => :foo_worker)[current_user.id]
end
2007 Dec 21
7
Using my models
I''m working on upgrading my app to the latest version of backgroundrb.
Everything went find until I tried to execute my tasks.
Here is my simple worker for testing:
class MscWorker < BackgrounDRb::MetaWorker
set_worker_name :msc_worker
def create(args = nil)
# this method is called, when worker is loaded for the first time
end
# Send a message to everyone
def
2008 Jan 13
2
{worker} after :end-time worker freaks out
Hi all,
i was using bdrb a while ago and it wasn''t stable enough in version
0.2.1 for doing the job - it loss jobs or did execute only the first one
invoked and so on.
Now i gave the new version a try and i found a bug at playing around.
When i start a worker_method over the normal Unix scheduler bdrb will
start as much as possible the worker_method after the :end-time is reached.
2007 May 15
4
Need help with singleton worker
We have a fairly expensive task that we''d rather not schedule too many
instances of in parallel.
Couldn''t get pool_size to limit the amount of workers, and I figure
that''s hardly optimal anyway, so would like to have the work queued up
for a single named worker instead, running as soon as possible.
Using MiddleMan.schedule_worker() with :job_key does start off a
2008 May 04
12
best approach to managing workers and getting status
Hi,
I am using backgroundrb to process audio files from a rails
controller. Currently a new worker gets created every time the method
is called on the worker, using this code:
@job_key = MiddleMan.new_worker(:worker
=> :audio_file_worker, :job_key => Time.now.to_i)
MiddleMan.worker(:audio_file_worker,
@job_key).make_new_audio_file(params[:release_id])
I need to create the new
2007 Dec 24
2
backgroundrb script crashing on startup
Everything works fine on my development box (Ubuntu 7.10, Ruby 1.8.6)
but on my server (Fedora Core 6, Ruby 1.8.5) when I run
script/backgroundrb start, the process fails to start.
This is with Rails 2.0.2 frozen in the app, and I have the most recent
version of the plugin (r297). Is Ruby 1.8.6 a requirement for
backgroundrb now? I can''t figure any other reason it would fail...
2008 Jan 03
5
Start script not working when run via Rake
Hi there
I''m using the latest release (r300) and ''script/backgroundrb start'' works
perfectly when executed on the server, but when put inside a Rake task, it
doesn''t launch the worker processes.
The Rake task is as follows:
task :start_backgroundrb do
run "cd #{current_path} && ./script/backgroundrb start"
end
When I run this task, the
2007 Dec 15
10
1) Error 2) sending request to a specific worker
Hello !
1) I have this error logged by bdrb:
undefined method `send_request'' for nil:NilClass
framework/packet_master.rb:58:in `ask_worker''
backgroundrb/server/master_worker.rb:59:in `process_work''
backgroundrb/server/master_worker.rb:16:in `receive_data''
backgroundrb/framework/bin_parser.rb:29:in `call''
backgroundrb/framework/bin_parser.rb:29:in
2007 Nov 16
1
Backgroundrb with Load Balancing Rails engines
Hi there,
We run several (3-4) Rails servers behind the reverse proxy / load
balancing web server serving the single application. All Rails
instances share the same database and use the database as a session
storage. Memcached is also part of the picture.
I''m looking into using Backgroundrb for some large uploads / parsing
task that provide progress status updates (via ajax calls).
2006 Nov 04
1
BackgrounDRb Call for help
Hey there bdrb''ers!
I have been so very busy with http://engineyard.com that I have not
had time to complete the new release of backgroundrb. But I have done
substantial work towards it. It is basically an entirely new beast
with a complete rethinking of how it works. I have put up a zip file
of the new code base in the hopes that some folks will be able to
start playing with
2007 Dec 25
6
error: no marshal_dump is defined for class Thread
I get this error periodically in backgroundrb.log, but only on my
production box (the one running ruby 1.8.5) - my dev box doesn''t get
this error. As far as I can tell, everything is working ok, despite
the error (I don''t really know how to determine if the jobs are
getting threaded successfully, but they are running, that I am sure
of).
Here''s the dump:
no
2008 May 17
1
Can someone help with this error?
Hello all,
I get this intermittent error saying OpenURI::HTTPError. At the bottom of
the email is what is reported in my backgroundrb_server_<port>.log file. The
process_netflix_reviews method is parsing (in the background) Netflix''s RSS
feeds. This error also pretty much brings down the BDRb process and to
recover, I am forced to do a
./script/backgroundrb stop
2007 Dec 12
3
BDRB, new version questions
Hi,
we are trying to use BDRB for background processing of long-running
reports, and have two issues - one is that worker does not see our
Report class from Rails, throws a:
/var/apps/ror_trunk/vendor/plugins/backgroundrb/server/master_worker.rb:22:in
`load'': undefined class/module Report (ArgumentError)
from
2008 May 30
5
Upper limit to number of jobs queued by BDRb?
I use BDRb to process RSS feeds for users on my site (http://feedflix.com).
I have a batch job that queries the DB for records that haven''t been updated
in the last so many hours and kicks off a background job for each of them.
If N records are returned by the DB, N background jobs gets queued and get
done serially. As long as N is 255 or under, everything works like a charm.
2007 Mar 05
2
Scheduled workers only run once unless you call self.delete inside the worker
I had a worker scheduled to run every minute with
backgroundrb_schedules.yml:
ebay_runner:
:class: :ebay_auction_worker
:job_key: :ebay_auction_runner
:trigger_type: :cron_trigger
:trigger_args: 0 * * * * * *
This worker posts an auction to eBay from a queue of auctions every minute.
I was having a problem where the worker would run ok the first time, but
never any subsequent minutes
2007 Dec 20
1
mocking a few things in the test helper
When using the provided bdrb_test_helper, I was getting some undefined
methods (register_status, thread_pool, etc) in unit tests. The README
says to go ahead and stub out methods that need it, and send the patch
to the list, so here it is (attached). Also, the MetaWorker initialize
method was written as "initializes", causing the @logger never to be
set, causing undefined method errors
2008 Feb 01
3
Job Queue
After some initial stumblings, I think I''ve got the hang of
backgroundrb. It''s great! I''d been thinking for many many months how
cool something like this would be!
I''m trying to make a "job queue". That is, a pool of worker threads
monitor a queue. When a job appears, one of the workers grabs it and
executes the task. When complete, the worker
2007 Nov 14
7
BackgrounDRb version 1.0RC1 available now
Hi Folks,
BackgrounDRb is a Ruby job server and scheduler. Its main intent is to be
used with Ruby on Rails applications for offloading long-running tasks.
Since a Rails application blocks while serving a request it is best to
move long-running tasks off into a background process that is divorced
from http request/response cycle.
This new release of BackgrounDRb is also modular and can be used
2006 Sep 14
1
Status of your worker pool
On Sep 14, 2006, at 10:25 AM, Michael Siebert wrote:
> Hey Ezra,
> how is the status of your worker pool? i need some thing like this
> ASAP and i can''t get David Lemstra''s QueueWorker to work, so: whats
> the status? do you have some "beta" lying around on your hard
> drive? I dont want to spend my time on that if you''re coming up
>
2007 Dec 17
11
BackgrounDRb release 1.0 available now
Hi Folks,
I am glad to announce 1.0 release of BackgrounDRb.
This would be a major release since 0.2 release of BackgrounDRb.
Here is a brief summary of changes:
- BackgrounDRb is DRb no longer. It makes use of EventDriven network
programming library packet ( http://packet.googlecode.com ).
- Since we moved to packet, many nasty thread issues, result hash
corruption issues are totally