Displaying 20 results from an estimated 3000 matches similar to: "Creating another database connection for large mysql import?"
2007 Apr 04
6
Exception when doing DRb remote calls from a BackgrounDRb worker
Hello,
I am trying to make DRb calls to a external server from a backgrounDRb
worker, but I''m getting always the next exception when I make the remote
call.
> ERROR:
> drbunix:///tmp/backgroundrb.11175/experimenter_worker_3e899de945f0803a82cd257cfac316d0_0_0.0738904928422051
> - #<Errno::ENOENT: No such file or directory -
>
2006 Nov 05
5
backgroundrb preview
Hi Ezra/skaar,
Wow man, the exercise was worth it. The connection closed problem with
socket as i mentioned in my earlier mails...completely disappeared,
and now i can connect only once to the socket and keep reading..till
end of its days.
Literally impossible with older release of backgroundrb.
This could also potentially solve the issues people were having with
ActiveRecord.
As i said
2007 Jan 15
6
Instantiating middleman and worker from inside a model?
In short: how (if possible) would i go about arranging it so that i
can instantiate a middleman and set a worker going from within a
method in one of my models? or is this a weird thing to be wanting to
do? (
My specific situation: I have an ''Image'' model in my application. An
actual image file associated with the model is being stored on
amazons s3 system.
2007 Jan 22
1
Strange behavior
Ok two things that bug me
1) http://backgroundrb.devjavu.com/projects/backgroundrb/ticket/48
i thought i''ll just post ticket link - but well - it''s strange
2) when i switch base class from RailsBase to Base i can''t access MiddleMan
- i get error
NameError: uninitialized constant MiddleMan
from (drbunix:///tmp/backgroundrbunix_localhost_2999)
2008 Jan 13
3
right usage of bdrb
Hi,
i''m going to implement a syndication-service, which will get lists in
xml with some meta-data an enclosed video files, which will get encoded
at the end. The syndication run will be startet every five minutes of
a full hour.
So i thought to build 4 Worker. One for checking which feeds to
syndicate (syndication_worker) at a specific time, one for processing
the list
2007 Mar 13
3
Scheduled worker dies after about 30-45 runs
I have a scheduled worker that runs every minute, checking for new eBay
auctions to post. If it finds an auction, then it posts it. If there are no
auctions in the database that are queued up, it simply does nothing. I got
the worker to finally run as a scheduled worker, every minute. However,
after about 30-45 scheduled runs, it simply stops running.
My backgroundrb_schedules.yml file:
------
2006 Nov 20
4
Production RAILS_ENV / DB Selection
Hey all,
I''m having some issues moving a project that incorporates Backgroundrb onto
a staging server... For some reason (surely of my own doing), my RailsBase
workers are insisting on using trying to access my development DB instead of
my "production" DB.
When I try to load a model object from within a worker, I get the following:
20061120-21:54:28 (26296)
2007 Mar 02
1
example standalone error.
Hello,
Trying to get the example to work in standalone mode. I have the following
in a file and am not certain why I get this undefined method error:
error:
~/ruby sample_app.rb
my sample app :)
sample_app.rb:9: undefined method `new_worker'' for
BackgrounDRb::MiddleMan:Class (NoMethodError)
### code follows ###
# sample_app ... try to get stand-alone happiness.
#require
2007 Apr 26
2
looking for a worker that''s gone
In my app, I store the job key when a worker is fired off and then
check back in periodically to see how its doing. The workers delete
themselves when they''re done. I would expect when I try to get a
worker that has been deleted, I would get nil or a proper exception,
but instead I get:
>> MiddleMan.worker(''foobar'')
NoMethodError: undefined method
2007 Jan 22
1
MiddleMan behavior
i found some questions and answers on mailing lists but there is still a
problem - when i want to create new worker from within a worker -
::BackgrounDRb::MiddleMan.new_worker(:class => :second_worker, :args =>
{:id=>2, :text=>"slave"}) works
but when i want to get reference to that object:
::BackgrounDRb::MiddleMan.worker(@second)
yields:
NoMethodError: undefined
2007 Jun 06
2
struggling with stability
Greetings all,
Unit tests are passing, but I''m having mucho problems getting brb to
run without exceptions for more than 6 hours.
I''m seeing a mixture of the following 2 exceptions:
20070605-11:26:56 (21497) failed to find slave socket - (RuntimeError)
20070605-11:26:56 (21497) /usr/local/lib/ruby/gems/1.8/gems/
slave-1.2.1/lib/slave.rb:435:in `initialize''
2006 Dec 15
1
:job_key acting weird?
Hi all
I''m experiencing something strange with a :job_key, it took me a very
long time to find out a worker wasn''t doing it''s job because of the
name of my job_key. The first one I tried was :make_kohier, and with
that name (and lot''s of other ones) I can''t get the worker to work. I
do get my key in return, but the job doesn''t start
2006 Dec 08
3
Thread Pool Size?
Hi All,
It might be lack of sleep, but I am struggling to accurately limit our pool
size. It seems like I can specify it on the server with the -s command
line option and also on the client via the YAML pool_size. Is that right?
Which one wins?
Our problem is that we are getting about 40 threads on each backgroundrb box
and it''s flooring our db and each bgrb box.
We want around 8.
2007 Jan 22
7
Yet Another Problem with BackgroundRB
Hi!
My cron-based worker is being indeed invoked by backgroundRB at
correct times. But... After several runs it can no longer find DB
columns! The same query, which was running OK an hour ago starts to
throw MySQL error about unkown column in where clause. If I restart
backgroundrb it works for some time but stops working after several
invocations.
Has anyone epxerienced the similar beahviour?
2006 Dec 05
1
worker method not running in background
When i call a worker method my browsers hangs until the task is finished.
The same code works nicely in the background when inside the do_work method.
Does this mean i can only start a task in background via the do_work method
?
Or am i doing something wrong here ?
regards tom
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
2007 Nov 30
1
backgroundrb not cleaning up tmp files?
I just had an interesting issue on a production system that has been
running nicely for about a year. There were approximately 10,000
backgroundrb temp files in the /tmp directory. It looks like
backgroundrb wasn''t cleaning them up.
I noticed it with the following error:
DRb::DRbConnError: drbunix:///tmp/backgroundrb.20015/
backgroundrb_logger_0_0.101544829808665 -
2007 Jul 29
4
Server dying with perpetual "Connection reset by peer"
I''m at a loss to explain a very strange error I''m getting.
This seems to happen on our production system where we have a
backgroundrb server sharing a host with a Rails app running on
Mongrel. The first one or two, occasionally three, calls to a worker
(direct MiddleMan calls from Rails, not scheduled) succeed, but
afterwards, the server fails to initialize new workers.
2006 Nov 20
2
Passing object into results - "can''t convert DRb::DRbUnknown into Hash - (TypeError)"
Hi,
I''m using backgroundrb to get RSS feeds and pass them back to the
controller. I''m using the Ruby RSS library to parse the feed, which returns
an RSS object. After that I pass the object into the results hash, but
that''s when this error occurs. Basically, this is what I have:
rss = RSS::Parser.parse(response.body)
results[:feed] = rss # error!
20061120-15:46:19
2006 Dec 15
3
can Timeout::timeout(...) be used in a Worker ?
Hi ,
I was wondering if anyone else has tried to use the Timeout::timeout
method in a backgroundrb Worker and had Timeout raise an exception
after the allotted amount of time .
I ask because i have written a test script to make sure Timeout would
work . I have tested the script by directly feeding it to ruby with :
$ ruby test_script.rb
and piping the script to the rails console:
$
2007 Nov 16
1
Backgroundrb with Load Balancing Rails engines
Hi there,
We run several (3-4) Rails servers behind the reverse proxy / load
balancing web server serving the single application. All Rails
instances share the same database and use the database as a session
storage. Memcached is also part of the picture.
I''m looking into using Backgroundrb for some large uploads / parsing
task that provide progress status updates (via ajax calls).