Displaying 1 result from an estimated 1 matches for "myspaceworker".
2008 Mar 25
0
Questions about backgroundrb
...eduled to run periodically on
> a daily basis, saving information to the db but not generating any xml or
> json to send back to the view.
> The questions I have:
>
> Is the following the best/most scalable way to implement?...Each site I am
> crawling gets its own worker -- e.g., MyspaceWorker. Within each worker, I
> have a crawl method that uses concurrency to avoid latency when crawling one
> set of several web pages within one website. If 2 users decides to track
> two different sets of pages from a given website, then I declare two new
> instances of MyspaceWorker. An...