Displaying 1 result from an estimated 1 matches for "39e6".
Did you mean:
39,6
2010 Dec 08
2
Parallel Scan of Large File
...uot;)
child <- foreach(i = icount(40)) %dopar%
{
scan(file,what = "character",sep = "\n",skip = 0,nlines = 1e6)
}
Thus, each child would have a different skip argument. child[[1]]: skip = 0,
child[[2]]: skip = 1e6 + 1, child[[3]]: skip = 2e6 + 1, ... ,child[[40]]:
skip = 39e6 + 1. I would then end up with a list of 40 vectors with
child[[1]] containing records 1 to 1000000, child[[2]] containing records
1000001 to 2000000, ... ,child[[40]] containing records 39000001 to
40000000.
Also, would one file connection suffice or does their need to be a file
connection that o...