[R] Odp: reading a big file

Petr PIKAL petr.pikal at precheza.cz
Thu May 24 10:22:44 CEST 2007


One possibility is to use scan with combination of skip and nlines 
parameters in a body of for cycle and adding read portion to some suitable 



petr.pikal at precheza.cz

r-help-bounces at stat.math.ethz.ch napsal dne 23.05.2007 19:38:33:

> Dear All,
> I am on WindowsXP with 512 MB of RAM, R 2.4.0, and I want to read in a
> big file mln100.txt. The file is 390MB big, it contains a column of 100 
> millions integers.
> > mln100=scan("mln100.txt")
> Error: cannot allocate vector of size 512000 Kb
> In addition: Warning messages:
> 1: Reached total allocation of 511Mb: see help(memory.size)
> 2: Reached total allocation of 511Mb: see help(memory.size)
> In fact, I would be quite happy if I could read, say, every tenth 
> integer (line) of the file. Is it possible to do this?
> Cheers,
> Rem
> ______________________________________________
> R-help at stat.math.ethz.ch mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide 
> and provide commented, minimal, self-contained, reproducible code.

More information about the R-help mailing list