[R] large dataset

Douglas Bates bates at stat.wisc.edu
Mon Mar 29 22:58:38 CEST 2010


On Sat, Mar 27, 2010 at 4:19 AM, n.vialma at libero.it <n.vialma at libero.it> wrote:
> Hi I have a question,
> as im not able to import a csv file which contains a big dataset(100.000 records) someone knows how many records R can handle without giving problems?
> What im facing when i try to import the file is that R generates more than 100.000 records and is very slow...
> thanks a lot!!!

Did you read the sections of the "R Data Import/Export" manual (check
the Help menu item under manuals) relating to reading large data sets?
 There are many things you can do to make read.csv faster on files
with a large number of records.  You can pre-specify the number of
records so that vectors are not continually being resized and,
probably the most important, you can specify the column types.

You can read the whole manual in less than the R is taking to read the file.



More information about the R-help mailing list