[R] Processing 10^8 rows and 1^3 columns

Gabor Grothendieck ggrothendieck at gmail.com
Thu Jul 3 05:36:44 CEST 2008

The sqldf package makes it easy to use DBI, RSQLite and sqlite
to read a large file directly to an sqlite database without going through
R and then read all or a portion of it into R using an arbitrary SQL
statement.  See example 6 on the home page: http://sqldf.googlecode.com

On Wed, Jul 2, 2008 at 11:21 PM, Daren Tan <daren76 at hotmail.com> wrote:
> With smaller tab-limited files, I could load them using read.table and the likes. Now I have a gigantic 10^8 rows and 1^3 columns tab-limited file for processsing, please throw some ideas how to handle it.
> Thanks
> _________________________________________________________________
> Publish your photos to your Space easily with Photo Gallery.
>        [[alternative HTML version deleted]]
> ______________________________________________
> R-help at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.

More information about the R-help mailing list