[R] maximal dataset size

[Cheng, Yiling]

Very good. This is big enough usually. My dataset size in SAS format is over
300M, but I can make it smaller by selecting some variables for R. By the
way, you said you can run with 100 M dataset on you PC. What kind of format
do they have? ASCII or R? 
Thank you for your help.

Yiling

-----Original Message-----
From: james.holtman at convergys.com [mailto:james.holtman at convergys.com]
Sent: Monday, February 04, 2002 3:43 PM
To: Cheng, Yiling
Subject: Re: [R] maximal dataset size



The maximum data set is limited by the addressing of the PC, which is 2GB.
The largest dataset that you could probably work with is at least 50%
smaller (<1GB), since you probably need some working space if you are doing
any manipulation of the data.  It is also a function of the memory on your
system.  I would suggest you get at least twice as much real memory as the
largest data set you will be working with, or else you will be paging, and
paging 1GB will take a lot of time.

If the largest you are working with is about 20-25% of your real memory
that R can use (don't run anything else on the machine that might take
memory), you will probably be fine.  I use 512M of memory and run with 100M
data sets.





"Cheng, Yiling" <ycheng at cooperinst.org>@stat.math.ethz.ch on 02/04/2002
13:02:11

Sent by:  owner-r-help at stat.math.ethz.ch


To:   "R-Help (E-mail)" <r-help at stat.math.ethz.ch>
cc:
Subject:  [R] maximal dataset size


Hi, there,
    I am using PC window version R and dealing with big dataset usually.
May
anyone let me whether the maximal dataset size in R is limited by computer
memory or hard drive capacity?
   Thanks in advance.
Yiling Cheng, M.D., Ph.D.
Project Manager
The Cooper Institute for Aerobics Research
12330 Preston Road, Dallas, Texas 75230
phone: (972) 3413248; Fax: (972) 3413224

-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.
-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._.
_._._



--

NOTICE:  The information contained in this electronic mail transmission is
intended by Convergys Corporation for the use of the named individual or
entity to which it is directed and may contain information that is
privileged or otherwise confidential.  If you have received this electronic
mail transmission in error, please delete it from your system without
copying or forwarding it, and notify the sender of the error by reply email
or by telephone (collect), so that the sender's address records can be
corrected.

-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-.-
r-help mailing list -- Read http://www.ci.tuwien.ac.at/~hornik/R/R-FAQ.html
Send "info", "help", or "[un]subscribe"
(in the "body", not the subject !)  To: r-help-request at stat.math.ethz.ch
_._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._._