Re: memory limits
:Hi there,
:
:I'm running a very memory intensive php 5.0 script through apache2 on a recent
:DragonFly build (Sept 1). My problem is that I'm running into some OS limit or
:something. I'm assuming this because I have 2G physical RAM and 4G swap, but
:apache runs out of memory waaaay before then (maybe 500MB) even though top
:reports 1400M Free.
:
:I've tried setting datasize to 'infinity' using `limits`, but that didn't stick
:(I ran it again, and it still said datasize was limited to 524288). I also
:tried to adjust kern.ipc.shmmax to 6GB using `sysctl`, but it didn't make a
:difference. FYI, that variable's upper limit is 2147483647.
:
:What can I do to give apache2 access to all the addressable memory on this
:system?
:
:Thanks,
:
:Adrian
The address space is broken up into several pieces. The 'heap' space
is what the datasize limit specifies and is limited to 512MB by the
kernel.
You can increase this space by setting the kern.maxdsiz loader
variable to the number of bytes you want the process heap space
to be.
However, since these are 32 bit systems any given process only has 4GB
of VM space. 1G is used by the kernel, 64MB is used by the stack, and
you need to leave enough for mmap() as well so it is generally best not
to set kern.maxdsiz larger then 2GB (e.g. 2147483648) or so.
e.g. a /boot/loader.conf containing:
kern.maxdsiz="2147483648"
Generally speaking if you want to work on very large data sets in linear
memory you need to run on a 64 bit platform with a 64 bit kernel.
DragonFly does not yet have any 64 bit platform support. Otherwise you
need to reformulate your program to reduce the directly addressed
working set to something a 32 bit platform can handle.
-Matt
Matthew Dillon
<dillon@backplane.com>
討論串 (同標題文章)