I know the drill about it not being the best idea to use PAE, but AMD64 is not an option for my circumstances.
First, Here is an output of uname -a:
I have 12GB of memory installed and this server runs a large number of jails and has operated satisfactorily for half a year just using the 4GB of memory addressable with a GENERIC kernel.
Recently, I have begun to experience some memory resource issues that caused me to start looking into utilizing the full 12GB that I have available on this machine. With that in mind, I diligently followed the advice and instructions to build in PAE to my otherwise fairly GENERIC kernel (see attached kernel config file). I included
as indicated. I also tweaked my kern.maxfiles to 110000, up from 100000. The build and installation went faultless.
On reboot with the new PAE kernel, it booted just fine. However, after the 16th jail, it stopped loading the remaining jails.
In the /var/logs/messages, I started seeing the following entries repeating:
Checking the values of sysctl vm.kvm_free it said "0".
Here are my sysctl vm.kvm* settings:
I thought okay, I need to up the vm.kmem_size_max and vm.kmem_size values in my /boot/loader.conf file, so I set them, as such:
On reboot, it froze with the following console error:
I had to boot into single user to remove the kmem stuff from loader.conf.
I am back using my old stalwart GENERIC kernel, but would sure like to understand what I could do to increase my kmem_size and kmem_size_max. I understand that there is supposed to be a kernel mempory hard limit of 2048M in 32bit FBSD, but that is twice what I had set and I still received the error.
Grateful for any advice.
Jake
First, Here is an output of uname -a:
Code:
FreeBSD xxxx.net 8.0-RELEASE FreeBSD 8.0-RELEASE #1: Thu Aug 12 19:04:50 UTC 2010
[email]root@xxxx.net[/email]:/usr/obj/usr/src/sys/PAE_KERNEL_9_2_0 i386I have 12GB of memory installed and this server runs a large number of jails and has operated satisfactorily for half a year just using the 4GB of memory addressable with a GENERIC kernel.
Recently, I have begun to experience some memory resource issues that caused me to start looking into utilizing the full 12GB that I have available on this machine. With that in mind, I diligently followed the advice and instructions to build in PAE to my otherwise fairly GENERIC kernel (see attached kernel config file). I included
Code:
options KVA_PAGES=512
device acpi
device ispfwOn reboot with the new PAE kernel, it booted just fine. However, after the 16th jail, it stopped loading the remaining jails.
In the /var/logs/messages, I started seeing the following entries repeating:
Code:
kernel: vm_thread_new: kstack allocation failedChecking the values of sysctl vm.kvm_free it said "0".
Here are my sysctl vm.kvm* settings:
Code:
vm.kmem_size_max: 335544320
vm.kmem_size: 335544320I thought okay, I need to up the vm.kmem_size_max and vm.kmem_size values in my /boot/loader.conf file, so I set them, as such:
Code:
vm.kmem_size_max="1073741824"
vm.kmem_size="1073741824"On reboot, it froze with the following console error:
Code:
panic: kmem_suballoc: bad status return of 3
cpuid = 0I had to boot into single user to remove the kmem stuff from loader.conf.
I am back using my old stalwart GENERIC kernel, but would sure like to understand what I could do to increase my kmem_size and kmem_size_max. I understand that there is supposed to be a kernel mempory hard limit of 2048M in 32bit FBSD, but that is twice what I had set and I still received the error.
Grateful for any advice.
Jake
