We have DELL 2650 server and I found recently /var/log/messages have following messages continue pop-up: ==========================================Dec 3 15:47:06 HOST1 kernel: Free pages: 17816kB (1664kB HighMem) Dec 3 15:47:06 HOST1 kernel: Active:7463815 inactive:656000 dirty:0 writeback:0 unstable:0 free:4454 slab:119979 mapped:730440 pagetables:63277 Dec 3 15:47:06 HOST1 kernel: DMA free:12448kB min:64kB low:128kB high:192kB active:0kB inactive:0kB present:16384kB pages_scanned:0 all_unreclaimable? yes Dec 3 15:47:06 HOST1 kernel: protections[]: 0 0 0 Dec 3 15:47:06 HOST1 kernel: Normal free:3704kB min:3728kB low:7456kB high:11184kB active:2688kB inactive:2284kB present:901120kB pages_scanned:6237 all_unreclaimable? yes Dec 3 15:47:06 HOST1 kernel: protections[]: 0 0 0 Dec 3 15:47:06 HOST1 kernel: HighMem free:1664kB min:512kB low:1024kB high:1536kB active:29852572kB inactive:2621716kB present:33423360kB pages_scanned:0 all_unreclaimable? no Dec 3 15:47:06 HOST1 kernel: protections[]: 0 0 0 Dec 3 15:47:06 HOST1 kernel: DMA: 2*4kB 5*8kB 3*16kB 2*32kB 4*64kB 2*128kB 2*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12448kB Dec 3 15:47:06 HOST1 kernel: Normal: 0*4kB 3*8kB 54*16kB 6*32kB 1*64kB 0*128kB 0*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3704kBDec 3 15:47:06 HOST1 kernel: HighMem: 4*4kB 54*8kB 0*16kB 18*32kB 4*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1664kB Dec 3 15:47:06 HOST1 kernel: 7920770 pagecache pages Dec 3 15:47:06 HOST1 kernel: Swap cache: add 144565971, delete 144479462, find 64245277/81316857, race 15+5335 Dec 3 15:47:06 HOST1 kernel: 0 bounce buffer pages Dec 3 15:47:06 HOST1 kernel: Free swap: 39981120kB Dec 3 15:47:06 HOST1 kernel: 8585216 pages of RAM Dec 3 15:47:06 HOST1 kernel: 8158130 pages of HIGHMEM Dec 3 15:47:06 HOST1 kernel: 266508 reserved pages Dec 3 15:47:06 HOST1 kernel: 11584926 pages shared Dec 3 15:47:06 HOST1 kernel: 87087 pages swap cached Dec 3 15:47:06 HOST1 kernel: Out of Memory: Killed process 27850 (oracle). ================================================== This server have 32 GB RAM and 40GB swap space. I don't know why I continue got those messages? $ free total used free shared buffers cached Mem: 33274832 33200168 74664 0 7116 31325660 -/+ buffers/cache: 1867392 31407440 Swap: 40957676 945640 40012036 ___________________________________________________ ??????? ? ???????????????? http://messenger.yahoo.com.tw/
m.roth at 5-cent.us
2009-Dec-03 21:45 UTC
[CentOS] Centos 4.7 /var/log/messages file kill process
> We have DELL 2650 server and I found recently /var/log/messages have > following messages continue pop-up:You had a runaway process that ate all of memory (mmm! tasty!) and wanted more, and the dreaded OOM (out of memory killer) started in, and killed the system. What's running on it that might have done that? It's got a bug.... mark "seen that here"> > ==========================================> Dec 3 15:47:06 HOST1 kernel: Free pages: 17816kB (1664kB HighMem) > Dec 3 15:47:06 HOST1 kernel: Active:7463815 inactive:656000 dirty:0 > writeback:0 unstable:0 free:4454 slab:119979 mapped:730440 > pagetables:63277 > Dec 3 15:47:06 HOST1 kernel: DMA free:12448kB min:64kB low:128kB > high:192kB active:0kB inactive:0kB present:16384kB pages_scanned:0 > all_unreclaimable? yes > Dec 3 15:47:06 HOST1 kernel: protections[]: 0 0 0 > Dec 3 15:47:06 HOST1 kernel: Normal free:3704kB min:3728kB low:7456kB > high:11184kB active:2688kB inactive:2284kB present:901120kB > pages_scanned:6237 all_unreclaimable? yes > Dec 3 15:47:06 HOST1 kernel: protections[]: 0 0 0 > Dec 3 15:47:06 HOST1 kernel: HighMem free:1664kB min:512kB low:1024kB > high:1536kB active:29852572kB inactive:2621716kB present:33423360kB > pages_scanned:0 all_unreclaimable? no > Dec 3 15:47:06 HOST1 kernel: protections[]: 0 0 0 > Dec 3 15:47:06 HOST1 kernel: DMA: 2*4kB 5*8kB 3*16kB 2*32kB 4*64kB > 2*128kB 2*256kB 0*512kB 1*1024kB 1*2048kB 2*4096kB = 12448kB > Dec 3 15:47:06 HOST1 kernel: Normal: 0*4kB 3*8kB 54*16kB 6*32kB 1*64kB > 0*128kB 0*256kB 1*512kB 0*1024kB 1*2048kB 0*4096kB = 3704kBDec 3 15:47:06 > HOST1 kernel: HighMem: 4*4kB 54*8kB 0*16kB 18*32kB 4*64kB 1*128kB 1*256kB > 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1664kB > Dec 3 15:47:06 HOST1 kernel: 7920770 pagecache pages > Dec 3 15:47:06 HOST1 kernel: Swap cache: add 144565971, delete 144479462, > find 64245277/81316857, race 15+5335 > Dec 3 15:47:06 HOST1 kernel: 0 bounce buffer pages > Dec 3 15:47:06 HOST1 kernel: Free swap: 39981120kB > Dec 3 15:47:06 HOST1 kernel: 8585216 pages of RAM > Dec 3 15:47:06 HOST1 kernel: 8158130 pages of HIGHMEM > Dec 3 15:47:06 HOST1 kernel: 266508 reserved pages > Dec 3 15:47:06 HOST1 kernel: 11584926 pages shared > Dec 3 15:47:06 HOST1 kernel: 87087 pages swap cached > Dec 3 15:47:06 HOST1 kernel: Out of Memory: Killed process 27850 > (oracle). > > ==================================================> > > This server have 32 GB RAM and 40GB swap space. I don't know why I > continue got those messages? > > > $ free > total used free shared buffers cached > Mem: 33274832 33200168 74664 0 7116 31325660 > -/+ buffers/cache: 1867392 31407440 > Swap: 40957676 945640 40012036 > > > > > ___________________________________________________ > ?z???????Y???q ?? ???q?B?T???B?????B?u?@?@???d?w?I > http://messenger.yahoo.com.tw/ > _______________________________________________ > CentOS mailing list > CentOS at centos.org > http://lists.centos.org/mailman/listinfo/centos >
mcclnx mcc wrote:> We have DELL 2650 server and I found recently /var/log/messages have > following messages continue pop-up: > > ==========================================> Dec 3 15:47:06 HOST1 kernel: Free pages: 17816kB (1664kB HighMem)Looks like you ran out of/low on highmem or lowmem pages? check /proc/meminfo HighTotal: 2227668 kB HighFree: 362404 kB LowTotal: 888620 kB LowFree: 8932 kB http://www.redhat.com/advice/tips/meminfo.html Also Dell 2650 doesn't support 32GB of ram, only 12GB, so re-check what hardware your running(run dmidecode). It sounds like your using a 32-bit OS, if so(uname -m), then upgrade your system (hardware too if needed) to a 64-bit OS. Nobody should run 32GB of ram on a 32-bit system that is just stupid crazy. I don't even think Oracle supports 32-bit anymore. nate