I was wondering if you could tell me whether this is an issue inside enhanceio or just memory starvation. Not sure why this would affect the caches that are all in writethrough mode. I got this error after installing NFS server:
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912860] kworker/u290:2: page allocation failure: order:0, mode:0x2200000(GFP_NOWAIT|__GFP_NOTRACK)
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912867] CPU: 21 PID: 108658 Comm: kworker/u290:2 Tainted: G OE 4.6.4-040604-generic #201607111332
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912869] Hardware name: Dell Inc. Precision Rack 7910/01J90F, BIOS 1.1.4 11/04/2014
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912878] Workqueue: writeback wb_workfn (flush-183:0)
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912881] 0000000000000086 000000009b7a5130 ffff880018577320 ffffffff813f3373
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912885] 0000000000000000 0000000000000000 ffff8800185773b0 ffffffff8119d7e1
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912887] 0220000000000000 ffff88107ffd4700 0000000000000040 0000000000000040
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912890] Call Trace:
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912898] [] dump_stack+0x63/0x90
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912903] [] warn_alloc_failed+0x101/0x170
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912906] [] __alloc_pages_nodemask+0x4f9/0xc30
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912910] [] ? bt_get+0x74/0x1d0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912916] [] alloc_pages_current+0x8c/0x110
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912919] [] new_slab+0x452/0x5c0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912922] [] ___slab_alloc+0x249/0x480
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912932] [] ? eio_new_ebio+0x175/0x2a0 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912934] [] ? __bt_get.isra.6+0xe5/0x1c0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912937] [] ? eio_new_ebio+0x175/0x2a0 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912940] [] __slab_alloc+0x20/0x40
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912942] [] kmem_cache_alloc_trace+0x192/0x1e0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912946] [] eio_new_ebio+0x175/0x2a0 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912950] [] eio_map+0x1e0/0x1690 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912954] [] eio_make_request_fn+0x355/0x480 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912959] [] generic_make_request+0xf2/0x1d0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912961] [] submit_bio+0x76/0x170
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912966] [] submit_bh_wbc+0x12f/0x160
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912969] [] __block_write_full_page.constprop.38+0x115/0x3a0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912971] [] ? I_BDEV+0x20/0x20
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912973] [] ? I_BDEV+0x20/0x20
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912976] [] block_write_full_page+0x145/0x170
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912979] [] blkdev_writepage+0x18/0x20
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912981] [] __writepage+0x13/0x30
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912984] [] write_cache_pages+0x1fe/0x530
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912986] [] ? wb_position_ratio+0x1f0/0x1f0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912989] [] generic_writepages+0x51/0x80
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912994] [] ? rbd_queue_rq+0x24/0x30 [rbd]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912998] [] ? __blk_mq_run_hw_queue+0x1f5/0x370
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913001] [] blkdev_writepages+0x2f/0x40
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913004] [] do_writepages+0x1e/0x30
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913007] [] __writeback_single_inode+0x45/0x320
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913009] [] writeback_sb_inodes+0x26c/0x600
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913012] [] __writeback_inodes_wb+0x92/0xc0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913015] [] wb_writeback+0x261/0x310
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913017] [] wb_workfn+0x10d/0x3e0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913023] [] ? try_to_wake_up+0x47/0x3c0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913030] [] process_one_work+0x168/0x480
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913033] [] worker_thread+0x4b/0x500
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913036] [] ? process_one_work+0x480/0x480
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913039] [] kthread+0xd8/0xf0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913043] [] ret_from_fork+0x22/0x40
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913046] [] ? kthread_create_on_node+0x1a0/0x1a0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913047] Mem-Info:
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] active_anon:138161 inactive_anon:182788 isolated_anon:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] active_file:7134443 inactive_file:7334078 isolated_file:64
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] unevictable:4174 dirty:7301268 writeback:2470 unstable:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] slab_reclaimable:757342 slab_unreclaimable:55780
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] mapped:19650 shmem:248009 pagetables:1695 bounce:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] free:295885 free_pcp:3298 free_cma:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913061] Node 0 DMA free:14872kB min:252kB low:312kB high:372kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15980kB managed:15896kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913072] lowmem_reserve[]: 0 1727 31926 31926 31926
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913076] Node 0 DMA32 free:148808kB min:28224kB low:35280kB high:42336kB active_anon:10180kB inactive_anon:25500kB active_file:470944kB inactive_file:507656kB unevictable:0kB isolated(anon):0kB isolated(file):128kB present:1851052kB managed:1769256kB mlocked:4kB dirty:502012kB writeback:2688kB mapped:160kB shmem:18396kB slab_reclaimable:433752kB slab_unreclaimable:16044kB kernel_stack:4192kB pagetables:52kB unstable:0kB bounce:0kB free_pcp:2364kB local_pcp:116kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913085] lowmem_reserve[]: 0 0 30198 30198 30198
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913089] Node 0 Normal free:493360kB min:493328kB low:616660kB high:739992kB active_anon:268028kB inactive_anon:415624kB active_file:13445392kB inactive_file:13691064kB unevictable:952kB isolated(anon):0kB isolated(file):0kB present:31457280kB managed:30923004kB mlocked:968kB dirty:13607724kB writeback:1936kB mapped:63552kB shmem:487352kB slab_reclaimable:1264356kB slab_unreclaimable:102352kB kernel_stack:73824kB pagetables:2644kB unstable:0kB bounce:0kB free_pcp:9428kB local_pcp:112kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913099] lowmem_reserve[]: 0 0 0 0 0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913103] Node 1 Normal free:526500kB min:526764kB low:658452kB high:790140kB active_anon:274436kB inactive_anon:290028kB active_file:14621436kB inactive_file:15137592kB unevictable:15744kB isolated(anon):0kB isolated(file):128kB present:33554432kB managed:33018892kB mlocked:15752kB dirty:15095336kB writeback:5256kB mapped:14888kB shmem:486288kB slab_reclaimable:1331260kB slab_unreclaimable:104724kB kernel_stack:76320kB pagetables:4084kB unstable:0kB bounce:0kB free_pcp:1392kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:2668 all_unreclaimable? no
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913111] lowmem_reserve[]: 0 0 0 0 0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913115] Node 0 DMA: 0_4kB 1_8kB (U) 1_16kB (U) 0_32kB 2_64kB (U) 1_128kB (U) 1_256kB (U) 0_512kB 0_1024kB 1_2048kB (M) 3_4096kB (M) = 14872kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913126] Node 0 DMA32: 2569_4kB (UM) 1714_8kB (ME) 3556_16kB (UME) 1439_32kB (UME) 307_64kB (UME) 10_128kB (E) 0_256kB 0_512kB 0_1024kB 0_2048kB 0_4096kB = 147860kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913137] Node 0 Normal: 101968_4kB (UME) 10187_8kB (UM) 0_16kB 0_32kB 0_64kB 0_128kB 0_256kB 0_512kB 0_1024kB 0_2048kB 0_4096kB = 489368kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913145] Node 1 Normal: 14381_4kB (UME) 58530_8kB (UME) 20_16kB (UE) 0_32kB 0_64kB 0_128kB 0_256kB 0_512kB 0_1024kB 0_2048kB 0_4096kB = 526084kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913155] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913157] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913159] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913160] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913162] 14717778 total pagecache pages
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913164] 2 pages in swap cache
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913165] Swap cache stats: add 12, delete 10, find 0/0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913166] Free swap = 48827340kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913168] Total swap = 48827388kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913169] 16719686 pages RAM
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913170] 0 pages HighMem/MovableOnly
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913171] 287924 pages reserved
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913172] 0 pages cma reserved
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913173] 0 pages hwpoisoned
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913175] SLUB: Unable to allocate memory on node -1, gfp=0x2000000(GFP_NOWAIT)
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913177] cache: kmalloc-96, object size: 96, buffer size: 96, default order: 0, min order: 0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913180] node 0: slabs: 217, objs: 9114, free: 114
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913182] node 1: slabs: 295, objs: 12390, free: 0
syslog-outofram.zip
I was wondering if you could tell me whether this is an issue inside enhanceio or just memory starvation. Not sure why this would affect the caches that are all in writethrough mode. I got this error after installing NFS server:
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912860] kworker/u290:2: page allocation failure: order:0, mode:0x2200000(GFP_NOWAIT|__GFP_NOTRACK)
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912867] CPU: 21 PID: 108658 Comm: kworker/u290:2 Tainted: G OE 4.6.4-040604-generic #201607111332
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912869] Hardware name: Dell Inc. Precision Rack 7910/01J90F, BIOS 1.1.4 11/04/2014
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912878] Workqueue: writeback wb_workfn (flush-183:0)
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912881] 0000000000000086 000000009b7a5130 ffff880018577320 ffffffff813f3373
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912885] 0000000000000000 0000000000000000 ffff8800185773b0 ffffffff8119d7e1
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912887] 0220000000000000 ffff88107ffd4700 0000000000000040 0000000000000040
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912890] Call Trace:
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912898] [] dump_stack+0x63/0x90
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912903] [] warn_alloc_failed+0x101/0x170
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912906] [] __alloc_pages_nodemask+0x4f9/0xc30
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912910] [] ? bt_get+0x74/0x1d0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912916] [] alloc_pages_current+0x8c/0x110
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912919] [] new_slab+0x452/0x5c0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912922] [] ___slab_alloc+0x249/0x480
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912932] [] ? eio_new_ebio+0x175/0x2a0 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912934] [] ? __bt_get.isra.6+0xe5/0x1c0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912937] [] ? eio_new_ebio+0x175/0x2a0 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912940] [] __slab_alloc+0x20/0x40
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912942] [] kmem_cache_alloc_trace+0x192/0x1e0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912946] [] eio_new_ebio+0x175/0x2a0 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912950] [] eio_map+0x1e0/0x1690 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912954] [] eio_make_request_fn+0x355/0x480 [enhanceio]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912959] [] generic_make_request+0xf2/0x1d0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912961] [] submit_bio+0x76/0x170
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912966] [] submit_bh_wbc+0x12f/0x160
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912969] [] __block_write_full_page.constprop.38+0x115/0x3a0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912971] [] ? I_BDEV+0x20/0x20
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912973] [] ? I_BDEV+0x20/0x20
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912976] [] block_write_full_page+0x145/0x170
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912979] [] blkdev_writepage+0x18/0x20
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912981] [] __writepage+0x13/0x30
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912984] [] write_cache_pages+0x1fe/0x530
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912986] [] ? wb_position_ratio+0x1f0/0x1f0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912989] [] generic_writepages+0x51/0x80
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912994] [] ? rbd_queue_rq+0x24/0x30 [rbd]
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.912998] [] ? __blk_mq_run_hw_queue+0x1f5/0x370
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913001] [] blkdev_writepages+0x2f/0x40
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913004] [] do_writepages+0x1e/0x30
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913007] [] __writeback_single_inode+0x45/0x320
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913009] [] writeback_sb_inodes+0x26c/0x600
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913012] [] __writeback_inodes_wb+0x92/0xc0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913015] [] wb_writeback+0x261/0x310
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913017] [] wb_workfn+0x10d/0x3e0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913023] [] ? try_to_wake_up+0x47/0x3c0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913030] [] process_one_work+0x168/0x480
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913033] [] worker_thread+0x4b/0x500
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913036] [] ? process_one_work+0x480/0x480
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913039] [] kthread+0xd8/0xf0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913043] [] ret_from_fork+0x22/0x40
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913046] [] ? kthread_create_on_node+0x1a0/0x1a0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913047] Mem-Info:
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] active_anon:138161 inactive_anon:182788 isolated_anon:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] active_file:7134443 inactive_file:7334078 isolated_file:64
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] unevictable:4174 dirty:7301268 writeback:2470 unstable:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] slab_reclaimable:757342 slab_unreclaimable:55780
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] mapped:19650 shmem:248009 pagetables:1695 bounce:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913057] free:295885 free_pcp:3298 free_cma:0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913061] Node 0 DMA free:14872kB min:252kB low:312kB high:372kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15980kB managed:15896kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913072] lowmem_reserve[]: 0 1727 31926 31926 31926
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913076] Node 0 DMA32 free:148808kB min:28224kB low:35280kB high:42336kB active_anon:10180kB inactive_anon:25500kB active_file:470944kB inactive_file:507656kB unevictable:0kB isolated(anon):0kB isolated(file):128kB present:1851052kB managed:1769256kB mlocked:4kB dirty:502012kB writeback:2688kB mapped:160kB shmem:18396kB slab_reclaimable:433752kB slab_unreclaimable:16044kB kernel_stack:4192kB pagetables:52kB unstable:0kB bounce:0kB free_pcp:2364kB local_pcp:116kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913085] lowmem_reserve[]: 0 0 30198 30198 30198
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913089] Node 0 Normal free:493360kB min:493328kB low:616660kB high:739992kB active_anon:268028kB inactive_anon:415624kB active_file:13445392kB inactive_file:13691064kB unevictable:952kB isolated(anon):0kB isolated(file):0kB present:31457280kB managed:30923004kB mlocked:968kB dirty:13607724kB writeback:1936kB mapped:63552kB shmem:487352kB slab_reclaimable:1264356kB slab_unreclaimable:102352kB kernel_stack:73824kB pagetables:2644kB unstable:0kB bounce:0kB free_pcp:9428kB local_pcp:112kB free_cma:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913099] lowmem_reserve[]: 0 0 0 0 0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913103] Node 1 Normal free:526500kB min:526764kB low:658452kB high:790140kB active_anon:274436kB inactive_anon:290028kB active_file:14621436kB inactive_file:15137592kB unevictable:15744kB isolated(anon):0kB isolated(file):128kB present:33554432kB managed:33018892kB mlocked:15752kB dirty:15095336kB writeback:5256kB mapped:14888kB shmem:486288kB slab_reclaimable:1331260kB slab_unreclaimable:104724kB kernel_stack:76320kB pagetables:4084kB unstable:0kB bounce:0kB free_pcp:1392kB local_pcp:0kB free_cma:0kB writeback_tmp:0kB pages_scanned:2668 all_unreclaimable? no
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913111] lowmem_reserve[]: 0 0 0 0 0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913115] Node 0 DMA: 0_4kB 1_8kB (U) 1_16kB (U) 0_32kB 2_64kB (U) 1_128kB (U) 1_256kB (U) 0_512kB 0_1024kB 1_2048kB (M) 3_4096kB (M) = 14872kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913126] Node 0 DMA32: 2569_4kB (UM) 1714_8kB (ME) 3556_16kB (UME) 1439_32kB (UME) 307_64kB (UME) 10_128kB (E) 0_256kB 0_512kB 0_1024kB 0_2048kB 0_4096kB = 147860kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913137] Node 0 Normal: 101968_4kB (UME) 10187_8kB (UM) 0_16kB 0_32kB 0_64kB 0_128kB 0_256kB 0_512kB 0_1024kB 0_2048kB 0_4096kB = 489368kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913145] Node 1 Normal: 14381_4kB (UME) 58530_8kB (UME) 20_16kB (UE) 0_32kB 0_64kB 0_128kB 0_256kB 0_512kB 0_1024kB 0_2048kB 0_4096kB = 526084kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913155] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913157] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913159] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913160] Node 1 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913162] 14717778 total pagecache pages
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913164] 2 pages in swap cache
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913165] Swap cache stats: add 12, delete 10, find 0/0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913166] Free swap = 48827340kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913168] Total swap = 48827388kB
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913169] 16719686 pages RAM
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913170] 0 pages HighMem/MovableOnly
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913171] 287924 pages reserved
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913172] 0 pages cma reserved
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913173] 0 pages hwpoisoned
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913175] SLUB: Unable to allocate memory on node -1, gfp=0x2000000(GFP_NOWAIT)
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913177] cache: kmalloc-96, object size: 96, buffer size: 96, default order: 0, min order: 0
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913180] node 0: slabs: 217, objs: 9114, free: 114
Sep 5 07:11:12 roc-4r-scd226 kernel: [314530.913182] node 1: slabs: 295, objs: 12390, free: 0
syslog-outofram.zip