freebsd stable - Nov 2018 - Where is my memory on 'fresh' 11-STABLE? It should be used by ARC, but it is not used for it anymore.

Hello Lev,

Wednesday, November 21, 2018, 1:56:18 PM, you wrote:
>> Could you show the output of "vmstat -s" when in this state?
>  Now ARC is 1.9GB (!!!) and 15G is still Wired:
> % vmstat -s
> 1311134466 cpu context switches
> 2126950424 device interrupts
>  45414140 software interrupts
> 103215017 traps
> 2910067754 system calls
>        25 kernel threads created
>    108756  fork() calls
>     50914 vfork() calls
>       111 rfork() calls
>         0 swap pager pageins
>         0 swap pager pages paged in
>         0 swap pager pageouts
>         0 swap pager pages paged out
>      4201 vnode pager pageins
>     51719 vnode pager pages paged in
>     31597 vnode pager pageouts
>     63028 vnode pager pages paged out
>         7 page daemon wakeups
> 1212387275 pages examined by the page daemon
>         0 clean page reclamation shortfalls
>         0 pages reactivated by the page daemon
>   8281789 copy-on-write faults
>      7909 copy-on-write optimized faults
>  44440180 zero fill pages zeroed
>     24762 zero fill pages prezeroed
>         2 intransit blocking page faults
>  63838217 total VM faults taken
>      3816 page faults requiring I/O
>         0 pages affected by kernel thread creation
>   3996512 pages affected by  fork()
>   1842784 pages affected by vfork()
>      5499 pages affected by rfork()
>  88771375 pages freed
>         0 pages freed by daemon
>  21591789 pages freed by exiting processes
>      4936 pages active
>    161234 pages inactive
>     16674 pages in the laundry queue
>   3848989 pages wired down
>     39951 pages free
>      4096 bytes per page
> 612681203 total name lookups
>           cache hits (95% pos + 0% neg) system 0% per-directory
>           deletions 0%, falsehits 0%, toolong 0%
> %
 And here top consumers. I don't like that most of te memory is in FREE
abd_chunks - 8GB!

USED (b) FREE (b) NAME
28785840 9299280 VM OBJECT
33817600 11413760 256
36598392 2486808 S VFS Cache
38157856 246224 arc_buf_hdr_t_l2only
44302336 629276672 zio_buf_131072
50377824 53424 sa_cache
72323072 85626880 mbuf_jumbo_page
74094592 55296 mbuf_cluster
90320896 63102976 4096
92359344 67056 zfs_znode_cache
126912480 159632160 dmu_buf_impl_t
150967296 233911296 mbuf_jumbo_9k
165164600 92040 VNODE
199124480 23927520 UMA Slabs
209715200 8388608 zio_data_buf_1048576
218103808 48758784 zio_data_buf_524288
259242496 293377536 zio_buf_512
346030080 383516672 zio_buf_16384
375592672 346991008 dnode_t
531902464 8392536064 abd_chunk



-- 
Best regards,
 Lev                            mailto:lev at FreeBSD.org

21.11.2018 18:34, Lev Serebryakov wrote:
>  And here top consumers. I don't like that most of te memory is in FREE
> abd_chunks - 8GB!
> 
> USED (b) FREE (b) NAME
> 531902464 8392536064 abd_chunk
This may be a leak. Can you monitor this value for longer run?