Hi, I am trying to get faster search results on our webmail client(Roundcube). Besides using Lucene for FTS are there other options? Would having all mails indexed give fast results? Currently the time it takes to search 25,000mails is 4mins. If indexed how much faster are we looking at? Really appreciate if someone could advise about this. Thanks Kevin
* Kevin Laurie <superinterstellar at gmail.com> 2015.01.24 19:41:> Currently the time it takes to search 25,000mails is 4mins. If indexed how > much faster are we looking at?With a current version of Dovecot a search is pretty fast _without_ using external indexes. I have a view defined (virtual plugin) with around 22.000 messages in it, and searching the full view only takes 2.5 seconds: $ /usr/lib/dovecot/imap -u tlx at leuxner.net * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE NOTIFY QUOTA ACL RIGHTS=texk] Logged in as tlx at leuxner.net a select "Virtual/Postfix-Users" * FLAGS (\Answered \Flagged \Deleted \Seen \Draft Old) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft Old \*)] Flags permitted. * 22094 EXISTS * 0 RECENT * OK [UIDVALIDITY 1420123174] UIDs valid * OK [UIDNEXT 44036] Predicted next UID * OK [HIGHESTMODSEQ 679] Highest a OK [READ-WRITE] Select completed (0.028 secs). b search charset utf-8 body "SQL" * SEARCH 51 52 54 83 87 102 108 126 172 173 195 223 234 238 249 250 252 254 260 263 268 274 293 294 316 317 324 343 412 414 431 432 434 435 436 438 439 440 441 442 443 450 451 454 457 458 464 478 493 496 497 505 590 617 619 625 628 632 636 637 638 639 644 645 646 650 655 657 659 671 676 677 699 702 757 759 762 767 769 770 790 791 792 793 796 799 839 840 841 843 844 845 846 847 848 849 850 864 868 882 905 907 929 953 955 959 1129 1133 1136 1137 1138 1139 1140 1143 1145 1168 1174 1175 1176 1177 1178 1179 1182 1205 1208 1244 1247 1248 1251 1316 1320 1334 1336 1352 1356 1392 1394 1395 1397 1398 1403 1407 1409 1410 1411 1433 1434 1435 1451 1468 1469 1470 1511 1512 1546 1547 1548 1560 1561 1562 1563 1567 1569 1570 1574 1578 1587 1588 1590 1601 1606 1648 1661 1669 1670 1671 1726 1748 1749 1750 1751 1752 1753 1755 1771 1773 1774 1792 1800 1808 1819 1822 1850 1885 1913 1932 1933 1980 1982 1999 2004 2026 2102 2104 2144 2145 2162 2184 2192 2193 2194 2204 2205 2217 2237 2272 2336 2337 2339 2341 2342 2343 2344 2346 2348 2368 2369 2380 2409 2426 2429 2455 2461 2499 2605 2607 2609 2611 2615 2618 2620 2635 2638 2639 2640 2642 2673 2784 2797 2799 2800 2821 2830 2849 2857 2863 2894 2895 2943 2944 2953 2954 2955 3049 3050 3052 3195 3244 3418 3419 3420 3421 3425 3465 3470 3474 3530 3543 3544 3546 3549 3550 3569 3572 3593 3602 3643 3647 3648 3649 3650 3654 3655 3656 3673 3674 3721 3722 3723 3724 3728 3740 3741 3772 3795 3797 3799 3803 3804 3806 3830 3832 3837 3838 3839 3840 3841 3859 3865 3866 3867 3875 3896 3898 3907 3915 3919 3924 3925 3927 3949 3951 4029 4031 4043 4073 4083 4084 4085 4087 4089 4091 4094 4096 4185 4186 4350 4354 4400 4401 4403 4404 4405 4406 4417 4419 4422 4423 4424 4425 4427 4431 4463 4501 4554 4556 4583 4615 4640 4642 4650 4683 4684 4686 4687 4688 4690 4691 4696 4697 4698 4699 4702 4705 4713 4714 4724 4725 4726 4727 4728 4729 4730 4734 4746 4754 4770 4772 4785 4787 4792 4794 4798 4800 4912 4922 4955 4956 4958 4966 4972 4973 4974 4975 4978 4979 4988 4990 4991 4992 4998 5009 5021 5025 5026 5027 5029 5030 5031 5036 5037 5109 5110 5111 5112 5149 5150 5151 5156 5159 5202 5248 5249 5365 5366 5367 5402 5428 5441 5442 5447 5449 5483 5484 5486 5487 5489 5493 5494 5495 5496 5497 5498 5499 5501 5502 5503 5504 5506 5508 5604 5681 5721 5722 5723 5724 5725 5727 5728 5729 5730 5731 5737 5738 5761 5778 5794 5796 5817 5818 5860 5863 5864 5865 5867 5989 5990 5991 6006 6028 6075 6078 6080 6081 6082 6083 6090 6092 6093 6103 6104 6115 6122 6193 6194 6197 6198 6235 6243 6258 6259 6260 6268 6312 6317 6321 6408 6409 6471 6472 6485 6546 6551 6620 6622 6623 6624 6630 6637 6652 6694 6698 6710 6768 6770 6772 6797 6851 6853 6868 6899 6900 6949 7092 7093 7095 7156 7219 7226 7227 7265 7278 7280 7281 7282 7283 7294 7295 7305 7307 7310 7317 7319 7327 7338 7341 7342 7358 7363 7365 7370 7378 7381 7382 7434 7447 7448 7449 7450 7452 7509 7516 7517 7518 7520 7521 7522 7523 7524 7525 7526 7544 7585 7614 7616 7617 7637 7644 7670 7671 7794 7795 7796 7885 7886 7887 7889 7895 7898 7900 7953 8016 8052 8054 8055 8056 8057 8059 8063 8064 8066 8069 8079 8119 8132 8156 8175 8232 8233 8234 8235 8236 8242 8289 8354 8420 8506 8507 8508 8511 8546 8622 8666 8667 8709 8873 8874 8875 8876 8877 8879 8887 8892 8898 8899 8927 8956 8957 8984 8988 8993 9056 9166 9207 9225 9226 9227 9229 9230 9231 9232 9262 9263 9264 9265 9266 9267 9268 9269 9272 9357 9366 9369 9371 9378 9381 9390 9392 9393 9402 9403 9409 9416 9417 9426 9430 9431 9432 9455 9458 9540 9553 9554 9574 9575 9577 9593 9599 9601 9610 9611 9612 9613 9618 9619 9625 9627 9641 9642 9659 9685 9694 9735 9737 9772 9773 9774 9775 9776 9777 9781 9795 9802 9803 9806 9827 9829 9844 9866 9867 9875 9914 9949 9954 9957 9958 9959 9960 9961 9962 9967 9968 9969 9970 9986 9987 9988 9996 10003 10004 10006 10037 10040 10041 10043 10044 10046 10048 10049 10053 10072 10107 10121 10132 10136 10138 10140 10142 10143 10144 10146 10158 10276 10306 10336 10343 10353 10366 10389 10390 10400 10401 10413 10421 10429 10511 10709 10710 10711 10712 10713 10714 10715 10717 10719 10720 10728 10778 10779 10799 10800 10801 10819 10823 10829 10830 10850 10853 10857 10859 10861 10863 10874 10883 10884 10916 10932 11009 11010 11011 11083 11084 11089 11100 11118 11121 11147 11148 11161 11162 11163 11168 11171 11226 11228 11229 11255 11342 11359 11369 11375 11378 11461 11463 11464 11465 11466 11543 11548 11549 11552 11557 11558 11559 11673 11704 11721 11756 11812 11826 11827 11828 11829 11830 11832 11836 11838 11840 11841 11843 11844 11867 11868 11871 11872 11876 11885 11892 11985 11988 11992 12143 12154 12182 12183 12185 12198 12287 12329 12330 12334 12338 12345 12387 12391 12393 12394 12443 12502 12586 12589 12590 12645 12652 12653 12654 12656 12701 12702 12709 12711 12718 12719 12720 12722 12745 12790 12795 12837 12847 12914 12915 13098 13099 13108 13111 13124 13131 13132 13146 13157 13159 13160 13161 13170 13175 13176 13181 13258 13264 13265 13271 13277 13290 13291 13410 13431 13432 13454 13455 13456 13458 13459 13469 13478 13548 13549 13550 13557 13558 13567 13570 13590 13591 13594 13664 13679 13683 13684 13685 13686 13714 13715 13718 13735 13766 13788 13790 13800 13801 13805 13848 13855 13865 13866 13893 13911 13912 13914 13915 13918 13919 13942 13943 13944 13945 13946 13967 13968 13969 13975 13980 13986 13989 13999 14001 14007 14008 14010 14043 14044 14065 14077 14080 14081 14082 14149 14151 14156 14157 14183 14186 14305 14308 14359 14366 14455 14477 14479 14481 14490 14491 14566 14622 14640 14644 14653 14661 14662 14663 14664 14708 14712 14732 14733 14734 14755 14781 14805 14807 14808 14809 14825 14832 14833 14853 14860 14902 14905 14907 14908 14929 14931 14940 14954 14955 15010 15021 15026 15037 15039 15057 15058 15062 15065 15066 15142 15143 15145 15154 15169 15172 15206 15220 15294 15398 15424 15435 15436 15512 15558 15569 15616 15634 15649 15653 15776 15778 15827 15868 15870 15899 15900 15920 15926 15927 15928 15929 15944 15946 15948 16013 16014 16015 16074 16075 16078 16080 16103 16104 16105 16108 16109 16111 16112 16115 16116 16117 16118 16121 16122 16124 16125 16128 16161 16162 16165 16166 16190 16192 16272 16327 16351 16355 16382 16393 16409 16410 16467 16492 16493 16494 16497 16510 16511 16513 16514 16515 16519 16527 16587 16618 16632 16680 16769 16770 16771 16773 16776 16777 16778 16779 16830 16833 16839 16859 16863 16871 16872 16873 16875 16876 16877 16878 16879 16880 16885 16886 16919 16951 16967 16971 16974 16979 16986 16996 17040 17041 17052 17059 17060 17077 17081 17092 17196 17198 17203 17211 17212 17258 17302 17365 17367 17374 17391 17398 17424 17445 17447 17474 17476 17479 17481 17551 17568 17569 17570 17571 17572 17573 17575 17577 17585 17664 17665 17677 17678 17712 17713 17715 17755 17756 17757 17762 17784 17830 17831 17897 17906 17951 18024 18040 18042 18129 18136 18137 18138 18161 18162 18163 18167 18169 18222 18234 18275 18284 18285 18286 18287 18291 18342 18349 18356 18358 18361 18362 18363 18373 18375 18396 18436 18437 18438 18440 18441 18457 18460 18462 18467 18474 18475 18477 18479 18485 18486 18488 18489 18491 18492 18493 18494 18499 18503 18514 18576 18585 18586 18602 18603 18604 18605 18664 18769 18770 18772 18773 18774 18811 18813 18944 18952 18953 18981 18982 18983 18998 19124 19127 19129 19130 19136 19171 19174 19176 19180 19181 19182 19217 19218 19241 19243 19245 19257 19259 19276 19358 19360 19361 19362 19363 19375 19388 19390 19391 19393 19394 19421 19422 19423 19437 19492 19579 19594 19660 19668 19918 19920 19921 20016 20032 20034 20036 20038 20041 20053 20055 20149 20150 20159 20210 20211 20258 20282 20301 20355 20356 20357 20358 20360 20371 20376 20467 20468 20469 20475 20477 20481 20482 20483 20485 20487 20488 20489 20490 20491 20492 20493 20498 20504 20510 20533 20534 20535 20536 20537 20538 20541 20543 20546 20576 20580 20583 20585 20626 20634 20655 20724 20725 20726 20727 20728 20729 20730 20731 20732 20733 20962 20967 20968 20970 20974 21007 21008 21009 21010 21012 21019 21028 21043 21047 21056 21103 21108 21130 21145 21185 21253 21474 21482 21484 21488 21489 21523 21543 21544 21545 21548 21554 21566 21583 21584 21585 21586 21610 21631 21685 21717 21724 21731 21859 21860 21885 b OK Search completed (2.493 secs). -------------- next part -------------- A non-text attachment was scrubbed... Name: signature.asc Type: application/pgp-signature Size: 198 bytes Desc: Digital signature URL: <http://dovecot.org/pipermail/dovecot/attachments/20150124/18507417/attachment-0001.sig>
Thomas Leuxner:> I have a view defined (virtual plugin) with around 22.000 messages in itinteresting. I assume you drop multiple mailing lists together in a mailbox and separate them using the virtual plugin, right? could publish how you configured dovecot virtual plugin? I never had success on using the plugin in a useful way :-/ Thanks Andreas
Hi Thomas, That's very interesting. Below is my search result. Any idea why is my result so slow:- Appreciate if you could advise. Thanks Kevin . OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE QUOTA] Logged in . select inbox * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Forwarded \*)] Flags permitted. * 49225 EXISTS * 73 RECENT * OK [UNSEEN 46791] First unseen. * OK [UIDVALIDITY 1414214135] UIDs valid * OK [UIDNEXT 106460] Predicted next UID * OK [NOMODSEQ] No permanent modsequences . OK [READ-WRITE] Select completed (0.548 secs). . search text dear * OK Searched 9% of the mailbox, ETA 1:39 * OK Searched 20% of the mailbox, ETA 1:18 * OK Searched 29% of the mailbox, ETA 1:12 * OK Searched 38% of the mailbox, ETA 1:03 * OK Searched 50% of the mailbox, ETA 0:49 * OK Searched 60% of the mailbox, ETA 0:39 * OK Searched 69% of the mailbox, ETA 0:30 * OK Searched 79% of the mailbox, ETA 0:20 On Sun, Jan 25, 2015 at 3:04 AM, Thomas Leuxner <tlx at leuxner.net> wrote:> * Kevin Laurie <superinterstellar at gmail.com> 2015.01.24 19:41: > > > Currently the time it takes to search 25,000mails is 4mins. If indexed > how > > much faster are we looking at? > > With a current version of Dovecot a search is pretty fast _without_ using > external indexes. I have a view defined (virtual plugin) with around 22.000 > messages in it, and searching the full view only takes 2.5 seconds: > > $ /usr/lib/dovecot/imap -u tlx at leuxner.net > * PREAUTH [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > IDLE SORT SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT > MULTIAPPEND URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS > LIST-EXTENDED I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN > CONTEXT=SEARCH LIST-STATUS SPECIAL-USE BINARY MOVE NOTIFY QUOTA ACL > RIGHTS=texk] Logged in as tlx at leuxner.net > a select "Virtual/Postfix-Users" > * FLAGS (\Answered \Flagged \Deleted \Seen \Draft Old) > * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft Old \*)] > Flags permitted. > * 22094 EXISTS > * 0 RECENT > * OK [UIDVALIDITY 1420123174] UIDs valid > * OK [UIDNEXT 44036] Predicted next UID > * OK [HIGHESTMODSEQ 679] Highest > a OK [READ-WRITE] Select completed (0.028 secs). > b search charset utf-8 body "SQL" > * SEARCH 51 52 54 83 87 102 108 126 172 173 195 223 234 238 249 250 252 > 254 260 263 268 274 293 294 316 317 324 343 412 414 431 432 434 435 436 438 > 439 440 441 442 443 450 451 454 457 458 464 478 493 496 497 505 590 617 619 > 625 628 632 636 637 638 639 644 645 646 650 655 657 659 671 676 677 699 702 > 757 759 762 767 769 770 790 791 792 793 796 799 839 840 841 843 844 845 846 > 847 848 849 850 864 868 882 905 907 929 953 955 959 1129 1133 1136 1137 > 1138 1139 1140 1143 1145 1168 1174 1175 1176 1177 1178 1179 1182 1205 1208 > 1244 1247 1248 1251 1316 1320 1334 1336 1352 1356 1392 1394 1395 1397 1398 > 1403 1407 1409 1410 1411 1433 1434 1435 1451 1468 1469 1470 1511 1512 1546 > 1547 1548 1560 1561 1562 1563 1567 1569 1570 1574 1578 1587 1588 1590 1601 > 1606 1648 1661 1669 1670 1671 1726 1748 1749 1750 1751 1752 1753 1755 1771 > 1773 1774 1792 1800 1808 1819 1822 1850 1885 1913 1932 1933 1980 1982 1999 > 2004 2026 2102 2104 2144 2145 2162 2184 2192 2193 2194 2204 2205 2217 2237 > 2272 2336 2337 2339 2341 2342 2343 2344 2346 2348 2368 2369 2380 2409 2426 > 2429 2455 2461 2499 2605 2607 2609 2611 2615 2618 2620 2635 2638 2639 2640 > 2642 2673 2784 2797 2799 2800 2821 2830 2849 2857 2863 2894 2895 2943 2944 > 2953 2954 2955 3049 3050 3052 3195 3244 3418 3419 3420 3421 3425 3465 3470 > 3474 3530 3543 3544 3546 3549 3550 3569 3572 3593 3602 3643 3647 3648 3649 > 3650 3654 3655 3656 3673 3674 3721 3722 3723 3724 3728 3740 3741 3772 3795 > 3797 3799 3803 3804 3806 3830 3832 3837 3838 3839 3840 3841 3859 3865 3866 > 3867 3875 3896 3898 3907 3915 3919 3924 3925 3927 3949 3951 4029 4031 4043 > 4073 4083 4084 4085 4087 4089 4091 4094 4096 4185 4186 4350 4354 4400 4401 > 4403 4404 4405 4406 4417 4419 4422 4423 4424 4425 4427 4431 4463 4501 4554 > 4556 4583 4615 4640 4642 4650 4683 4684 4686 4687 4688 4690 4691 4696 4697 > 4698 4699 4702 4705 4713 4714 4724 4725 4726 4727 4728 4729 4730 4734 4746 > 4754 4770 4772 4785 4787 4792 4794 4798 4800 4912 4922 4955 4956 4958 4966 > 4972 4973 4974 4975 4978 4979 4988 4990 4991 4992 4998 5009 5021 5025 5026 > 5027 5029 5030 5031 5036 5037 5109 5110 5111 5112 5149 5150 5151 5156 5159 > 5202 5248 5249 5365 5366 5367 5402 5428 5441 5442 5447 5449 5483 5484 5486 > 5487 5489 5493 5494 5495 5496 5497 5498 5499 5501 5502 5503 5504 5506 5508 > 5604 5681 5721 5722 5723 5724 5725 5727 5728 5729 5730 5731 5737 5738 5761 > 5778 5794 5796 5817 5818 5860 5863 5864 5865 5867 5989 5990 5991 6006 6028 > 6075 6078 6080 6081 6082 6083 6090 6092 6093 6103 6104 6115 6122 6193 6194 > 6197 6198 6235 6243 6258 6259 6260 6268 6312 6317 6321 6408 6409 6471 6472 > 6485 6546 6551 6620 6622 6623 6624 6630 6637 6652 6694 6698 6710 6768 6770 > 6772 6797 6851 6853 6868 6899 6900 6949 7092 7093 7095 7156 7219 7226 7227 > 7265 7278 7280 7281 7282 7283 7294 7295 7305 7307 7310 7317 7319 7327 7338 > 7341 7342 7358 7363 7365 7370 7378 7381 7382 7434 7447 7448 7449 7450 7452 > 7509 7516 7517 7518 7520 7521 7522 7523 7524 7525 7526 7544 7585 7614 7616 > 7617 7637 7644 7670 7671 7794 7795 7796 7885 7886 7887 7889 7895 7898 7900 > 7953 8016 8052 8054 8055 8056 8057 8059 8063 8064 8066 8069 8079 8119 8132 > 8156 8175 8232 8233 8234 8235 8236 8242 8289 8354 8420 8506 8507 8508 8511 > 8546 8622 8666 8667 8709 8873 8874 8875 8876 8877 8879 8887 8892 8898 8899 > 8927 8956 8957 8984 8988 8993 9056 9166 9207 9225 9226 9227 9229 9230 9231 > 9232 9262 9263 9264 9265 9266 9267 9268 9269 9272 9357 9366 9369 9371 9378 > 9381 9390 9392 9393 9402 9403 9409 9416 9417 9426 9430 9431 9432 9455 9458 > 9540 9553 9554 9574 9575 9577 9593 9599 9601 9610 9611 9612 9613 9618 9619 > 9625 9627 9641 9642 9659 9685 9694 9735 9737 9772 9773 9774 9775 9776 9777 > 9781 9795 9802 9803 9806 9827 9829 9844 9866 9867 9875 9914 9949 9954 9957 > 9958 9959 9960 9961 9962 9967 9968 9969 9970 9986 9987 9988 9996 10003 > 10004 10006 10037 10040 10041 10043 10044 10046 10048 10049 10053 10072 > 10107 10121 10132 10136 10138 10140 10142 10143 10144 10146 10158 10276 > 10306 10336 10343 10353 10366 10389 10390 10400 10401 10413 10421 10429 > 10511 10709 10710 10711 10712 10713 10714 10715 10717 10719 10720 10728 > 10778 10779 10799 10800 10801 10819 10823 10829 10830 10850 10853 10857 > 10859 10861 10863 10874 10883 10884 10916 10932 11009 11010 11011 11083 > 11084 11089 11100 11118 11121 11147 11148 11161 11162 11163 11168 11171 > 11226 11228 11229 11255 11342 11359 11369 11375 11378 11461 11463 11464 > 11465 11466 11543 11548 11549 11552 11557 11558 11559 11673 11704 11721 > 11756 11812 11826 11827 11828 11829 11830 11832 11836 11838 11840 11841 > 11843 11844 11867 11868 11871 11872 11876 11885 11892 11985 11988 11992 > 12143 12154 12182 12183 12185 12198 12287 12329 12330 12334 12338 12345 > 12387 12391 12393 12394 12443 12502 12586 12589 12590 12645 12652 12653 > 12654 12656 12701 12702 12709 12711 12718 12719 12720 12722 12745 12790 > 12795 12837 12847 12914 12915 13098 13099 13108 13111 13124 13131 13132 > 13146 13157 13159 13160 13161 13170 13175 13176 13181 13258 13264 13265 > 13271 13277 13290 13291 13410 13431 13432 13454 13455 13456 13458 13459 > 13469 13478 13548 13549 13550 13557 13558 13567 13570 13590 13591 13594 > 13664 13679 13683 13684 13685 13686 13714 13715 13718 13735 13766 13788 > 13790 13800 13801 13805 13848 13855 13865 13866 13893 13911 13912 13914 > 13915 13918 13919 13942 13943 13944 13945 13946 13967 13968 13969 13975 > 13980 13986 13989 13999 14001 14007 14008 14010 14043 14044 14065 14077 > 14080 14081 14082 14149 14151 14156 14157 14183 14186 14305 14308 14359 > 14366 14455 14477 14479 14481 14490 14491 14566 14622 14640 14644 14653 > 14661 14662 14663 14664 14708 14712 14732 14733 14734 14755 14781 14805 > 14807 14808 14809 14825 14832 14833 14853 14860 14902 14905 14907 14908 > 14929 14931 14940 14954 14955 15010 15021 15026 15037 15039 15057 15058 > 15062 15065 15066 15142 15143 15145 15154 15169 15172 15206 15220 15294 > 15398 15424 15435 15436 15512 15558 15569 15616 15634 15649 15653 15776 > 15778 15827 15868 15870 15899 15900 15920 15926 15927 15928 15929 15944 > 15946 15948 16013 16014 16015 16074 16075 16078 16080 16103 16104 16105 > 16108 16109 16111 16112 16115 16116 16117 16118 16121 16122 16124 16125 > 16128 16161 16162 16165 16166 16190 16192 16272 16327 16351 16355 16382 > 16393 16409 16410 16467 16492 16493 16494 16497 16510 16511 16513 16514 > 16515 16519 16527 16587 16618 16632 16680 16769 16770 16771 16773 16776 > 16777 16778 16779 16830 16833 16839 16859 16863 16871 16872 16873 16875 > 16876 16877 16878 16879 16880 16885 16886 16919 16951 16967 16971 16974 > 16979 16986 16996 17040 17041 17052 17059 17060 17077 17081 17092 17196 > 17198 17203 17211 17212 17258 17302 17365 17367 17374 17391 17398 17424 > 17445 17447 17474 17476 17479 17481 17551 17568 17569 17570 17571 17572 > 17573 17575 17577 17585 17664 17665 17677 17678 17712 17713 17715 17755 > 17756 17757 17762 17784 17830 17831 17897 17906 17951 18024 18040 18042 > 18129 18136 18137 18138 18161 18162 18163 18167 18169 18222 18234 18275 > 18284 18285 18286 18287 18291 18342 18349 18356 18358 18361 18362 18363 > 18373 18375 18396 18436 18437 18438 18440 18441 18457 18460 18462 18467 > 18474 18475 18477 18479 18485 18486 18488 18489 18491 18492 18493 18494 > 18499 18503 18514 18576 18585 18586 18602 18603 18604 18605 18664 18769 > 18770 18772 18773 18774 18811 18813 18944 18952 18953 18981 18982 18983 > 18998 19124 19127 19129 19130 19136 19171 19174 19176 19180 19181 19182 > 19217 19218 19241 19243 19245 19257 19259 19276 19358 19360 19361 19362 > 19363 19375 19388 19390 19391 19393 19394 19421 19422 19423 19437 19492 > 19579 19594 19660 19668 19918 19920 19921 20016 20032 20034 20036 20038 > 20041 20053 20055 20149 20150 20159 20210 20211 20258 20282 20301 20355 > 20356 20357 20358 20360 20371 20376 20467 20468 20469 20475 20477 20481 > 20482 20483 20485 20487 20488 20489 20490 20491 20492 20493 20498 20504 > 20510 20533 20534 20535 20536 20537 20538 20541 20543 20546 20576 20580 > 20583 20585 20626 20634 20655 20724 20725 20726 20727 20728 20729 20730 > 20731 20732 20733 20962 20967 20968 20970 20974 21007 21008 21009 21010 > 21012 21019 21028 21043 21047 21056 21103 21108 21130 21145 21185 21253 > 21474 21482 21484 21488 21489 21523 21543 21544 21545 21548 21554 21566 > 21583 21584 21585 21586 21610 21631 21685 21717 21724 21731 21859 21860 > 21885 > b OK Search completed (2.493 secs). >
> * Kevin Laurie <superinterstellar at gmail.com> 2015.01.24 19:41: > > > Currently the time it takes to search 25,000mails is 4mins. If indexed > how > > much faster are we looking at? > > With a current version of Dovecot a search is pretty fast _without_ using > external indexes. I have a view defined (virtual plugin) with around 22.000 > messages in it, and searching the full view only takes 2.5 seconds: > >hmmm, could you please tell me more about your setup? What storage format do you use? Maildir or? What is the cumulative size of your messages? My results without FTS on ZFS FS with SSD L2ARC are not so good: a4 select INBOX._OLD-OUTLOOK * FLAGS (\Answered \Flagged \Deleted \Seen \Draft $Junk $NotJunk JunkRecorded $Forwarded) * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $Junk $NotJunk JunkRecorded $Forwarded \*)] Flags permitted. ** 7748 EXISTS* * 0 RECENT * OK [UIDVALIDITY 1421198037] UIDs valid * OK [UIDNEXT 11509] Predicted next UID * OK [HIGHESTMODSEQ 12204] Highest a4 OK [READ-WRITE] Select completed (0.001 secs). a5 search charset utf-8 body "mall" * SEARCH 2 49 101 117 158 171 185 192 197 202 207 223 228 234 236 240 249 279 280 281 287 288 289 290 297 321 327 337 344 351 360 370 373 385 389 390 391 398 405 413 424 444 458 463 470 474 480 482 505 513 520 530 531 532 533 543 559 560 561 562 563 566 588 593 597 625 630 639 644 656 671 672 677 692 720 723 734 738 741 745 752 755 757 765 775 777 784 791 818 820 821 833 855 863 864 868 881 896 910 917 922 926 928 931 991 996 997 998 1000 1010 1011 1012 1014 1018 1019 1026 1047 1068 1077 1095 1101 1105 1122 1136 1137 1140 1155 1160 1166 1171 1179 1180 1197 1208 1229 1239 1258 1263 1271 1282 1286 1290 1298 1319 1364 1365 1370 1386 1408 1410 1429 1463 1465 1470 1471 1494 1518 1522 1529 1530 1536 1541 1548 1571 1581 1585 1588 1594 1605 1606 1611 1612 1619 1620 1625 1652 1666 1667 1729 1730 1731 1732 1733 1734 1735 1781 1782 1817 1818 1897 1900 1921 1940 1946 1960 1972 1981 1995 1998 2002 2006 2028 2049 2057 2095 2100 2157 2168 2181 2185 2192 2203 2204 2207 2208 2210 2220 2225 2255 2273 2282 2283 2288 2289 2317 2320 2340 2367 2374 2377 2378 2379 2384 2389 2402 2409 2436 2459 2475 2476 2488 2504 2519 2538 2539 2551 2566 2572 2597 2599 2603 2617 2629 2664 2698 2716 2731 2733 2753 2754 2780 2805 2808 2815 2818 2850 2861 2862 2867 2886 2896 2900 2914 2931 2936 2938 2939 2950 2969 2990 3017 3019 3062 3075 3094 3101 3115 3138 3159 3161 3178 3185 3190 3204 3217 3218 3248 3263 3265 3266 3273 3282 3288 3295 3386 3428 3453 3476 3478 3479 3511 3548 3606 3629 3693 3694 3737 3793 3799 3801 3808 3812 3814 3815 3834 3849 3860 3862 3880 3910 3917 3930 3932 3952 3953 3954 3957 3959 3968 3971 3973 3978 3979 3980 4008 4022 4040 4057 4058 4059 4063 4064 4066 4069 4070 4075 4096 4112 4131 4132 4133 4141 4143 4144 4145 4146 4147 4167 4174 4199 4201 4202 4203 4206 4211 4217 4218 4226 4229 4258 4259 4267 4287 4357 4359 4363 4364 4365 4367 4390 4391 4462 4475 4497 4502 4538 4540 4552 4557 4558 4561 4563 4567 4571 4572 4573 4575 4577 4593 4594 4604 4611 4619 4628 4638 4639 4662 4672 4678 4679 4692 4696 4785 4786 4787 4788 4789 4792 4793 4794 4802 4817 4818 4819 4820 4836 4857 4874 4887 4901 4905 4906 4907 4908 4911 4925 4928 4940 4941 4953 5060 5103 5116 5118 5129 5131 5136 5158 5163 5182 5184 5203 5212 5216 5269 5270 5271 5272 5273 5276 5277 5278 5286 5301 5302 5303 5304 5320 5341 5358 5371 5385 5389 5390 5391 5392 5395 5409 5412 5424 5425 5437 5544 5587 5600 5602 5613 5615 5620 5642 5647 5666 5668 5687 5696 5700 5736 5740 5749 5764 5783 5809 5814 5853 5866 5867 5877 5888 5895 5896 5897 5898 5899 5908 5910 5911 5912 5939 5950 5958 5990 6000 6059 6074 6095 6097 6112 6137 6141 6189 6193 6212 6228 6229 6233 6271 6273 6275 6285 6310 6317 6335 6383 6384 6397 6427 6430 6459 6463 6482 6492 6506 6565 6585 6620 6670 6673 6675 6705 6715 6716 6741 6812 6826 6852 6859 6895 6896 6907 6913 6919 6935 6943 6948 6979 7023 7025 7035 7039 7042 7108 7131 7145 7163 7171 7172 7194 7198 7199 7203 7256 7257 7294 7303 7317 7322 7343 7344 7347 7348 7352 7386 7390 7391 7392 7393 7407 7408 7409 7417 7418 7419 7420 7421 7426 7432 7437 7462 7467 7468 7473 7474 7475 7488 7502 7503 7558 7588 7589 7628 7685 7695 7699 7703 7723 *a5 OK Search completed (7.846 secs).* Searching against "subject" is pretty fast, few miliseconds ...