Commit Graph

2826 Commits (d761a2ee2081fde9b6779fc9a5b54969160aee68)

Author SHA1 Message Date
Zlatin Balevsky 29e002f8f1
get rid of manual library refresh, switch to LinkedHashSet for all files, properly clean up intermediate nodes in the filtered tree 2021-06-12 09:30:16 +01:00
Zlatin Balevsky 65b20a9f93
update library in batch after unsharing 2021-06-12 08:06:11 +01:00
Zlatin Balevsky 7b670b9037
make sure spans are fully loaded before trying to flush them 2021-06-12 07:50:16 +01:00
Zlatin Balevsky d5a17e9b6a
fix collapsing of tree on refresh (as in during uploads). Fix magic expansion on clearing of filter 2021-06-12 06:09:14 +01:00
Zlatin Balevsky 4fcb82133c
add Clear and Filter buttons. Disable filtering until library has loaded. Do not traverse subtree on every selection 2021-06-12 05:38:23 +01:00
Zlatin Balevsky 88fe173fbb
do not filter on every keystroke 2021-06-11 18:54:23 +01:00
Zlatin Balevsky 9c7cf3d969
try to speed up tree expansion 2021-06-11 18:49:49 +01:00
Zlatin Balevsky 7e08417c91
ability to filter library 2021-06-11 18:33:17 +01:00
Zlatin Balevsky f56a96923b
do not canonicalize from the UI thread 2021-06-11 05:35:17 +01:00
Zlatin Balevsky 674ef4c708
White background on systray icon, thanks to slrslr, GitHub issue #60 2021-06-10 11:31:21 +01:00
Zlatin Balevsky 8356a92aa3
add an option to disable throttling of the loading of shared files on startup 2021-06-09 13:41:32 +01:00
Zlatin Balevsky 1e7e30dee2
Switch to LAX Json parser and parallelize the stream after filtering 2021-06-09 12:50:00 +01:00
Zlatin Balevsky aa2b80cc0d
remove unnecessary canonicalization 2021-06-09 12:48:47 +01:00
Zlatin Balevsky 3c2d6e3952
more efficient (de)serialization of String[] 2021-06-09 00:57:27 +01:00
Zlatin Balevsky 96e359643a
double page size 2021-06-09 00:55:31 +01:00
Zlatin Balevsky 12a052ca55
small optimizations 2021-06-08 23:21:54 +01:00
Zlatin Balevsky fd06fdf7ce
spltt search index into Java and Groovy parts for faster initial loading. GitHub issue #59 2021-06-08 22:30:33 +01:00
Zlatin Balevsky e09b4c6621
do not reload keys, only values 2021-06-08 21:26:18 +01:00
Zlatin Balevsky 5b3416f7bb
perform a periodic gc() just in case, GitHub issue #59 2021-06-08 16:17:04 +01:00
Zlatin Balevsky 94a78bfa4e
GitHub issue #59 - try to accommodate larger libraries without limiting heap size 2021-06-08 15:54:51 +01:00
Zlatin Balevsky bcc94abadd
switch Set -> Array in FileTree 2021-06-05 23:54:04 +01:00
Zlatin Balevsky d00d6d7e18
flatten the nameToFile map as well 2021-06-05 23:39:25 +01:00
Zlatin Balevsky 71d20d075b
reduce memory usage of the rootToFiles structure by switching to array values 2021-06-05 23:18:39 +01:00
Zlatin Balevsky 30abc5af8d
get rid of unused cached value 2021-06-05 22:16:49 +01:00
Zlatin Balevsky fe85887b39
use two SkipLists, thanks zzz for the suggestion 2021-06-05 15:44:53 +01:00
Zlatin Balevsky 72c4998954
increment counters appropriately after increasing value size to integer 2021-06-05 05:29:54 +01:00
Zlatin Balevsky ea1f431323
more efficient splitting, reduces blockfile access 2021-06-05 03:18:18 +01:00
Zlatin Balevsky cb2ab77316
increase max value size to 2^24 2021-06-05 03:11:50 +01:00
Zlatin Balevsky a9c4f612fd
fix re-use of SkipSpan when it goes empty 2021-06-05 03:04:52 +01:00
Zlatin Balevsky 1168a871eb
get rid of the limit for byte[] i/o 2021-06-04 22:27:22 +01:00
Zlatin Balevsky 85043abb82 Merge branch 'blockfile-index' into 'master'
Off-heap Blockfile storage for search index

See merge request zlatinb/muwire!52
2021-06-04 17:49:52 +00:00
Zlatin Balevsky 0916e67939
rename package so that it won't conflict in the plugin 2021-06-04 18:22:45 +01:00
Zlatin Balevsky 88f1f381b9
multi-part backing storage 2021-06-04 18:14:07 +01:00
Zlatin Balevsky 4a0275914d
clean or suppress some warnings 2021-06-04 16:05:14 +01:00
Zlatin Balevsky 38bfecbc4f
increase span size 2021-06-04 16:01:14 +01:00
Zlatin Balevsky 40492ac5d2
re-add nulling of values 2021-06-04 16:00:31 +01:00
Zlatin Balevsky 008d82ad1d
side-port the blockfile db changes from i2p.i2p 2021-06-04 14:54:16 +01:00
Zlatin Balevsky 93ac56b353
fix or suppress various warnings 2021-06-04 12:41:01 +01:00
Zlatin Balevsky 84387bef8e
clear out vals storage after retrieving value 2021-06-04 12:35:21 +01:00
Zlatin Balevsky 3d30f49776
do not store values in the heap, just keys 2021-06-04 12:23:22 +01:00
Zlatin Balevsky 9ecb73149c
Split processing of files from directories. Throttle emission of new events based on threadpool queue length 2021-06-04 05:57:50 +01:00
Zlatin Balevsky dfd7be9618
reduce the size of the memmapped file 2021-06-04 03:48:15 +01:00
Zlatin Balevsky 8892dd73a8
switch to a memory-mapped file instead of a RAF 2021-06-04 03:21:43 +01:00
Zlatin Balevsky 76eaca996f
experimental Blockfile db instead of in-memory index 2021-06-04 00:09:33 +01:00
Zlatin Balevsky 1c2972ecfc
add some default file types to ignore 2021-06-03 17:22:38 +01:00
Zlatin Balevsky 34b7496036
prevent corrupt messages from breaking messenger loading 2021-06-03 12:54:00 +01:00
Zlatin Balevsky 6f3a3357ea
more efficient traversal of directories 2021-06-03 12:15:14 +01:00
Zlatin Balevsky 3ac6d085f6
configurable list of file types to not share 2021-06-03 05:27:42 +01:00
Zlatin Balevsky 95fcd1635f
more safeguards against zero-length or unreadable files 2021-06-03 01:59:33 +01:00
Zlatin Balevsky 4b11aca16e
show the number of files being hashed 2021-06-02 20:10:26 +01:00