You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Currently the searcher is pretty slow.
Re arrange the data strucutre so there is no more need to search for 1000000 triples, but create two indexes as following:
1: for all node
HashN -> s_tripleIndex1 s_tripleIndex2 ... o_tripleIndexN
2: for all triples ->
tripleIndexK -> quadString
where as the indexes in the node are the same as the ones in the triples.
Using a IntPoint.newSetQuery this only needs the following searches:
first Step:
search for quad Nodes in BGP: (around 1ms on 2 GB Ram with 30.000.000 nodes)
merge Indexes (so only the indexes where the searched Nodes are at the field (s,p,o) and merge all of them)
second step:
search using a boolean query all of the indexes in the triplesIndex (thus maxSearch can be set dynamically) (around 80ms on 2GB ram with 30.000.000 triples with 100 results)
Due to the maxSearch dynamically setting, small resultsets are much faster returned (7 results need only an eight about 100 results)
this is still not that good, but an amazing improvment on what it was before.
The text was updated successfully, but these errors were encountered:
Currently the searcher is pretty slow.
Re arrange the data strucutre so there is no more need to search for 1000000 triples, but create two indexes as following:
1: for all node
HashN -> s_tripleIndex1 s_tripleIndex2 ... o_tripleIndexN
2: for all triples ->
tripleIndexK -> quadString
where as the indexes in the node are the same as the ones in the triples.
Using a IntPoint.newSetQuery this only needs the following searches:
first Step:
second step:
Due to the maxSearch dynamically setting, small resultsets are much faster returned (7 results need only an eight about 100 results)
this is still not that good, but an amazing improvment on what it was before.
The text was updated successfully, but these errors were encountered: