Skip to content

Commit 5661773

Browse files
guillep2klunny
authored andcommitted
Remove unique filter from repo indexer analyzer. (#7878)
* Remove unique filter from repo indexer analyzer. * Bump repoIndexerLatestVersion to 4 * Corrrect fmt * make vendor to remove unique dependency
1 parent 85202d4 commit 5661773

File tree

3 files changed

+2
-57
lines changed

3 files changed

+2
-57
lines changed

modules/indexer/repo.go

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,6 @@ import (
1313
"github.com/blevesearch/bleve"
1414
"github.com/blevesearch/bleve/analysis/analyzer/custom"
1515
"github.com/blevesearch/bleve/analysis/token/lowercase"
16-
"github.com/blevesearch/bleve/analysis/token/unique"
1716
"github.com/blevesearch/bleve/analysis/tokenizer/unicode"
1817
"github.com/blevesearch/bleve/search/query"
1918
"github.com/ethantkoenig/rupture"
@@ -23,7 +22,7 @@ const (
2322
repoIndexerAnalyzer = "repoIndexerAnalyzer"
2423
repoIndexerDocType = "repoIndexerDocType"
2524

26-
repoIndexerLatestVersion = 3
25+
repoIndexerLatestVersion = 4
2726
)
2827

2928
// repoIndexer (thread-safe) index for repository contents
@@ -110,7 +109,7 @@ func createRepoIndexer(path string, latestVersion int) error {
110109
"type": custom.Name,
111110
"char_filters": []string{},
112111
"tokenizer": unicode.Name,
113-
"token_filters": []string{unicodeNormalizeName, lowercase.Name, unique.Name},
112+
"token_filters": []string{unicodeNormalizeName, lowercase.Name},
114113
}); err != nil {
115114
return err
116115
}

vendor/github.com/blevesearch/bleve/analysis/token/unique/unique.go

Lines changed: 0 additions & 53 deletions
This file was deleted.

vendor/modules.txt

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -26,7 +26,6 @@ github.com/blevesearch/bleve
2626
github.com/blevesearch/bleve/analysis/analyzer/custom
2727
github.com/blevesearch/bleve/analysis/token/lowercase
2828
github.com/blevesearch/bleve/analysis/token/unicodenorm
29-
github.com/blevesearch/bleve/analysis/token/unique
3029
github.com/blevesearch/bleve/analysis/tokenizer/unicode
3130
github.com/blevesearch/bleve/index/upsidedown
3231
github.com/blevesearch/bleve/mapping

0 commit comments

Comments
 (0)