Commit Graph
132 Commits
Author SHA1 Message Date
9973d8470e [DOC] Add new documentation about Query Workbench (#5378)
* Rewrite Query Workbench

---------

Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
2023-11-02 16:39:35 -06:00
kolchfa-awsandMelissa Vagi 88d06e13bd Add full-text query documentation (#5428)
* Refactor full-text query documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add examples and parameter descriptions

Signed-off-by: Fanit Kolchina <[email protected]>

* Add multi-match query

Signed-off-by: Fanit Kolchina <[email protected]>

* Add query string field format

Signed-off-by: Fanit Kolchina <[email protected]>

* Query string examples

Signed-off-by: Fanit Kolchina <[email protected]>

* Add regular expressions and fuzziness

Signed-off-by: Fanit Kolchina <[email protected]>

* Add wildcard and regex warning

Signed-off-by: Fanit Kolchina <[email protected]>

* Added more query string format

Signed-off-by: Fanit Kolchina <[email protected]>

* Added multi-field sections

Signed-off-by: Fanit Kolchina <[email protected]>

* Rewrite minimum should match section

Signed-off-by: Fanit Kolchina <[email protected]>

* Added allow expensive queries section

Signed-off-by: Fanit Kolchina <[email protected]>

* Add simple query string query

Signed-off-by: Fanit Kolchina <[email protected]>

* Small rewrites

Signed-off-by: Fanit Kolchina <[email protected]>

* Add intervals query

Signed-off-by: Fanit Kolchina <[email protected]>

* Include discover in query string syntax

Signed-off-by: Fanit Kolchina <[email protected]>

* Link and index page fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
2023-11-01 09:29:13 -04:00
242c35db59 add pretrained model description and saving disk description (#5383)
* add description and saving disk

Signed-off-by: xinyual <[email protected]>

* update

Signed-off-by: xinyual <[email protected]>

* update

Signed-off-by: xinyual <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _query-dsl/specialized/neural-sparse.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _search-plugins/neural-sparse-search.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _search-plugins/neural-sparse-search.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _search-plugins/neural-sparse-search.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Moved recommended model choice options outside the table

Signed-off-by: Fanit Kolchina <[email protected]>

* Add a link for more info

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: xinyual <[email protected]>
Signed-off-by: xinyual <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-25 11:59:49 -04:00
Jon Wiggins 81c858f683 Fix typo by removing . (#5381)
Carry through change by removing breakline in plugin docs

Signed-off-by: jonwiggins <[email protected]>
2023-10-24 10:33:07 -05:00
Jon Wiggins 98cbab7e5b Fix link to lucene filtering implementation (#5382)
Signed-off-by: jonwiggins <[email protected]>
2023-10-24 10:28:16 -05:00
abe43ce3a5 Add pretrained model information for neural sparse (#5355)
* add pretrained model for neural sparse

Signed-off-by: xinyual <[email protected]>

* change typo error

Signed-off-by: xinyual <[email protected]>

* Apply suggestions from code review

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/ml-framework.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/ml-framework.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _ml-commons-plugin/ml-framework.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: xinyual <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/neural-sparse-search.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/ml-framework.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update pretrained-models.md

Change description and name in the sparse encoding doc model example

Signed-off-by: xinyual <[email protected]>

* Update _search-plugins/neural-sparse-search.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: xinyual <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: xinyual <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-23 09:34:09 -04:00
Sander van de Geijn 79e4fb7eb4 Update concurrent-segment-search.md (#5348)
syntax error

Signed-off-by: Sander van de Geijn <[email protected]>
2023-10-20 14:52:33 -04:00
25233c2888 Update OpenSearch k-NN Faiss Documentation (#5226)
* Update OpenSearch k-NN Faiss Documentation

Signed-off-by: Naveen Tatikonda <[email protected]>

* Address Review Comments

Signed-off-by: Naveen Tatikonda <[email protected]>

* Apply suggestions from code review

Signed-off-by: kolchfa-aws <[email protected]>

* Additional rewrites and format

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _search-plugins/knn/knn-index.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/knn/knn-index.md

Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Naveen Tatikonda <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-19 13:02:15 -04:00
kolchfa-aws ea16c75b9a Remove experimental header from search comparison tool (#5124)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-10-16 10:46:47 -04:00
cb2c2f53b1 Add terminate after behavior to concurrent segment search (#5143)
* Add terminate after behavior to concurrent segment search

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Co-authored-by: Jay Deng <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Doc review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove extra space

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Jay Deng <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-16 10:45:51 -04:00
a97c719591 Add multimodal search/sparse search/pre- and post-processing function documentation (#5168)
* Add multimodal search documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Text image embedding processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Add prerequisite

Signed-off-by: Fanit Kolchina <[email protected]>

* Change query text

Signed-off-by: Fanit Kolchina <[email protected]>

* Added bedrock connector tutorial and renamed ML TOC

Signed-off-by: Fanit Kolchina <[email protected]>

* Name changes and rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Change connector link

Signed-off-by: Fanit Kolchina <[email protected]>

* Change link

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Link fix and field name fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Add default text embedding preprocessing and post-processing functions

Signed-off-by: Fanit Kolchina <[email protected]>

* Add sparse search documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix links

Signed-off-by: Fanit Kolchina <[email protected]>

* Pre/post processing function tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

* Sparse search tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add actual test sparse pipeline response

Signed-off-by: Fanit Kolchina <[email protected]>

* Added tested examples

Signed-off-by: Fanit Kolchina <[email protected]>

* Added model choice for sparse search

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove Bedrock connector

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Add that the model must be deployed to neural search

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Link fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Add session token to sagemaker blueprint

Signed-off-by: Fanit Kolchina <[email protected]>

* Formatted bullet points the same way

Signed-off-by: Fanit Kolchina <[email protected]>

* Specified both model types in neural sparse query

Signed-off-by: Fanit Kolchina <[email protected]>

* Added more explanation for default pre/post-processing functions

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove framework and extensibility references

Signed-off-by: Fanit Kolchina <[email protected]>

* Minor rewording

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-16 10:45:35 -04:00
06527a2772 Add documentation about setting a default model for neural search (#5121)
* Add documentation about setting a default model for neural search

Signed-off-by: Fanit Kolchina <[email protected]>

* Add new processor to the processor list

Signed-off-by: Fanit Kolchina <[email protected]>

* More tweaks

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor search pipeline documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor retrieving search pipelines

Signed-off-by: Fanit Kolchina <[email protected]>

* Add working examples

Signed-off-by: Fanit Kolchina <[email protected]>

* Implement tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add responses to documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _search-plugins/search-pipelines/neural-query-enricher.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-04 13:35:37 -04:00
3a23cc67e1 Updating the K-NN Filters documentation due to recent enhancements in… (#4987)
* Updating the K-NN Filters documentation due to recent enhancements in Efficient Filters

Signed-off-by: Navneet Verma <[email protected]>

* Fixed the review comments.

Signed-off-by: Navneet Verma <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Navneet Verma <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Navneet Verma <[email protected]>

* Update settings.md

Signed-off-by: Navneet Verma <[email protected]>

* Update _search-plugins/knn/settings.md

Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Navneet Verma <[email protected]>
Signed-off-by: Navneet Verma <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-09-22 17:31:36 -04:00
cab5e40e31 Add concurrent segment search documentation (#4990)
* Add concurrent segment search documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add API information

Signed-off-by: Fanit Kolchina <[email protected]>

* Small rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Add tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

* Add API section

Signed-off-by: Fanit Kolchina <[email protected]>

* Small rewriting

Signed-off-by: Fanit Kolchina <[email protected]>

* Rewriting

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update profile.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _api-reference/profile.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update concurrent-segment-search.md

Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-09-22 17:31:04 -04:00
f5b8ff79fd Add score normalization and combination documentation (#4985)
* Add search phase results processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Add hybrid query

Signed-off-by: Fanit Kolchina <[email protected]>

* Normalization processor additions

Signed-off-by: Fanit Kolchina <[email protected]>

* Add more details

Signed-off-by: Fanit Kolchina <[email protected]>

* Continue writing

Signed-off-by: Fanit Kolchina <[email protected]>

* Add more query then fetch details and diagram

Signed-off-by: Fanit Kolchina <[email protected]>

* Small rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Leaner left nav headers

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Add semantic search tutorial

Signed-off-by: Fanit Kolchina <[email protected]>

* Reworded prerequisites

Signed-off-by: Fanit Kolchina <[email protected]>

* Removed comma

Signed-off-by: Fanit Kolchina <[email protected]>

* Rewording advanced prerequisites

Signed-off-by: Fanit Kolchina <[email protected]>

* Changed searching for ML model to shorter request

Signed-off-by: Fanit Kolchina <[email protected]>

* Update task type in register model response

Signed-off-by: Fanit Kolchina <[email protected]>

* Changing example

Signed-off-by: Fanit Kolchina <[email protected]>

* Added huggingface prefix to model names

Signed-off-by: Fanit Kolchina <[email protected]>

* Change example responses

Signed-off-by: Fanit Kolchina <[email protected]>

* Added note about huggingface prefix

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _ml-commons-plugin/semantic-search.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* List weights under parameters

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove one-shard warning for normalization processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Change links

Signed-off-by: Fanit Kolchina <[email protected]>

* More editorial feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Change model-serving framework to ML framework

Signed-off-by: Fanit Kolchina <[email protected]>

* Use get model API to check model status

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Added neural search description and diagram

Signed-off-by: Fanit Kolchina <[email protected]>

* More editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add link to profile API

Signed-off-by: Fanit Kolchina <[email protected]>

* Addressed more tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented editorial comments on changes

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-09-22 17:29:58 -04:00
de5f5ae073 Add quantization techniques and links to byte vector (#4893)
* Add quantization techniquest and links to byte vector

Signed-off-by: Fanit Kolchina <[email protected]>

* Added cosine similarity space type quantization

Signed-off-by: Fanit Kolchina <[email protected]>

* Rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove redundant line

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _field-types/supported-field-types/knn-vector.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _field-types/supported-field-types/knn-vector.md

Signed-off-by: kolchfa-aws <[email protected]>

* Editorial feedback

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-29 13:45:19 -04:00
kolchfa-awsandNathan Bower 87ed0af851 Refactor search pipeline documentation (#4908)
* Refactor search pipeline documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-28 11:56:11 -04:00
kolchfa-aws 6bece563ea Add k-NN vector field type (#4850)
* Add k-NN vector field type

Signed-off-by: Fanit Kolchina <[email protected]>

* Rename topic

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-22 13:27:31 -04:00
cac580ef00 Refactor term query documentation (#4787)
* Refactor term query documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor term-level query documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* fix links

Signed-off-by: Fanit Kolchina <[email protected]>

* More examples

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add section about expensive queries

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* More editorial feedback

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-17 14:38:31 -04:00
kolchfa-aws 1a1a385cf0 Update knn-index.md (#4732)
Signed-off-by: kolchfa-aws <[email protected]>
2023-08-10 09:36:55 -04:00
kolchfa-aws a214fa7fc1 Remove link to Personalize compare search results and reorganize topic (#4721)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-08 19:46:35 -04:00
a87fdc0f63 Split query DSL, analyzer, and aggregation sections and add more to analyzer section (#4693)
* Add analyzer documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add index and search analyzer pages

Signed-off-by: Fanit Kolchina <[email protected]>

* Doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* More doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Update index-analyzers.md

Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-08 09:41:55 -04:00
Christian AdaminiandNaarcha-AWS b70e377cad Fix typos and minor text improvements (#4663)
Signed-off-by: Christian Adamini <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-08-03 15:50:39 -05:00
kolchfa-aws 3bc859bbd2 Clarify Neural Search ingest pipeline (#4539)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-03 10:18:41 -04:00
kolchfa-aws 6badff1b33 Fix links for Personalize documentation (#4641)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-07-26 17:37:13 -04:00
kolchfa-awsandNathan Bower 6d7d7d7c3d Personalize Search Ranking documentation (#4572)
* Add Personalize search ranking documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add personalize search ranking processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Table format

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

* Add link to processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Change index name

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update personalize-search-ranking.md

Signed-off-by: kolchfa-aws <[email protected]>

* Move Personalize up one section

Signed-off-by: Fanit Kolchina <[email protected]>

* Changes example

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-25 12:49:43 -04:00
Andrew CarbonettoandNaarcha-AWS 60a85c7e60 Update SQL limitations page for release 2.8 features (#4265)
* Update SQL limitations page for release 2.8 features

Signed-off-by: Andrew Carbonetto <[email protected]>

* Update SQL limitations page - reword json limitation

Signed-off-by: Andrew Carbonetto <[email protected]>

* Update review for comments

Signed-off-by: Andrew Carbonetto <[email protected]>

* Update _search-plugins/sql/limitation.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Andrew Carbonetto <[email protected]>

* Update _search-plugins/sql/limitation.md

Signed-off-by: Andrew Carbonetto <[email protected]>

* Update _search-plugins/sql/limitation.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Andrew Carbonetto <[email protected]>

* Update _search-plugins/sql/limitation.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Andrew Carbonetto <[email protected]>

---------

Signed-off-by: Andrew Carbonetto <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-07-21 10:39:39 -05:00
Naarcha-AWS f916f40625 Change Neural Search plugin from experimental to GA. (#4588)
* Change Neural Search plugin from experimental to GA.

Signed-off-by: Naarcha-AWS <[email protected]>

* Update neural-search.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
2023-07-20 15:02:28 -05:00
9b386b3d47 Add Spark connector settings (#4577)
* Add Spark connector settings

Signed-off-by: Naarcha-AWS <[email protected]>

* Add additional settings.

Signed-off-by: Naarcha-AWS <[email protected]>

* Adjust intro description.

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-18 16:07:31 -07:00
6c83dfd87c Add k-NN Faiss filtering documentation (#4476)
* Add k-NN Faiss filtering documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Move the note

Signed-off-by: Fanit Kolchina <[email protected]>

* Add faiss and a filter table

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor boolean filtering section

Signed-off-by: Fanit Kolchina <[email protected]>

* Clarified that Faiss works with hnsw only

Signed-off-by: Fanit Kolchina <[email protected]>

* Add more Faiss filtering information

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/knn/filter-search-knn.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented one more editorial comment

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-18 10:57:53 -04:00
kolchfa-awsandNathan Bower 33e3d77816 Add Lucene byte vector documentation (#4475)
* Add Lucene byte vector documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add limitation note

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Reworded data_type description

Signed-off-by: Fanit Kolchina <[email protected]>

* Update knn-index.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/knn/knn-index.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add a performance note

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-14 17:28:35 -04:00
kolchfa-awsandNathan Bower 480589cda1 Search pipeline GA documentation (#4553)
* Search pipeline GA documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add ad-hoc pipelines and ignore failure flag

Signed-off-by: Fanit Kolchina <[email protected]>

* Rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Update script-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/index.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/index.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-14 16:28:27 -04:00
Alexsandro Luiz Specht 29532894e4 Adding max_analyzer_offset setting on highlight (#4501)
Signed-off-by: Alexsandro Specht <[email protected]>
2023-07-06 10:53:54 -04:00
44e397c932 [Fix] add documentation regarding usage of filter/post_filter in k-NN… (#4494)
* [Fix] add documentation regarding usage of filter/post_filter in k-NN plugin

Signed-off-by: jiapinw <[email protected]>

* Revise doc update based on comments and offline discussions

Signed-off-by: jiapinw <[email protected]>

* Update doc based on comments

Signed-off-by: jiapinw <[email protected]>

* Update _search-plugins/knn/filter-search-knn.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: jiapinw <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-06 10:18:00 -04:00
Matthew Wells 2e6016ce54 Updated functions documentation (#4232)
* Updated documentation of arithmetic functions, correct some mistakes, added missing functions

Signed-off-by: Matthew Wells <[email protected]>

* Added a few missing variable definitions

Signed-off-by: Matthew Wells <[email protected]>

* Updated arithmetic operators documentation to include symbol

Signed-off-by: Matthew Wells <[email protected]>

* removed unneeded SELECT and LIMIT

Signed-off-by: Matthew Wells <[email protected]>

* reformated table

Signed-off-by: Matthew Wells <[email protected]>

* updated data types of functions and made some corrections

Signed-off-by: Matthew Wells <[email protected]>

* removed missing brackets, fixed incorrect ifnull documentation

Signed-off-by: Matthew Wells <[email protected]>

* fixed more minor mistakes and confirmed all function examples work

Signed-off-by: Matthew Wells <[email protected]>

* added ticks to all function names to get it to pass the linter

Signed-off-by: Matthew Wells <[email protected]>

---------

Signed-off-by: Matthew Wells <[email protected]>
2023-06-12 22:16:33 -04:00
kolchfa-aws 492cdddd4e Add info to enable search pipelines (#4297)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-06-09 13:28:21 -04:00
kolchfa-aws 687148e880 Update point in time sort parameter (#4239)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-06-07 09:43:18 -04:00
kolchfa-aws d0242fd6fa Change GitHub issue to forum link (#4259)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-06-06 16:16:53 -04:00
1ae4a86f0c Add search pipeline documentation (#4204)
* Add search pipeline documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add search pipeline documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add search pipeline documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add experimental label

Signed-off-by: Fanit Kolchina <[email protected]>

* Update script processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add wildcard and pipeline path parameter

Signed-off-by: Fanit Kolchina <[email protected]>

* Reworded get pipeline responses

Signed-off-by: Fanit Kolchina <[email protected]>

* Add we do not recommend to use the feature in prod

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add header to table

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented tech review and editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-06-06 11:11:52 -04:00
Heather Halter 837112f9b6 Fixes to redirects (#4195)
* redirects

Signed-off-by: Heather Halter <[email protected]>

* fixedformat

Signed-off-by: Heather Halter <[email protected]>

* fixbrokenlink

Signed-off-by: Heather Halter <[email protected]>

* fixbrokenlink

Signed-off-by: Heather Halter <[email protected]>

---------

Signed-off-by: Heather Halter <[email protected]>
2023-05-26 14:48:31 -07:00
GabeFernandez310andGuian Gumpac 0e7b0f895f Updated Date and Time Functions List (#3908)
* Updated Date and Time Functions List

* Updated Date and Time Functions List

Signed-off-by: GabeFernandez310 <[email protected]>

* Changed A Description

Signed-off-by: GabeFernandez310 <[email protected]>

* Added More Function Descriptions

Signed-off-by: GabeFernandez310 <[email protected]>

* Fixed An Entry

Signed-off-by: GabeFernandez310 <[email protected]>

---------

Signed-off-by: GabeFernandez310 <[email protected]>

* Changes for suggest PR comment

Signed-off-by: Guian Gumpac <[email protected]>

---------

Signed-off-by: GabeFernandez310 <[email protected]>
Signed-off-by: Guian Gumpac <[email protected]>
Co-authored-by: Guian Gumpac <[email protected]>
2023-05-25 15:25:31 -05:00
Seyed Alireza Fatemi Jahromi 8d394f5726 [Doc] Fix cosinesimil OpenSearch Score and Distance Function formula (#4138) (#4139)
Signed-off-by: Alireza Fatemi <[email protected]>
2023-05-25 12:45:55 -04:00
JHeil a4138eaaf4 Update async response state with real values (#4085)
Signed-off-by: JHeil <[email protected]>
2023-05-18 12:15:43 -05:00
Bryce Seager van Dyk 3470787811 Remove references to _shard_doc (#3808)
Opensearch does not currently appear to support `_shard_doc` as part of Point In Time search, so remove references to it from the documentation.

Further details:
- I don't see any reference to `_shard_doc` in the code on [Opensearch's](https://github.com/opensearch-project/OpenSearch) main branch at time of proposing the change.
- ElasticSearch added `_shard_doc` in [7.12](https://github.com/elastic/elasticsearch-net/issues/5337) and it looks like it was not added as part of Opensearch's [Point In Time work](https://github.com/opensearch-project/OpenSearch/issues/1147).

Signed-off-by: Bryce Seager van Dyk <[email protected]>
2023-05-18 12:14:53 -05:00
Heather HalterandNaarcha-AWS ee7d1efd02 More redirects and spelling fixes (#4093)
* redirects and spelling

Signed-off-by: Heather Halter <[email protected]>

* Update _observing-your-data/ad/index.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Update _observing-your-data/ad/index.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

* Update _search-plugins/knn/index.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

---------

Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-05-17 09:57:14 -07:00
Heather Halterandkolchfa-aws e9db68d327 redirect updates (#4061)
* redirect updates

Signed-off-by: Heather Halter <[email protected]>

* Update _search-plugins/sql/ppl/syntax.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Heather Halter <[email protected]>

---------

Signed-off-by: Heather Halter <[email protected]>
Signed-off-by: Heather Halter <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
2023-05-11 15:48:29 -07:00
astephanusandFanit Kolchina 1fb5252cd6 Adds collections landing page configuration and navigation header linking (#3812)
* Adds collections landing page configuration and navigation header linking

Signed-off-by: Aaron Stephanus <[email protected]>

* Removes unnecessary collection property from the configuration.

Signed-off-by: Aaron Stephanus <[email protected]>

* Adds links to navigation collection headers to collection index pages based on the collection name

Signed-off-by: Aaron Stephanus <[email protected]>

* Hide index pages from view and add info to formatting guide

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Aaron Stephanus <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
2023-05-11 13:56:08 -04:00
2e369607e1 Add index pages to support heading clickability (#3837)
* Add index pages and reorganize content for header clickability

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>

* Implemented doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Punctuation fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Renamed to creating and tuning cluster

Signed-off-by: Fanit Kolchina <[email protected]>

* Content planning dashboards index page

Signed-off-by: vagimeli <[email protected]>

* Add Dashboards index page

Signed-off-by: vagimeli <[email protected]>

* Add Dashboards index page

Signed-off-by: vagimeli <[email protected]>

* Add Dashboards index

Signed-off-by: vagimeli <[email protected]>

* Update _dashboards/index.md

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Melissa Vagi <[email protected]>

* Address doc feedback

Signed-off-by: vagimeli <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Link fix

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: vagimeli <[email protected]>
Signed-off-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-05-11 11:00:30 -04:00
phkornandFanit Kolchina 20052bb5e9 fix link to did you mean functionality (#4038)
* Update index.md

fix link to did you mean functionality

Signed-off-by: phkorn <[email protected]>

* Added a redirect

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: phkorn <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
2023-05-09 10:14:44 -04:00
Heather Halter 2bc05adb72 more redirect changes 5 (#4028)
Signed-off-by: Heather Halter <[email protected]>
2023-05-08 08:07:01 -07:00