Commit Graph
167 Commits
Author SHA1 Message Date
0c8ca401f7 Add Cohere RAG tutorial link (#6442)
* Add link to Cohere RAG tutorial

Signed-off-by: Tianjing Li <[email protected]>

* upgrade OS version to 2.12, english fixes

Signed-off-by: Tianjing Li <[email protected]>

* Update _search-plugins/conversational-search.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/conversational-search.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Tianjing Li <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-20 16:57:00 -05:00
3f7468b504 Add agent framework/throttling/hidden model/OS assistant and update conversational search documentation (#6354)
* Add agent framework documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Add hidden model and API updates

Signed-off-by: Fanit Kolchina <[email protected]>

* Vale error

Signed-off-by: Fanit Kolchina <[email protected]>

* Updated field names

Signed-off-by: Fanit Kolchina <[email protected]>

* Add updating credentials

Signed-off-by: Fanit Kolchina <[email protected]>

* Added tools table

Signed-off-by: Fanit Kolchina <[email protected]>

* Add OpenSearch forum thread for OS Assistant

Signed-off-by: Fanit Kolchina <[email protected]>

* Add tech review for conv search

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix links

Signed-off-by: Fanit Kolchina <[email protected]>

* Add tools

Signed-off-by: Fanit Kolchina <[email protected]>

* Add links to tools

Signed-off-by: Fanit Kolchina <[email protected]>

* More info about tools

Signed-off-by: Fanit Kolchina <[email protected]>

* Tool parameters

Signed-off-by: Fanit Kolchina <[email protected]>

* Update cat-index-tool.md

Signed-off-by: kolchfa-aws <[email protected]>

* Parameter clarification

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Typo fix

Signed-off-by: Fanit Kolchina <[email protected]>

* More tech review feedback: RAG tool

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback: memory APis

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _ml-commons-plugin/agents-tools/index.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/agents-tools/tools/neural-sparse-tool.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/agents-tools/tools/neural-sparse-tool.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/agents-tools/tools/neural-sparse-tool.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/opensearch-assistant.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/agents-tools/tools/ppl-tool.md

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Separated search and get APIs and add conversational flow agent

Signed-off-by: Fanit Kolchina <[email protected]>

* More parameters for PPL tool

Signed-off-by: Fanit Kolchina <[email protected]>

* Added more parameters

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review feedback: PPL tool

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Rename to automating configurations

Signed-off-by: Fanit Kolchina <[email protected]>

* Editorial comments on the new text

Signed-off-by: Fanit Kolchina <[email protected]>

* Add parameter to PPl tool

Signed-off-by: Fanit Kolchina <[email protected]>

* Changed link to configurations

Signed-off-by: Fanit Kolchina <[email protected]>

* Rate limiter feedback and added warning

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-20 12:09:31 -05:00
SorabhandSorabh Hamirwasia 6620673f24 Disable concurrent search for composite agg (#6444)
Signed-off-by: Sorabh Hamirwasia <[email protected]>
Co-authored-by: Sorabh Hamirwasia <[email protected]>
2024-02-19 19:40:08 -05:00
kolchfa-aws 9af42a86f4 Fix link in concurrent segment search (#6436)
* Fix link in concurrent segment search

Signed-off-by: Fanit Kolchina <[email protected]>

* Prevent 403on the maven repo domain

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2024-02-19 11:56:44 -05:00
kolchfa-aws eacc70b361 Add closed details block to formatting guide (#6421)
Signed-off-by: Fanit Kolchina <[email protected]>
2024-02-16 12:32:44 -05:00
kolchfa-awsandNathan Bower e76ec7c0c7 Add cross-encoder model documentation (#6357)
* Add cross-ranking model documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Model id format

Signed-off-by: Fanit Kolchina <[email protected]>

* Move to custom models

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _search-plugins/search-relevance/reranking-search-results.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/custom-local-models.md

Signed-off-by: kolchfa-aws <[email protected]>

* Tech review and doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _ml-commons-plugin/pretrained-models.md

Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-16 08:44:29 -05:00
37ee05d979 Add warning related to ad and concurrent segment search (#6411)
* Add warning related to ad and concurrent segment search

Signed-off-by: Jay Deng <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Jay Deng <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-16 08:36:12 -05:00
kolchfa-aws 2ef6964d01 Add back changes from PR 6362 to concurrent segment search (#6416)
Signed-off-by: Fanit Kolchina <[email protected]>
2024-02-15 13:25:20 -05:00
6d884b6db3 Add documentation for new reranking feature in 2.12 (#6368)
* Create reranking.md

document new reranking feature in 2.12

Signed-off-by: HenryL27 <[email protected]>

* Doc review and address comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/rerank-processor.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/rerank-processor.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: HenryL27 <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-13 14:24:08 -05:00
kolchfa-awsandNathan Bower 37803ff5fa Concurrent segment search GA and API changes (#6356)
* Concurrent segment search GA and API changes for 2.12

Signed-off-by: Fanit Kolchina <[email protected]>

* Add types

Signed-off-by: Fanit Kolchina <[email protected]>

* Changed wording to enable concur seg search

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Typo

Signed-off-by: Fanit Kolchina <[email protected]>

* Tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* More tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Added link to response fields

Signed-off-by: Fanit Kolchina <[email protected]>

* More tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Signed-off-by: kolchfa-aws <[email protected]>

* Update _api-reference/profile.md

Signed-off-by: kolchfa-aws <[email protected]>

* Resolve merge conflicts

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-12 09:42:44 -05:00
33697681dc Add things to know for concurrent segment search (#6362)
* Add things to know for concurrent segment search

Signed-off-by: Jay Deng <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Jay Deng <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Signed-off-by: Jay Deng <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/concurrent-segment-search.md

Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Jay Deng <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-08 14:06:21 -05:00
cc5c60393d Add documentation for nested search in knn (#6237)
* Add documentation for nested search in knn

Signed-off-by: Heemin Kim <[email protected]>

* Doc review

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Heemin Kim <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-01 11:08:20 -08:00
4b3f09ae11 Added documentation for changing the default values of HNSW hyper parameters in k-NN plugin (#6272)
* Added documentation for changing the default values of HNSW hyperparameters in k-NN plugin

Signed-off-by: Navneet Verma <[email protected]>

* Update _search-plugins/knn/knn-index.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Navneet Verma <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-01 11:07:53 -08:00
Junqiu LeiandNaarcha-AWS 80fbd210a1 Updated k-NN lucene engine dimension max count to 16k (#5875)
* Updated k-NN lucene engine dimension max count to 16k

Signed-off-by: Junqiu Lei <[email protected]>

* Update _search-plugins/knn/approximate-knn.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Junqiu Lei <[email protected]>

* Update _search-plugins/knn/approximate-knn.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Junqiu Lei <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2024-02-01 11:03:01 -08:00
83f91acd5b Add documentation for collapse, oversample, truncate_hits processors (#5881)
* Add documentation for collapse, oversample, truncate_hits processors

Signed-off-by: Michael Froh <[email protected]>

* Apply suggestions from code review

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/oversample-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/collapse-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/oversample-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/truncate-hits-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/collapse-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/collapse-processor.md

Signed-off-by: kolchfa-aws <[email protected]>

* Update _search-plugins/search-pipelines/truncate-hits-processor.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* More editorial comments and link fixes

Signed-off-by: Fanit Kolchina <[email protected]>

* Add oversample and deduplicate to vale and format files nicely

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _search-plugins/search-pipelines/truncate-hits-processor.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Michael Froh <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
2024-02-01 11:02:26 -08:00
6af66500eb Remove admin:admin default and update instructions for demo setup (#5887)
* Update some admin:admin references

Signed-off-by: Derek Ho <[email protected]>

* Update all references except for helm

Signed-off-by: Derek Ho <[email protected]>

* Update helm

Signed-off-by: Derek Ho <[email protected]>

* Reverts changes made to _install-and-configure folder

Signed-off-by: Darshit Chanpura <[email protected]>

* Apply suggestions from code review

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Derek Ho <[email protected]>

* Update _about/quickstart.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update quickstart.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Darshit Chanpura <[email protected]>
Signed-off-by: Derek Ho <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Co-authored-by: Darshit Chanpura <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-02-01 11:01:58 -08:00
kolchfa-aws a258d7951a Correct heading level for approximate k-NN (#6239)
Signed-off-by: Fanit Kolchina <[email protected]>
2024-01-22 15:45:32 -05:00
kolchfa-aws 8b80980959 Point all non-versioned documentation to latest and add permalinks (#6042)
* Point all non-versioned documentation to latest and add permalinks

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix links

Signed-off-by: Fanit Kolchina <[email protected]>

* Add a permalink to the main page

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2024-01-05 08:58:23 -05:00
kolchfa-aws 8e35488077 Rename collection links to directory names (#6040)
Signed-off-by: Fanit Kolchina <[email protected]>
2024-01-04 18:59:53 -05:00
kolchfa-aws 699cb9ac20 Change navigation for index pages of collections (#6039)
Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
2024-01-04 14:55:05 -05:00
kolchfa-aws ff0693991e Separate clients, data prepper, and benchmark documentation (#5878)
* Separate clients, data prepper, and benchmark documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Flexbox card positioning

Signed-off-by: Fanit Kolchina <[email protected]>

* Change flex basis

Signed-off-by: Fanit Kolchina <[email protected]>

* Add links to home page

Signed-off-by: Fanit Kolchina <[email protected]>

* Change card layout to grid

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor section traversal

Signed-off-by: Fanit Kolchina <[email protected]>

* Add json formatting

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor home layout

Signed-off-by: Fanit Kolchina <[email protected]>

* Link the top left nav header to main page and add items to top menu

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2024-01-03 15:48:59 -05:00
kolchfa-aws 247d88814a Update approximate-knn.md (#6030)
Signed-off-by: kolchfa-aws <[email protected]>
2024-01-02 19:43:42 -05:00
3ccd28064e Update approximate-knn.md (#6011)
* Update approximate-knn.md

Updated a sentence.

Signed-off-by: Madhan <[email protected]>

* Update _search-plugins/knn/approximate-knn.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Madhan <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2024-01-02 19:20:14 -05:00
kolchfa-awsandNathan Bower a7da03343e Style guide fix - white space (#6023)
* Style guide fix - white space

Signed-off-by: Fanit Kolchina <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/parse-json.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2024-01-02 14:27:35 -05:00
Naarcha-AWS 9dabda8dce Update PPL Kmeans example (#6010)
Fixes #3026

Signed-off-by: Naarcha-AWS <[email protected]>
2023-12-29 11:28:57 -06:00
kolchfa-aws 97470eb642 Fix search phase result processor intro sentence (#5888)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-12-15 15:37:06 -05:00
kolchfa-aws 603da74e79 Change parent name in PPL pages (#5709)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-11-30 13:24:09 -05:00
kolchfa-aws f524e6891f Change terminology from sparse to neural sparse (#5714)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-11-30 10:43:12 -05:00
kolchfa-aws a8bd47e07b Add redirects from old links to ML documentation (#5707)
* Add redirects from old links to ML documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Rename links

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2023-11-29 16:26:35 -05:00
f999e0a8a8 Add an overview of search methods and pages for each search method (#5636)
* Restructuring TOC

Signed-off-by: Fanit Kolchina <[email protected]>

* Resolve merge conflicts

Signed-off-by: Fanit Kolchina <[email protected]>

* More foundational rewrites of ML

Signed-off-by: Fanit Kolchina <[email protected]>

* TOC restructure

Signed-off-by: Fanit Kolchina <[email protected]>

* Rename and rewrite search pages and add keyword search

Signed-off-by: Fanit Kolchina <[email protected]>

* Small wording change

Signed-off-by: Fanit Kolchina <[email protected]>

* Small wording change

Signed-off-by: Fanit Kolchina <[email protected]>

* Updated response

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Small rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Move neural search to top of vector search list

Signed-off-by: Fanit Kolchina <[email protected]>

* Change terminology

Signed-off-by: Fanit Kolchina <[email protected]>

* Reorganize search methods list

Signed-off-by: Fanit Kolchina <[email protected]>

* Rename links

Signed-off-by: Fanit Kolchina <[email protected]>

* More link renames

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented editorial comments

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-11-29 15:28:20 -05:00