Files
OpenSearch-Docs-Cn/_ml-commons-plugin/index.md
T
a97c719591 Add multimodal search/sparse search/pre- and post-processing function documentation (#5168)
* Add multimodal search documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Text image embedding processor

Signed-off-by: Fanit Kolchina <[email protected]>

* Add prerequisite

Signed-off-by: Fanit Kolchina <[email protected]>

* Change query text

Signed-off-by: Fanit Kolchina <[email protected]>

* Added bedrock connector tutorial and renamed ML TOC

Signed-off-by: Fanit Kolchina <[email protected]>

* Name changes and rewording

Signed-off-by: Fanit Kolchina <[email protected]>

* Change connector link

Signed-off-by: Fanit Kolchina <[email protected]>

* Change link

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Link fix and field name fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Add default text embedding preprocessing and post-processing functions

Signed-off-by: Fanit Kolchina <[email protected]>

* Add sparse search documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix links

Signed-off-by: Fanit Kolchina <[email protected]>

* Pre/post processing function tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Fix link

Signed-off-by: Fanit Kolchina <[email protected]>

* Sparse search tech review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Melissa Vagi <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Implemented doc review comments

Signed-off-by: Fanit Kolchina <[email protected]>

* Add actual test sparse pipeline response

Signed-off-by: Fanit Kolchina <[email protected]>

* Added tested examples

Signed-off-by: Fanit Kolchina <[email protected]>

* Added model choice for sparse search

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove Bedrock connector

Signed-off-by: Fanit Kolchina <[email protected]>

* Implemented tech review feedback

Signed-off-by: Fanit Kolchina <[email protected]>

* Add that the model must be deployed to neural search

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Link fix

Signed-off-by: Fanit Kolchina <[email protected]>

* Add session token to sagemaker blueprint

Signed-off-by: Fanit Kolchina <[email protected]>

* Formatted bullet points the same way

Signed-off-by: Fanit Kolchina <[email protected]>

* Specified both model types in neural sparse query

Signed-off-by: Fanit Kolchina <[email protected]>

* Added more explanation for default pre/post-processing functions

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove framework and extensibility references

Signed-off-by: Fanit Kolchina <[email protected]>

* Minor rewording

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-10-16 10:45:35 -04:00

1.9 KiB

layout, title, nav_order, has_children, has_toc, nav_exclude
layout title nav_order has_children has_toc nav_exclude
default About ML Commons 1 false false true

ML Commons plugin

ML Commons for OpenSearch simplifies the development of machine learning (ML) features by providing a set of ML algorithms through transport and REST API calls. Those calls choose the right nodes and resources for each ML request and monitor ML tasks to ensure uptime. This allows you to use existing open-source ML algorithms and reduce the effort required to develop new ML features.

Interaction with the ML Commons plugin occurs through either the REST API or ad and kmeans Piped Processing Language (PPL) commands.

Models trained through the ML Commons plugin support model-based algorithms, such as k-means. After you've trained a model to your precision requirements, use the model to make predictions.

If you don't want to use a model, you can use the Train and Predict API to test your model without having to evaluate the model's performance.

Using ML Commons

  1. Ensure that you've appropriately set the cluster settings described in ML Commons cluster settings.
  2. Set up model access as described in Model access control.
  3. Start using models: