Commit Graph
2257 Commits
Author SHA1 Message Date
Chris Moore b2d258d513 Add breaking changes documentation for ES 6.8 to OS 1.x migration issues (#4856)
* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

* fix#4831 es to os migration issues

Signed-off-by: cwillum <[email protected]>

---------

Signed-off-by: cwillum <[email protected]>
2023-08-23 13:24:00 -07:00
David VenableandNaarcha-AWS 5306134c41 Updated the intro text for the s3 sink. (#4854)
Signed-off-by: David Venable <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-08-23 13:33:46 -05:00
Naarcha-AWSandChris Moore 1250649984 Fix typos on S3 sink documentation (#4862)
* Fix typos on S3 sink documentation

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/s3.md

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
2023-08-23 12:49:46 -05:00
David Venable ed21ec74cf Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859)
Signed-off-by: David Venable <[email protected]>
2023-08-23 09:19:04 -05:00
Asif Sohail MohammedandNaarcha-AWS cc21df7ee8 S3 scan doc update (#4848)
* Updated s3 scan docs

Signed-off-by: Asif Sohail Mohammed <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Asif Sohail Mohammed <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-08-22 15:28:13 -05:00
David VenableandNaarcha-AWS 0b5011409a Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847)
* Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections.

* Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema.

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-08-22 15:18:40 -05:00
kolchfa-aws 6bece563ea Add k-NN vector field type (#4850)
* Add k-NN vector field type

Signed-off-by: Fanit Kolchina <[email protected]>

* Rename topic

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-22 13:27:31 -04:00
Melissa VagiandChris Moore fc14355c1f [DOC} Reconcile Alerting Monitors 2.9 Documentation Changes (#4710)
* Reconcile PR changes that weren't published due to files being edited simultaneously

---------

Signed-off-by: Melissa Vagi <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
2023-08-21 12:22:25 -06:00
8e9d0ed4de S3 scan docs (#4756)
* Add notification_source option for S3

Signed-off-by: Asif Sohail Mohammed <[email protected]>

* Added S3 scan configuration

Signed-off-by: Asif Sohail Mohammed <[email protected]>

* Addressed some failing style checks

Signed-off-by: Asif Sohail Mohammed <[email protected]>

* Edit S3 additions.

* Fix links.

* Fix style flaw

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Update s3.md

---------

Signed-off-by: Asif Sohail Mohammed <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-21 11:02:07 -05:00
ac3f60d5ca Documentation for bucket ownership features in Data Prepper 2.4 (#4679)
* Adds documentation for new features in Data Prepper 2.4 related to bucket ownership. Includes a section explaining how the bucket ownership works and can be configured for cross-account access. Resolves #4678

Signed-off-by: David Venable <[email protected]>

* Updates from PR feedback.

Signed-off-by: David Venable <[email protected]>

* Remove redundant header

Add a name to primary H2 header to section to prevent links from breaking.

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-21 10:46:04 -05:00
Qi ChenandNaarcha-AWS 7d077786bc MAINT: update distribution_version in opensearch sink (#4742)
* MAINT: update distribution_version in opensearch sink

Signed-off-by: George Chen <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Qi Chen <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Qi Chen <[email protected]>

* Fix typo

* ADD: request compression flag

Signed-off-by: George Chen <[email protected]>

* Update opensearch.md

---------

Signed-off-by: George Chen <[email protected]>
Signed-off-by: Qi Chen <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-08-21 10:45:40 -05:00
152ffcd79f Add Kafka source for DP 2.4 (#4737)
* Add Kafka source for DP 2.4

Signed-off-by: Naarcha-AWS <[email protected]>

* Use new Kafka settings

Signed-off-by: Naarcha-AWS <[email protected]>

* Add technical feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typos

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Change array to object.

Signed-off-by: Naarcha-AWS <[email protected]>

* Last minute changes to Kafka defaults

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-21 10:43:32 -05:00
09ff9fc10c Add documentation for managing data prepper source coordination (#4758)
* Add documentation for managing data prepper source coordination

Signed-off-by: Taylor Gray <[email protected]>

* Update source-coordination.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/managing-data-prepper/source-coordination.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Add TTL link

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Taylor Gray <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-21 10:39:50 -05:00
David VenableandNaarcha-AWS 442f4c446a Documents general sink options (#4759)
* Adds general sink options which includes: routes, tags_target_key, include_keys, exclude_keys.

Signed-off-by: David Venable <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-08-21 10:39:31 -05:00
toyozaki ff0492a966 [DOC] Fix typo in IDs query doc (#4836)
Signed-off-by: Akira Toyozaki <[email protected]>
2023-08-20 12:24:30 -04:00
Chris Moore b9b21e1e30 Add documentation to provide a link from detector creation to detection rule creation in using rules docs (#4829)
* fix#4828 link to detection rule creation

Signed-off-by: cwillum <[email protected]>

* fix#4828 link to detection rule creation

Signed-off-by: cwillum <[email protected]>

* fix#4828 link to detection rule creation

Signed-off-by: cwillum <[email protected]>

* fix#4828 link to detection rule creation

Signed-off-by: cwillum <[email protected]>

---------

Signed-off-by: cwillum <[email protected]>
2023-08-17 17:22:04 -07:00
Heather Halter 8f91f1a49b Update docker.md (#4822)
As per Peter Zhu, `docker container prune` is right to use when trying to remove stopped containers: https://docs.docker.com/engine/reference/commandline/container_prune/

Signed-off-by: Heather Halter <[email protected]>
2023-08-17 15:50:13 -07:00
kolchfa-aws 3ade0a93b8 Add data type to term and term set queries (#4821)
* Add data type to term and term set queries

Signed-off-by: Fanit Kolchina <[email protected]>

* Remove extra parenthesis

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-17 18:47:42 -04:00
cac580ef00 Refactor term query documentation (#4787)
* Refactor term query documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* Refactor term-level query documentation

Signed-off-by: Fanit Kolchina <[email protected]>

* fix links

Signed-off-by: Fanit Kolchina <[email protected]>

* More examples

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* Add section about expensive queries

Signed-off-by: Fanit Kolchina <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

* More editorial feedback

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-17 14:38:31 -04:00
Nathan Bower b1767a1e0b Add acronyms (#4816)
* Add acronyms

Signed-off-by: natebower <[email protected]>

* Add pipe

Signed-off-by: natebower <[email protected]>

---------

Signed-off-by: natebower <[email protected]>
2023-08-16 14:08:49 -04:00
91c65e525f Add zstd compression content to performance tuning doc (#4814)
* add codec info

Signed-off-by: Shankaran <[email protected]>

* Update _tuning-your-cluster/performance.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>

---------

Signed-off-by: Shankaran <[email protected]>
Signed-off-by: kolchfa-aws <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-16 11:03:51 -04:00
Vacha Shah 476e2d6422 Correcting the java client code snippets and updating java client version (#4789)
Signed-off-by: Vacha Shah <[email protected]>
2023-08-15 16:00:32 -04:00
kolchfa-aws df2b573e46 Remove reload_search_analyzers API (#4790)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-15 15:57:10 -04:00
Heather Halter 61d6cb754b Update logs.md (#4772)
Fixes an issue with the code. See https://github.com/opensearch-project/documentation-website/issues/4339

Signed-off-by: Heather Halter <[email protected]>
2023-08-14 13:19:10 -07:00
kolchfa-aws 4d98febcbd Fix links (#4768)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-14 11:21:51 -04:00
Heather Halter 99bed46b47 Update bulk.md (#4761)
Fixes https://github.com/opensearch-project/documentation-website/issues/4706

Signed-off-by: Heather Halter <[email protected]>
2023-08-11 14:13:48 -07:00
Heather Halter 03fdf3d130 Update index.md (#4762)
Addresses https://github.com/opensearch-project/documentation-website/issues/4706

Signed-off-by: Heather Halter <[email protected]>
2023-08-11 14:12:26 -07:00
kolchfa-aws e9be98f0e0 Add 1.3.12 to version history (#4740)
Signed-off-by: Fanit Kolchina <[email protected]>
2023-08-10 16:05:20 -04:00
62ab7416aa Add ML connector edits (#4636)
* Add ML connector edits

Signed-off-by: Naarcha-AWS <[email protected]>

* Change integrators to blueprints

Signed-off-by: Naarcha-AWS <[email protected]>

* Add PM feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Change connector names

Signed-off-by: Naarcha-AWS <[email protected]>

* Add note about which parameters are relevant to admins.

Signed-off-by: Naarcha-AWS <[email protected]>

* Make seperation between personas more clear

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typo

Signed-off-by: Naarcha-AWS <[email protected]>

* Add technical feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Breakout connectors and blueprints into two pages.

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix blueprint links

Signed-off-by: Naarcha-AWS <[email protected]>

* Address additional technical feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Yaliang Wu <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Add Doc review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Yaliang Wu <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-08-10 14:55:37 -05:00
Nathan Bower b02dec8211 Add style guidelines and terms (#4734)
* Add style guidelines and terms

Signed-off-by: natebower <[email protected]>

* Reviewer feedback

Signed-off-by: natebower <[email protected]>

---------

Signed-off-by: natebower <[email protected]>
2023-08-10 10:29:16 -04:00