Commit Graph
76 Commits
Author SHA1 Message Date
c14b8b2a07 Add CIDR and User Agent processors (#4585)
* Add CIDR and User Agent processors

Signed-off-by: Naarcha-AWS <[email protected]>

* Add CIDR functions

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typos

Signed-off-by: Naarcha-AWS <[email protected]>

* Add technical feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* Update user-agent.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/expression-syntax.md

Co-authored-by: Hai Yan <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update user-agent.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Hai Yan <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-27 14:58:47 -05:00
0fcfc4862e Add S3 sink documentation (#4340)
* Add S3 sink documentation

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-18 16:06:06 -07:00
adae164d53 Add obfuscate processor (#4515)
* Add obfuscate processor reference

Signed-off-by: Naarcha-AWS <[email protected]>

* fix typo

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix paragraph description.

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix consistency issues

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-07-14 12:44:01 -05:00
Powershellfish d78bd5b70e Update capitalization for Events (#4213)
Signed-off-by: Powershellfish <[email protected]>
2023-07-05 13:50:27 -05:00
David VenableandNaarcha-AWS 5a4daa4225 Documents the Data Prepper opensearch sink's template_type parameter. (#4290)
* Documents the Data Prepper opensearch sink's template_type parameter.

Signed-off-by: David Venable <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-06-13 13:53:29 -05:00
Powershellfish 3b9ae603de Updated capitalization. (#4214)
Signed-off-by: Powershellfish <[email protected]>
2023-06-07 06:41:42 -07:00
Heather Halter 91ca0ffd55 redirect (#4198)
Signed-off-by: Heather Halter <[email protected]>
2023-05-26 15:57:18 -07:00
Powershellfish baa2fb45ef [DOC] Remove indentation in copy_values processor (#4057)
* Test.

Signed-off-by: Powershellfish <[email protected]>

* Update index.md

Testing ability to create PRs.

* Removed indentation.

Signed-off-by: Powershellfish <[email protected]>

---------

Signed-off-by: Powershellfish <[email protected]>
2023-05-15 17:49:13 -07:00
a9a47ed945 Data Prepper documentation for the SNS to SQS fan out pattern in S3 (#3915)
* Adds documentation on how to use the SNS to SQS fan out with Data Prepper.

Signed-off-by: David Venable <[email protected]>

* Grammar edits.

* Update s3-logs.md

* Update _data-prepper/common-use-cases/s3-logs.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/common-use-cases/s3-logs.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-05-15 12:55:45 -05:00
astephanusandFanit Kolchina 1fb5252cd6 Adds collections landing page configuration and navigation header linking (#3812)
* Adds collections landing page configuration and navigation header linking

Signed-off-by: Aaron Stephanus <[email protected]>

* Removes unnecessary collection property from the configuration.

Signed-off-by: Aaron Stephanus <[email protected]>

* Adds links to navigation collection headers to collection index pages based on the collection name

Signed-off-by: Aaron Stephanus <[email protected]>

* Hide index pages from view and add info to formatting guide

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Aaron Stephanus <[email protected]>
Signed-off-by: Fanit Kolchina <[email protected]>
Co-authored-by: Fanit Kolchina <[email protected]>
2023-05-11 13:56:08 -04:00
56a55102a6 Document Data Prepper circuit breakers. (#3916)
* Document Data Prepper circuit breakers.

Signed-off-by: David Venable <[email protected]>

* Update configuring-data-prepper.md

* Update configuring-data-prepper.md

* Update _data-prepper/managing-data-prepper/configuring-data-prepper.md

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/managing-data-prepper/configuring-data-prepper.md

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/managing-data-prepper/configuring-data-prepper.md

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/managing-data-prepper/configuring-data-prepper.md

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/managing-data-prepper/configuring-data-prepper.md

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
2023-05-10 13:13:54 -05:00
Heather Halter 22cfcf119b CAT API redirects (#3965)
* catapi redirects

Signed-off-by: Heather Halter <[email protected]>

* data prepper redirects

Signed-off-by: Heather Halter <[email protected]>

* committing unsaved

Signed-off-by: Heather Halter <[email protected]>

---------

Signed-off-by: Heather Halter <[email protected]>
2023-05-04 11:22:52 -07:00
kolchfa-aws 8463c8f278 Correct plugin capitalization (#3838)
* Correct plugin capitalization

Signed-off-by: Fanit Kolchina <[email protected]>

* Revert cluster-stats because the name is in response

Signed-off-by: Fanit Kolchina <[email protected]>

* Revert cluster-stats once more

Signed-off-by: Fanit Kolchina <[email protected]>

---------

Signed-off-by: Fanit Kolchina <[email protected]>
2023-05-04 11:11:54 -04:00
Heather Halter f35e72d577 fix list-to-map order (#3941)
Signed-off-by: Heather Halter <[email protected]>
2023-05-03 10:37:27 -07:00
Heather Halter 0235af562f fix table headings (#3943)
Signed-off-by: Heather Halter <[email protected]>
2023-05-03 07:04:30 -07:00
Naarcha-AWS 1259454b73 Fix typo on processor page. (#3903)
Signed-off-by: Naarcha-AWS <[email protected]>
2023-04-27 18:58:54 -05:00
196c750b55 Adds general S3 use-case documentation. #3833 (#3842)
* Adds general S3 use-case documentation. #3833

Signed-off-by: David Venable <[email protected]>

* Add edits to S3 logs doc

* Apply suggestions from code review

Co-authored-by: Heather Halter <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update s3-logs.md

* Update s3-logs.md

* Apply suggestions from code review

Co-authored-by: Chris Moore <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Heather Halter <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
2023-04-27 16:20:01 -05:00
David Venable 3baac55d9f Updates the images used for Data Prepper use-cases to use images with OpenSearch icons and typography. (#3844)
Signed-off-by: David Venable <[email protected]>
2023-04-27 14:50:50 -05:00
4251fb04bd Add DLQ and aggregate processor edits. Baseline processor names (#3880)
* Add DLQ and aggregate processor edits. Baseline processor names

Signed-off-by: Naarcha-AWS <[email protected]>

* Remove processor from titles

Signed-off-by: Naarcha-AWS <[email protected]>

* Update dlq.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Add additional feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* add cross links

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typos

Signed-off-by: Naarcha-AWS <[email protected]>

* Add doc review

Signed-off-by: Naarcha-AWS <[email protected]>

* Remove link

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: kolchfa-aws <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update dlq.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix processor title

Signed-off-by: Naarcha-AWS <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-27 14:01:01 -05:00
CarolineandNaarcha-AWS 66f30d757f Add DLQ to OpenSearch sink configuration options. (#3743)
* Add DLQ to OpenSearch sink configuration options.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: carolxob <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
2023-04-26 11:36:47 -05:00
ab10e6a296 Add OTel trace group processor to doc website. (#3236)
* Add otel trace group processor.

Signed-off-by: carolxob <[email protected]>

* Copy edits to improve table formatting.

Signed-off-by: carolxob <[email protected]>

* Incorporated doc review feedback.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Tech review updates.

Signed-off-by: carolxob <[email protected]>

* Content modifications based on tech feedback.

Signed-off-by: carolxob <[email protected]>

* Content updates.

Signed-off-by: carolxob <[email protected]>

* Removed unnecessary link.

Signed-off-by: carolxob <[email protected]>

* Removed markdown comments.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Changed processor name references to remove tic marks.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Minor edits to fix links.

Signed-off-by: carolxob <[email protected]>

* Removed common metrics from Metrics section and updated default value for .

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Updated OpenSearch security link.

Signed-off-by: carolxob <[email protected]>

* Removed unnecessary column in Metrics table.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Minor update to title for accuracy.

Signed-off-by: carolxob <[email protected]>

* Removed optional from each item in the Configuration table. All items are optional.

Signed-off-by: carolxob <[email protected]>

* Updated links for OS security and service.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Updates made based on editorial feedback.

Signed-off-by: carolxob <[email protected]>

* Minor update to phrasing.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-trace-group.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

---------

Signed-off-by: carolxob <[email protected]>
Signed-off-by: Caroline <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-25 15:58:10 -06:00
ec668fdcba Add OTel logs source doc to doc website. (#3608)
* Add otel_logs_source doc.

Signed-off-by: carolxob <[email protected]>

* Content updates mainly to formatting.

Signed-off-by: carolxob <[email protected]>

* Converted list entries into tables and fixed formatting.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Adjusted nav_order in metadata.

Signed-off-by: carolxob <[email protected]>

* Content edits from tech review.

Signed-off-by: carolxob <[email protected]>

* Edit made based on technical review feedback.

Signed-off-by: carolxob <[email protected]>

* Major revisions to table formatting and headers.

Signed-off-by: carolxob <[email protected]>

* Minor adjustements.

Signed-off-by: carolxob <[email protected]>

* Adjusted default values for items in the SSL table.

Signed-off-by: carolxob <[email protected]>

* Reworded two options in the SSL section.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Minor changes.

Signed-off-by: carolxob <[email protected]>

* Minor changes.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Content updates from feedback.

Signed-off-by: carolxob <[email protected]>

* Minor update.

Signed-off-by: carolxob <[email protected]>

* Minor change.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Naarcha-AWS <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/otel-logs-source.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Minor updates from editorial feedback.

Signed-off-by: carolxob <[email protected]>

---------

Signed-off-by: carolxob <[email protected]>
Signed-off-by: Caroline <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-25 15:57:32 -06:00
abd544826b Add OTel metrics raw processor doc to doc website. (#3235)
* Opening new PR for file.

Signed-off-by: carolxob <[email protected]>

* Add otel metrics raw processor doc.

Signed-off-by: carolxob <[email protected]>

* Minor title change.

Signed-off-by: carolxob <[email protected]>

* Delete mutate-event.md

Removing file - it is not part of this PR.

* Minor edits to format data as table.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Updates based on technical feedback.

Signed-off-by: carolxob <[email protected]>

* Minor updates to common metrics section.

Signed-off-by: carolxob <[email protected]>

* Incorporated technical feedback.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor rephrasing.

Signed-off-by: carolxob <[email protected]>

* Update otel-metrics-raw.md

Fixed typo.

* Updated phrasing.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics-raw.md

Co-authored-by: Naarcha-AWS <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updated

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates to metadata and first heading to ensure page displays correctly.

Signed-off-by: carolxob <[email protected]>

* Updated title.

Signed-off-by: carolxob <[email protected]>

* Renamed file for consistency with processor title.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/otel-metrics.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Minor update.

Signed-off-by: carolxob <[email protected]>

* Minor changes.

Signed-off-by: carolxob <[email protected]>

---------

Signed-off-by: carolxob <[email protected]>
Signed-off-by: Caroline <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-25 15:50:41 -06:00
aa2033c863 Updates the Data Prepper S3 source documentation (#3813)
* Updates the Data Prepper S3 source documentation with additional instructions for usage and new features in 2.2. Includes some clean-up as well.

Signed-off-by: David Venable <[email protected]>

* Add back in example

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Caroline <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Caroline <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Caroline <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Caroline <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update s3.md

* Apply suggestions from code review

Co-authored-by: Caroline <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Update s3.md

Implement Caroline's feedback

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

Signed-off-by: Naarcha-AWS <[email protected]>

---------

Signed-off-by: David Venable <[email protected]>
Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Caroline <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-25 13:10:40 -05:00
Liz Snyder 6202845539 Add max_retries option (#3835)
Signed-off-by: Liz Snyder <[email protected]>
2023-04-25 10:40:43 -05:00
11c3e98335 Add examples to Key value page (#3105)
* Created PR to add examples to Key value doc.

Signed-off-by: carolxob <[email protected]>

* Minor adjustements.

Signed-off-by: carolxob <[email protected]>

* Minor update to table formatting.

Signed-off-by: carolxob <[email protected]>

* Minor change.

Signed-off-by: carolxob <[email protected]>

* Corrected table formatting.

Signed-off-by: carolxob <[email protected]>

* Added examples field table data.

Signed-off-by: carolxob <[email protected]>

* Minor phrasing change.

Signed-off-by: carolxob <[email protected]>

* Updated regex definition.

Signed-off-by: carolxob <[email protected]>

* Minor updates to intro.

Signed-off-by: carolxob <[email protected]>

* Minor updates to intro.

Signed-off-by: carolxob <[email protected]>

* Added default value column.?

Signed-off-by: carolxob <[email protected]>

* Edits based on doc review feedback.

Signed-off-by: carolxob <[email protected]>

* Minor changes.

Signed-off-by: carolxob <[email protected]>

* Incorporated doc review feedback.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Major modifications to table formatting.

Signed-off-by: carolxob <[email protected]>

* Updates to phrasing for examples for clarity.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: kolchfa-aws <[email protected]>

* Minor update to content.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/key-value.md

Co-authored-by: Nathan Bower <[email protected]>
Signed-off-by: Caroline <[email protected]>

---------

Signed-off-by: carolxob <[email protected]>
Signed-off-by: Caroline <[email protected]>
Co-authored-by: kolchfa-aws <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-25 09:07:10 -06:00
e1a1f44dd6 Add list to map processor (#3806)
* Add list to map processor.

Signed-off-by: Naarcha-AWS <[email protected]>

* Tweak one last file

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typo

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Hai Yan <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Hai Yan <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Hai Yan <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Hai Yan <[email protected]>

* Update mutate-event.md

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Chris Moore <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Chris Moore <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Chris Moore <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

* Add Chris' feedback

Signed-off-by: Naarcha-AWS <[email protected]>

* A couple more wording tweaks

Signed-off-by: Naarcha-AWS <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/list-to-map.md

Co-authored-by: Nathan Bower <[email protected]>

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Hai Yan <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-20 13:48:36 -05:00
586cb3d2ff Add opensearch sink security (#3809)
* Add opensearch sink security

Signed-off-by: Liz Snyder <[email protected]>

* Tweaks

Signed-off-by: Liz Snyder <[email protected]>

* Fix trust policy

Signed-off-by: Liz Snyder <[email protected]>

* Fix resource policy

Signed-off-by: Liz Snyder <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/sinks/opensearch.md

* Apply suggestions from code review

Co-authored-by: Nathan Bower <[email protected]>

* Additional editorial feedback

* Make opensearch sink use consistent

* Last piece of editorial feedback

---------

Signed-off-by: Liz Snyder <[email protected]>
Co-authored-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-20 13:47:54 -05:00
Naarcha-AWSandNathan Bower 098f6d961a Add E2E acknowledgements (#3811)
* Add E2E acknowledgements

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix typos

Signed-off-by: Naarcha-AWS <[email protected]>

* Remove E from achknowledgments

Signed-off-by: Naarcha-AWS <[email protected]>

* another e

Signed-off-by: Naarcha-AWS <[email protected]>

* Fix link

* Adjust S3 source.

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/sources/s3.md

* Update _data-prepper/pipelines/configuration/sources/s3.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/pipelines.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/pipelines.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/pipelines.md

---------

Signed-off-by: Naarcha-AWS <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-20 12:39:24 -05:00
8de7c3e3d3 Add Anomaly detector plugin doc. (#3569)
* Initial commit for new plugin doc.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor updates to content.

Signed-off-by: carolxob <[email protected]>

* Added questions to get technical review feedback.

Signed-off-by: carolxob <[email protected]>

* Minor updates to phrasing.

Signed-off-by: carolxob <[email protected]>

* Removed markdown comment.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Removed markdown comments.

Signed-off-by: carolxob <[email protected]>

* Removed markdown comments and added in GitHub.

Signed-off-by: carolxob <[email protected]>

* Removed markdown comments.

Signed-off-by: carolxob <[email protected]>

* Removed markdown comments, added table header.

Signed-off-by: carolxob <[email protected]>

* Minor updates to table.

Signed-off-by: carolxob <[email protected]>

* Minor updates to table.

Signed-off-by: carolxob <[email protected]>

* Updates to random_cut_forest mode section.

Signed-off-by: carolxob <[email protected]>

* Content edits from tech review feedback

Signed-off-by: carolxob <[email protected]>

* Content modifications based on tech feedback.

Signed-off-by: carolxob <[email protected]>

* Content edits.

Signed-off-by: carolxob <[email protected]>

* Minor edits to bookmark/link.

Signed-off-by: carolxob <[email protected]>

* Minor change to link.

Signed-off-by: carolxob <[email protected]>

* Update to content from tech feedback.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Minor edits.

Signed-off-by: carolxob <[email protected]>

* Removed a 'this may appear in future releases' sentence.

Signed-off-by: carolxob <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Chris Moore <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Chris Moore <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Chris Moore <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Melissa Vagi <[email protected]>

* Minor updates.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

* Minor edits from editorial feedback.

Signed-off-by: carolxob <[email protected]>

* Minor update.

Signed-off-by: carolxob <[email protected]>

* Phrasing changes.

Signed-off-by: carolxob <[email protected]>

* Minor change.

Signed-off-by: carolxob <[email protected]>

* Minor edit.

Signed-off-by: carolxob <[email protected]>

* Minor phrasing change.

Signed-off-by: carolxob <[email protected]>

* Minor phrasing update to RCF reference.

Signed-off-by: carolxob <[email protected]>

* Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md

Co-authored-by: Nathan Bower <[email protected]>

---------

Signed-off-by: carolxob <[email protected]>
Co-authored-by: Chris Moore <[email protected]>
Co-authored-by: Melissa Vagi <[email protected]>
Co-authored-by: Nathan Bower <[email protected]>
2023-04-20 10:30:22 -06:00