124 Commits

Include renames

Author	SHA1	Message	Date
kolchfa-aws	d8533562c9	Fix broken links to Cohere embedding connector and Data Prepper (#6710) ... * Update connectors.md Signed-off-by: kolchfa-aws <[email protected]> * Update core-apis.md Signed-off-by: kolchfa-aws <[email protected]> --------- Signed-off-by: kolchfa-aws <[email protected]>	2024-03-18 14:48:53 -04:00
charlesardsilva	09f00d3aa7	Fix copy_values processor documentation (#6630) ... The documentation of copy-values has a mistake, the property overwrite_if_to_key_exists used on example is different from the property in the table. In the source code the correct value is `overwrite_if_to_key_exists` Signed-off-by: charlesardsilva <[email protected]>	2024-03-12 12:31:50 -05:00
Arun Annamalai	2f42ef540c	[bug]: Typo in otel-trace-raw.md (#6650) ... Signed-off-by: Arun Annamalai <[email protected]>	2024-03-12 09:16:20 -07:00
Melissa Vagi	a742d47b01	Alphabetize by title (#6608) ... * Alphabetize by title Signed-off-by: Melissa Vagi <[email protected]> * Alphabetize by title Signed-off-by: Melissa Vagi <[email protected]> --------- Signed-off-by: Melissa Vagi <[email protected]>	2024-03-06 12:19:41 -07:00
Melissa Vagi	aa16bc0eab	Copy edit title (#6583) ... Signed-off-by: Melissa Vagi <[email protected]>	2024-03-05 14:31:14 -07:00
3 people	d91584b6e1	Add-Entries Processor (#6385) ... * Add-Entries Processor Signed-off-by: shaavanga <[email protected]> * Add-Entries Processor Signed-off-by: shaavanga <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/add-entries.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Prathyusha Vangala <[email protected]> * removing backticks Signed-off-by: shaavanga <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/add-entries.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: shaavanga <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Prathyusha Vangala <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-02-26 14:31:09 -06:00
Melissa Vagi	5b5b1d0de1	Add metrics traces use case to Data Prepper (#6251) ... * Add metrics traces use case to Data Prepper --------- Signed-off-by: Melissa Vagi <[email protected]>	2024-02-22 14:49:58 -07:00
3 people	83fd43c4d4	Update CSV Data Prepper processor (#6378) ... * Update csv.md Move example usage from plugin README: https://github.com/opensearch-project/data-prepper/blob/4c4677bc6a5f7b1ba3493d071758903d745af4a3/data-prepper-plugins/csv-processor/README.md Signed-off-by: Travis Benedict <[email protected]> * Update csv.md Signed-off-by: Naarcha-AWS <[email protected]> * Update csv.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/csv.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/csv.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/csv.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/csv.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Travis Benedict <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-02-22 11:42:32 -06:00
3 people	d20468bb30	Add event aggregation use case to Data Prepper documentation (#6206) ... * Add event aggregation use case to Data Prepper documentation --------- Signed-off-by: Melissa Vagi <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-02-22 10:20:37 -07:00
Melissa Vagi	a079c51e88	Add sampling with Data Prepper use case (#6186) ... * Add sampling with Data Prepper use case --------- Signed-off-by: Melissa Vagi <[email protected]>	2024-02-22 10:16:50 -07:00
3 people	74e50ca9fc	MAINT: Data Prepper opensearch source metrics (#6392) ... * MAINT: opensearch source metrics Signed-off-by: George Chen <[email protected]> * MNT: rewording Signed-off-by: George Chen <[email protected]> * MAINT: correct typo and rewording Signed-off-by: George Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: George Chen <[email protected]> Signed-off-by: Qi Chen <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-02-16 12:08:49 -06:00
Melissa VagiandNathan Bower	fedb5504df	Add use case for anomaly detection with Data Prepper (#6140) ... * Add anomaly detection use case for Data Prepper --------- Signed-off-by: Melissa Vagi <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-02-14 14:44:31 -07:00
Melissa Vagi	d9d5406f93	Add pattern matching (text processing) use case to Data Prepper documentation (#6181) ... * Add pattern matching use case to Data Prepper documentation Signed-off-by: Melissa Vagi <[email protected]> * Add pattern matching use case to Data Prepper documentation Signed-off-by: Melissa Vagi <[email protected]> * Address SME comments Signed-off-by: Melissa Vagi <[email protected]> * Copy edits Signed-off-by: Melissa Vagi <[email protected]> * Address editorial feedback Signed-off-by: Melissa Vagi <[email protected]> --------- Signed-off-by: Melissa Vagi <[email protected]>	2024-01-30 12:00:58 -07:00
Melissa VagiandNathan Bower	719b3895cf	Add log enrichment use case to Data Prepper (#6225) ... * Add log enrichment use case to Data Prepper --------- Signed-off-by: Melissa Vagi <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-01-22 13:15:47 -07:00
kolchfa-aws	699cb9ac20	Change navigation for index pages of collections (#6039) ... Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: kolchfa-aws <[email protected]>	2024-01-04 14:55:05 -05:00
kolchfa-awsandNathan Bower	a7da03343e	Style guide fix - white space (#6023) ... * Style guide fix - white space Signed-off-by: Fanit Kolchina <[email protected]> * Update _data-prepper/pipelines/configuration/processors/parse-json.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> --------- Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-01-02 14:27:35 -05:00
4 people	e63b67b873	Added documentation for grok_when option (#5912) ... * Added documentation for grok_when option Signed-off-by: Kondaka <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update grok.md Address editorial review feedback. Signed-off-by: Melissa Vagi <[email protected]> * Update grok.md Signed-off-by: Melissa Vagi <[email protected]> --------- Signed-off-by: Kondaka <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Melissa Vagi <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-12-21 13:39:11 -07:00
3 people	21de57685c	Documentation for Data Prepper's kafka buffer (#5689) ... * Adds documentation for Data Prepper's kafka buffer. Signed-off-by: David Venable <[email protected]> * Update kafka.md * Adds an example pipeline configuration for the Kafka buffer in Data Prepper. Also some related clean-up. Signed-off-by: David Venable <[email protected]> * Update _data-prepper/pipelines/configuration/buffers/kafka.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/buffers/kafka.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-12-13 14:12:26 -06:00
Craig AdamandNaarcha-AWS	9c4e13bd2e	Fix missing character typo (#5771) ... * Fix missing character typo Signed-off-by: Craig Adam <[email protected]> * Update substitute-string.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Craig Adam <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-12-04 12:27:39 -06:00
3 people	fa5bc07a69	Add DynamoDB source (#5664) ... * Add DynamoDB source Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Reconfigure sections Signed-off-by: Naarcha-AWS <[email protected]> * Add Dynamo DB source. Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-11-29 11:38:08 -06:00
Naarcha-AWSandNathan Bower	5877f13f16	Add Serverless configuration options for Data Prepper (#5663) ... * Add Serverless configuration options for Data Prepper Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Implement additional technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Fix options Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-11-28 10:10:15 -06:00
David VenableandNaarcha-AWS	97d14ccfc2	Data Prepper's s3 source: visibility_duplication_protection (#5665) ... * Adds documentation for Data Prepper's s3 source visibility_duplication_protection configuration. Includes the necessary permissions. Signed-off-by: David Venable <[email protected]> * Update _data-prepper/pipelines/configuration/sources/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/s3.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-27 11:26:54 -06:00
Naarcha-AWSandMelissa Vagi	72b3363460	Add codec and processor combinations to S3 source (#5288) ... * Add codec and processor combinations to S3 source. Signed-off-by: Naarcha-AWS <[email protected]> * Update s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Make codec-processor combinations its own file Signed-off-by: Naarcha-AWS <[email protected]> * Make Data Prepper codec page Signed-off-by: Naarcha-AWS <[email protected]> * Fix links Signed-off-by: Naarcha-AWS <[email protected]> * Fix links Signed-off-by: Naarcha-AWS <[email protected]> * Reformat article without tables. Signed-off-by: Naarcha-AWS <[email protected]> * fix link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/common-use-cases/codec-processor-combinations.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update codec-processor-combinations.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Melissa Vagi <[email protected]>	2023-11-17 20:06:04 -06:00
MUHAMMAD SAMIULLAHandNaarcha-AWS	e4c5ec18db	[DOC] Fix rename processor 'otel_trace' to 'otel_traces' (#5423) ... * Fix APIs File Signed-off-by: samipak458 <[email protected]> * Update API files according to API template Signed-off-by: samipak458 <[email protected]> * Update exec-stored-script.md Signed-off-by: Naarcha-AWS <[email protected]> * Update cat-aliases.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-allocation.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-cluster_manager.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-count.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-field-data.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-health.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * updated * updated * updated * data prepper update Signed-off-by: samipak458 <[email protected]> * Update _data-prepper/managing-data-prepper/peer-forwarder.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: samipak458 <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-07 14:48:11 -06:00
kolchfa-aws	3c94bc80d7	Fix links and liquid formatting error (#5512) ... Signed-off-by: Fanit Kolchina <[email protected]>	2023-11-06 12:23:59 -05:00
Qi ChenandNaarcha-AWS	96175482d6	[DOC] data prepper secret extensions (#5202) ... * ADD: extension docs in data-prepper-config Signed-off-by: George Chen <[email protected]> * MAINT: updating secrets extension doc Signed-off-by: George Chen <[email protected]> * MAINT: fix links Signed-off-by: George Chen <[email protected]> * MAINT: fix one more dead link Signed-off-by: George Chen <[email protected]> * MAINT: renaming Signed-off-by: George Chen <[email protected]> * Update configuring-data-prepper.md * Update pipelines.md --------- Signed-off-by: George Chen <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-03 12:08:00 -05:00
Samuel Valdes GutierrezandNaarcha-AWS	7012af124a	[OSCI][DOCs] Replacing 'indices' terms for 'indexes' terms ONLY for description texts (#5353) ... * Fixing documentation for Wildcard in term-level queries section for Query DSL Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * replacing 'indices' term for 'indexes' term ONLY for description texts (not variables, links or properties) Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * Update creating-custom-workloads.md Signed-off-by: Naarcha-AWS <[email protected]> * updating changes suggested by Naarcha-AWS Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * updating changes suggested by Naarcha-AWS Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * Rename _benchmark/workloads/index.md to _benchmark/workloads/reference/index.md Signed-off-by: Naarcha-AWS <[email protected]> * Rename _benchmark/workloads/indices.md to _benchmark/workloads/reference/indices.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Samuel Valdes Gutierrez <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-10-31 10:18:45 -05:00
3 people	03d177aa2b	Add documentation for Data Prepper translate processor (#5122) ... * Add translate processor docs Signed-off-by: Hai Yan <[email protected]> * Fix a table display issue Signed-off-by: Hai Yan <[email protected]> * Address review comments: tweak sentences; add type info; add top level options Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/translate.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update translate.md * Update translate.md * Update _data-prepper/pipelines/configuration/processors/translate.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-12 08:53:20 -05:00
3 people	f4984fb605	Documentation for the Data Prepper OpenSearch source (#5144) ... * Documentation for the Data Prepper OpenSearch source Signed-off-by: Taylor Gray <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Update opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 13:48:53 -05:00
3 people	55fb97b290	Update Data Prepper key_value processor docs (#5153) ... * Add new options to table Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/key-value.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/key-value.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 10:00:57 -05:00
3 people	66db871345	Add docs for Data Prepper dissect processor (#5159) ... * Add docs for dissect processor Signed-off-by: Hai Yan <[email protected]> * Fix some style issues Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/dissect.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 10:00:28 -05:00
Jonah CalvoandMelissa Vagi	7eceb2baf0	Update documentation for new AD settings (#4835) ... * Update documentation for new AD settings Signed-off-by: Jonah Calvo <[email protected]> * update wording for verbose Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Remove 'few' from description Signed-off-by: Jonah Calvo <[email protected]> --------- Signed-off-by: Jonah Calvo <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> Co-authored-by: Melissa Vagi <[email protected]>	2023-09-21 15:07:38 -05:00
Vlad Babak	0e2a5888a9	Typo in convert_entry_type.md (#4994) ... Replaced "convert_entry_type_type" with "convert_entry_type". Signed-off-by: Vlad Babak <[email protected]>	2023-09-08 14:03:14 -05:00
Naarcha-AWS	ea886a4763	Fix S3 bug (#4974) ... Signed-off-by: Naarcha-AWS <[email protected]>	2023-09-06 16:01:03 -05:00
David VenableandNaarcha-AWS	64d59b9bb2	Behavioral changes for Data Prepper S3 sink (#4897) ... * Updates the Data Prepper documentation for S3 sinks based on recent behavior changes. Signed-off-by: David Venable <[email protected]> * Updates from the PR feedback. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-29 10:01:24 -05:00
David Venable	27cbf9d03a	Removes the acknowledgements_timeout configuration from the Data Prepper Kafka source. (#4898) ... Signed-off-by: David Venable <[email protected]>	2023-08-28 11:47:36 -05:00
David Venable	000aecc1a3	Moves the generic sink options into the Sinks documentation rather than PIpeline Configuration options. (#4907) ... Signed-off-by: David Venable <[email protected]>	2023-08-28 10:43:26 -05:00
David VenableandNaarcha-AWS	5306134c41	Updated the intro text for the s3 sink. (#4854) ... Signed-off-by: David Venable <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-23 13:33:46 -05:00
Naarcha-AWSandChris Moore	1250649984	Fix typos on S3 sink documentation (#4862) ... * Fix typos on S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]>	2023-08-23 12:49:46 -05:00
David Venable	ed21ec74cf	Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859) ... Signed-off-by: David Venable <[email protected]>	2023-08-23 09:19:04 -05:00
Asif Sohail MohammedandNaarcha-AWS	cc21df7ee8	S3 scan doc update (#4848) ... * Updated s3 scan docs Signed-off-by: Asif Sohail Mohammed <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:28:13 -05:00
David VenableandNaarcha-AWS	0b5011409a	Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847) ... * Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections. * Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema. * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:18:40 -05:00
3 people	8e9d0ed4de	S3 scan docs (#4756) ... * Add notification_source option for S3 Signed-off-by: Asif Sohail Mohammed <[email protected]> * Added S3 scan configuration Signed-off-by: Asif Sohail Mohammed <[email protected]> * Addressed some failing style checks Signed-off-by: Asif Sohail Mohammed <[email protected]> * Edit S3 additions. * Fix links. * Fix style flaw * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update s3.md --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 11:02:07 -05:00
3 people	ac3f60d5ca	Documentation for bucket ownership features in Data Prepper 2.4 (#4679) ... * Adds documentation for new features in Data Prepper 2.4 related to bucket ownership. Includes a section explaining how the bucket ownership works and can be configured for cross-account access. Resolves #4678 Signed-off-by: David Venable <[email protected]> * Updates from PR feedback. Signed-off-by: David Venable <[email protected]> * Remove redundant header Add a name to primary H2 header to section to prevent links from breaking. * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:46:04 -05:00
Qi ChenandNaarcha-AWS	7d077786bc	MAINT: update distribution_version in opensearch sink (#4742) ... * MAINT: update distribution_version in opensearch sink Signed-off-by: George Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Fix typo * ADD: request compression flag Signed-off-by: George Chen <[email protected]> * Update opensearch.md --------- Signed-off-by: George Chen <[email protected]> Signed-off-by: Qi Chen <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-21 10:45:40 -05:00
3 people	152ffcd79f	Add Kafka source for DP 2.4 (#4737) ... * Add Kafka source for DP 2.4 Signed-off-by: Naarcha-AWS <[email protected]> * Use new Kafka settings Signed-off-by: Naarcha-AWS <[email protected]> * Add technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Change array to object. Signed-off-by: Naarcha-AWS <[email protected]> * Last minute changes to Kafka defaults Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:43:32 -05:00
3 people	09ff9fc10c	Add documentation for managing data prepper source coordination (#4758) ... * Add documentation for managing data prepper source coordination Signed-off-by: Taylor Gray <[email protected]> * Update source-coordination.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/source-coordination.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Add TTL link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:39:50 -05:00
David VenableandNaarcha-AWS	442f4c446a	Documents general sink options (#4759) ... * Adds general sink options which includes: routes, tags_target_key, include_keys, exclude_keys. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-21 10:39:31 -05:00
4 people	c14b8b2a07	Add CIDR and User Agent processors (#4585) ... * Add CIDR and User Agent processors Signed-off-by: Naarcha-AWS <[email protected]> * Add CIDR functions Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Add technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Update user-agent.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/expression-syntax.md Co-authored-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update user-agent.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Hai Yan <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-27 14:58:47 -05:00
3 people	0fcfc4862e	Add S3 sink documentation (#4340) ... * Add S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-18 16:06:06 -07:00