112 Commits

Include renames

Author	SHA1	Message	Date
Melissa Vagi	d9d5406f93	Add pattern matching (text processing) use case to Data Prepper documentation (#6181) ... * Add pattern matching use case to Data Prepper documentation Signed-off-by: Melissa Vagi <[email protected]> * Add pattern matching use case to Data Prepper documentation Signed-off-by: Melissa Vagi <[email protected]> * Address SME comments Signed-off-by: Melissa Vagi <[email protected]> * Copy edits Signed-off-by: Melissa Vagi <[email protected]> * Address editorial feedback Signed-off-by: Melissa Vagi <[email protected]> --------- Signed-off-by: Melissa Vagi <[email protected]>	2024-01-30 12:00:58 -07:00
Melissa VagiandNathan Bower	719b3895cf	Add log enrichment use case to Data Prepper (#6225) ... * Add log enrichment use case to Data Prepper --------- Signed-off-by: Melissa Vagi <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-01-22 13:15:47 -07:00
kolchfa-aws	699cb9ac20	Change navigation for index pages of collections (#6039) ... Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: kolchfa-aws <[email protected]>	2024-01-04 14:55:05 -05:00
kolchfa-awsandNathan Bower	a7da03343e	Style guide fix - white space (#6023) ... * Style guide fix - white space Signed-off-by: Fanit Kolchina <[email protected]> * Update _data-prepper/pipelines/configuration/processors/parse-json.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> --------- Signed-off-by: Fanit Kolchina <[email protected]> Signed-off-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2024-01-02 14:27:35 -05:00
4 people	e63b67b873	Added documentation for grok_when option (#5912) ... * Added documentation for grok_when option Signed-off-by: Kondaka <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update _data-prepper/pipelines/configuration/processors/grok.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> * Update grok.md Address editorial review feedback. Signed-off-by: Melissa Vagi <[email protected]> * Update grok.md Signed-off-by: Melissa Vagi <[email protected]> --------- Signed-off-by: Kondaka <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Melissa Vagi <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Melissa Vagi <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-12-21 13:39:11 -07:00
3 people	21de57685c	Documentation for Data Prepper's kafka buffer (#5689) ... * Adds documentation for Data Prepper's kafka buffer. Signed-off-by: David Venable <[email protected]> * Update kafka.md * Adds an example pipeline configuration for the Kafka buffer in Data Prepper. Also some related clean-up. Signed-off-by: David Venable <[email protected]> * Update _data-prepper/pipelines/configuration/buffers/kafka.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/buffers/kafka.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-12-13 14:12:26 -06:00
Craig AdamandNaarcha-AWS	9c4e13bd2e	Fix missing character typo (#5771) ... * Fix missing character typo Signed-off-by: Craig Adam <[email protected]> * Update substitute-string.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Craig Adam <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-12-04 12:27:39 -06:00
3 people	fa5bc07a69	Add DynamoDB source (#5664) ... * Add DynamoDB source Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Reconfigure sections Signed-off-by: Naarcha-AWS <[email protected]> * Add Dynamo DB source. Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update dynamo-db.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-11-29 11:38:08 -06:00
Naarcha-AWSandNathan Bower	5877f13f16	Add Serverless configuration options for Data Prepper (#5663) ... * Add Serverless configuration options for Data Prepper Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Implement additional technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Fix options Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-11-28 10:10:15 -06:00
David VenableandNaarcha-AWS	97d14ccfc2	Data Prepper's s3 source: visibility_duplication_protection (#5665) ... * Adds documentation for Data Prepper's s3 source visibility_duplication_protection configuration. Includes the necessary permissions. Signed-off-by: David Venable <[email protected]> * Update _data-prepper/pipelines/configuration/sources/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/s3.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-27 11:26:54 -06:00
Naarcha-AWSandMelissa Vagi	72b3363460	Add codec and processor combinations to S3 source (#5288) ... * Add codec and processor combinations to S3 source. Signed-off-by: Naarcha-AWS <[email protected]> * Update s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Make codec-processor combinations its own file Signed-off-by: Naarcha-AWS <[email protected]> * Make Data Prepper codec page Signed-off-by: Naarcha-AWS <[email protected]> * Fix links Signed-off-by: Naarcha-AWS <[email protected]> * Fix links Signed-off-by: Naarcha-AWS <[email protected]> * Reformat article without tables. Signed-off-by: Naarcha-AWS <[email protected]> * fix link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/common-use-cases/codec-processor-combinations.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update codec-processor-combinations.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Melissa Vagi <[email protected]>	2023-11-17 20:06:04 -06:00
MUHAMMAD SAMIULLAHandNaarcha-AWS	e4c5ec18db	[DOC] Fix rename processor 'otel_trace' to 'otel_traces' (#5423) ... * Fix APIs File Signed-off-by: samipak458 <[email protected]> * Update API files according to API template Signed-off-by: samipak458 <[email protected]> * Update exec-stored-script.md Signed-off-by: Naarcha-AWS <[email protected]> * Update cat-aliases.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-allocation.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-cluster_manager.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-count.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-field-data.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-health.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * updated * updated * updated * data prepper update Signed-off-by: samipak458 <[email protected]> * Update _data-prepper/managing-data-prepper/peer-forwarder.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: samipak458 <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-07 14:48:11 -06:00
kolchfa-aws	3c94bc80d7	Fix links and liquid formatting error (#5512) ... Signed-off-by: Fanit Kolchina <[email protected]>	2023-11-06 12:23:59 -05:00
Qi ChenandNaarcha-AWS	96175482d6	[DOC] data prepper secret extensions (#5202) ... * ADD: extension docs in data-prepper-config Signed-off-by: George Chen <[email protected]> * MAINT: updating secrets extension doc Signed-off-by: George Chen <[email protected]> * MAINT: fix links Signed-off-by: George Chen <[email protected]> * MAINT: fix one more dead link Signed-off-by: George Chen <[email protected]> * MAINT: renaming Signed-off-by: George Chen <[email protected]> * Update configuring-data-prepper.md * Update pipelines.md --------- Signed-off-by: George Chen <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-03 12:08:00 -05:00
Samuel Valdes GutierrezandNaarcha-AWS	7012af124a	[OSCI][DOCs] Replacing 'indices' terms for 'indexes' terms ONLY for description texts (#5353) ... * Fixing documentation for Wildcard in term-level queries section for Query DSL Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * replacing 'indices' term for 'indexes' term ONLY for description texts (not variables, links or properties) Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * Update creating-custom-workloads.md Signed-off-by: Naarcha-AWS <[email protected]> * updating changes suggested by Naarcha-AWS Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * updating changes suggested by Naarcha-AWS Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * Rename _benchmark/workloads/index.md to _benchmark/workloads/reference/index.md Signed-off-by: Naarcha-AWS <[email protected]> * Rename _benchmark/workloads/indices.md to _benchmark/workloads/reference/indices.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Samuel Valdes Gutierrez <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-10-31 10:18:45 -05:00
3 people	03d177aa2b	Add documentation for Data Prepper translate processor (#5122) ... * Add translate processor docs Signed-off-by: Hai Yan <[email protected]> * Fix a table display issue Signed-off-by: Hai Yan <[email protected]> * Address review comments: tweak sentences; add type info; add top level options Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/translate.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update translate.md * Update translate.md * Update _data-prepper/pipelines/configuration/processors/translate.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-12 08:53:20 -05:00
3 people	f4984fb605	Documentation for the Data Prepper OpenSearch source (#5144) ... * Documentation for the Data Prepper OpenSearch source Signed-off-by: Taylor Gray <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Update opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 13:48:53 -05:00
3 people	55fb97b290	Update Data Prepper key_value processor docs (#5153) ... * Add new options to table Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/key-value.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/key-value.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 10:00:57 -05:00
3 people	66db871345	Add docs for Data Prepper dissect processor (#5159) ... * Add docs for dissect processor Signed-off-by: Hai Yan <[email protected]> * Fix some style issues Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/dissect.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 10:00:28 -05:00
Jonah CalvoandMelissa Vagi	7eceb2baf0	Update documentation for new AD settings (#4835) ... * Update documentation for new AD settings Signed-off-by: Jonah Calvo <[email protected]> * update wording for verbose Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Remove 'few' from description Signed-off-by: Jonah Calvo <[email protected]> --------- Signed-off-by: Jonah Calvo <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> Co-authored-by: Melissa Vagi <[email protected]>	2023-09-21 15:07:38 -05:00
Vlad Babak	0e2a5888a9	Typo in convert_entry_type.md (#4994) ... Replaced "convert_entry_type_type" with "convert_entry_type". Signed-off-by: Vlad Babak <[email protected]>	2023-09-08 14:03:14 -05:00
Naarcha-AWS	ea886a4763	Fix S3 bug (#4974) ... Signed-off-by: Naarcha-AWS <[email protected]>	2023-09-06 16:01:03 -05:00
David VenableandNaarcha-AWS	64d59b9bb2	Behavioral changes for Data Prepper S3 sink (#4897) ... * Updates the Data Prepper documentation for S3 sinks based on recent behavior changes. Signed-off-by: David Venable <[email protected]> * Updates from the PR feedback. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-29 10:01:24 -05:00
David Venable	27cbf9d03a	Removes the acknowledgements_timeout configuration from the Data Prepper Kafka source. (#4898) ... Signed-off-by: David Venable <[email protected]>	2023-08-28 11:47:36 -05:00
David Venable	000aecc1a3	Moves the generic sink options into the Sinks documentation rather than PIpeline Configuration options. (#4907) ... Signed-off-by: David Venable <[email protected]>	2023-08-28 10:43:26 -05:00
David VenableandNaarcha-AWS	5306134c41	Updated the intro text for the s3 sink. (#4854) ... Signed-off-by: David Venable <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-23 13:33:46 -05:00
Naarcha-AWSandChris Moore	1250649984	Fix typos on S3 sink documentation (#4862) ... * Fix typos on S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]>	2023-08-23 12:49:46 -05:00
David Venable	ed21ec74cf	Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859) ... Signed-off-by: David Venable <[email protected]>	2023-08-23 09:19:04 -05:00
Asif Sohail MohammedandNaarcha-AWS	cc21df7ee8	S3 scan doc update (#4848) ... * Updated s3 scan docs Signed-off-by: Asif Sohail Mohammed <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:28:13 -05:00
David VenableandNaarcha-AWS	0b5011409a	Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847) ... * Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections. * Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema. * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:18:40 -05:00