101 Commits

Include renames

Author	SHA1	Message	Date
MUHAMMAD SAMIULLAHandNaarcha-AWS	e4c5ec18db	[DOC] Fix rename processor 'otel_trace' to 'otel_traces' (#5423) ... * Fix APIs File Signed-off-by: samipak458 <[email protected]> * Update API files according to API template Signed-off-by: samipak458 <[email protected]> * Update exec-stored-script.md Signed-off-by: Naarcha-AWS <[email protected]> * Update cat-aliases.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-allocation.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-cluster_manager.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-count.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-field-data.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * Update cat-health.md Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> * updated * updated * updated * data prepper update Signed-off-by: samipak458 <[email protected]> * Update _data-prepper/managing-data-prepper/peer-forwarder.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: samipak458 <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: MUHAMMAD SAMIULLAH <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-07 14:48:11 -06:00
kolchfa-aws	3c94bc80d7	Fix links and liquid formatting error (#5512) ... Signed-off-by: Fanit Kolchina <[email protected]>	2023-11-06 12:23:59 -05:00
Qi ChenandNaarcha-AWS	96175482d6	[DOC] data prepper secret extensions (#5202) ... * ADD: extension docs in data-prepper-config Signed-off-by: George Chen <[email protected]> * MAINT: updating secrets extension doc Signed-off-by: George Chen <[email protected]> * MAINT: fix links Signed-off-by: George Chen <[email protected]> * MAINT: fix one more dead link Signed-off-by: George Chen <[email protected]> * MAINT: renaming Signed-off-by: George Chen <[email protected]> * Update configuring-data-prepper.md * Update pipelines.md --------- Signed-off-by: George Chen <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-11-03 12:08:00 -05:00
Samuel Valdes GutierrezandNaarcha-AWS	7012af124a	[OSCI][DOCs] Replacing 'indices' terms for 'indexes' terms ONLY for description texts (#5353) ... * Fixing documentation for Wildcard in term-level queries section for Query DSL Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * replacing 'indices' term for 'indexes' term ONLY for description texts (not variables, links or properties) Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * Update creating-custom-workloads.md Signed-off-by: Naarcha-AWS <[email protected]> * updating changes suggested by Naarcha-AWS Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * updating changes suggested by Naarcha-AWS Signed-off-by: Samuel Valdes Gutierrez <[email protected]> * Rename _benchmark/workloads/index.md to _benchmark/workloads/reference/index.md Signed-off-by: Naarcha-AWS <[email protected]> * Rename _benchmark/workloads/indices.md to _benchmark/workloads/reference/indices.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Samuel Valdes Gutierrez <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-10-31 10:18:45 -05:00
3 people	03d177aa2b	Add documentation for Data Prepper translate processor (#5122) ... * Add translate processor docs Signed-off-by: Hai Yan <[email protected]> * Fix a table display issue Signed-off-by: Hai Yan <[email protected]> * Address review comments: tweak sentences; add type info; add top level options Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/translate.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update translate.md * Update translate.md * Update _data-prepper/pipelines/configuration/processors/translate.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-12 08:53:20 -05:00
3 people	f4984fb605	Documentation for the Data Prepper OpenSearch source (#5144) ... * Documentation for the Data Prepper OpenSearch source Signed-off-by: Taylor Gray <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Update opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update opensearch.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Update _data-prepper/pipelines/configuration/sources/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Taylor Gray <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 13:48:53 -05:00
3 people	55fb97b290	Update Data Prepper key_value processor docs (#5153) ... * Add new options to table Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/key-value.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/key-value.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 10:00:57 -05:00
3 people	66db871345	Add docs for Data Prepper dissect processor (#5159) ... * Add docs for dissect processor Signed-off-by: Hai Yan <[email protected]> * Fix some style issues Signed-off-by: Hai Yan <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/processors/dissect.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-10-11 10:00:28 -05:00
Jonah CalvoandMelissa Vagi	7eceb2baf0	Update documentation for new AD settings (#4835) ... * Update documentation for new AD settings Signed-off-by: Jonah Calvo <[email protected]> * update wording for verbose Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Update _data-prepper/pipelines/configuration/processors/anomaly-detector.md Co-authored-by: Melissa Vagi <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> * Remove 'few' from description Signed-off-by: Jonah Calvo <[email protected]> --------- Signed-off-by: Jonah Calvo <[email protected]> Signed-off-by: Jonah Calvo <[email protected]> Co-authored-by: Melissa Vagi <[email protected]>	2023-09-21 15:07:38 -05:00
Vlad Babak	0e2a5888a9	Typo in convert_entry_type.md (#4994) ... Replaced "convert_entry_type_type" with "convert_entry_type". Signed-off-by: Vlad Babak <[email protected]>	2023-09-08 14:03:14 -05:00
Naarcha-AWS	ea886a4763	Fix S3 bug (#4974) ... Signed-off-by: Naarcha-AWS <[email protected]>	2023-09-06 16:01:03 -05:00
David VenableandNaarcha-AWS	64d59b9bb2	Behavioral changes for Data Prepper S3 sink (#4897) ... * Updates the Data Prepper documentation for S3 sinks based on recent behavior changes. Signed-off-by: David Venable <[email protected]> * Updates from the PR feedback. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-29 10:01:24 -05:00
David Venable	27cbf9d03a	Removes the acknowledgements_timeout configuration from the Data Prepper Kafka source. (#4898) ... Signed-off-by: David Venable <[email protected]>	2023-08-28 11:47:36 -05:00
David Venable	000aecc1a3	Moves the generic sink options into the Sinks documentation rather than PIpeline Configuration options. (#4907) ... Signed-off-by: David Venable <[email protected]>	2023-08-28 10:43:26 -05:00
David VenableandNaarcha-AWS	5306134c41	Updated the intro text for the s3 sink. (#4854) ... Signed-off-by: David Venable <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-23 13:33:46 -05:00
Naarcha-AWSandChris Moore	1250649984	Fix typos on S3 sink documentation (#4862) ... * Fix typos on S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]>	2023-08-23 12:49:46 -05:00
David Venable	ed21ec74cf	Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859) ... Signed-off-by: David Venable <[email protected]>	2023-08-23 09:19:04 -05:00
Asif Sohail MohammedandNaarcha-AWS	cc21df7ee8	S3 scan doc update (#4848) ... * Updated s3 scan docs Signed-off-by: Asif Sohail Mohammed <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:28:13 -05:00
David VenableandNaarcha-AWS	0b5011409a	Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847) ... * Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections. * Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema. * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:18:40 -05:00
3 people	8e9d0ed4de	S3 scan docs (#4756) ... * Add notification_source option for S3 Signed-off-by: Asif Sohail Mohammed <[email protected]> * Added S3 scan configuration Signed-off-by: Asif Sohail Mohammed <[email protected]> * Addressed some failing style checks Signed-off-by: Asif Sohail Mohammed <[email protected]> * Edit S3 additions. * Fix links. * Fix style flaw * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update s3.md --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 11:02:07 -05:00
3 people	ac3f60d5ca	Documentation for bucket ownership features in Data Prepper 2.4 (#4679) ... * Adds documentation for new features in Data Prepper 2.4 related to bucket ownership. Includes a section explaining how the bucket ownership works and can be configured for cross-account access. Resolves #4678 Signed-off-by: David Venable <[email protected]> * Updates from PR feedback. Signed-off-by: David Venable <[email protected]> * Remove redundant header Add a name to primary H2 header to section to prevent links from breaking. * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:46:04 -05:00
Qi ChenandNaarcha-AWS	7d077786bc	MAINT: update distribution_version in opensearch sink (#4742) ... * MAINT: update distribution_version in opensearch sink Signed-off-by: George Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Fix typo * ADD: request compression flag Signed-off-by: George Chen <[email protected]> * Update opensearch.md --------- Signed-off-by: George Chen <[email protected]> Signed-off-by: Qi Chen <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-21 10:45:40 -05:00
3 people	152ffcd79f	Add Kafka source for DP 2.4 (#4737) ... * Add Kafka source for DP 2.4 Signed-off-by: Naarcha-AWS <[email protected]> * Use new Kafka settings Signed-off-by: Naarcha-AWS <[email protected]> * Add technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Change array to object. Signed-off-by: Naarcha-AWS <[email protected]> * Last minute changes to Kafka defaults Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:43:32 -05:00
3 people	09ff9fc10c	Add documentation for managing data prepper source coordination (#4758) ... * Add documentation for managing data prepper source coordination Signed-off-by: Taylor Gray <[email protected]> * Update source-coordination.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/source-coordination.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Add TTL link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:39:50 -05:00
David VenableandNaarcha-AWS	442f4c446a	Documents general sink options (#4759) ... * Adds general sink options which includes: routes, tags_target_key, include_keys, exclude_keys. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-21 10:39:31 -05:00
4 people	c14b8b2a07	Add CIDR and User Agent processors (#4585) ... * Add CIDR and User Agent processors Signed-off-by: Naarcha-AWS <[email protected]> * Add CIDR functions Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Add technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Update user-agent.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/expression-syntax.md Co-authored-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update user-agent.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Hai Yan <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-27 14:58:47 -05:00
3 people	0fcfc4862e	Add S3 sink documentation (#4340) ... * Add S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-18 16:06:06 -07:00
3 people	adae164d53	Add obfuscate processor (#4515) ... * Add obfuscate processor reference Signed-off-by: Naarcha-AWS <[email protected]> * fix typo Signed-off-by: Naarcha-AWS <[email protected]> * Fix paragraph description. Signed-off-by: Naarcha-AWS <[email protected]> * Fix consistency issues Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-14 12:44:01 -05:00
Powershellfish	d78bd5b70e	Update capitalization for Events (#4213) ... Signed-off-by: Powershellfish <[email protected]>	2023-07-05 13:50:27 -05:00
David VenableandNaarcha-AWS	5a4daa4225	Documents the Data Prepper opensearch sink's template_type parameter. (#4290) ... * Documents the Data Prepper opensearch sink's template_type parameter. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-06-13 13:53:29 -05:00