87 Commits

Include renames

Author	SHA1	Message	Date
David VenableandNaarcha-AWS	5306134c41	Updated the intro text for the s3 sink. (#4854) ... Signed-off-by: David Venable <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-23 13:33:46 -05:00
Naarcha-AWSandChris Moore	1250649984	Fix typos on S3 sink documentation (#4862) ... * Fix typos on S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]>	2023-08-23 12:49:46 -05:00
David Venable	ed21ec74cf	Removes the Data Prepper csv sink codec. This is not ready for use and should not be documented. (#4859) ... Signed-off-by: David Venable <[email protected]>	2023-08-23 09:19:04 -05:00
Asif Sohail MohammedandNaarcha-AWS	cc21df7ee8	S3 scan doc update (#4848) ... * Updated s3 scan docs Signed-off-by: Asif Sohail Mohammed <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:28:13 -05:00
David VenableandNaarcha-AWS	0b5011409a	Data Prepper documentation updates for the s3 sink in 2.4.0 (#4847) ... * Data Prepper documentation updates for the s3 sink in 2.4.0. Includes other corrections. * Updated the Parquet/Avro codecs to include auto_schema as well as some clarifications on the restrictions of the auto-generated schema. * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-22 15:18:40 -05:00
3 people	8e9d0ed4de	S3 scan docs (#4756) ... * Add notification_source option for S3 Signed-off-by: Asif Sohail Mohammed <[email protected]> * Added S3 scan configuration Signed-off-by: Asif Sohail Mohammed <[email protected]> * Addressed some failing style checks Signed-off-by: Asif Sohail Mohammed <[email protected]> * Edit S3 additions. * Fix links. * Fix style flaw * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update s3.md --------- Signed-off-by: Asif Sohail Mohammed <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 11:02:07 -05:00
3 people	ac3f60d5ca	Documentation for bucket ownership features in Data Prepper 2.4 (#4679) ... * Adds documentation for new features in Data Prepper 2.4 related to bucket ownership. Includes a section explaining how the bucket ownership works and can be configured for cross-account access. Resolves #4678 Signed-off-by: David Venable <[email protected]> * Updates from PR feedback. Signed-off-by: David Venable <[email protected]> * Remove redundant header Add a name to primary H2 header to section to prevent links from breaking. * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:46:04 -05:00
Qi ChenandNaarcha-AWS	7d077786bc	MAINT: update distribution_version in opensearch sink (#4742) ... * MAINT: update distribution_version in opensearch sink Signed-off-by: George Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/opensearch.md Co-authored-by: Naarcha-AWS <[email protected]> Signed-off-by: Qi Chen <[email protected]> * Fix typo * ADD: request compression flag Signed-off-by: George Chen <[email protected]> * Update opensearch.md --------- Signed-off-by: George Chen <[email protected]> Signed-off-by: Qi Chen <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-21 10:45:40 -05:00
3 people	152ffcd79f	Add Kafka source for DP 2.4 (#4737) ... * Add Kafka source for DP 2.4 Signed-off-by: Naarcha-AWS <[email protected]> * Use new Kafka settings Signed-off-by: Naarcha-AWS <[email protected]> * Add technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Change array to object. Signed-off-by: Naarcha-AWS <[email protected]> * Last minute changes to Kafka defaults Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:43:32 -05:00
3 people	09ff9fc10c	Add documentation for managing data prepper source coordination (#4758) ... * Add documentation for managing data prepper source coordination Signed-off-by: Taylor Gray <[email protected]> * Update source-coordination.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/source-coordination.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Add TTL link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Taylor Gray <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-08-21 10:39:50 -05:00
David VenableandNaarcha-AWS	442f4c446a	Documents general sink options (#4759) ... * Adds general sink options which includes: routes, tags_target_key, include_keys, exclude_keys. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-08-21 10:39:31 -05:00
4 people	c14b8b2a07	Add CIDR and User Agent processors (#4585) ... * Add CIDR and User Agent processors Signed-off-by: Naarcha-AWS <[email protected]> * Add CIDR functions Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Add technical feedback Signed-off-by: Naarcha-AWS <[email protected]> * Update user-agent.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/expression-syntax.md Co-authored-by: Hai Yan <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update user-agent.md Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Hai Yan <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-27 14:58:47 -05:00
3 people	0fcfc4862e	Add S3 sink documentation (#4340) ... * Add S3 sink documentation Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/pipelines/configuration/sinks/s3.md Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-18 16:06:06 -07:00
3 people	adae164d53	Add obfuscate processor (#4515) ... * Add obfuscate processor reference Signed-off-by: Naarcha-AWS <[email protected]> * fix typo Signed-off-by: Naarcha-AWS <[email protected]> * Fix paragraph description. Signed-off-by: Naarcha-AWS <[email protected]> * Fix consistency issues Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-07-14 12:44:01 -05:00
Powershellfish	d78bd5b70e	Update capitalization for Events (#4213) ... Signed-off-by: Powershellfish <[email protected]>	2023-07-05 13:50:27 -05:00
David VenableandNaarcha-AWS	5a4daa4225	Documents the Data Prepper opensearch sink's template_type parameter. (#4290) ... * Documents the Data Prepper opensearch sink's template_type parameter. Signed-off-by: David Venable <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>	2023-06-13 13:53:29 -05:00
Powershellfish	3b9ae603de	Updated capitalization. (#4214) ... Signed-off-by: Powershellfish <[email protected]>	2023-06-07 06:41:42 -07:00
Heather Halter	91ca0ffd55	redirect (#4198) ... Signed-off-by: Heather Halter <[email protected]>	2023-05-26 15:57:18 -07:00
Powershellfish	baa2fb45ef	[DOC] Remove indentation in copy_values processor (#4057) ... * Test. Signed-off-by: Powershellfish <[email protected]> * Update index.md Testing ability to create PRs. * Removed indentation. Signed-off-by: Powershellfish <[email protected]> --------- Signed-off-by: Powershellfish <[email protected]>	2023-05-15 17:49:13 -07:00
3 people	a9a47ed945	Data Prepper documentation for the SNS to SQS fan out pattern in S3 (#3915) ... * Adds documentation on how to use the SNS to SQS fan out with Data Prepper. Signed-off-by: David Venable <[email protected]> * Grammar edits. * Update s3-logs.md * Update _data-prepper/common-use-cases/s3-logs.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/common-use-cases/s3-logs.md Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-05-15 12:55:45 -05:00
astephanusandFanit Kolchina	1fb5252cd6	Adds collections landing page configuration and navigation header linking (#3812) ... * Adds collections landing page configuration and navigation header linking Signed-off-by: Aaron Stephanus <[email protected]> * Removes unnecessary collection property from the configuration. Signed-off-by: Aaron Stephanus <[email protected]> * Adds links to navigation collection headers to collection index pages based on the collection name Signed-off-by: Aaron Stephanus <[email protected]> * Hide index pages from view and add info to formatting guide Signed-off-by: Fanit Kolchina <[email protected]> --------- Signed-off-by: Aaron Stephanus <[email protected]> Signed-off-by: Fanit Kolchina <[email protected]> Co-authored-by: Fanit Kolchina <[email protected]>	2023-05-11 13:56:08 -04:00
4 people	56a55102a6	Document Data Prepper circuit breakers. (#3916) ... * Document Data Prepper circuit breakers. Signed-off-by: David Venable <[email protected]> * Update configuring-data-prepper.md * Update configuring-data-prepper.md * Update _data-prepper/managing-data-prepper/configuring-data-prepper.md Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/configuring-data-prepper.md Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/configuring-data-prepper.md Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/configuring-data-prepper.md Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update _data-prepper/managing-data-prepper/configuring-data-prepper.md Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Heather Halter <[email protected]>	2023-05-10 13:13:54 -05:00
Heather Halter	22cfcf119b	CAT API redirects (#3965) ... * catapi redirects Signed-off-by: Heather Halter <[email protected]> * data prepper redirects Signed-off-by: Heather Halter <[email protected]> * committing unsaved Signed-off-by: Heather Halter <[email protected]> --------- Signed-off-by: Heather Halter <[email protected]>	2023-05-04 11:22:52 -07:00
kolchfa-aws	8463c8f278	Correct plugin capitalization (#3838) ... * Correct plugin capitalization Signed-off-by: Fanit Kolchina <[email protected]> * Revert cluster-stats because the name is in response Signed-off-by: Fanit Kolchina <[email protected]> * Revert cluster-stats once more Signed-off-by: Fanit Kolchina <[email protected]> --------- Signed-off-by: Fanit Kolchina <[email protected]>	2023-05-04 11:11:54 -04:00
Heather Halter	f35e72d577	fix list-to-map order (#3941) ... Signed-off-by: Heather Halter <[email protected]>	2023-05-03 10:37:27 -07:00
Heather Halter	0235af562f	fix table headings (#3943) ... Signed-off-by: Heather Halter <[email protected]>	2023-05-03 07:04:30 -07:00
Naarcha-AWS	1259454b73	Fix typo on processor page. (#3903) ... Signed-off-by: Naarcha-AWS <[email protected]>	2023-04-27 18:58:54 -05:00
4 people	196c750b55	Adds general S3 use-case documentation. #3833 (#3842) ... * Adds general S3 use-case documentation. #3833 Signed-off-by: David Venable <[email protected]> * Add edits to S3 logs doc * Apply suggestions from code review Co-authored-by: Heather Halter <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update s3-logs.md * Update s3-logs.md * Apply suggestions from code review Co-authored-by: Chris Moore <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: David Venable <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]> Co-authored-by: Heather Halter <[email protected]> Co-authored-by: Chris Moore <[email protected]>	2023-04-27 16:20:01 -05:00
David Venable	3baac55d9f	Updates the images used for Data Prepper use-cases to use images with OpenSearch icons and typography. (#3844) ... Signed-off-by: David Venable <[email protected]>	2023-04-27 14:50:50 -05:00
3 people	4251fb04bd	Add DLQ and aggregate processor edits. Baseline processor names (#3880) ... * Add DLQ and aggregate processor edits. Baseline processor names Signed-off-by: Naarcha-AWS <[email protected]> * Remove processor from titles Signed-off-by: Naarcha-AWS <[email protected]> * Update dlq.md Signed-off-by: Naarcha-AWS <[email protected]> * Add additional feedback Signed-off-by: Naarcha-AWS <[email protected]> * add cross links Signed-off-by: Naarcha-AWS <[email protected]> * Fix typos Signed-off-by: Naarcha-AWS <[email protected]> * Add doc review Signed-off-by: Naarcha-AWS <[email protected]> * Remove link Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: kolchfa-aws <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> * Update dlq.md Signed-off-by: Naarcha-AWS <[email protected]> * Fix processor title Signed-off-by: Naarcha-AWS <[email protected]> * Apply suggestions from code review Co-authored-by: Nathan Bower <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> --------- Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: kolchfa-aws <[email protected]> Co-authored-by: Nathan Bower <[email protected]>	2023-04-27 14:01:01 -05:00