CarolineandNaarcha-AWS
0249991f76
* Creating PR with first file. Signed-off-by: carolxob <[email protected]> * Adding newly created files to PR. Signed-off-by: carolxob <[email protected]> * Reorganized files and added appropriate metadata to map ToC correctly. Signed-off-by: carolxob <[email protected]> * Moved Authoring pipelines page. Signed-off-by: carolxob <[email protected]> * Minor ToC updates. Signed-off-by: carolxob <[email protected]> * Minor ToC updates to Sources section for Data Prepper. Signed-off-by: carolxob <[email protected]> * Updated Buffers section under Data Prepper. Signed-off-by: carolxob <[email protected]> * Minor update to otelmetricssource. Signed-off-by: carolxob <[email protected]> * Restructured ToC in Processors section for Data Prepper. Signed-off-by: carolxob <[email protected]> * Minor filename change. Signed-off-by: carolxob <[email protected]> * Adjustments to metadata in ToC. Signed-off-by: carolxob <[email protected]> * Minor edit. Signed-off-by: carolxob <[email protected]> * Fixed nav order in metadata. Signed-off-by: carolxob <[email protected]> * Minor edit. Signed-off-by: carolxob <[email protected]> * Minor update top metadata for ToC. Signed-off-by: carolxob <[email protected]> * Adjustmenets to Toc order. Signed-off-by: carolxob <[email protected]> * Minor adjustments to ToC metadata. Signed-off-by: carolxob <[email protected]> * Minor adjustments to Sinks section. Signed-off-by: carolxob <[email protected]> * Adjustements to high level ToC. Signed-off-by: carolxob <[email protected]> * Minor adjustement to Pipelines.md Signed-off-by: carolxob <[email protected]> * Minor update. Signed-off-by: carolxob <[email protected]> * Slight reorganization. Removed two placeholder pages for now. Signed-off-by: carolxob <[email protected]> * Removed a page and replaced with pipelines content. Signed-off-by: carolxob <[email protected]> * Minor changes/additions to content for placeholder pages. Signed-off-by: carolxob <[email protected]> * Minor update to page link. Signed-off-by: carolxob <[email protected]> * Minor adjustments to ToC metadata. Signed-off-by: carolxob <[email protected]> * Minor edits. Signed-off-by: carolxob <[email protected]> * Removed /clients from redirects to correct nav order. Signed-off-by: carolxob <[email protected]> * Minor edits. Signed-off-by: carolxob <[email protected]> * Minor adjustments to ToC metadata. Signed-off-by: carolxob <[email protected]> * Minor adjustments. Signed-off-by: carolxob <[email protected]> * Minor adjustment ot metadata. Signed-off-by: carolxob <[email protected]> * TOC link fixes Signed-off-by: Naarcha-AWS <[email protected]> * Changed page name. Signed-off-by: carolxob <[email protected]> * Corrected references to Peer Forwarder. Signed-off-by: carolxob <[email protected]> * Renamed Data Prepper folder. Signed-off-by: carolxob <[email protected]> * Minor updates to phrasing and capitalization. Signed-off-by: carolxob <[email protected]> * Minor phrasing update. Signed-off-by: carolxob <[email protected]> * Minor phrasing update. Signed-off-by: carolxob <[email protected]> * Minor change. Signed-off-by: carolxob <[email protected]> * Minor change to change S3 Source to S3Source. Signed-off-by: carolxob <[email protected]> * Updated references to peer forwarder and changed capitalization. Signed-off-by: carolxob <[email protected]> * Updated capitalization for peer forwarder. Signed-off-by: carolxob <[email protected]> * Made edits based on doc review feedback. Signed-off-by: carolxob <[email protected]> * Update to one word. Signed-off-by: carolxob <[email protected]> --------- Signed-off-by: carolxob <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Co-authored-by: Naarcha-AWS <[email protected]>
1.9 KiB
1.9 KiB
layout, title, parent, grand_parent, nav_order
| layout | title | parent | grand_parent | nav_order |
|---|---|---|---|---|
| default | csv | Processors | Pipelines | 45 |
csv
Overview
Takes in an Event and parses its CSV data into columns.
| Option | Required | Type | Description |
|---|---|---|---|
| source | No | String | The field in the Event that will be parsed. Default is message. |
| quote_character | No | String | The character used as a text qualifier for a single column of data. Default is double quote ". |
| delimiter | No | String | The character separating each column. Default is ,. |
| delete_header | No | Boolean | If specified, the header on the Event (column_names_source_key) deletes after the event is parsed. If there’s no header on the event, no actions is taken. Default is true. |
| column_names_source_key | No | String | The field in the Event that specifies the CSV column names, which will be autodetected. If there must be extra column names, the column names autogenerate according to their index. If column_names is also defined, the header in column_names_source_key can also be used to generate the event fields. If too few columns are specified in this field, the remaining column names autogenerate. If too many column names are specified in this field, the CSV processor omits the extra column names. |
| column_names | No | List | User-specified names for the CSV columns. Default is [column1, column2, ..., columnN] if there are N columns of data in the CSV record and column_names_source_key is not defined. If column_names_source_key is defined, the header in column_names_source_key generates the Event fields. If too few columns are specified in this field, the remaining column names will autogenerate. If too many column names are specified in this field, CSV processor omits the extra column names. |