* Make API reference top level Signed-off-by: Naarcha-AWS <[email protected]> * Fix typo on Drag and Drop page (#1633) * Fix typo on Drag and Drop page * Update _dashboards/drag-drop-wizard.md Co-authored-by: Nate Bower <[email protected]> * Update drag-drop-wizard.md Co-authored-by: Nate Bower <[email protected]> * Putting all the Docker install material on a single page (#1452) * Putting all the Docker install material on a single page Signed-off-by: JeffH-AWS <[email protected]> * Making room for revamp Signed-off-by: JeffH-AWS <[email protected]> * Intro added Signed-off-by: JeffH-AWS <[email protected]> * Continuing to flesh out the intro section and overview Signed-off-by: JeffH-AWS <[email protected]> * Overview finalized Signed-off-by: JeffH-AWS <[email protected]> * Introducing docker compose Signed-off-by: JeffH-AWS <[email protected]> * Added link to compose Signed-off-by: JeffH-AWS <[email protected]> * Continuing docker image commentary Signed-off-by: JeffH-AWS <[email protected]> * Sometimes I wonder if anyone reads these Signed-off-by: JeffH-AWS <[email protected]> * Adding notes on installing compose with pip Signed-off-by: JeffH-AWS <[email protected]> * Adding prereqs Signed-off-by: JeffH-AWS <[email protected]> * Magnets - how do they work? Signed-off-by: JeffH-AWS <[email protected]> * Almonds and peaches are part of the same plant subgenus, Amygdalus Signed-off-by: JeffH-AWS <[email protected]> * There are 293 ways to make change for a dollar Signed-off-by: JeffH-AWS <[email protected]> * A shark is the only known fish that can blink with both eyes Signed-off-by: JeffH-AWS <[email protected]> * A crocodile cannot stick its tongue out Signed-off-by: JeffH-AWS <[email protected]> * wording Signed-off-by: JeffH-AWS <[email protected]> * Reorganizing a couple paragraphs to make it flow better Signed-off-by: JeffH-AWS <[email protected]> * Forgot a word Signed-off-by: JeffH-AWS <[email protected]> * Add tip about pruning stopped containers Signed-off-by: JeffH-AWS <[email protected]> * Cleaning up Signed-off-by: JeffH-AWS <[email protected]> * Add blurb about container ls Signed-off-by: JeffH-AWS <[email protected]> * Adding the Docker Compose stuff Signed-off-by: JeffH-AWS <[email protected]> * Working on compose Signed-off-by: JeffH-AWS <[email protected]> * Continuing work on the compose section - it's a lot of info Signed-off-by: JeffH-AWS <[email protected]> * Added important settings Signed-off-by: JeffH-AWS <[email protected]> * Updates to settings that need configured Signed-off-by: JeffH-AWS <[email protected]> * Still working through compose things Signed-off-by: JeffH-AWS <[email protected]> * Fixed wording Signed-off-by: JeffH-AWS <[email protected]> * Working through compose commands and guidance Signed-off-by: JeffH-AWS <[email protected]> * Reordering/rewording Signed-off-by: JeffH-AWS <[email protected]> * More phrasing Signed-off-by: JeffH-AWS <[email protected]> * More wording in steps Signed-off-by: JeffH-AWS <[email protected]> * More wording in steps Signed-off-by: JeffH-AWS <[email protected]> * Organizing Signed-off-by: JeffH-AWS <[email protected]> * Adding stuff and things Signed-off-by: JeffH-AWS <[email protected]> * Continuing to work through the configuration steps Signed-off-by: JeffH-AWS <[email protected]> * Fixes Signed-off-by: JeffH-AWS <[email protected]> * Fixes Signed-off-by: JeffH-AWS <[email protected]> * Still working on the configuration steps Signed-off-by: JeffH-AWS <[email protected]> * Changes Signed-off-by: JeffH-AWS <[email protected]> * More work Signed-off-by: JeffH-AWS <[email protected]> * Removed perf analyzer - refer to GH issue 1555 Signed-off-by: JeffH-AWS <[email protected]> * Fixing things Signed-off-by: JeffH-AWS <[email protected]> * Adding guidance on passing settings in compose Signed-off-by: JeffH-AWS <[email protected]> * Working through dockerfile materials now Signed-off-by: JeffH-AWS <[email protected]> * wording Signed-off-by: JeffH-AWS <[email protected]> * Finalized the sample dev compose file Signed-off-by: JeffH-AWS <[email protected]> * Continuing work with configuration Signed-off-by: JeffH-AWS <[email protected]> * Finished - ready for reviews Signed-off-by: JeffH-AWS <[email protected]> * Fixed a link I forgot to change before Signed-off-by: JeffH-AWS <[email protected]> * Changes from first proofread Signed-off-by: JeffH-AWS <[email protected]> * Changed heading Signed-off-by: JeffH-AWS <[email protected]> * Addressed reviewer comments and made some changes Signed-off-by: JeffH-AWS <[email protected]> * Forgot to incorporate one change. Fixed. Signed-off-by: JeffH-AWS <[email protected]> * Final editorial changes Signed-off-by: JeffH-AWS <[email protected]> Signed-off-by: JeffH-AWS <[email protected]> * fix#1584-custom_attr_allowlist (#1636) Signed-off-by: cwillum <[email protected]> Signed-off-by: cwillum <[email protected]> * Update TERMS.md with definition for Setting (#1632) * fix#1631-Terms-setting Signed-off-by: cwillum <[email protected]> * fix#1631-Terms-setting Signed-off-by: cwillum <[email protected]> Signed-off-by: cwillum <[email protected]> * Add disclaimer about remote fs usage and an example of setting env var (#1644) * Add disclaimer about remote fs usage and an example of setting env var Signed-off-by: JeffH-AWS <[email protected]> * Enhanced wording a little bit Signed-off-by: JeffH-AWS <[email protected]> Signed-off-by: JeffH-AWS <[email protected]> * [DOC] New documentation: Self-host maps server (#1625) * Add new page self-host maps server Signed-off-by: vagimeli <[email protected]> * Added new content Signed-off-by: vagimeli <[email protected]> * Copy edit Signed-off-by: vagimeli <[email protected]> * Tech review edits Signed-off-by: vagimeli <[email protected]> * Doc review edits Signed-off-by: vagimeli <[email protected]> * Editorial review changes Signed-off-by: vagimeli <[email protected]> * Final edits Signed-off-by: vagimeli <[email protected]> Signed-off-by: vagimeli <[email protected]> * Add feedback. Signed-off-by: Naarcha-AWS <[email protected]> * Fix links Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: Naarcha-AWS <[email protected]> Signed-off-by: JeffH-AWS <[email protected]> Signed-off-by: cwillum <[email protected]> Signed-off-by: vagimeli <[email protected]> Co-authored-by: Nate Bower <[email protected]> Co-authored-by: Jeff Huss <[email protected]> Co-authored-by: Chris Moore <[email protected]> Co-authored-by: Melissa Vagi <[email protected]>
198 lines
4.1 KiB
Markdown
198 lines
4.1 KiB
Markdown
---
|
|
layout: default
|
|
title: Simulate an ingest pipeline
|
|
parent: Ingest APIs
|
|
nav_order: 13
|
|
---
|
|
|
|
# Simulate a pipeline
|
|
|
|
Simulates an ingest pipeline with any example documents you specify.
|
|
|
|
## Example
|
|
|
|
```
|
|
POST /_ingest/pipeline/35678/_simulate
|
|
{
|
|
"docs": [
|
|
{
|
|
"_index": "index",
|
|
"_id": "id",
|
|
"_source": {
|
|
"location": "document-name"
|
|
}
|
|
},
|
|
{
|
|
"_index": "index",
|
|
"_id": "id",
|
|
"_source": {
|
|
"location": "document-name"
|
|
}
|
|
}
|
|
]
|
|
}
|
|
```
|
|
|
|
## Path and HTTP methods
|
|
|
|
Simulate the last ingest pipeline created.
|
|
|
|
```
|
|
GET _ingest/pipeline/_simulate
|
|
POST _ingest/pipeline/_simulate
|
|
```
|
|
|
|
Simulate a single pipeline based on the pipeline's ID.
|
|
|
|
```
|
|
GET _ingest/pipeline/{id}/_simulate
|
|
POST _ingest/pipeline/{id}/_simulate
|
|
```
|
|
|
|
## URL parameters
|
|
|
|
All URL parameters are optional.
|
|
|
|
Parameter | Type | Description
|
|
:--- | :--- | :---
|
|
verbose | boolean | Verbose mode. Display data output for each processor in executed pipeline.
|
|
|
|
## Request body fields
|
|
|
|
Field | Required | Type | Description
|
|
:--- | :--- | :--- | :---
|
|
`pipeline` | Optional | object | The pipeline you want to simulate. When included without the pipeline `{id}` inside the request path, the response simulates the last pipeline created.
|
|
`docs` | Required | array of objects | The documents you want to use to test the pipeline.
|
|
|
|
The `docs` field can include the following subfields:
|
|
|
|
Field | Required | Type | Description
|
|
:--- | :--- | :---
|
|
`id` | Optional |string | An optional identifier for the document. The identifier cannot be used elsewhere in the index.
|
|
`index` | Optional | string | The index where the document's transformed data appears.
|
|
`source` | Required | object | The document's JSON body.
|
|
|
|
## Response
|
|
|
|
Responses vary based on which path and HTTP method you choose.
|
|
|
|
### Specify pipeline in request body
|
|
|
|
```json
|
|
{
|
|
"docs" : [
|
|
{
|
|
"doc" : {
|
|
"_index" : "index",
|
|
"_id" : "id",
|
|
"_source" : {
|
|
"location" : "new-new",
|
|
"field2" : "_value"
|
|
},
|
|
"_ingest" : {
|
|
"timestamp" : "2022-02-07T18:47:57.479230835Z"
|
|
}
|
|
}
|
|
},
|
|
{
|
|
"doc" : {
|
|
"_index" : "index",
|
|
"_id" : "id",
|
|
"_source" : {
|
|
"location" : "new-new",
|
|
"field2" : "_value"
|
|
},
|
|
"_ingest" : {
|
|
"timestamp" : "2022-02-07T18:47:57.47933496Z"
|
|
}
|
|
}
|
|
}
|
|
]
|
|
}
|
|
```
|
|
|
|
### Specify pipeline ID inside HTTP path
|
|
|
|
```json
|
|
{
|
|
"docs" : [
|
|
{
|
|
"doc" : {
|
|
"_index" : "index",
|
|
"_id" : "id",
|
|
"_source" : {
|
|
"field-name" : "value",
|
|
"location" : "document-name"
|
|
},
|
|
"_ingest" : {
|
|
"timestamp" : "2022-02-03T21:47:05.382744877Z"
|
|
}
|
|
}
|
|
},
|
|
{
|
|
"doc" : {
|
|
"_index" : "index",
|
|
"_id" : "id",
|
|
"_source" : {
|
|
"field-name" : "value",
|
|
"location" : "document-name"
|
|
},
|
|
"_ingest" : {
|
|
"timestamp" : "2022-02-03T21:47:05.382803544Z"
|
|
}
|
|
}
|
|
}
|
|
]
|
|
}
|
|
```
|
|
|
|
### Receive verbose response
|
|
|
|
With the `verbose` parameter set to `true`, the response shows how each processor transforms the specified document.
|
|
|
|
```json
|
|
{
|
|
"docs" : [
|
|
{
|
|
"processor_results" : [
|
|
{
|
|
"processor_type" : "set",
|
|
"status" : "success",
|
|
"doc" : {
|
|
"_index" : "index",
|
|
"_id" : "id",
|
|
"_source" : {
|
|
"field-name" : "value",
|
|
"location" : "document-name"
|
|
},
|
|
"_ingest" : {
|
|
"pipeline" : "35678",
|
|
"timestamp" : "2022-02-03T21:45:09.414049004Z"
|
|
}
|
|
}
|
|
}
|
|
]
|
|
},
|
|
{
|
|
"processor_results" : [
|
|
{
|
|
"processor_type" : "set",
|
|
"status" : "success",
|
|
"doc" : {
|
|
"_index" : "index",
|
|
"_id" : "id",
|
|
"_source" : {
|
|
"field-name" : "value",
|
|
"location" : "document-name"
|
|
},
|
|
"_ingest" : {
|
|
"pipeline" : "35678",
|
|
"timestamp" : "2022-02-03T21:45:09.414093212Z"
|
|
}
|
|
}
|
|
}
|
|
]
|
|
}
|
|
]
|
|
}
|
|
``` |