How to use the field returned by sql for logstash if statement
Sql statement
statement => "select ref_id,index_name,type,content from t_backup_es_data where backup_id >= :sql_last_value"
The value of the returned type column has a proposal and quotation
if[%type] == "quotation"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/quotationMapping.json"
else if[%type] == "proposal"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/proposalMapping.json"
This configuration does not working, what advice do you have?
elasticsearch logstash logstash-configuration logstash-jdbc asked Nov 12 at 13:14
Jacky0312
233
add a comment |
Sql statement
statement => "select ref_id,index_name,type,content from t_backup_es_data where backup_id >= :sql_last_value"
The value of the returned type column has a proposal and quotation
if[%type] == "quotation"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/quotationMapping.json"
else if[%type] == "proposal"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/proposalMapping.json"
This configuration does not working, what advice do you have?
elasticsearch logstash logstash-configuration logstash-jdbc asked Nov 12 at 13:14
Jacky0312
233
In my opinion, the separated Logstash instance will be better but also there is an answer to similar question stackoverflow.com/a/33820688/721600
– hkulekci
Nov 12 at 13:22
@hkulekci Thank you for your reply. the link does not same as my question. I want to use a column value returned by the database as a condition for the if statement.
– Jacky0312
Nov 12 at 13:33
add a comment |
Sql statement
statement => "select ref_id,index_name,type,content from t_backup_es_data where backup_id >= :sql_last_value"
The value of the returned type column has a proposal and quotation
if[%type] == "quotation"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/quotationMapping.json"
else if[%type] == "proposal"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/proposalMapping.json"
This configuration does not working, what advice do you have?
elasticsearch logstash logstash-configuration logstash-jdbc asked Nov 12 at 13:14
Jacky0312
233
Sql statement
statement => "select ref_id,index_name,type,content from t_backup_es_data where backup_id >= :sql_last_value"
The value of the returned type column has a proposal and quotation
if[%type] == "quotation"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/quotationMapping.json"
else if[%type] == "proposal"
elasticsearch
hosts => "localhost:9200"
index => "%index_name"
document_type => "%type"
document_id => "%ref_id"
manage_template => true
template_overwrite => true
template => "../config/proposalMapping.json"
This configuration does not working, what advice do you have?
elasticsearch logstash logstash-configuration logstash-jdbc elasticsearch logstash logstash-configuration logstash-jdbc asked Nov 12 at 13:14
Jacky0312
233
asked Nov 12 at 13:14
Jacky0312
233
asked Nov 12 at 13:14
Jacky0312
233
asked Nov 12 at 13:14
Jacky0312
233
asked Nov 12 at 13:14
Jacky0312
233
233
In my opinion, the separated Logstash instance will be better but also there is an answer to similar question stackoverflow.com/a/33820688/721600
– hkulekci
Nov 12 at 13:22
@hkulekci Thank you for your reply. the link does not same as my question. I want to use a column value returned by the database as a condition for the if statement.
– Jacky0312
Nov 12 at 13:33
add a comment |
In my opinion, the separated Logstash instance will be better but also there is an answer to similar question stackoverflow.com/a/33820688/721600
– hkulekci
Nov 12 at 13:22
@hkulekci Thank you for your reply. the link does not same as my question. I want to use a column value returned by the database as a condition for the if statement.
– Jacky0312
Nov 12 at 13:33
In my opinion, the separated Logstash instance will be better but also there is an answer to similar question stackoverflow.com/a/33820688/721600
– hkulekci
Nov 12 at 13:22
In my opinion, the separated Logstash instance will be better but also there is an answer to similar question stackoverflow.com/a/33820688/721600
– hkulekci
Nov 12 at 13:22
@hkulekci Thank you for your reply. the link does not same as my question. I want to use a column value returned by the database as a condition for the if statement.
– Jacky0312
Nov 12 at 13:33
@hkulekci Thank you for your reply. the link does not same as my question. I want to use a column value returned by the database as a condition for the if statement.
– Jacky0312
Nov 12 at 13:33
add a comment |
1 Answer
1
active
oldest
votes
Assuming you're using the JDBC input plugin, the doc states:
Columns in the resultset are converted into fields in the event
I'd start with a stdout output and see what you have. The ELK stack has used 'type' as an internal field in the past, so it might be as simple as renaming the column in your query.
answered Nov 27 at 21:39
Alain Collins
13.5k12147
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53262959%2fhow-to-use-the-field-returned-by-sql-for-logstash-if-statement%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Assuming you're using the JDBC input plugin, the doc states:
Columns in the resultset are converted into fields in the event
I'd start with a stdout output and see what you have. The ELK stack has used 'type' as an internal field in the past, so it might be as simple as renaming the column in your query.
answered Nov 27 at 21:39
Alain Collins
13.5k12147
add a comment |
Assuming you're using the JDBC input plugin, the doc states:
Columns in the resultset are converted into fields in the event
I'd start with a stdout output and see what you have. The ELK stack has used 'type' as an internal field in the past, so it might be as simple as renaming the column in your query.
answered Nov 27 at 21:39
Alain Collins
13.5k12147
add a comment |
Assuming you're using the JDBC input plugin, the doc states:
Columns in the resultset are converted into fields in the event
I'd start with a stdout output and see what you have. The ELK stack has used 'type' as an internal field in the past, so it might be as simple as renaming the column in your query.
answered Nov 27 at 21:39
Alain Collins
13.5k12147
Assuming you're using the JDBC input plugin, the doc states:
Columns in the resultset are converted into fields in the event
I'd start with a stdout output and see what you have. The ELK stack has used 'type' as an internal field in the past, so it might be as simple as renaming the column in your query.
answered Nov 27 at 21:39
Alain Collins
13.5k12147
answered Nov 27 at 21:39
Alain Collins
13.5k12147
answered Nov 27 at 21:39
Alain Collins
13.5k12147
answered Nov 27 at 21:39
Alain Collins
13.5k12147
13.5k12147
add a comment |
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53262959%2fhow-to-use-the-field-returned-by-sql-for-logstash-if-statement%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
In my opinion, the separated Logstash instance will be better but also there is an answer to similar question stackoverflow.com/a/33820688/721600
– hkulekci
Nov 12 at 13:22
@hkulekci Thank you for your reply. the link does not same as my question. I want to use a column value returned by the database as a condition for the if statement.
– Jacky0312
Nov 12 at 13:33