Configure ELK

In this section you will create the integration with ELK.

🚀 TASK: Create the ELK Integration

🌏 Documentation for the Task: Creating ELK connections

Create the ELK Integration with the following parameters:

ELK service URL:        from MY_CONFIGURATION.txt
Kibana URL:             from MY_CONFIGURATION.txt
Authentication type:        Token
Token:              from MY_CONFIGURATION.txt

Filter:
{
 "query": {
  "bool": {

🔎 The parameters can also be found in your configuration file MY_CONFIGURATION.txt - section 2.2 Configure ELK

💡 Solution?

In the CP4AIOPS “Hamburger” Menu select Define/Data and tool connections
Click Add connection
Under ELK, click on Add connection
Click Connect
Name it ELK

🔎 Get the data from your configuration file MY_CONFIGURATION.txt - section 2.2 Configure ELK

./tools/11_practicum/get_configuration_info.sh > MY_CONFIGURATION.txt

Fill out the fields on the first page:

ELK service URL:        from MY_CONFIGURATION.txt
Kibana URL:             from MY_CONFIGURATION.txt
Authentication type:        Token
Token:              from MY_CONFIGURATION.txt

Filter:
    {
    "query": {
        "bool": {

Click Test connection. You should get Connection successful!
Click Next

Fill out the Field mapping:

{ 
"codec": "elk",
"message_field": "message",
"log_entity_types": "kubernetes.container_image_id, kubernetes.host, kubernetes.pod_name, kubernetes.namespace_name",
"instance_id_field": "kubernetes.container_name",
"rolling_time": 10,
"timestamp_field": "@timestamp"
}

Click Next
Turn On Data collection
Select Live data for continuous AI training and anomaly detection
Click Done
Make sure that the Data Collection and Connection Status turn green after a few minutes

Edit this page on GitHub

Page last updated: 03 November 2022

Configure CP4AIOPS: Configure LDAP

Configure CP4AIOPS: Configure Runbooks