Prompt Title: Set up ELK stack

To monitor Nginx logs using the ELK stack set up with Helm, you can follow these steps:

1. Add Nginx logs to Logstash: In order to monitor Nginx logs, you need to configure Logstash to read the Nginx access logs. This can be done by adding a new input in the Logstash configuration file (logstash.yaml) as follows:

javascriptCopy code
input {
  beats {
    port => 5044
  }
  file {
    path => "/var/log/nginx/access.log"
    start_position => "beginning"
  }
}

This will tell Logstash to read the Nginx access logs from the file /var/log/nginx/access.log and send them to Elasticsearch via the Beats input.

2. Update Logstash deployment: Once you have added the input for Nginx logs, you need to update the Logstash deployment to use the updated configuration. This can be done by running the following command:

bashCopy code
helm upgrade logstash elastic/logstash -f logstash.yaml

where logstash.yaml is the name of the Logstash configuration file you just created.

3. Create Kibana index pattern: After Logstash has started processing Nginx logs, you need to create a Kibana index pattern to visualize the data. To do this, go to the Kibana web interface and click on the "Management" tab. Then, click on "Index Patterns" and create a new index pattern for the Nginx logs. For example, you can use the following pattern:

Copy code
logstash-nginx-*

This will match all indices with the prefix logstash-nginx-.

4. Visualize Nginx logs in Kibana: Once you have created the index pattern, you can start visualizing the Nginx logs in Kibana. For example, you can create a new visualization to show the top Nginx response codes or the top Nginx URLs. You can also create a dashboard to show multiple visualizations at once.

That's it! You have now set up monitoring of Nginx logs using the ELK stack deployed with Helm.