What tools do you use to manage application logs and how do you handle log management at scale

0 votes
What tools do you use to manage application logs, and how do you handle log management at scale?

Centralized logging at scale: As the volume increases, managing logs at scale is done by collecting, storing, and analyzing massive datasets. Explain your use of centralised logging tools such as ELK Stack, Splunk, or DataDog, and strategies for dealing with data retention, indexing, and searching to make logs accessible and manageable as the volume grows. Also include practices like log rotation and archiving for efficient storage.
Nov 3 in DevOps Tools by Anila
• 3,390 points
52 views

1 answer to this question.

0 votes

Centralization of Application Logs: Centralize application logs by aggregating them across environments on platforms like ELK Stack (Elasticsearch, Logstash, Kibana), Splunk, or Fluentd. All these tools support full-text search, visualization, and real-time monitoring to simplify the analysis and troubleshooting at scale.
Scaling Log Management: On very large environments, I force rotation policies and retention limits for controlling the cost of storage. Logs are archived with low cost in S3 Glacier (or other cold storage) while recent ones stay on fast-access storage. In Kubernetes, Grafana Loki is used for logging. It pairs really well with Prometheus to scale efficiently log aggregation since they index logs by labels instead of content, which cuts the cost of storage and retrieval time.

answered Nov 12 by Gagana
• 2,450 points

Related Questions In DevOps Tools

0 votes
1 answer

How do you test infrastructure as code, and what frameworks or tools do you use for this purpose?

Testing Infrastructure as Code: Provisioning the infrastructure correctly ...READ MORE

answered Oct 24 in DevOps Tools by Gagana
• 2,450 points
123 views
0 votes
1 answer

How do you integrate automated testing into your deployment pipeline, and what tools do you use for this?

Automate tests into a deployment pipeline  1.Add Tests ...READ MORE

answered Oct 23 in DevOps Tools by Gagana
• 2,450 points
90 views
0 votes
1 answer

What tools do you use for container security, and how do you integrate them into your DevOps pipeline?

Securing Containers: Tools and the integration with ...READ MORE

answered Nov 4 in DevOps Tools by Gagana
• 2,450 points
69 views
0 votes
1 answer

How do you manage environment variables in your DevOps processes, and what coding techniques have you found effective?

In DevOps processes, maintain environment variables that ...READ MORE

answered Oct 16 in DevOps Tools by Gagana
• 2,450 points

edited Oct 18 by Hoor 90 views
+5 votes
7 answers

Docker swarm vs kubernetes

Swarm is easy handling while kn8 is ...READ MORE

answered Aug 27, 2018 in Docker by Mahesh Ajmeria
3,925 views
+15 votes
2 answers

Git management technique when there are multiple customers and need multiple customization?

Consider this - In 'extended' Git-Flow, (Git-Multi-Flow, ...READ MORE

answered Mar 27, 2018 in DevOps & Agile by DragonLord999
• 8,450 points
4,034 views
0 votes
1 answer
0 votes
1 answer

What are your favorite command-line tools for DevOps, and how do you use them in your daily workflows?

No DevOps working environment is possible without ...READ MORE

answered Oct 23 in DevOps Tools by Gagana
• 2,450 points
103 views
webinar REGISTER FOR FREE WEBINAR X
REGISTER NOW
webinar_success Thank you for registering Join Edureka Meetup community for 100+ Free Webinars each month JOIN MEETUP GROUP