Tag: elk

Monitoring sendgrid with Elasticsearch

If you are using sendgrid as a service for your outbound email, you would want to monitor and be able to answer questions such as: how much email are you sending status of sent email – success, bounced, delayed, etc. trends etc. We get questions all the time from $WORK customer support folks on whether…

continue reading
No Comments

Elasticsearch util to copy/reindex index(es)

Elasticsearch (and the entire ELK stack) is pretty useful open source piece of software for analyzing large datasets.   I manage a fairly large ELK infrastructure at work — around 90+ ES clusters, 300+ TB of data.   One of things I’ve found myself having to do is copying and/or reindexing one or more index(es).…

continue reading
No Comments

Monitoring Postfix and Dovecot logs in ELK

I’ve been using pflogsumm for the longest time to monitor my postfix logs.   When I used to manage hundreds of domains and many more mailing lists, it was important to keep an eye on my mail servers. These days, it is just my own personal mail server for my dozens of domains.   I…

continue reading
9 Comments

ELK Operational Tips

I’ve been running ELK clusters for over a year now, and want to share tips and tricks that I’ve found to be useful. Feel free to post questions and corrections. I’ll try to answer and update when possible. Elasticsearch Split brained – this is when you have more than one node in your cluster becoming…

continue reading
No Comments

adding CORS support to elasticsearch-head plugin

There are two vulnerabilities in Elasticsearch that I recently patched in my installations. One is the ‘script’ vuln, mentioned here. Fix by adding script.disable_dynamic: true to your Elasticsearch.yml config file. The other one has to do with CORS, which exposes data via REST endpoints. Fix by adding http.cors.allow-origin: “http://your.FQDN.domain.name” to your Elasticsearch.yml config file. In…

continue reading
No Comments

Elasticsearch, Logstash and Kibana Meetup @ LinkedIn

We had a great ELK Meetup on Wed 5/21/2014 at LinkedIn.  The recorded video is available here. http://www.ustream.tv/recorded/47864947 We had Kurt Hurtado, one of the logstash dev, speaking on ELK in the DevOps Environment.  Then a nice long Q&A session after, joined by Uri Boness, one of the Elasticsearch core dev.  

continue reading
No Comments
%d bloggers like this: