Once we’ve set up the data sending from out ethOS machine, we can check that ElasticSearch collects data. With GET /ethos/_count, we get something like:
If the count is greather than 0, we can start analysing the data. Metrics I am currently measuring only machine. Therefore, I’ve set up some simple measurements: Hash rate […]
This second post in the series provides a starting point for visualising the log data. It makes some assumptions that logs are collected in a way described by the first part, so I would suggest to read through it if you haven’t already. Verify First, make sure you have some data logged in: You should […]
Following my attempts to monitor ethOS data via ElasticSearch and Kibana, I’ve thought it would be a good idea to start monitoring the logs produced by my various docker instances. This first part deals with configuring ELK and logspout. Prerequisites I assume the following: ELK is installed. You can do it either as a set […]
Following the previous post, we are now in position to install the monitoring code on the monitoried machine, of course. The easiest way is to download the code on the machine in /home/ethos. Following steps will assume you have the unpacked code in
Once you have downloaded the code, you need to add the […]
The other day I’ve been trying to improve the downtime when updating an index in elasticsearch (ES) and I’ve decided the best approach would be to create a new index and do a symlink to the active one, keeping the valid index. so, my structure would be:
4 drwxrwxrwx 4 nagios ssh 4096 Nov 8 11:21 .
4 drwxrwxrwx 4 nagios ssh 4096 Nov 9 10:17 ..
4 drwxr-xr-x 8 nagios ssh 4096 Oct 20 14:03 myindex_default
0 lrwxrwxrwx 1 nagios ssh 1 Nov 9 11:30 myindex -> myindex_000
4 lrwxrwxrwx 8 nagios ssh 4096 Nov 6 10:55 myindex_000
4 lrwxrwxrwx 8 nagios ssh 4096 Nov 8 10:55 myindex_001
Note: this is likely not a best […]
The other day I found a file with a peculiar format and I needed to find it again. There are two problems I’ve encountered: Size: It’s one of 20,000,000 XML files Search: I need to find a file containing a string “xocs:doi”, which is not interpreted as a single word (due to the colon character, […]