Enrich and transform data in ElasticSearch using Ingest Nodes

transformElastic

You can send or ingest all sorts of data in ElasticSearch and here and there you might have the need to enrich or transform certain data. ElasticSearch has some nice features for this. They are called ‘Ingest Nodes’: Ingest Nodes are a new type of Elasticsearch node you can use to perform common data transformation and enrichments. The Ingest Node has multiple built-in processors, for example grok, date, gsub, lowercase/uppercase, Continue ReadingEnrich and transform data in ElasticSearch using Ingest Nodes

Setup a watcher in Kibana to send email notifications

KibanaWatcher

In this blog I showed how you can hook up you SOA Suite stack to ElasticSearch and create dasboards to monitor and report. Another nice feature is that you can set a watcher to monitor the data for you and send emails or post something on Slack when the event occurs. For example I want to be notified by email when more then 25 errors occur in a minute. Lets Continue ReadingSetup a watcher in Kibana to send email notifications

Monitor and analyse SOA Suite data using ElasticSearch and Kibana

SoaSuiteElasticSearchKibana

In this article I am going to create a light-weigh dasboard build on ElasticSearch and Kibana which can monitor and analyse SOA Suite data. It is fast and easy to create. It is also extendible if you would like to do more analysis (Apache Spark), transform data before storing it (Logstash) or get data from other sources (Beats) and so on. In this example I will setup a SOA Suite Continue ReadingMonitor and analyse SOA Suite data using ElasticSearch and Kibana