Running AWS ES Open Distro locally

Image for post
Image for post

AWS Open Distro for ES is an open source distribution from Amazon for ElasticSearch cluster and Kibana. Today I will show a simple script I made in order to run ES/Kibana locally without pain. You will be able to run the solution without worrying about any configuration. You need to keep in mind this is a developer sandbox script, this is not production ready ES cluster config. AWS ES Open Distro is enterprise-grade because it has advanced capabilities like SQL, Alerting and cluster diagnostics, I like the cluster tools a lot.

The Script

The script uses docker and link 2 containers(es and kibana). The script also creates an index in ES called Twitter having 3 documents getting indexed with the following props: user, post_data and message. The script copy a custom kibana.yml file into kibana container in order to pass proper docker DNS / Container link to ES container — by default config looks up to localhost and I have to change to es DNS(same name used on docker link).

Checking ES and Kibana

ES: https://localhost:9200/_all
Kibana:
http://localhost:5601/app/kibana

ES (_all)

Image for post
Image for post

Kibana

Image for post
Image for post

Perf Tool Node Analysis

Image for post
Image for post

Cluster Thread Analysis

Image for post
Image for post

Cluster Network Analysis

Image for post
Image for post

Cluster Overview

Image for post
Image for post

When you are done you can simply do:

docker kill es kibana

Cheers,

Diego Pacheco

Originally published at diego-pacheco.blogspot.com.

Written by

Brazilian, Software Architect, SWE(Java, Scala, Rust, Go) SOA & DevOps expert, Author. Working with EKS/K8S. diegopacheco.github.io (Opinions on my own)

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store