Add prometheus install and scrape config

[shinta-liem]

Adding a script to deploy Prometheus to k8s cluster.

To test run:

./monitoring_install.sh

Port forward Prometheus console to your host:

kubectl --namespace=monitoring port-forward deploy/prometheus-server 9090

Create ssh tunnel from bastion host to your local machine to access prometheus console from browser:

ssh -N -L 9090:localhost:9090 -i .ssh/helper_test.pem -l ec2-user 34.220.109.13

Go to http://localhost:9090/targets on browser. The helper nodes should be listed in the target for scraping metrics.

[cberkhoff]

Why not just have the monitoring namespace, prometheus charts and basically everything from the install just straight up in the templates? I see monitoring as an integral part of this infrastructure and would like it to be included on every helm installation if possible.

[cberkhoff]

Maybe we need to talk this out... but what I was expecting was for the script to disappear, and the changes just be templates.