Description: InfluxDB is time-series database intended for metric storage and fast querying of it.

Provision script (Puppet manifest): influxdb.pp

Additional info: InfluxDB site

The most opaque thing in IT it’s distributed system - you will not see what happens under hood until it’s too late. Of course if you don’t use some kind of monitoring and alarms - and I do…

So I have been using InfluxDB in project from the beginning. It keeps records during a month and it’s enough to monitor current state and make some investigations. With help of InfluxDB + Grafana I can easily watch what influence I made with my modifications on whole system.

---

Table of content:

• Home
• Prerequisites
• Developement stand provisioning
• Components
  • Crawler (Spring Boot, Java)
  • Message Broker (Kafka)
  • Distributed file storage (Hadoop’s HDFS)
  • Data warehouse (Apache Hive)
  • Distributed business logic cluster (Akka, Scala)
  • Distributed data processing cluster (Spark, Scala)
  • Indexing/Search engine (Elasticsearch)
  • REST server (Lagom, Scala)
  • Service coordination (Zookeeper)
  • Time-series database (monitoring data) (InfluxDB)
  • Metrics collector (Telegraf)
  • Monitoring visualization service (Grafana)
  • Reverse proxy/load-balancer (nginx)
• Monitoring Links
• Development
  • Build Tool
  • Provisioning (DevOps specific)
  • Configuration
  • Continuous Integration, Continuous Deployment
  • Implementation design
  • Logging
  • Metrics
  • Used ports
  • Adding new server