Build tool
Building and dependency management
Building all submodules, dependency management and artifact generation is done with help of gradle.
Gradle tasks
Main tasks is held in “build_scripts/build-tasks.gradle”.
Submodule release
Main steps:
- Check all tests
- Check for SNAPSHOT dependencies
- Check “gradle.properties” for all params.
- Commit all changes to remote git-repo in master
- Check all stored credential in submodule dir (call
git config credential.helper store
in submodule dir) - Call
gradle release
(from “build_scripts/build-tasks.gradle”) - After successful invocation - set SNAPSHOT in “gradle.properties”
Dependencies
All dependencies specified in “build_scripts/dependencies.gradle”.
Table of content:
- Home
- Prerequisites
- Developement stand provisioning
- Components
- Crawler (Spring Boot, Java)
- Message Broker (Kafka)
- Distributed file storage (Hadoop’s HDFS)
- Data warehouse (Apache Hive)
- Distributed business logic cluster (Akka, Scala)
- Distributed data processing cluster (Spark, Scala)
- Indexing/Search engine (Elasticsearch)
- REST server (Lagom, Scala)
- Service coordination (Zookeeper)
- Time-series database (monitoring data) (InfluxDB)
- Metrics collector (Telegraf)
- Monitoring visualization service (Grafana)
- Reverse proxy/load-balancer (nginx)
- Monitoring Links
- Development