openstack/monasca-persister
Code Issues Proposed changes
Monasca Database Persister
436 Commits 4 Branches 85 Tags 5.7 MiB
Java 49.4%
Python 45%
Shell 3.9%
Jinja 1.1%
Dockerfile 0.6%
5d082a9178
Go to file
Witek Bedyk 5d082a9178 Fix default alarm_state_history_driver value 
Change-Id: Id85bb6d2ab85048e38d8fd427829a7b61136d9aa
Story: 2004943
Task: 29344
2019-02-05 13:07:55 +01:00
common Make legacy java gate working 2017-10-19 04:09:07 +00:00
config-generator Use oslo-config-generator 2017-07-28 13:48:01 +02:00
docker Add tooling for building Docker image 2018-08-01 11:01:10 +02:00
etc/monasca Turn logging down from DEBUG in persister-logging.conf 2018-09-28 16:26:36 -07:00
java Disable ClassPathURLCheck for Java build 2018-11-06 14:43:01 +01:00
monasca_persister Fix default alarm_state_history_driver value 2019-02-05 13:07:55 +01:00
perf fix misspelling of "because" 2018-05-03 09:32:05 +08:00
.gitignore Add performance testing in Monasca persister 2018-02-12 09:53:13 +00:00
.gitreview Update .gitreview for new namespace 2015-10-17 22:30:59 +00:00
.stestr.conf Add .stestr.conf . 2017-09-22 14:13:18 +02:00
.testr.conf Add persister.py unit tests 2017-01-12 09:18:29 +00:00
.zuul.yaml Add tempest tests jobs 2019-01-31 19:12:51 +01:00
bindep.txt Add bindep.txt 2017-04-12 18:10:55 +02:00
LICENSE Added copyright header and LICENSE file. 2014-05-01 12:45:08 -06:00
lower-constraints.txt Merge "Clean up lower-constraints.txt" 2018-09-05 12:39:22 +00:00
pom.xml Upper pom version to 1.3.0 2017-12-19 13:11:41 -08:00
README.rst Convert README.md to ReStructuredTest format 2018-06-21 09:38:07 +02:00
requirements.txt Updated from global requirements 2018-03-14 05:38:23 +00:00
run_maven.sh Ensure the same branch is used for common build 2016-02-10 15:30:38 -07:00
setup.cfg Change openstack-dev to openstack-discuss 2018-12-05 01:34:18 +08:00
setup.py Updated from global requirements 2017-03-13 19:34:04 +00:00
test-requirements.txt Add check for README.rst syntax 2018-08-06 17:17:23 +02:00
tox.ini Merge "Remove setup.py check from pep8 job" 2018-11-20 09:07:18 +00:00

README.rst

Team and repository tags

image

monasca-persister

The Monitoring Persister consumes metrics and alarm state transitions from the Message Queue and stores them in the Metrics and Alarms database.

Although the Persister isn’t primarily a Web service it uses DropWizard, https://dropwizard.github.io/dropwizard/, which provides a nice Web application framework to expose an http endpoint that provides an interface through which metrics about the Persister can be queried as well as health status.

The basic design of the Persister is to have one Kafka consumer publish to a Disruptor, https://github.com/LMAX-Exchange/disruptor, that has output processors. The output processors use prepared batch statements to write to the Metrics and Alarms database.

The number of output processors/threads in the Persister can be specified to scale to more messages. To horizontally scale and provide fault-tolerance any number of Persisters can be started as consumers from the Message Queue.

Build

Requires monasca-common from https://github.com/openstack/monasca-common. Download and build following instructions in its README.md. Then build monasca-persister by:

mvn clean package

Configuration

A sample configuration file is available in java/src/deb/etc/persister-config.yml-sample.

A second configuration file is provided in java/src/main/resources/persister-config.yml for use with the vagrant “mini-mon” development environment.

TODO

  • Purge metrics on shutdown
  • Add more robust offset management in Kafka. Currently, the offset is advanced as each message is read. If the Persister stops after the metric has been read and prior to it being committed to the Metrics and Alarms database, the metric will be lost.
  • Add better handling of SQL exceptions.
  • Complete health check.
  • Specify and document the names of the metrics that are available for monitoring of the Persister.
  • Document the yaml configuration parameters.

License

Copyright (c) 2014 Hewlett-Packard Development Company, L.P.

Licensed under the Apache License, Version 2.0 (the “License”); you may not use this file except in compliance with the License. You may obtain a copy of the License at

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an “AS IS” BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

Python

To install the Python monasca-persister modules, git clone the source and run the following command:

$ sudo python setup.py install

To run the unit tests use:

$ tox -e py27,py35