9114e135b6
Addresses: BP decoupled-source-sink-discoverable-resources
Add support for a new decoupled model of pipeline config
which does not conflate the elements specific to sources
and sinks.
Instead of the basic unit of config being a consolidated
pipeline, the sources and sinks may now be specified as
separate lists of dictionaries, before being linked together
once parsed.
This allows source-specific configuration, such as resource
discovery, to be kept focused only on the fine-grained source
while avoiding the necessity for wide duplication of sink-
related config.
The shape of the new config format is best illustrated with
an example:
---
sources:
- name: meter_source
interval: 600
meters:
- "*"
sinks:
- meter_sink
- name: host_cpu_source
interval: 120
meters:
- "cpu.util.*min"
resources:
- "snmp://ip1"
- "snmp://ip2"
- "snmp://ip3"
sinks:
- meter_sink
- lossy_sink
- name: instance_cpu_source
interval: 60
meters:
- "cpu"
sinks:
- cpu_sink
sinks:
- name: meter_sink
transformers:
publishers:
- rpc://
- name: lossy_sink
transformers:
publishers:
- udp://addr
- name: cpu_sink
transformers:
- name: "rate_of_change"
parameters:
target:
name: "cpu_util"
unit: "%"
type: "gauge"
scale: "100.0 / (10**9 * (resource_metadata.cpu_number or 1))"
publishers:
- rpc://
The old pipeline.yaml format continues to be supported as
a deprecated feature to avoid breaking existing deployments.
The semantics of the common individual configuration elements
are identical in the deprecated and decoupled versions.
Change-Id: Ide86c0feba88ae736f2a913b5faa95e640c4ceaf
79 lines
2.3 KiB
Python
79 lines
2.3 KiB
Python
# -*- encoding: utf-8 -*-
|
|
#
|
|
# Copyright © 2012 New Dream Network, LLC (DreamHost)
|
|
#
|
|
# Author: Doug Hellmann <doug.hellmann@dreamhost.com>
|
|
# Angus Salkeld <asalkeld@redhat.com>
|
|
#
|
|
# Licensed under the Apache License, Version 2.0 (the "License"); you may
|
|
# not use this file except in compliance with the License. You may obtain
|
|
# a copy of the License at
|
|
#
|
|
# http://www.apache.org/licenses/LICENSE-2.0
|
|
#
|
|
# Unless required by applicable law or agreed to in writing, software
|
|
# distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
|
|
# WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
|
|
# License for the specific language governing permissions and limitations
|
|
# under the License.
|
|
|
|
import threading
|
|
|
|
from oslo.config import cfg
|
|
from pecan import hooks
|
|
|
|
from ceilometer import pipeline
|
|
|
|
|
|
class ConfigHook(hooks.PecanHook):
|
|
"""Attach the configuration object to the request
|
|
so controllers can get to it.
|
|
"""
|
|
|
|
def before(self, state):
|
|
state.request.cfg = cfg.CONF
|
|
|
|
|
|
class DBHook(hooks.PecanHook):
|
|
|
|
def __init__(self, storage_connection):
|
|
self.storage_connection = storage_connection
|
|
|
|
def before(self, state):
|
|
state.request.storage_conn = self.storage_connection
|
|
|
|
|
|
class PipelineHook(hooks.PecanHook):
|
|
'''Create and attach a pipeline to the request so that
|
|
new samples can be posted via the /v2/meters/ API.
|
|
'''
|
|
|
|
pipeline_manager = None
|
|
|
|
def __init__(self):
|
|
if self.__class__.pipeline_manager is None:
|
|
# this is done here as the cfg options are not available
|
|
# when the file is imported.
|
|
self.__class__.pipeline_manager = pipeline.setup_pipeline()
|
|
|
|
def before(self, state):
|
|
state.request.pipeline_manager = self.pipeline_manager
|
|
|
|
|
|
class TranslationHook(hooks.PecanHook):
|
|
|
|
def __init__(self):
|
|
# Use thread local storage to make this thread safe in situations
|
|
# where one pecan instance is being used to serve multiple request
|
|
# threads.
|
|
self.local_error = threading.local()
|
|
self.local_error.translatable_error = None
|
|
|
|
def before(self, state):
|
|
self.local_error.translatable_error = None
|
|
|
|
def after(self, state):
|
|
if hasattr(state.response, 'translatable_error'):
|
|
self.local_error.translatable_error = (
|
|
state.response.translatable_error)
|