Vertica configuration groups
Configuration groups support for single-instance vertica Change-Id: I325d46572645cccf2d46fcbd3a134515f198c91a
This commit is contained in:
Alex Tomic
parent
f200cf24df
commit
d1a6313079
423
specs/mitaka/vertica-configuration-groups.rst
Normal file
423
specs/mitaka/vertica-configuration-groups.rst
Normal file
@ -0,0 +1,423 @@
|
|||||||
|
..
|
||||||
|
This work is licensed under a Creative Commons Attribution 3.0 Unported
|
||||||
|
License.
|
||||||
|
|
||||||
|
http://creativecommons.org/licenses/by/3.0/legalcode
|
||||||
|
|
||||||
|
Sections of this template were taken directly from the Nova spec template at:
|
||||||
|
https://github.com/openstack/nova-specs/blob/master/specs/template.rst
|
||||||
|
|
||||||
|
============================
|
||||||
|
Vertica Configuration Groups
|
||||||
|
============================
|
||||||
|
|
||||||
|
Launchpad Blueprint:
|
||||||
|
https://blueprints.launchpad.net/trove/+spec/vertica-configuration-groups
|
||||||
|
|
||||||
|
Problem Description
|
||||||
|
===================
|
||||||
|
|
||||||
|
The Vertica guestagent currently does not support configuration groups for the
|
||||||
|
single instance case.
|
||||||
|
|
||||||
|
Proposed Change
|
||||||
|
===============
|
||||||
|
|
||||||
|
While Vertica has minimal required configuration as one of its design goals, it
|
||||||
|
is nonetheless possible to configure a large number of parameters [1]_.
|
||||||
|
|
||||||
|
Databases in Trove and Vertica
|
||||||
|
------------------------------
|
||||||
|
|
||||||
|
While Trove thinks of instances as being the parent of one or more databases,
|
||||||
|
following the model of single-server MySQL, Vertica supports one or more nodes
|
||||||
|
natively, and databases can span multiple nodes. Configuration options can
|
||||||
|
also be applied at both the node and database level.
|
||||||
|
|
||||||
|
The Vertica guest agent currently does not support multiple Vertica databases
|
||||||
|
for both the single instance and clustered cases, so only configuration
|
||||||
|
options valid at the database level will be exposed.
|
||||||
|
|
||||||
|
Configuration Changes
|
||||||
|
---------------------
|
||||||
|
|
||||||
|
Vertica recommends against writing configuration changes to a configuration
|
||||||
|
file for version 7.1. It is unclear if this applies to 7.2, or has been
|
||||||
|
remedied, but for the purposes of providing support for both 7.1 and 7.2,
|
||||||
|
writing to this file will be avoided [3]_. Configurations can be applied with
|
||||||
|
the use of the ALTER DATABASE command, and current configuration settings can
|
||||||
|
be retrieved via the CONFIGURATION_PARAMETERS system view [2]_.
|
||||||
|
|
||||||
|
Vertica supports 360 different options as of Vertica 7.2.1. Options related to
|
||||||
|
authentication and big data support have been excluded. For a complete list of
|
||||||
|
the options that will be supported, see the Appendix section.
|
||||||
|
|
||||||
|
Configuration
|
||||||
|
-------------
|
||||||
|
|
||||||
|
None
|
||||||
|
|
||||||
|
Database
|
||||||
|
--------
|
||||||
|
|
||||||
|
None
|
||||||
|
|
||||||
|
Public API
|
||||||
|
----------
|
||||||
|
|
||||||
|
None
|
||||||
|
|
||||||
|
Public API Security
|
||||||
|
-------------------
|
||||||
|
|
||||||
|
None
|
||||||
|
|
||||||
|
Python API
|
||||||
|
----------
|
||||||
|
|
||||||
|
None (empty section added after merging)
|
||||||
|
|
||||||
|
CLI (python-troveclient)
|
||||||
|
------------------------
|
||||||
|
|
||||||
|
None (empty section added after merging)
|
||||||
|
|
||||||
|
Internal API
|
||||||
|
------------
|
||||||
|
|
||||||
|
CLI (python-troveclient)
|
||||||
|
------------------------
|
||||||
|
|
||||||
|
This work will enable the following client commands:
|
||||||
|
|
||||||
|
* configuration-attach
|
||||||
|
* configuration-create
|
||||||
|
* configuration-default
|
||||||
|
* configuration-delete
|
||||||
|
* configuration-detach
|
||||||
|
* configuration-instances
|
||||||
|
* configuration-list
|
||||||
|
* configuration-parameter-list
|
||||||
|
* configuration-parameter-show
|
||||||
|
* configuration-patch
|
||||||
|
* configuration-show
|
||||||
|
* configuration-update
|
||||||
|
|
||||||
|
Note that the configuration groups API is not currently supported for clusters,
|
||||||
|
so only support for single-instance Vertica will be provided.
|
||||||
|
|
||||||
|
Guest Agent
|
||||||
|
-----------
|
||||||
|
|
||||||
|
* Implement *update_overrides* and *apply_overrides* in the *manager* and
|
||||||
|
*service* modules.
|
||||||
|
|
||||||
|
The following existing files will be updated:
|
||||||
|
|
||||||
|
.. code-block:: bash
|
||||||
|
|
||||||
|
guestagent/datastore/experimental/vertica/manager.py
|
||||||
|
guestagent/datastore/experimental/vertica/service.py
|
||||||
|
guestagent/datastore/experimental/vertica/system.py
|
||||||
|
|
||||||
|
Alternatives
|
||||||
|
------------
|
||||||
|
|
||||||
|
None
|
||||||
|
|
||||||
|
Implementation
|
||||||
|
==============
|
||||||
|
|
||||||
|
Assignee(s)
|
||||||
|
-----------
|
||||||
|
|
||||||
|
Alex Tomic <atomic@tesora.com>
|
||||||
|
|
||||||
|
Milestones
|
||||||
|
----------
|
||||||
|
|
||||||
|
mitaka-3
|
||||||
|
|
||||||
|
Work Items
|
||||||
|
----------
|
||||||
|
|
||||||
|
- provide support for viewing and modifying the vertica database-level
|
||||||
|
configuration options
|
||||||
|
|
||||||
|
- implement configuration-related manager API calls:
|
||||||
|
|
||||||
|
.. code-block:: python
|
||||||
|
|
||||||
|
def update_overrides(self, context, overrides, remove=False)
|
||||||
|
def apply_overrides(self, context, overrides)
|
||||||
|
|
||||||
|
Upgrade Implications
|
||||||
|
====================
|
||||||
|
|
||||||
|
None.
|
||||||
|
|
||||||
|
Dependencies
|
||||||
|
============
|
||||||
|
|
||||||
|
None.
|
||||||
|
|
||||||
|
Testing
|
||||||
|
=======
|
||||||
|
|
||||||
|
Unit tests will be added to validate implemented functions, and integration
|
||||||
|
tests added or modified from the new scenario testing framework as needed.
|
||||||
|
|
||||||
|
Documentation Impact
|
||||||
|
====================
|
||||||
|
|
||||||
|
The datastore documentation should be updated to reflect the enabled features.
|
||||||
|
|
||||||
|
Dashboard Impact (UX)
|
||||||
|
=====================
|
||||||
|
|
||||||
|
None.
|
||||||
|
|
||||||
|
Appendix
|
||||||
|
========
|
||||||
|
|
||||||
|
The following is the list of parameters that will be supported:
|
||||||
|
|
||||||
|
ActivePartitionCount
|
||||||
|
AddressCollectorInterval
|
||||||
|
AdvanceAHMInterval
|
||||||
|
AHMBackupManagement
|
||||||
|
AllowNonAsciiNames
|
||||||
|
AnalyzeRowCountInterval
|
||||||
|
AnalyzeStatsPlanMaxColumns
|
||||||
|
AnalyzeStatsSampleBands
|
||||||
|
ARCCommitPercentage
|
||||||
|
AuditConfidenceLevel
|
||||||
|
AuditErrorTolerance
|
||||||
|
BasicVerticaOptions
|
||||||
|
BlockCacheSize
|
||||||
|
BufferQueryOutputForPossibleRetry
|
||||||
|
CachePositionIndex
|
||||||
|
CascadeResourcePoolAlwaysReplan
|
||||||
|
CatalogCheckpointChunkSizeKB
|
||||||
|
CatalogCheckpointMinLogSizeKB
|
||||||
|
CatalogCheckpointPercent
|
||||||
|
CatalogDeindexRename
|
||||||
|
CheckCRCs
|
||||||
|
CheckDataTargetSortOrder
|
||||||
|
ClusterRecoveryWait
|
||||||
|
CollationExpansion
|
||||||
|
CompressCatalogOnDisk
|
||||||
|
CompressDistCalls
|
||||||
|
CompressNetworkData
|
||||||
|
ComputeApproxNDVsDuringAnalyzeStats
|
||||||
|
ContainersPerProjectionLimit
|
||||||
|
CopyFromVerticaWithIdentity
|
||||||
|
DatabaseHeartbeatInterval
|
||||||
|
DBDCorrelationSampleRowCount
|
||||||
|
DBDCorrelationSampleRowPct
|
||||||
|
DBDCountDistinctSampleRowCount
|
||||||
|
DBDCountDistinctSampleRowPct
|
||||||
|
DBDDeploymentParallelism
|
||||||
|
DBDDynamicSampling
|
||||||
|
DBDEncodingSampleRowCount
|
||||||
|
DBDEncodingSampleRowPct
|
||||||
|
DBDLargestTableRowCountBoundary
|
||||||
|
DBDLogInternalDesignProcess
|
||||||
|
DBDMaxConcurrencyForEncodingExperiment
|
||||||
|
DBDRepLargeRowCountPct
|
||||||
|
DBDRepSmallRowCountPct
|
||||||
|
DBDSampleStorageBandCount
|
||||||
|
DBDSkewDetectionSampleRowCount
|
||||||
|
DBDSkewDetectionSampleRowPct
|
||||||
|
DBDUseOnlyDesignerResourcePool
|
||||||
|
DefaultIntervalStyle
|
||||||
|
DefaultSessionLocale
|
||||||
|
DisableInheritedPrivileges
|
||||||
|
DisableLocalResegmentation
|
||||||
|
DisableNodeDownOptimization
|
||||||
|
DisablePrejoinProjections
|
||||||
|
DisallowMars
|
||||||
|
DiskSpacePollingInterval
|
||||||
|
DMLCancelTM
|
||||||
|
EEVerticaOptions
|
||||||
|
EnableAccessPolicy
|
||||||
|
EnableAllRolesOnLogin
|
||||||
|
EnableApportionLoad
|
||||||
|
EnableAutoDMLStats
|
||||||
|
EnableBlockMemoryManager
|
||||||
|
EnableCooperativeParse
|
||||||
|
EnableDataCollector
|
||||||
|
EnabledCipherSuites
|
||||||
|
EnableEEThreadPool
|
||||||
|
EnableEMMJMultiblockSIPS
|
||||||
|
EnableExprsInProjections
|
||||||
|
EnableForceOuter
|
||||||
|
EnableGroupByProjections
|
||||||
|
EnableJIT
|
||||||
|
EnableNewPrimaryKeysByDefault
|
||||||
|
EnableNewUniqueKeysByDefault
|
||||||
|
EnableParallelHashBuild
|
||||||
|
EnableParallelSort
|
||||||
|
EnablePatternMatchingAnyRow
|
||||||
|
EnablePlanStability
|
||||||
|
EnablePlanStabilityLookup
|
||||||
|
EnableResourcePoolCPUAffinity
|
||||||
|
EnableRuntimePriorityScheduler
|
||||||
|
EnableSSL
|
||||||
|
EnableStorageBundling
|
||||||
|
EnableStrictTimeCasts
|
||||||
|
EnableTopKProjections
|
||||||
|
EnableUDTProjections
|
||||||
|
EnableUniquenessOptimization
|
||||||
|
EnableVirtualCoreCount
|
||||||
|
EpochMapInterval
|
||||||
|
EscapeStringWarning
|
||||||
|
EvaluateDeletePerformanceSampleStorageBandCount
|
||||||
|
EvaluateDeletePerformanceSampleStorageCount
|
||||||
|
ExcludeEphemeralNodesInQueries
|
||||||
|
ExternalTablesExceptionsLimit
|
||||||
|
FailoverToStandbyAfter
|
||||||
|
FencedUDxMemoryLimitMB
|
||||||
|
FilesPerProjectionLimit
|
||||||
|
FlexTableDataTypeGuessMultiplier
|
||||||
|
FlexTableRawSize
|
||||||
|
ForceUDxFencedMode
|
||||||
|
FsyncCatalogForLuck
|
||||||
|
FsyncDataForLuck
|
||||||
|
GBHashMemCapMB
|
||||||
|
GlobalEEProfiling
|
||||||
|
GlobalHeirUsername
|
||||||
|
GlobalQueryProfiling
|
||||||
|
GlobalSessionProfiling
|
||||||
|
GroupGeneratorHashingEnabled
|
||||||
|
HadoopConfDir
|
||||||
|
HCatConnectionTimeout
|
||||||
|
HCatParserName
|
||||||
|
HCatSlowTransferLimit
|
||||||
|
HCatSlowTransferTime
|
||||||
|
HCatSourceName
|
||||||
|
HCatWebserviceName
|
||||||
|
HCatWebserviceVersion
|
||||||
|
HistoryRetentionEpochs
|
||||||
|
HistoryRetentionTime
|
||||||
|
JavaBinaryForUDx
|
||||||
|
JavaSideProcessMinHeapSizeMB
|
||||||
|
KeepMinMaxOnAllColumns
|
||||||
|
LGELagThreshold
|
||||||
|
LoadMaxFinalROSCount
|
||||||
|
LockTimeout
|
||||||
|
LogHeartbeatInterval
|
||||||
|
LowDiskSpaceWarningPct
|
||||||
|
MaxAutoSegColumns
|
||||||
|
MaxBundleableROSSizeKB
|
||||||
|
MaxClientSessions
|
||||||
|
MaxConstraintChecksPerQuery
|
||||||
|
MaxDataCollectorFileSize
|
||||||
|
MaxDesiredEEBlockSize
|
||||||
|
MaxDVROSPerContainer
|
||||||
|
MaxLogLineLength
|
||||||
|
MaxMrgOutROSSizeMB
|
||||||
|
MaxOptMemMB
|
||||||
|
MaxOptMemMBInDBD
|
||||||
|
MaxParsedQuerySizeMB
|
||||||
|
MaxPartitionCount
|
||||||
|
MaxQueryRetries
|
||||||
|
MaxRecoverErrors
|
||||||
|
MaxRecoverHistoricPasses
|
||||||
|
MaxRefreshErrors
|
||||||
|
MaxRefreshHistoricPasses
|
||||||
|
MaxROSPerStratum
|
||||||
|
MergeJoinInnerInitialMB
|
||||||
|
MergeOutCache
|
||||||
|
MergeOutInterval
|
||||||
|
MinimumCatalogDiskMegabytes
|
||||||
|
MinimumDataDiskMegabytes
|
||||||
|
MinimumDataDiskTempMegabytes
|
||||||
|
MinSortMergeJoinMB
|
||||||
|
MoveOutInterval
|
||||||
|
MoveOutMaxAgeEpochs
|
||||||
|
MoveOutMaxAgeTime
|
||||||
|
MoveOutSizePct
|
||||||
|
NewEEGroupBySmallMemMB
|
||||||
|
NewEEROSSubdivisionRows
|
||||||
|
NewEEThreads
|
||||||
|
NoRecoverShutdownWait
|
||||||
|
OptVerticaOptions
|
||||||
|
ParallelizeLocalSegmentLoad
|
||||||
|
PatternMatchAllocator
|
||||||
|
PatternMatchingMatchLimitRecursion
|
||||||
|
PatternMatchingMaxPartition
|
||||||
|
PatternMatchingMaxPartitionMatches
|
||||||
|
PatternMatchingPerMatchWorkspaceSize
|
||||||
|
PatternMatchingUseJit
|
||||||
|
PatternMatchStackAllocator
|
||||||
|
PinProcessors
|
||||||
|
PinProcessorsOffset
|
||||||
|
PreExcavatorReplicatedProjection
|
||||||
|
PruneDataCollectorByTime
|
||||||
|
PruneSystemTableColumns
|
||||||
|
PurgeMergeoutPercent
|
||||||
|
RangeWindowMaxMem
|
||||||
|
ReapBeforeRecover
|
||||||
|
RecoverByContainer
|
||||||
|
RecoveryDirtyTxnWait
|
||||||
|
ReflexiveMoveout
|
||||||
|
RefreshByContainer
|
||||||
|
RemoteInitiatorBufSize
|
||||||
|
RemoveSnapshotInterval
|
||||||
|
ReplayDeleteAlgorithmSwitchThreshold
|
||||||
|
ResLowLimPctOfHighLim
|
||||||
|
RestrictSystemTables
|
||||||
|
ROSCacheBlocks
|
||||||
|
ROSCacheLargeBlocks
|
||||||
|
ROSPerStratum
|
||||||
|
SaveDCEEProfileThresholdUS
|
||||||
|
SecurityAlgorithm
|
||||||
|
SegmentAutoProjection
|
||||||
|
SegmentDataCollector
|
||||||
|
SessionProfilingAgeOut
|
||||||
|
SlowDeleteConsoleWarningLimit
|
||||||
|
SlowDeleteSystemWarningLimit
|
||||||
|
SmallROSSize
|
||||||
|
SnapshotRetentionTime
|
||||||
|
SnmpTrapDestinationsList
|
||||||
|
SnmpTrapEvents
|
||||||
|
SnmpTrapsEnabled
|
||||||
|
SortCheckOption
|
||||||
|
SortOrderReportLevel
|
||||||
|
SortWorkerThreads
|
||||||
|
SSLCA
|
||||||
|
SSLCertificate
|
||||||
|
SSLPrivateKey
|
||||||
|
StandardConformingStrings
|
||||||
|
StrictUDxParameterChecking
|
||||||
|
SyslogEnabled
|
||||||
|
SyslogEvents
|
||||||
|
SyslogFacility
|
||||||
|
SystemMonitorInterval
|
||||||
|
SystemMonitorThreshold
|
||||||
|
TerraceRoutingFactor
|
||||||
|
TextIndexComputeDeletedTokens
|
||||||
|
TextIndexMaxTokenLength
|
||||||
|
TopKHeapMaxMem
|
||||||
|
TransactionIsolationLevel
|
||||||
|
TransactionMode
|
||||||
|
TrustConstraintsAsUnique
|
||||||
|
UDxFencedBlockTimeout
|
||||||
|
UDxFencedCancelTimeout
|
||||||
|
UDxFencedExternalProcedureTimeout
|
||||||
|
UseModularHashForReseg
|
||||||
|
UseOnlyResilientRedistribution
|
||||||
|
UseRecoveringNodesInVirtualTableQueries
|
||||||
|
UseSafeDecompression
|
||||||
|
UseV50IntegerDivision
|
||||||
|
UseZygoteForExternalProcedures
|
||||||
|
WarnOnIncompleteStartupPacket
|
||||||
|
WithClauseMaterialization
|
||||||
|
|
||||||
|
References
|
||||||
|
==========
|
||||||
|
|
||||||
|
.. [1] https://my.vertica.com/docs/7.2.x/HTML/index.htm#Authoring/AdministratorsGuide/ConfiguringTheDB/ConfiguringTheDatabase.htm
|
||||||
|
.. [2] https://my.vertica.com/docs/7.2.x/HTML/Content/Authoring/SQLReferenceManual/SystemTables/MONITOR/CONFIGURATION_PARAMETERS.htm
|
||||||
|
.. [3] https://my.vertica.com/docs/7.2.x/HTML/index.htm#Authoring/AdministratorsGuide/ConfiguringTheDB/SettingandClearingConfigParameters.htm
|
||||||
Loading…
Reference in New Issue
Block a user