swift/doc/saio/swift
Matthew Oliver 2641814010 Add sharder daemon, manage_shard_ranges tool and probe tests
The sharder daemon visits container dbs and when necessary executes
the sharding workflow on the db.

The workflow is, in overview:

- perform an audit of the container for sharding purposes.

- move any misplaced objects that do not belong in the container
  to their correct shard.

- move shard ranges from FOUND state to CREATED state by creating
  shard containers.

- move shard ranges from CREATED to CLEAVED state by cleaving objects
  to shard dbs and replicating those dbs. By default this is done in
  batches of 2 shard ranges per visit.

Additionally, when the auto_shard option is True (NOT yet recommeneded
in production), the sharder will identify shard ranges for containers
that have exceeded the threshold for sharding, and will also manage
the sharding and shrinking of shard containers.

The manage_shard_ranges tool provides a means to manually identify
shard ranges and merge them to a container in order to trigger
sharding. This is currently the recommended way to shard a container.

Co-Authored-By: Alistair Coles <alistairncoles@gmail.com>
Co-Authored-By: Tim Burke <tim.burke@gmail.com>
Co-Authored-By: Clay Gerrard <clay.gerrard@gmail.com>

Change-Id: I7f192209d4d5580f5a0aa6838f9f04e436cf6b1f
2018-05-18 18:48:13 +01:00
..
account-server Bind SAIO services on different loopback addresses 2017-06-27 16:08:08 -04:00
container-server Add sharder daemon, manage_shard_ranges tool and probe tests 2018-05-18 18:48:13 +01:00
object-server Bind SAIO services on different loopback addresses 2017-06-27 16:08:08 -04:00
container-reconciler.conf Removed default value for log_statsd_host 2016-02-10 10:36:59 -06:00
container-sync-realms.conf Add container sync probe test to SAIO default set 2015-08-22 22:50:50 +03:00
internal-client.conf Add sharder daemon, manage_shard_ranges tool and probe tests 2018-05-18 18:48:13 +01:00
object-expirer.conf Removed default value for log_statsd_host 2016-02-10 10:36:59 -06:00
proxy-server.conf Symlink implementation. 2017-12-13 21:26:12 +00:00
swift.conf Add note on using printable chars for swift_hash_path_suffix/prefix 2016-02-17 20:47:53 +01:00