moonbitstack/moonzero/shedder

README
U
Balancer
U
BidiCall
U
BidiStreamFactory
U
BidiStreamHandler
U
Breaker
U
ClientStreamHandler
U
Clock
U
Conf
U
ConfigError
U
ConsulClient
U
ConsulDiscovery
U
ConsulError
U
ConsulHttp
U
ConsulResponse
U
CorsConf
U
CounterVec
U
Endpoint
U
EtcdClient
U
EtcdDeleteRangeRequest
U
EtcdDeleteRangeResponse
U
EtcdDiscovery
U
EtcdError
U
EtcdEvent
U
EtcdEventType
U
EtcdKeyValue
U
EtcdLeaseGrantRequest
U
EtcdLeaseGrantResponse
U
EtcdLeaseKeepAliveRequest
U
EtcdLeaseKeepAliveResponse
U
EtcdPutRequest
U
EtcdPutResponse
U
EtcdRangeRequest
U
EtcdRangeResponse
U
EtcdWatchCancelRequest
U
EtcdWatchCreateRequest
U
EtcdWatchRequest
U
EtcdWatchResponse
U
Group
U
Histogram
U
InMemoryRegistry
U
Layer
U
LoadBalancedChannel
U
LogLevel
U
Logger
U
ManualClock
U
MaxConns
U
Middleware
U
MiddlewaresConf
U
PeriodLimit
U
PeriodResult
U
PersistentRegistry
U
PrivateKeyConf
U
Promise
U
RedisClient
U
RedisConn
U
RedisDiscovery
U
RedisError
U
RedisPeriodLimit
U
RedisScript
U
RedisTokenLimit
U
Refusal
U
RegistryEvent
U
RequestLog
U
Resolve
U
RespError
U
RespReader
U
RespValue
U
RestConf
U
RestEngine
U
RoundRobin
U
RpcChannel
U
RpcCluster
U
RpcGroup
U
RpcHandler
U
RpcServer
U
RpcServerConf
U
Server
U
ServerMetrics
U
ServerStreamHandler
U
ServiceConf
U
Shedder
U
ShutdownCoordinator
U
SignatureConf
U
Ticket
U
TokenBucket
U
TraceContext
U
Unavailable
U
WeightedRoundRobin
V
auth
V
breaker
V
canonical_key
V
consul_check_id
V
consul_parse_health
V
consul_register_body
V
cors
V
default_latency_buckets
V
duration_key
V
entry
V
etcd_prefix_end
V
etcd_service_prefix
V
exposition_content_type
V
generate_span_id
V
generate_trace_id
V
jwt_authorized
V
jwt_sign
V
jwt_verify
V
level_name
V
logging
V
logx
V
max_conns
V
maxbytes
V
message_key
V
metrics
V
metrics_handler
V
mount_metrics
V
next_trace_context
V
parse_traceparent
V
period_limit
V
period_script
V
pick_first
V
plain_text
V
port
V
rate_limit
V
recovery
V
redis_instance_key
V
redis_period_limit
V
redis_rate_limit
V
redis_service_pattern
V
redis_service_prefix
V
refusal
V
request_id
V
resolve_one
V
resp_command
V
resp_encode_command
V
resp_kind
V
rpc_port
V
set_log_level
V
set_log_sink
V
set_log_writer
V
shedding
V
stamp_key
V
status_of_code
V
structured_logging
V
timed_out
V
timeout
V
token_script
V
too_large
V
too_many
V
tracing
V
unavailable

moonbitstack/moonzero/shedder does not have a README file

Shedder

pub struct Shedder {
  core : @moonbitstack/moonward.Shedder
Shedder
  clock : @moonbitstack/moonzero/clock.Clock
Clock
  usage : () -> Int64
}

Load shedding under pressure (← go-zero's load.AdaptiveShedder, wired from RestConf.CpuThreshold).

A request is refused only when the server is hot, its CPU at or over threshold per-mille or recently so, and full, with more requests in flight than it has shown it can finish. The algorithm is moonward's Shedder; this binds it to a Clock and to usage, the CPU meter. Without a meter usage reads zero and nothing is shed, since no MoonBit backend can read one alone.

Shedder::allow

source

fn Shedder::allow(self : Shedder) -> Ticket?

Ask to admit one request. Some ticket means go ahead, and the caller settles it when the request finishes; None means shed it.

Shedder::new

source

fn Shedder::new(clock : @moonbitstack/moonzero/clock.Clock
Clock, threshold? : Int64, usage? : () -> Int64) -> Shedder

Shedder::usage

source

fn Shedder::usage(self : Shedder) -> Int64

The CPU usage the shedder is reading, per mille.

Ticket

source

pub struct Ticket {
  inner : @moonbitstack/moonward.Ticket
Ticket
  clock : @moonbitstack/moonzero/clock.Clock
Clock
}

An admitted request (← go-zero's load.Promise).

Ticket::fail

source

fn Ticket::fail(self : Ticket) -> Unit

Ticket::pass

source

fn Ticket::pass(self : Ticket) -> Unit

The request succeeded; its duration counts towards the server's capacity.

Source Files

shedder.mbt

Site source Report issue Packages Build queue Skills Statistics

#Shedder

#Shedder::allow

#Shedder::new

#Shedder::usage

#Ticket

#Ticket::fail

#Ticket::pass

Source Files

Shedder

Shedder::allow

Shedder::new

Shedder::usage

Ticket

Ticket::fail

Ticket::pass