Table of Contents

Class SidecarReaderSweeper

Namespace
Virtufin.Api.Services
Assembly
Virtufin.Api.dll

Debounced UnblockSidecarReadersAsync(CancellationToken) after Dapr subscriptions close, so a closed subscription's parked reader exits before it takes a message (see the positioner's remarks).

public sealed class SidecarReaderSweeper : IDisposable
Inheritance
SidecarReaderSweeper
Implements
Inherited Members

Remarks

A sweep also wakes this pod's live readers. That's harmless (they read again, nothing is consumed) but costs each one a reconnect, so closes are batched: a close starts a sweep Virtufin.Api.Services.SidecarReaderSweeper.FirstDelay later, plus one more Virtufin.Api.Services.SidecarReaderSweeper.SecondDelay after that for subscriptions whose daprd-side drain (up to 5s) hadn't finished, i.e. whose context wasn't cancelled yet at the first sweep. Closes before the first sweep begins join it (a notebook's cleanup closing 20 topics yields one sweep); a later close starts the next sweep. A close never postpones a sweep already scheduled: with closes arriving more often than Virtufin.Api.Services.SidecarReaderSweeper.FirstDelay, as on a busy gateway, a postponed sweep held a message a closed reader took until the closes paused (17.5 s instead of 6 s with a close every 1.5 s).

Constructors

SidecarReaderSweeper(IConsumerGroupPositioner, ILogger<SidecarReaderSweeper>)

Debounced UnblockSidecarReadersAsync(CancellationToken) after Dapr subscriptions close, so a closed subscription's parked reader exits before it takes a message (see the positioner's remarks).

public SidecarReaderSweeper(IConsumerGroupPositioner positioner, ILogger<SidecarReaderSweeper> logger)

Parameters

positioner IConsumerGroupPositioner
logger ILogger<SidecarReaderSweeper>

Remarks

A sweep also wakes this pod's live readers. That's harmless (they read again, nothing is consumed) but costs each one a reconnect, so closes are batched: a close starts a sweep Virtufin.Api.Services.SidecarReaderSweeper.FirstDelay later, plus one more Virtufin.Api.Services.SidecarReaderSweeper.SecondDelay after that for subscriptions whose daprd-side drain (up to 5s) hadn't finished, i.e. whose context wasn't cancelled yet at the first sweep. Closes before the first sweep begins join it (a notebook's cleanup closing 20 topics yields one sweep); a later close starts the next sweep. A close never postpones a sweep already scheduled: with closes arriving more often than Virtufin.Api.Services.SidecarReaderSweeper.FirstDelay, as on a busy gateway, a postponed sweep held a message a closed reader took until the closes paused (17.5 s instead of 6 s with a close every 1.5 s).

Methods

Dispose()

Performs application-defined tasks associated with freeing, releasing, or resetting unmanaged resources.

public void Dispose()

Request(string, IEnumerable<string>, Func<string, RetainedEntry, bool>?)

A subscription closed: join the scheduled sweep, or schedule one. closedTopic and openTopics (this pod's still-open topics, where a closed reader of the same topic may have taken a live subscription's message) are checked for abandoned pending entries. An abandoned entry redeliver takes (one published for an open subscription) is delivered rather than dropped.

public void Request(string closedTopic, IEnumerable<string> openTopics, Func<string, RetainedEntry, bool>? redeliver = null)

Parameters

closedTopic string
openTopics IEnumerable<string>
redeliver Func<string, RetainedEntry, bool>