Skip to content

Commit 48ebf0a

Browse files
arzonusarzonus
committed
feat(simulation): add cached scheduled queue simulation scenarios
Signed-off-by: Seva Kaloshin <seva.kaloshin@gmail.com>
1 parent 3c69ffe commit 48ebf0a

File tree

4 files changed

+160
-0
lines changed

4 files changed

+160
-0
lines changed

‎simulation/history/dynamicconfig/queuev2_scheduled_cache_enabled.yaml‎

Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,59 @@
1+
system.workflowDeletionJitterRange:
2+
- value: 0
3+
constraints: {}
4+
history.enableTimerQueueV2:
5+
- value: true
6+
constraints: {}
7+
history.enableTransferQueueV2:
8+
- value: true
9+
constraints: {}
10+
history.queueMaxPendingTaskCount:
11+
- value: 10000
12+
constraints: {}
13+
history.timerTaskBatchSize:
14+
- value: 100
15+
constraints: {}
16+
history.timerProcessorUpdateAckInterval:
17+
- value: 30s
18+
constraints: {}
19+
history.timerProcessorUpdateAckIntervalJitterCoefficient:
20+
- value: 0
21+
constraints: {}
22+
history.timerProcessorMaxPollRPS:
23+
- value: 20
24+
constraints: {}
25+
history.transferTaskBatchSize:
26+
- value: 100
27+
constraints: {}
28+
history.transferProcessorUpdateAckInterval:
29+
- value: 30s
30+
constraints: {}
31+
history.transferProcessorUpdateAckIntervalJitterCoefficient:
32+
- value: 0
33+
constraints: {}
34+
history.transferProcessorMaxPollRPS:
35+
- value: 20
36+
constraints: {}
37+
# Cached scheduled queue settings
38+
history.timerProcessorEnableCachedScheduledQueue:
39+
- value: true
40+
constraints: {}
41+
history.timerProcessorCachedQueueReaderMode:
42+
- value: "enabled"
43+
constraints: {}
44+
history.timerProcessorCacheMaxSize:
45+
- value: 1000
46+
constraints: {}
47+
history.timerProcessorCacheMaxLookAheadWindow:
48+
- value: 5m
49+
constraints: {}
50+
history.timerProcessorCachePrefetchTriggerWindow:
51+
- value: 30s
52+
constraints: {}
53+
# Set to 0s to ensure caching starts immediately in simulation
54+
history.timerProcessorCacheWarmupGracePeriod:
55+
- value: 0s
56+
constraints: {}
57+
history.timerProcessorCacheEvictionSafeWindow:
58+
- value: 10s
59+
constraints: {}

‎simulation/history/dynamicconfig/queuev2_scheduled_cache_shadow.yaml‎

Lines changed: 59 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,59 @@
1+
system.workflowDeletionJitterRange:
2+
- value: 0
3+
constraints: {}
4+
history.enableTimerQueueV2:
5+
- value: true
6+
constraints: {}
7+
history.enableTransferQueueV2:
8+
- value: true
9+
constraints: {}
10+
history.queueMaxPendingTaskCount:
11+
- value: 10000
12+
constraints: {}
13+
history.timerTaskBatchSize:
14+
- value: 100
15+
constraints: {}
16+
history.timerProcessorUpdateAckInterval:
17+
- value: 30s
18+
constraints: {}
19+
history.timerProcessorUpdateAckIntervalJitterCoefficient:
20+
- value: 0
21+
constraints: {}
22+
history.timerProcessorMaxPollRPS:
23+
- value: 20
24+
constraints: {}
25+
history.transferTaskBatchSize:
26+
- value: 100
27+
constraints: {}
28+
history.transferProcessorUpdateAckInterval:
29+
- value: 30s
30+
constraints: {}
31+
history.transferProcessorUpdateAckIntervalJitterCoefficient:
32+
- value: 0
33+
constraints: {}
34+
history.transferProcessorMaxPollRPS:
35+
- value: 20
36+
constraints: {}
37+
# Cached scheduled queue settings
38+
history.timerProcessorEnableCachedScheduledQueue:
39+
- value: true
40+
constraints: {}
41+
history.timerProcessorCachedQueueReaderMode:
42+
- value: "shadow"
43+
constraints: {}
44+
history.timerProcessorCacheMaxSize:
45+
- value: 1000
46+
constraints: {}
47+
history.timerProcessorCacheMaxLookAheadWindow:
48+
- value: 15s
49+
constraints: {}
50+
history.timerProcessorCachePrefetchTriggerWindow:
51+
- value: 5s
52+
constraints: {}
53+
# Set to 0s to ensure caching starts immediately in simulation
54+
history.timerProcessorCacheWarmupGracePeriod:
55+
- value: 0s
56+
constraints: {}
57+
history.timerProcessorCacheEvictionSafeWindow:
58+
- value: 10s
59+
constraints: {}

‎simulation/history/testdata/history_simulation_queuev2_scheduled_cache_enabled.yaml‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
enablearchival: false
2+
clusterno: 0
3+
messagingclientconfig:
4+
usemock: true
5+
historyconfig:
6+
numhistoryshards: 4
7+
numhistoryhosts: 1
8+
simulationconfig:
9+
numworkflows: 1000
10+
sleepbetweenworkflowstarts: 100ms
11+
numworkflowsleeps: 10
12+
matchingconfig:
13+
nummatchinghosts: 1
14+
workerconfig:
15+
enableasyncwfconsumer: false
16+
enablearchiver: false
17+
enablereplicator: false
18+
enableindexer: false
19+
dynamicclientconfig:
20+
filepath: "dynamicconfig/queuev2_scheduled_cache_enabled.yaml"
21+
pollInterval: "10s"

‎simulation/history/testdata/history_simulation_queuev2_scheduled_cache_shadow.yaml‎

Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
enablearchival: false
2+
clusterno: 0
3+
messagingclientconfig:
4+
usemock: true
5+
historyconfig:
6+
numhistoryshards: 4
7+
numhistoryhosts: 1
8+
simulationconfig:
9+
numworkflows: 1000
10+
sleepbetweenworkflowstarts: 100ms
11+
numworkflowsleeps: 10
12+
matchingconfig:
13+
nummatchinghosts: 1
14+
workerconfig:
15+
enableasyncwfconsumer: false
16+
enablearchiver: false
17+
enablereplicator: false
18+
enableindexer: false
19+
dynamicclientconfig:
20+
filepath: "dynamicconfig/queuev2_scheduled_cache_shadow.yaml"
21+
pollInterval: "10s"

0 commit comments

Comments
 (0)