Multiple throttle options

[apetrov88]

Is it possible to set multiple throttle option like:

5 per 1 minute
100 per 1 hour
1000 per 1 day

All of them for the same worker.

[ixti]

You should be able to do something like:

sidekiq_throttled(
  threshold: [
    { limit: 5, period: 5.minutes, key_suffix: "minutely" },
    { limit: 100, period: 1.hour, key_suffix: "hourly" },
    { limit: 1000, period: 1.day, key_suffix: "daily" },
  ]
)

[apetrov88]

Does not seem to work for me. Can you confirm the settings above are correctly?

[danishsatkut]

@apetrov88 What's your sidekiq and sidekiq-throttled version?

[jakeonrails]

I can confirm that this does not work with:

sidekiq (7.3.7)
    sidekiq-cron (2.0.1)
      sidekiq (>= 6.5.0)
    sidekiq-throttled (1.5.1)
      sidekiq (>= 6.5)
  sidekiq
  sidekiq-cron
  sidekiq-throttled

In the Sidekiq Admin, the jobs that I attempt to throttle with an array of throttle options, both using string values for key_suffix as well as procs that return string values, the throttled job does not even appear in the list, and in fact is not throttled at all.

When I replace the array of throttle options with a single hash of throttle options, the job reappears and is throttled as expected.

I have tried:

Will not appear on sidekiq UI, no throttling happens:

  sidekiq_throttle(
    threshold: [
      { limit: 5, period: 5.minutes, key_suffix: ->(job_id) { 'minutely' } },
      { limit: 100, period: 1.hour, key_suffix: ->(job_id) { 'hourly' } },
      { limit: 1000, period: 1.day, key_suffix: ->(job_id) { 'daily' } }
    ]
  )

Will not appear on sidekiq UI, no throttling happens:

  sidekiq_throttle(
    threshold: [
      { limit: 5, period: 5.minutes, key_suffix: 'minutely' },
      { limit: 100, period: 1.hour, key_suffix: 'hourly' },
      { limit: 1000, period: 1.day, key_suffix: 'daily' }
    ]
  )

This appears in the UI and correctly throttles

sidekiq_throttle(threshold: { limit: 1, period: 1.second })

[jakeonrails]

Follow up:

I can confirm that this style works:

  sidekiq_throttle(
    threshold: [
      { limit: 1, period: 1.second, key_suffix: ->(job_id) { 'secondly' } },
      { limit: 10, period: 1.minute, key_suffix: ->(job_id) { 'minutely' } }
    ]
  )

By "works" I mean that it correctly throttles the jobs at the 1/second and 10/minute rate.

It was a red herring that the job is not listed in the /throttled page in Sidekiq Admin - only so-called "static" throttles appear there. If there is any ->() procs, the jobs are not listed on the dashboard :(