v1.0.9

Changes

• Log each repo-local TruffleHog exclusion pattern individually so patterns are queryable in Loki (msg=repoExclusion pattern=...)
• Add testdata files and table-driven contract tests for exclusion metrics in SuiteRunSummary

What's Changed

• 📚 Update documentation and libsonnet for v1.0.8 by @grafana-pr-automation[bot] in #953
• Log repo-local TruffleHog exclusion patterns for Loki visibility by @isaiah-grafana in #954

Full Changelog: v1.0.8...v1.0.9

v1.0.8

What's Changed

• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.11 by @renovate-sh-app[bot] in #948
• Add TruffleHog exclusion pattern tracking by @isaiah-grafana in #951

Full Changelog: v1.0.7...v1.0.8

What's Changed

• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.11 by @renovate-sh-app[bot] in #948
• Add TruffleHog exclusion pattern tracking by @isaiah-grafana in #951

Full Changelog: v1.0.7...v1.0.8

v1.0.7

What's Changed

• fix(ci): add id-token permission for update-docs job by @jalevin in #930
• fix(ci): add permissions to release-docs.yml for direct triggers by @jalevin in #931
• 📚 Update documentation and libsonnet for v1.0.6 by @grafana-pr-automation[bot] in #932
• fix(deps): update module github.com/go-git/go-git/v5 to v5.17.1 [security] by @renovate-sh-app[bot] in #935
• Update migration documentation for metrics file option by @mmandrus in #937
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.10 by @renovate-sh-app[bot] in #938
• feat: add parser for eslint stats reports from grafana repo by @fastfrwrd in #939
• fix: infer default port from scheme in service health check by @jalevin in #944
• fix(deps): update module github.com/go-git/go-git/v5 to v5.17.2 by @renovate-sh-app[bot] in #941
• chore(deps): update docker/dockerfile docker tag to v1.23.0 by @renovate-sh-app[bot] in #943
• fix(deps): update module github.com/grafana/nanogit to v0.13.1 by @renovate-sh-app[bot] in #940
• chore(deps): update grafana/grafana docker tag to v12.4.2 by @renovate-sh-app[bot] in #933
• fix(deps): update module github.com/go-playground/validator/v10 to v10.30.2 by @renovate-sh-app[bot] in #936
• fix(deps): update module buf.build/gen/go/prometheus/prometheus/protocolbuffers/go to v1.36.11-20260331160422-eae785f0a21d.1 by @renovate-sh-app[bot] in #942

New Contributors

• @grafana-pr-automation[bot] made their first contribution in #932
• @mmandrus made their first contribution in #937
• @fastfrwrd made their first contribution in #939

Full Changelog: v1.0.6...v1.0.7

What's Changed

• fix(ci): add id-token permission for update-docs job by @jalevin in #930
• fix(ci): add permissions to release-docs.yml for direct triggers by @jalevin in #931
• 📚 Update documentation and libsonnet for v1.0.6 by @grafana-pr-automation[bot] in #932
• fix(deps): update module github.com/go-git/go-git/v5 to v5.17.1 [security] by @renovate-sh-app[bot] in #935
• Update migration documentation for metrics file option by @mmandrus in #937
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.10 by @renovate-sh-app[bot] in #938
• feat: add parser for eslint stats reports from grafana repo by @fastfrwrd in #939
• fix: infer default port from scheme in service health check by @jalevin in #944
• fix(deps): update module github.com/go-git/go-git/v5 to v5.17.2 by @renovate-sh-app[bot] in #941
• chore(deps): update docker/dockerfile docker tag to v1.23.0 by @renovate-sh-app[bot] in #943
• fix(deps): update module github.com/grafana/nanogit to v0.13.1 by @renovate-sh-app[bot] in #940
• chore(deps): update grafana/grafana docker tag to v12.4.2 by @renovate-sh-app[bot] in #933
• fix(deps): update module github.com/go-playground/validator/v10 to v10.30.2 by @renovate-sh-app[bot] in #936
• fix(deps): update module buf.build/gen/go/prometheus/prometheus/protocolbuffers/go to v1.36.11-20260331160422-eae785f0a21d.1 by @renovate-sh-app[bot] in #942

New Contributors

• @grafana-pr-automation[bot] made their first contribution in #932
• @mmandrus made their first contribution in #937
• @fastfrwrd made their first contribution in #939

Full Changelog: v1.0.6...v1.0.7

v1.0.6

What's Changed

• fix: use version string as deployment label for versioned releases by @jalevin in #925
• fix(libsonnet): make test assertions throw on failure by @jalevin in #926
• chore: add AGPLv3 license and dependency license check by @jalevin in #927
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.9 by @renovate-sh-app[bot] in #928
• feat(jscoverage): parse Istanbul/NYC, Jest, Vitest, Monocart style JSON by @jesdavpet in #929

New Contributors

• @jesdavpet made their first contribution in #929

Full Changelog: v1.0.5...v1.0.6

What's Changed

• fix: use version string as deployment label for versioned releases by @jalevin in #925
• fix(libsonnet): make test assertions throw on failure by @jalevin in #926
• chore: add AGPLv3 license and dependency license check by @jalevin in #927
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.9 by @renovate-sh-app[bot] in #928
• feat(jscoverage): parse Istanbul/NYC, Jest, Vitest, Monocart style JSON by @jesdavpet in #929

New Contributors

• @jesdavpet made their first contribution in #929

Full Changelog: v1.0.5...v1.0.6

v1.0.5

What's Changed

• chore(deps): update actions/checkout action to v6 by @renovate-sh-app[bot] in #837
• Bump github.com/olekukonko/tablewriter from 1.1.3 to 1.1.4 by @dependabot[bot] in #894
• Bump softprops/action-gh-release from 2.5.0 to 2.6.1 by @dependabot[bot] in #892
• chore(deps): update playwright monorepo to v1.58.2 by @renovate-sh-app[bot] in #891
• 📚 Update documentation and libsonnet for by @github-actions[bot] in #896
• fix(ci): use replace strategy and fix automerge prefix for experimental libsonnet by @jalevin in #897
• fix(playwright): fix consistently failing CI playwright tests by @jalevin in #900
• fix(ci): use go-version-file instead of loose go-version range by @jalevin in #899
• chore(ci): use GitHub App token broker in release-docs workflow by @jalevin in #903
• chore(deps): update grafana/grafana docker tag to v12.4.1 by @renovate-sh-app[bot] in #902
• chore(deps): update docker/dockerfile docker tag to v1.22.0 by @renovate-sh-app[bot] in #901
• fix(deps): update module github.com/testcontainers/testcontainers-go to v0.41.0 by @renovate-sh-app[bot] in #905
• fix(deps): update module github.com/go-git/go-git/v5 to v5.17.0 by @renovate-sh-app[bot] in #904
• Bump github.com/testcontainers/testcontainers-go from 0.40.0 to 0.41.0 by @dependabot[bot] in #893
• Bump github.com/go-git/go-git/v5 from 5.16.5 to 5.17.0 by @dependabot[bot] in #866
• Bump playwright from v1.55.1-noble to v1.58.2-noble by @dependabot[bot] in #844
• chore(deps): update dependency @grafana/plugin-e2e to ^1.18.3 by @renovate-sh-app[bot] in #821
• fix(deps): update module github.com/go-playground/validator/v10 to v10.30.1 by @renovate-sh-app[bot] in #835
• chore(deps): update registry docker tag to v3 by @renovate-sh-app[bot] in #908
• chore(deps): update dependency @grafana/plugin-e2e to v3 by @renovate-sh-app[bot] in #907
• fix(deps): update module buf.build/gen/go/prometheus/prometheus/protocolbuffers/go to v1.36.11-20251118093737-4105057cc7d4.1 by @renovate-sh-app[bot] in #728
• chore(deps): update grafana/shared-workflows/ action to by @renovate-sh-app[bot] in #726
• fix(deps): update golang.org/x/exp digest to 7ab1446 by @renovate-sh-app[bot] in #727
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.7 by @renovate-sh-app[bot] in #911
• chore(deps): update actions/setup-go action to v6 by @renovate-sh-app[bot] in #906
• fix(deps): update k6pack to grafana/k6pack v0.2.4 by @jalevin in #914
• fix(deps): update module github.com/grafana/nanogit to v0.8.1 by @renovate-sh-app[bot] in #916
• fix(deps): update module github.com/grafana/nanogit to v0.9.0 by @renovate-sh-app[bot] in #917
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.8 by @renovate-sh-app[bot] in #923
• fix(deps): update module github.com/slack-go/slack to v0.20.0 by @renovate-sh-app[bot] in #922
• chore(deps): bump github.com/grafana/nanogit from 0.9.0 to 0.13.0 by @dependabot[bot] in #920
• remove dependabot by @jalevin in #924

Full Changelog: v1.0.4...v1.0.5

What's Changed

• chore(deps): update actions/checkout action to v6 by @renovate-sh-app[bot] in #837
• Bump github.com/olekukonko/tablewriter from 1.1.3 to 1.1.4 by @dependabot[bot] in #894
• Bump softprops/action-gh-release from 2.5.0 to 2.6.1 by @dependabot[bot] in #892
• chore(deps): update playwright monorepo to v1.58.2 by @renovate-sh-app[bot] in #891
• 📚 Update documentation and libsonnet for by @github-actions[bot] in #896
• fix(ci): use replace strategy and fix automerge prefix for experimental libsonnet by @jalevin in #897
• fix(playwright): fix consistently failing CI playwright tests by @jalevin in #900
• fix(ci): use go-version-file instead of loose go-version range by @jalevin in #899
• chore(ci): use GitHub App token broker in release-docs workflow by @jalevin in #903
• chore(deps): update grafana/grafana docker tag to v12.4.1 by @renovate-sh-app[bot] in #902
• chore(deps): update docker/dockerfile docker tag to v1.22.0 by @renovate-sh-app[bot] in #901
• fix(deps): update module github.com/testcontainers/testcontainers-go to v0.41.0 by @renovate-sh-app[bot] in #905
• fix(deps): update module github.com/go-git/go-git/v5 to v5.17.0 by @renovate-sh-app[bot] in #904
• Bump github.com/testcontainers/testcontainers-go from 0.40.0 to 0.41.0 by @dependabot[bot] in #893
• Bump github.com/go-git/go-git/v5 from 5.16.5 to 5.17.0 by @dependabot[bot] in #866
• Bump playwright from v1.55.1-noble to v1.58.2-noble by @dependabot[bot] in #844
• chore(deps): update dependency @grafana/plugin-e2e to ^1.18.3 by @renovate-sh-app[bot] in #821
• fix(deps): update module github.com/go-playground/validator/v10 to v10.30.1 by @renovate-sh-app[bot] in #835
• chore(deps): update registry docker tag to v3 by @renovate-sh-app[bot] in #908
• chore(deps): update dependency @grafana/plugin-e2e to v3 by @renovate-sh-app[bot] in #907
• fix(deps): update module buf.build/gen/go/prometheus/prometheus/protocolbuffers/go to v1.36.11-20251118093737-4105057cc7d4.1 by @renovate-sh-app[bot] in #728
• chore(deps): update grafana/shared-workflows/ action to by @renovate-sh-app[bot] in #726
• fix(deps): update golang.org/x/exp digest to 7ab1446 by @renovate-sh-app[bot] in #727
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.7 by @renovate-sh-app[bot] in #911
• chore(deps): update actions/setup-go action to v6 by @renovate-sh-app[bot] in #906
• fix(deps): update k6pack to grafana/k6pack v0.2.4 by @jalevin in #914
• fix(deps): update module github.com/grafana/nanogit to v0.8.1 by @renovate-sh-app[bot] in #916
• fix(deps): update module github.com/grafana/nanogit to v0.9.0 by @renovate-sh-app[bot] in #917
• chore(deps): update dependency @grafana/plugin-e2e to ^3.4.8 by @renovate-sh-app[bot] in #923
• fix(deps): update module github.com/slack-go/slack to v0.20.0 by @renovate-sh-app[bot] in #922
• chore(deps): bump github.com/grafana/nanogit from 0.9.0 to 0.13.0 by @dependabot[bot] in #920
• remove dependabot by @jalevin in #924

Full Changelog: v1.0.4...v1.0.5

v1.0.4

What's Changed

• fix(ci): use --auto flag for PR merge to respect branch protection rules by @jalevin in #887
• fix(gotest): return zero duration when no tests are executed by @jalevin in #888
• Remove internal Grafana references from docs for OSS publication by @jalevin in #885
• fix(metrics): remove bench_ prefix from executor-specific metrics by @jalevin in #889
• feat(report): add TruffleHog JSON parser for report command by @isaiah-grafana in #879

New Contributors

• @isaiah-grafana made their first contribution in #879

Full Changelog: v1.0.3...v1.0.4

What's Changed

• fix(ci): use --auto flag for PR merge to respect branch protection rules by @jalevin in #887
• fix(gotest): return zero duration when no tests are executed by @jalevin in #888
• Remove internal Grafana references from docs for OSS publication by @jalevin in #885
• fix(metrics): remove bench_ prefix from executor-specific metrics by @jalevin in #889
• Bump docker/build-push-action from 6.18.0 to 7.0.0 by @dependabot[bot] in #878
• Bump docker/setup-qemu-action from 3.7.0 to 4.0.0 by @dependabot[bot] in #877
• Bump docker/login-action from 3.6.0 to 4.0.0 by @dependabot[bot] in #876
• Bump github.com/slack-go/slack from 0.17.3 to 0.19.0 by @dependabot[bot] in #875
• Bump golang from 1.25-alpine to 1.26-alpine by @dependabot[bot] in #849
• Bump actions/github-script from 7 to 8 by @dependabot[bot] in #676
• chore(deps): update grafana/shared-workflows/get-vault-secrets action to v1.3.1 by @renovate-sh-app[bot] in #890
• Bump golang.org/x/text from 0.33.0 to 0.34.0 by @dependabot[bot] in #852
• Bump actions/setup-go from 4 to 6 by @dependabot[bot] in #678
• Bump peter-evans/create-pull-request from 7.0.8 to 8.1.0 by @dependabot[bot] in #838
• Bump github.com/grafana/nanogit from 0.3.0 to 0.7.0 by @dependabot[bot] in #895
• feat(report): add TruffleHog JSON parser for report command by @isaiah-grafana in #879

New Contributors

• @isaiah-grafana made their first contribution in #879

Full Changelog: v1.0.3...v1.0.4

v1.0.3

What's Changed

• remove frontend asset size workflow. being moved into core by @jalevin in #881
• docs: add Slack notifications and Go tests guides by @jalevin in #882
• fix: quote workflow name to avoid YAML colon parsing error by @jalevin in #884

Full Changelog: v1.0.2...v1.0.3

What's Changed

• remove frontend asset size workflow. being moved into core by @jalevin in #881
• docs: add Slack notifications and Go tests guides by @jalevin in #882
• fix: quote workflow name to avoid YAML colon parsing error by @jalevin in #884

Full Changelog: v1.0.2...v1.0.3

v1.0.2

What's Changed

• introduce pkg/parser/ and separate parsers from executors by @jalevin in #865
• Fix libsonnet generator: use std.escapeStringBash for run-dashboard URL by @jalevin in #874
• fix(slack): surface not_in_channel errors and fix nil dereference in validate by @jalevin in #873

Full Changelog: v1.0.1...v1.0.2

What's Changed

• introduce pkg/parser/ and separate parsers from executors by @jalevin in #865
• Fix libsonnet generator: use std.escapeStringBash for run-dashboard URL by @jalevin in #874
• fix(slack): surface not_in_channel errors and fix nil dereference in validate by @jalevin in #873

Full Changelog: v1.0.1...v1.0.2

v1.0.1

What's Changed

• fix: Use v1.0.0 flags in generated libsonnet for v1.0.0+ by @jalevin in #848
• fix(deps): update module github.com/go-git/go-git/v5 to v5.16.5 [security] by @renovate-sh-app[bot] in #847
• fix empty test executor attribute by @jalevin in #853
• chore(deps): update module go.opentelemetry.io/otel/sdk to v1.40.0 [security] by @renovate-sh-app[bot] in #855
• chore(deps): update module github.com/cloudflare/circl to v1.6.3 [security] by @renovate-sh-app[bot] in #861
• Use gh CLI to download release binaries, go install for latest by @jalevin in #863
• fix tag in git worktree and update docs by @jalevin in #859
• Add zizmor SARIF parser for security scanning results by @jalevin in #854

Full Changelog: v1.0.0...v1.0.1

What's Changed

• fix: Use v1.0.0 flags in generated libsonnet for v1.0.0+ by @jalevin in #848
• fix(deps): update module github.com/go-git/go-git/v5 to v5.16.5 [security] by @renovate-sh-app[bot] in #847
• fix empty test executor attribute by @jalevin in #853
• chore(deps): update module go.opentelemetry.io/otel/sdk to v1.40.0 [security] by @renovate-sh-app[bot] in #855
• chore(deps): update module github.com/cloudflare/circl to v1.6.3 [security] by @renovate-sh-app[bot] in #861
• Use gh CLI to download release binaries, go install for latest by @jalevin in #863
• fix tag in git worktree and update docs by @jalevin in #859
• Add zizmor SARIF parser for security scanning results by @jalevin in #854

Full Changelog: v1.0.0...v1.0.1

v1.0.0

What's Changed

This is a fundamental shift for Bench that includes breaking changes. Whereas v0.x.x was grafana centric, v1.0.0 is service centric, meaning it works for any service you may want to test and includes generic health checks. I recommend passing the Migration Guide and [What's changed] doc to your LLM of choice and pointing it at your pipeline to perform the updates.

• 📚 Update documentation and libsonnet for v0.6.11 by @github-actions[bot] in #815
• rework libsonnet pipeline to handle versions by @jalevin in #822
• bump playwright version by @jalevin in #775
• add better debugging for gitea in ci by @jalevin in #824
• fix overriding secrets in libsonnet library by @jalevin in #826
• Bump alpine from 3.22 to 3.23 by @dependabot[bot] in #778
• Bump docker/setup-qemu-action from 3.6.0 to 3.7.0 by @dependabot[bot] in #752
• Bump github.com/testcontainers/testcontainers-go from 0.38.0 to 0.40.0 by @dependabot[bot] in #784
• Bump actions/cache from 4 to 5 by @dependabot[bot] in #790
• Bump github.com/olekukonko/tablewriter from 1.1.0 to 1.1.3 by @dependabot[bot] in #825
• Bump github.com/go-git/go-git/v5 from 5.16.2 to 5.16.4 by @dependabot[bot] in #772
• Bump github.com/prometheus/client_golang from 1.23.0 to 1.23.2 by @dependabot[bot] in #675
• Bump golang.org/x/text from 0.31.0 to 0.33.0 by @dependabot[bot] in #823
• chore(deps): update grafana/grafana docker tag to v12.3.1 by @renovate-sh-app[bot] in #829
• chore(deps): update docker/dockerfile docker tag to v1.20.0 by @renovate-sh-app[bot] in #828
• docs: improve documentation discoverability by @jalevin in #832
• chore(deps): update playwright monorepo to v1.57.0 by @renovate-sh-app[bot] in #834
• chore(deps): update grafana/shared-workflows/get-vault-secrets action to v1.3.0 by @renovate-sh-app[bot] in #833
• chore(deps): update dependency go to v1.25.6 by @renovate-sh-app[bot] in #827
• Bump github.com/spf13/cobra from 1.9.1 to 1.10.2 by @dependabot[bot] in #783
• Bump softprops/action-gh-release from 2.3.3 to 2.5.0 by @dependabot[bot] in #780
• (BREAKING CHANGES) Bench support for multitenant services. v1.0.0 by @jalevin in #831
• add support for go benchmark by @jalevin in #840

Full Changelog: v0.6.11...v1.0.0

What's Changed

• 📚 Update documentation and libsonnet for v0.6.11 by @github-actions[bot] in #815
• rework libsonnet pipeline to handle versions by @jalevin in #822
• bump playwright version by @jalevin in #775
• add better debugging for gitea in ci by @jalevin in #824
• fix overriding secrets in libsonnet library by @jalevin in #826
• Bump alpine from 3.22 to 3.23 by @dependabot[bot] in #778
• Bump docker/setup-qemu-action from 3.6.0 to 3.7.0 by @dependabot[bot] in #752
• Bump github.com/testcontainers/testcontainers-go from 0.38.0 to 0.40.0 by @dependabot[bot] in #784
• Bump actions/cache from 4 to 5 by @dependabot[bot] in #790
• Bump github.com/olekukonko/tablewriter from 1.1.0 to 1.1.3 by @dependabot[bot] in #825
• Bump github.com/go-git/go-git/v5 from 5.16.2 to 5.16.4 by @dependabot[bot] in #772
• Bump github.com/prometheus/client_golang from 1.23.0 to 1.23.2 by @dependabot[bot] in #675
• Bump golang.org/x/text from 0.31.0 to 0.33.0 by @dependabot[bot] in #823
• chore(deps): update grafana/grafana docker tag to v12.3.1 by @renovate-sh-app[bot] in #829
• chore(deps): update docker/dockerfile docker tag to v1.20.0 by @renovate-sh-app[bot] in #828
• docs: improve documentation discoverability by @jalevin in #832
• chore(deps): update playwright monorepo to v1.57.0 by @renovate-sh-app[bot] in #834
• chore(deps): update grafana/shared-workflows/get-vault-secrets action to v1.3.0 by @renovate-sh-app[bot] in #833
• chore(deps): update dependency go to v1.25.6 by @renovate-sh-app[bot] in #827
• Bump github.com/spf13/cobra from 1.9.1 to 1.10.2 by @dependabot[bot] in #783
• Bump softprops/action-gh-release from 2.3.3 to 2.5.0 by @dependabot[bot] in #780
• (BREAKING CHANGES) Bench support for multitenant services. v1.0.0 by @jalevin in #831
• add support for go benchmark by @jalevin in #840

Full Changelog: v0.6.11...v1.0.0