Skip to content

feat: set baseline scrape defaults for reliability and integration#1

Merged
gildesmarais merged 2 commits intomainfrom
codex-botasaurus-baseline-defaults
Apr 20, 2026
Merged

feat: set baseline scrape defaults for reliability and integration#1
gildesmarais merged 2 commits intomainfrom
codex-botasaurus-baseline-defaults

Conversation

@gildesmarais
Copy link
Copy Markdown
Member

@gildesmarais gildesmarais commented Apr 20, 2026

Summary

  • commit 1: default block_images to true for POST /scrape baseline request behavior
  • commit 2: align timeout defaults with html2rss/html2rss-web runtime budget (SCRAPE_TIMEOUT_SECONDS=25, wait_timeout_seconds=15)
  • keep existing tiny_profile=true and headless=false baseline behavior
  • update README and API contract unit coverage for the new defaults

Validation

  • SMOKE_HOST_PORT=4110 make smoke (pass)

@gildesmarais gildesmarais changed the title Set baseline scrape defaults for better reliability feat: set baseline scrape defaults for better reliability Apr 20, 2026
@gildesmarais gildesmarais changed the title feat: set baseline scrape defaults for better reliability feat: set baseline scrape defaults for reliability and integration Apr 20, 2026
@gildesmarais gildesmarais merged commit 092a216 into main Apr 20, 2026
5 checks passed
@gildesmarais gildesmarais deleted the codex-botasaurus-baseline-defaults branch April 20, 2026 16:47
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant