You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Move blocked_status_codes from Session to the crawler #2139
Blocked status codes are configured per Session (src/crawlee/sessions/_session.py), even though deciding whether a response means "blocked" is the crawler's concern - and the crawler already owns additional_http_error_status_codes and ignore_http_error_status_codes. Move it to a crawler option and keep the handling internal to the crawler.
Activity