You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hello, and thank you for your interest in Crawlee! Do I understand it right that you want to prevent images and such from loading? Perhaps to save bandwidth and make scraping faster?
Once pre-navigation hooks are implemented (#427), I would utilize those to call page.route and set up blocking as you like. As of now, I'm not aware of an easy way to do this.
Just one note about this, request interception (page.route) means not being able to reuse the resource cache of the browser. You can use this approach to save bandwidth, but it will result in worse overall performance most likely.
Activity
janbuchar commentedon Oct 29, 2024
Hello, and thank you for your interest in Crawlee! Do I understand it right that you want to prevent images and such from loading? Perhaps to save bandwidth and make scraping faster?
zhk0603 commentedon Oct 29, 2024
yes
janbuchar commentedon Oct 29, 2024
Once pre-navigation hooks are implemented (#427), I would utilize those to call
page.routeand set up blocking as you like. As of now, I'm not aware of an easy way to do this.B4nan commentedon Oct 29, 2024
Just one note about this, request interception (
page.route) means not being able to reuse the resource cache of the browser. You can use this approach to save bandwidth, but it will result in worse overall performance most likely.