Fixing a bug with reading response bytes in playwright/camoufox when …

…`network_idle` is used PlayWright doesn't provide a way to get the response in bytes after all wait ends like `page.content()` so that's more efficient to do anyway
D4Vinci · Nov 20, 2024 · 4c74d9b · 4c74d9b
1 parent 1473803
commit 4c74d9b
Show file tree

Hide file tree

Showing 2 changed files with 2 additions and 2 deletions.
diff --git a/scrapling/engines/camo.py b/scrapling/engines/camo.py
@@ -114,7 +114,7 @@ def fetch(self, url: str) -> Response:
             response = Response(
                 url=res.url,
                 text=page.content(),
-                body=res.body(),
+                body=page.content().encode('utf-8'),
                 status=res.status,
                 reason=res.status_text,
                 encoding=encoding,

diff --git a/scrapling/engines/pw.py b/scrapling/engines/pw.py
@@ -224,7 +224,7 @@ def fetch(self, url: str) -> Response:
             response = Response(
                 url=res.url,
                 text=page.content(),
-                body=res.body(),
+                body=page.content().encode('utf-8'),
                 status=res.status,
                 reason=res.status_text,
                 encoding=encoding,