Remove brotli compression from accepted encodings for indeed sessions

Resolves an issue where indeed responses are not being decoded correctly. Might resolve issue #137
PaulMcInnis · Mar 25, 2021 · 2128be1 · 2128be1
1 parent e1f1dfa
commit 2128be1
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/jobfunnel/backend/scrapers/indeed.py b/jobfunnel/backend/scrapers/indeed.py
@@ -103,7 +103,7 @@ def headers(self) -> Dict[str, str]:
         return {
             'accept': 'text/html,application/xhtml+xml,application/xml;'
             'q=0.9,image/webp,*/*;q=0.8',
-            'accept-encoding': 'gzip, deflate, sdch, br',
+            'accept-encoding': 'gzip, deflate, sdch',
             'accept-language': 'en-GB,en-US;q=0.8,en;q=0.6',
             'referer':
                 f'https://www.indeed.{self.config.search_config.domain}/',