Skip to content

Pull requests: scrapy/scrapy

New pull request New
204 Open 3,701 Closed
204 Open 3,701 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Add HttpxDownloader. enhancement
#7239 opened Feb 3, 2026 by wRAR • Draft
1
4
docs: document files created inside JOBDIR
#7231 opened Feb 1, 2026 by NandanKopplu Loading…
3 tasks done
1
Docs: Document job directory contents in jobs.rst
#7219 opened Jan 14, 2026 by Feashliaa Loading…
Add Request to Response lifecycle documentation needs more info
#7203 opened Dec 29, 2025 by ajbmachon Loading…
7
Await persist_file() in media pipelines. asyncio bug
#7182 opened Dec 16, 2025 by wRAR • Draft
1
3
Refactor AutoThrottle and deprecate the download_delay spider attr (#7167)
#7175 opened Dec 13, 2025 by DenisC96 Loading…
1
5
Allow specifying sitemap meta
#7174 opened Dec 12, 2025 by vrana Loading…
1
File download error fix at staus code 201
#7130 opened Oct 28, 2025 by rohan45327 Loading…
3
Docs: Request callbacks
#7119 opened Oct 24, 2025 by Suchi1905 Loading…
1
8
Added structured logging to systemd journal.
#7115 opened Oct 24, 2025 by AliAlimohammadi Loading…
40
Address typos and grammar issues in docs/
#7114 opened Oct 23, 2025 by Gallaecio • Draft
1
Docs: Cleaned and added proper JOBDIR file documentation (fixes #4842)
#7110 opened Oct 20, 2025 by veerasai06 Loading…
1
6
Document files created in JOBDIR: requests.seen, requests.queue, etc.
#7108 opened Oct 19, 2025 by louraider Loading…
1
scrapy-spider-metadata docs added
#7096 opened Oct 15, 2025 by vasiliyk Loading…
1
1
Ipv6 support for proxy
#7090 opened Oct 12, 2025 by vasiliyk Loading…
1
9
Support for Python 3.14 compression.zstd
#7083 opened Oct 7, 2025 by vasiliyk Loading…
1
1
add tests for #7036
#7078 opened Oct 5, 2025 by albertedwardson Loading…
1
tests(memusage): add unit tests covering scrapy.extensions.memusage.MemoryUsage (resolves #7002) stale
#7061 opened Sep 29, 2025 by T-leke • Draft
1
4
Docs: clarify JOBDIR common files (requests.seen, spider.state) (#4842)
#7056 opened Sep 25, 2025 by TJPcodes Loading…
Reducing memory footprint of Request object: __slots__ and lazy evaluation enhancement performance
#7036 opened Sep 1, 2025 by albertedwardson Loading…
10
tests: integration coverage for memusage extension
#7017 opened Aug 22, 2025 by Lions-1 Loading…
1
19
Optimise SitemapSpider memory usage enhancement performance
#7007 opened Aug 12, 2025 by albertedwardson Loading…
1
42
Fix getwithbase() to drop base keys when there is a setting value (#6912)
#7001 opened Aug 9, 2025 by adglee • Draft
1
1
fix duplicate keys in settings.getwithbase() (#6912)
#7000 opened Aug 9, 2025 by Aearsears Loading…
1
3
Fix override behavior in getwithbase() issue #6912
#6993 opened Aug 7, 2025 by Ryotaro25 Loading…
1
1
ProTip! Follow long discussions with comments:>50.