1
0
mirror of https://github.com/scrapy/scrapy.git synced 2025-02-06 10:24:24 +00:00

Commit Graph

  • 754ccc6c11
    Merge c1a46b28f5e5424eb8734fea6835d1e4f2d03672 into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Andrey Rakhmatullin 2025-02-06 13:54:36 +05:00
  • 61dbe6762a
    Merge be75e74af8fed193259ce2b6a9a2440a88a6cb2f into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Gaurav Ramnani 2025-02-06 07:18:17 +00:00
  • 5a838cd0f6
    Merge 85c2d530ed9ff80605499a66d897fb80d5740d05 into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Georgiy Zatserklianyi 2025-02-06 10:28:03 +05:30
  • 0889645744
    Merge 95881ee62b9b19f0d37469ff659b1574b46bb35d into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Taito Horiuchi 2025-02-06 08:54:22 +08:00
  • 305e324586
    Merge 15233dff9f65e67a90617109ecbd35d1aa3db16a into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Laerte Pereira 2025-02-06 00:38:24 +00:00
  • 15233dff9f
    Change condition syntax Laerte Pereira 2025-02-05 21:38:21 -03:00
  • 7e9b56daf5 fix: Reactor info logged twice Laerte Pereira 2025-02-05 18:50:04 -03:00
  • d58fa63747
    Merge ea9a52fe626853ad49ab3a8964a058defd34a711 into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Nitin Tejuja 2025-02-06 02:44:11 +05:30
  • 55e84a0f45
    Merge f46b8473f04e4a6a8845530b7814b2dd8829f223 into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 Georgiy Zatserklianyi 2025-02-05 20:55:39 +01:00
  • b4f09ea093
    Merge 5dc41f4cfa46522971bb5b5aef14a5fa145d984a into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 WinterComes 2025-02-05 20:40:56 +03:00
  • d7b8f705f2
    Merge 340cea6d67e7ef5d9a7f1f6332ef14e499560f5a into 02ad6bd1f6ab9623ac0c2a2b01c766d36e6c3c43 anubhav 2025-02-05 22:37:36 +05:30
  • 02ad6bd1f6
    Merge pull request #6656 from Laerte/master master Andrey Rakhmatullin 2025-02-05 21:05:54 +04:00
  • 2eb3c75c69 Remove AjaxCrawlMiddleware mention from built-in downloader middleware Laerte Pereira 2025-02-05 13:16:51 -03:00
  • 9fd08a92a8
    Merge pull request #6655 from Laerte/master Andrey Rakhmatullin 2025-02-05 16:49:56 +04:00
  • 9d35428770 Remove deprecated signals Laerte Pereira 2025-02-05 06:48:56 -03:00
  • e7c32fb7be
    Merge ae6cfec7c62877699ff65001a08f56f29ecc3238 into cc480680d784886bff97cdcdc789238187a56f3a Bernardas Ališauskas 2025-02-04 16:33:56 -03:00
  • a3e4a74a3f
    Merge 3eae8d53f09e6209db99ced81835f3a1d69d80e3 into cc480680d784886bff97cdcdc789238187a56f3a Vineeth Sai 2025-02-04 16:53:59 +05:30
  • 340cea6d67 changes to custom style for higher resolution anubhav 2025-02-04 12:49:07 +05:30
  • 0ad0d63668 Added comment about custom style in custom.css anubhav 2025-02-04 12:17:34 +05:30
  • 7f3bb8a3f5 dark mode disabled by default in conf.py anubhav 2025-02-04 09:32:20 +05:30
  • 850e751caa dark mode for scrapy documentation anubhav 2025-02-04 09:09:39 +05:30
  • 439e36b51e
    Merge 4de7eb3396a63d67fd1b34f8d07eda734769945b into cc480680d784886bff97cdcdc789238187a56f3a Andrey Rakhmatullin 2025-02-04 00:33:25 +05:00
  • cc480680d7
    Merge pull request #6650 from wRAR/cleanup-cache-tests Andrey Rakhmatullin 2025-02-03 23:33:07 +04:00
  • 4de7eb3396 Implement the changes for unknown encoding handling. Andrey Rakhmatullin 2025-02-03 22:28:46 +05:00
  • e5e4c2fc4f Merge branch 'master' into warn-unsupported-encodings Andrey Rakhmatullin 2025-02-03 22:22:26 +05:00
  • ba5df629a2
    Refactor downloader tests (#6647) Andrey Rakhmatullin 2025-02-03 19:11:47 +04:00
  • 16e39661e9
    Merge pull request #6651 from wRAR/deprecate-ajaxcrawl Andrey Rakhmatullin 2025-02-03 13:57:46 +04:00
  • 76a8badd24 Add a deprecation notice to the AjaxCrawlMiddleware docs. Andrey Rakhmatullin 2025-02-03 14:55:10 +05:00
  • 4842bcbf1d Deprecate and disable escape_ajax(). Andrey Rakhmatullin 2025-02-02 23:23:51 +05:00
  • 393ff96e45 Deprecate AjaxCrawlMiddleware. Andrey Rakhmatullin 2024-11-07 21:21:17 +05:00
  • b4c2531021
    Merge pull request #6648 from wRAR/mockserver-calls Mikhail Korobov 2025-02-03 14:06:35 +05:00
  • c727c6f201
    Merge pull request #6646 from wRAR/engine-tests-cleanup Mikhail Korobov 2025-02-03 13:56:47 +05:00
  • df688910e0 Remove a duplicate test. Andrey Rakhmatullin 2025-02-02 18:48:26 +05:00
  • 783b98deda Make mockserver instances per-class. Andrey Rakhmatullin 2025-02-02 14:10:09 +05:00
  • 1a0dfbd32e Reuse mockserver instances in test_feedexport.py. Andrey Rakhmatullin 2025-02-02 13:28:34 +05:00
  • 1066e37e52 Revert "Simplify the H2DownloadHandler import." Andrey Rakhmatullin 2025-02-02 01:57:28 +05:00
  • 579bee5856 Forbig pytest 8.2.x. Andrey Rakhmatullin 2025-02-02 01:36:10 +05:00
  • ed187046ac Simplify the H2DownloadHandler import. Andrey Rakhmatullin 2025-02-02 01:31:21 +05:00
  • 79480658cd Move FTP imports back to the top level. Andrey Rakhmatullin 2025-02-02 01:20:21 +05:00
  • 190967439d Remove an obsolete service_identity check. Andrey Rakhmatullin 2025-02-02 01:17:41 +05:00
  • 542764c02f Don't run tests in imported base classes. Andrey Rakhmatullin 2025-02-02 00:45:53 +05:00
  • 9d10ce56a0 Don't run the full test suite for special HTTP cases. Andrey Rakhmatullin 2025-02-02 00:36:05 +05:00
  • fcc4d30df0 Small cleanup. Andrey Rakhmatullin 2025-02-01 23:47:12 +05:00
  • b4a8c11453 Make download handler test base classes abstract. Andrey Rakhmatullin 2025-02-01 23:16:12 +05:00
  • b23148b852
    Merge 4eed8e2d609bcd1be7ee59cab1a17422b5432381 into 340819eff095a76ca824874dbf1ea9f841716d54 Cyril Mouchel 2025-02-01 11:15:38 +00:00
  • 8624ae9988
    Merge 846b2da04ebc75a455a4acc1a18814a1dfb5d1c1 into 340819eff095a76ca824874dbf1ea9f841716d54 Patrick-Culley 2025-02-01 11:14:53 +00:00
  • bc147b96e0
    Merge 25e60cee6ac6916203f156094d96fbeaee16a57f into 340819eff095a76ca824874dbf1ea9f841716d54 Elias Dorneles 2025-02-01 11:13:57 +00:00
  • 85280d2453
    Merge 1e14be77434ce2c71e0559d99bf0ecca91827a5e into 340819eff095a76ca824874dbf1ea9f841716d54 Georgiy Zatserklianyi 2025-02-01 11:13:31 +00:00
  • d4a21f0fbd
    Merge 0fe0109386df7a0ee4cc3e7f61459c1fe6a6e603 into 340819eff095a76ca824874dbf1ea9f841716d54 Adrián Chaves 2025-02-01 11:11:40 +00:00
  • 3f4b2d1462
    Merge d5a35a60a9299d1861106625a6f3c98486483249 into 340819eff095a76ca824874dbf1ea9f841716d54 smellslikeml 2025-02-01 11:10:49 +00:00
  • ee6024ba4c
    Merge 859976ef1977ff92766e00d005046e4d64804d46 into 340819eff095a76ca824874dbf1ea9f841716d54 Martin Schimandl 2025-02-01 11:10:43 +00:00
  • 49c9710d59
    Merge 3b407cf04057143a28b36f1572e1b653bf4885b4 into 340819eff095a76ca824874dbf1ea9f841716d54 Aseem Saxena 2025-02-01 11:09:48 +00:00
  • df82f67f0e
    Merge c008fa6dfcfb1f5ff2a9cfffff86329e408a1ba5 into 340819eff095a76ca824874dbf1ea9f841716d54 Lucas Belo 2025-02-01 11:07:56 +00:00
  • 9a534613b2
    Merge 25241f2cc0f23687edc6cbda0020c9d1b628da9f into 340819eff095a76ca824874dbf1ea9f841716d54 immerrr again 2025-02-01 11:07:55 +00:00
  • 200d76afa9 Refactor EngineTest tests. Andrey Rakhmatullin 2025-02-01 16:07:55 +05:00
  • 28bf244e20
    Merge 0354bbc5e87ee8f3b378a5fcd15c7ab115932c28 into 340819eff095a76ca824874dbf1ea9f841716d54 Mikhail Korobov 2025-02-01 11:07:39 +00:00
  • 7c417c244e
    Merge f80beea6f8eefa2790467fb29279e74b421e8ed7 into 340819eff095a76ca824874dbf1ea9f841716d54 w-495 2025-02-01 11:07:32 +00:00
  • 98f831b6cc
    Merge 12a28daedbeb05c789acf823538dafd49f73d054 into 340819eff095a76ca824874dbf1ea9f841716d54 stranac 2025-02-01 11:07:23 +00:00
  • 2982b8be1d
    Merge 37ca67f0a2e6ee18a393dc1daca92e34be2c973d into 340819eff095a76ca824874dbf1ea9f841716d54 Adrián Chaves 2025-02-01 11:07:13 +00:00
  • f22c306c5f
    Merge e75cd113d9d4c7afe1fe51bd73d71ad0f9f3a9b7 into 340819eff095a76ca824874dbf1ea9f841716d54 JosephFarrell 2025-02-01 11:05:42 +00:00
  • fa67598363
    Merge 53a38eeb13ae49615ba51f1ae86a087f3f85253f into 340819eff095a76ca824874dbf1ea9f841716d54 Hassaan Naushahi 2025-02-01 11:05:31 +00:00
  • 03585fefee
    Merge 5f454941e88f1750ec4f72bd160dd12de5c735ba into 340819eff095a76ca824874dbf1ea9f841716d54 Adrián Chaves 2025-02-01 11:04:53 +00:00
  • 014d0a2bfb
    Merge 7538718464b0e3b48707b919cdb3f8bce2f1ebe5 into 340819eff095a76ca824874dbf1ea9f841716d54 Anubhav Patel 2025-02-01 11:04:42 +00:00
  • 3e0e4623ba
    Merge 32750db59f59d8c305fbde3e8eb3bf6105c02668 into 340819eff095a76ca824874dbf1ea9f841716d54 guillermo-bondonno 2025-01-29 15:07:22 +03:00
  • 340819eff0
    Merge pull request #6635 from wRAR/webclient-cleanup Andrey Rakhmatullin 2025-01-28 23:08:06 +04:00
  • 0a80871c3a Remove scrapy.core.downloader.webclient._parse(). Andrey Rakhmatullin 2025-01-28 22:22:09 +05:00
  • a8d9746f56
    Merge pull request #6634 from wRAR/deprecate-http10 Andrey Rakhmatullin 2025-01-28 13:29:25 +04:00
  • 0d2d2892ba Silence the readBody warning. Andrey Rakhmatullin 2025-01-28 02:08:49 +05:00
  • bc1aeeefc9 Deprecate overriding ScrapyClientContextFactory.getContext(). Andrey Rakhmatullin 2025-01-28 01:54:43 +05:00
  • 16b998f9ca Sort out webclient tests. Andrey Rakhmatullin 2025-01-28 01:33:00 +05:00
  • d27c6b46b1 Deprecate HTTP/1.0 support. Andrey Rakhmatullin 2025-01-27 21:25:47 +05:00
  • 98a57e2418
    Fix error when running scrapy bench (#6633) Lidiane T 2025-01-27 10:21:30 +00:00
  • cec0aeca58
    Bump ruff, switch from black to ruff-format (#6631) Andrey Rakhmatullin 2025-01-27 14:07:09 +04:00
  • b88829ce4e
    Add a test reproducing the bug Lidiane Taquehara 2025-01-25 20:53:59 +00:00
  • be9e80afb1
    Fix AssertionError when running scrapy bench Lidiane Taquehara 2025-01-25 10:42:06 +00:00
  • 7219d778aa Switch from black to ruff-format. Andrey Rakhmatullin 2025-01-25 01:35:07 +05:00
  • fecc0fb948 Bump ruff. Andrey Rakhmatullin 2025-01-25 01:24:50 +05:00
  • c03fb2abb8
    fix: added feed_options as a keyword argument to GCSFeedStorage. (#6628) anubhav 2025-01-23 21:36:45 +05:30
  • f46b8473f0 spiderloader (load spider from given location) Georgiy Zatserklianyi 2025-01-23 15:57:43 +01:00
  • ec52e09134 added two test cases to GCSFeedStorageTest... anubhav 2025-01-23 16:57:04 +05:30
  • 7bfb7e4e75 add feed_options to GCSFeedStorage anubhav 2025-01-23 14:04:11 +05:30
  • d4b152bbf6
    Drop PyPy 3.9, add a pypy3-extra-deps CI job. (#6613) Andrey Rakhmatullin 2025-01-23 12:22:18 +04:00
  • 85c3b6a149 reverted all the changes... anubhav 2025-01-23 13:18:17 +05:30
  • 82dabbec18
    Merge 2960b16ca340f81489cb28b0d1aa8b2c7f4b8354 into 7e61ff352439d3e5c85785fc26b5503e4fed67b8 Andrey Rakhmatullin 2025-01-23 14:25:19 +07:00
  • 596444df7a undo changes from previous commit... anubhav 2025-01-23 11:55:07 +05:30
  • 9dd99879f1 added feed_options as a keyword argument to GCSFeedStorage... anubhav 2025-01-23 00:20:55 +05:30
  • c1de8920aa Typo. Andrey Rakhmatullin 2025-01-22 22:54:50 +05:00
  • fc380b2cb9 Disable coverage for PyPy again. Andrey Rakhmatullin 2025-01-22 22:27:43 +05:00
  • 7e61ff3524
    Upgrade Sphinx (#6624) Rotzbua 2025-01-22 18:09:42 +01:00
  • ea9a52fe62 Modified docs to use default strings in feeds export nitintecg 2025-01-09 22:54:39 +00:00
  • eefbf44b30
    chore(docs): bump sphinx to v8 Rotzbua 2025-01-22 15:06:34 +01:00
  • 499b6c66b4
    Merge pull request #6626 from Laerte/master Andrey Rakhmatullin 2025-01-22 15:14:33 +04:00
  • 9bc0029d27
    Allow updating pre-crawler settings from add-ons (#6568) guillermo-bondonno 2025-01-22 08:07:44 -03:00
  • 14219b1fca fix: test_s3_export fails with boto3 >= 1.36.0 Laerte Pereira 2025-01-22 07:16:22 -03:00
  • af048af1c6 early settings → pre-crawler settings; improve docs Adrián Chaves 2025-01-21 14:48:23 +01:00
  • c8436483ba Fix test_s3_export StubAssertionError by allowing ChecksumAlgorithm Azraf 2025-01-21 06:33:26 -05:00
  • 8fa0d9bbb0
    addons docs improvement guillermo-bondonno 2025-01-20 11:32:03 -03:00
  • 62dc027d2e
    addons docs improvement guillermo-bondonno 2025-01-20 11:31:52 -03:00
  • 08f5eac3be
    Update docs/topics/addons.rst guillermo-bondonno 2025-01-20 11:31:36 -03:00
  • e0c828b7f6
    chore(docs): refactor config (#6623) Rotzbua 2025-01-20 12:18:30 +01:00