Upstream Merge #1
Open
+130,072
−75,884
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Preview environment iamrony777-searxng-pr-1 is being deployed... |
|
Your preview environment iamrony777-searxng-pr-1 failed to deploy. |
Signed-off-by: Markus Heiser <[email protected]>
…ugin Co-authored-by: Markus Heiser <[email protected]>
351fcdf - 2024-06-14 - return42 <[email protected]> 4ab6400 - 2024-06-13 - Xvnov <[email protected]> 8f1bb9a - 2024-06-14 - return42 <[email protected]> fa14755 - 2024-06-12 - MVDW-Java <[email protected]> 3beab11 - 2024-06-11 - return42 <[email protected]> 52f4506 - 2024-06-11 - mukmckenzie <[email protected]> c61f2cb - 2024-06-11 - tentsbet <[email protected]> 7c74be3 - 2024-06-10 - nebras <[email protected]> b5aace1 - 2024-06-07 - SomeTr <[email protected]> fc187ae - 2024-06-07 - return42 <[email protected]> cf3a8d3 - 2024-06-07 - return42 <[email protected]> bfc316b - 2024-06-07 - diodio <[email protected]> a27e158 - 2024-06-07 - return42 <[email protected]> 6bd0bf1 - 2024-06-07 - return42 <[email protected]> 9b2b3aa - 2024-06-07 - return42 <[email protected]> 4171675 - 2024-06-07 - return42 <[email protected]> 08c9fef - 2024-06-07 - return42 <[email protected]> dd2555f - 2024-06-07 - return42 <[email protected]> e69dc5d - 2024-06-07 - ganoci <[email protected]> a350313 - 2024-06-08 - ghose <[email protected]> a2a2f07 - 2024-06-07 - return42 <[email protected]> 35b9d1b - 2024-06-07 - return42 <[email protected]> d53560d - 2024-06-07 - return42 <[email protected]> 58c3c04 - 2024-06-07 - return42 <[email protected]> d7847aa - 2024-06-07 - EifionLlwyd <[email protected]> 3a114bf - 2024-06-07 - Fjuro <[email protected]> 1f2fc0f - 2024-06-07 - return42 <[email protected]> 17a7862 - 2024-06-07 - return42 <[email protected]> 6e8bdfd - 2024-06-07 - diodio <[email protected]>
Bumps [redis](https://github.com/redis/redis-py) from 5.0.5 to 5.0.6. - [Release notes](https://github.com/redis/redis-py/releases) - [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES) - [Commits](redis/redis-py@v5.0.5...v5.0.6) --- updated-dependencies: - dependency-name: redis dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]>
This change does the following things: - the `ip` keyword is now case-insensitive - if the query includes `my ip` it will now also match In order to avoid too many false matches, the `ip` keyword alone matches only if it's the _only_ word, but the inclusion of `my` loosens that to be inclusive of users type a phrase (eg, "what is my ip", "tell me my ip", "my IP address", etc). Better answer context Previously this plugin simply dumped your IP or user-agent string as an answer. This tiny change just adds some text to contextualize those answers (eg, "Your IP is: 1.2.3.4" instead of just "1.2.3.4").
Fix installing answerers when installing SearXNG through a wheel [1]. These files have been missed in commit d72fa99. Here is what have been tested: $ make clean py.build ... $ python -m venv test123 $ . ./test123/bin/activate (test123) $ pip install dist/searxng-2024*-py3-none-any.whl (test123) $ SEARXNG_DEBUG=1 searxng-run [1] #3045 (comment)
The data types (list & map) should be made clearer, as these sometimes lead to misunderstandings. [1] #3558 (comment) Signed-off-by: Markus Heiser <[email protected]>
3e3c194 - 2024-06-20 - Vulcain <[email protected]> 0ffab2b - 2024-06-19 - LunarCat93 <[email protected]> 36809a1 - 2024-06-19 - return42 <[email protected]> a97aff3 - 2024-06-19 - MonsoonRain <[email protected]> 5d7cbca - 2024-06-17 - SomeTr <[email protected]> ada44ff - 2024-06-17 - Xvnov <[email protected]> 2f398eb - 2024-06-18 - tiziodcaio <[email protected]> 11fde54 - 2024-06-18 - ghose <[email protected]> 7de1d0c - 2024-06-18 - return42 <[email protected]> eeb9500 - 2024-06-18 - return42 <[email protected]>
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.21.0 to 4.22.0. - [Release notes](https://github.com/SeleniumHQ/Selenium/releases) - [Commits](SeleniumHQ/selenium@selenium-4.21.0...selenium-4.22.0) --- updated-dependencies: - dependency-name: selenium dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]>
Enables unit tests in the engines directory by adding __init__.py, and fixups for the enabled tests.
Closes: #3502 Signed-off-by: Markus Heiser <[email protected]>
The domains of zlibrary instances are known to be seized from time to time. This leads to problems when, for example, the automated tasks try to update the engine traits (aka fetch_traits). The search function should also generate a suitable error message (currently either SSL errors or empty result lists are returned). [1] [1] #3610 Signed-off-by: Markus Heiser <[email protected]>
Signed-off-by: Markus Heiser <[email protected]>
$ make data.traits Last GH action has been failed [1], the bugfixes from - #3611 - #3612 were necessary to update the data. [1] https://github.com/searxng/searxng/actions/runs/9278028691/job/25528337485 Signed-off-by: Markus Heiser <[email protected]>
Reddit is enabled by default .. many bot request will go through Reddit .. we should disable Reddit by default to cool down the IP [1]. [1] #3444 (comment) Closes: #3444 Signed-off-by: Markus Heiser <[email protected]>
Depending on the order in which the unit tests are executed, the python modules
of the engines are initialized (monkey patched) or not. As the order of the
tests is not static, random errors may occur.
To avaoid random `NameError: name 'logger' is not defined` in the unit tests of
the xpath engine, a logger is monkey patched into the xpath py-module.
```
make test.unit
TEST tests/unit
......EE...................
======================================================================
ERROR: test_response (tests.unit.engines.test_xpath.TestXpathEngine.test_response)
----------------------------------------------------------------------
Traceback (most recent call last):
File "./tests/unit/engines/test_xpath.py", line 60, in test_response
self.assertEqual(xpath.response(response), [])
^^^^^^^^^^^^^^^^^^^^^^^^
File "./searx/engines/xpath.py", line 309, in response
logger.debug("found %s results", len(results))
^^^^^^
NameError: name 'logger' is not defined
======================================================================
ERROR: test_response_results_xpath (tests.unit.engines.test_xpath.TestXpathEngine.test_response_results_xpath)
----------------------------------------------------------------------
Traceback (most recent call last):
File "./tests/unit/engines/test_xpath.py", line 102, in test_response_results_xpath
self.assertEqual(xpath.response(response), [])
^^^^^^^^^^^^^^^^^^^^^^^^
File "./searx/engines/xpath.py", line 309, in response
logger.debug("found %s results", len(results))
^^^^^^
NameError: name 'logger' is not defined
```
Signed-off-by: Markus Heiser <[email protected]>
Bumps [redis](https://github.com/redis/redis-py) from 5.0.6 to 5.0.7. - [Release notes](https://github.com/redis/redis-py/releases) - [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES) - [Commits](redis/redis-py@v5.0.6...v5.0.7) --- updated-dependencies: - dependency-name: redis dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]>
4fc3ba3 - 2024-06-27 - Kita Ikuyo <[email protected]> 15a6fae - 2024-06-26 - artnay <[email protected]> 2cb0884 - 2024-06-27 - MonsoonRain <[email protected]> 794c9db - 2024-06-25 - return42 <[email protected]> 8edf874 - 2024-06-25 - Linerly <[email protected]> bc97997 - 2024-06-26 - LIGMATV <[email protected]> d8620ed - 2024-06-24 - ahmetax <[email protected]> 7d8d658 - 2024-06-25 - gvlx <[email protected]> 57f8e9b - 2024-06-25 - return42 <[email protected]> 7364acb - 2024-06-25 - eddywidjaja <[email protected]> 9f6ddc2 - 2024-06-24 - return42 <[email protected]> a64f2e7 - 2024-06-21 - PeterDaveHello <[email protected]> cc195d7 - 2024-06-21 - nish_j <[email protected]> 87d2e16 - 2024-06-22 - tentsbet <[email protected]> 2c73400 - 2024-06-22 - return42 <[email protected]> a467cf8 - 2024-06-21 - Fjuro <[email protected]>
The entire source code of the duckduckgo engine has been reengineered and purified. 1. DDG used the URL https://html.duckduckgo.com/html for no-JS requests whose response is also easier to parse than the previous https://lite.duckduckgo.com/lite/ URL 2. the bot detection of DDG has so far caused problems and often led to a CAPTCHA, this can be circumvented using `'Sec-Fetch-Mode'] = “navigate”` Closes: #3927 Signed-off-by: Markus Heiser <[email protected]>
… at `$.favicons.cache.db_url` Closes: #3975 Signed-off-by: Markus Heiser <[email protected]>
a4cdaaa - 2024-10-30 - Juno Takano <[email protected]> 46bad3a - 2024-10-29 - saltsnorter <[email protected]> 6a4096d - 2024-10-27 - Eryk Michalak <[email protected]> 64815d9 - 2024-10-28 - ljansen <[email protected]> 851ae55 - 2024-10-26 - return42 <[email protected]> 24f16d5 - 2024-10-26 - return42 <[email protected]> 8278d1c - 2024-10-26 - Atul_Eterno <[email protected]>
The test.coverage cause a lot of failed CI jobs for reasons that cannot be explained. As we do not monitor the coverage anyway, it is superfluous to run this job, especially as it only has a disruptive effect on the CI. BTW and the CI action upload-artifact@v3 is deprecated [1] [1] https://github.com/actions/upload-artifact?tab=readme-ov-file#actionsupload-artifact Related: #3983 Signed-off-by: Markus Heiser <[email protected]>
Signed-off-by: Markus Heiser <[email protected]>
Signed-off-by: Markus Heiser <[email protected]>
Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.25.0 to 4.26.1. - [Release notes](https://github.com/SeleniumHQ/Selenium/releases) - [Commits](https://github.com/SeleniumHQ/Selenium/commits) --- updated-dependencies: - dependency-name: selenium dependency-type: direct:development update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]>
8d90a7e - 2024-11-06 - sahussawud <[email protected]> 41ee8bb - 2024-11-02 - laaknor <[email protected]> c1a30af - 2024-11-02 - return42 <[email protected]> 627ab7a - 2024-11-01 - zarlin <[email protected]>
Bumps [typer-slim](https://github.com/fastapi/typer) from 0.12.5 to 0.13.0. - [Release notes](https://github.com/fastapi/typer/releases) - [Changelog](https://github.com/fastapi/typer/blob/master/docs/release-notes.md) - [Commits](fastapi/typer@0.12.5...0.13.0) --- updated-dependencies: - dependency-name: typer-slim dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]>
…tings Remove 'Autodetect search language', which is no longer valid, from settings, and add 'Unit converter plugin', which is now default enabled, to settings.
during the revision in PR #3955 the query string was accidentally converted into a list of words, further the query must be quoted before POSTed in the ``data`` field, see ``urllib.parse.quote_plus`` [1] [1] https://docs.python.org/3/library/urllib.parse.html#urllib.parse.quote_plus Closed: #4009 Co-Authored-by: @return42
0216898 - 2024-11-14 - KhietVo <[email protected]> 3293db4 - 2024-11-14 - return42 <[email protected]> 574e0d6 - 2024-11-13 - lrnz2 <[email protected]> a32d9d1 - 2024-11-08 - Aadniz <[email protected]>
Bumps [flask](https://github.com/pallets/flask) from 3.0.3 to 3.1.0. - [Release notes](https://github.com/pallets/flask/releases) - [Changelog](https://github.com/pallets/flask/blob/main/CHANGES.rst) - [Commits](pallets/flask@3.0.3...3.1.0) --- updated-dependencies: - dependency-name: flask dependency-type: direct:production update-type: version-update:semver-minor ... Signed-off-by: dependabot[bot] <[email protected]>
The query string send to DDG must not be qouted. The query string was URL-qouted in #4011, but the URL-qouted query string result in unexpected *URL decoded* and other garbish results as reported in #4019 and #4020. To test compare the results of a query like:: !ddg Häuser und Straßen :de !ddg Häuser und Straßen :all !ddg 房屋和街道 :all !ddg 房屋和街道 :zh Closed: - [#4019] #4019 - [#4020] #4020 Related: - [#4011] #4011 Signed-off-by: Markus Heiser <[email protected]>
Bumps [setproctitle](https://github.com/dvarrazzo/py-setproctitle) from 1.3.3 to 1.3.4. - [Changelog](https://github.com/dvarrazzo/py-setproctitle/blob/master/HISTORY.rst) - [Commits](dvarrazzo/py-setproctitle@version-1.3.3...version-1.3.4) --- updated-dependencies: - dependency-name: setproctitle dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]>
Bumps [typer-slim](https://github.com/fastapi/typer) from 0.13.0 to 0.13.1. - [Release notes](https://github.com/fastapi/typer/releases) - [Changelog](https://github.com/fastapi/typer/blob/master/docs/release-notes.md) - [Commits](fastapi/typer@0.13.0...0.13.1) --- updated-dependencies: - dependency-name: typer-slim dependency-type: direct:production update-type: version-update:semver-patch ... Signed-off-by: dependabot[bot] <[email protected]>
6581d89 - 2024-11-21 - return42 <[email protected]> a342903 - 2024-11-21 - return42 <[email protected]> 61d3236 - 2024-11-21 - return42 <[email protected]> cd03e8c - 2024-11-21 - return42 <[email protected]> a2399e2 - 2024-11-20 - tentsbet <[email protected]> 9a5bcc0 - 2024-11-17 - cherrad <[email protected]> 4364e5e - 2024-11-16 - DiamondBrain113 <[email protected]> e3a127e - 2024-11-15 - KinoCineaste <[email protected]>
In order to be able to implement error handling, it is necessary to know which URL triggered the exception / the URL has not yet been logged. Signed-off-by: Markus Heiser <[email protected]>
Avoid HTTP 404 and redirects. Requests to the JSON/YAML API use the base url [1]
https://www.loc.gov/{endpoint}/?fo=json
[1] https://www.loc.gov/apis/json-and-yaml/requests/
Signed-off-by: Markus Heiser <[email protected]>
The quantities on the intro page were partly out of date / example; we already have 210 engines and not just 70. To avoid having to change the quantities manually in the future, they are now calculated from the jinja context Signed-off-by: Markus Heiser <[email protected]>
Engine was added in #2733 but the API does no longer exists. Related: - #4038 Signed-off-by: Markus Heiser <[email protected]>
The engine has been revised; there is now the option ``adobe_content_types``
with which it is possible to configure engines for video and audio from the
adobe stock. BTW this patch adds documentation to the engine.
To test all three engines in one use a search term like::
!asi !asv !asa sound
Signed-off-by: Markus Heiser <[email protected]>
Signed-off-by: Markus Heiser <[email protected]>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.