Signed-off-by: Markus Heiser <[email protected]>

…ugin

Co-authored-by: Markus Heiser <[email protected]>

351fcdf - 2024-06-14 - return42 <[email protected]>
4ab6400 - 2024-06-13 - Xvnov <[email protected]>
8f1bb9a - 2024-06-14 - return42 <[email protected]>
fa14755 - 2024-06-12 - MVDW-Java <[email protected]>
3beab11 - 2024-06-11 - return42 <[email protected]>
52f4506 - 2024-06-11 - mukmckenzie <[email protected]>
c61f2cb - 2024-06-11 - tentsbet <[email protected]>
7c74be3 - 2024-06-10 - nebras <[email protected]>
b5aace1 - 2024-06-07 - SomeTr <[email protected]>
fc187ae - 2024-06-07 - return42 <[email protected]>
cf3a8d3 - 2024-06-07 - return42 <[email protected]>
bfc316b - 2024-06-07 - diodio <[email protected]>
a27e158 - 2024-06-07 - return42 <[email protected]>
6bd0bf1 - 2024-06-07 - return42 <[email protected]>
9b2b3aa - 2024-06-07 - return42 <[email protected]>
4171675 - 2024-06-07 - return42 <[email protected]>
08c9fef - 2024-06-07 - return42 <[email protected]>
dd2555f - 2024-06-07 - return42 <[email protected]>
e69dc5d - 2024-06-07 - ganoci <[email protected]>
a350313 - 2024-06-08 - ghose <[email protected]>
a2a2f07 - 2024-06-07 - return42 <[email protected]>
35b9d1b - 2024-06-07 - return42 <[email protected]>
d53560d - 2024-06-07 - return42 <[email protected]>
58c3c04 - 2024-06-07 - return42 <[email protected]>
d7847aa - 2024-06-07 - EifionLlwyd <[email protected]>
3a114bf - 2024-06-07 - Fjuro <[email protected]>
1f2fc0f - 2024-06-07 - return42 <[email protected]>
17a7862 - 2024-06-07 - return42 <[email protected]>
6e8bdfd - 2024-06-07 - diodio <[email protected]>

Bumps [redis](https://github.com/redis/redis-py) from 5.0.5 to 5.0.6.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](redis/redis-py@v5.0.5...v5.0.6)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

This change does the following things:

- the `ip` keyword is now case-insensitive
- if the query includes `my ip` it will now also match

In order to avoid too many false matches, the `ip` keyword alone matches only if
it's the _only_ word, but the inclusion of `my` loosens that to be inclusive of
users type a phrase (eg, "what is my ip", "tell me my ip", "my IP address",
etc).

Better answer context

Previously this plugin simply dumped your IP or user-agent string as an answer.
This tiny change just adds some text to contextualize those answers (eg, "Your
IP is: 1.2.3.4" instead of just "1.2.3.4").

Fix installing answerers when installing SearXNG through a wheel [1].  These
files have been missed in commit d72fa99.

Here is what have been tested:

    $ make clean py.build
    ...
    $ python -m venv test123
    $ . ./test123/bin/activate
    (test123) $ pip install dist/searxng-2024*-py3-none-any.whl
    (test123) $ SEARXNG_DEBUG=1 searxng-run

[1] #3045 (comment)

The data types (list & map) should be made clearer, as these sometimes lead to
misunderstandings.

[1] #3558 (comment)

Signed-off-by: Markus Heiser <[email protected]>

3e3c194 - 2024-06-20 - Vulcain <[email protected]>
0ffab2b - 2024-06-19 - LunarCat93 <[email protected]>
36809a1 - 2024-06-19 - return42 <[email protected]>
a97aff3 - 2024-06-19 - MonsoonRain <[email protected]>
5d7cbca - 2024-06-17 - SomeTr <[email protected]>
ada44ff - 2024-06-17 - Xvnov <[email protected]>
2f398eb - 2024-06-18 - tiziodcaio <[email protected]>
11fde54 - 2024-06-18 - ghose <[email protected]>
7de1d0c - 2024-06-18 - return42 <[email protected]>
eeb9500 - 2024-06-18 - return42 <[email protected]>

Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.21.0 to 4.22.0.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](SeleniumHQ/selenium@selenium-4.21.0...selenium-4.22.0)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

Enables unit tests in the engines directory by adding __init__.py, and fixups
for the enabled tests.

Closes: #3502
Signed-off-by: Markus Heiser <[email protected]>

The domains of zlibrary instances are known to be seized from time to time.
This leads to problems when, for example, the automated tasks try to update the
engine traits (aka fetch_traits). The search function should also generate a
suitable error message (currently either SSL errors or empty result lists are
returned). [1]

[1] #3610
Signed-off-by: Markus Heiser <[email protected]>

Signed-off-by: Markus Heiser <[email protected]>

    $ make data.traits

Last GH action has been failed [1], the bugfixes from

- #3611
- #3612

were necessary to update the data.

[1] https://github.com/searxng/searxng/actions/runs/9278028691/job/25528337485

Signed-off-by: Markus Heiser <[email protected]>

Reddit is enabled by default .. many bot request will go through Reddit .. we
should disable Reddit by default to cool down the IP [1].

[1] #3444 (comment)

Closes: #3444
Signed-off-by: Markus Heiser <[email protected]>

Depending on the order in which the unit tests are executed, the python modules
of the engines are initialized (monkey patched) or not. As the order of the
tests is not static, random errors may occur.

To avaoid random `NameError: name 'logger' is not defined` in the unit tests of
the xpath engine, a logger is monkey patched into the xpath py-module.

```
make test.unit
TEST      tests/unit
......EE...................
======================================================================
ERROR: test_response (tests.unit.engines.test_xpath.TestXpathEngine.test_response)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "./tests/unit/engines/test_xpath.py", line 60, in test_response
    self.assertEqual(xpath.response(response), [])
                     ^^^^^^^^^^^^^^^^^^^^^^^^
  File "./searx/engines/xpath.py", line 309, in response
    logger.debug("found %s results", len(results))
    ^^^^^^
NameError: name 'logger' is not defined

======================================================================
ERROR: test_response_results_xpath (tests.unit.engines.test_xpath.TestXpathEngine.test_response_results_xpath)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "./tests/unit/engines/test_xpath.py", line 102, in test_response_results_xpath
    self.assertEqual(xpath.response(response), [])
                     ^^^^^^^^^^^^^^^^^^^^^^^^
  File "./searx/engines/xpath.py", line 309, in response
    logger.debug("found %s results", len(results))
    ^^^^^^
NameError: name 'logger' is not defined
```

Signed-off-by: Markus Heiser <[email protected]>

Bumps [redis](https://github.com/redis/redis-py) from 5.0.6 to 5.0.7.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](redis/redis-py@v5.0.6...v5.0.7)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

4fc3ba3 - 2024-06-27 - Kita Ikuyo <[email protected]>
15a6fae - 2024-06-26 - artnay <[email protected]>
2cb0884 - 2024-06-27 - MonsoonRain <[email protected]>
794c9db - 2024-06-25 - return42 <[email protected]>
8edf874 - 2024-06-25 - Linerly <[email protected]>
bc97997 - 2024-06-26 - LIGMATV <[email protected]>
d8620ed - 2024-06-24 - ahmetax <[email protected]>
7d8d658 - 2024-06-25 - gvlx <[email protected]>
57f8e9b - 2024-06-25 - return42 <[email protected]>
7364acb - 2024-06-25 - eddywidjaja <[email protected]>
9f6ddc2 - 2024-06-24 - return42 <[email protected]>
a64f2e7 - 2024-06-21 - PeterDaveHello <[email protected]>
cc195d7 - 2024-06-21 - nish_j <[email protected]>
87d2e16 - 2024-06-22 - tentsbet <[email protected]>
2c73400 - 2024-06-22 - return42 <[email protected]>
a467cf8 - 2024-06-21 - Fjuro <[email protected]>

1f7de30 - 2024-07-04 - Jeex <[email protected]>
5d34f39 - 2024-07-04 - return42 <[email protected]>
930a817 - 2024-07-04 - return42 <[email protected]>
53936f2 - 2024-07-03 - return42 <[email protected]>
3fcf83c - 2024-07-02 - rodgui <[email protected]>
19b2f9a - 2024-07-03 - seonghobae <[email protected]>
07ef05d - 2024-06-30 - return42 <[email protected]>
23f2ef2 - 2024-06-29 - geekom13 <[email protected]>

Bumps [pylint](https://github.com/pylint-dev/pylint) from 3.2.3 to 3.2.5.
- [Release notes](https://github.com/pylint-dev/pylint/releases)
- [Commits](pylint-dev/pylint@v3.2.3...v3.2.5)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Bumps [certifi](https://github.com/certifi/python-certifi) from 2024.6.2 to 2024.7.4.
- [Commits](certifi/python-certifi@2024.06.02...2024.07.04)

---
updated-dependencies:
- dependency-name: certifi
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

cleanup

Import annontations

Engines are loaded into global name `searx.engines.engines` other applications
such as statistics or the histogram use this global variable to search for
values in their own memories, which can lead to key errors as described in

- #2988

Signed-off-by: Markus Heiser <[email protected]>
Closes: #2988

cecd918 - 2024-07-11 - ds451 <[email protected]>
8e9bf64 - 2024-07-10 - wazhanudin <[email protected]>
82e209f - 2024-07-08 - notlmutsaers <[email protected]>
428204a - 2024-07-08 - alexgabi <[email protected]>
4dd1651 - 2024-07-08 - notlmutsaers <[email protected]>
fb5015d - 2024-07-08 - notlmutsaers <[email protected]>
686800d - 2024-07-08 - louispires <[email protected]>
7fc33af - 2024-07-05 - wags07 <[email protected]>
cbab31e - 2024-07-06 - jonkke9 <[email protected]>

HINT: this is a workaround to fix a rendering bug in FFox-Desktop [3]

Descenders [1] in the URL are truncated, caused by the `overflow: hidden;`
because part of link overflow the flex box [2].

[1] https://en.wikipedia.org/wiki/Descender
[2] #3550
[3] #3592 (comment)

Closes: #3550
Suggested-by: @coxde
Signed-off-by: Markus Heiser <[email protected]>

If the flag icon is first, it prevents easily searching the select list on the
keyboard.  By moving the icon fully to the right, this will enable a user to
search the select list.

Closes: #3645

Co-authored-by: Markus Heiser <[email protected]>

The intention of this PR is to modernize the settings_loader implementations.
The concept is old (remember, this is partly from 2014), back then we only had
one config file, meanwhile we have had a folder with config files for a very
long time.  Callers can now load a YAML configuration from this folder as
follows ::

    settings_loader.get_yaml_cfg('my-config.yml')

- BTW this is a fix of #3557.

- Further the `existing_filename_or_none` construct dates back to times when
  there was not yet a `pathlib.Path` in all Python versions we supported in the
  past.

- Typehints have been added wherever appropriate

At the same time, this patch should also be downward compatible and not
introduce a new environment variable. The localization of the folder with the
configurations is further based on:

    SEARXNG_SETTINGS_PATH (wich defaults to /etc/searxng/settings.yml)

Which means, the default config folder is `/etc/searxng/`.

ATTENTION: intended functional changes!

 If SEARXNG_SETTINGS_PATH was set and pointed to a not existing file, the
 previous implementation silently loaded the default configuration.  This
 behavior has been changed: if the file or folder does not exist, an
 EnvironmentError exception will be thrown in future.

Closes: #3557
Signed-off-by: Markus Heiser <[email protected]>

A recent update from Mullvad Leta introduced the img_elem. This update
broke the existing logic. Now, by checking the length of the dom_result
to see if it was included in the return results, we can handle the logic
accordingly.

94bacfa - 2024-07-19 - wazhanudin <[email protected]>
360fa8b - 2024-07-19 - return42 <[email protected]>
b378bf4 - 2024-07-12 - return42 <[email protected]>
8110ad6 - 2024-07-12 - return42 <[email protected]>

Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.22.0 to 4.23.0.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](SeleniumHQ/selenium@selenium-4.22.0...selenium-4.23.0)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

https://search.lomig.me
  Poor results / tested `!yacy :en hello` and got zero results

https://yacy.ecosys.eu
  Slow response (> 6sec for trivial search terms)

https://search.webproject.link
  Dead instance / URL offline

Signed-off-by: Markus Heiser <[email protected]>

2b14808 - 2024-07-26 - pdwalker <[email protected]>

Closes: #3649

Bumps [pylint](https://github.com/pylint-dev/pylint) from 3.2.5 to 3.2.6.
- [Release notes](https://github.com/pylint-dev/pylint/releases)
- [Commits](pylint-dev/pylint@v3.2.5...v3.2.6)

---
updated-dependencies:
- dependency-name: pylint
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Bumps [selenium](https://github.com/SeleniumHQ/Selenium) from 4.23.0 to 4.23.1.
- [Release notes](https://github.com/SeleniumHQ/Selenium/releases)
- [Commits](https://github.com/SeleniumHQ/Selenium/commits)

---
updated-dependencies:
- dependency-name: selenium
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

The `_STORAGE_UNIT_VALUE` dictionary is a left over from:

- #3570

in this PR we removed the old implementations but forgot to delete this
`_STORAGE_UNIT_VALUE`.

Closes: #3672
Signed-off-by: Markus Heiser <[email protected]>

Bumps [sphinx](https://github.com/sphinx-doc/sphinx) from 7.3.7 to 7.4.7.
- [Release notes](https://github.com/sphinx-doc/sphinx/releases)
- [Changelog](https://github.com/sphinx-doc/sphinx/blob/master/CHANGES.rst)
- [Commits](sphinx-doc/sphinx@v7.3.7...v7.4.7)

---
updated-dependencies:
- dependency-name: sphinx
  dependency-type: direct:development
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

The result.content field is *safe* HTML, tags to highlight search terms are
intended.

Signed-off-by: Markus Heiser <[email protected]>

…template

Its a leftover from 657dcb9

Signed-off-by: Markus Heiser <[email protected]>

In my review of [1] I tried to reformat the template code of the language
menue whereby I have made two mistakes.

- default language was added twice
- in the 'Auto-detect' item a hard coded `[auto]` was implemented where the
  `search_language` variable was needed.

[1] #3645

Signed-off-by: Markus Heiser <[email protected]>

Fault pattern: if there are no offers, then an exception has been thrown:

    IndexError: list index out of range

This patch makes the addition of “best price” dependent on whether one exists.

Closes: #3685
Signed-off-by: Markus Heiser <[email protected]>

Signed-off-by: Markus Heiser <[email protected]>

    $ make data.traits

Last GH action has been failed [1], the bugfixes from aa05685
were necessary to update the data.

[1] https://github.com/searxng/searxng/actions/runs/10135834050/job/28023757191

Signed-off-by: Markus Heiser <[email protected]>

458a223 - 2024-08-01 - Wexterity <[email protected]>
615d49d - 2024-08-01 - return42 <[email protected]>
16bfd76 - 2024-08-01 - Thecode764 <[email protected]>
ccd38ad - 2024-07-31 - return42 <[email protected]>
3820b92 - 2024-07-31 - Shpubly <[email protected]>
11c302c - 2024-07-29 - return42 <[email protected]>
a588e2e - 2024-07-29 - return42 <[email protected]>
15ba3d4 - 2024-07-29 - ghose <[email protected]>
a160c69 - 2024-07-30 - wags07 <[email protected]>
fc9d877 - 2024-07-29 - nebras <[email protected]>
61eaf70 - 2024-07-28 - SomeTr <[email protected]>
3c7e9cd - 2024-07-27 - return42 <[email protected]>
babce47 - 2024-07-27 - EifionLlwyd <[email protected]>
0b467dd - 2024-07-27 - Fjuro <[email protected]>

Bumps [sphinx-notfound-page](https://github.com/readthedocs/sphinx-notfound-page) from 1.0.2 to 1.0.4.
- [Changelog](https://github.com/readthedocs/sphinx-notfound-page/blob/main/CHANGELOG.rst)
- [Commits](readthedocs/sphinx-notfound-page@1.0.2...1.0.4)

---
updated-dependencies:
- dependency-name: sphinx-notfound-page
  dependency-type: direct:development
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Bumps [redis](https://github.com/redis/redis-py) from 5.0.7 to 5.0.8.
- [Release notes](https://github.com/redis/redis-py/releases)
- [Changelog](https://github.com/redis/redis-py/blob/master/CHANGES)
- [Commits](redis/redis-py@v5.0.7...v5.0.8)

---
updated-dependencies:
- dependency-name: redis
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>

Google underlines words inside of answers that can be clicked to show
additional definitions. These definitions inside the answer were not
correctly handled and ended up in the middle of the answer text. With
this fix, the extra definitions are stripped from the answer shown by
the frontend.

The successor is “hostname plugin” from PR:

- #3463

---

Revert "[refactor] hostnames plugin: add fallback for old hostname_replace plugin"

This reverts commit f5eb56b.

Signed-off-by: Markus Heiser <[email protected]>

Bumps [babel](https://github.com/python-babel/babel) from 2.15.0 to 2.16.0.
- [Release notes](https://github.com/python-babel/babel/releases)
- [Changelog](https://github.com/python-babel/babel/blob/master/CHANGES.rst)
- [Commits](python-babel/babel@v2.15.0...v2.16.0)

---
updated-dependencies:
- dependency-name: babel
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <[email protected]>

Bumps [pyyaml](https://github.com/yaml/pyyaml) from 6.0.1 to 6.0.2.
- [Release notes](https://github.com/yaml/pyyaml/releases)
- [Changelog](https://github.com/yaml/pyyaml/blob/main/CHANGES)
- [Commits](yaml/pyyaml@6.0.1...6.0.2)

---
updated-dependencies:
- dependency-name: pyyaml
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <[email protected]>