KeyError: "Attempt to overwrite 'name' in LogRecord" in async_pipeline.py

[danliszka1]

Running the AsyncPipeline gave me a KeyError, originating from the log statement on line 138 in async_pipeline.py

Environment:

• Python version: 3.11.8
• Library tag: 0.6.0

Stack trace:

2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack_experimental/core/pipeline/async_pipeline.py", line 509, in run_async
2025-02-11 12:26:49     async for partial in self.run_async_generator(
2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack_experimental/core/pipeline/async_pipeline.py", line 384, in run_async_generator
2025-02-11 12:26:49     async for partial_result in _wait_for_one_task_to_complete():
2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack_experimental/core/pipeline/async_pipeline.py", line 265, in _wait_for_one_task_to_complete
2025-02-11 12:26:49     partial_result = finished.result()
2025-02-11 12:26:49                      ^^^^^^^^^^^^^^^^^
2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack_experimental/core/pipeline/async_pipeline.py", line 244, in _runner
2025-02-11 12:26:49     result = await _run_component_async(component_name, component_inputs)
2025-02-11 12:26:49              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack_experimental/core/pipeline/async_pipeline.py", line 138, in _run_component_async
2025-02-11 12:26:49     logger.info("Running component {name}", name=component_name)
2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack/logging.py", line 144, in _log_only_with_kwargs
2025-02-11 12:26:49     return func(
2025-02-11 12:26:49            ^^^^^
2025-02-11 12:26:49   File "/usr/local/lib/python3.11/logging/__init__.py", line 1489, in info
2025-02-11 12:26:49     self._log(INFO, msg, args, **kwargs)
2025-02-11 12:26:49   File "/usr/local/lib/python3.11/logging/__init__.py", line 1632, in _log
2025-02-11 12:26:49     record = self.makeRecord(self.name, level, fn, lno, msg, args,
2025-02-11 12:26:49              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-02-11 12:26:49   File "/src/app/.venv/lib/python3.11/site-packages/haystack/logging.py", line 197, in _wrapper
2025-02-11 12:26:49     return original_make_records(name, level, fn, lno, interpolated_msg, (), exc_info, func, extra, sinfo)
2025-02-11 12:26:49            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
2025-02-11 12:26:49   File "/usr/local/lib/python3.11/logging/__init__.py", line 1606, in makeRecord
2025-02-11 12:26:49     raise KeyError("Attempt to overwrite %r in LogRecord" % key)
2025-02-11 12:26:49 KeyError: "Attempt to overwrite 'name' in LogRecord"

[mathislucka]

Thanks for reporting @danliszka1! We'll work on a fix quickly. Note that we now also merged the AsyncPipeline into haystack main. We'll have the 2.10 release this week, so please switch to the implementation in main once it's available there.