literal workaround

[ahuang11]

Since quotations '"table"."name"' is unconventional, the LLMs would hallucinate table names, i.e. drop quotations, and it would crash the Pydantic model, raising an invalid error. So, to workaround that, replaces everything except alphanumeric with _ which the LLM understands/copies well, then remaps it back to the original table name with all the special characters after the LLM chooses the table.

[codecov]

Codecov Report

Attention: Patch coverage is 25.00000% with 9 lines in your changes missing coverage. Please review.

Project coverage is 60.87%. Comparing base (687d54f) to head (28992cf).
Report is 11 commits behind head on main.

Files with missing lines	Patch %	Lines
lumen/ai/utils.py	33.33%	4 Missing ⚠️
lumen/ai/agents.py	0.00%	3 Missing ⚠️
lumen/ai/coordinator.py	33.33%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main     #777      +/-   ##
==========================================
- Coverage   60.92%   60.87%   -0.06%     
==========================================
  Files         103      103              
  Lines       12556    12573      +17     
==========================================
+ Hits         7650     7654       +4     
- Misses       4906     4919      +13     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[philippjfr]

Honestly, I believe you this works but it seems pretty hacky.

[ahuang11]

Superseded by #799