Support token counting for OpenAI, DashScope, Gemini and HuggingFace models#470

Merged

DavdGao merged 9 commits intomodelscope:mainfrom DavdGao:dev/tokens

Nov 5, 2024

+536-4

Commits on Oct 23, 2024

Commits on Oct 31, 2024

Support vision models in OpenAI token counting function; Add unit test for OpenAI vision models
DavdGao
committed

Commits on Nov 1, 2024

Fix error in web_browser.py.
DavdGao
committed