deepseek-r1-qwen xinference 发布后，在测试界面报错 #2885
Comments
我尝试将gradio降低到<4.0和pydantic<2.0版本,解决了这个问题 pip install "gradio<4.0"
pip install "pydantic_core<2"这个情况会在官方镜像得到优化吗？ |
|
提示： xinference launch --model_path /root/.cache/huggingface/hub/deepseek-r1-distill-qwen-1.5b-awq --model-engine transformers --model-name deepseek-r1-distill-qwen --size-in-billions 1_5 --model-format awq --quantization Int4(base) root@6124cea6235e:/# xinference launch --model_path /root/.cache/huggingface/hub/deepseek-r1-distill-qwen-1.5b-awq --model-engine transformers --model-name deepseek-r1-distill-qwen --size-in-billions 1_5 --model-format awq --quantization Int4
Launch model name: deepseek-r1-distill-qwen with kwargs: {'model_path': '/root/.cache/huggingface/hub/deepseek-r1-distill-qwen-1.5b-awq'}
Traceback (most recent call last):
File "/opt/conda/bin/xinference", line 8, in <module>
sys.exit(cli())
^^^^^
File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1161, in __call__
return self.main(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1082, in main
rv = self.invoke(ctx)
^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1697, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 1443, in invoke
return ctx.invoke(self.callback, **ctx.params)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/click/core.py", line 788, in invoke
return __callback(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/click/decorators.py", line 33, in new_func
return f(get_current_context(), *args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/xinference/deploy/cmdline.py", line 908, in model_launch
model_uid = client.launch_model(
^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/lib/python3.11/site-packages/xinference/client/restful/restful_client.py", line 999, in launch_model
raise RuntimeError(
RuntimeError: Failed to launch model, detail: [address=0.0.0.0:39895, pid=1087] To use IPEX backend, you need autoawq>0.6.2. Please install the latest version or from source. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
System Info / 系統信息
xinference:v1.2.2-cpu
Running Xinference with Docker? / 是否使用 Docker 运行 Xinfernece？
Version info / 版本信息
xinference:v1.2.2-cpu，在容器内部通过 pip list获得的信息
The command used to start Xinference / 用以启动 xinference 的命令
docker compose 启动，然后进入容器内部执行命令
docker compose 文件如下
Reproduction / 复现过程
复现过程：
4.通过web进入测试界面
5. 输入测试指令
这是console中的详细报错信息
xinference-1 | 2025-02-19T03:24:16.934029010Z loading configuration file /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b/config.json
xinference-1 | 2025-02-19T03:24:16.936248465Z 2025-02-19 11:24:16,936 transformers.configuration_utils 895 INFO Model config Qwen2Config {
xinference-1 | 2025-02-19T03:24:16.936267491Z "_name_or_path": "/root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b",
xinference-1 | 2025-02-19T03:24:16.936272070Z "architectures": [
xinference-1 | 2025-02-19T03:24:16.936275323Z "Qwen2ForCausalLM"
xinference-1 | 2025-02-19T03:24:16.936278260Z ],
xinference-1 | 2025-02-19T03:24:16.936281439Z "attention_dropout": 0.0,
xinference-1 | 2025-02-19T03:24:16.936284673Z "bos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:16.936287578Z "eos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:16.936290368Z "hidden_act": "silu",
xinference-1 | 2025-02-19T03:24:16.936293466Z "hidden_size": 3584,
xinference-1 | 2025-02-19T03:24:16.936296285Z "initializer_range": 0.02,
xinference-1 | 2025-02-19T03:24:16.936299059Z "intermediate_size": 18944,
xinference-1 | 2025-02-19T03:24:16.936302158Z "max_position_embeddings": 131072,
xinference-1 | 2025-02-19T03:24:16.936305011Z "max_window_layers": 28,
xinference-1 | 2025-02-19T03:24:16.936310855Z "model_type": "qwen2",
xinference-1 | 2025-02-19T03:24:16.936313673Z "num_attention_heads": 28,
xinference-1 | 2025-02-19T03:24:16.936316749Z "num_hidden_layers": 28,
xinference-1 | 2025-02-19T03:24:16.936319647Z "num_key_value_heads": 4,
xinference-1 | 2025-02-19T03:24:16.936322531Z "rms_norm_eps": 1e-06,
xinference-1 | 2025-02-19T03:24:16.936337283Z "rope_scaling": null,
xinference-1 | 2025-02-19T03:24:16.936341011Z "rope_theta": 10000,
xinference-1 | 2025-02-19T03:24:16.936344211Z "sliding_window": null,
xinference-1 | 2025-02-19T03:24:16.936347028Z "tie_word_embeddings": false,
xinference-1 | 2025-02-19T03:24:16.936349794Z "torch_dtype": "float32",
xinference-1 | 2025-02-19T03:24:16.936352577Z "transformers_version": "4.48.3",
xinference-1 | 2025-02-19T03:24:16.936355814Z "use_cache": true,
xinference-1 | 2025-02-19T03:24:16.936359162Z "use_mrope": false,
xinference-1 | 2025-02-19T03:24:16.936362180Z "use_sliding_window": false,
xinference-1 | 2025-02-19T03:24:16.936365215Z "vocab_size": 152064
xinference-1 | 2025-02-19T03:24:16.936368107Z }
xinference-1 | 2025-02-19T03:24:16.936370827Z
xinference-1 | 2025-02-19T03:24:16.936378250Z Model config Qwen2Config {
xinference-1 | 2025-02-19T03:24:16.936381539Z "_name_or_path": "/root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b",
xinference-1 | 2025-02-19T03:24:16.936384915Z "architectures": [
xinference-1 | 2025-02-19T03:24:16.936387883Z "Qwen2ForCausalLM"
xinference-1 | 2025-02-19T03:24:16.936390630Z ],
xinference-1 | 2025-02-19T03:24:16.936393667Z "attention_dropout": 0.0,
xinference-1 | 2025-02-19T03:24:16.936396683Z "bos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:16.936399721Z "eos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:16.936402424Z "hidden_act": "silu",
xinference-1 | 2025-02-19T03:24:16.936405536Z "hidden_size": 3584,
xinference-1 | 2025-02-19T03:24:16.936408509Z "initializer_range": 0.02,
xinference-1 | 2025-02-19T03:24:16.936411273Z "intermediate_size": 18944,
xinference-1 | 2025-02-19T03:24:16.936414047Z "max_position_embeddings": 131072,
xinference-1 | 2025-02-19T03:24:16.936417334Z "max_window_layers": 28,
xinference-1 | 2025-02-19T03:24:16.936420220Z "model_type": "qwen2",
xinference-1 | 2025-02-19T03:24:16.936423136Z "num_attention_heads": 28,
xinference-1 | 2025-02-19T03:24:16.936426112Z "num_hidden_layers": 28,
xinference-1 | 2025-02-19T03:24:16.936428984Z "num_key_value_heads": 4,
xinference-1 | 2025-02-19T03:24:16.936432026Z "rms_norm_eps": 1e-06,
xinference-1 | 2025-02-19T03:24:16.936434993Z "rope_scaling": null,
xinference-1 | 2025-02-19T03:24:16.936438205Z "rope_theta": 10000,
xinference-1 | 2025-02-19T03:24:16.936441181Z "sliding_window": null,
xinference-1 | 2025-02-19T03:24:16.936443916Z "tie_word_embeddings": false,
xinference-1 | 2025-02-19T03:24:16.936446708Z "torch_dtype": "float32",
xinference-1 | 2025-02-19T03:24:16.936449521Z "transformers_version": "4.48.3",
xinference-1 | 2025-02-19T03:24:16.936452528Z "use_cache": true,
xinference-1 | 2025-02-19T03:24:16.936478069Z "use_mrope": false,
xinference-1 | 2025-02-19T03:24:16.936524542Z "use_sliding_window": false,
xinference-1 | 2025-02-19T03:24:16.936575880Z "vocab_size": 152064
xinference-1 | 2025-02-19T03:24:16.936606938Z }
xinference-1 | 2025-02-19T03:24:16.936620058Z
xinference-1 | 2025-02-19T03:24:17.263300773Z 2025-02-19 11:24:17,263 transformers.modeling_utils 895 INFO loading weights file /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b/model.safetensors.index.json
xinference-1 | 2025-02-19T03:24:17.263335648Z loading weights file /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b/model.safetensors.index.json
xinference-1 | 2025-02-19T03:24:17.263692207Z 2025-02-19 11:24:17,263 transformers.modeling_utils 895 INFO Instantiating Qwen2ForCausalLM model under default dtype torch.float32.
xinference-1 | 2025-02-19T03:24:17.263743772Z Instantiating Qwen2ForCausalLM model under default dtype torch.float32.
xinference-1 | 2025-02-19T03:24:17.265202469Z 2025-02-19 11:24:17,265 transformers.generation.configuration_utils 895 INFO Generate config GenerationConfig {
xinference-1 | 2025-02-19T03:24:17.265220364Z "bos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:17.265224455Z "eos_token_id": 151643
xinference-1 | 2025-02-19T03:24:17.265227562Z }
xinference-1 | 2025-02-19T03:24:17.265230429Z
xinference-1 | 2025-02-19T03:24:17.265257203Z Generate config GenerationConfig {
xinference-1 | 2025-02-19T03:24:17.265264311Z "bos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:17.265267612Z "eos_token_id": 151643
xinference-1 | 2025-02-19T03:24:17.265270579Z }
xinference-1 | 2025-02-19T03:24:17.265273641Z
Loading checkpoint shards: 100%|█████████████████| 2/2 [00:02<00:00, 1.27s/it]
xinference-1 | 2025-02-19T03:24:19.856022983Z 2025-02-19 11:24:19,855 transformers.modeling_utils 895 INFO All model checkpoint weights were used when initializing Qwen2ForCausalLM.
xinference-1 | 2025-02-19T03:24:19.856043588Z
xinference-1 | 2025-02-19T03:24:19.856116166Z All model checkpoint weights were used when initializing Qwen2ForCausalLM.
xinference-1 | 2025-02-19T03:24:19.856124339Z
xinference-1 | 2025-02-19T03:24:19.856188283Z 2025-02-19 11:24:19,856 transformers.modeling_utils 895 INFO All the weights of Qwen2ForCausalLM were initialized from the model checkpoint at /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b.
xinference-1 | 2025-02-19T03:24:19.856202856Z If your task is similar to the task the model of the checkpoint was trained on, you can already use Qwen2ForCausalLM for predictions without further training.
xinference-1 | 2025-02-19T03:24:19.856221471Z All the weights of Qwen2ForCausalLM were initialized from the model checkpoint at /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b.
xinference-1 | 2025-02-19T03:24:19.856232251Z If your task is similar to the task the model of the checkpoint was trained on, you can already use Qwen2ForCausalLM for predictions without further training.
xinference-1 | 2025-02-19T03:24:20.033863228Z 2025-02-19 11:24:20,033 transformers.generation.configuration_utils 895 INFO loading configuration file /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b/generation_config.json
xinference-1 | 2025-02-19T03:24:20.033914489Z loading configuration file /root/.xinference/cache/deepseek-r1-distill-qwen-pytorch-7b/generation_config.json
xinference-1 | 2025-02-19T03:24:20.034287472Z 2025-02-19 11:24:20,034 transformers.generation.configuration_utils 895 INFO Generate config GenerationConfig {
xinference-1 | 2025-02-19T03:24:20.034304324Z "bos_token_id": 151646,
xinference-1 | 2025-02-19T03:24:20.034307814Z "do_sample": true,
xinference-1 | 2025-02-19T03:24:20.034310716Z "eos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:20.034313584Z "temperature": 0.6,
xinference-1 | 2025-02-19T03:24:20.034316389Z "top_p": 0.95
xinference-1 | 2025-02-19T03:24:20.034319111Z }
xinference-1 | 2025-02-19T03:24:20.034321741Z
xinference-1 | 2025-02-19T03:24:20.034336378Z Generate config GenerationConfig {
xinference-1 | 2025-02-19T03:24:20.034349354Z "bos_token_id": 151646,
xinference-1 | 2025-02-19T03:24:20.034352721Z "do_sample": true,
xinference-1 | 2025-02-19T03:24:20.034356622Z "eos_token_id": 151643,
xinference-1 | 2025-02-19T03:24:20.034359602Z "temperature": 0.6,
xinference-1 | 2025-02-19T03:24:20.034362617Z "top_p": 0.95
xinference-1 | 2025-02-19T03:24:20.034365585Z }
xinference-1 | 2025-02-19T03:24:20.034368537Z
xinference-1 | 2025-02-19T03:24:20.039889925Z 2025-02-19 11:24:20,039 xinference.core.model 895 INFO ModelActor(deepseek-r1-distill-qwen-0) loaded
xinference-1 | 2025-02-19T03:24:20.041223817Z 2025-02-19 11:24:20,041 xinference.core.worker 56 INFO [request fc1d9df2-ee70-11ef-9cb5-0242ac150002] Leave launch_builtin_model, elapsed time: 9 s
xinference-1 | 2025-02-19T03:24:29.607775623Z 2025-02-19 11:24:29,604 xinference.api.restful_api 1 ERROR Handling request http://localhost:9997/deepseek-r1-distill-qwen/run/predict failed: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set
arbitrary_types_allowed=Truein the model_config to ignore this error or implement__get_pydantic_core_schema__on your type to fully support it.xinference-1 | 2025-02-19T03:24:29.607800455Z
xinference-1 | 2025-02-19T03:24:29.607804169Z If you got this error by calling handler() within
__get_pydantic_core_schema__then you likely need to callhandler.generate_schema(<some type>)since we do not call__get_pydantic_core_schema__on<some type>otherwise to avoid infinite recursion.xinference-1 | 2025-02-19T03:24:29.607807979Z
xinference-1 | 2025-02-19T03:24:29.607810770Z For further information visit https://errors.pydantic.dev/2.10/u/schema-for-unknown-type
xinference-1 | 2025-02-19T03:24:29.607814056Z Traceback (most recent call last):
xinference-1 | 2025-02-19T03:24:29.607816938Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 271, in _init_core_attrs
xinference-1 | 2025-02-19T03:24:29.607820013Z self.core_schema = _getattr_no_parents(self._type, 'pydantic_core_schema')
xinference-1 | 2025-02-19T03:24:29.607822873Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.607825666Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 55, in _getattr_no_parents
xinference-1 | 2025-02-19T03:24:29.607828609Z raise AttributeError(attribute)
xinference-1 | 2025-02-19T03:24:29.607841597Z AttributeError: pydantic_core_schema
xinference-1 | 2025-02-19T03:24:29.607844739Z
xinference-1 | 2025-02-19T03:24:29.607847597Z During handling of the above exception, another exception occurred:
xinference-1 | 2025-02-19T03:24:29.607850479Z
xinference-1 | 2025-02-19T03:24:29.607853515Z Traceback (most recent call last):
xinference-1 | 2025-02-19T03:24:29.607856341Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
xinference-1 | 2025-02-19T03:24:29.607859453Z await self.app(scope, receive, _send)
xinference-1 | 2025-02-19T03:24:29.607862159Z File "/opt/conda/lib/python3.11/site-packages/aioprometheus/asgi/middleware.py", line 184, in call
xinference-1 | 2025-02-19T03:24:29.607865029Z await self.asgi_callable(scope, receive, wrapped_send)
xinference-1 | 2025-02-19T03:24:29.607867796Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
xinference-1 | 2025-02-19T03:24:29.607870849Z await self.simple_response(scope, receive, send, request_headers=headers)
xinference-1 | 2025-02-19T03:24:29.607873773Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/cors.py", line 144, in simple_response
xinference-1 | 2025-02-19T03:24:29.607876630Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607880393Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
xinference-1 | 2025-02-19T03:24:29.607883469Z await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607886225Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.607889100Z raise exc
xinference-1 | 2025-02-19T03:24:29.607892102Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.607895124Z await app(scope, receive, sender)
xinference-1 | 2025-02-19T03:24:29.607898066Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
xinference-1 | 2025-02-19T03:24:29.607900891Z await self.middleware_stack(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607903593Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
xinference-1 | 2025-02-19T03:24:29.607906376Z await route.handle(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607909350Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 460, in handle
xinference-1 | 2025-02-19T03:24:29.607912329Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607914967Z File "/opt/conda/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
xinference-1 | 2025-02-19T03:24:29.607917864Z await super().call(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607920645Z File "/opt/conda/lib/python3.11/site-packages/starlette/applications.py", line 112, in call
xinference-1 | 2025-02-19T03:24:29.607925734Z await self.middleware_stack(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607928501Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in call
xinference-1 | 2025-02-19T03:24:29.607934797Z raise exc
xinference-1 | 2025-02-19T03:24:29.607937587Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
xinference-1 | 2025-02-19T03:24:29.607940626Z await self.app(scope, receive, _send)
xinference-1 | 2025-02-19T03:24:29.607943342Z File "/opt/conda/lib/python3.11/site-packages/gradio/route_utils.py", line 695, in call
xinference-1 | 2025-02-19T03:24:29.607949537Z await self.simple_response(scope, receive, send, request_headers=headers)
xinference-1 | 2025-02-19T03:24:29.607952599Z File "/opt/conda/lib/python3.11/site-packages/gradio/route_utils.py", line 711, in simple_response
xinference-1 | 2025-02-19T03:24:29.607955459Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607958182Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
xinference-1 | 2025-02-19T03:24:29.607961077Z await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607963998Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.607966842Z raise exc
xinference-1 | 2025-02-19T03:24:29.607969897Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.607973155Z await app(scope, receive, sender)
xinference-1 | 2025-02-19T03:24:29.607975874Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
xinference-1 | 2025-02-19T03:24:29.607978818Z await self.middleware_stack(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607981594Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
xinference-1 | 2025-02-19T03:24:29.607984647Z await route.handle(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607987735Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
xinference-1 | 2025-02-19T03:24:29.607990747Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607993884Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
xinference-1 | 2025-02-19T03:24:29.607996667Z await wrap_app_handling_exceptions(app, request)(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.607999455Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.608002323Z raise exc
xinference-1 | 2025-02-19T03:24:29.608005029Z File "/opt/conda/lib/python3.11/site-packages/starlette/exception_handler.py", line 42, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.608008258Z await app(scope, receive, sender)
xinference-1 | 2025-02-19T03:24:29.608011243Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
xinference-1 | 2025-02-19T03:24:29.608014047Z response = await f(request)
xinference-1 | 2025-02-19T03:24:29.608016879Z ^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608019759Z File "/opt/conda/lib/python3.11/site-packages/fastapi/routing.py", line 291, in app
xinference-1 | 2025-02-19T03:24:29.608025342Z solved_result = await solve_dependencies(
xinference-1 | 2025-02-19T03:24:29.608028227Z ^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608030922Z File "/opt/conda/lib/python3.11/site-packages/fastapi/dependencies/utils.py", line 666, in solve_dependencies
xinference-1 | 2025-02-19T03:24:29.608033754Z ) = await request_body_to_args( # body_params checked above
xinference-1 | 2025-02-19T03:24:29.608036575Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608039298Z File "/opt/conda/lib/python3.11/site-packages/fastapi/dependencies/utils.py", line 891, in request_body_to_args
xinference-1 | 2025-02-19T03:24:29.608042707Z fields_to_extract = get_cached_model_fields(first_field.type)
xinference-1 | 2025-02-19T03:24:29.608045546Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608048287Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 659, in get_cached_model_fields
xinference-1 | 2025-02-19T03:24:29.608051139Z return get_model_fields(model)
xinference-1 | 2025-02-19T03:24:29.608053938Z ^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608056690Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 285, in get_model_fields
xinference-1 | 2025-02-19T03:24:29.608059802Z return [
xinference-1 | 2025-02-19T03:24:29.608062584Z ^
xinference-1 | 2025-02-19T03:24:29.608065646Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 286, in
xinference-1 | 2025-02-19T03:24:29.608068711Z ModelField(field_info=field_info, name=name)
xinference-1 | 2025-02-19T03:24:29.608071660Z File "", line 6, in init
xinference-1 | 2025-02-19T03:24:29.608074578Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 111, in post_init
xinference-1 | 2025-02-19T03:24:29.608077425Z self._type_adapter: TypeAdapter[Any] = TypeAdapter(
xinference-1 | 2025-02-19T03:24:29.608080276Z ^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608083359Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 228, in init
xinference-1 | 2025-02-19T03:24:29.608086340Z self._init_core_attrs(
xinference-1 | 2025-02-19T03:24:29.608089067Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 290, in _init_core_attrs
xinference-1 | 2025-02-19T03:24:29.608091899Z core_schema = schema_generator.generate_schema(self._type)
xinference-1 | 2025-02-19T03:24:29.608094674Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608097387Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 610, in generate_schema
xinference-1 | 2025-02-19T03:24:29.608100486Z schema = self._generate_schema_inner(obj)
xinference-1 | 2025-02-19T03:24:29.608103141Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608106029Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 863, in _generate_schema_inner
xinference-1 | 2025-02-19T03:24:29.608109450Z return self._annotated_schema(obj)
xinference-1 | 2025-02-19T03:24:29.608115138Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608117870Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 1977, in _annotated_schema
xinference-1 | 2025-02-19T03:24:29.608120820Z schema = self._apply_annotations(source_type, annotations)
xinference-1 | 2025-02-19T03:24:29.608123532Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608126259Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2056, in _apply_annotations
xinference-1 | 2025-02-19T03:24:29.608129069Z schema = get_inner_schema(source_type)
xinference-1 | 2025-02-19T03:24:29.608131804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608134501Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_schema_generation_shared.py", line 84, in call
xinference-1 | 2025-02-19T03:24:29.608137442Z schema = self._handler(source_type)
xinference-1 | 2025-02-19T03:24:29.608140096Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608142774Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2131, in new_handler
xinference-1 | 2025-02-19T03:24:29.608145669Z schema = metadata_get_schema(source, get_inner_schema)
xinference-1 | 2025-02-19T03:24:29.608148510Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608151656Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2127, in
xinference-1 | 2025-02-19T03:24:29.608154888Z lambda source, handler: handler(source)
xinference-1 | 2025-02-19T03:24:29.608157578Z ^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608160400Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_schema_generation_shared.py", line 84, in call
xinference-1 | 2025-02-19T03:24:29.608163574Z schema = self._handler(source_type)
xinference-1 | 2025-02-19T03:24:29.608166646Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608169374Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2037, in inner_handler
xinference-1 | 2025-02-19T03:24:29.608172593Z schema = self._generate_schema_inner(obj)
xinference-1 | 2025-02-19T03:24:29.608175454Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608178170Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 884, in _generate_schema_inner
xinference-1 | 2025-02-19T03:24:29.608181138Z return self.match_type(obj)
xinference-1 | 2025-02-19T03:24:29.608184116Z ^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608186842Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 986, in match_type
xinference-1 | 2025-02-19T03:24:29.608189631Z return self._match_generic_type(obj, origin)
xinference-1 | 2025-02-19T03:24:29.608192607Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608195597Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 1014, in _match_generic_type
xinference-1 | 2025-02-19T03:24:29.608201579Z return self._union_schema(obj)
xinference-1 | 2025-02-19T03:24:29.608204276Z ^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608207394Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 1325, in _union_schema
xinference-1 | 2025-02-19T03:24:29.608210383Z choices.append(self.generate_schema(arg))
xinference-1 | 2025-02-19T03:24:29.608213035Z ^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608215778Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 610, in generate_schema
xinference-1 | 2025-02-19T03:24:29.608218618Z schema = self._generate_schema_inner(obj)
xinference-1 | 2025-02-19T03:24:29.608221360Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608224342Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 884, in _generate_schema_inner
xinference-1 | 2025-02-19T03:24:29.608227557Z return self.match_type(obj)
xinference-1 | 2025-02-19T03:24:29.608230235Z ^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608233013Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 995, in match_type
xinference-1 | 2025-02-19T03:24:29.608236274Z return self._unknown_type_schema(obj)
xinference-1 | 2025-02-19T03:24:29.608239340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.608242419Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 513, in _unknown_type_schema
xinference-1 | 2025-02-19T03:24:29.608245302Z raise PydanticSchemaGenerationError(
xinference-1 | 2025-02-19T03:24:29.608247996Z pydantic.errors.PydanticSchemaGenerationError: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set
arbitrary_types_allowed=Truein the model_config to ignore this error or implement__get_pydantic_core_schema__on your type to fully support it.xinference-1 | 2025-02-19T03:24:29.608251490Z
xinference-1 | 2025-02-19T03:24:29.608254314Z If you got this error by calling handler() within
__get_pydantic_core_schema__then you likely need to callhandler.generate_schema(<some type>)since we do not call__get_pydantic_core_schema__on<some type>otherwise to avoid infinite recursion.xinference-1 | 2025-02-19T03:24:29.608257829Z
xinference-1 | 2025-02-19T03:24:29.608260446Z For further information visit https://errors.pydantic.dev/2.10/u/schema-for-unknown-type
xinference-1 | 2025-02-19T03:24:29.681782473Z 2025-02-19 11:24:29,679 xinference.api.restful_api 1 ERROR Handling request http://localhost:9997/deepseek-r1-distill-qwen/run/predict failed: Unable to generate pydantic-core schema for <class 'starlette.requests.Request'>. Set
arbitrary_types_allowed=Truein the model_config to ignore this error or implement__get_pydantic_core_schema__on your type to fully support it.xinference-1 | 2025-02-19T03:24:29.681807797Z
xinference-1 | 2025-02-19T03:24:29.681811478Z If you got this error by calling handler() within
__get_pydantic_core_schema__then you likely need to callhandler.generate_schema(<some type>)since we do not call__get_pydantic_core_schema__on<some type>otherwise to avoid infinite recursion.xinference-1 | 2025-02-19T03:24:29.681823239Z
xinference-1 | 2025-02-19T03:24:29.681826152Z For further information visit https://errors.pydantic.dev/2.10/u/schema-for-unknown-type
xinference-1 | 2025-02-19T03:24:29.681829136Z Traceback (most recent call last):
xinference-1 | 2025-02-19T03:24:29.681831896Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 271, in _init_core_attrs
xinference-1 | 2025-02-19T03:24:29.681834894Z self.core_schema = _getattr_no_parents(self._type, 'pydantic_core_schema')
xinference-1 | 2025-02-19T03:24:29.681837748Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.681840755Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 55, in _getattr_no_parents
xinference-1 | 2025-02-19T03:24:29.681843726Z raise AttributeError(attribute)
xinference-1 | 2025-02-19T03:24:29.681846454Z AttributeError: pydantic_core_schema
xinference-1 | 2025-02-19T03:24:29.681849266Z
xinference-1 | 2025-02-19T03:24:29.681853714Z During handling of the above exception, another exception occurred:
xinference-1 | 2025-02-19T03:24:29.681856762Z
xinference-1 | 2025-02-19T03:24:29.681859561Z Traceback (most recent call last):
xinference-1 | 2025-02-19T03:24:29.681862577Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
xinference-1 | 2025-02-19T03:24:29.681865750Z await self.app(scope, receive, _send)
xinference-1 | 2025-02-19T03:24:29.681868584Z File "/opt/conda/lib/python3.11/site-packages/aioprometheus/asgi/middleware.py", line 184, in call
xinference-1 | 2025-02-19T03:24:29.681871656Z await self.asgi_callable(scope, receive, wrapped_send)
xinference-1 | 2025-02-19T03:24:29.681874505Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/cors.py", line 93, in call
xinference-1 | 2025-02-19T03:24:29.681877533Z await self.simple_response(scope, receive, send, request_headers=headers)
xinference-1 | 2025-02-19T03:24:29.681880324Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/cors.py", line 144, in simple_response
xinference-1 | 2025-02-19T03:24:29.681883293Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681886885Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
xinference-1 | 2025-02-19T03:24:29.681890336Z await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681893445Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.681896362Z raise exc
xinference-1 | 2025-02-19T03:24:29.681899098Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.681902068Z await app(scope, receive, sender)
xinference-1 | 2025-02-19T03:24:29.681905280Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
xinference-1 | 2025-02-19T03:24:29.681908614Z await self.middleware_stack(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681911409Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
xinference-1 | 2025-02-19T03:24:29.681917489Z await route.handle(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681920266Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 460, in handle
xinference-1 | 2025-02-19T03:24:29.681923286Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681926056Z File "/opt/conda/lib/python3.11/site-packages/fastapi/applications.py", line 1054, in call
xinference-1 | 2025-02-19T03:24:29.681928958Z await super().call(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681931688Z File "/opt/conda/lib/python3.11/site-packages/starlette/applications.py", line 112, in call
xinference-1 | 2025-02-19T03:24:29.681934778Z await self.middleware_stack(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681937560Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/errors.py", line 187, in call
xinference-1 | 2025-02-19T03:24:29.681940435Z raise exc
xinference-1 | 2025-02-19T03:24:29.681943108Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/errors.py", line 165, in call
xinference-1 | 2025-02-19T03:24:29.681945942Z await self.app(scope, receive, _send)
xinference-1 | 2025-02-19T03:24:29.681948660Z File "/opt/conda/lib/python3.11/site-packages/gradio/route_utils.py", line 695, in call
xinference-1 | 2025-02-19T03:24:29.681951625Z await self.simple_response(scope, receive, send, request_headers=headers)
xinference-1 | 2025-02-19T03:24:29.681954861Z File "/opt/conda/lib/python3.11/site-packages/gradio/route_utils.py", line 711, in simple_response
xinference-1 | 2025-02-19T03:24:29.681957804Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681960591Z File "/opt/conda/lib/python3.11/site-packages/starlette/middleware/exceptions.py", line 62, in call
xinference-1 | 2025-02-19T03:24:29.681963519Z await wrap_app_handling_exceptions(self.app, conn)(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681966572Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.681969577Z raise exc
xinference-1 | 2025-02-19T03:24:29.681972516Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 42, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.681975509Z await app(scope, receive, sender)
xinference-1 | 2025-02-19T03:24:29.681978368Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 715, in call
xinference-1 | 2025-02-19T03:24:29.681981241Z await self.middleware_stack(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681983975Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 735, in app
xinference-1 | 2025-02-19T03:24:29.681987032Z await route.handle(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681990109Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 288, in handle
xinference-1 | 2025-02-19T03:24:29.681993023Z await self.app(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.681995745Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 76, in app
xinference-1 | 2025-02-19T03:24:29.682002974Z await wrap_app_handling_exceptions(app, request)(scope, receive, send)
xinference-1 | 2025-02-19T03:24:29.682005968Z File "/opt/conda/lib/python3.11/site-packages/starlette/_exception_handler.py", line 53, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.682008858Z raise exc
xinference-1 | 2025-02-19T03:24:29.682011524Z File "/opt/conda/lib/python3.11/site-packages/starlette/exception_handler.py", line 42, in wrapped_app
xinference-1 | 2025-02-19T03:24:29.682022450Z await app(scope, receive, sender)
xinference-1 | 2025-02-19T03:24:29.682025739Z File "/opt/conda/lib/python3.11/site-packages/starlette/routing.py", line 73, in app
xinference-1 | 2025-02-19T03:24:29.682028802Z response = await f(request)
xinference-1 | 2025-02-19T03:24:29.682031658Z ^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682034401Z File "/opt/conda/lib/python3.11/site-packages/fastapi/routing.py", line 291, in app
xinference-1 | 2025-02-19T03:24:29.682037993Z solved_result = await solve_dependencies(
xinference-1 | 2025-02-19T03:24:29.682042153Z ^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682046496Z File "/opt/conda/lib/python3.11/site-packages/fastapi/dependencies/utils.py", line 666, in solve_dependencies
xinference-1 | 2025-02-19T03:24:29.682050471Z ) = await request_body_to_args( # body_params checked above
xinference-1 | 2025-02-19T03:24:29.682054859Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682058985Z File "/opt/conda/lib/python3.11/site-packages/fastapi/dependencies/utils.py", line 891, in request_body_to_args
xinference-1 | 2025-02-19T03:24:29.682063587Z fields_to_extract = get_cached_model_fields(first_field.type)
xinference-1 | 2025-02-19T03:24:29.682067717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682072233Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 659, in get_cached_model_fields
xinference-1 | 2025-02-19T03:24:29.682076782Z return get_model_fields(model)
xinference-1 | 2025-02-19T03:24:29.682080951Z ^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682085403Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 285, in get_model_fields
xinference-1 | 2025-02-19T03:24:29.682089934Z return [
xinference-1 | 2025-02-19T03:24:29.682094090Z ^
xinference-1 | 2025-02-19T03:24:29.682098819Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 286, in
xinference-1 | 2025-02-19T03:24:29.682103794Z ModelField(field_info=field_info, name=name)
xinference-1 | 2025-02-19T03:24:29.682108439Z File "", line 6, in init
xinference-1 | 2025-02-19T03:24:29.682112967Z File "/opt/conda/lib/python3.11/site-packages/fastapi/_compat.py", line 111, in post_init
xinference-1 | 2025-02-19T03:24:29.682117035Z self._type_adapter: TypeAdapter[Any] = TypeAdapter(
xinference-1 | 2025-02-19T03:24:29.682121223Z ^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682125386Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 228, in init
xinference-1 | 2025-02-19T03:24:29.682134106Z self._init_core_attrs(
xinference-1 | 2025-02-19T03:24:29.682138197Z File "/opt/conda/lib/python3.11/site-packages/pydantic/type_adapter.py", line 290, in _init_core_attrs
xinference-1 | 2025-02-19T03:24:29.682142605Z core_schema = schema_generator.generate_schema(self._type)
xinference-1 | 2025-02-19T03:24:29.682146873Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682151223Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 610, in generate_schema
xinference-1 | 2025-02-19T03:24:29.682157122Z schema = self._generate_schema_inner(obj)
xinference-1 | 2025-02-19T03:24:29.682161770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682166196Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 863, in _generate_schema_inner
xinference-1 | 2025-02-19T03:24:29.682170728Z return self._annotated_schema(obj)
xinference-1 | 2025-02-19T03:24:29.682174457Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682177144Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 1977, in _annotated_schema
xinference-1 | 2025-02-19T03:24:29.682180014Z schema = self._apply_annotations(source_type, annotations)
xinference-1 | 2025-02-19T03:24:29.682183009Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682185945Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2056, in _apply_annotations
xinference-1 | 2025-02-19T03:24:29.682188782Z schema = get_inner_schema(source_type)
xinference-1 | 2025-02-19T03:24:29.682191460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682194445Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_schema_generation_shared.py", line 84, in call
xinference-1 | 2025-02-19T03:24:29.682197698Z schema = self._handler(source_type)
xinference-1 | 2025-02-19T03:24:29.682200695Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682203380Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2131, in new_handler
xinference-1 | 2025-02-19T03:24:29.682206203Z schema = metadata_get_schema(source, get_inner_schema)
xinference-1 | 2025-02-19T03:24:29.682209933Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682213318Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2127, in
xinference-1 | 2025-02-19T03:24:29.682216370Z lambda source, handler: handler(source)
xinference-1 | 2025-02-19T03:24:29.682219071Z ^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682222115Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_schema_generation_shared.py", line 84, in call
xinference-1 | 2025-02-19T03:24:29.682225078Z schema = self._handler(source_type)
xinference-1 | 2025-02-19T03:24:29.682229364Z ^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682233733Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 2037, in inner_handler
xinference-1 | 2025-02-19T03:24:29.682243063Z schema = self._generate_schema_inner(obj)
xinference-1 | 2025-02-19T03:24:29.682248318Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682252836Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 884, in _generate_schema_inner
xinference-1 | 2025-02-19T03:24:29.682256528Z return self.match_type(obj)
xinference-1 | 2025-02-19T03:24:29.682259564Z ^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682262220Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 986, in match_type
xinference-1 | 2025-02-19T03:24:29.682265528Z return self._match_generic_type(obj, origin)
xinference-1 | 2025-02-19T03:24:29.682268590Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682271461Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 1014, in _match_generic_type
xinference-1 | 2025-02-19T03:24:29.682274737Z return self._union_schema(obj)
xinference-1 | 2025-02-19T03:24:29.682277615Z ^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682280337Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 1325, in _union_schema
xinference-1 | 2025-02-19T03:24:29.682283495Z choices.append(self.generate_schema(arg))
xinference-1 | 2025-02-19T03:24:29.682286493Z ^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682289190Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 610, in generate_schema
xinference-1 | 2025-02-19T03:24:29.682294993Z schema = self._generate_schema_inner(obj)
xinference-1 | 2025-02-19T03:24:29.682297979Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
xinference-1 | 2025-02-19T03:24:29.682300687Z File "/opt/conda/lib/python3.11/site-packages/pydantic/_internal/_generate_schema.py", line 884, in _generate_schema_inner
xinference-1 | 2025-02-19T03:24:29.682303822Z return self.match_type(obj)
xinference-1 | 2025-02-19T03:24:29.682306871Z ^^^^^^^^^^^^^^^^^^^^
Expected behavior / 期待表现
测试信息应正常返回结果
The text was updated successfully, but these errors were encountered: