Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Coral TPU model change automatically after 120sec #8

Open
1 of 6 tasks
bbo76 opened this issue Apr 9, 2024 · 4 comments
Open
1 of 6 tasks

Coral TPU model change automatically after 120sec #8

bbo76 opened this issue Apr 9, 2024 · 4 comments
Assignees
Labels
question Further information is requested

Comments

@bbo76
Copy link

bbo76 commented Apr 9, 2024

Area of Concern

  • Server
  • Behaviour of one or more Modules [ObjectDetectionCoral]
  • Installer
  • Runtime [e.g. Python3.7, .NET]
  • Module packages [e.g. PyTorch)
  • Something else

Describe the bug
I call object detection API with custom model 2 time with +120sec between and the second time, the model used wasn't YOLO but default model.

API called: http://XXX:32168/v1/vision/custom/YOLOv5

server log output:
Response rec'd from Object Detection (Coral) command 'custom' (...6e9f4a) ['Found car, person, car'] took 280ms
11:48:39:objectdetection_coral_adapter.py: WARNING:root:No work in 120.0 seconds, watchdog shutting down TPUs.
11:49:47:Response rec'd from Object Detection (Coral) command 'custom' (...8c1757) ['No objects found'] took 2751ms
11:50:02:objectdetection_coral_adapter.py: Object Detection (Coral) started.
11:50:02:objectdetection_coral_adapter.py: no TPU interpreters: Falling back to CPU detection
11:50:02:objectdetection_coral_adapter.py: No interpreter found. Recreating.
11:50:02:objectdetection_coral_adapter.py: Model change detected. Forcing model reload.
11:50:02:objectdetection_coral_adapter.py: Timeout connecting to the server

As you can see, first time the model detect person car etc... and second time (same query) nothing found and the model was changed.

Expected behavior
Keep the model configured on the start of the module.

Your System (please complete the following information):

  • CodeProject.AI Server version: 2.6.2]
  • OS:Docker
  • CoralUSB TPU
@ChrisMaunder
Copy link
Collaborator

USB or PCIe Coral?

@ChrisMaunder ChrisMaunder added the question Further information is requested label Apr 18, 2024
@ChrisMaunder ChrisMaunder self-assigned this Apr 18, 2024
@bbo76
Copy link
Author

bbo76 commented Apr 18, 2024

USB or PCIe Coral?

USB

@Jensilein
Copy link

I experience basically the same behaviour on Windows. Whereas on Linux (Ubuntu) it works fine.

@scho0ck
Copy link

scho0ck commented Aug 27, 2024

Same issue on Windows with PCIe Coral Yolov5s model and CPAI 2.8

@ChrisMaunder ChrisMaunder transferred this issue from codeproject/CodeProject.AI-Server Nov 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

4 participants