Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebooting ISY disconnects all of polyglot #29

Closed
Einstein42 opened this issue Apr 1, 2016 · 5 comments
Closed

Rebooting ISY disconnects all of polyglot #29

Einstein42 opened this issue Apr 1, 2016 · 5 comments
Labels

Comments

@Einstein42
Copy link
Contributor

I've noticed though various testing that if you reboot the ISY, polyglot doesn't update the nodes correctly once it comes back until you restart polyglot. Restarting the node_servers themselves don't seem to help. I will have to look into why this is happening.

@Einstein42 Einstein42 self-assigned this Apr 1, 2016
@Einstein42 Einstein42 added the bug label Apr 1, 2016
@mkohanim
Copy link
Contributor

mkohanim commented Apr 1, 2016

Thanks James.

With kind regards,


Michel Kohanim
CEO

(p) 818.631.0333
(f) 818.436.0702
http://www.universal-devices.comhttp://www.universal-devices.com/


From: James [mailto:[email protected]]
Sent: Friday, April 1, 2016 8:23 AM
To: UniversalDevicesInc/Polyglot [email protected]
Subject: [UniversalDevicesInc/Polyglot] Rebooting ISY disconnects all of polyglot (#29)

I've noticed though various testing that if you reboot the ISY, polyglot doesn't update the nodes correctly once it comes back until you restart polyglot. Restarting the node_servers themselves don't seem to help. I will have to look into why this is happening.


You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHubhttps://github.com//issues/29

@Einstein42 Einstein42 removed their assignment May 26, 2016
@Einstein42
Copy link
Contributor Author

I'm not sure where to necessarily even start on this one... Thoughts?

@mjwesterhof
Copy link
Collaborator

Was this observed before or after the implementation of the request queue for comms to the ISY?

Either way, I'd suggest a full polyglot log at DEBUG level would be helpful with the current version, plus a lot of patience. My guess, if this still happens, is related to issue #56 -- things can get pretty piled up in the queues with a default of (I think) 5 minutes per request.

As part of the project to add the node probes (first part of which is implemented), I've also been considering adding a mechanism to determine ISY connection health so that we can short-circuit the entire queue issue in the first place. In a nutshell, the idea would be that the lowest level code that sends node server API REST calls to the ISY would have a global that records the last several attempts to contact the ISY. If we have repeated timeouts, this code would fall back to an algorithm that does a simple "ping" type of request to the ISY with a short timeout, and drop the request with a failure indication back to the calling node server. When it enters this state, this "ISY offline" state would be signaled to the node servers so they could avoid calling in the first place.

Kind of hack-ey. Actually, very hack-ey. Hence issue #56 -- if the timeouts were set to some low value to begin with (15 seconds, for example), then piling up of requests on queues and the associated long recovery times becomes less of an issue to begin with.

I'm travelling again, so not in a position to do a lot of experimentation until next week.

@Einstein42
Copy link
Contributor Author

This is probably the right answer... I'll try to get some time this week and mess with it.

@Einstein42
Copy link
Contributor Author

Moved to #62

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants