Discussion:
What decides how often a collector is run?
Erik Itland
2011-11-03 13:17:36 UTC
Permalink
Erik Itland [http://community.zenoss.org/people/eitland] created the discussion

"What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62385#62385

--------------------------------------------------------------
I've been trying to reconfigure the cycle time of a performance collector (zenperfsql) a few times and for some reason or another some of the hosts seem to be polled according to the old configuration while other hosts are polled according to the new configuration. How I found out was by grepping for "changing state from RUNNING to SQLC_QUERY" in zenperfsql.log.

It seems to me that the configuration is stashed away in a cache somewhere, maybe in the object database or somewhere (have been looking for .pickle and .zec files to no avail though).

Does anyone know?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62385#62385]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jmp242
2011-11-03 13:22:58 UTC
Permalink
jmp242 [http://community.zenoss.org/people/jmp242] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62400#62400

--------------------------------------------------------------
Have you restarted all the collectors, or use push configuration changes ...?

--
James Pulver
ZCA Member
LEPP Computer Group
Cornell University
Have you restarted all the collectors or used push configuration changes ...
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62400#62400]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Erik Itland
2011-11-03 14:16:21 UTC
Permalink
Erik Itland [http://community.zenoss.org/people/eitland] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62387#62387

--------------------------------------------------------------
I have restarted zenoss completely a couple of times.

When you mention pushing configuration changes, - did you mean by going to the devices in question and choose "Push changes"?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62387#62387]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jmp242
2011-11-03 14:28:19 UTC
Permalink
jmp242 [http://community.zenoss.org/people/jmp242] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62403#62403

--------------------------------------------------------------
Yes.

--
James Pulver
ZCA Member
LEPP Computer Group
Cornell University
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62403#62403]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Erik Itland
2011-11-03 14:51:42 UTC
Permalink
Erik Itland [http://community.zenoss.org/people/eitland] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62388#62388

--------------------------------------------------------------
Have tried it on one of the notorious offenders. Just got a second collection in less than 30 mins but I guess I should give it another hour.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62388#62388]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Erik Itland
2011-11-03 17:42:01 UTC
Permalink
Erik Itland [http://community.zenoss.org/people/eitland] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62389#62389

--------------------------------------------------------------
Still the same.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62389#62389]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jcurry
2011-11-04 12:21:35 UTC
Permalink
jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62413#62413

--------------------------------------------------------------
The reason you can't trivially find the cycle interval for zenperfsql is that it is part of Egor's ZenPack, rather than a standard daemon with Zenoss Core.  The version I have is ZenPacks.community.SQLDataSource 1.96 and this has a sqlPerfConfig.py file under the services directory of the ZenPack.  In my version, the comments say that the polling interval is taken from the WinCycleInterval (default 60 sec) though the actual code looks like it is picking up the snmp cycle interval of 300 secs.  There is a TODO note in my version that suggests he may be looking at making this interval configurable.

Hope that helps!

Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62413#62413]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Erik Itland
2011-11-04 13:57:24 UTC
Permalink
Erik Itland [http://community.zenoss.org/people/eitland] created the discussion

"Re: What decides how often a collector is run?"

To view the discussion, visit: http://community.zenoss.org/message/62427#62427

--------------------------------------------------------------
Hi Jane, and thanks!

I have already unpacked the Zenpack, tested a few changes and this in one in https://github.com/epuzanov/ZenPacks.community.SQLDataSource/blob/104598ba43027389890b7af429886a223d142027/ZenPacks/community/SQLDataSource/zenperfsql.py zenperfsql.py was the one I hoped would fix it: https://github.com/epuzanov/ZenPacks.community.SQLDataSource/blob/104598ba43027389890b7af429886a223d142027/ZenPacks/community/SQLDataSource/zenperfsql.py

self.cycleInterval = 5 * 60 # seconds
self.configCycleInterval = 20 # minutes

Some days ago I updated the code to read like

self.cycleInterval = 4 * 60 * 60 # seconds
self.configCycleInterval = 12 * 60 # minutes

The problem is that some of the servers are now polled every 4 hours while others are still consistently being polled multiple times an hour instead of every 4 hours as I would expect.

While looking at it now I'm wondering if the configCycleInterval in zenperfsql.py might be the same thing as the configCycleInterval in sqlPerfConfig.py under services and if those are the ones that Matt Ray mentioned here: http://community.zenoss.org/message/27768#27768 http://community.zenoss.org/message/27768
The "config cycle interval" is how often some of the daemons will reload their configuration unless it has been updated asynchronously in the interim.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62427#62427]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Loading...