Discussion:
ZENTRAP keeps going down
kingpin
2011-10-21 07:00:24 UTC
Permalink
kingpin [http://community.zenoss.org/people/kingpin] created the discussion

"ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62060#62060

--------------------------------------------------------------
Ever since the upgrade to Zenoss 3.2 the zentrap daemon keeps going down.  It runs for a few hours the goes down.

The Zentrap log always looks like this :
2011-10-20 23:04:34,187 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:04:34,187 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 9 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:09:34,287 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:09:34,287 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 9 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:14:34,299 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:14:34,299 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 9 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:19:34,307 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:19:34,307 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:24:34,316 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:24:34,316 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:29:34,323 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:29:34,324 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:34:34,331 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:34:34,331 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:39:34,339 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:39:34,339 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:44:34,348 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:44:34,348 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:49:34,355 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:49:34,355 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 11 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:54:34,363 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:54:34,363 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 11 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-20 23:59:34,371 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-20 23:59:34,371 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 11 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-21 00:04:34,379 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-21 00:04:43,500 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 11 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-21 00:09:43,508 INFO zen.zentrap: 1 devices processed (0 datapoints)
2011-10-21 00:09:43,508 INFO zen.collector.scheduler: Tasks: 3 Successful_Runs: 11 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2011-10-21 00:14:43,516 INFO zen.zentrap: 3 devices processed (0 datapoints)
2011-10-21 00:14:43,516 INFO zen.collector.scheduler: Tasks: 5 Successful_Runs: 9 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 2
2011-10-21 00:19:49,263 INFO zen.zentrap: 3 devices processed (0 datapoints)
2011-10-21 00:19:49,263 INFO zen.collector.scheduler: Tasks: 5 Successful_Runs: 10 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 1
2011-10-21 00:37:12,307 INFO zen.zentrap: 52 devices processed (0 datapoints)
2011-10-21 00:37:12,307 INFO zen.collector.scheduler: Tasks: 54 Successful_Runs: 26 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 2
2011-10-21 01:41:38,165 INFO zen.zentrap: 229 devices processed (0 datapoints)
2011-10-21 01:41:38,167 INFO zen.collector.scheduler: Tasks: 231 Successful_Runs: 197 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 5

An increase in failed runs and running tasks.

Does anyone know what this means and how to resolve this issue.

Thanks !
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62060#62060]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
kingpin
2011-11-07 08:36:07 UTC
Permalink
kingpin [http://community.zenoss.org/people/kingpin] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62462#62462

--------------------------------------------------------------
Anyone ?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62462#62462]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
kingpin
2011-11-07 10:01:49 UTC
Permalink
kingpin [http://community.zenoss.org/people/kingpin] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62463#62463

--------------------------------------------------------------
Debug Mode :

2011-11-07 10:34:14,088 DEBUG zen.collector.scheduler: Scheduler._cleanupTaskComplete: result=None task.name=zentrap
2011-11-07 10:34:14,088 DEBUG zen.collector.scheduler: Cleanup on task configLoader <Products.ZenCollector.config.ConfigurationLoaderTask object at 0x5320850>
2011-11-07 10:34:14,088 DEBUG zen.collector.scheduler: Scheduler._cleanupTaskComplete: result=None task.name=configLoader
2011-11-07 10:34:14,089 DEBUG zen.zentrap: stop() called when not running
2011-11-07 10:34:14,089 INFO zen.zentrap: Daemon TrapDaemon shutting down
2011-11-07 10:34:14,089 DEBUG zen.zentrap: Removing service EventService
2011-11-07 10:34:14,090 DEBUG zen.zentrap: Removing service Products.ZenHub.services.SnmpTrapConfig
Unhandled error in Deferred:
Traceback (most recent call last):
Failure: twisted.spread.pb.PBConnectionLost: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion: Connection lost.
]
2011-11-07 10:34:14,090 DEBUG zen.collector.scheduler: In shutdown stage during
2011-11-07 10:34:14,090 DEBUG zen.collector.scheduler: In shutdown stage after

2011-11-07 10:42:43,531 DEBUG zen.collector.scheduler: Scheduler._cleanupTaskComplete: result=None task.name=zentrap
2011-11-07 10:42:43,531 DEBUG zen.collector.scheduler: Cleanup on task configLoader <Products.ZenCollector.config.ConfigurationLoaderTask object at 0x3bbd850>
2011-11-07 10:42:43,531 DEBUG zen.collector.scheduler: Scheduler._cleanupTaskComplete: result=None task.name=configLoader
2011-11-07 10:42:43,531 DEBUG zen.zentrap: stop() called when not running
2011-11-07 10:42:43,531 INFO zen.zentrap: Daemon TrapDaemon shutting down
2011-11-07 10:42:43,532 DEBUG zen.zentrap: Removing service EventService
2011-11-07 10:42:43,532 DEBUG zen.zentrap: Removing service Products.ZenHub.services.SnmpTrapConfig
Unhandled error in Deferred:
Traceback (most recent call last):
Failure: twisted.spread.pb.PBConnectionLost: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion: Connection lost.
]
2011-11-07 10:42:43,533 DEBUG zen.collector.scheduler: In shutdown stage during
2011-11-07 10:42:43,533 DEBUG zen.collector.scheduler: In shutdown stage after

Can anyone shed some light on this  ?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62463#62463]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
blewa
2011-11-10 17:23:43 UTC
Permalink
blewa [http://community.zenoss.org/people/blewa] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62557#62557

--------------------------------------------------------------
I'm having similar issues.  On one of my Zenoss servers zentrap will begin consumer 2GB of memory overnight and still growing.  It seems to coorelate with the 12 hour remodel schedule for whatever that's worth.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62557#62557]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jcurry
2011-11-11 17:19:35 UTC
Permalink
jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62596#62596

--------------------------------------------------------------
I also have the same.  But we don't have Failed Runs (any of us, I suspect).  This log is not good for the eye but the last line of your log:

2011-10-21 01:41:38,167 INFO zen.collector.scheduler: Tasks: 231 Successful_Runs: 197 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 5

is saying 231 Tasks (definitely high but may be a trap storm),
Successful_Runs: 197
Failed Runs: 0
....
We are at 3.2.1.

Looking even closer at our zentrap.log, the zentrap die seems to happen every 12 hours - regular as clockwork.

We have fixed the issue by restarting zentrap in cron every hour. 

Could anyone else with this problem check whether they are also seeing the 12-hour cycle and could you check whether it coincides with zenmodeler running (we have lost the zenmodeler logs that match up with the zentrap logs from before our cron kludge).  That's the only thing I can think of that typically runs every 12 hours.

Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62596#62596]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Shane Scott
2011-11-11 17:34:31 UTC
Permalink
Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62586#62586

--------------------------------------------------------------
Jane:

We're seeing this problem in Zenoss v4.1 as well, but with more than just zentrap. Do you see any unjellyable errors in zenhub (in debug mode) when zentrap tries to fetch its updated config?

Best,
--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62586#62586]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jcurry
2011-11-14 13:07:12 UTC
Permalink
jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62604#62604

--------------------------------------------------------------
Don't see any "jelly" around but CPU on zentrap seems to go through the roof as you approach failure condition.

We are restarting zentrap every hour with cron using:

# Restart the zentrap Daemon every hour
0 * * * * /usr/local/zenoss/zenoss/bin/zentrap restart >> /home/zenoss/zendisc_crontab.log 2>&1

This sometimes produces following messages in zentrap.log on daemon restart:

2011-11-14 12:33:42,710 INFO zen.zentrap: 107 devices processed (0 datapoints)
2011-11-14 12:33:42,711 INFO zen.collector.scheduler: Tasks: 108 Successful_Runs: 39 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 4
2011-11-14 12:39:22,655 INFO zen.zentrap: 126 devices processed (0 datapoints)
2011-11-14 12:39:22,656 INFO zen.collector.scheduler: Tasks: 127 Successful_Runs: 65 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 6
2011-11-14 13:00:01,999 INFO zen.zentrap: 232 devices processed (0 datapoints)
2011-11-14 13:00:02,000 INFO zen.collector.scheduler: Tasks: 233 Successful_Runs: 160 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 10
2011-11-14 13:00:05,302 INFO zen.zentrap: Deleting PID file /usr/local/zenoss/zenoss/var/zentrap-localhost.pid ...
2011-11-14 13:00:05,302 INFO zen.zentrap: Daemon TrapDaemon shutting down
2011-11-14 13:00:05,303 ERROR zen.zentrap: Maintenance failed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionLost'>: Connection to the other side was lost in a non-clean fashion: Connection lost.

I have opened a ticket against 3.2.1 - http://dev.zenoss.com/trac/ticket/7885 http://dev.zenoss.com/trac/ticket/7885 .
Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62604#62604]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Shane Scott
2011-11-15 16:58:31 UTC
Permalink
Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/62637#62637

--------------------------------------------------------------
Jane:

Sorry. I'd meant that the unjellyable message will show up in the zenhub feeding zentrap.

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62637#62637]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
johnnynoc
2011-12-07 16:42:49 UTC
Permalink
johnnynoc [http://community.zenoss.org/people/johnnynoc] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/63121#63121

--------------------------------------------------------------
I've experienced the same problem and it seems to be compounded by a zenmodeler process that's running.  Meaning, I have a process that kicks off every night to model all of our devices on a collector.  When this runs I see the collected zentrap events shoot through the roof.  I put in a cron job to restart zentrap hourly on Tuesday and you can see in the graphs the collected events will drop but then immediately shoot back up.

Loading Image... Loading Image...

Is anyone else seeing something similar or can suggest how the zenmodeler and zentrap events correlate?

Thanks,
John
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/63121#63121]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jcurry
2011-12-07 16:59:49 UTC
Permalink
jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/63122#63122

--------------------------------------------------------------
Yeh - that mirrors what we are seeing.  I opened ticket  7885 3 weeks back but it doesn't look like it has made any progress even though I set it at priority 1.

Any update from Zenoss would be much appreciated by a few of us now ;)

Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/63122#63122]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
zenphil
2011-12-08 23:06:19 UTC
Permalink
zenphil [http://community.zenoss.org/people/zenphil] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/63162#63162

--------------------------------------------------------------
We are currently working on this issue. Please hang tight!

Phil Bowman
Sr. Software Developer, Zenoss
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/63162#63162]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
andrew savvas
2012-02-08 11:21:56 UTC
Permalink
andrew savvas [http://community.zenoss.org/people/asavvas] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/64352#64352

--------------------------------------------------------------
Hey Phil, is there any update on this issue? We've just upgraded to v3.2 and are seeing the exact same problem.

Thanks

Andrew
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/64352#64352]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jcurry
2012-02-08 11:57:50 UTC
Permalink
jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/64353#64353

--------------------------------------------------------------
No update to the ticket other than a target of Core 4 alpha. 

Zenoss???  Is it in the current alpha build?

Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/64353#64353]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Shane Scott
2012-02-08 14:59:41 UTC
Permalink
Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/64366#64366

--------------------------------------------------------------
jcurry:

We haven't had any issues with zentrap in v4.1.1 as of yet. Should be working in v4.1.7 also.

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/64366#64366]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
blewa
2012-02-23 18:38:17 UTC
Permalink
blewa [http://community.zenoss.org/people/blewa] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/64758#64758

--------------------------------------------------------------
Sad that an issue that's so pronounced and affects a Zenoss environment so much hasn't had a fix come out.  I realize there's a lot of resources going into 4.x, but it's easy to see how one could have missed events because of this bug starving the host for resources.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/64758#64758]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
mwcotton
2012-02-23 22:09:57 UTC
Permalink
mwcotton [http://community.zenoss.org/people/mwcotton] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/64747#64747

--------------------------------------------------------------
Agreed, I would think a key to avoiding this issue in future releases would be to understand what is causing it in the current release.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/64747#64747]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
emb3dd3d
2012-03-14 21:01:20 UTC
Permalink
emb3dd3d [http://community.zenoss.org/people/emb3dd3d] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/65220#65220

--------------------------------------------------------------
strange you guys mention this.. I have the same 12 hr issue with zenmodeler and zenhub.   Like clockwork.. and it shoots me the pages , of course.  I am blue in the face and the boss just turned of his alerting.  Unfortunately , I have not done my due diligence with research to the logs.. maybe I can get to it today.  It would be nice to get a bugfix or stumble upon a fix..

I will keep checking back.

thanx for posting this topic, I thought it was just me.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/65220#65220]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Shane Scott
2012-03-14 21:29:52 UTC
Permalink
Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/65221#65221

--------------------------------------------------------------
Has anyone tried porting the v4.1.7 alpha zentrap to v3.2.1?

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/65221#65221]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
jplouis
2012-03-15 03:53:32 UTC
Permalink
jplouis [http://community.zenoss.org/people/jplouis] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/65225#65225

--------------------------------------------------------------
I believe this is the patch done to resolve similar 3.2.1 zentrap issues at a customer site:

Index: /branches/core/zenoss-3.2.x/Products/ZenHub/services/SnmpTrapConfig.py
===================================================================
--- /branches/core/zenoss-3.2.x/Products/ZenHub/services/SnmpTrapConfig.py (revision 46761)
+++ /branches/core/zenoss-3.2.x/Products/ZenHub/services/SnmpTrapConfig.py (revision 52650)
@@ -112,17 +112,15 @@
             self._create_user(object)
         else:
             for listener in self.listeners:
                 listener.callRemote('notifyConfigChanged')
         CollectorConfigService.update(self, object)
-        self._procrastinator.doLater()

     def deleted(self, object):
         for listener in self.listeners:
             listener.callRemote('notifyConfigChanged')
         CollectorConfigService.update(self, object)
-        self._procrastinator.doLater()


if __name__ == '__main__':
     from pprint import pprint
     from Products.ZenHub.ServiceTester import ServiceTester
Index: /branches/core/zenoss-3.2.x/Products/ZenCollector/services/config.py
===================================================================
--- /branches/core/zenoss-3.2.x/Products/ZenCollector/services/config.py (revision 44697)
+++ /branches/core/zenoss-3.2.x/Products/ZenCollector/services/config.py (revision 52650)
@@ -254,17 +254,24 @@
     def _notifyAll(self, object):
         """
         TODO
         """
         # TODO doc me
+        if not isinstance(object, Device):
+            self.log.debug("Trying to procrastinate pushConfig for non-device: %s" % object)
+            return
         if object.perfServer.getRelatedId() == self.instance:
             self._procrastinator.doLater(object)

     def _pushConfig(self, device):
         """
         TODO
         """
+        if not isinstance(device, Device):
+            self.log.debug("Trying to pushConfig for non-device: %s" % device)
+            return defer.DeferredList([])
+
         deferreds = []

         if self._filterDevice(device):
             proxy = self._wrapFunction(self._createDeviceProxy, device)
             if proxy:
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/65225#65225]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Shane Scott
2012-03-15 05:45:20 UTC
Permalink
Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/65206#65206

--------------------------------------------------------------
jplouis:

Interesting patch.

I'll be interested to see how it tests.

Thanks jp!

Best,
--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/65206#65206]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
eistconn
2013-05-16 15:48:43 UTC
Permalink
eistconn [http://community.zenoss.org/people/eistconn] created the discussion

"Re: ZENTRAP keeps going down"

To view the discussion, visit: http://community.zenoss.org/message/73249#73249

--------------------------------------------------------------
I am having exactly the same problem. zentrap daemon crashes every 12 hours. However when I applied the patch in this discussion, the problem still exists.

I did completely restart zenoss after applying the patch.

We are using zenoss 3.2.1.

On our productive system I have applied the workaround of an hourly cronjob, but it would be nicet to get to the bottom of this problem.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/73249#73249]

Start a new discussion in zenoss-users at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Loading...