Background jobs running forever in 4.2

[James M]

James M [http://community.zenoss.org/people/James] created the discussion

"Background jobs running forever in 4.2"

To view the discussion, visit: http://community.zenoss.org/message/70433#70433

--------------------------------------------------------------
Hey
I'm not sure why but in the last few hours my Zenoss server background jobs just not ending.
When I'm adding device it stuck on: 2012-12-10 14:33:51,661 INFO zen.ZenDisc: Looking for 10.13.4.130
if I'm running nslookup from the server I'm getting an answer.

The device is added and I was able to model it BUT the job still in "started" status.
I tried restarting zenoss, rebooting the server but nothing helps..

Tried to add several different servers and the results are the same..

I didn't change any configurations in the zenoss server so I have no idea what to check next..

here's the job log:

*Log file: /opt/zenoss/log/jobs/9b212c8e-f9b5-4b80-8c3a-06dc5181a228.log*
2012-12-10 14:33:36,446 INFO zen.Job: Job Add Device Products.ZenModel.ZDeviceLoader.DeviceCreationJob received, waiting for other side to commit
2012-12-10 14:33:36,468 INFO zen.Job: Beginning job Add Device Products.ZenModel.ZDeviceLoader.DeviceCreationJob
2012-12-10 14:33:37,308 INFO zen.Job: Running Job Add Device Products.ZenModel.ZDeviceLoader.DeviceCreationJob
2012-12-10 14:33:37,309 INFO zen.Job: Spawning subprocess: /opt/zenoss/bin/zendisc run --now -d 10.13.4.144 --monitor localhost --deviceclass /Server/Windows/WMI --prod_state 1000 --job 9b212c8e-f9b5-4b80-8c3a-06dc5181a228
2012-12-10 14:33:47,068 INFO zen.ZenDisc: Connecting to localhost:8789
2012-12-10 14:33:47,077 INFO zen.ZenDisc: Connected to ZenHub
2012-12-10 14:33:51,661 INFO zen.ZenDisc: Looking for 10.13.4.144

Any suggestions?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70433#70433]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Yuri Goikhman]

Yuri Goikhman [http://community.zenoss.org/people/yurigo79] created the discussion

"Re: Background jobs running forever in 4.2"

To view the discussion, visit: http://community.zenoss.org/message/70681#70681

--------------------------------------------------------------
Can you check what happens when it runs manully? try run this:
/opt/zenoss/bin/zendisc run --now -d 10.13.4.144 --monitor localhost --deviceclass /Server/Windows/WMI --prod_state 1000 -v10
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70681#70681]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[James M]

James M [http://community.zenoss.org/people/James] created the discussion

"Re: Background jobs running forever in 4.2"

To view the discussion, visit: http://community.zenoss.org/message/71193#71193

--------------------------------------------------------------
OK
run it manually and it failed
(log file attached)

In addition tried to  run nping and got errors:
#> /opt/zenoss/bin/nping --icmp 10.13.4.144
Starting Nping 0.5.51.4 ( http://nmap.org/nping http://nmap.org/nping ) at 2012-12-24 03:51 EST
SENT (0.0175s) ICMP 10.0.0.161 > 10.13.4.144 Echo request (type=8/code=0) ttl=64 id=18419 iplen=28
SENT (1.0176s) ICMP 10.0.0.161 > 10.13.4.144 Echo request (type=8/code=0) ttl=64 id=18419 iplen=28
SENT (2.0177s) ICMP 10.0.0.161 > 10.13.4.144 Echo request (type=8/code=0) ttl=64 id=18419 iplen=28
SENT (3.0178s) ICMP 10.0.0.161 > 10.13.4.144 Echo request (type=8/code=0) ttl=64 id=18419 iplen=28
SENT (4.0179s) ICMP 10.0.0.161 > 10.13.4.144 Echo request (type=8/code=0) ttl=64 id=18419 iplen=28
nping_event_handler(): READ-PCAP killed: Resource temporarily unavailable
nping_event_handler(): TIMER killed: Resource temporarily unavailable

Max rtt: N/A | Min rtt: N/A | Avg rtt: N/A
Raw packets sent: 5 (140B) | Rcvd: 0 (0B) | Lost: 5 (100.00%)
Tx time: 4.00050s | Tx bytes/s: 35.00 | Tx pkts/s: 1.25
Rx time: 4.99996s | Rx bytes/s: 0.00 | Rx pkts/s: 0.00
Nping done: 1 IP address pinged in 5.03 seconds
While simple ping from the machine works.

Currently (after upgrading to 4.2.3) I can't add devices - the jobs not ending, It does add a single device - the job is not completed (aborting it manually).

This is making my life hard :-)
Everytime I need to add multiple devices it's really time consuming.

Any suggestions?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/71193#71193]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Yuri Goikhman]

Yuri Goikhman [http://community.zenoss.org/people/yurigo79] created the discussion

"Re: Background jobs running forever in 4.2"

To view the discussion, visit: http://community.zenoss.org/message/71194#71194

--------------------------------------------------------------
Hi,
I didn't forget this

I'll try to undertand this on the weekend.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/71194#71194]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Jean-Michel Beylard-Ozeroff]

Jean-Michel Beylard-Ozeroff [http://community.zenoss.org/people/unirisc] created the discussion

"Re: Background jobs running forever in 4.2"

To view the discussion, visit: http://community.zenoss.org/message/71267#71267

--------------------------------------------------------------
Hi,

Having the same issue here. Fresh install of Zenoss Core 4.2.3.
Looking forward to your suggestions too B-)

Thanks !
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/71267#71267]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[ignacio freyre]

ignacio freyre [http://community.zenoss.org/people/nachofw] created the discussion

"Re: Background jobs running forever in 4.2"

To view the discussion, visit: http://community.zenoss.org/message/74498#74498

--------------------------------------------------------------
Hi, same here, zenoss 4.2.4, using zenpacks: distributed.collectors, cisco.mibs, fping.
if i restart zenoss the queue for pending jobs gets reduced by 2 but hungs again.
regards
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/74498#74498]

Start a new discussion in zenoss-users at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]