Zopectl and zenhub not running

[Ramu Chittiprolu]

Ramu Chittiprolu [http://community.zenoss.org/people/Ramu] created the discussion

"Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70742#70742

--------------------------------------------------------------
Hi,
PFB. I have installed zenoss recently on RHEL 6.3 but am not able use web portal because of zopectl and zenhub issues.
Mysql and rabbimq are running but still am failed to start zopectl and zenhub collectors.

Can anyone provide me the solution on this.

[***@i2mpblrzenoss01 init.d]# service zenoss status
Daemon: zeneventserver program running; pid=8660
*Daemon: zopectl not running*
*Daemon: zenhub not running*
Daemon: zenjobs program running; pid=8833
Daemon: zeneventd program running; pid=8905
Daemon: zenping program running; pid=8954
Daemon: zensyslog program running; pid=8986
Daemon: zenstatus program running; pid=9014
Daemon: zenactiond program running; pid=9050
Daemon: zentrap program running; pid=9085
Daemon: zenmodeler program running; pid=9123
Daemon: zenperfsnmp program running; pid=9157
Daemon: zencommand program running; pid=9194
Daemon: zenprocess program running; pid=9225
Daemon: zenrrdcached program running; pid=9229

###########
*Zenhug logs -*

[***@i2mpblrzenoss01 log]# tail -10 zenhub.log
    self._publish("$RawZenEvents", routing_key, event, mandatory=mandatory, immediate=immediate)
  File "/opt/zenoss/Products/ZenMessaging/queuemessaging/publisher.py", line 302, in _publish
    mandatory, immediate)
  File "/opt/zenoss/Products/ZenMessaging/queuemessaging/publisher.py", line 376, in publish
    headers=headers, declareExchange=declareExchange)
  File "/opt/zenoss/lib/python/zenoss/protocols/amqp.py", line 138, in publish
    raise Exception("Could not publish message. Connection may be down")
Exception: Could not publish message. Connection may be down
2012-12-29 13:49:37,007 INFO zen.zenoss.protocols.amqp: amqp connection was closed [Errno 104] Connection reset by peer
2012-12-29 13:49:40,011 INFO zen.zenoss.protocols.amqp: amqp connection was closed [Errno 104] Connection reset by peer



###########
*Install.logs -*
[***@i2mpblrzenoss01 log]# tail -10 install.log
Daemon: zenrrdcached starting...Fresh install post step
--2012-12-28 21:33:39--  http://i2mpblrzenoss01.i2mp-infosys.com:8080/zport/dmd/DeviceLoader/loadDevice?deviceName=i2mpblrzenoss01.i2mp-infosys.com&devicePath=/Server/Linux http://i2mpblrzenoss01.i2mp-infosys.com:8080/zport/dmd/DeviceLoader/loadDevice?deviceName=i2mpblrzenoss01.i2mp-infosys.com&devicePath=/Server/Linux
Resolving i2mpblrzenoss01.i2mp-infosys.com... 10.68.128.42
Connecting to i2mpblrzenoss01.i2mp-infosys.com|10.68.128.42|:8080... connected.
HTTP request sent, awaiting response... 400 Bad Request
2012-12-28 21:33:39 ERROR 400: Bad Request.
##########
*Zensys.log -*
[***@i2mpblrzenoss01 log]# tail -5 zensyslog.log
2012-12-29 14:30:10,412 INFO zen.maintenance: Performing periodic maintenance
2012-12-29 14:30:10,413 INFO zen.zensyslog: 0 devices processed (0 datapoints)
2012-12-29 14:30:10,414 INFO zen.collector.scheduler: Tasks: 0 Successful_Runs: 0 Failed_Runs: 0 Missed_Runs: 0 Queued_Tasks: 0 Running_Tasks: 0
2012-12-29 14:30:10,414 WARNING zen.zensyslog: No service named 'EventService': ZenHub may be disconnected
2012-12-29 14:30:10,414 ERROR zen.maintenance: Maintenance failed. Message from hub: ZenHub is down
##########

Thanks,
Ramu
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70742#70742]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Andrew Kirch]

Andrew Kirch [http://community.zenoss.org/people/akirch] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70743#70743

--------------------------------------------------------------
Ramu,

Please paste the output of the below command when run as root on your zenoss install.

rabbitmqctl -p /zenoss list_queues
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70743#70743]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Ramu Chittiprolu]

Ramu Chittiprolu [http://community.zenoss.org/people/Ramu] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70729#70729

--------------------------------------------------------------
Hi Andrew,
Here is the output of the above command.

#######
[***@i2mpblrzenoss01 zenoss]#pwd
/opt/zenoss
*[***@i2mpblrzenoss01 zenoss]# rabbitmqctl -p /zenoss list_queues*
*Listing queues ...*
*...done.*
[***@i2mpblrzenoss01 zenoss]#
#######
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70729#70729]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Andrew Kirch]

Andrew Kirch [http://community.zenoss.org/people/akirch] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70744#70744

--------------------------------------------------------------
Ramu: Follow the instructions here: http://wiki.zenoss.org/Working_with_Queues http://wiki.zenoss.org/Working_with_Queues
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70744#70744]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Ramu Chittiprolu]

Ramu Chittiprolu [http://community.zenoss.org/people/Ramu] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70745#70745

--------------------------------------------------------------
Hi Andrew,

Thanks for the instructions provided. PFB, zenhub started running. However, am still seeing constraints in opening the web portal. Zopectl collector is still not running.

#########
[***@i2mpblrzenoss01 init.d]# service zenoss status
Daemon: zeneventserver program running; pid=28105
*Daemon: zopectl not running*
*Daemon: zenhub program running; pid=28239*
Daemon: zenjobs program running; pid=28307
Daemon: zeneventd program running; pid=28364
Daemon: zenping program running; pid=28400
Daemon: zensyslog program running; pid=28499
Daemon: zenstatus program running; pid=28479
Daemon: zenactiond program running; pid=28519
Daemon: zentrap program running; pid=28602
Daemon: zenmodeler program running; pid=28608
Daemon: zenperfsnmp program running; pid=28648
Daemon: zencommand program running; pid=28679
Daemon: zenprocess program running; pid=28708
Daemon: zenrrdcached program running; pid=28712
[***@i2mpblrzenoss01 init.d]#
###########

Below is the output when i try to start the zopectl..

*[***@i2mpblrzenoss01 bin]# ./zopectl start*
*Traceback (most recent call last):*
*  File "/opt/zenoss/zopehome/zopectl", line 5, in <module>*
*    from pkg_resources import load_entry_point*
*ImportError: No module named pkg_resources*
*[***@i2mpblrzenoss01 bin]#*
############

Zenhub logs:

[***@i2mpblrzenoss01 log]# tail zenhub.log
    mandatory, immediate)
  File "/opt/zenoss/Products/ZenMessaging/queuemessaging/publisher.py", line 376, in publish
    headers=headers, declareExchange=declareExchange)
  File "/opt/zenoss/lib/python/zenoss/protocols/amqp.py", line 138, in publish
    raise Exception("Could not publish message. Connection may be down")
Exception: Could not publish message. Connection may be down
2012-12-29 13:49:37,007 INFO zen.zenoss.protocols.amqp: amqp connection was closed [Errno 104] Connection reset by peer
2012-12-29 13:49:40,011 INFO zen.zenoss.protocols.amqp: amqp connection was closed [Errno 104] Connection reset by peer
2012-12-30 13:11:36,556 INFO zen.HubService.RenderConfig: Starting graph retrieval listener on port 8090
2012-12-30 13:26:09,515 INFO zen.HubService.RenderConfig: Starting graph retrieval listener on port 8090
##########
Output of rabbitmqctl -p /zenoss list_queues
*[***@i2mpblrzenoss01 log]# rabbitmqctl -p /zenoss list_queues*
*Listing queues ...*
*celery  0*
*i2mpblrzenoss01.i2mp-infosys.com.celeryd.pidbox 0*
*zenoss.queues.zep.heartbeats    0*
*zenoss.queues.zep.migrated.archive      0*
*zenoss.queues.zep.migrated.summary      0*
*zenoss.queues.zep.modelchange   0*
*zenoss.queues.zep.rawevents     0*
*zenoss.queues.zep.signal        0*
*zenoss.queues.zep.zenevents     0*
*...done.*
[***@i2mpblrzenoss01 log]#
###########

Thanks,
Ramu

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70745#70745]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Ramu Chittiprolu]

Ramu Chittiprolu [http://community.zenoss.org/people/Ramu] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70748#70748

--------------------------------------------------------------
Hi Andrew, Any update on the above issue?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70748#70748]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Andrew Kirch]

Andrew Kirch [http://community.zenoss.org/people/akirch] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70749#70749

--------------------------------------------------------------
I'm not a Zope guru, check Z2.log whould be the only advice I have at this point.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70749#70749]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Ramu Chittiprolu]

Ramu Chittiprolu [http://community.zenoss.org/people/Ramu] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70751#70751

--------------------------------------------------------------
Hi Andrew, I dont see Z2.log is existed.Here is the issue when i try to start zopectl.

#######
*[***@i2mpblrzenoss01 zopehome]# ls*
*addzope2user  mkzopeinstance  runzope  zopectl  zpasswd*
*[***@i2mpblrzenoss01 zopehome]# ./zopectl start*
*Traceback (most recent call last):*
*  File "./zopectl", line 5, in <module>*
*    from pkg_resources import load_entry_point*
*ImportError: No module named pkg_resources*
*[***@i2mpblrzenoss01 zopehome]# cat zopectl*
*#!/opt/zenoss/bin/python*
*# EASY-INSTALL-ENTRY-SCRIPT: 'Zope2==2.13.13','console_scripts','zopectl'*
*__requires__ = 'Zope2==2.13.13'*
*import sys*
*from pkg_resources import load_entry_point*
*sys.exit(*
*   load_entry_point('Zope2==2.13.13', 'console_scripts', 'zopectl')()*
*)*
*[***@i2mpblrzenoss01 zopehome]#*

#############

Thanks,
Ramu
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70751#70751]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[jcurry]

jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70756#70756

--------------------------------------------------------------
Ramu,
It looks like you are trying to start zopectl as root?   You should ALWAYS do Zenoss stuff as the zenoss user.  One of the few exceptions to this is the rabbitmq command that Andrew gave you, but the standard daemons you should start and stop as the zenoss user.

If you have been doing your testing and debugging as root, there is a danger that you now have various files owned by root instead of zenoss.  I'd start by trying to start zopectl as the zenoss user.

Run a ps -ef | grep zen
and check that all the Zenoss processes are running as the user zenoss.

Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70756#70756]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Ramu Chittiprolu]

Ramu Chittiprolu [http://community.zenoss.org/people/Ramu] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70760#70760

--------------------------------------------------------------
Hi Jane,
Thank you for the reply.

I cheked the above command. zenoss processes are running. But am not able to start the zenoss services using  zenoss account. When i type the password, am not getting anything.

#######
*[***@i2mpblriporws01 zenoss]$ cd /etc/init.d*
*[***@i2mpblriporws01 init.d]$ service zenoss start*
*Password:*
*#######*

*I have installed the zenoss application using root account. Please let me know what needs to be done now.*

*Awaiting for the response!!*

*Thanks,*
*Ramu
*
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70760#70760]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[jcurry]

jcurry [http://community.zenoss.org/people/jcurry] created the discussion

"Re: Zopectl and zenhub not running"

To view the discussion, visit: http://community.zenoss.org/message/70761#70761

--------------------------------------------------------------
Sorry - you are right - the "other" thing you cannot do as the zenoss user is the "service zenoss start" as that also brings up rabbit and MySQL.  However, I almost never use the is "service zenoss start".

I would become the zenoss user and then to start all the zenoss daemons (ie not mysql or rabbit), use "zenoss start".  Zenoss stop stops them all and zenoss status gives you status.  To start a single daemon, use <daemon name> start eg zeneventserver start.

As hipped, the zenoss user is created but you cannot login to it directly.  I wiuld log in as me, use su to switch to root and then use "su - zenoss" to become the zenoss user.

Cheers,
Jane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70761#70761]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]