Triggers and notifications are not shown in the UI

[Maxim Yegorushkin]

Maxim Yegorushkin [http://community.zenoss.org/people/max0x7ba] created the discussion

"Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70800#70800

--------------------------------------------------------------
Hi Zenoss community,

I use Zenoss Core 4.2. I used to be able to view and create triggers and notifications in the web UI. Now when I open that page it displays a warning pop up with no text and none of my existing triggers and notifications are shown (see the screenshot below). How do I fix this please?

Loading Image... Loading Image...
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70800#70800]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Michele Abò]

Michele Abò [http://community.zenoss.org/people/doGmaI] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70991#70991

--------------------------------------------------------------
I have noticed the same problem in my fresh install of Zenoss 4.2.3

I noticed that the problem (in my case) arises after I add the first trigger (I name it ReportAllErrors).
Looking in /opt/zenoss/log/event.log I noticed

+------+
[phone]T04:52:35 INFO zen.TriggersFacade SYNC: *Found trigger uuid in zep that does not seem to exist in zodb, creating: AllErrors*+
+------+
[phone]T04:52:38 ERROR Zope.SiteErrorLog 1358243558.270.30512805136 http://10.0.20.43:8080/zport/dmd/Events/triggers_router http://10.0.20.43:8080/zport/dmd/Events/triggers_router+
+Traceback (innermost last):+
+  Module ZPublisher.Publish, line 134, in publish+
+  Module Zope2.App.startup, line 301, in commit+
+  Module transaction._manager, line 89, in commit+
+  Module transaction._transaction, line 327, in commit+
+  Module transaction._transaction, line 397, in _callBeforeCommitHooks+
+  Module Products.ZenMessaging.queuemessaging.publisher, line 236, in beforeCompletionHook+
+  Module Products.ZenMessaging.queuemessaging.publisher, line 396, in channel+
+  Module zenoss.protocols.amqp, line 69, in getChannel+
+  Module amqplib.client_0_8.connection, line 144, in __init__+
+  Module amqplib.client_0_8.abstract_channel, line 95, in wait+
+  Module amqplib.client_0_8.connection, line 202, in _wait_method+
+  Module amqplib.client_0_8.method_framing, line 221, in read_method+
+error: [Errno 104] Connection reset by peer+

Going in mysql and deleting the row AllError from the table event_trigger solved the problem (the page with the triggers appears again, but if I try to add another trigger, with a different name in case the problem was a reserved word or something like that, the problem arises again

I hope this helps

PS: when I open the page triggers i get a popUp saying "Server Exception - The server reported the following error: unable to connect to the server. The system has encountered an error Please reload the page" with two buttons: reload and dismiss
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70991#70991]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Philip Warren]

Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70993#70993

--------------------------------------------------------------
Those error messages point to a problem connecting to the RabbitMQ server. Is RabbitMQ running on the system? Can you run the following commands on the system (as root) and post the results here to troubleshoot further?

# service rabbitmq-server status
# rabbitmqctl list_vhosts
# rabbitmqctl list_users
# rabbitmqctl list_queues -p /zenoss
# rabbitmqctl list_user_permissions zenoss

Thanks,

-- Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70993#70993]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Maxim Yegorushkin]

Maxim Yegorushkin [http://community.zenoss.org/people/max0x7ba] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/71008#71008

--------------------------------------------------------------
Hi Philip,

This is what these commands output:
[***@linux02 ~]# service rabbitmq-server status
Status of node ***@localhost ...
Error: unable to connect to node ***@localhost: nodedown

DIAGNOSTICS
===========

nodes in question: [***@localhost]

hosts, their running nodes and ports:
- localhost: [{rabbit,34918},{rabbitmqctl17045,59165}]

current node details:
- node name: ***@linux02
- home dir: /var/lib/rabbitmq
- cookie hash: gee/l9ejO6/u7O7kSGCZbw==

[***@linux02 ~]# rabbitmqctl list_vhosts
Listing vhosts ...
/zenoss
/
...done.
[***@linux02 ~]# rabbitmqctl list_users
Listing users ...
guest   [administrator]
zenoss  []
...done.
[***@linux02 ~]#  rabbitmqctl list_users
Listing users ...
guest   [administrator]
zenoss  []
...done.
[***@linux02 ~]# rabbitmqctl list_user_permissions zenoss
Listing permissions for user "zenoss" ...
/zenoss .*      .*      .*
...done.

The first line of service rabbitmq-server status looks suspect.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/71008#71008]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Philip Warren]

Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70994#70994

--------------------------------------------------------------
In $ZENHOME/etc/global.conf, is are 'amqphost' and 'amqpport' set to the default values of 'localhost' and '5672' on your system? If so, can you run this command (as root) to show what is listening on port 5672?

# netstat -anltp | grep 5672

Does this system use DHCP? Has its hostname changed recently?

-- Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70994#70994]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Michele Abò]

Michele Abò [http://community.zenoss.org/people/doGmaI] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70995#70995

--------------------------------------------------------------
Thanks for you response Philip

Don't know if it is better to start another thread to avoid mixing informations with those supplied by Maxim.

In the meantime I'm attaching my output here (hoping it will help to solve both mine and Maxim problems)

# service rabbitmq-server status
+Status of node ***@zenoss_dev_02 ...+
+[{pid,3502},+
+{running_applications,[{rabbit,"RabbitMQ","2.8.6"},+
+                        {mnesia,"MNESIA  CXC 138 12","4.4.7"},+
+                        {os_mon,"CPO  CXC 138 46","2.1.8"},+
+                        {sasl,"SASL  CXC 138 11","2.1.5.4"},+
+                        {stdlib,"ERTS  CXC 138 10","1.15.5"},+
+                        {kernel,"ERTS  CXC 138 10","2.12.5"}]},+
+{os,{unix,linux}},+
+{erlang_version,"Erlang (BEAM) emulator version 5.6.5 [source] [64-bit] [async-threads:30] [hipe] [kernel-poll:true]\n"},+
+{memory,[{total,24898856},+
+          {processes,9975616},+
+          {processes_used,9955352},+
+          {system,14923240},+
+          {atom,1070473},+
+          {atom_used,1054773},+
+          {binary,123344},+
+          {code,11799175},+
+          {ets,743448}]},+
+{vm_memory_high_watermark,0.4},+
+{vm_memory_limit,1656687820},+
+{disk_free_limit,1000000000},+
+{disk_free,5604323328},+
+{file_descriptors,[{total_limit,924},+
+                    {total_used,4},+
+                    {sockets_limit,829},+
+                    {sockets_used,2}]},+
+{processes,[{limit,1048576},{used,119}]},+
+{run_queue,0},+
+{uptime,9973}]+
+...done.+


# rabbitmqctl list_vhosts
+Listing vhosts ...+
+/+
+...done.+


# rabbitmqctl list_users
+Listing users ...+
+guest     [administrator]+
+...done.+


# rabbitmqctl list_queues -p /zenoss
+Listing queues ...+
+...done.+


# rabbitmqctl list_user_permissions zenoss
Listing permissions for user "zenoss" ...
After this, a message "Error: no_suc_user: zenoss" appears on screen (I did a rabbitmqctl list_user_permissions zenoss > output.txt but the error wasn't in the output file

In /opt/zenoss/etc/global.conf both amqphost and amqpport are set to default values
+zodb-cachesize 1000+

+amqphost localhost+
+amqpport 5672+
+amqpvhost /zenoss+

# netstat-anltp | grep 5672
+tcp        0      0 127.0.0.1:42377             127.0.0.1:5672              ESTABLISHED 8037/python+
+tcp        0      0 127.0.0.1:42376             127.0.0.1:5672              ESTABLISHED 4738/python+
+tcp        0      0 127.0.0.1:42375             127.0.0.1:5672              ESTABLISHED 4596/python+
+tcp        0      0 127.0.0.1:42374             127.0.0.1:5672              ESTABLISHED 4534/python+
+tcp        0      0 :::5672                     :::*                        LISTEN      3502/beam+
+tcp        0      0 ::ffff:127.0.0.1:5672       ::ffff:127.0.0.1:42374      ESTABLISHED 3502/beam+
+tcp        0      0 ::ffff:127.0.0.1:5672       ::ffff:127.0.0.1:42375      ESTABLISHED 3502/beam+
+tcp        0      0 ::ffff:127.0.0.1:5672       ::ffff:127.0.0.1:42376      ESTABLISHED 3502/beam+
+tcp        0      0 ::ffff:127.0.0.1:5672       ::ffff:127.0.0.1:42377      ESTABLISHED 3502/beam+

The system has a fixed IP.
I changed its hostname, before following the wizard to configure zenoss to zenoss_dev_02

Thanks for any help
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70995#70995]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Philip Warren]

Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70996#70996

--------------------------------------------------------------

# rabbitmqctl add_user zenoss zenoss
# rabbitmqctl add_vhost /zenoss
# rabbitmqctl set_permissions -p /zenoss zenoss '.*' '.*' '.*'
# service zenoss stop
# service zenoss start

-- Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70996#70996]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Michele Abò]

Michele Abò [http://community.zenoss.org/people/doGmaI] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70997#70997

--------------------------------------------------------------
UPDATE: since you pointed out about DHCP and Fixed IP, I've tried to create a new virtual machine (using the virtual machine package downloaded from zenoss website), and setup triggers before setting the IP address of the virtual machine to a fixed IP. Strange, but with DHCP, the trigger was correctly created, with fixed IP no.
Just wanted to point it out, in case it can help to find the source of the problem

I will try to run the commands you suggested on my other instance
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70997#70997]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Michele Abò]

Michele Abò [http://community.zenoss.org/people/doGmaI] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70998#70998

--------------------------------------------------------------
Just to complete my information
1. running the installation web wizard on a freshly deployed virtual machine with no changes completes successfully1. adding the trigger without modification completes successfully
2. adding the trigger after setting the IP address to fixes completes successfully
3. adding the trigger after setting the IP address to fixed and changing the hostname doesn't complete1. using the command supplied by Phillip solves the problem: the trigger page loads without error and you can add more trigger


2. running the installation wizard on a virtual machine with fixed ip and an hostname set to zenoss_dev_03 doesn't complete successfully. After the page where you set the admin password, a page with a webform to report the error appears. If you reload the page with the browser reload button, you're into the standard zenoss UI logged in as admin (I don't know the password. Haven't tried the reset password procedure). No other user is created

Thanks for your support Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70998#70998]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Philip Warren]

Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/70999#70999

--------------------------------------------------------------
For Zenoss systems whose hostnames may change, it is preferable to configure RabbitMQ to have a fixed NODENAME prior to installing Zenoss. This will prevent any of the RabbitMQ configuration changing when the hostname changes. To do so, perform the following before installing the Zenoss RPM:

# service rabbitmq-server stop

Create /etc/rabbitmq/rabbitmq-env.conf with the contents:

NODENAME=***@localhost

Start rabbit:

# service rabbitmq-server start

After making these changes, 'rabbitmqctl status' should show the node name as '***@localhost'.

-- Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70999#70999]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Maxim Yegorushkin]

Maxim Yegorushkin [http://community.zenoss.org/people/max0x7ba] created the discussion

"Re: Triggers and notifications are not shown in the UI"

To view the discussion, visit: http://community.zenoss.org/message/71015#71015

--------------------------------------------------------------

Post by Philip Warren
In $ZENHOME/etc/global.conf, is are 'amqphost' and 'amqpport' set to the default values of 'localhost' and '5672' on your system? If so, can you run this command (as root) to show what is listening on port 5672?
# netstat -anltp | grep 5672
Does this system use DHCP? Has its hostname changed recently?
-- Philip

Checked $ZENHOME/etc/global.conf, amqphost and amqpport have the expected values.

beam.smp process listens on :::5672.

The system is using a static IP.

Also, the system is a Red Hat IPA client, that authenticate users against an IPA server. But it can still have local users like it does for root, zenoss, etc..
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/71015#71015]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]