Zenoss 4.2 - problems with ldap and snmp counter

Discussion:

ebogaard

2012-09-12 17:22:15 UTC

ebogaard [http://community.zenoss.org/people/ebogaard] created the discussion

"Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/68526#68526

--------------------------------------------------------------
After a failed upgrade from 3.2.1 to 4.2 on Centos 5, I decided to start with a fresh install in Cos6.

But now I experience two problems with the fresh 4.2 install, which didn't happen on the upgraded 4.2:
1. The LDAPServer-plugin keeps on nagging about 'No performance data from plugin'. When I look in the event viewer, it says 'Could not bind to LDAP server'. In the details is says 'Datasource: LDAPServer/ldap - Code: 2 - Msg: Misuse of shell builtins'. So I'm wondering what the actual error is.
I connect using ldaps v3 on port 636. The 'Configuration properties' for zLDAPxxx are checked and working.

2. I created a custom Postfix template that uses SNMP to read some values. Because this value increases when a message is sent/received/etc, I used a COUNTER. As the value started at around 20K for some OIDs, the graph is a bit screwed up, but that doesnt matter. The second time it reads the value, it should only see a small increase and show this as the 'current' value. Sadly, this doesn work and the 20K is shown as the current value. When I do a manual test against one of the devices, the value is retrieved nicely. I also tried to switch to DERIVED, but that didn't have any effect.

Hope you guys can help!

Something else (probably a bug): there are problems with remembering the 'severity' within several modules. This always shows up empty. But when you change the value and save it, the value is saved. You can see this in de LDAP-module for example.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/68526#68526]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

ebogaard

2012-09-13 07:34:15 UTC

Permalink

ebogaard [http://community.zenoss.org/people/ebogaard] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/68539#68539

--------------------------------------------------------------
Since some time, there's also another another annoying thing happening: there are quite some notifications about zenoss components missing their heartbeat. Even though these messages clear at about at the same time. Also, in the logs of the mentioned components, there's no mentioning of errors.

In the logfile "zeneventserver-stdio.2012_09_xx.log", there is an error shown at the time of the error, and it mentions the heartbeat:

2012-09-13 09:28:14.527:WARN:oejs.ServletHandler:/zeneventserver/api/1.0/heartbeats/
org.jboss.resteasy.spi.UnhandledException: org.springframework.transaction.TransactionSystemException: Could not roll back JDBC transaction; nested exception is com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.Connection was implicitly closed by the driver.
...
Caused by:
org.springframework.transaction.TransactionSystemException: Could not roll back JDBC transaction; nested exception is com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.Connection was implicitly closed by the driver.
....
Caused by:
com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.Connection was implicitly closed by the driver.

I checked MySQL with mysqltuner, but there doesn't seem to be a problem with the connections: the maximum number of connections wasn't reached at any time.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/68539#68539]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

Luca Maranzano

2012-10-08 08:48:48 UTC

Permalink

Luca Maranzano [http://community.zenoss.org/people/liuk] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/68888#68888

--------------------------------------------------------------
Hello,

same issues here on Zenoss 4.2 that we are testing for migration from 3.2.1.

Error messages are like these:

localhost zensyslog heartbeat failure
localhost zencommand heartbeat failure
localhost zenstatus heartbeat failure
localhost zenactiond heartbeat failure
localhost zentrap heartbeat failure
localhost zenperfsnmp heartbeat failure
localhost zenping heartbeat failure

they are generated almost in the same time and then after some minutes the auto clear arrives.

I think that the error is due to mysql connection time out, may be the connection pool from jdbc must be tuned right with mysql server timeout confguration, but still I'm investigating.

Anyone with a working configuration about these timeouts?

Thanks,
Luca
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/68888#68888]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

Shane Scott

2012-10-08 15:50:36 UTC

Permalink

Luca Maranzano

2012-10-08 16:01:12 UTC

Permalink

Shane Scott

2012-10-08 16:16:05 UTC

Permalink

Luca Maranzano

2012-10-08 20:42:22 UTC

Permalink

Luca Maranzano [http://community.zenoss.org/people/liuk] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/68932#68932

--------------------------------------------------------------
Here thery are:

| Zenoss (http://www.zenoss.com) | Zenoss 4.2.0 |
| OS (http://www.tldp.org) | Linux (x86_64) 2.6.18 (Linux zenosscm.finiper.it 2.6.18-308.13.1.el5 #1 SMP Tue Aug 21 17:10:18 EDT 2012 x86_64) |
| Zope (http://www.zope.org) | Zope 2.13.13 |
| Python (http://www.python.org) | Python 2.7.2 |
| Database (http://www.mysql.com) | MySQL 5.5.27 (Ver 5.5.27) |
| RRD (http://oss.oetiker.ch/rrdtool) | RRDtool 1.4.7 |
| Twisted (http:///twistedmatrix.com/trac) | Twisted 11.0.0 |
| RabbitMQ (http://www.rabbitmq.com/) | RabbitMQ 2.8.4 |
| Erlang (http://www.erlang.org/) | Erlang 5.6.5 |
| NetSnmp (http://net-snmp.sourceforge.net) | NetSnmp 5.3.2 |
| PyNetSnmp (http://www.zenoss.com) | PyNetSnmp 0.30.3 |

Any clue?

Thanks,
Luca
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/68932#68932]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

Shane Scott

2012-10-08 20:47:05 UTC

Permalink

Luca Maranzano

2012-10-09 08:10:20 UTC

Permalink

Luca Maranzano [http://community.zenoss.org/people/liuk] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/68935#68935

--------------------------------------------------------------
We are running on a CentOS 5.8 64 bit, a Virtual Machine with 2 vCPU @ 3.0 Ghz and 4 GB of RAM.

/etc/my.cnfÂ
[mysqld]
max_allowed_packet=16M
innodb_buffer_pool_size=256M
innodb_additional_mem_pool_size=20M

# /usr/sbin/rabbitmqctl list_queues -p /zenoss
Listing queues ...
celeryÂ Â Â 0
zenoss.queues.zep.migrated.summaryÂ Â Â 0
zenoss.queues.zep.migrated.archiveÂ Â Â 0
zenosscm.finiper.it.celeryd.pidboxÂ Â Â 0
zenoss.queues.zep.raweventsÂ Â Â 0
zenoss.queues.zep.heartbeatsÂ Â Â 0
zenoss.queues.zep.zeneventsÂ Â Â 0
zenoss.queues.zep.signalÂ Â Â 0
zenoss.queues.zep.modelchangeÂ Â Â 0
...done.

Thanks,
Luca
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/68935#68935]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

Shane Scott

2012-10-09 16:26:03 UTC

Permalink

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/68946#68946

--------------------------------------------------------------
Luca:

Let's update that mysql conf.

[mysqld]
skip_external_locking

#
# Per the current Zenoss Resource Manager Install Guide,
# please size innodb_buffer_pool_size according to the following
# guidelines:
#
# Deployment Size Value of innodb_buffer_pool_size
# -------------------- --------------------------------
# 1 to 250 devices 512M
# 250 to 500 devices 768M
# 500 to 1000 devices 1024M
# 1000 to 2000 devices 2048M
#
# If mysqld is installed on a dedicated system, this can (and should) be set
# to as much as 75% of available memory on the system.
#
innodb_buffer_pool_size =256M

# log file size should be 25% of of buffer pool size
innodb_log_file_size = 512M

innodb_additional_mem_pool_size = 32M
innodb_log_buffer_size = 8M
innodb_flush_method = O_DIRECT
innodb_flush_log_at_trx_commit = 2

# Set to 2 times the number of CPUs which can be dedicated to mysql
innodb_thread_concurrency = 2

# Setting this setting to 0 is recommended in virtualized environments. If
# running virtualized, it is recommended to uncomment the setting below when
# seeing database performance issues.
#innodb_spin_wait_delay = 0

# In large installs, there were a significant number of mutex waits on the
# adaptive hash index, and this needed to be disabled.
#innodb_adaptive_hash_index = OFF

# Use the Barracuda file format which enables support for dynamic and
# compressed row formats.
innodb_file_format = Barracuda

# Disable the query cache - it provides negligible performance improvements
# and leads to significant thread contention under load.
query_cache_size = 0
query_cache_type = OFF

max_allowed_packet = 64M
wait_timeout = 86400
interactive_timeout = 86400
max_connections = 1500
max_user_connections = 1500

# Enable dedicated purge thread. (default is 0)
innodb_purge_threads = 1
innodb_max_purge_lag = 100000

[client]
user = zenoss

[mysql]
max_allowed_packet = 64M

[mysqldump]
max_allowed_packet = 64M

In the $ZENHOME/etc/zeneventserver.conf uncomment the line zep.jdbc.pool.test_on_borrow=false and set zep.jdbc.pool.test_on_borrow=false to true.

Stop zenoss then stop mysqld. Delete the ib_logfile0 and ib_logfile1 in the mysql data directory. Start mysql and verify you can connect. If all is well, start zenoss.

Once done let it ride for a day or so to see if the situation improves.

Best,
--Shane Scott (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/68946#68946]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

Daniel Felipe Meireles de Souza

2012-10-24 22:23:31 UTC

Permalink

Daniel Felipe Meireles de Souza [http://community.zenoss.org/people/danfmsouza] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/69516#69516

--------------------------------------------------------------
http://community.zenoss.org/people/hackman238 Shane Scott,

Your reply works fine to me thanks!
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/69516#69516]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

Shane Scott

2012-10-25 23:52:56 UTC

Permalink

ingrid meriles

2012-11-09 12:40:32 UTC

Permalink

ingrid meriles [http://community.zenoss.org/people/ingrid.m] created the discussion

"Re: Zenoss 4.2 - problems with ldap and snmp counter"

To view the discussion, visit: http://community.zenoss.org/message/69796#69796

--------------------------------------------------------------
Hi well i have read ur posts, i thinkÂ i have the same problem, im new on Zenoss, and this is the error that i have.

*Type: <class 'zenoss.protocols.services.ServiceResponseError'>*
*Value: org.springframework.transaction.TransactionSystemException: Could not roll back JDBC transaction; nested exception is com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException: No operations allowed after connection closed.Connection was implicitly closed by the driver.*
Traceback (most recent call last): File "/opt/zenoss/lib/python/ZPublisher/Publish.py", line 126, in publish request, bind=1)
File "/opt/zenoss/lib/python/ZPublisher/mapply.py", line 77, in mapply if debug is not None: return debug(object,args,context)
File "/opt/zenoss/lib/python/ZPublisher/Publish.py", line 46, in call_object result=apply(object,args) # Type s<cr> to step into published object.
File "/opt/zenoss/lib/python/Products/Five/browser/metaconfigure.py", line 476, in __call__ return self.index(*args, **kw)
File "/opt/zenoss/lib/python/Products/Five/browser/pagetemplatefile.py", line 125, in __call__ return self.im_func(im_self, *args, **kw)
File "/opt/zenoss/Products/ZenWidgets/FileGzipper.py", line 82, in __call__ return original(self, __instance, *args, **keywords)
File "/opt/zenoss/lib/python/Products/Five/browser/pagetemplatefile.py", line 59, in __call__ sourceAnnotations=getattr(debug_flags, 'sourceAnnotations', 0),
File "/opt/zenoss/lib/python/zope/pagetemplate/pagetemplate.py", line 132, in pt_render strictinsert=0, sourceAnnotations=sourceAnnotations
File "/opt/zenoss/lib/python/zope/pagetemplate/pagetemplate.py", line 240, in __call__ interpreter()
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 266, in __call__ self.interpret(self.program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 883, in do_useMacro self.interpret(macro)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 528, in do_optTag_tal self.do_optTag(stuff)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 513, in do_optTag return self.no_tag(start, program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 508, in no_tag self.interpret(program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 883, in do_useMacro self.interpret(macro)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 528, in do_optTag_tal self.do_optTag(stuff)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 513, in do_optTag return self.no_tag(start, program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 508, in no_tag self.interpret(program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 883, in do_useMacro self.interpret(macro)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 528, in do_optTag_tal self.do_optTag(stuff)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 513, in do_optTag return self.no_tag(start, program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 508, in no_tag self.interpret(program)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args)
File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 737, in do_insertStructure_tal structure = self.engine.evaluateStructure(expr)
File "/opt/zenoss/lib/python/Products/PageTemplates/Expressions.py", line 218, in evaluateStructure text = super(ZopeContext, self).evaluateStructure(expr)
File "/opt/zenoss/lib/python/zope/tales/tales.py", line 696, in evaluate return expression(self)
File "/opt/zenoss/lib/python/zope/contentprovider/tales.py", line 80, in __call__ return provider.render()
File "/opt/zenoss/Products/ZenUI3/utils/javascript.py", line 28, in render raw_js = '\n'.join(v.render() for v in self.viewlets)
File "/opt/zenoss/Products/ZenUI3/utils/javascript.py", line 28, in <genexpr> raw_js = '\n'.join(v.render() for v in self.viewlets)
File "/opt/zenoss/Products/ZenUI3/utils/javascript.py", line 40, in render return self.snippet()
File "/opt/zenoss/Products/ZenUI3/browser/eventconsole/grid.py", line 159, in snippet defs = column_config(self.request, archive=archive)
File "/opt/zenoss/Products/ZenUI3/browser/eventconsole/grid.py", line 115, in column_config columns = _find_column_definitions(archive)
File "/opt/zenoss/Products/ZenUI3/browser/eventconsole/grid.py", line 71, in _find_column_definitions details = getFacade('zep').getUnmappedDetails()
File "/opt/zenoss/Products/Zuul/facades/zepfacade.py", line 656, in getUnmappedDetails return getDetailsInfo().getUnmappedDetails()
File "/opt/zenoss/Products/Zuul/facades/zepfacade.py", line 811, in getUnmappedDetails self._initDetails()
File "/opt/zenoss/Products/Zuul/facades/zepfacade.py", line 769, in _initDetails response, content = self._configClient.getDetails()
File "/opt/zenoss/lib/python/zenoss/protocols/services/zep.py", line 257, in getDetails return self.client.get('index_details')
File "/opt/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 181, in get return self._request(path, method='GET', params=params, headers=headers)
File "/opt/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 160, in _request response, content = self._executeRequest(request)
File "/opt/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest raise ServiceResponseError(response.reason, response.status, request, response, content)
ServiceResponseError: org.springframework.transaction.
TransactionSystemException: Could not roll back JDBC transaction;
nested exception is com.mysql.jdbc.exceptions.jdbc4.MySQLNonTransientConnectionException:
No operations allowed after connection closed.
Connection was implicitly closed by the driver.
please i need some help!!!
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/69796#69796]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]