millerjord
2013-05-30 07:00:32 UTC
millerjord [http://community.zenoss.org/people/millerjord] created the discussion
"Lots of unhandled exceptions in Zenoss Core 4.2.3"
To view the discussion, visit: http://community.zenoss.org/message/73356#73356
--------------------------------------------------------------
Hi
All of a sudden my installation of Zenoss has started to produce lots of unhandled exceptions, and some POSKEYerrors. I have tried figuring out the reason, and have found a server entry that might be the reason for the POSKeyError. But I can't delete the device, not using the webUI at least.
These errors result in errors in the monitored servers not being reported, like crashing services. What else I don't get alerts on I don't know.
I thought about doing a clean install, but I can't find the zendevicedump, and I have ~400 devices set up.
Any help is appreciated.
Here are the logs from the server:
Unhandled exception in zenhub service ZenPacks.zenoss.WindowsMonitor.services.WinPerfConfig.WinPerfConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/services/WinPerfConfig.py", line 70, in _createDeviceProxy for comp in device.getMonitoredComponents(): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", l
-----------------------------------------------
Unhandled exception in zenhub service ZenPacks.zenoss.ZenJMX.services.ZenJMXConfigService.ZenJMXConfigService: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.ZenJMX-3.9.3-py2.7.egg/ZenPacks/zenoss/ZenJMX/services/ZenJMXConfigService.py", line 211, in _createDeviceProxy for component in device.getMonitoredComponents(): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", line 476, in load raise POSKeyError(oid) POSKeyError: 0x080a0a
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.ProcessConfig.ProcessConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/ProcessConfig.py", line 70, in _createDeviceProxy procs = device.getMonitoredComponents(collector='zenprocess') File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", line 476, in load raise POSKeyError(oid) POSKeyError: 0x080a0
-----------------------------------------------
Unhandled exception in zenhub service ZenPacks.zenoss.WindowsMonitor.services.WinServiceConfig.WinServiceConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/services/WinServiceConfig.py", line 80, in _createDeviceProxy for service in genServices(device): File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/services/WinServiceConfig.py", line 49, in genServices for service in device.getMonitoredComponents(type='WinService'): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py",
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.CommandPerformanceConfig.CommandPerformanceConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/CommandPerformanceConfig.py", line 192, in _createDeviceProxy for comp in device.getMonitoredComponents(collector='zencommand'): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storag
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.PingPerformanceConfig.PingPerformanceConfig: 0x127bb6
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 165, in _createDeviceProxy self._getComponentConfig(iface, perfServer, proxy.monitoredIps) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 102, in _getComponentConfig for ipAddress in iface.ipaddresses(): File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 71, in __call__ return self.objectValuesAll() File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 174, in objectValuesAll return list(self.objectValuesGen()) File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 181, in objectValuesGen for obj in self._objects: File "/opt/zenoss/lib/python2.7/_abcoll.py", line 532, in __iter__ v = self[i] File "/opt/zenoss/lib/python2.7/UserList.py", line 31, in __getitem__ def __getitem__(self, i): return self.data[i] File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", l
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.PingPerformanceConfig.PingPerformanceConfig: 0x106a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 165, in _createDeviceProxy self._getComponentConfig(iface, perfServer, proxy.monitoredIps) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 102, in _getComponentConfig for ipAddress in iface.ipaddresses(): File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 71, in __call__ return self.objectValuesAll() File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 174, in objectValuesAll return list(self.objectValuesGen()) File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 181, in objectValuesGen for obj in self._objects: File "/opt/zenoss/lib/python2.7/_abcoll.py", line 532, in __iter__ v = self[i] File "/opt/zenoss/lib/python2.7/UserList.py", line 31, in __getitem__ def __getitem__(self, i): return self.data[i] File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py",
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.PingPerformanceConfig.PingPerformanceConfig: 0x0dcceb
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 165, in _createDeviceProxy self._getComponentConfig(iface, perfServer, proxy.monitoredIps) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 102, in _getComponentConfig for ipAddress in iface.ipaddresses(): File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 71, in __call__ return self.objectValuesAll() File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 174, in objectValuesAll return list(self.objectValuesGen()) File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 181, in objectValuesGen for obj in self._objects: File "/opt/zenoss/lib/python2.7/_abcoll.py", line 532, in __iter__ v = self[i] File "/opt/zenoss/lib/python2.7/UserList.py", line 31, in __getitem__ def __getitem__(self, i): return self.data[i] File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py"
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.SnmpPerformanceConfig.SnmpPerformanceConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenHub/services/SnmpPerformanceConfig.py", line 136, in _createDeviceProxies components = device.os.getMonitoredComponents(collector="zenperfsnmp") File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", line 476, in load raise POSKeyError(oid) POSKeyError: 0x080a0a
-----------------------------------------------
Internal exception processing event: POSKeyError('\x00\x00\x00\x00\x00\x08\n\x12',)/{'nt_event_code': 256, 'severity': 1, 'first_seen_time': 1369894761914L, 'monitor': u'localhost', 'actor': {'element_identifier': u'server1.domain.com', 'element_sub_type_id': 2, 'element_type_id': 1, 'element_sub_identifier': u'vmStatsProvider'}, 'summary': u'The "vmStatsProvider" is successfully initialized for this Virtual Machine. WMI namespace: "root\\cimv2".', 'agent': u'zeneventlog', 'created_time': 1369894761914L, 'details': [{'name': u'manager', 'value': [u'zenoss4.domain.com']}, {'name': u'categorystring', 'value': [u'General']}, {'name': u'eventidentifier', 'value': [u'131328']}, {'name': u'computername', 'value': [u'server1.domain.com']}, {'name': u'originaltime', 'value': [u'2013/05/30 06:19:21']}], 'event_class_key': u'vmStatsProvider_256', 'event_group': u'Application', 'event_key': u'', 'uuid': u'dfe613ce-c8f0-11e2-bd70-0050569934
--------------------------------------------------------------
Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/73356#73356]
Start a new discussion in zenoss-users at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
"Lots of unhandled exceptions in Zenoss Core 4.2.3"
To view the discussion, visit: http://community.zenoss.org/message/73356#73356
--------------------------------------------------------------
Hi
All of a sudden my installation of Zenoss has started to produce lots of unhandled exceptions, and some POSKEYerrors. I have tried figuring out the reason, and have found a server entry that might be the reason for the POSKeyError. But I can't delete the device, not using the webUI at least.
These errors result in errors in the monitored servers not being reported, like crashing services. What else I don't get alerts on I don't know.
I thought about doing a clean install, but I can't find the zendevicedump, and I have ~400 devices set up.
Any help is appreciated.
Here are the logs from the server:
Unhandled exception in zenhub service ZenPacks.zenoss.WindowsMonitor.services.WinPerfConfig.WinPerfConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/services/WinPerfConfig.py", line 70, in _createDeviceProxy for comp in device.getMonitoredComponents(): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", l
-----------------------------------------------
Unhandled exception in zenhub service ZenPacks.zenoss.ZenJMX.services.ZenJMXConfigService.ZenJMXConfigService: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.ZenJMX-3.9.3-py2.7.egg/ZenPacks/zenoss/ZenJMX/services/ZenJMXConfigService.py", line 211, in _createDeviceProxy for component in device.getMonitoredComponents(): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", line 476, in load raise POSKeyError(oid) POSKeyError: 0x080a0a
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.ProcessConfig.ProcessConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/ProcessConfig.py", line 70, in _createDeviceProxy procs = device.getMonitoredComponents(collector='zenprocess') File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", line 476, in load raise POSKeyError(oid) POSKeyError: 0x080a0
-----------------------------------------------
Unhandled exception in zenhub service ZenPacks.zenoss.WindowsMonitor.services.WinServiceConfig.WinServiceConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/services/WinServiceConfig.py", line 80, in _createDeviceProxy for service in genServices(device): File "/opt/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/services/WinServiceConfig.py", line 49, in genServices for service in device.getMonitoredComponents(type='WinService'): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py",
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.CommandPerformanceConfig.CommandPerformanceConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/CommandPerformanceConfig.py", line 192, in _createDeviceProxy for comp in device.getMonitoredComponents(collector='zencommand'): File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storag
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.PingPerformanceConfig.PingPerformanceConfig: 0x127bb6
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 165, in _createDeviceProxy self._getComponentConfig(iface, perfServer, proxy.monitoredIps) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 102, in _getComponentConfig for ipAddress in iface.ipaddresses(): File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 71, in __call__ return self.objectValuesAll() File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 174, in objectValuesAll return list(self.objectValuesGen()) File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 181, in objectValuesGen for obj in self._objects: File "/opt/zenoss/lib/python2.7/_abcoll.py", line 532, in __iter__ v = self[i] File "/opt/zenoss/lib/python2.7/UserList.py", line 31, in __getitem__ def __getitem__(self, i): return self.data[i] File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", l
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.PingPerformanceConfig.PingPerformanceConfig: 0x106a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 165, in _createDeviceProxy self._getComponentConfig(iface, perfServer, proxy.monitoredIps) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 102, in _getComponentConfig for ipAddress in iface.ipaddresses(): File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 71, in __call__ return self.objectValuesAll() File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 174, in objectValuesAll return list(self.objectValuesGen()) File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 181, in objectValuesGen for obj in self._objects: File "/opt/zenoss/lib/python2.7/_abcoll.py", line 532, in __iter__ v = self[i] File "/opt/zenoss/lib/python2.7/UserList.py", line 31, in __getitem__ def __getitem__(self, i): return self.data[i] File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py",
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.PingPerformanceConfig.PingPerformanceConfig: 0x0dcceb
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenCollector/services/config.py", line 227, in _createDeviceProxies proxy = self._createDeviceProxy(device) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 165, in _createDeviceProxy self._getComponentConfig(iface, perfServer, proxy.monitoredIps) File "/opt/zenoss/Products/ZenHub/services/PingPerformanceConfig.py", line 102, in _getComponentConfig for ipAddress in iface.ipaddresses(): File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 71, in __call__ return self.objectValuesAll() File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 174, in objectValuesAll return list(self.objectValuesGen()) File "/opt/zenoss/Products/ZenRelations/ToManyRelationship.py", line 181, in objectValuesGen for obj in self._objects: File "/opt/zenoss/lib/python2.7/_abcoll.py", line 532, in __iter__ v = self[i] File "/opt/zenoss/lib/python2.7/UserList.py", line 31, in __getitem__ def __getitem__(self, i): return self.data[i] File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py"
-----------------------------------------------
Unhandled exception in zenhub service Products.ZenHub.services.SnmpPerformanceConfig.SnmpPerformanceConfig: 0x080a0a
Traceback (most recent call last): File "/opt/zenoss/Products/ZenCollector/services/config.py", line 108, in _wrapFunction return functor(*args, **kwargs) File "/opt/zenoss/Products/ZenHub/services/SnmpPerformanceConfig.py", line 136, in _createDeviceProxies components = device.os.getMonitoredComponents(collector="zenperfsnmp") File "/opt/zenoss/Products/ZenModel/Device.py", line 531, in getMonitoredComponents collector=collector, type=type) File "/opt/zenoss/Products/ZenModel/Device.py", line 591, in getDeviceComponents return list(getObjectsFromCatalog(self.componentSearch, query, log)) File "/opt/zenoss/Products/ZenUtils/Utils.py", line 1654, in getObjectsFromCatalog for brain in catalog(query): File "/opt/zenoss/lib/python/ZODB/Connection.py", line 860, in setstate self._setstate(obj) File "/opt/zenoss/lib/python/ZODB/Connection.py", line 901, in _setstate p, serial = self._storage.load(obj._p_oid, '') File "/opt/zenoss/lib/python/relstorage/storage.py", line 476, in load raise POSKeyError(oid) POSKeyError: 0x080a0a
-----------------------------------------------
Internal exception processing event: POSKeyError('\x00\x00\x00\x00\x00\x08\n\x12',)/{'nt_event_code': 256, 'severity': 1, 'first_seen_time': 1369894761914L, 'monitor': u'localhost', 'actor': {'element_identifier': u'server1.domain.com', 'element_sub_type_id': 2, 'element_type_id': 1, 'element_sub_identifier': u'vmStatsProvider'}, 'summary': u'The "vmStatsProvider" is successfully initialized for this Virtual Machine. WMI namespace: "root\\cimv2".', 'agent': u'zeneventlog', 'created_time': 1369894761914L, 'details': [{'name': u'manager', 'value': [u'zenoss4.domain.com']}, {'name': u'categorystring', 'value': [u'General']}, {'name': u'eventidentifier', 'value': [u'131328']}, {'name': u'computername', 'value': [u'server1.domain.com']}, {'name': u'originaltime', 'value': [u'2013/05/30 06:19:21']}], 'event_class_key': u'vmStatsProvider_256', 'event_group': u'Application', 'event_key': u'', 'uuid': u'dfe613ce-c8f0-11e2-bd70-0050569934
--------------------------------------------------------------
Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/73356#73356]
Start a new discussion in zenoss-users at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]