Discussion:
my zenoss broke
Doug C
2012-12-10 20:37:00 UTC
Permalink
Doug C [http://community.zenoss.org/people/thedukeness] created the discussion

"my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70436#70436

--------------------------------------------------------------
My network-script for eth0 had a rogue value in it for the dns server and search suffix.  After I rebooted it took effect and seems to have broken Zenoss.  I've corrected resolv.conf and removed those settings from the network-script but now I get this when I log into Zenoss.

Type: <class 'zenoss.protocols.services.ServiceResponseError'>
Value: Service Unavailable
Traceback (most recent call last): File "/opt/zenoss/lib/python/ZPublisher/Publish.py", line 126, in publish request, bind=1) File "/opt/zenoss/lib/python/ZPublisher/mapply.py", line 77, in mapply if debug is not None: return debug(object,args,context) File "/opt/zenoss/lib/python/ZPublisher/Publish.py", line 46, in call_object result=apply(object,args) # Type s<cr> to step into published object. File "/opt/zenoss/lib/python/Products/Five/browser/metaconfigure.py", line 476, in __call__ return self.index(*args, **kw) File "/opt/zenoss/lib/python/Products/Five/browser/pagetemplatefile.py", line 125, in __call__ return self.im_func(im_self, *args, **kw) File "/opt/zenoss/Products/ZenWidgets/FileGzipper.py", line 82, in __call__ return original(self, __instance, *args, **keywords) File "/opt/zenoss/lib/python/Products/Five/browser/pagetemplatefile.py", line 59, in __call__ sourceAnnotations=getattr(debug_flags, 'sourceAnnotations', 0), File "/opt/zenoss/lib/python/zope/pagetemplate/pagetemplate.py", line 132, in pt_render strictinsert=0, sourceAnnotations=sourceAnnotations File "/opt/zenoss/lib/python/zope/pagetemplate/pagetemplate.py", line 240, in __call__ interpreter() File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 266, in __call__ self.interpret(self.program) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 883, in do_useMacro self.interpret(macro) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 528, in do_optTag_tal self.do_optTag(stuff) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 513, in do_optTag return self.no_tag(start, program) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 508, in no_tag self.interpret(program) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 883, in do_useMacro self.interpret(macro) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 528, in do_optTag_tal self.do_optTag(stuff) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 513, in do_optTag return self.no_tag(start, program) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 508, in no_tag self.interpret(program) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 338, in interpret handlers[opcode](self, args) File "/opt/zenoss/lib/python/zope/tal/talinterpreter.py", line 737, in do_insertStructure_tal structure = self.engine.evaluateStructure(expr) File "/opt/zenoss/lib/python/Products/PageTemplates/Expressions.py", line 218, in evaluateStructure text = super(ZopeContext, self).evaluateStructure(expr) File "/opt/zenoss/lib/python/zope/tales/tales.py", line 696, in evaluate return expression(self) File "/opt/zenoss/lib/python/zope/contentprovider/tales.py", line 80, in __call__ return provider.render() File "/opt/zenoss/Products/ZenUI3/utils/javascript.py", line 28, in render raw_js = '\n'.join(v.render() for v in self.viewlets) File "/opt/zenoss/Products/ZenUI3/utils/javascript.py", line 28, in <genexpr> raw_js = '\n'.join(v.render() for v in self.viewlets) File "/opt/zenoss/Products/ZenUI3/utils/javascript.py", line 40, in render return self.snippet() File "/opt/zenoss/Products/ZenUI3/browser/eventconsole/grid.py", line 159, in snippet defs = column_config(self.request, archive=archive) File "/opt/zenoss/Products/ZenUI3/browser/eventconsole/grid.py", line 115, in column_config columns = _find_column_definitions(archive) File "/opt/zenoss/Products/ZenUI3/browser/eventconsole/grid.py", line 71, in _find_column_definitions details = getFacade('zep').getUnmappedDetails() File "/opt/zenoss/Products/Zuul/facades/zepfacade.py", line 656, in getUnmappedDetails return getDetailsInfo().getUnmappedDetails() File "/opt/zenoss/Products/Zuul/facades/zepfacade.py", line 811, in getUnmappedDetails self._initDetails() File "/opt/zenoss/Products/Zuul/facades/zepfacade.py", line 769, in _initDetails response, content = self._configClient.getDetails() File "/opt/zenoss/lib/python/zenoss/protocols/services/zep.py", line 257, in getDetails return self.client.get('index_details') File "/opt/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 181, in get return self._request(path, method='GET', params=params, headers=headers) File "/opt/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 160, in _request response, content = self._executeRequest(request) File "/opt/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest raise ServiceResponseError(response.reason, response.status, request, response, content) ServiceResponseError: Service Unavailable


Any ideas on how the bad dns settings broke it and where I can fix this?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70436#70436]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Philip Warren
2012-12-10 21:43:46 UTC
Permalink
Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70451#70451

--------------------------------------------------------------
Can you try applying the steps in this comment:

http://community.zenoss.org/message/68939#68939#68939 http://community.zenoss.org/message/68939#68939

Then restart 'zeneventserver' daemon and the 'zopectl' daemon and see if the problem is now resolved.

Thanks,

Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70451#70451]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Doug C
2012-12-10 22:09:29 UTC
Permalink
Doug C [http://community.zenoss.org/people/thedukeness] created the discussion

"Re: my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70437#70437

--------------------------------------------------------------
no luck unfortunately.  I'm still getting the same Zenoss error after setting zep.jdbc.pool.test_on_borrow=true.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70437#70437]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Philip Warren
2012-12-11 11:58:07 UTC
Permalink
Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70439#70439

--------------------------------------------------------------
Can you attach to this forum post the following logs from your system?

* /opt/zenoss/log/event.log
* /opt/zenoss/log/zeneventserver.log
* /opt/zenoss/log/zeneventserver-YYYY-MM-DD.log (from the day you started it last)

Thanks,

Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70439#70439]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Doug C
2012-12-11 20:04:37 UTC
Permalink
Doug C [http://community.zenoss.org/people/thedukeness] created the discussion

"Re: my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70442#70442

--------------------------------------------------------------
Thanks Philip, here's those logs --

http://pastebin.com/t2UwYTeb http://pastebin.com/t2UwYTeb
http://pastebin.com/C2T7kYR3 http://pastebin.com/C2T7kYR3
http://s000.tinyupload.com/index.php?file_id=47541612596821796279 http://s000.tinyupload.com/index.php?file_id=47541612596821796279
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70442#70442]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Philip Warren
2012-12-11 21:10:22 UTC
Permalink
Philip Warren [http://community.zenoss.org/people/pwarren] created the discussion

"Re: my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70443#70443

--------------------------------------------------------------
From what I can tell, MySQL was shut down without having a chance to complete partitioning operations leaving the event_archive table in an unknown state. You have a few options, depending on how you want to proceed:

1. Start over with a fresh events database (losing any current Zenoss events). You can re-initialize the zenoss_zep database with a command similar to:

$ zeneventserver-create-db --force --dbtype=mysql --dbname=zenoss_zep --dbhost=localhost --dbport=3306 --dbuser=zenoss --dbpass=zenoss

Run 'zeneventserver-create-db --help' for information on the available options.


2. Restore from a previous events database backup (if available).


3. Attempt to drop/re-create the 'event_archive' table. Download this script ( https://gist.github.com/4262124 https://gist.github.com/4262124) to a file named event_archive_restore.sql, and execute it as follows (specify your root user password if is set):

$ mysql -uroot zenoss_zep < event_archive_restore.sql

This may not work if MySQL doesn't let you drop the table.


Hopefully one of these options will work for you.

-- Philip
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70443#70443]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Doug C
2012-12-11 22:55:28 UTC
Permalink
Doug C [http://community.zenoss.org/people/thedukeness] created the discussion

"Re: my zenoss broke"

To view the discussion, visit: http://community.zenoss.org/message/70444#70444

--------------------------------------------------------------
Bam, you nailed it.  Option 1 did the trick for me.  You were right, my mysql db must have been corrupt because I couldn't even drop it, I had to delete the tables with rm.  Many thanks.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/70444#70444]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]
Loading...