AttributeError __call__ error

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62468#62468

--------------------------------------------------------------
I get the following error when attempting to click on "INFRASTRUCTURE" in Zenoss 3.0.3 (CentOS)

The server reported the following error:
AttributeError __call__
The system has encountered an error. Please reload the page.


Everything else is ok as far as events, reports and advanced. I'm trying to troubleshoot some SNMP down events but cannot make it to the devices through In
frastructure. Any ideas?

event.log shows

2011-11-07T12:21:50 ERROR extdirect __call__
Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenUtils/extdirect/router.py", line 128, in _processDirectRequest
    result = _targetfn(**data)
  File "/opt/zenoss/Products/Zuul/routers/device.py", line 49, in getTree
    tree = facade.getTree(id)
  File "/opt/zenoss/Products/Zuul/facades/__init__.py", line 77, in getTree
    return ITreeNode(obj)
  File "/opt/zenoss/lib/python/zope/site/hooks.py", line 95, in adapter_hook
    return siteinfo.adapter_hook(interface, object, name, default)
  File "/opt/zenoss/Products/Zuul/tree.py", line 34, in __init__
    brain = ICatalogTool(ob).getBrain(ob)
  File "/opt/zenoss/Products/Zuul/tree.py", line 200, in getBrain
    brains = self.catalog(path={'query':path, 'depth':0})
AttributeError: __call__
------
Any ideas?
| | | | | |
| | | |
| | | |
| | ++ |
|
|


--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62468#62468]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62585#62585

--------------------------------------------------------------
dswope:

I'd try to rebuild teh global catalog.

As the zenoss user on the zenoss master:

python $ZENHOME/Products/ZenUtils/zencatalog.py --forceindex --createcatalog

Let me know if it helps.

Best,
--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62585#62585]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62772#62772

--------------------------------------------------------------
Here is the output of the rebuild catalog

[***@ZENOSS root]$ python $ZENHOME/Products/ZenUtils/zencatalog.py --for                                                                                                                                                             ceindex --createcatalog
2011-11-22 08:35:31,909 INFO zen.Catalog: Global catalog already exists.
2011-11-22 08:35:31,911 INFO zen.Catalog: Reindexing your system. This may take some time.
/opt/zenoss/lib/python/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView ZenPacks.Nagios.CheckPing refers to a non-existing path '/opt/zenoss/ZenPacks/ZenPacks.Nagios.CheckPing-1.0-py2.4.egg/ZenPacks/Nagios/CheckPing/skins/ZenPacks.Nagios.CheckPing'
  (self.id, reg_key), UserWarning)
/opt/zenoss/lib/python/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView WMIPerformanceMonitor refers to a non-existing path 'Products.WMIPerformanceMonitor:skins/WMIPerformanceMonitor'
  (self.id, reg_key), UserWarning)
2011-11-22 08:35:35,589 ERROR zen.Catalog: [Failure instance: Traceback: <type 'exceptions.AttributeError'>: 'GlobalCatalog' object has no attribute 'catalog_object'
/opt/zenoss/lib/python/twisted/internet/defer.py:737:_inlineCallbacks
/opt/zenoss/Products/ZenUtils/zencatalog.py:97:inner
/opt/zenoss/lib/python/twisted/internet/defer.py:243:callback
/opt/zenoss/lib/python/twisted/internet/defer.py:312:_startRunCallbacks
--- <exception caught here> ---
/opt/zenoss/lib/python/twisted/internet/defer.py:328:_runCallbacks
/opt/zenoss/Products/ZenUtils/zencatalog.py:243:handle_chunk
/opt/zenoss/Products/ZenUtils/zencatalog.py:223:catalog_object
]
None
[***@ZENOSS root]$

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62772#62772]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62775#62775

--------------------------------------------------------------
dsWope:

Yikes!

If this is an important install, back it up before we continue.

Once done, su zenoss the zenmigrate run --step='GlobalCatalog'

Let me know what happens.

Best,
--Shane (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62775#62775]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62777#62777

--------------------------------------------------------------
Yeah, it's important. It's production environment but I back it up every night so no worries
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62777#62777]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62779#62779

--------------------------------------------------------------
Ok result of this are as follows






[***@ZENOSS root]$ zenmigrate run --step='GlobalCatalog'
Use of "run" is deprecated.
INFO:zen.migrate:Will execute these steps: GlobalCatalog
INFO:zen.migrate:Installing GlobalCatalog (3.0.0)
INFO:zen.migrate:Installing SpeedUpGlobalCatalog (3.0.3)
INFO:zen.migrate:Removing Software and Operating Systems from catalog
WARNING:zen.migrate:Recovering
Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 21, in <module>
    main()
  File "/opt/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 18, in main
    m.main()
  File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 417, in main
    self.cutover()
  File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 304, in cutover
    self.migrate()
  File "/opt/zenoss/Products/ZenModel/migrate/Migrate.py", line 280, in migrate
    m.cutover(self.dmd)
  File "/opt/zenoss/Products/ZenModel/migrate/SpeedUpGlobalCatalog.py", line 136, in cutover
    self.removeSoftwareAndOperatingSystems(dmd)
  File "/opt/zenoss/Products/ZenModel/migrate/SpeedUpGlobalCatalog.py", line 127, in removeSoftwareAndOperatingSystems
    cat = ICatalogTool(dmd)
  File "/opt/zenoss/lib/python/zope/site/hooks.py", line 95, in adapter_hook
    return siteinfo.adapter_hook(interface, object, name, default)
  File "/opt/zenoss/Products/Zuul/tree.py", line 191, in __init__
    self.catalog._v_caches = getattr(self.catalog, "_v_caches", OOBTree())
  File "/opt/zenoss/lib/python/ZODB/broken.py", line 317, in __setattr__
    raise BrokenModified("Can't change broken objects")
ZODB.broken.BrokenModified: Can't change broken objects

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62779#62779]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62780#62780

--------------------------------------------------------------
This sticks out to me, something has broken with Python?

  File "/opt/zenoss/lib/python/ZODB/broken.py", line 317, in __setattr__
    raise BrokenModified("Can't change broken objects")
ZODB.broken.BrokenModified: Can't change broken objects



--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62780#62780]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62781#62781

--------------------------------------------------------------
dsWope:

As user zenoss, zenchkrels -x1 -r

It could take a long time.

--Shane (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62781#62781]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62782#62782

--------------------------------------------------------------
Ok running now..lots of output. Thanks for the insight here
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62782#62782]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62888#62888

--------------------------------------------------------------
Any ideas here anyone? I'm finding absolutely nothing online to help resolve this. I'm looking at a restore here looks like if I cannot find a solution.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62888#62888]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62860#62860

--------------------------------------------------------------
dswope:

In zendmd, try:

sync()
from Acquisition import aq_base
from Products.ZenRelations.ToManyContRelationship import ToManyContRelationship
reportclass = dmd.Reports._getOb('Multi-Graph Reports')
for organizer in reportclass.getSubOrganizers():
    for report in organizer.reports():
        try:
            rptcolls = report.collections
        except AttributeError:
            continue
        for coll in rptcolls():
            rel = coll.items
            if isinstance(rel, ToManyContRelationship):
                obs = []
                for ob in rel():
                    obs.append(aq_base(ob))
                    remote_rel = ob.collection
                    remote_rel._remove(coll)
                    rel._remove(ob)
                coll._delObject('items')
                coll.buildRelations()
                newrel = coll.collection_items.primaryAq()
                for ob in obs:
                    newrel._setObject(ob.getId(), ob)
                    ob = newrel._getOb(ob.getId())
                    print ob.__primary_parent__
                    assert ob.__primary_parent__ == newrel
                    assert ob.collection() == coll
                    assert ob in newrel()


commit()



--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62860#62860]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62890#62890

--------------------------------------------------------------
This is the output of me trying to get into zendmd



[***@ZENOSS root]$ zendmd
2011-11-29 14:36:49 ERROR zc.lockfile Error locking file /opt/zenoss/var/zeo1-1.zec.lock; pid=UNKNOWN
Traceback (most recent call last):
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 76, in __init__
    _lock_file(fp)
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 59, in _lock_file
    raise LockError("Couldn't lock %r" % file.name)
LockError: Couldn't lock '/opt/zenoss/var/zeo1-1.zec.lock'
Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenModel/zendmd.py", line 421, in <module>
    vars = _customStuff()
  File "/opt/zenoss/Products/ZenModel/zendmd.py", line 93, in _customStuff
    app = Zope2.app()
  File "/opt/zenoss/lib/python/Zope2/__init__.py", line 51, in app
    startup()
  File "/opt/zenoss/lib/python/Zope2/__init__.py", line 47, in startup
    _startup()
  File "/opt/zenoss/lib/python/Zope2/App/startup.py", line 72, in startup
    DB = dbtab.getDatabase('/', is_root=1)
  File "/opt/zenoss/lib/python/Zope2/Startup/datatypes.py", line 287, in getDatabase
    db = factory.open(name, self.databases)
  File "/opt/zenoss/lib/python/Zope2/Startup/datatypes.py", line 185, in open
    DB = self.createDB(database_name, databases)
  File "/opt/zenoss/lib/python/Zope2/Startup/datatypes.py", line 182, in createDB
    return ZODBDatabase.open(self, databases)
  File "/opt/zenoss/lib/python/ZODB/config.py", line 101, in open
    storage = section.storage.open()
  File "/opt/zenoss/lib/python/ZODB/config.py", line 210, in open
    **options)
  File "/opt/zenoss/lib/python/ZEO/ClientStorage.py", line 395, in __init__
    self._cache = self.ClientCacheClass(cache_path, size=cache_size)
  File "/opt/zenoss/lib/python/ZEO/cache.py", line 194, in __init__
    self._lock_file = zc.lockfile.LockFile(path + '.lock')
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 76, in __init__
    _lock_file(fp)
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 59, in _lock_file
    raise LockError("Couldn't lock %r" % file.name)
zc.lockfile.LockError: Couldn't lock '/opt/zenoss/var/zeo1-1.zec.lock'

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62890#62890]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62906#62906

--------------------------------------------------------------
dswope:

I'd stop zenoss completely, restart it and try again. Thats a odd error.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62906#62906]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62894#62894

--------------------------------------------------------------
Yeah, funny you mentioned that. I have restarted the entire server and am now getting some output form zendmd but looks like issues

[***@ZENOSS root]$ zendmd
2011-11-29 15:29:17 WARNING ZEO.zrpc (2004) CW: error connecting to ('localhost', 8100): ECONNREFUSED
2011-11-29 15:29:22 WARNING ZEO.zrpc (2004) CW: error connecting to ('localhost', 8100): ECONNREFUSED
2011-11-29 15:29:32 WARNING ZEO.zrpc (2004) CW: error connecting to ('localhost', 8100): ECONNREFUSED
2011-11-29 15:29:52 WARNING ZEO.zrpc (2004) CW: error connecting to ('localhost', 8100): ECONNREFUSED

It's not looking good

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62894#62894]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62907#62907

--------------------------------------------------------------
dswope:

As the zenoss user, zeoctl stop then zeoctl. It'll present a zeo> prompt. Type start and post the trace.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62907#62907]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62895#62895

--------------------------------------------------------------
[***@ZENOSS root]$ zeoctl stop
daemon process stopped
[***@ZENOSS root]$ zeoctl
program: /opt/zenoss/bin/runzeo
daemon manager not running
zeoctl> fg
/opt/zenoss/bin/runzeo


--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62895#62895]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62896#62896

--------------------------------------------------------------
Now zeoctl is no longer running
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62896#62896]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62917#62917

--------------------------------------------------------------
dswope:

Exit out of that prompt and kill -7 any hits on 'ps aux | grep zeo' then zeoctl and finally fg. this will run zeo in foreground mode so we can see trace where applicable.

--Shane (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62917#62917]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62922#62922

--------------------------------------------------------------
I've exited out yesterday and zeoctl daemon is back up and running this morning. Do you want me to try another
zeoctl then fg?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62922#62922]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62923#62923

--------------------------------------------------------------
dswope:

Yes after zeoctl stop. Once you zeoctl then fg zeo will run in foreground mode. In a new console open zendmd. Is there any trace produces in the console running zeoctl fg?

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62923#62923]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62926#62926

--------------------------------------------------------------
Ok I stopped zeoctl, ran the command again and input "fg" and that console has this prompt

[***@ZENOSS root]$ zeoctl stop
.
daemon process stopped
[***@ZENOSS root]$ zeoctl
program: /opt/zenoss/bin/runzeo
daemon manager not running
zeoctl> fg
/opt/zenoss/bin/runzeo


Now on the second console (as zenoss user) I ran "zendmd" and it spit out


[***@ZENOSS root]$ zendmd
2011-11-30 14:14:07 ERROR zc.lockfile Error locking file /opt/zenoss/var/zeo1-1.zec.lock; pid=UNKNOWN
Traceback (most recent call last):
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 76, in __init__
    _lock_file(fp)
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 59, in _lock_file
    raise LockError("Couldn't lock %r" % file.name)
LockError: Couldn't lock '/opt/zenoss/var/zeo1-1.zec.lock'
Traceback (most recent call last):
  File "/opt/zenoss/Products/ZenModel/zendmd.py", line 421, in <module>
    vars = _customStuff()
  File "/opt/zenoss/Products/ZenModel/zendmd.py", line 93, in _customStuff
    app = Zope2.app()
  File "/opt/zenoss/lib/python/Zope2/__init__.py", line 51, in app
    startup()
  File "/opt/zenoss/lib/python/Zope2/__init__.py", line 47, in startup
    _startup()
  File "/opt/zenoss/lib/python/Zope2/App/startup.py", line 72, in startup
    DB = dbtab.getDatabase('/', is_root=1)
  File "/opt/zenoss/lib/python/Zope2/Startup/datatypes.py", line 287, in getDatabase
    db = factory.open(name, self.databases)
  File "/opt/zenoss/lib/python/Zope2/Startup/datatypes.py", line 185, in open
    DB = self.createDB(database_name, databases)
  File "/opt/zenoss/lib/python/Zope2/Startup/datatypes.py", line 182, in createDB
    return ZODBDatabase.open(self, databases)
  File "/opt/zenoss/lib/python/ZODB/config.py", line 101, in open
    storage = section.storage.open()
  File "/opt/zenoss/lib/python/ZODB/config.py", line 210, in open
    **options)
  File "/opt/zenoss/lib/python/ZEO/ClientStorage.py", line 395, in __init__
    self._cache = self.ClientCacheClass(cache_path, size=cache_size)
  File "/opt/zenoss/lib/python/ZEO/cache.py", line 194, in __init__
    self._lock_file = zc.lockfile.LockFile(path + '.lock')
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 76, in __init__
    _lock_file(fp)
  File "/opt/zenoss/lib/python/zc/lockfile/__init__.py", line 59, in _lock_file
    raise LockError("Couldn't lock %r" % file.name)
zc.lockfile.LockError: Couldn't lock '/opt/zenoss/var/zeo1-1.zec.lock'




--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62926#62926]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62927#62927

--------------------------------------------------------------
Ok, I stopped zenoss services, rand zeoctl->fg and got


[***@ZENOSS root]$ zeoctl
program: /opt/zenoss/bin/runzeo
daemon manager not running
zeoctl> fg
/opt/zenoss/bin/runzeo
Error: address ('localhost', 8100) already in use
For help, use /opt/zenoss/lib/python/ZEO/runzeo.py -h

Then on the other console I ran "zendmd" and now have this


[***@ZENOSS root]$ zendmd
2011-11-30 14:21:49 ERROR ZEO.zrpc (18608) CW: error in testConnection (('localhost', 8100))
Traceback (most recent call last):
  File "/opt/zenoss/lib/python/ZEO/zrpc/client.py", line 452, in test_connection
    self.preferred = self.client.testConnection(self.conn)
  File "/opt/zenoss/lib/python/ZEO/ClientStorage.py", line 554, in testConnection
    stub = self.StorageServerStubClass(conn)
  File "/opt/zenoss/lib/python/ZEO/ServerStub.py", line 377, in stub
    raise ValueError("Timeout waiting for protocol handshake")
ValueError: Timeout waiting for protocol handshake
2011-11-30 14:22:05 ERROR ZEO.zrpc (18608) CW: error in testConnection (('localhost', 8100))
Traceback (most recent call last):
  File "/opt/zenoss/lib/python/ZEO/zrpc/client.py", line 452, in test_connection
    self.preferred = self.client.testConnection(self.conn)
  File "/opt/zenoss/lib/python/ZEO/ClientStorage.py", line 554, in testConnection
    stub = self.StorageServerStubClass(conn)
  File "/opt/zenoss/lib/python/ZEO/ServerStub.py", line 377, in stub
    raise ValueError("Timeout waiting for protocol handshake")
ValueError: Timeout waiting for protocol handshake
2011-11-30 14:22:25 ERROR ZEO.zrpc (18608) CW: error in testConnection (('localhost', 8100))
Traceback (most recent call last):
  File "/opt/zenoss/lib/python/ZEO/zrpc/client.py", line 452, in test_connection
    self.preferred = self.client.testConnection(self.conn)
  File "/opt/zenoss/lib/python/ZEO/ClientStorage.py", line 554, in testConnection
    stub = self.StorageServerStubClass(conn)
  File "/opt/zenoss/lib/python/ZEO/ServerStub.py", line 377, in stub
    raise ValueError("Timeout waiting for protocol handshake")
ValueError: Timeout waiting for protocol handshake



So that's some progress. I appreciate your insight here.

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62927#62927]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62928#62928

--------------------------------------------------------------
dswope:

Huh...thats odd. Looks like zeo isnt binding to the localhost adapter on port 8100.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62928#62928]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62929#62929

--------------------------------------------------------------
So at this point, do we continue chasing this or should I look at a restore?
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62929#62929]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62904#62904

--------------------------------------------------------------
dswope:

After some digging I can't figure what the root problem is. It's a pretty strange error. If at all possible a restore of just the ZODB would be best. You don't need to restore the rrd's, leave the existing ones in place so you don't lose performance data history.

--Shane (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62904#62904]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62935#62935

--------------------------------------------------------------
Ok, I will need to find that process because while I have restored Zenoss successfully in the past and have that documented. Performing a restore of the ZOPE database is new to me
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62935#62935]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62952#62952

--------------------------------------------------------------
dswope:

You'll want to zenoss stop then move $ZENHOME/Data.fs to Data.fs.broken then extract the backup Data.fs from the backup tar file and put it in $ZENHOME/var. After a zenoss start you should be good.

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62952#62952]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62954#62954

--------------------------------------------------------------
I'm restoring my zenoss backup from September 30th to be safe and will rename the current Data.fs then copy over the restore Data.fs and restart zenoss. I'll post when i'm done.
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62954#62954]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62956#62956

--------------------------------------------------------------
Ok i'm still waiting to see if this has worked, zeoctl is giving me problems

*Daemon: zeoctl daemon manager not running*
Daemon: zopectl program running; pid=3839
Daemon: zenhub program running; pid=3878
Daemon: zenjobs program running; pid=3909
Daemon: zenping program running; pid=3969
Daemon: zensyslog program running; pid=4021
Daemon: zenstatus program running; pid=4011
Daemon: zenactions program running; pid=4044
Daemon: zentrap program running; pid=4150
Daemon: zenmodeler program running; pid=4138
Daemon: zenperfsnmp program running; pid=4177
Daemon: zencommand program running; pid=4203
Daemon: zenprocess program running; pid=4229
Daemon: zenwin program running; pid=4265
Daemon: zeneventlog program running; pid=4301

Funny because a zeoctl start gives me this and looks like it's running

*zeoctl start*
*. . . . . . .*
*daemon process started, pid=4713*
*[***@ZENOSS root]$*

zenhub.log shows

2011-12-01 10:12:29,081 WARNING ZEO.zrpc: (3878) CW: error connecting to ('localhost', 8100): ECONNREFUSED
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62956#62956]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62958#62958

--------------------------------------------------------------
dswope:

Stop zeo and try a zeoctl then fg and in a new console restart zope and zenhub by zopectl restart and zenhub restart. Any trace in the zeocft fg screen?

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62958#62958]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62959#62959

--------------------------------------------------------------
Ok, I found that the Data.fs was owned by root..I changed that to zenoss and it started without any issues. Bad news is this damn attribute error persists when browsing to Infrastructure
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62959#62959]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62961#62961

--------------------------------------------------------------
*Console 1*

[***@ZENOSS root]$ zeoctl stop
daemon process stopped
[***@ZENOSS root]$
[***@ZENOSS root]$
[***@ZENOSS root]$ zeoctl
program: /opt/zenoss/bin/runzeo
daemon manager not running
zeoctl> fg
/opt/zenoss/bin/runzeo


*Console 2*



[***@ZENOSS root]$ zopectl restart
.
daemon process restarted, pid=5553
[***@ZENOSS root]$ zenhub restart
stopping...
starting...
[***@ZENOSS root]$

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62961#62961]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62962#62962

--------------------------------------------------------------
dswope:

You might need to get a zenoss master to remote in and check this out for you. How possible is that?

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62962#62962]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62964#62964

--------------------------------------------------------------
Whoever is a Zenoss master can come on, i'm ready when he/she is. ;\

This is getting a bit nutty to chase down
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62964#62964]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62965#62965

--------------------------------------------------------------
dswope:

What's your availability at 4:00 PM CDT today? Can you allow an ssh connetion?

Best,
--Shane (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62965#62965]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62966#62966

--------------------------------------------------------------
Let's take this offline..

Contact me at 469-330-1541
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62966#62966]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62967#62967

--------------------------------------------------------------
dswope:

I'll give you a call this afternoon.

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62967#62967]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Martijn Marty]

Martijn Marty [http://community.zenoss.org/people/m.lijesen] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/69277#69277

--------------------------------------------------------------
Where you able to fix this issue? I seem to have almost the same errors as you were having.

Kind regards,
Martijn
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/69277#69277]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/69279#69279

--------------------------------------------------------------
Martijn:

I don't think so. Sounds like a seriously corrupt ZODB though. Can you post more info?

Best,
--Shaen Scott (Hackman238)
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/69279#69279]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Martijn Marty]

Martijn Marty [http://community.zenoss.org/people/m.lijesen] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/69301#69301

--------------------------------------------------------------
Hi Shane,
Thanks for your reply!

I will try to explain the situation.
Goal is to upgrade zenoss to the a newer version.
Zenoss 3.1.0 64bit is running in a production environment. this installation has been upgraded more times then I can trace back in history, but since version 2.5 this is the path.
2.5 32bit -> 2.5 64bit -> 3.0.3 64bit -> 3.1.0 64bit
Zenoss is installed on a virtual server running debian and an exact copy is in our test environment.
There is a difference in hardware (memory and cores).
The production environment seems to work good, also in the test environment.
I've done a lot of tries to upgrade this version, but never succeeded in running without errors!


This is what I've done in my last try:
1) stop zenoss production environment
2) ps -ef (check for still running zenoss processes)
2) tar cfvB /root/zenossbackup.tar /opt/zenoss/production
3) /etc/init.d/zenoss-stack start
4) scp zenossbackup.tar zenoss-test:/opt/zenoss
5) login on zenoss-test and unpack the tar
6) start zenoss
7) remove alerting rules (we don't want alert mails from our test environment)
8) remove all zenpacks
     # su - zenoss
     # /opt/zenoss/production/zenoss/bin/zenpack --list | cut -d ' ' -f1 | while read line ; do /opt/zenoss/production/zenoss/bin/zenpack --remove $line ; done
8) remove all directories under /opt/zenoss/production/zenoss/ZenPacks
9) remove custom reports
10) remove monitoring templates
11) start zenoss
All zenoss daemons seems to be running fine when I open infrastructure tab I get:
Server exception
The server reported the following error:
AttributeError __call__
The system has encountered an error. Please reload the page.

12) Trying to fix the catalog
   # su - zenoss
   # ***@zenoss-test:/opt/zenoss/zenossstuff$ /opt/zenoss/production/python/bin/python ./zenfixit.py
   #Cleaning up invalid entries from catalogs:
* deviceSearch
* componentSearch
* layer3_catalog
   - removing /zport/dmd/Devices/Printer/Laser/devices/<I renamed this>/os/interfaces/ncmac0/ipaddresses/122.30.30.12.
   - removing /zport/dmd/Devices/Printer/devices/<I renamed this>/os/interfaces/sie0/ipaddresses/10.30.30.13.
   - removing /zport/dmd/Devices/Printer/Laser/devices/<I renamed this>/os/interfaces/sie0/ipaddresses/122.30.30.10.
   - removing /zport/dmd/Devices/Printer/Laser/devices/<I renamed this>/os/interfaces/ncmac0/ipaddresses/122.30.30.11.
   - removing /zport/dmd/Devices/Server/Linux/devices/<I renamed this>/os/interfaces/eth2/ipaddresses/122.11.11.11.
   - removing /zport/dmd/Devices/Server/Solaris/devices/<I renamed this>/os/interfaces/ce0/ipaddresses/122.30.20.33.
   - removing /zport/dmd/Devices/Server/Linux/devices/secura/os/interfaces/eth1/ipaddresses/192.168.117.228.
   - removing /zport/dmd/Devices/Network/Accesspoint/devices/ap-l3008/os/interfaces/eth0/ipaddresses/222.168.10.203.
   - removing /zport/dmd/Devices/Network/Accesspoint/devices/ap-l3008/os/interfaces/eth0/ipaddresses/222.168.10.201.
* maintenanceWindowSearch
* zenPackPersistence
   - removing /zport/MsSqlSrvInst/datasources/LockRequests.
   - removing /zport/MsSqlSrvInst/datasources/LockWaitTime.
   - removing /zport/MsSqlSrvInst/datasources/SQL Errors.
   - removing MsSqlSrvInst/datasources/LockRequests.
   - removing MsSqlSrvInst/datasources/LockWaitTime.
   - removing MsSqlSrvInst/datasources/SQL Errors.
   - removing /zport/MsSqlDatabase/datasources/sysperfinfo.
   - removing /zport/WMIPerfExchange2003/datasources/Address List Queue Length.
   - removing /zport/WMIPerfExchange2003/datasources/Exchange Mailbox Queues.
   - removing /zport/WMIPerfExchange2003/datasources/Exchange Public Queues.
   - removing /zport/WMIPerfExchange2003/datasources/Exchange User Statistics.
   - removing WMIPerfExchange2003/datasources/Address List Queue Length.
   - removing WMIPerfExchange2003/datasources/Exchange Mailbox Queues.
   - removing WMIPerfExchange2003/datasources/Exchange Public Queues.
   - removing WMIPerfExchange2003/datasources/Exchange User Statistics.
   - removing /zport/MsSqlSrvInst/datasources/LockTimeouts.
   - removing /zport/MsSqlSrvInst/datasources/sysperfinfo.
   - removing MsSqlSrvInst/datasources/NumberOfDeadlocks.
   - removing MsSqlDatabase/datasources/sysperfinfo.
   - removing /zport/WMIPerfExchange2003/datasources/Exchange Public Delivery.
   - removing /zport/WMIPerfExchange2003/datasources/RPC Averaged Latency.
   - removing WMIPerfExchange2003/datasources/Exchange Public Delivery.
   - removing WMIPerfExchange2003/datasources/RPC Averaged Latency.
   - removing /zport/MsSqlSrvInst/datasources/NumberOfDeadlocks.
   - removing MsSqlSrvInst/datasources/sysperfinfo.
   - removing /zport/WMIPerfExchange2003/datasources/Exchange SMTP Queues.
   - removing WMIPerfExchange2003/datasources/Exchange SMTP Queues.
   - removing MsSqlSrvInst/datasources/LockTimeouts.
   - removing WMIPerfExchange2003/datasources/Exchange Mailbox Delivery.
   - removing /zport/WMIPerfExchange2003/datasources/Exchange Mailbox Delivery.
Cleaning up any admin roles associated to invalid users.
Updating component catalog with monitor state from database.
Verifying that all devices have a deviceClass relation.
Removing invalid devices from collectors.
Converting important values from unicode to string.
Unbinding component templates from devices.
- removing ethernetCsmacd template from Router.
- removing ethernetCsmacd template from Switch.
Removing IP addresses linked to invalid devices.


# /opt/zenoss/production/python/bin/python ../production/zenoss/Products/ZenUtils/zencatalog.py --forceindex --createcatalog
2012-10-17 11:55:37,037 INFO zen.Catalog: Global catalog already exists.
2012-10-17 11:55:37,064 INFO zen.Catalog: Reindexing your system. This may take some time.
/opt/zenoss/production/python/lib/python2.6/site-packages/Products.CMFCore-2.2.0_alpha-py2.6.egg/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView  HttpMonitor refers to a non-existing path '/space/opt/zenoss/2.2.0/zenoss/ZenPacks/ZenPacks.zenoss.HttpMonitor-2.0.0-py2.4.egg/ZenPacks/zenoss/HttpMonitor/skins/HttpMonitor'
(self.id, reg_key), UserWarning)
/opt/zenoss/production/python/lib/python2.6/site-packages/Products.CMFCore-2.2.0_alpha-py2.6.egg/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView  ZenPacks.Jcolon.NortelMibs refers to a non-existing path '/space/opt/zenoss/production/zenoss/ZenPacks/ZenPacks.Jcolon.NortelMibs-1.0- py2.4.egg/ZenPacks/Jcolon/NortelMibs/skins/ZenPacks.Jcolon.NortelMibs'
(self.id, reg_key), UserWarning)
/opt/zenoss/production/python/lib/python2.6/site-packages/Products.CMFCore-2.2.0_alpha-py2.6.egg/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView   ZenPacks.TijmenvandenBrink.Juniper IVE refers to a non-existing path '/space/opt/zenoss/production/zenoss/ZenPacks/ZenPacks.TijmenvandenBrink.JuniperIVE-1.0- py2.4.egg/ZenPacks/TijmenvandenBri nk/JuniperIVE/skins/ZenPacks.TijmenvandenBrink.JuniperIVE'
(self.id, reg_key), UserWarning )
/opt/zenoss/production/python/lib/python2.6/site-packages/Products.CMFCore-2.2.0_alpha-py2.6.egg/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView   ZenPacks.ers8600.custom refers to a non-existing path '/space/opt/zenoss/production/zeno ss/ZenPacks/ZenPacks.ers8600.custom/ZenPacks/ers8600/custom/skins/ZenPacks.ers8600.custom'
(self.id, reg_key), UserWarning)
/opt/zenoss/production/python/lib/python2.6/site-packages/Products.CMFCore-2.2.0_alpha-py2.6.egg/Products/CMFCore/DirectoryView.py:489: UserWarning: DirectoryView Squid  refers to a non-existing path 'Products.Squid:skins/Squid'
  (self.id, reg_key), UserWarning)
2012-10-17 11:55:39,197 ERROR zen.Catalog: [Failure instance: Traceback: <type 'exceptions.AttributeError'>: 'GlobalCatalog' object has no attribute 'catalog_object'
/opt/zenoss/production/python/lib/python2.6/site-packages/Twisted-8.1.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py:737:_inlineCallbacks
../production/zenoss/Products/ZenUtils/zencatalog.py:97:inner
/opt/zenoss/production/python/lib/python2.6/site-packages/Twisted-8.1.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py:243:callback
/opt/zenoss/production/python/lib/python2.6/site-packages/Twisted-8.1.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py:312:_startRunCallbacks
--- <exception caught here> ---
/opt/zenoss/production/python/lib/python2.6/site-packages/Twisted-8.1.0-py2.6-linux-x86_64.egg/twisted/internet/defer.py:328:_runCallbacks
../production/zenoss/Products/ZenUtils/zencatalog.py:243:handle_chunk
../production/zenoss/Products/ZenUtils/zencatalog.py:223:catalog_object
]
None


# ./zenmigrate run --step='GlobalCatalog'
Use of "run" is deprecated.
INFO:zen.migrate:Will execute these steps: GlobalCatalog
INFO:zen.migrate:Installing GlobalCatalog (3.0.0)
INFO:zen.migrate:Installing SpeedUpGlobalCatalog (3.0.3)
INFO:zen.migrate:Removing Software and Operating Systems from catalog
WARNING:zen.migrate:Recovering
Traceback (most recent call last):
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 21, in <module>
   main()
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/zenmigrate.py", line 18, in main
   m.main()
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/Migrate.py", line 417, in main
   self.cutover()
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/Migrate.py", line 304, in cutover
   self.migrate()
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/Migrate.py", line 280, in migrate
   m.cutover(self.dmd)
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/SpeedUpGlobalCatalog.py", line 136, in cutover
   self.removeSoftwareAndOperatingSystems(dmd)
File "/opt/zenoss/production/zenoss/Products/ZenModel/migrate/SpeedUpGlobalCatalog.py", line 127, in removeSoftwareAndOperatingSystems
   cat = ICatalogTool(dmd)
File "/opt/zenoss/production/python/lib/python2.6/site-packages/zope.site-3.7.0-py2.6.egg/zope/site/hooks.py", line 95, in adapter_hook
   return siteinfo.adapter_hook(interface, object, name, default)
File "/opt/zenoss/production/zenoss/Products/Zuul/tree.py", line 191, in __init__
   self.catalog._v_caches = getattr(self.catalog, "_v_caches", OOBTree())
File "/opt/zenoss/production/python/lib/python2.6/site-packages/ZODB3-3.9.3-py2.6-linux-x86_64.egg/ZODB/broken.py", line 317, in __setattr__
   raise BrokenModified("Can't change broken objects")
ZODB.broken.BrokenModified: Can't change broken objects


# /opt/zenoss/production/zenoss/bin/zenchkrels -x1 -r
INFO:zen.Relations:checking relations on object /zport/dmd/ZenUsers/admin
INFO:zen.Relations:checking relations on object /zport/dmd/ZenUsers/admin/test
INFO:zen.Relations:checking relations on object /zport/dmd/ZenUsers/admin/messages/msg
ERROR:zen.Relations:remote relation /zport/dmd/ZenUsers/admin/messages/msg/messageQueue doesn't point back to /zport/dmd/ZenUsers/admin/messages/msg/messageQueue
WARNING:zen.Relations:reconnecting relation /zport/dmd/ZenUsers/admin/messages/msg/messageQueue to relation /zport/dmd/ZenUsers/admin/messages/msg/messageQueue
Traceback (most recent call last):
File "/opt/zenoss/production/zenoss/Products/ZenUtils/CheckRelations.py", line 72, in <module>
   tmbk.rebuild()
File "/opt/zenoss/production/zenoss/Products/ZenUtils/CheckRelations.py", line 40, in rebuild
   object.checkRelations(repair=repair)
File "/opt/zenoss/production/zenoss/Products/ZenRelations/RelationshipManager.py", line 262, in checkRelations
   rel.checkRelation(repair)
File "/opt/zenoss/production/zenoss/Products/ZenRelations/ToOneRelationship.py", line 223, in checkRelation
   rrel._add(parobj)
File "/opt/zenoss/production/zenoss/Products/ZenRelations/ToOneRelationship.py", line 80, in _add
   self._remoteRemove()
File "/opt/zenoss/production/zenoss/Products/ZenRelations/ToOneRelationship.py", line 102, in _remoteRemove
   remoteRel = getattr(aq_base(self.obj), self.remoteName())
AttributeError: messageQueue


# su - zenoss
# ./zenpatch /opt/zenoss/zenossstuff/changeset_r25791.diff
# zendmd
...     user.messages.removeRelation()
...

commit()                           
commit()

--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/69301#69301]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[dswope]

dswope [http://community.zenoss.org/people/dswope] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62951#62951

--------------------------------------------------------------
Also, do you think it would be a good idea to run a repair of the Zope database with "fsrecover.py"? So far I do not see how to restore this database. I can see it via hostname:port/manage" and it is 77.4MB in size but i see no option for restore. I can pack the Zope database, flush cache but not restore
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62951#62951]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]

[Shane Scott]

Shane Scott [http://community.zenoss.org/people/hackman238] created the discussion

"Re: AttributeError __call__ error"

To view the discussion, visit: http://community.zenoss.org/message/62953#62953

--------------------------------------------------------------
dswope:

That will fix database problems not structure problems, unfortunately.

--Shane
--------------------------------------------------------------

Reply to this message by replying to this email -or- go to the discussion on Zenoss Community
[http://community.zenoss.org/message/62953#62953]

Start a new discussion in zenoss-users by email
[discussions-community-forums-zenoss--***@community.zenoss.org] -or- at Zenoss Community
[http://community.zenoss.org/choose-container!input.jspa?contentType=1&containerType=14&container=2003]