I noticed an agent on one of my database servers was down this morning. Agents crash from time to time, no big deal. I will just restart it
$ ./emctl start agent Oracle Enterprise Manager Cloud Control 12c Release 2 Copyright (c) 1996, 2012 Oracle Corporation. All rights reserved. Starting agent ............ failed. Target Manager failed at Startup: targets.xml was rejected: loaded with a wrong agent token Consult emctl.log and emagent.nohup in: /u01/app/oracle/product/12.1.0.4/agent12c/agent_inst/sysman/log
Well that sucks. Something is out of sync. Usually this will happen when your file system is filled up and a change cannot be written to the targets.xml. I wasn’t out of space though. I’m not quite sure what caused this, but I know how to fix it.
make a backup of the targets.xml file, blank out the file, and add the opening and closign targets tag
cd /u01/app/oracle/product/12.1.0.4/agent12c/agent_inst/sysman/emd/ mv targets.xml targets.xml.20170220 echo "<Targets></Targets>" > targets.xml
Then re-synchronize the agent from OMS, this will re-populate the targets.xml
emcli login -username=SYSMAN emcli sync emcli resyncAgent -agent="dbsrv01:3872"
it takes about another 10 minutes to resynchronize but while it is running the agent will look like this
$ ./emctl status agent Oracle Enterprise Manager Cloud Control 12c Release 2 Copyright (c) 1996, 2012 Oracle Corporation. All rights reserved. --------------------------------------------------------------- Agent Version : 12.1.0.2.0 OMS Version : (unknown) Protocol Version : 12.1.0.1.0 Agent Home : /u01/app/oracle/product/12.1.0.4/agent12c/agent_inst Agent Binaries : /u01/app/oracle/product/12.1.0.4/agent12c/core/12.1.0.2.0 Agent Process ID : 794210 Parent Process ID : 793987 Agent URL : https://dbsrv01:3872/emd/main/ Repository URL : https://oem1:4900/empbs/upload Started at : 2017-02-20 11:56:00 Started by user : oracle Last Reload : (none) Last successful upload : (none) Last attempted upload : (none) Total Megabytes of XML files uploaded so far : 0 Number of XML files pending upload : 95 Size of XML files pending upload(MB) : 0.9 Available disk space on upload filesystem : 73.85% Collection Status : [RESYNC] Heartbeat Status : Agent is blocked Last attempted heartbeat to OMS : 2017-02-20 11:59:03 Last successful heartbeat to OMS : (none) Next scheduled heartbeat to OMS : 2017-02-20 12:02:03
After a little waiting around the agent is back to normal
$ ./emctl status agent Oracle Enterprise Manager Cloud Control 12c Release 2 Copyright (c) 1996, 2012 Oracle Corporation. All rights reserved. --------------------------------------------------------------- Agent Version : 12.1.0.2.0 OMS Version : 12.1.0.4.0 Protocol Version : 12.1.0.1.0 Agent Home : /u01/app/oracle/product/12.1.0.4/agent12c/agent_inst Agent Binaries : /u01/app/oracle/product/12.1.0.4/agent12c/core/12.1.0.2.0 Agent Process ID : 794210 Parent Process ID : 793987 Agent URL : https://dbsrv01:3872/emd/main/ Repository URL : https://oem1:4900/empbs/upload Started at : 2017-02-20 11:56:00 Started by user : oracle Last Reload : (none) Last successful upload : 2017-02-20 12:19:53 Last attempted upload : 2017-02-20 12:19:53 Total Megabytes of XML files uploaded so far : 2.15 Number of XML files pending upload : 0 Size of XML files pending upload(MB) : 0 Available disk space on upload filesystem : 73.62% Collection Status : Collections enabled Heartbeat Status : Ok Last attempted heartbeat to OMS : 2017-02-20 12:19:04 Last successful heartbeat to OMS : 2017-02-20 12:19:04 Next scheduled heartbeat to OMS : 2017-02-20 12:20:04 --------------------------------------------------------------- Agent is Running and Ready
Recent Comments