Tag Archives: cause

Oracle

Investigating an OEM 12c E-Business Suite Alert (AMS 12.1.0.x)

Leave a comment
OEM 12 Home Page
OEM 12 Home Page

The Applications Management Suite plug-in for Oracle Enterprise Manager simplifies discovery of the myriad of subtargets that make up an Oracle E-Business Suite instance.  Correspondingly, the number of alerts sent out can rise dramatically because of the inter-relationships between the components.

For example, the outage of a single Apache process triggers all of the following associated targets also to flag as a service Down status:

INSTANCE-Oracle E-Business Suite
INSTANCE-Infrastructure INSTANCE_host-APPL_TOP Context
HTTP_Server

The number of downed targets increases if a subcomponent of a primary component (such as a single JVM thread under the OACore process) experiences an outage.

This is a simple walk-through of navigating one of the e-mail alerts to start figuring out what happened.

The e-mail alert looks like this:

From: OEM12 Burbank
Sent: Monday, December 07, 2015 8:30 AM
To: DBAs
Subject: EM Event: Fatal:INSTANCE-Oracle E-Business Suite – Target is down; 1 member is down: INSTANCE_EBS Availability System

Host=hostname
Target type=Oracle E-Business Suite
Target name=INSTANCE-Oracle E-Business Suite
Categories=Availability
Message=Target is down; 1 member is down: INSTANCE_EBS Availability System
Severity=Fatal
Event reported time=Dec 7, 2015 8:29:14 AM PST
Target Lifecycle Status=Production
Operating System=Linux
Platform=x86_64
Associated Incident Id=390885
Associated Incident Status=New
Associated Incident Owner=
Associated Incident Acknowledged By Owner=No
Associated Incident Priority=None
Associated Incident Escalation Level=0
Event Type=Target Availability
Event name=Status
Availability status=Down
Root Cause Analysis Status=Symptom
Rule Name=EBS Notifications,Rule_EBS_Notifications
(to get notified, you set up Rule Sets that tell OEM when and what to notify you about)
Rule Owner=DBA
Update Details:
Target is down; 1 member is down: INSTANCE_EBS Availability System
Incident created by rule (Name = Incident management rule set for all targets, Incident creation rule for a Target Down availability status [System generated rule]).

To investigate an event alert, click on the Associated Incident ID (e.g. the 390885 which on your system will be a URL taking you into OEM) which will take you to the associated Incident Summary page.

Click on Related Events to investigate what raised the event alert (there may be more than one cause):

ss1
OEM 12c AMS 12.1.0.4 – Incident Details

From the screen, it shows the red mark on PRODARMK-Infrastructure PRODARMK_ascopofinm01-APPL_TOP Context (Oracle E-Business Suite Node).

Click on that link in the list of Targets.

Navigate to Monitoring -> Status History:

ss2
OEM 12c AMS 12.1.0.4 – Navigation Target: Monitoring -> Status History

Change the Availability History view to All History (the related underlying event caused is displayed.)

ss3
OEM 12c AMS 12.1.0.4 – Target: Status History Details

If you click on the related Message (e.g. Target is down; 1 member is down: INSTANCE_hostname.auca.corp_oacore_JVM_…); you will then be shown the related Event page for that target:

ss4
OEM 12c AMS 12.1.0.4 – Target: Event Details

Click on the Related Events tab for this target, to confirm the service alert recorded:

ss5
OEM 12c AMS 12.1.0.4 – Target: Event Details -> Related Events Timeline

If this is a recurring issue, by sliding the timeline back and forth (and adjusting the period view to a larger sample) you can see if there are any associated time-related occurrences that can be used to identify root cause.

For the specific issue, login to the associated host, and view the output and error logs for the process itself to determine what triggered the alert (in this case, the JVM automatically restarted the OACore process that had run out of memory.)

Advertisement
Shinnyo Podcasts

2015-March Shinnyo Podcast – Understanding Impact

Leave a comment

2015-March Shinnyo Podcast – Understanding Impact

  • Responding to Icky Moments
  • 1 -> 10 -> 10 million
  • Every Seed is Important
  • Try Not to Watch Your Pot When Boiling Water
  • A Snowflake Starts an Avalanche

Subscribe to this Podcast (RSS) or iTunes or via Flipboard

rain_bird
Found on YouTube

There are many inconsistent and confusing examples of contradictory spiritual behavior in the world. We seem to have buddhist monks behaving aggressively in Myanmar, people beheading people in the name of a belief system, children with explosives strapped to themselves being sent as human bomb carriers, and in Japan, toxins were unleashed on the public in a subway all in the name of a religion or belief system. 1,000 years ago, we had the Crusades marching across a continent in the name of spiritual liberation. Last month we talked about alignment between actions and our principles. But what exactly happens when misalignment occurs?

When we witness behavior that is contrary to our beliefs, humans generate a typical “fight or flight” emotional response. This is part of our built-in survival mechanism to avoid things that make us shudder, go “Eeek!” or “Blechh!” and generally keep us sane because we reinforce our own belief system. If you were in a constant state of questioning your own beliefs, you might find yourself overwhelmed by a sense of confusion or disarray in a very short time. But these are all short-term and immediate responses to aversive behavior. What I find more interesting is the relationship between these exposures to repellant behavior and what we call Karma or the concept of how positive and negative actions have impact over time.

Let’s say someone is harmed or killed in the name of a particular belief, that is the victim is perceived as being an enemy of the beliefs, or otherwise would cause some kind of harm to it. And the person who causes the harm or death is not directly impacted or addressed by their actions, meaning a witness or onlooker doesn’t see an individual person as the cause of the negative action –  we don’t perceive someone specific to blame for the incident. To keep this example simple, 10 random people witness this act. What happens in these 10 different impressions of the action of one person? What happens when this same act is magnified by media coverage to expose this same act to 10 million random people? What if it were just you, who saw what happened?  What would you do? What would you say to others? What if you did absolutely nothing?

The parents, family, friends, and even enemies of the person who performed the act above have impressions, too. And each of those people create a downstream effect of how that act will be perceived by generation upon generation of others. Was it good or bad? Was it righteous or tyrannical? Was it selfish, or generous? Each of these individuals contributes to future actions of whether this one act will be repeated in the future, and to what extent it will occur (positive perception generally leads to magnification of the effort).

In the nature of cause and effect, each of the above actions or inactions results in something else. The seed that doesn’t get planted, doesn’t result in a plant, which doesn’t have roots that hold soil, which results in:

  • the dirt can more easily be washed away in the rain,
  • one fewer plant to grow and filter the air,
  • one fewer parent plant to produce seeds,
  • less shade on the ground leading to hotter soil temperatures,
  • one fewer plant to act as a home to a few insects,
  • and so on.

plant_in_hand_thYet, all it takes is one positive act to have the same and opposite effect. Whether you “Do unto others..,” “Pay it Forward,” watch for “Butterfly Effects” or plant a seed, things start to happen when you do something. The odd and sometimes frustrating thing is that in all of these actions, there is no guarantee of instant gratification of seeing the results of your action. It may happen centuries in the future. This is why detachment from attachments is emphasized in philosophy; try to not have the expectation of a result every time you cause something to happen. By becoming an agent of change, you automatically subscribe to the results – you really don’t need to sit around and wait for the “Lessons Learned” meeting to happen.

Photo courtesy of Earth Science Picture of the Day @esra.edu
Photo courtesy of Earth Science Picture of the Day @esra.edu

The concept of inertial change isn’t new. Over 40 years ago, John Naisbitt wrote about Megatrends and studied how they occur and what we can learn from them. 40,000 years ago, someone scratched into the wall of a cave that a big four-legged animal might be a thing to eat and feed a village, or you could plant something and get a similar result. Ultimately, how do you react to things and how do you affect your downstream relationships (all 10 generations worth)?

/* For more information and discussion feel free to e-mail me at jlui at jlui dot net, or twitter @jhlui1; With Gassho _()_, James*/

Shinnyo Podcasts

2015-February Shinnyo Podcast – Taking Action

Leave a comment

2015-February Shinnyo Podcast – Taking Action

  •         How Actions Lead to Perception
  •         Consistent Form -> Consistent Results
  •         The Rules of Engagement Require Actual Engagement
  •         You Are What You Do
  •         Taking the Next Step

Subscribe to this Podcast (RSS) or iTunes or via Flipboard

action_thFrom an address by Her Holiness, Keishu Shinso at the commencement of this year’s Annual Training period on January 25, 2015:

“Shinnyo refers to the qualities that we find exemplified in the lives of the Shinnyo Parents and the Two Dojis, most prominently in the way they demonstrated what it means to embody a spirit that is selfless, unbowed, and full of harmony. Shinnyo Ichinyo (oneness with truth) is about the effort that we make to express these qualities of shinnyo in our daily life, and by so doing, we are always connected with our spiritual masters”

Spirituality is often interpreted as being an internalized concept in that while various groups of people will have a common belief system, it is the beliefs and practices of the individual that comprise how the philosophy impacts the rest of the world.  We see that demonstrated in our contemporary life by the acts of a few individuals affecting the impressions that others form about a whole religion, or even simply the label of alliance with a philosophy. Whether or not the actions by those individuals are conscribed or taught by the actual philosophy are not part of the perception.

This is often illustrated in many idioms and proverbs:

  •         Do as I say, not as I do.
  •         Actions speak louder than words.
  •         It’s the thought that counts (implying, not the action, or lack thereof).

Effectively, these are saying, “Take my advice, even though I am acting contrary to it.” (Sometimes used as an apology for behaving hypocritically.) – McGraw-Hill Dictionary of American Idioms and Phrasal Verbs. © 2002 by The McGraw-Hill Companies, Inc.

What most philosophical schools teach is that individual actions should always strive to be in alignment with the principles of conduct, or the laws of commonly decent behavior. In Buddhism, these are illustrated as the Dharma, which comes in many different expressions:

Four Noble Truths

  •         There is suffering
  •         A source of suffering.
  •         The cessation of suffering
  •         Attainment of Nirvana

Five Cardinal Sins

  •         Killing one’s father,
  •         …mother,
  •         …a saint,
  •         Injuring a Buddha,
  •         Disturbing the Sangha

8-fold Noble Path

  •         Right views
  •         …thoughts,
  •         …speech,
  •         …acts,
  •         …livelihood,
  •         …efforts,
  •         …mindfulness,
  •         …meditation

And others.

Nonetheless, memorizing the guidelines becomes pointless if actions taken aren’t in alignment with what performance is expected. We know children pick up on this concept rather quickly at a young age. If parents always say to do something, but either don’t do it themselves, or don’t make efforts to correct or demonstrate desired behavior, kids figure out, “they say it, but they don’t really mean it.” And likewise, so do our pet dogs and cats, and even our co-workers.  We learn from the actions we observe, and much less so, the words we read or hear.

Similarly, we also learn more from our own actions (and mistakes) much more than from what we write, or say. Repeated actions reinforce memory. Learning how to golf takes practice, and that doesn’t mean watching videos or reading books about it. The “muscle memory” comes from repeated guidance in the correct form (or conversely, incorrect form repeated over and over leads to really lousy golf scores.)

Returning to our sales-related analogy, once you have assessed the needs of the customer and figured out a solution that would address them, you have to actually finish the transaction (“seal the deal”, follow-through, make it happen.)  In a nutshell, if you don’t take action to write the sale up, you go home with less pay, thus there’s a direct positively correlated relationship between taking action and personal gain.

In life, the relationship is not so clear to those who don’t take action. But as in physics, not taking action is in and of itself another action. And there are consequences for inaction, too. And every action should emanate from a compassionate source or it tends to have an opposite effect.

In Shinnyo Buddhism this belief in action has been distilled into three basic practices:

  •         Connecting to others (jpn. otasuke)
  •         Making voluntary effort (jpn. gohoshi)
  •         Contributing time or value (jpn. kangi)

Just as the symbolism of cleaning things and places is also referred to as “polishing our hearts”, it is the actions that when repeated and reinforced through positive guidance that lead to actual transition, and transformation.