<html>

<head>
<meta http-equiv=Content-Type content="text/html; charset=us-ascii">
<meta name=Generator content="Microsoft Word 10 (filtered)">

<DEFANGED_style>
<!--
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
a:link, span.MsoHyperlink
        {color:blue;
        text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
        {color:purple;
        text-decoration:underline;}
p.MsoAutoSig, li.MsoAutoSig, div.MsoAutoSig
        {margin:0in;
        margin-bottom:.0001pt;
        font-size:12.0pt;
        font-family:"Times New Roman";}
span.EmailStyle17
        {font-family:Arial;
        color:windowtext;}
@page Section1
        {size:8.5in 11.0in;
        margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
        {page:Section1;}
-->
</DEFANGED_style>

</head>

<body lang=EN-US link=blue vlink=purple>

<DEFANGED_div class=Section1>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>Another item for release 3, from a customer who is moving multi-threaded
APPs to Linux.</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>They reported using mpstat to help tune the locking in the
original environment, but were </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>dismayed that there is no Linux equivalent or other tools
for doing the same.</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>After looking at the open source mpstat that is available
for Red Hat Linux, it just displays</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>the minimal level of processor utilization statistics
(processor/%user/%system/%idle/intr).</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>Other versions for Unix report additional information:</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- Minor/Major faults</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- Interprocessor cross calls</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- Context switches</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- System calls</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- Process migrations from this processor</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- Kernel lock statistics (Mutex stalls)</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>- Wait time</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>This customer said that the inability to use these tools on
Linux was hindering their ability</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>to tune their application effectively for Linux.</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>My guess is that the current Linux mpstat is exposing
everything that is available from the </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>kernel, and that to do better will require additional
statistics gathering in the kernel as well </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>as the hooks in the mpstat utility to display them. This may
be hard to sell to LKML.</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>While having all of this under on hood is likely best for
the customer, i.e. in mpstat, it would</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>seem reasonable if the functionality were offered through
several tools; I was thinking of the </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>lockmeter framework and utilities for the kernel locking
statistics. Having a complete set of </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>tools for determining bottlenecks would be very useful. Documentation
that describes how </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>to use the utilities, and how to identify and debug real problems
is also needed.</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>For customers who are used to using these tools for tuning
on other Unixes, keeping as </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>much of the presentation of the stats similar would help, but
may be difficult or impossible </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>for Linux. </DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>Reference projects:</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; <a
href="http://freshmeat.net/projects/mpstat/?topic_id=862">http://freshmeat.net/projects/mpstat/?topic_id=862</a>
&nbsp;- Utility version used on Linux (?)</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; LKML,
for kernel changes to enable additional statistics</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>Documentation:</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
Using the mpstat load displayer (SCO)</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
<a href="http://docs.sun.com/db/doc/806-0625/6j9vfilr4?q=mpstat&amp;a=view">http://docs.sun.com/db/doc/806-0625/6j9vfilr4?q=mpstat&amp;a=view</a>
</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; -
<a href="http://sunsite.uakom.sk/sunworldonline/swol-08-1998/swol-08-perf.html">http://sunsite.uakom.sk/sunworldonline/swol-08-1998/swol-08-perf.html</a></DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoNormal><font size=2 face=Arial><DEFANGED_span style='font-size:10.0pt;
font-family:Arial'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>These are my opinions and not official opinions of Intel Corp.</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>David Howell</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>Intel Corporation</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>Telco Server Development</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>Server Products Division</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>Voice: (803) 216-2359&nbsp; Fax: (803) 216-2178</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>Intel Corporation</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>Columbia Design Center, CBA-1</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span style='font-size:
12.0pt'>100 Center Point Circle, Suite 210</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span lang=PT-BR
style='font-size:12.0pt'>Columbia, SC 29210</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span lang=PT-BR
style='font-size:12.0pt'>&nbsp;</DEFANGED_span></font></p>

<p class=MsoAutoSig><font size=3 face="Times New Roman"><DEFANGED_span lang=PT-BR
style='font-size:12.0pt'>david.p.howell@intel.com</DEFANGED_span></font></p>

<p class=MsoNormal><font size=3 face="Times New Roman"><DEFANGED_span lang=PT-BR
style='font-size:12.0pt'>&nbsp;</DEFANGED_span></font></p>

</DEFANGED_div>

</body>

</html>