<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; ">
<br>
<div>
<div>On Jul 26, 2013, at 4:51 AM, Anton Starikov <<a href="mailto:ant.starikov@gmail.com">ant.starikov@gmail.com</a>> wrote:</div>
<br class="Apple-interchange-newline">
<blockquote type="cite"><br style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">
<span style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; display: inline !important; float: none; ">This
is exactly my point. It is gone. And I am curious what is correct procedure now?</span><br style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">
</blockquote>
<div><br>
</div>
We use only the log_mtts_per_seg here on our newer clusters. I think that is the new black.</div>
<div><br>
</div>
<div>We did some investigation and below is the amount of memory you can allocate give the value of the parameter.</div>
<div><br>
</div>
<div>0 - 2 GB (new mlx4 default) <br>
1 - 4 GB <br>
2 - 8 GB <br>
3 - 16 GB (old mlx4 default) <br>
4 - 32 GB <br>
5 - 64 GB <br>
6 - 128 GB <br>
7 - 256 GB </div>
<div><br>
</div>
<div>Some drivers accept 1 thru 5 as values, some take 0-7.</div>
<div>We set our value to be the entire memory of the node.</div>
<div><br>
</div>
<div><br>
<blockquote type="cite"><span style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; display: inline !important; float: none; ">I
tried to pass through driver to figure out, does it still have this limit (log_num_mtt) somewhere internally, or it is flexible and irrelevant (like with mlx5 driver). But didn't have much time to get to some conclusion on this matter.</span><br style="font-family: Helvetica; font-size: medium; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: -webkit-auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0px; ">
</blockquote>
</div>
<br>
<div>
<div>
<div>====================================</div>
<div><br>
</div>
<div>Susan Coulter<br>
HPC-3 Network/Infrastructure<br>
505-667-8425<br>
Increase the Peace...<br>
An eye for an eye leaves the whole world blind<br>
====================================</div>
</div>
</div>
<br>
</body>
</html>