[ofa-general] IO Size more than 48K

chas williams - CONTRACTOR chas at cmf.nrl.navy.mil
Fri Nov 30 09:42:33 PST 2007


addtionally, you might need to echo 'blocks' >
/sys/block/<device/queue/max_hw_segments to increase the size of the
rdma segments.

max_hw_segments doesnt exist on all kernels i think.

In message <3A453CF1-5FFC-44BF-8F72-7E3EF5AA6E41 at alcf.anl.gov>,Kevin Harms writ
es:
>
>	you may also have to go to /sys/block/sdX/queue and echo 1024 >  
>max_sectors_kb
>	if you use the srp_daemon you can also add:
>	a max_sect=2048 to /etc/srp_daemon.conf
>
>kevin
>
>On Nov 29, 2007, at 11:08 AM, Vu Pham wrote:
>
>>
>>> Hi,
>>> We are using OFED-1.2, and using xdd and some other tools, and  
>>> trying to
>>> send 1/2MB IOs, but what we are seeing in analyzer traces, that  
>>> memory
>>> descriptor in SRP command shows max. 48K which means 1MB I/Os has  
>>> broken
>>> into smaller SRP request from initiator.
>>> How can I have this I/O directly going to target? What parameter I  
>>> need
>>> to change?
>>>
>>>
>>
>> module param srp_sg_tablesize (default is 12 ie. 12 x 4K = 48K)
>> and/or
>> max_sect=yyy in echo id_ext=xxx,...,max_sect=1024,service_id= > /sys/ 
>> class/infiniband_srp/...
>>
>> -vu
>>
>>> Thanks
>>> Ashish
>>> _______________________________________________
>>> general mailing list
>>> general at lists.openfabrics.org
>>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>>
>>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-gene
>ral
>>>
>>
>> _______________________________________________
>> general mailing list
>> general at lists.openfabrics.org
>> http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>>
>> To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-gener
>al
>>
>
>_______________________________________________
>general mailing list
>general at lists.openfabrics.org
>http://lists.openfabrics.org/cgi-bin/mailman/listinfo/general
>
>To unsubscribe, please visit http://openib.org/mailman/listinfo/openib-general
>



More information about the general mailing list