At May 2012, I was attended to FMX 2012. Here’s my repot of FMX 2012 in Japanese. BTW, this is my second trip to Germany. First time, I was attended EG2002, and met some render guys at MPI. This time, I also met some render guys there, it was a great experience. 今年の 5 月に,Continue reading “FMX 2012 repot”
Trying to recover the reflectance of our hand-crafted Cornell box with a color chart palette 😉
I’ve ported OFED 126.96.36.199 userland to OpenIndiana151a/Illumos. https://github.com/syoyo/oi-build/tree/ofed-188.8.131.52/components/open-fabrics This port is based on previous work of open-fabrics package from Solaris 11, which is disclosed under a GPL/CDDL. Still I just got success to port and build the source code. I need a people who can evaluate this in an actual IB environment. Challengers wanted!
I created a repository which is usable for constructing InfiniBand stuff on OpenIndiana/Illumos https://github.com/syoyo/solaris-infiniband-tools Its something like a debian PPA. I don’t know Illumos or OI community provides such a PPA infrastructure, so I made a stuff on github. Enjoy, and feedbacks are welcome!
(Updated: Now confirmed OpenSM works. see my new post) I am trying to run opensm on illumos(OpenIndiana151a) + hermon(ConnectX). I found opensm stops at umad_recv(), entering infinite loop of dev_poll(). # opensm … ibwarn:  umad_recv: fd 5 umad 8147b88 timeout 4294967295 Breakpoint 1, umad_recv (fd=8, umad=0x8124c68, length=0xfe260f58, timeout_ms=-1) at ../src/umad.c:923 923 struct ib_user_mad *madContinue reading “OpenSM on Illumos + Hermon(ConnectX)”
Soft RoCE http://www.systemfabricworks.com/downloads/roce is a software implementation of IBoE(InfiniBand over Ethernet). You can program your InfiniBand program and run it on any Ether devices(e.g. 1 GbE ethernet) without RoCE-capable HBA. I got success to install and run Soft RoCE on Ubuntu 10.4 TLS running on VMWare fusion, on my MacBookPro(CentOS 5.7 and CentOS 6.2 doesn’tContinue reading “Soft RoCE”
Finally I got success to running OpenSM on OpenIndiana151a(Illumos). OpenSM is compiled from source with solris patch(provided by ofusr source package from OpenSolaris era, or open-fabrics source package from Solaris 11, which is licensed under CDDL). In this time, I use OpenSM 3.3.9 + solaris patch(shipped with open-fabrics package). To run OpenSM on OpenIndiana 151a(Illumos),Continue reading “OpenSM on OpenIndiana151a(Illumos kernel) works!”
I got success to compile opensm on Solaris 11, and it seems work well! (At least, it works well on my IB facilities) root@solaris11:~# opensm ————————————————- OpenSM 3.3.9 Command Line Arguments: Log File: /var/log/opensm.log ————————————————- OpenSM 3.3.9 Entering DISCOVERING state Using default GUID 0x2c903000736b9 Entering MASTER state SUBNET UP opensm on Solaris is what manyContinue reading “OpenSM on Solaris11… works!”
Solaris 11 has InfiniBand HCA driver/SW stacks. SW stack is based on OFED 1.5.3, and I’ve confirmed some of them works well Here’s a summary on Solaris 11 InfiniBand status with our facility. HW: Mellanox ConnectX QDR 1port, Mellanox 8 port QDR switch. SW: OFUV(Solaris11, installed with default), OFED 184.108.40.206(Linux SL6.0), WinOF 3.0 RC4(Windows) IPoIBContinue reading “InfiniBand status on Solaris 11”
I’m been investigating InfiniBand(RDMA) things on Solaris 10/11. My ultimate goal is to realize fast and reliable InfiniBand + ZFS storage on top of (Oracle) Solaris 11 or OpenIndiana. Following is the memo of my survey of InfiniBand stack status on Solaris 10/11. At this time, OpenIndiana and Nexenta is not based on Solaris 11Continue reading “Solaris InfiniBand SW stack short summary”