<div dir="ltr"><span style="font-family:arial,sans-serif;font-size:13px">RBD support is disabled in the Centos 7.0 qemu release packages. There's a block in the .spec file that reads:</span><br><div><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">%if %{rhev}</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px"> --enable-live-block-ops \</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px"> --enable-ceph-support \</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">%else</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px"> --disable-live-block-ops \</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px"> --disable-ceph-support \</span><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">%endif</span><br style="font-family:arial,sans-serif;font-size:13px"><br style="font-family:arial,sans-serif;font-size:13px"><span style="font-family:arial,sans-serif;font-size:13px">rhev is defined 0 at the top of the file, setting this to 1 and rebuilding after sorting the build dependencies yields some new packages with RBD support and a -rhev suffix that install and work on Centos 7.0 just fine.</span><span style="font-family:arial,sans-serif;font-size:13px"><br></span></div></div><div class="gmail_extra"><br><div class="gmail_quote">2014-09-11 9:42 GMT+12:00 Steven Timm <span dir="ltr"><<a href="mailto:timm@fnal.gov" target="_blank">timm@fnal.gov</a>></span>:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">The first and most obvious problem below was that we were running an<br>
old version of qemu-img and qemu-kvm that ships with RHEL6/Centos6/SL6<br>
that doesn't support the "rbd" format. We were able to find<br>
a modified version that the Ceph people had back-ported and now<br>
we can import an image into the datastore and have<br>
gotten as far to getting a deployment.0 written on the hypervisor.<br>
It can't contact Ceph as yet, is getting connection refused but<br>
we think that is an authentication issue.<br>
<br>
<a href="http://ceph.com/packages/qemu-kvm/redhat/x86_64/" target="_blank">http://ceph.com/packages/qemu-<u></u>kvm/redhat/x86_64/</a><br>
is where these packages for 6.2 live.<br>
<br>
Hopefully this all gets easier pretty soon now that RedHat has bought Ceph<br>
and all the right packages will be in RHEL7. Or will they be only proprietarily available in Redhat Enterprise Virtualization? Has anyone tried yet?<br>
<br>
Steve<div><div class="h5"><br>
<br>
<br>
<br>
On Wed, 10 Sep 2014, Steven Timm wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<br>
<br>
I have configured a Ceph datastore on one 4.6 and have gotten as<br>
far as to get opennebula to accept the datastore. But when we<br>
try to do the first oneimage create into the datastore we get the<br>
following error in oned.log :<br>
<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: Command execution fail: /var/lib/one/remotes/<u></u>datastore/ceph/cp PERTX0RSSVZFUl9BQ1RJT05fREFUQT<u></u>48SU1BR0U+<u></u>PElEPjE4PC9JRD48VUlEPjA8L1VJRD<u></u>48R0lEPjA8L0dJRD48VU5BTUU+<u></u>b25lYWRtaW48L1VOQU1FPjxHTkFNRT<u></u>5vbmVhZG1pbjwvR05BTUU+PE5BTUU+<u></u>Y2VwaHRlc3Q8L05BTUU+<u></u>PFBFUk1JU1NJT05TPjxPV05FUl9VPj<u></u>E8L09XTkVSX1U+PE9XTkVSX00+<u></u>MTwvT1dORVJfTT48T1dORVJfQT4wPC<u></u>9PV05FUl9BPjxHUk9VUF9VPjA8L0dS<u></u>T1VQX1U+PEdST1VQX00+<u></u>MDwvR1JPVVBfTT48R1JPVVBfQT4wPC<u></u>9HUk9VUF9BPjxPVEhFUl9VPjA8L09U<u></u>SEVSX1U+PE9USEVSX00+<u></u>MDwvT1RIRVJfTT48T1RIRVJfQT4wPC<u></u>9PVEhFUl9BPjwvUEVSTUlTU0lPTlM+<u></u>PFRZUEU+<u></u>MDwvVFlQRT48RElTS19UWVBFPjM8L0<u></u>RJU0tfVFlQRT48UEVSU0lTVEVOVD4w<u></u>PC9QRVJTSVNURU5UPjxSRUdUSU1FPj<u></u>E0MTAzNzI1NTU8L1JFR1RJTUU+<u></u>PFNPVVJDRT48L1NPVVJDRT48UEFUSD<u></u>4vY2xvdWQvaW1hZ2VzL3RpbW0vNDBn<u></u>Yi5xY293MjwvUEFUSD48RlNUWVBFPj<u></u>wvRlNUWVBFPjxTSVpFPjQwOTYwPC9T<u></u>SVpFPjxTVEFURT40PC9TVEFURT48Ul<u></u>VOTklOR19WTVM+<u></u>MDwvUlVOTklOR19WTVM+<u></u>PENMT05JTkdfT1BTPjA8L0NMT05JTk<u></u>dfT1BTPjxDTE9OSU5HX0lEPi0xPC9D<u></u>TE9OSU5HX0lEPjxEQVRBU1RPUkVfSU<u></u>Q+MTAzPC9EQVRBU1RPUkVfSUQ+<u></u>PERBVEFTVE9SRT5jZXBoX2RhdGFzdG<u></u>9yZTwvREFUQVNUT1JFPjxWTVM+<u></u>PC9WTVM+<u></u>PENMT05FUz48L0NMT05FUz48VEVNUE<u></u>xBVEU+PERFU0NSSVBU<br>
</blockquote>
S <br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
U9OPjwhW0NEQVRBW3Rlc3QgY2VwaCB<u></u>nb2xkZW4gaW1nXV0+<u></u>PC9ERVNDUklQVElPTj48REVWX1BSRU<u></u>ZJWD48IVtDREFUQVtoZF1dPjwvREVW<u></u>X1BSRUZJWD48RFJJVkVSPjwhW0NEQV<u></u>RBW3Fjb3cyXV0+PC9EUklWRVI+<u></u>PC9URU1QTEFURT48L0lNQUdFPjxEQV<u></u>RBU1RPUkU+PElEPjEwMzwvSUQ+<u></u>PFVJRD4wPC9VSUQ+<u></u>PEdJRD4wPC9HSUQ+<u></u>PFVOQU1FPm9uZWFkbWluPC9VTkFNRT<u></u>48R05BTUU+<u></u>b25lYWRtaW48L0dOQU1FPjxOQU1FPm<u></u>NlcGhfZGF0YXN0b3JlPC9OQU1FPjxQ<u></u>RVJNSVNTSU9OUz48T1dORVJfVT4xPC<u></u>9PV05FUl9VPjxPV05FUl9NPjE8L09X<u></u>TkVSX00+PE9XTkVSX0E+<u></u>MDwvT1dORVJfQT48R1JPVVBfVT4xPC<u></u>9HUk9VUF9VPjxHUk9VUF9NPjA8L0dS<u></u>T1VQX00+PEdST1VQX0E+<u></u>MDwvR1JPVVBfQT48T1RIRVJfVT4wPC<u></u>9PVEhFUl9VPjxPVEhFUl9NPjA8L09U<u></u>SEVSX00+PE9USEVSX0E+<u></u>MDwvT1RIRVJfQT48L1BFUk1JU1NJT0<u></u>5TPjxEU19NQUQ+<u></u>Y2VwaDwvRFNfTUFEPjxUTV9NQUQ+<u></u>Y2VwaDwvVE1fTUFEPjxCQVNFX1BBVE<u></u>g+<u></u>L3Zhci9saWIvb25lLy9kYXRhc3Rvcm<u></u>VzLzEwMzwvQkFTRV9QQVRIPjxUWVBF<u></u>PjA8L1RZUEU+<u></u>PERJU0tfVFlQRT4zPC9ESVNLX1RZUE<u></u>U+PENMVVNURVJfSUQ+<u></u>LTE8L0NMVVNURVJfSUQ+<u></u>PENMVVNURVI+<u></u>PC9DTFVTVEVSPjxUT1RBTF9NQj42MT<u></u>AyNzMyODwvVE9UQUxfTUI+<u></u>PEZSRUVfTUI+<u></u>NjA4NTE1NTI8L0ZSRUVfTUI+<u></u>PFVTRURfTUI+<u></u>MTc1Nzc2PC9VU0VEX01CPjxJTUFHRV<u></u>M+PC9JTUFHR<br>
</blockquote>
V <br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
M+PFRFTVBMQVRFPjxCQVNFX1BBVEg+<u></u>PCFbQ0RBVEFbL3Zhci9saWIvb25lLy<u></u>9kYXRhc3RvcmVzL11dPjwvQkFTRV9Q<u></u>QVRIPjxCUklER0VfTElTVD48IVtDRE<u></u>FUQVtvbmU0ZGV2XV0+<u></u>PC9CUklER0VfTElTVD48Q0VQSF9IT1<u></u>NUPjwhW0NEQVRBW3N0a2VuZGNhMDFh<u></u>IHN0a2VuZGNhMDRhIHN0a2VuZGNhMD<u></u>JhXV0+PC9DRVBIX0hPU1Q+<u></u>PENFUEhfU0VDUkVUPjwhW0NEQVRBWy<u></u>9ldGMvY2VwaC9jZXBoLmNsaWVudC5h<u></u>ZG1pbi5rZXlyaW5nXV0+<u></u>PC9DRVBIX1NFQ1JFVD48Q0xPTkVfVE<u></u>FSR0VUPjwhW0NEQVRBW1NFTEZdXT48<u></u>L0NMT05FX1RBUkdFVD48REFUQVNUT1<u></u>JFX0NBUEFDSVRZX0NIRUNLPjwhW0NE<u></u>QVRBW3llc11dPjwvREFUQVNUT1JFX0<u></u>NBUEFDSVRZX0NIRUNLPjxESVNLX1RZ<u></u>UEU+PCFbQ0RBVEFbUkJEXV0+<u></u>PC9ESVNLX1RZUEU+<u></u>PERTX01BRD48IVtDREFUQVtjZXBoXV<u></u>0+PC9EU19NQUQ+<u></u>PExOX1RBUkdFVD48IVtDREFUQVtOT0<u></u>5FXV0+PC9MTl9UQVJHRVQ+<u></u>PFBPT0xfTkFNRT48IVtDREFUQVtvbm<u></u>VdXT48L1BPT0xfTkFNRT48U1RBR0lO<u></u>R19ESVI+<u></u>PCFbQ0RBVEFbL3Zhci9saWIvb25lL2<u></u>NlcGgtdG1wXV0+<u></u>PC9TVEFHSU5HX0RJUj48VE1fTUFEPj<u></u>whW0NEQVRBW2NlcGhdXT48L1RNX01B<u></u>RD48L1RFTVBMQVRFPjwvREFUQVNUT1<u></u>JFPjwvRFNfRFJJVkVSX0FDVElPTl9E<u></u>QVRBPg== 18<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: cp: Copying local image /cloud/images/timm/40gb.qcow2 to the image repository<br>
Wed Sep 10 13:10:44 2014 [ImM][E]: cp: Command " set -e<br>
Wed Sep 10 13:10:44 2014 [ImM][I]:<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: if [ "" = "2" ]; then<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: FORMAT=$(qemu-img info /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c | grep "^file format:" | awk '{print }')<br>
Wed Sep 10 13:10:44 2014 [ImM][I]:<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: if [ "$FORMAT" != "raw" ]; then<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: qemu-img convert -O raw /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c.raw<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: mv /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c.raw /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: fi<br>
Wed Sep 10 13:10:44 2014 [ImM][I]:<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: rbd import --format 2 /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c one/one-18<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: else<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: qemu-img convert /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c rbd:one/one-18<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: fi<br>
Wed Sep 10 13:10:44 2014 [ImM][I]:<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: # remove original<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: rm -f /var/lib/one/ceph-tmp/<u></u>68bec7e25cb73c98a31a48117022d7<u></u>2c" failed: Unknown protocol 'rbd:one/one-18'<br>
Wed Sep 10 13:10:44 2014 [ImM][E]: Error registering one/one-18 in one4dev<br>
Wed Sep 10 13:10:44 2014 [ImM][I]: ExitCode: 1<br>
Wed Sep 10 13:10:44 2014 [ImM][E]: Error copying image in the datastore: Error registering one/one-18 in one4dev<br>
<br>
<br>
<br>
<br>
---<br>
<br>
Clear we are afailed to register the rbd, but not clear why.. any<br>
or clues on why we failed are helpful.<br>
Several places in the docs refer to libvirt 1.x. Has anyone<br>
made this work on RHEL6/Centos 6 (we are running the newer kernel so<br>
we do have the rbd.o kernel module available, and rbd import/export<br>
works from the command line.)<br>
<br>
Steve Timm<br>
<br>
<br>
------------------------------<u></u>------------------------------<u></u>------<br>
Steven C. Timm, Ph.D (630) 840-8525<br>
<a href="mailto:timm@fnal.gov" target="_blank">timm@fnal.gov</a> <a href="http://home.fnal.gov/~timm/" target="_blank">http://home.fnal.gov/~timm/</a><br>
Fermilab Scientific Computing Division, Scientific Computing Services Quad.<br>
Grid and Cloud Services Dept., Associate Dept. Head for Cloud Computing<br>
<br>
</blockquote>
<br>
------------------------------<u></u>------------------------------<u></u>------<br>
Steven C. Timm, Ph.D (630) 840-8525<br>
<a href="mailto:timm@fnal.gov" target="_blank">timm@fnal.gov</a> <a href="http://home.fnal.gov/~timm/" target="_blank">http://home.fnal.gov/~timm/</a><br>
Fermilab Scientific Computing Division, Scientific Computing Services Quad.<br>
Grid and Cloud Services Dept., Associate Dept. Head for Cloud Computing<br></div></div>
______________________________<u></u>_________________<br>
Users mailing list<br>
<a href="mailto:Users@lists.opennebula.org" target="_blank">Users@lists.opennebula.org</a><br>
<a href="http://lists.opennebula.org/listinfo.cgi/users-opennebula.org" target="_blank">http://lists.opennebula.org/<u></u>listinfo.cgi/users-opennebula.<u></u>org</a><br>
</blockquote></div><br></div>