Tuesday, 2018-06-12

prometheanfireok01:24
openstackgerritMatthew Thode proposed openstack/diskimage-builder master: uncap networkx to match global-requirements.  https://review.openstack.org/57450301:25
*** trungnv has quit IRC01:38
*** trungnv has joined #openstack-dib01:39
prometheanfireianw: it seems like dib isn't respecting constraints, should we remove it from our projects.txt and remove the check-requirements job?02:17
ianwwell i'm not sure we're deliberately doing that02:18
ianwi think we want to do whatever best practice is02:19
prometheanfire:P02:20
prometheanfirehttp://logs.openstack.org/03/574503/1/check/tripleo-buildimage-overcloud-full-centos-7/e23d231/job-output.txt.gz wasn't obeying constraints (installs networkx 2.1)02:21
prometheanfirethis is the first error I see though http://logs.openstack.org/03/574503/1/check/tripleo-buildimage-overcloud-full-centos-7/e23d231/job-output.txt.gz#_2018-06-12_01_44_28_07499602:22
prometheanfirethe trusty job seems to install 1.11 though02:23
ianwohhh, yeah will the tripleo jobs ...02:28
ianwhow constraints interacts with them we would have to get some help with02:28
prometheanfireya, I have no clue there02:34
prometheanfireI don't think the errors were networkx related though02:34
prometheanfirewin 2902:34
trungnvPlease clarify my issue with following logs: /usr/sbin/setfiles get context on /boot/efi failed: 'Operation not supported'02:42
trungnvI am trying to create centos with block-device-efi02:42
*** chhagarw has joined #openstack-dib02:46
ianwtrungnv: hmmm; we try to run setfiles over everything to fixup selinux permissions.  however, i guess vfat doesn't support that at all02:47
ianwwe should likely skip this, and i imagine we've never hit it because we've never tried centos with efi?  do you have the full logs?02:47
trungnvif I skip this then I cannot boot over UEFI into server.02:50
ianwyou mean if you skip the entire selinux setting?02:51
trungnvhttp://paste.ubuntu.com/p/J2PDFSf4B8/ This is my logs02:51
trungnvyep.02:51
ianwtrungnv: i think the quickest thing to do is put a skip for this in https://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/elements/rpm-distro/cleanup.d/99-selinux-fixfiles-restore#n6602:54
ianwadd && [ "${MOUNTPOINT}" != "/boot/efi" ]02:54
ianwi'd also run with "-x" to get more debugging02:54
trungnv"-x" arg in command of disk-image-create?02:56
trungnvianw, before this issue, I also hit other issue with grub-efi package and I has use  DIB_EXTLINUX=1 to ignore them.02:58
ianwyes on "-x" ... that turns  on more debugging02:59
ianwi very much doubt you want DIB_EXTLINUX=1 ...02:59
ianwtrungnv: you probably need yolanda's change to get efi bootloader packages?  https://review.openstack.org/#/c/573726/2/diskimage_builder/elements/bootloader/pkg-map03:00
trungnvYeah. I will try with it.03:02
trungnvperhaps, I has created centos image when i ignore setfile permission. this is logs: http://paste.ubuntu.com/p/J4ZY7PkZzw/03:04
trungnvBut, I am not sure I can boot successful with this image.03:06
ianwtrungnv: i doubt it, as grub isn't installed03:06
ianwbut if you try with that other change, that *should* find the right packages for centos.  we've only really built ubuntu/xenial with efi ATM, for arm6403:07
trungnvianw, we couldn't build centos7 with efi at the moment via DIB?03:08
trungnvdisk-image-create centos7 vm devuser cloud-init-datasources dhcp-all-interfaces iscsi-boot block-device-efi -o $IMAGE_NAME03:08
trungnvThis is my command for image creation.03:08
trungnvDo you know what kind of centos image which suitable with efi booting?03:09
ianwyou'll need to at least try with yolanda's change 57372603:10
ianwafaik, centos+efi has just never been done, which is why things don't "just work"03:10
trungnvyep. I will try to create new image with yolanda's patch then will try to boot again.03:12
trungnvianw, In the last time, I can boot ubuntu with efi but It's only boot into intramfs and stop.03:17
trungnvDo you know what happen?03:17
ianwhmmm, that could be a lot of things, it's a good start though03:17
ianwone thing is to just leave it for a bit, it's possible the console is just not coming out?  sometimes you'll see a login pop up after a bit03:18
trungnvhttp://paste.ubuntu.com/p/ZzwqdpzRQW/ this is logs in server03:19
trungnvI also check in /etc/fstab then nothing inside.03:20
trungnvI also check this info if image which has used booting then enough info which ubuntu need for booting. I don't know why they lost during booting.03:21
trungnvs/if/in03:22
ianwhmm, a "blkid" on that busybox prompt would be a good start03:22
trungnvianw, any fixing in DIB for this issue? I will try to type "blkid" in busybox.03:24
ianwno, i'm not sure what's up with that.  either the partition doesn't exist, or the initrd can't see it03:24
trungnv*maybe* Have an issue with ubuntu image which download for source in this case?03:27
ianwi don't think, more likely the bootloader03:33
trungnvbootloader in DIB?03:34
ianwyes03:35
trungnvwhat kind of issue in bootloader and should we change them in DIB?03:36
trungnvianw, "Trying to terminate EFI services again" this is log in server when I try with centos + efi + patch of yolanda.03:43
ianwsorry, never seen that before04:19
*** rajinir has quit IRC04:30
*** sm806 has joined #openstack-dib05:59
sm806I am trying to create a centos7 based image with disk-image-create. At the end of the command I dont see the image getting created. Going through the logs, the last error I could spot is "ln: failed to create symbolic link '/usr/local/bin/dib-run-parts': File exists". Any idea what could be the issue ??06:01
ianwsm806: hmmm, that is not something i'd expect.  are you running from git?06:04
sm806nope. I did a yum install on centos7.06:06
ianwok, i'm not sure what repo that came from, it's likely not a very recent version.  i'd recommend just setting up a virtualenv and installing git master into that06:07
sm806ok. I will do a "yum remove" and use the git clone. Should I take the master branch or is there a stable branch that I should clone?06:09
ianwsm806: master is stable ... well as stable as it gets :)06:12
ianwthat's not quite true, the latest tag on master is probably the most stable point06:12
ianwbut we try to release fairly regularly06:12
yolandahi trungnv , so i didn't finish a complete uefi testing with that, but just fixed the problem with the element, it was giving an error because the wrong package was installed06:24
yolandaso this patch fixes it, although some other things are needed to boot from uefi06:24
yolandatrungnv, inside dib code, there is a test that creates the needed partitions for uefi, have you used that?06:25
trungnvyolanda, Yes. I has booted with uefi for ubuntu, please see my video: https://www.youtube.com/watch?v=UrwqSjBOV0E&feature=youtu.be06:38
trungnvlast time, I hit an issue with initramfs when I use patch https://review.openstack.org/#/c/511494/ without your patch.06:41
trungnvyolanda, which kind of OS? ubuntu or centos?06:44
yolandatrungnv, are we talking about that patch? https://review.openstack.org/#/c/573726/06:45
yolandaor you refer to some other patch i did?06:45
sm806ianw, tried it with the latest master on "https://git.openstack.org/openstack/diskimage-builder". Its failing with error Cannot uninstall 'PyYAML'. It is a distutils installed project and thus we cannot accurately determine which files belong to it which would lead to only a partial uninstall.06:45
yolandathat patch only should fix rhel/centos06:45
trungnvyolanda, right. I only complete with ubuntu. with centos I meet an other issue in booting.06:46
yolandawithout that, i could not even build the image for rhel, it was complaining about grub-efi package not existing06:46
trungnv"Trying to terminate EFI services again" this is log in server.06:47
ianwsm806: are you installing into a virtualenv?06:47
yolandai didn't see that, but i could not complete the boot. What i was hitting, is that the system was just stuck in the grub menu forever06:47
yolandai didn't go further06:47
trungnvI think your patch was fixing this issue.06:48
trungnvlast time, I must use DIB_EXTLINUX=1 to ignore error  grub-efi package not existing.06:49
trungnvyolanda, I also stuck something when booting for centos with EFI. I am not sure why they could not get EFI service. Maybe, we have different issue in this case.06:52
trungnvyolanda, ah. I know your issue. I ever meet this issue06:53
trungnvMaybe you need to change *.efi file for booting.06:53
ianwyolanda:  could you interact with grub?06:54
trungnvhttps://rom-o-matic.eu/ you can use link which help create new efi file.06:54
sm806ianw, yes i am installing it in the virtualenv. I have copied the commands I executed in this location: http://paste.openstack.org/show/723260/06:56
yolandaianw, i didn't have time to test , still need to dedicate more time06:56
ianwsm806: after your clone, did you do "pip install ./diskimage-builder ?06:57
ianwyou can also use "--logfile" fyi, though that's minor06:57
sm806ianw, I did "cd diskimage-builder" and "pip install -e ." Missed it in the pase.06:59
trungnvyolanda, what are elements for centos7 with EFI?07:00
ianwsm806: and you're still getting a pyyaml removal error?07:00
sm806ianw, added the commands in sequence in: http://paste.openstack.org/show/723261/07:00
yolandatrungnv, i added block-device-efi07:02
ianwsm806: so is the problem still removing the pyyaml package now, or something lese?07:03
trungnvyolanda, Do you know why have following iss "Trying to terminate EFI services again" when server boot?07:05
trungnvbefore booting, I hit issue with chroot at https://git.openstack.org/cgit/openstack/diskimage-builder/tree/diskimage_builder/elements/rpm-distro/cleanup.d/99-selinux-fixfiles-restore#n6607:06
trungnvand I must ignore them07:06
yolandatrungnv, that's before or after the grub menu?07:08
trungnvduring create image07:08
yolandaah, even on image creation. And then the image is aborted'07:08
yolanda?07:08
trungnvyep07:08
yolandatrungnv, let me paste the block layout i use, so see if that helps07:09
yolandaalthough is not 100% working, i can build the image07:09
trungnvyes. thanks07:09
sm806ianw, yes seems like issue is still with PyYAML. I have copied the debug file at this location, https://www.dropbox.com/s/804vcjgtctmye3l/debug.out?dl=0. Probably it should give more details.07:12
yolandatrungnv, that's the element i use for the device layout http://paste.openstack.org/show/723263/07:13
yolandai create an element called overcloud-secure07:14
yolandaand inside it, i have block-device-default.yaml with that content07:14
ianwsm806: oooohhhhh, this is *inside* the image07:15
yolandain the element-deps for that element i have07:15
yolandablock-device-efi07:15
yolandapackage-installs07:15
ianwsm806: this is really something the 50-heat-config-source needs to sort out, "pip install python-heatclient python-zaqarclient python-keystoneclient"07:16
trungnvWe only need to create with overcloud-secure. is right?07:16
ianwsm806: it's fundamentally related to pip10 behaviour in https://github.com/pypa/pip/issues/480507:16
trungnvDo you have other changes?07:17
yolandatrungnv, i have it integrated for TripleO, so there are other elements included. But this element is relevant. I also add bootloader element07:20
sm806ianw, any known workarrounds ??07:20
yolandatrungnv, i use that list https://github.com/openstack/tripleo-common/blob/master/image-yaml/overcloud-hardened-images.yaml07:21
yolandabut most of them are not going to be relevant for just a test image build07:21
ianwsm806: the pip people would say this is why you install things in a virtualenv to isolate yourself.07:21
ianwsm806: as mentioned in the github issue, you can remove the .egg files for the install and pip will go back to overwriting it.  you'd have to do that in the element07:22
trungnvyolanda, yep. I will try with your suggestion. Thanks07:23
*** dlbewley has quit IRC07:24
yolandatrungnv, cool, please let me know how it goes07:28
sm806ianw, sorry for bothering you with basic questions. I am a newbee to this tool. Can you tell me which option should I use in element to remove the .egg file.07:29
ianwsm806: you'll probably need to edit https://github.com/openstack/heat-agents/blob/master/heat-config/install.d/heat-config-source-install/50-heat-config-soure and actually do an "rm" of the file in there07:32
trungnvyolanda, I hit an issue "AlreadyProvidedException: block-device: already provided by ['block-device-mbr']" when I create centos image.08:14
trungnvwith overcloud-secure element08:14
sm806ianw, thanks. Will give it a try.08:16
yolandayou need to remove the block-device-mbr one. Do you have some element that adds it?08:20
trungnvcentos7 vm devuser cloud-init-datasources dhcp-all-interfaces iscsi-boot overcloud-secure08:26
yolandavm makes it , you need to remove it08:26
trungnvyep. thanks08:26
trungnvcool. It's running.08:27
*** pavel_V has quit IRC08:27
*** pavel_V has joined #openstack-dib08:32
*** hkominos has joined #openstack-dib09:55
hkominosHi all. Is this the right channel for a dev question in dib ?09:55
ianwhkominos: yep10:09
hkominosnvm i just got it!10:10
lennybHi, I am trying to build CentOS7.4 1708 image, but I see that I am getting centos7.5 latest. my env params http://paste.openstack.org/show/723295/ .  Is there a way to set DIB_RELEASE for CentOS or install a specific version?11:06
*** pavel_V has quit IRC11:14
*** sambetts|afk is now known as sambetts12:34
*** vmlinuz has joined #openstack-dib12:55
*** vmlinuz has joined #openstack-dib12:55
*** mjturek has joined #openstack-dib13:03
*** mjturek has quit IRC13:03
*** mjturek has joined #openstack-dib13:06
*** vmlinuz has quit IRC13:33
*** vmlinuz has joined #openstack-dib13:50
*** vmlinuz has joined #openstack-dib13:50
*** pavel_V has joined #openstack-dib14:19
*** rajinir has joined #openstack-dib14:36
*** mordred has quit IRC14:55
*** hkominos has quit IRC15:06
*** mordred has joined #openstack-dib15:08
clarkblennyb: I'm not sure, beacus centos doesn't support older point releases15:16
clarkblennyb: you could probably use an existing 7.4 as a base image and not yum update anything15:17
clarkbbut if you use centos minimal I doubt it will install older versions as upstream has moved beyond that point in time15:17
*** mordred has quit IRC15:48
*** mordred has joined #openstack-dib15:51
lennybclarkb: thanks, I've found a solution by manual removing https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/elements/base/install.d/00-up-to-date#L1116:01
*** dlbewley has joined #openstack-dib16:01
*** sambetts is now known as sambetts|afk16:22
*** chhagarw has quit IRC17:30
*** calebb has quit IRC19:49
*** squid has joined #openstack-dib20:03
*** vmlinuz has quit IRC20:23
*** brault has quit IRC20:39
*** mjturek has quit IRC20:48
*** mjturek has joined #openstack-dib20:49
*** pavel_V has quit IRC21:35
*** squid has quit IRC22:08
*** squid has joined #openstack-dib22:10
*** rajinir has quit IRC23:24

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!