| *** evrardjp has quit IRC | 01:44 | |
| *** evrardjp has joined #openstack-loci | 01:49 | |
| *** evrardjp has quit IRC | 02:02 | |
| *** evrardjp has joined #openstack-loci | 02:08 | |
| *** portdirect has quit IRC | 05:30 | |
| *** portdirect has joined #openstack-loci | 05:30 | |
| *** aspiers has quit IRC | 05:31 | |
| *** portdirect is now known as Guest72952 | 05:32 | |
| *** aspiers has joined #openstack-loci | 05:38 | |
| *** e0ne has joined #openstack-loci | 06:20 | |
| *** ispp has joined #openstack-loci | 07:00 | |
| *** openstackgerrit has quit IRC | 07:04 | |
| *** ispp has quit IRC | 07:04 | |
| *** ispp has joined #openstack-loci | 07:23 | |
| *** pbourke has quit IRC | 08:52 | |
| *** pbourke has joined #openstack-loci | 08:53 | |
| *** ispp has quit IRC | 10:12 | |
| *** ispp has joined #openstack-loci | 11:01 | |
| *** ispp has quit IRC | 12:26 | |
| *** ispp has joined #openstack-loci | 12:28 | |
| hrw | fetching wheels image is weird | 12:28 |
|---|---|---|
| hrw | ocker build . --build-arg PROJECT=keystone --build-arg FROM=debian:stretch --tag keystone:master-debian --build-arg WHEELS=registry.hub.docker.com:5000/haerwu/luci-requirements:debian-0718 | 12:28 |
| hrw | Exception: Cannot detect protocol for registry: registry.hub.docker.com:5000 due to error: <urlopen error [Errno 110] Connection timed out> | 12:28 |
| *** Guest72952 is now known as portdirect | 12:41 | |
| SamYaple | hrw: `--build-arg WHEELS=haerwu/luci-requirements:debian-0718` | 12:47 |
| hrw | urllib2.HTTPError: HTTP Error 401: Unauthorized | 12:49 |
| SamYaple | hrw: sounds like your repo isn't public | 12:50 |
| SamYaple | we arent loading credentials in the container | 12:50 |
| SamYaple | if you have a need for private wheels, you can also use a local private registry instead of dockerhub | 12:50 |
| SamYaple | (im not sure registry.hub.docker.com:5000 is a thing) | 12:50 |
| hrw | SamYaple: fetch_wheels.py uses it | 12:51 |
| SamYaple | hrw: it doesn't. it uses `registry.hub.docker.com` | 12:52 |
| SamYaple | the port is 443 | 12:52 |
| hrw | ok | 12:53 |
| hrw | ~curse hub.docker web interface | 12:54 |
| hrw | it scales to 10 images ;( | 12:54 |
| SamYaple | haha yea man | 12:54 |
| SamYaple | i use a local private registry or a wheels tarball hosted by apache or similiar | 12:54 |
| SamYaple | in the gate, we push to a local registry as well | 12:54 |
| hrw | have to dig out my 'docker-hub-remova-tag-from-images' script and drop all images from hub | 12:55 |
| SamYaple | i just delete the image and push a tag again :P | 12:55 |
| hrw | SamYaple: I have over 200 images... | 12:55 |
| portdirect | hrw: I'd love a copy of that! | 12:56 |
| hrw | portdirect: https://github.com/hrw/docker-utils | 12:56 |
| SamYaple | hrw: are you familiar with the dockerhub api? its actually decent | 12:56 |
| portdirect | I had one ages ago but lost it | 12:56 |
| portdirect | Nice | 12:56 |
| -openstackstatus- NOTICE: logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown. | 12:56 | |
| *** ChanServ changes topic to "logs.openstack.org is offline, causing POST_FAILURE results from Zuul. Cause and resolution timeframe currently unknown." | 12:56 | |
| SamYaple | aparently you are ;) | 12:56 |
| portdirect | My docker hub is like a junk draw of failure :) | 12:56 |
| SamYaple | hrw: any changes you want to make to fetch_wheels.py , go for it. After those scripts i trust you :D | 12:57 |
| hrw | SamYaple: haha | 12:57 |
| SamYaple | whatever you think would make it work better, we will probably agree | 12:57 |
| SamYaple | fetch_wheels.py was a fairly quick script thats just... been working for us so we havent realyl touched it | 12:57 |
| hrw | R@#T@#$T*@Y$T*(!@$!! | 12:58 |
| hrw | 13:57 (45s) linaro@c1n1:loci$ docker build . --build-arg PROJECT=keystone --build-arg FROM=debian:stretch --tag keystone:master-debian --build-arg WHEELS=10.101.16.1:5000/haerwu/luci-requirements:debian-0718 | 12:58 |
| hrw | urllib2.HTTPError: HTTP Error 404: Not Found | 12:58 |
| hrw | will drop loci for a while and do some housekeeping instead | 12:58 |
| SamYaple | and `docker pull 10.101.16.1:5000/haerwu/luci-requirements:debian-0718` works? | 12:58 |
| hrw | 10.101.16.1 is local machine | 12:58 |
| SamYaple | because if so thats a bug | 12:58 |
| SamYaple | mind you you type `luci` | 12:59 |
| hrw | SamYaple: 3> | 12:59 |
| hrw | SamYaple: so fetch_wheels.py improvements can be done in a way "check, maybe you misspelled name" :D | 13:01 |
| SamYaple | haha | 13:02 |
| SamYaple | if only | 13:02 |
| SamYaple | unless you just want a generic warn, in which case we can probably catch the 404/401 errors and make better messages | 13:02 |
| SamYaple | "seems like a private repo" "repo not found" | 13:03 |
| hrw | Successfully tagged keystone:master-debian | 13:04 |
| hrw | 14:02 (0s) linaro@c1n1:loci$ for project in cinder glance heat horizon ironic keystone neutron nova octavia;do docker build . --build-arg PROJECT=$project --build-arg FROM=debian:stretch --tag ${project}:master-debian --build-arg WHEELS=10.101.16.1:5000/haerwu/loci-requirements:debian-0718;done | 13:04 |
| hrw | let it flow and I can do other stuff | 13:04 |
| SamYaple | cool. i recognize the for loop :) | 13:08 |
| SamYaple | rememeber to include `--build-arg PROFILES="ceph openvswitch"` or whatever profiles you want | 13:08 |
| SamYaple | you can specify the same flags for all projects and only projects that can use ceph (glance, nova, cinder) will install ceph packages | 13:09 |
| SamYaple | controlled via bindep.txt | 13:09 |
| hrw | would have to add CEPH_REPO (or how it was) too | 13:11 |
| SamYaple | hrw: we have some examples of how to do that. https://github.com/openstack/loci/blob/master/dockerfiles/debian/Dockerfile | 13:16 |
| SamYaple | but at the end of the day, its on you to provide an image for the FROM arg that has the appropriate repos | 13:17 |
| SamYaple | this is the current design that weve all centered around :) | 13:17 |
| hrw | SamYaple: noticed already that it is easier to make own base image then use debian:stretch official one | 13:19 |
| hrw | far too many rebuilds ;D | 13:19 |
| hrw | easier to use image where apt upgrade was done, proxy for apt is set etc | 13:20 |
| SamYaple | yea thats our recommendation as well | 13:22 |
| SamYaple | everyones base image use case is unique | 13:22 |
| *** ispp has quit IRC | 13:39 | |
| *** ChanServ changes topic to "Build image -- `docker build https://github.com/openstack/loci.git --build-arg PROJECT=keystone` || Review patches -- https://review.openstack.org/#/q/projects:openstack/loci+status:open" | 13:39 | |
| -openstackstatus- NOTICE: logs.openstack.org is back on-line. Changes with "POST_FAILURE" job results should be rechecked. | 13:39 | |
| *** ispp has joined #openstack-loci | 13:41 | |
| *** e0ne has quit IRC | 13:42 | |
| hrw | cinder glance heat horizon ironic keystone neutron octavia requirements built. | 13:45 |
| hrw | went nice - just 3 patches required (including Pillow one which got merged) | 13:49 |
| * hrw lunch | 13:52 | |
| *** ispp has quit IRC | 13:53 | |
| SamYaple | nice hrw! | 13:58 |
| *** e0ne has joined #openstack-loci | 14:21 | |
| hrw | ;D | 14:54 |
| SamYaple | hrw: what do the build times look for the non-requirements images? | 14:57 |
| SamYaple | im curious about the speeds on aarch64 | 14:57 |
| hrw | SamYaple: w8, will time them | 14:57 |
| SamYaple | :) | 14:57 |
| SamYaple | oh and a major difference in build process here is you can build keystone independantly from nova | 14:58 |
| SamYaple | they dont share a base | 14:58 |
| SamYaple | that said, i tend to rebuild all images when reuqirements updates, but thats a personal choice | 14:58 |
| hrw | I will rebuild requirements one | 14:58 |
| hrw | with python-scipy installed instead of piping numpy scipy | 14:59 |
| SamYaple | cool. yea based on how the build process works, doing that *should* work | 14:59 |
| *** e0ne has quit IRC | 15:06 | |
| hrw | cinder, glance - 3 minutes, heat 7, horizon 2 | 15:18 |
| hrw | ironic 3 | 15:22 |
| hrw | not checked how long it was on x86-64 | 15:22 |
| hrw | keyston 3 | 15:25 |
| hrw | keyston 6, neutron 1 | 15:30 |
| hrw | wrong | 15:30 |
| hrw | SamYaple: installing python-scipy will probably make blas/lapack patch not needed ;d | 15:35 |
| hrw | glance 3, heat 3, horizon 7, ironic 4, keystone 3, neutron 6, nova 5, octavia 2 | 15:35 |
| SamYaple | hrw: awesome! thats great to hear about the deps | 15:40 |
| SamYaple | those build times look longer than normal though | 15:40 |
| hrw | SamYaple: that's on 4-5y old machine | 15:45 |
| hrw | in arm64 this cpu is antique | 15:46 |
| SamYaple | oh. then those look good! | 15:48 |
| hrw | still 8 cores, 64GB ram and 480GB SSD | 15:49 |
| SamYaple | 2-4 minute builds are whats normal | 15:49 |
| SamYaple | on nvme you can do under 1 minute builds | 15:49 |
| hrw | I could move docker storage to tmpfs... | 15:49 |
| SamYaple | its normally iops bound, ya | 15:50 |
| hrw | installing python-scipy (which depends on python-numpy) is not a solution ;( | 16:27 |
| hrw | going back to pip install one... | 16:27 |
| *** openstackgerrit has joined #openstack-loci | 16:29 | |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/loci master: bindep: install blas and lapack headers to build scipy on aarch64 https://review.openstack.org/583726 | 16:29 |
| openstackgerrit | Marcin Juszkiewicz proposed openstack/loci master: requirements.sh: install numpy and scipy on AArch64 https://review.openstack.org/583727 | 16:29 |
| hrw | rebased one, tabs->spaces in second | 16:31 |
| SamYaple | hrw: is python-numpy not packaged for you? | 16:57 |
| SamYaple | python-scipy is what needs pyhton-numpy, you shouldnt need python-scipy on the build host, but you do need numpy | 16:58 |
| hrw | SamYaple: scikit-learn needs both. | 17:01 |
| SamYaple | weird. i need to get an arm board | 17:02 |
| SamYaple | i guess i could just qemu it | 17:02 |
| hrw | SamYaple: ask gema for some ;) | 17:10 |
| SamYaple | im pretty sure weve talked about it, but i honestly dont remeber the outcome. i think i was asking for remote access | 17:11 |
| portdirect | hrw: do you work with kevinz? | 17:11 |
| hrw | portdirect: yes | 17:17 |
| hrw | portdirect: part of same team under gema's command | 17:17 |
| portdirect | awesome :) I know hes been trying to get OSH up and running | 17:17 |
| portdirect | it would be great to see - if theres any way i can help in that just shout | 17:18 |
| hrw | portdirect: my job is building stuff (includes making it build) | 17:19 |
| hrw | portdirect: so for example I did kolla bringup for aarch64 (and ppc64le as extra) + full debian revival there | 17:19 |
| hrw | portdirect: built images, added building into CI | 17:20 |
| hrw | portdirect: and then other team members used it for deployments and testing | 17:20 |
| hrw | portdirect: with loci it will be probably similar. I got it running, will add to CI (where we have 98 cpu cores and 128GB ram) and other people will deploy/test | 17:21 |
| portdirect | are the images you make public? | 17:21 |
| portdirect | if we could get a 3rd party arm gate for OSH it would rock | 17:23 |
| hrw | portdirect: hub.docker.com/u/linaro keeps debian-source-* kolla images | 17:24 |
| hrw | gema: ^^ | 17:24 |
| SamYaple | last PTG i thought linaro was giving infra some arm hardware for gating. if so portdirect , you could do a true infra arm gate for OSH | 17:26 |
| SamYaple | maybe it wasnt linaro, but i do recall hearing infra was getting some arm stuff | 17:27 |
| hrw | it was us | 17:27 |
| portdirect | oh nice | 17:27 |
| hrw | but due to some stuff we only had China location available | 17:27 |
| SamYaple | ahh got it | 17:28 |
| SamYaple | that makes more sense | 17:28 |
| SamYaple | dots are connecting | 17:28 |
| portdirect | hmm - i dont think our current gate env is very "china friendly" :( I should prob fix that... | 17:29 |
| SamYaple | do like loci and make internal-to-the-test-node mirrors | 17:29 |
| SamYaple | how you populate those mirrors can be super pluggable then | 17:30 |
| hrw | http://blog.shippable.com/shippable-arm-packet-deliver-native-ci-cd-for-arm-architecture | 17:31 |
| hrw | from what I was told Packet uses kolla | 17:31 |
| portdirect | SamYaple: I'll prob reach out next week for help there if i get stuck, we do a few bad things i should really clean up anyway, eg: https://github.com/openstack/openstack-helm-infra/blob/master/tools/images/kubeadm-aio/Dockerfile#L81 | 17:31 |
| hrw | portdirect: s/amd64/$(arch)/g and add arch switch | 17:32 |
| SamYaple | portdirect: just a few? if I were to search the git history, how many times would i see "this is terrible, but..." | 17:32 |
| SamYaple | i do see people come back through and cleanup though ;) | 17:33 |
| portdirect | over 9000 i think ;) | 17:33 |
| hrw | portdirect: https://git.openstack.org/cgit/openstack/kolla/tree/docker/kube/kube-base/Dockerfile.j2#n6 | 17:33 |
| hrw | portdirect: btdt ;D | 17:33 |
| portdirect | yeah - I think it should be pretty easy | 17:34 |
| portdirect | i may just try a node on packet for a bit | 17:34 |
| hrw | Successfully tagged requirements:master-debian-0719 | 17:49 |
| hrw | real 60m57.693s | 17:49 |
| SamYaple | that seems about right if you kill all the parallel stuff | 17:51 |
| hrw | SamYaple: that's with -P20 | 17:54 |
| SamYaple | oh... well thats slower than i would expect | 17:55 |
| SamYaple | unless you got rid of the Cassandra thing | 17:55 |
| hrw | no. origin/master + blas/lapack + numpy/scipy on top | 17:57 |
| SamYaple | still. seems a bit long. but might just be like you said, 4-5 year old processor | 17:58 |
| SamYaple | you might try tunning the parallel runs | 17:58 |
| SamYaple | -P20 was just a number based on quick expermintation | 17:59 |
| hrw | ;) | 18:10 |
| * hrw off | 18:32 | |
| *** e0ne has joined #openstack-loci | 19:50 | |
| *** e0ne has quit IRC | 19:57 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!