Tuesday, 2019-11-19

« Monday, 2019-11-18 Index Wednesday, 2019-11-20 »
*** tosky has quit IRC00:07
*** jamesmcarthur has joined #zuul00:15
*** jamesmcarthur has quit IRC00:23
*** jamesmcarthur has joined #zuul00:25
*** rlandy|rover has quit IRC00:30
*** jamesmcarthur has quit IRC00:34
openstackgerritDavid Moreau Simard proposed zuul/zuul master: DNM: Test zuul-stream-functional with ara 1.2  https://review.opendev.org/69462200:46
*** jamesmcarthur has joined #zuul00:53
openstackgerritDavid Moreau Simard proposed zuul/zuul master: DNM: Test zuul-stream-functional with ara 1.2  https://review.opendev.org/69462200:58
corvusi've spent quite some time attempting to find a directory structure that will allow me to import a vendored pytoml in an ansible module, and have yet to succeed.  i'll pick this up tomorrow.01:13
openstackgerritDavid Moreau Simard proposed zuul/zuul master: DNM: Test zuul-stream-functional with ara 1.2  https://review.opendev.org/69462201:18
*** avass has quit IRC01:19
*** jamesmcarthur has quit IRC01:19
*** jamesmcarthur has joined #zuul01:31
*** jamesmcarthur has quit IRC01:39
*** jamesmcarthur has joined #zuul01:42
*** jamesmcarthur has quit IRC01:49
*** jamesmcarthur has joined #zuul01:52
*** jamesmcarthur has quit IRC02:21
*** igordc has quit IRC02:21
*** jamesmcarthur has joined #zuul02:30
*** bhavikdbavishi has joined #zuul03:11
*** bhavikdbavishi1 has joined #zuul03:19
*** bhavikdbavishi has quit IRC03:20
*** bhavikdbavishi1 is now known as bhavikdbavishi03:20
*** jamesmcarthur has quit IRC04:00
*** jamesmcarthur has joined #zuul04:00
*** jamesmcarthur has quit IRC04:06
*** sanjayu__ has joined #zuul04:08
openstackgerritIan Wienand proposed zuul/zuul-jobs master: install-devstack: switch to Python 3  https://review.opendev.org/69489804:22
*** bjackman has joined #zuul04:23
openstackgerritIan Wienand proposed zuul/nodepool master: [dnm] test devstack python3  https://review.opendev.org/69489904:26
*** jamesmcarthur has joined #zuul04:31
*** jamesmcarthur has quit IRC04:44
*** jamesmcarthur has joined #zuul04:47
*** bjackman has quit IRC05:00
*** mhu has quit IRC05:18
*** jamesmcarthur has quit IRC05:20
*** pcaruana has joined #zuul05:43
*** jamesmcarthur has joined #zuul05:51
*** lennyb has joined #zuul05:54
*** jamesmcarthur has quit IRC05:55
*** openstackstatus has joined #zuul06:10
*** ChanServ sets mode: +v openstackstatus06:10
*** pcaruana has quit IRC06:56
openstackgerritMerged zuul/zuul master: Change colors of various "negative" results in UI  https://review.opendev.org/69182806:56
openstackgerritMerged zuul/zuul master: Refresh public OpenPGP key for Jeremy Stanley  https://review.opendev.org/69344107:09
openstackgerritMerged zuul/zuul master: Enable starting executors in paused mode  https://review.opendev.org/69281207:27
*** tosky has joined #zuul08:26
*** sanjayu__ has quit IRC08:27
*** bhavikdbavishi has quit IRC08:36
*** pcaruana has joined #zuul08:36
*** bhavikdbavishi has joined #zuul08:37
*** bhavikdbavishi1 has joined #zuul08:40
*** bhavikdbavishi has quit IRC08:41
*** bhavikdbavishi1 is now known as bhavikdbavishi08:41
*** jpena|off is now known as jpena08:42
openstackgerritSimon Westphahl proposed zuul/zuul master: Add optional support for circular dependencies  https://review.opendev.org/68535408:56
*** sanjayu__ has joined #zuul09:21
*** dmyrhorodskyi has joined #zuul09:28
*** adso78 has joined #zuul09:33
*** jamesmcarthur has joined #zuul09:48
*** jamesmcarthur has quit IRC09:53
*** bhavikdbavishi has quit IRC10:04
*** sshnaidm|afk is now known as sshnaidm|ruck10:10
dmyrhorodskyiHi everyone, I am running Zuul v3 in Kubernetes and can`t connect to Gerrit 2.14 with following logs:2019-11-19 10:25:17,099 ERROR gerrit.GerritWatcher: Exception on ssh event stream with gerrit:Traceback (most recent call last):  File "/usr/local/lib/python3.7/site-packages/zuul/driver/gerrit/gerritconnection.py", line 322, in _run10:34
dmyrhorodskyikey_filename=self.keyfile)  File "/usr/local/lib/python3.7/site-packages/paramiko/client.py", line 406, in connect    t.start_client(timeout=timeout)  File "/usr/local/lib/python3.7/site-packages/paramiko/transport.py", line 660, in start_client    raise e  File "/usr/local/lib/python3.7/site-packages/paramiko/transport.py", line 2075, in run10:34
dmyrhorodskyiself.kex_engine.parse_next(ptype, m)  File "/usr/local/lib/python3.7/site-packages/paramiko/kex_ecdh_nist.py", line 53, in parse_next    return self._parse_kexecdh_reply(m)  File "/usr/local/lib/python3.7/site-packages/paramiko/kex_ecdh_nist.py", line 136, in _parse_kexecdh_reply    self.transport._verify_key(K_S, sig)  File10:34
dmyrhorodskyi"/usr/local/lib/python3.7/site-packages/paramiko/transport.py", line 1889, in _verify_key    self.host_key_typeparamiko.ssh_exception.SSHException: Signature verification (ssh-ed25519) failed.If I add host key of my Gerrit server to known_hosts file, it works fine. But Zuul does not require such actions afaik. Could someone help? What could go10:34
dmyrhorodskyiwrong?10:34
AJaegerdmyrhorodskyi: please use a paste service like paste.openstack.org next time10:36
AJaegerdmyrhorodskyi: sorry, can't help with actual problem, hope others can.10:38
dmyrhorodskyiSorry for unreadable message. Here is link to paste service http://paste.openstack.org/raw/786331/.10:41
*** rfolco has joined #zuul10:43
*** jamesmcarthur has joined #zuul10:50
*** bhavikdbavishi has joined #zuul10:53
*** jamesmcarthur has quit IRC10:54
*** bhavikdbavishi1 has joined #zuul10:56
*** bhavikdbavishi has quit IRC10:57
*** bhavikdbavishi1 is now known as bhavikdbavishi10:57
*** sanjayu__ has quit IRC12:03
*** saneax has joined #zuul12:04
*** bhavikdbavishi has quit IRC12:07
*** bhavikdbavishi has joined #zuul12:10
*** bhavikdbavishi has quit IRC12:14
*** jamesmcarthur has joined #zuul12:19
*** jpena is now known as jpena|lunch12:31
*** rlandy has joined #zuul12:54
*** rlandy is now known as rlandy|rover12:54
*** chandankumar is now known as raukadah13:05
*** bhavikdbavishi has joined #zuul13:11
*** jamesmcarthur has quit IRC13:12
*** jamesmcarthur has joined #zuul13:12
*** bhavikdbavishi has quit IRC13:28
*** jpena|lunch is now known as jpena13:31
openstackgerritTobias Henkel proposed zuul/nodepool master: Add ready endpoint to webapp  https://review.opendev.org/69500113:34
corvusdmyrhorodskyi: i think there's a bug with ed25519 keys in older gerrit versions, but if the host has an rsa key, you can convince paramiko to use it by adding it's fingerprint to ~/.ssh/known_hosts13:35
ShrewsIt looks like Ansible 2.8 has changed from OSError to FileNotFoundError exception, which is breaking the zuul-stream-functional-2.8 job: https://zuul.opendev.org/t/zuul/build/01839793b55643589699a0ff26c09fa5/log/job-output.txt#4214  breaking  https://opendev.org/zuul/zuul/src/branch/master/playbooks/zuul-stream/functional.yaml#L5413:41
ShrewsI suspect the tasks following that one might be affected too since they also look for OSError, but haven't validated that yet13:43
Shrewsoh, it's this one that is actually failing: https://opendev.org/zuul/zuul/src/branch/master/playbooks/zuul-stream/fixtures/test-stream-failure.yaml#L713:49
Shrewssame issue though13:49
*** jamesmcarthur has quit IRC13:52
openstackgerritMerged zuul/zuul-jobs master: install-devstack: switch to Python 3  https://review.opendev.org/69489814:41
dmyrhorodskyicorvus yeap, if not for containerized Zuul, it would be nice work around with known_hosts file :). Actually I thought it is problem with paramiko, but I will check it without gerrit.14:41
corvusdmyrhorodskyi: you may be able to bind-mount that in -- zuul shouldn't need to write to it if you supply all the keys14:42
dmyrhorodskyicorvus I`ve almost done it. Thank you for help.14:44
*** dmyrhorodskyi has quit IRC14:44
*** swest has quit IRC15:04
*** michael-beaver has joined #zuul15:08
*** saneax has quit IRC15:17
*** jamesmcarthur has joined #zuul15:31
*** rlandy|rover is now known as rlandy|rover|mtg15:32
*** sshnaidm|ruck has quit IRC15:49
*** sshnaidm has joined #zuul15:50
*** sshnaidm is now known as sshnaidm|ruck15:50
*** pcaruana has quit IRC15:50
*** pcaruana has joined #zuul15:51
*** themroc has quit IRC15:54
openstackgerritJavier Peña proposed zuul/zuul-registry master: Do not overwrite the kept_manifests variable when pruning  https://review.opendev.org/69341016:14
*** rlandy|rover|mtg is now known as rlandy|rover16:22
SpamapSmordred: w00t!16:37
* SpamapS will be refactoring his zuul deployment into Terraform modules and this will definitely simplify16:38
*** jpena is now known as jpena|brb16:46
openstackgerritDavid Shrewsbury proposed zuul/zuul master: Fix zuul-stream-functional tests  https://review.opendev.org/69461916:56
dmsimardSpamapS: moar yaml16:57
openstackgerritDavid Shrewsbury proposed zuul/zuul master: Fix zuul-stream-functional tests  https://review.opendev.org/69461916:57
*** jamesmcarthur has quit IRC17:05
*** jamesmcarthur has joined #zuul17:17
*** jpena|brb is now known as jpena17:26
*** michael-beaver has quit IRC17:27
Shrews https://review.opendev.org/694619  is ready now if folks want to +A it. The 2.5 test failed because of that weird, random "REMOTE HOST IDENTIFICATION HAS CHANGED" error in post. Not worth a recheck for that, IMO.17:38
corvusShrews: lgtm, +2, i'll let tobiash or tristanC +317:42
corvusShrews: thanks for dealing with that17:43
openstackgerritTristan Cacqueray proposed zuul/zuul-jobs master: DNM: negative test  https://review.opendev.org/52243817:43
*** jamesmcarthur has quit IRC17:43
mordredcorvus: do want want to let one of the re-review it? or ok if I +3 it?17:48
openstackgerritTristan Cacqueray proposed zuul/zuul master: trigger: add job filter event  https://review.opendev.org/63990517:48
corvusmordred: i reckon you'll do :)17:49
mordredcorvus: tristanC got it :)17:50
*** igordc has joined #zuul17:52
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: use-buildset-registry: Vendor pytoml and remarshal  https://review.opendev.org/69505017:56
openstackgerritJames E. Blair proposed zuul/zuul-jobs master: WIP: use-buildset-registry: add podman support  https://review.opendev.org/69505117:56
corvusmordred, tristanC, clarkb: ^ that's the solution i've come up with for the toml issue.  that ansible module should work, so next is incorporating that into the role and testing.17:57
openstackgerritTristan Cacqueray proposed zuul/zuul master: docs: add default project configuration guide  https://review.opendev.org/57199417:57
corvusi'm not happy about anything in 695050, but see no reasonable alternatives.17:57
mordredcorvus: I understand that emotion18:03
pabelangerI've raised this topic before and looking to get some help on how best to address it. In zuul.a.c, we do a lot of multinode testing, we have limited capacity in 4 regions with nodepool. What usually ends up happening, is 50% of a nodereqest comes online (locked ready) but we run out of quota for the 2nd node to be provisioned. This usually results in a provider almost getting wedged becase we have 4 of 5 node18:07
pabelangerrequests not fulfilled, waiting for the working nodeset to finish, then trying to boot more nodes.  This also has a side effort of our billing for testing ballooning in wasted CI cycles, since they nodes are only for extended periods as locked / ready.18:07
mordredcorvus: I have +2'd with a message that makes me feel slightly better18:07
pabelangerthis results as started to become user facing, as users have to wait longer for tests to run18:07
tristanCcorvus: that's unfortunate toml isn't supported by ansible...18:07
mordredtristanC: it's unfortunate that toml was used in the first palce18:07
mordredI mean - it's unfortunate that toml was created, but it's even more unfortunate that it was used in this context18:08
mordredso much sadness18:09
corvusyeah.  i find toml offensive.  i'm personally having a hard time dealing with this.18:09
tristanCwell some projects are using it... perhaps there is already work in progress to add an Ansible tomledit module?18:10
corvustristanC: sorry i didn't catch it earlier, but i left one more nitpicky (but important because it's user facing) note on https://review.opendev.org/69396118:11
openstackgerritTristan Cacqueray proposed zuul/zuul master: config: blacklist pipeline names that can not be used in template  https://review.opendev.org/69396118:13
tristanCcorvus: not sure if you saw that, but i'v been experimenting with the dhall language to manage zuul configuration, here is my poc: https://github.com/TristanCacqueray/dhall-zuul18:14
tristanCcorvus: it's a probably too rough around the edge at the moment, but i find it very promising and perhaps zuul could read such language natively in the distant future?18:17
tristanCfor example that would let us implement test matrix and remove the need for the project-template construct18:19
*** jpena is now known as jpena|off18:32
openstackgerritMerged zuul/zuul master: Fix zuul-stream-functional tests  https://review.opendev.org/69461918:38
pabelangercorvus: tristanC: tobiash: mordred: I'd like to see if we could bring https://review.opendev.org/660856/ back to life, skip file matches for timer tiggers.  in fact https://review.opendev.org/678273/ was proposed as a solution I belived, based on 660856 discussions.18:41
fungiaside from the choice to use non-ascii operators, my biggest gripe with dhall is that the underlying premise for it is how much the authors dislike yaml (so not that dissimilar from toml, except the authors haven't actually said they designed it because the yaml spec was too long to read)18:42
tristanCfungi: the non-ascii version of the operators are being replaced to their ascii equivalent. And I don't think it's much about yaml dislike per-se, but it's more about being able to program the configuration with functions and remove repetitivness18:46
tristanCfungi: here is another example to generate test matrix: https://github.com/dhall-lang/dhall-lang/blob/18842b0f5e2f69faff6453b9109b97cec374dc1c/docs/tutorials/string-matrix.md18:51
fungii dunno, the dhall documentation talks about how easy it is to make errors in yaml rathre than focusing on how easy it isn't to make errors in dhall18:57
corvustristanC: the zuul yaml configuration language was explicitly designed to avoid needing a metalanguage.  class inheritance was designed to replace all the misfeatures we discovered in jjb.  if there's a problem with it, i'd like to fix it, not add a second, more complex language for users to learn.19:05
tristanCcorvus: managing job matrix such [py-version, test-scenario, backend, base-os] can be very verbose and hard to maintain19:09
tristanCand it would be nice to be able to list those elements, and have the system figure out and run the resulting jobs combinaison19:11
* fungi is reminded of generators in bind's configuration language19:15
tristanCas another datapoint, shippable implement this matrix structure: https://github.com/ansible/ansible/blob/devel/shippable.yml#L7  , which would be very verbose to express in zuul yaml19:16
tristanCand i find it interesting that with dhall, we wouldn't have to change zuul model or add such 'matrix' contruct19:17
tristanCi do get that's a new language to learn, which is why i said 'distant future'. Nevertheless i figure you might find it interesting :)19:29
fungithe most compelling reason i can see for sticking with yaml in zuul is that jobs are written in ansible which also uses yaml19:48
pabelanger+119:51
corvustristanC: i appreciate the exploration and you sharing it, thanks :)20:02
*** michael-beaver has joined #zuul20:02
*** tosky has quit IRC20:27
openstackgerritTristan Cacqueray proposed zuul/zuul master: prometheus: add options to start the server and process collector  https://review.opendev.org/59920920:34
*** openstackgerrit has quit IRC20:35
*** igordc has quit IRC20:50
*** igordc has joined #zuul21:15
*** openstackgerrit has joined #zuul21:44
openstackgerritTristan Cacqueray proposed zuul/zuul master: prometheus: add options to start the server and process collector  https://review.opendev.org/59920921:44
*** jamesmcarthur has joined #zuul21:48
*** pcaruana has quit IRC22:33
*** jamesmcarthur has quit IRC22:42
openstackgerritDavid Moreau Simard proposed zuul/zuul-jobs master: DNM: test ara-report role using ara>1.0  https://review.opendev.org/69510722:43
*** tosky has joined #zuul23:24
*** tosky has quit IRC23:26
« Monday, 2019-11-18 Index Wednesday, 2019-11-20 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!