Friday, 2016-05-13

*** salv-orlando has quit IRC00:00
*** asettle has quit IRC00:01
openstackgerritJohn L. Villalovos proposed openstack-infra/puppet-gerrit: Change line lengths for commit message warnings  https://review.openstack.org/31581400:03
jlvillalzaro: clarkb ^^^  Not sure if that is the correct place for it. But it was my best guess :)00:04
*** sridhar_ram has quit IRC00:07
openstackgerritJoshua Harlow proposed openstack/requirements: Add pydotplus for usage during testing  https://review.openstack.org/29787700:07
ianwpabelanger: minor, but we should be able to cleanup the logs for wheel builds with -> https://review.openstack.org/29684100:07
*** mahatic has quit IRC00:08
openstackgerritJoshua Harlow proposed openstack/requirements: Add pydotplus for usage during testing  https://review.openstack.org/29787700:08
jesusaurclarkb: ack, would you like to send that or should i?00:09
*** mahatic has joined #openstack-infra00:09
openstackgerritMerged openstack/requirements: Add semi-colon as separator for parsing package names  https://review.openstack.org/31368600:11
*** ccamacho has quit IRC00:15
*** Sukhdev has joined #openstack-infra00:16
*** amitgandhinz has joined #openstack-infra00:19
*** ayoung has joined #openstack-infra00:20
*** sflanigan has joined #openstack-infra00:21
*** Jeffrey4l has joined #openstack-infra00:22
*** tqtran has quit IRC00:22
*** mahatic has quit IRC00:22
*** rcernin has quit IRC00:24
*** mahatic has joined #openstack-infra00:24
openstackgerritMerged openstack/requirements: Remove ironic-discoverd from requirements  https://review.openstack.org/30968000:25
pabelangerjeblair: success! http://paste.openstack.org/show/497001/00:25
pabelangerjeblair: Finally figured out my issue, my (shell) builder failing because of a path issue.00:26
*** jamesmcarthur has joined #openstack-infra00:27
*** markvoelker has joined #openstack-infra00:27
*** ffrank has quit IRC00:28
clarkbjesusaur: I think you can since you did most of the work and deserve credit00:28
*** psilvad has joined #openstack-infra00:29
fungijeblair: ooh, i didn't pay attention to the fact that the depends-on of 315681 was in the same repo, since that's somewhat nonsensical. i'll be on the lookout for that in the future00:32
*** jamesmcarthur has quit IRC00:32
fungidansmith: i guess the lesson there is to avoid using depends-on in place of an actual git parentage when it's on the same repo00:33
*** sdake has quit IRC00:33
dansmithfungi: it's more complicated than that.. I was trying to work on two things in parallel that had a db migration, keeping them non-overlapping, etc00:33
dansmithfungi: but yeah, a failure vector to remember00:33
openstackgerritTony Breeds proposed openstack-infra/irc-meetings: Update nova team meeting chair.  https://review.openstack.org/31582000:33
*** pkoniszewski has quit IRC00:33
*** markvoelker has quit IRC00:34
*** nijaba has quit IRC00:34
fungidansmith: yeah, had i realized that was the case i would have done the same as jeblair and checked to see whether there was a merge conflict hiding in between them00:34
*** nijaba has joined #openstack-infra00:35
fungihe is more observant than i00:35
dansmithfungi: ah, well, sorry about that :)00:35
*** SumitNaiksatam has joined #openstack-infra00:35
fungino need to apologize, i'm just glad that was a case of things working as designed00:36
*** pkoniszewski has joined #openstack-infra00:36
fungithanks, jeblair!00:36
openstackgerritMerged openstack-infra/project-config: Remove openstack/requirements from #-infra  https://review.openstack.org/31579800:37
openstackgerritMerged openstack/diskimage-builder: Add some output to dib-lint  https://review.openstack.org/30922000:38
*** bpokorny has quit IRC00:38
pabelangerjeblair: I have left comments on https://review.openstack.org/#/c/309221/7 for some suggestions00:39
openstackgerritOpenStack Proposal Bot proposed openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/31372100:39
pabelangerianw: okay, I'll check them out in the morning00:39
ianwpabelanger: cool ... no movement on the bandersnatch stuff ATM, but it seems the redirect is hanging in there for the moment00:40
openstackgerritMerged openstack/diskimage-builder: Split YAML & JSON parsing  https://review.openstack.org/30923400:42
pabelangerianw: Ya, I seen some talk about it today, but didn't follow it00:45
*** Qiming_ has quit IRC00:48
*** pvaneck has quit IRC00:49
*** kjorgensen has quit IRC00:49
*** cody-somerville has joined #openstack-infra00:50
openstackgerritMerged openstack-infra/irc-meetings: Update nova team meeting chair.  https://review.openstack.org/31582000:51
*** kjorgensen has joined #openstack-infra00:51
*** mixos has joined #openstack-infra00:52
openstackgerritMerged openstack-infra/irc-meetings: Moving meetings from odd weeks to even  https://review.openstack.org/31577100:53
*** rfolco has quit IRC00:54
*** kjorgensen has quit IRC00:56
*** kjorgensen has joined #openstack-infra00:59
*** Douhet has quit IRC00:59
*** mixos has quit IRC00:59
openstackgerritMerged openstack-infra/irc-meetings: Move the agenda for routed networks meeting to etherpad  https://review.openstack.org/31567401:00
*** asselin has joined #openstack-infra01:02
*** openstackgerrit has quit IRC01:02
*** openstackgerrit has joined #openstack-infra01:03
*** kjorgensen has quit IRC01:03
openstackgerritMerged openstack/diskimage-builder: Fix up EPEL element  https://review.openstack.org/30621301:04
openstackgerritMerged openstack/diskimage-builder: yum-minimal: strip locale archive  https://review.openstack.org/30439901:04
openstackgerritMerged openstack/diskimage-builder: yum-minimal : better cleanup of initial yum failure  https://review.openstack.org/30807701:04
*** zhurong has joined #openstack-infra01:05
*** mixos has joined #openstack-infra01:05
*** mtanino has quit IRC01:05
*** brucet_ has quit IRC01:09
*** gildub has quit IRC01:09
*** brucet has joined #openstack-infra01:09
*** hongbin has joined #openstack-infra01:11
*** apoorvad has quit IRC01:12
*** chlong has joined #openstack-infra01:13
*** hongbin has left #openstack-infra01:14
*** SumitNaiksatam has left #openstack-infra01:18
cloudnullkevinbenton: sorry was AFK -- I hope you get the message later.01:19
*** apoorvad has joined #openstack-infra01:19
*** ddieterly has joined #openstack-infra01:19
cloudnullSo when I see the duplicate return IDs I do do _NOT_ see duplicate FIP ids when I run ``neutron floatingip-list``01:21
*** brucet has quit IRC01:21
cloudnullHere is a paste of my last run http://cdn.pasteraw.com/4agsyj14165gl30n3ln0kxim6ed8ef701:21
*** brucet has joined #openstack-infra01:21
openstackgerritIan Wienand proposed openstack/diskimage-builder: tests/elements/fake-os: add '/tmp' as top level dir  https://review.openstack.org/31366001:22
cloudnullfrom what I'm seeing on the last run I have 5 different IP addresses all using the same ID.01:22
*** fedexo has joined #openstack-infra01:23
cloudnulland in the list of returned data the FIP that ack'd first was the one that got assigned.01:23
cloudnullI'm testing shade from master.01:23
kevinbentoncloudnull: ack. i'm suspicious that something is being mangled maybe in the neutron client01:27
*** netsin has joined #openstack-infra01:28
cloudnullso i've got shade in a venv, if you want me to test a differnt version of some combination of patches let me know.01:28
*** camunoz has quit IRC01:28
cloudnullmy version right now is 4.2.001:28
ianwhttps://review.openstack.org/#/c/311591 is a little to close to https://xkcd.com/1654/01:28
*** markvoelker has joined #openstack-infra01:29
cloudnullROFL . prometheanfire :P01:29
kevinbentoncloudnull: can you apply a quick change that would always force a new client?01:30
*** alex_xu_ has joined #openstack-infra01:30
kevinbentoncloudnull: change this method to just always return self._get_client(...01:31
kevinbentoncloudnull: https://github.com/openstack-infra/shade/blob/master/shade/openstackcloud.py#L86101:31
*** chlong has quit IRC01:31
*** kjorgensen has joined #openstack-infra01:32
*** markvoelker has quit IRC01:34
*** netsin has quit IRC01:34
*** jiggalator has quit IRC01:34
cloudnullsure thing01:35
cloudnulljust a sec01:35
*** kjorgensen has quit IRC01:35
*** rfolco has joined #openstack-infra01:36
*** mriedem has quit IRC01:37
cloudnulltest running now01:38
cloudnullno joy01:39
prometheanfirecloudnull: ?01:39
cloudnull[20:28] <ianw> https://review.openstack.org/#/c/311591 is a little to close to https://xkcd.com/1654/01:40
prometheanfireI know what that is without opening it01:40
prometheanfirewe need to add arch, and fedora's new package manager01:40
cloudnullkevinbenton: its the same sadly.01:42
*** roxanagh_ has joined #openstack-infra01:44
*** roxanagh_ has quit IRC01:44
*** gildub has joined #openstack-infra01:45
*** tphummel has quit IRC01:47
cloudnullkevinbenton: i have a diff i slammed together to see if I can make shade track the FIP instead of scraping the nova instance data. http://cdn.pasteraw.com/8k1culp91bdmway0itl1fwsi2l242zi -- its still return the duplicate FIP but may help ?01:47
cloudnullit seems to be working faster with that , but its the same result in the end.01:48
cloudnullI tested it with shade using the client return change, shade + that patch,  and shade from master all the same result01:49
* cloudnull is out01:51
cloudnullhave a good one . back at it in the morrow.01:51
prometheanfirecloudnull: cya01:51
*** ccamacho has joined #openstack-infra01:52
openstackgerritIan Wienand proposed openstack/diskimage-builder: Add install-bin element  https://review.openstack.org/31164601:53
*** anteaya has quit IRC01:53
openstackgerritMerged openstack/diskimage-builder: Install proliantutils in IPA's virtualenv  https://review.openstack.org/29911601:54
*** yamamot__ has joined #openstack-infra01:54
*** thorst_ has joined #openstack-infra01:56
*** morgan is now known as notmorgan01:57
*** Qiming_ has joined #openstack-infra01:57
*** ccamacho has quit IRC01:58
*** ccamacho has joined #openstack-infra02:00
*** thorst_ has quit IRC02:01
*** savihou has quit IRC02:04
*** thorst_ has joined #openstack-infra02:05
*** savihou has joined #openstack-infra02:05
*** regXboi has joined #openstack-infra02:07
*** yamahata has quit IRC02:08
*** jvrbanac has quit IRC02:08
*** rhallisey has quit IRC02:09
openstackgerritMerged openstack/diskimage-builder: Updated from global requirements  https://review.openstack.org/31372102:11
*** regXboi has quit IRC02:11
*** bryan_att has quit IRC02:13
*** jvrbanac has joined #openstack-infra02:14
*** regXboi has joined #openstack-infra02:14
*** bradm has quit IRC02:15
*** rfolco has quit IRC02:15
openstackgerritMerged openstack/diskimage-builder: tests/elements/fake-os: add '/tmp' as top level dir  https://review.openstack.org/31366002:17
kevinbentonmordred: you around?02:19
*** kengo_sakai has joined #openstack-infra02:19
*** kengo_sakai has quit IRC02:19
*** salv-orlando has joined #openstack-infra02:22
*** apoorvad has quit IRC02:22
openstackgerritMorgan Fainberg proposed openstack-infra/project-config: Add requirements check to ldappool  https://review.openstack.org/31584302:23
*** bradm has joined #openstack-infra02:23
*** salv-orlando has quit IRC02:27
*** markvoelker has joined #openstack-infra02:30
*** ccamacho has quit IRC02:30
*** ccamacho has joined #openstack-infra02:31
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Fix invalid time data format in get_test_counts_in_date_range()  https://review.openstack.org/31584502:33
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Fix invalid time data format in get_test_counts_in_date_range()  https://review.openstack.org/31584502:34
*** markvoelker has quit IRC02:34
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: New CI job for requirements repo  https://review.openstack.org/31558402:36
*** slaweq has quit IRC02:39
*** amitgandhinz has quit IRC02:43
*** brucet has quit IRC02:47
*** hongbin has joined #openstack-infra02:49
*** regXboi has quit IRC02:50
hongbinyolanda: clarkb; there?02:52
*** mtanino has joined #openstack-infra02:53
hongbinHi, I am going to start a meeting in 5 minutes, but I found that the meetbot is not setup in channel #openstack-higgins yet02:53
hongbinCould anyone setup the meetbot in minutes, or we can use other channel intead?02:54
*** camunoz has joined #openstack-infra02:54
*** ddieterly is now known as ddieterly[away]02:55
*** harlowja_at_home has joined #openstack-infra02:56
openstackgerritMerged openstack/diskimage-builder: Add install-bin element  https://review.openstack.org/31164603:00
*** chlong has joined #openstack-infra03:08
*** zz_dimtruck is now known as dimtruck03:14
*** ddieterly[away] is now known as ddieterly03:14
*** sflanigan is now known as sflanigan_afk03:15
openstackgerritMerged openstack/diskimage-builder: Add test dependency installation on Gentoo  https://review.openstack.org/31159103:18
openstackgerritMerged openstack/diskimage-builder: Add EPEL as requirement of centos-minimal  https://review.openstack.org/30622003:18
*** ddieterly is now known as ddieterly[away]03:20
*** ddieterly[away] is now known as ddieterly03:20
*** ddieterly is now known as ddieterly[away]03:21
*** mixos has quit IRC03:21
*** mixos has joined #openstack-infra03:21
*** rlandy has quit IRC03:25
*** sflanigan_afk is now known as sflanigan03:29
*** markvoelker has joined #openstack-infra03:31
*** kjorgensen has joined #openstack-infra03:34
*** markvoelker has quit IRC03:35
openstackgerritMatthew Thode proposed openstack-infra/project-config: [WIP] Add gentoo support to nodepool  https://review.openstack.org/31086503:36
prometheanfireianw: is there a way to add another distro without adding support for it into devstack?03:38
*** kjorgensen has quit IRC03:38
prometheanfirebecause I don't want devstack03:39
ianwprometheanfire: i'm sorry, i don't understand what you mean.  you're trying to get gentoo nodes registered for running tests in openstack ci?03:41
prometheanfireianw: for a particualr project that doesn't use devstack03:41
prometheanfireyes03:41
prometheanfirehttps://review.openstack.org/#/c/307157/ for instance for it's jobs03:42
ianwprometheanfire: well devstack isn't involved in that at all03:43
prometheanfireor is it 'its''03:43
ianwprometheanfire: you want to start in project-config:nodepool/nodepool.yaml03:43
prometheanfireya, so can I skip it until someone complains/doesthework?03:43
ianwsince dib can build the gentoo images, you can propose another dib build to create gentoo images03:43
prometheanfirethe disimages section?03:44
prometheanfirethe diskimages section?03:44
ianwyes, but you're starting down a road a lot less travelled.  you would not ,presumably, want the node-devstack element03:44
prometheanfireright03:45
ianwprobably, none of the puppet is going to work, and that does stuff like sets up keys03:45
prometheanfirethat's where the hangup was iirc03:45
prometheanfirewell, puppet should work with my patch I think03:45
prometheanfirehttps://review.openstack.org/31086503:45
ianwno, not those bits, all the actual puppet03:45
ianwmanifests in the varioius projects we bring in03:46
prometheanfirepuppet-agent?03:46
prometheanfirewhich element would that be?03:46
ianwi have pretty much written a blog post on this03:46
ianwhttps://www.technovelty.org/openstack/platform-bootstrap-for-openstack-infrastructure.html03:46
ianwalthough there's going to be a lot of differences for gentoo03:47
prometheanfirenot as many as you'd think :P03:47
*** tqtran has joined #openstack-infra03:47
ianwi think for something usable, you'd need simple-init openstack-repos puppet nodepool-base03:47
ianwthat should probably get the image up enough that it can be registered to jenkins and be used for tests03:48
prometheanfire/opt/build_git/openstack-infra/system-config/install_puppet.sh might need some tweaking03:48
*** tqtran has quit IRC03:48
prometheanfireya, that's what I was thinking03:48
ianwit's more the modules we bring in modules.env that will need work i think03:49
prometheanfireso it's the install_puppet.sh and install_modules.sh that I need to worry about03:50
ianwwell, that's where to start03:51
openstackgerritMatthew Thode proposed openstack-infra/project-config: [WIP] Add gentoo support to nodepool  https://review.openstack.org/31086503:52
prometheanfireupdated to remove nodepool-devstack stuff03:53
*** jamielennox is now known as jamielennox|away03:58
openstackgerritMatthew Thode proposed openstack-infra/project-config: Build Gentoo image for basic testing in OSA  https://review.openstack.org/31586503:59
*** asettle has joined #openstack-infra04:01
prometheanfireianw: is there a specific version of puppet we use?04:02
*** jamielennox|away is now known as jamielennox04:03
prometheanfirecurrently we have these versions to choose from04:03
prometheanfire     Available versions:  3.7.3-r1 ~3.7.4-r3 ~3.8.1-r1 ~3.8.2 ~3.8.3 ~3.8.4 ~3.8.5 ~3.8.7 ~4.4.2^t {augeas diff doc emacs ldap minimal rrdtool selinux shadow sqlite test vim-syntax xemacs ELIBC="FreeBSD" RUBY_TARGETS="ruby19 ruby20 ruby21"}04:03
prometheanfirealthough I'd recommend puppet-agent, which is at 1.4.2 (based off puppet 4.4.2)04:03
prometheanfireif we can use puppet-404:03
ianwpromethanfire: we worked through the issues with puppet4 support for everything with fedora 23.  ergo, puppet 4 should work04:03
*** hongbin has quit IRC04:04
prometheanfireah, nice04:04
*** netsin has joined #openstack-infra04:05
*** jiggalator has joined #openstack-infra04:05
prometheanfireI'll have it install puppet-agent then, as that's better supported/tested (by me even lol)04:05
prometheanfirehelps to maintain both puppet and openstack :D04:05
ianwprometheanfire: it is probably worth your time creating a spec for this, and raising it at the meeting and getting comments from those you're going to want reviewing changes.  another platform is a non-trivial maintenance point so ensuring people know the big picture will help04:07
*** asettle has quit IRC04:07
*** ayoung has quit IRC04:07
prometheanfireinfra meeting I imagine?04:09
prometheanfireI thought it was known this was the goal all along?04:09
prometheanfireas for the puppet modules, they may or may not need work, but installing them should work just fine04:12
openstackgerritMatthew Thode proposed openstack-infra/system-config: Add Gentoo to install_puppet.sh  https://review.openstack.org/31586904:12
crinklethis would be the first time we'd be using puppet-agent, since all of our stuff is on puppet 3 except for fedora, and on fedora we're using the fedora puppet packages04:12
crinkleso there might be some weirdness04:13
crinklebut then we'll be way closer to getting everything on puppet 4 :D04:13
prometheanfirewell, if fedora is already doing it I'd just be following in their footsteps04:14
prometheanfireI've some experience with puppet.  Gentoo infra (of which I'm a member) uses it extensivly.04:15
prometheanfirejust wish we could move off cfengine faster04:15
crinklefedora isn't installing puppet-agent, they're just using the fedora packages which keeps everything un-bundled04:15
prometheanfireso if any modules need tweaking for puppet4 I could probably help04:15
prometheanfireah04:15
prometheanfirewell, puppet-agent in gentoo is bundled, but it's also packaged (by me)04:16
prometheanfireit's marked stable if that helps :P04:16
tonybAre there know DNS/networkign issues that woudl result in: Could not resolve host: zm03.openstack.org'04:16
tonybor shoudl I just recheck my recheck?04:16
prometheanfireI could just as easilly install puppet from app-admin/puppet instead of app-admin/puppet-agent04:16
prometheanfireI chose puppet-agent as that's more maintained04:17
prometheanfireianw: I'm guessing https://wiki.openstack.org/wiki/Meetings/InfraTeamMeeting is up to date04:18
ianwprometheanfire: you can do whatever you want.  my advice though would be to use tools like the spec review process to bring people onboard with your goals, and you'll probably find that they're much more responsive to reviews04:19
*** mtanino has quit IRC04:19
*** thorst__ has joined #openstack-infra04:19
*** psachin has joined #openstack-infra04:20
prometheanfireianw: I just wanted to confirm the meeting time04:20
*** ccamacho has quit IRC04:20
prometheanfireI'd bring up making a spec and do so if people are receptive04:20
ianwthat is the meeting time04:20
*** ddieterly[away] has quit IRC04:20
*** thorst_ has quit IRC04:21
*** links has joined #openstack-infra04:23
*** fedexo has quit IRC04:24
prometheanfireok, reminder set04:24
*** doug-fish has joined #openstack-infra04:25
prometheanfireianw: only need one thing to merge before I can start building images then https://review.openstack.org/#/c/315869/04:25
prometheanfireianw: thanks for walking me through it, I'll be going though your blog post tomorrow04:28
prometheanfireianw: I was actually preparing my own blog post about this because I couldn't find anything04:28
ianwpromethanfire: you should be able to do basically all the bringup locally on a trusty vm04:29
ianwwhen we're at the point that we can make .qcow2 images, we can do some manual uploads to clouds for sanity checking04:29
*** doug-fish has quit IRC04:29
prometheanfireok04:30
prometheanfirethen just need https://review.openstack.org/#/c/315869/ and https://review.openstack.org/#/c/310865/04:30
*** markvoelker has joined #openstack-infra04:31
ianwprometheanfire: well, you'd be better applying those locally, they don't really need to be merged.04:32
ianwit's going to be more convincing to merge stuff like that if you've got logs showing that it's all working04:32
prometheanfireianw: ah, that's right I need devstack support because openstack-repos depends on devstack04:32
prometheanfirewhich is annoying04:32
prometheanfirereally annoying04:32
ianwthat is probably just for caching images04:32
prometheanfireit's in the element-deps04:33
ianwyes, but i mean why it's there is to cache the iso images, which it gets a list from devstack.  it's probably appropriate to split that out04:33
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Fix invalid time data format in get_test_counts_in_date_range()  https://review.openstack.org/31584504:33
prometheanfireappropriate to remove cache-devstack as a dep of openstack-repos?04:34
ianwprobably, the caching of images for devstack runs is probably orthogonal to caching the repos really04:35
prometheanfirethat's what I was hoping04:35
*** asilenkov_ has joined #openstack-infra04:35
ianwthis is the type of thing that will require some more thought ... there might be another dependency there i'm missing04:35
prometheanfireI guess I'll cross that bridge when I come to it04:35
prometheanfireianw: you added it :P04:36
prometheanfire6cab81fec4bc686b1f4ee58f56f890ef40d6851704:36
prometheanfirethree weeks ago04:36
*** markvoelker has quit IRC04:37
ianwyes, IIRC it was a dependency that wasn't expressed correctly04:37
prometheanfirethe jenkins user should probably be done somewhere else then04:37
ianwbut that doesn't mean the dependency *has* to be there, just that it is ATM04:38
prometheanfireright04:38
prometheanfireanyway, I'll leave things as they are until the meeting, from which I'll move and do whatever is needed04:38
openstackgerritMasayuki Igawa proposed openstack-infra/subunit2sql: Fix invalid time data format in get_test_counts_in_date_range()  https://review.openstack.org/31584504:40
*** hichihara has joined #openstack-infra04:41
*** amitgandhinz has joined #openstack-infra04:44
*** ccamacho has joined #openstack-infra04:46
*** amitgandhinz has quit IRC04:49
openstackgerritMasayuki Igawa proposed openstack/os-testr: Add whitelist file to ostestr docs  https://review.openstack.org/31477504:50
*** thorst__ has quit IRC04:50
*** thorst_ has joined #openstack-infra04:51
*** yamamot__ has quit IRC04:51
*** yamamot__ has joined #openstack-infra04:52
*** ccamacho has quit IRC04:53
*** thorst__ has joined #openstack-infra04:56
*** thorst___ has joined #openstack-infra04:59
*** thorst_ has quit IRC04:59
*** thorst_ has joined #openstack-infra05:00
*** thorst__ has quit IRC05:01
*** thorst__ has joined #openstack-infra05:02
*** thors____ has joined #openstack-infra05:03
*** thorst___ has quit IRC05:03
*** cody-somerville has quit IRC05:04
*** thorst_ has quit IRC05:05
*** sdake has joined #openstack-infra05:05
*** thorst__ has quit IRC05:07
*** thors____ has quit IRC05:07
*** thorst_ has joined #openstack-infra05:08
*** thorst__ has joined #openstack-infra05:09
*** thorst___ has joined #openstack-infra05:10
*** hferenc has quit IRC05:11
*** thors____ has joined #openstack-infra05:12
*** asettle has joined #openstack-infra05:12
*** thorst_ has quit IRC05:13
*** thorst_ has joined #openstack-infra05:13
*** thorst__ has quit IRC05:14
*** thorst___ has quit IRC05:15
*** thorst__ has joined #openstack-infra05:15
*** thors____ has quit IRC05:17
*** camunoz has quit IRC05:17
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Adding library Delimiter to the CI system  https://review.openstack.org/31523205:17
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add #openstack-quota to the IRC channels  https://review.openstack.org/31575905:17
*** asettle has quit IRC05:17
*** thorst_ has quit IRC05:18
*** thorst_ has joined #openstack-infra05:18
*** hamzy has joined #openstack-infra05:19
openstackgerritAndreas Jaeger proposed openstack-infra/project-config: Add oslo.tools repo/project  https://review.openstack.org/31434205:20
*** salv-orlando has joined #openstack-infra05:20
*** thorst__ has quit IRC05:20
*** jaosorior has joined #openstack-infra05:21
*** gildub has quit IRC05:21
*** ccamacho has joined #openstack-infra05:22
*** thorst_ has quit IRC05:22
*** amotoki has quit IRC05:23
*** thorst_ has joined #openstack-infra05:24
*** dimtruck is now known as zz_dimtruck05:24
*** salv-orlando has quit IRC05:25
*** sdake has quit IRC05:26
*** asilenkov_ has quit IRC05:26
*** sdake has joined #openstack-infra05:28
*** chlong has quit IRC05:29
*** gildub has joined #openstack-infra05:30
*** thorst_ has quit IRC05:32
*** markvoelker has joined #openstack-infra05:32
*** sdake has quit IRC05:33
*** harlowja_at_home has quit IRC05:34
*** thorst_ has joined #openstack-infra05:34
*** markvoelker has quit IRC05:37
*** salv-orlando has joined #openstack-infra05:37
*** thorst_ has quit IRC05:39
*** ccamacho has quit IRC05:39
*** netsin has quit IRC05:42
*** jiggalator has quit IRC05:42
*** gildub has quit IRC05:43
*** amitgandhinz has joined #openstack-infra05:45
*** eliqiao has quit IRC05:45
*** ccamacho has joined #openstack-infra05:47
openstackgerritRyo Tagami proposed openstack-infra/jenkins-job-builder: Adding support for Jenkins OpenStack Cloud Plugin  https://review.openstack.org/30694805:49
*** amitgandhinz has quit IRC05:49
*** rcernin has joined #openstack-infra05:50
*** andymaier has joined #openstack-infra05:51
openstackgerritRyo Tagami proposed openstack-infra/jenkins-job-builder: Adding support for Jenkins OpenStack Cloud Plugin  https://review.openstack.org/30694805:52
*** amotoki has joined #openstack-infra05:52
*** eliqiao has joined #openstack-infra05:52
*** jamielennox is now known as jamielennox|away05:56
*** thorst_ has joined #openstack-infra05:56
*** yamahata has joined #openstack-infra05:56
*** fedexo has joined #openstack-infra05:59
*** fedexo has quit IRC06:04
*** fedexo has joined #openstack-infra06:04
*** thorst_ has quit IRC06:05
*** cody-somerville has joined #openstack-infra06:05
openstackgerritOpenStack Proposal Bot proposed openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/31589806:07
*** ccamacho has quit IRC06:08
*** thorst_ has joined #openstack-infra06:08
*** jamielennox|away is now known as jamielennox06:10
*** thorst__ has joined #openstack-infra06:11
*** ccamacho has joined #openstack-infra06:12
*** thorst_ has quit IRC06:13
*** maishsk has joined #openstack-infra06:13
*** nadya has joined #openstack-infra06:13
*** e0ne has joined #openstack-infra06:15
*** nadya has quit IRC06:15
*** ccamacho has quit IRC06:16
*** thorst__ has quit IRC06:16
*** woodster_ has quit IRC06:18
*** salv-orlando has quit IRC06:22
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: DO NOT REVIEW  https://review.openstack.org/31549906:22
*** akaszuba has joined #openstack-infra06:24
*** ccamacho has joined #openstack-infra06:24
*** armax has quit IRC06:24
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Allow to set BUILD_TIMEOUT from the job  https://review.openstack.org/31549606:27
*** fedexo has quit IRC06:28
EmilienMgood morning, do we have an infra-root around?06:29
*** AJaeger has joined #openstack-infra06:29
AJaegerhongbin: Meeting should be done in one of the official channels, see http://docs.openstack.org/project-team-guide/open-community.html#public-meetings-on-irc06:31
EmilienMAJaeger: hey, good morning! are you infra-root?06:31
AJaegermorning, EmilienM06:31
AJaegerFortunately not ;)06:31
EmilienMdamn06:31
*** asettle has joined #openstack-infra06:31
EmilienMthe tripleo cloud is up again and zuul might need to be restarted06:31
AJaegerjhesketh and yolanda are the roots in current timezone06:31
EmilienMlet me check again what fungi said on the tripleo hw upgrade thread06:32
*** asettle has quit IRC06:33
*** markvoelker has joined #openstack-infra06:33
*** nadya has joined #openstack-infra06:34
EmilienMyolanda, jhesketh: hi, it seems that our tripleo cloud is up again, do you think we need to restart zuul or something?06:36
*** nadya has quit IRC06:36
EmilienMit seems like zuul does not schedule jobs to nodepool for tripleo CI06:36
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: DO NOT REVIEW  https://review.openstack.org/31549906:37
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Allow to set Ironic BUILD_TIMEOUT from the job  https://review.openstack.org/31549606:37
*** markvoelker has quit IRC06:38
*** andymaier has quit IRC06:41
openstackgerritMerged openstack-infra/project-config: Normalize projects.yaml  https://review.openstack.org/31589806:42
*** thorst_ has joined #openstack-infra06:45
*** aeng has quit IRC06:45
*** amitgandhinz has joined #openstack-infra06:46
*** javeriak has joined #openstack-infra06:46
*** amitgandhinz has quit IRC06:50
*** amotoki has quit IRC06:51
*** andreas_s has joined #openstack-infra06:52
*** thorst_ has quit IRC06:53
*** Sukhdev has quit IRC06:55
*** gildub has joined #openstack-infra06:55
*** tesseract has joined #openstack-infra06:56
*** hferenc has joined #openstack-infra06:57
*** psilvad has quit IRC06:58
*** asilenkov_ has joined #openstack-infra06:58
*** mixos has quit IRC06:59
*** mixos has joined #openstack-infra07:00
*** AJaeger has quit IRC07:00
*** salv-orlando has joined #openstack-infra07:01
*** amotoki has joined #openstack-infra07:01
pabelangerEmilienM: AJaeger: yes, we disabled it in nodepool.o.o yesterday. infact puppet is still disabled. Let me see if I can bring it back online and restart nodepool-builder07:01
*** amotoki has quit IRC07:01
EmilienMpabelanger: you don't sleep?07:02
EmilienMI'm glad you're here though. Thanks07:02
pabelangerEmilienM: just by chance07:02
EmilienMyeah, very lucky, merci07:02
*** arxcruz has joined #openstack-infra07:02
pabelanger#status log Removed nodepool.o.o from emergency file on puppetmaster.o.o07:03
openstackstatuspabelanger: finished logging07:03
*** amotoki has joined #openstack-infra07:07
*** amotoki has quit IRC07:07
*** mixos has quit IRC07:09
*** megm_ has quit IRC07:10
*** jeblair has quit IRC07:11
*** matrohon has joined #openstack-infra07:14
*** bauzas is now known as bauwser07:14
*** thorst_ has joined #openstack-infra07:15
*** vincentll has joined #openstack-infra07:15
*** megm has joined #openstack-infra07:15
*** sshnaidm has quit IRC07:16
*** pahuang has quit IRC07:17
*** amotoki has joined #openstack-infra07:17
*** jeblair has joined #openstack-infra07:18
*** megm has quit IRC07:19
*** fawadkhaliq has joined #openstack-infra07:20
*** megm has joined #openstack-infra07:20
*** zhurong has quit IRC07:20
openstackgerritMatthew Oliver proposed openstack/gertty: Make unified diffs group changed lines  https://review.openstack.org/31592707:22
*** zhurong has joined #openstack-infra07:23
*** sshnaidm has joined #openstack-infra07:24
*** thorst_ has quit IRC07:24
*** maishsk has quit IRC07:25
pabelangerianw: not today, but you think we can tag diskimage-builder soon? Would love to pick up the locale fixes07:25
*** maishsk has joined #openstack-infra07:25
*** dtardivel has joined #openstack-infra07:26
*** esikachev has joined #openstack-infra07:27
openstackgerritMatthew Oliver proposed openstack/gertty: Make unified diffs group changed lines  https://review.openstack.org/31592707:28
*** mikelk has joined #openstack-infra07:28
openstackgerritAndreas Florath proposed openstack/diskimage-builder: Fix apt-sources configuration for debian-minimal  https://review.openstack.org/31526507:28
*** jlanoux has joined #openstack-infra07:32
*** markvoelker has joined #openstack-infra07:34
openstackgerritMatthew Oliver proposed openstack/gertty: Make unified diffs group changed lines  https://review.openstack.org/31592707:35
*** shardy has joined #openstack-infra07:36
*** markvoelker has quit IRC07:39
*** maishsk_ has joined #openstack-infra07:39
*** kzaitsev_mb has joined #openstack-infra07:40
*** maishsk has quit IRC07:41
*** maishsk_ is now known as maishsk07:41
*** gildub has quit IRC07:42
*** hparekh has quit IRC07:42
*** jcoufal has joined #openstack-infra07:44
*** cody-somerville has quit IRC07:46
*** amitgandhinz has joined #openstack-infra07:46
*** nadya has joined #openstack-infra07:47
*** amitgandhinz has quit IRC07:52
*** frickler has quit IRC07:54
*** Mmike has quit IRC07:54
*** tdasilva has quit IRC07:54
openstackgerritAlexey Stepanov proposed openstack-infra/project-config: fuel-devops: Add nonvoting pylint job  https://review.openstack.org/31594807:55
*** hparekh has joined #openstack-infra07:55
*** hashar has joined #openstack-infra07:59
*** zzzeek has quit IRC08:00
*** kushal has joined #openstack-infra08:01
*** zzzeek has joined #openstack-infra08:02
*** Mmike has joined #openstack-infra08:02
*** Mmike has quit IRC08:03
*** Mmike has joined #openstack-infra08:03
openstackgerritAlexey Stepanov proposed openstack-infra/project-config: fuel-devops: Add nonvoting pylint job  https://review.openstack.org/31594808:05
*** slaweq has joined #openstack-infra08:05
*** nkinder has quit IRC08:06
*** salv-orlando has quit IRC08:06
*** sflanigan has quit IRC08:07
*** tdasilva has joined #openstack-infra08:09
*** binbincong has quit IRC08:12
*** sree has joined #openstack-infra08:13
*** nadya has quit IRC08:13
*** HeOS has joined #openstack-infra08:16
*** binbincong has joined #openstack-infra08:18
*** andymaier has joined #openstack-infra08:19
*** schipiga has joined #openstack-infra08:22
*** thorst_ has joined #openstack-infra08:22
schipigaHello, all! Is it possible to install ffmpeg for horizon selenium tests. I'm going to record video for failed tests.08:23
*** zeih has joined #openstack-infra08:28
*** thorst_ has quit IRC08:29
*** kzaitsev_mb has quit IRC08:29
*** kzaitsev_mb has joined #openstack-infra08:31
*** lucas-dinner is now known as lucasagomes08:31
pabelanger#status log tripleo-test-cloud-rh1 added back to nodepool.o.o however having currently having issues launching tripleo-f22 nodes. TripleO CI team should be looking into it08:32
openstackstatuspabelanger: finished logging08:32
*** eliqiao has quit IRC08:32
*** alex_xu_ has quit IRC08:33
*** eliqiao has joined #openstack-infra08:33
*** ramishra has quit IRC08:34
*** markvoelker has joined #openstack-infra08:35
*** alex_xu has joined #openstack-infra08:37
*** markvoelker has quit IRC08:39
*** kzaitsev_mb has quit IRC08:41
*** duobei has joined #openstack-infra08:41
*** mhickey has joined #openstack-infra08:42
*** timrc has quit IRC08:43
openstackgerritMerged openstack-infra/project-config: Add functional test job for python-brick-cinderclient-ext  https://review.openstack.org/26592508:43
*** timrc has joined #openstack-infra08:46
*** jtomasek_ has joined #openstack-infra08:46
*** jistr has joined #openstack-infra08:46
*** frickler has joined #openstack-infra08:47
*** ccamacho has quit IRC08:47
*** amitgandhinz has joined #openstack-infra08:49
*** salv-orlando has joined #openstack-infra08:49
*** duobei has quit IRC08:51
*** jtomasek_ has quit IRC08:51
*** e0ne has quit IRC08:52
*** ccamacho has joined #openstack-infra08:53
*** amitgandhinz has quit IRC08:53
*** vkramskikh_ has joined #openstack-infra08:53
openstackgerritJamie Lennox proposed openstack-infra/project-config: Revert "Revert "Actually use the service domain in V3 jobs""  https://review.openstack.org/31596909:00
pabelanger#status log tripleo-f22 nodes slowing coming online now in nodepool09:04
openstackstatuspabelanger: finished logging09:04
*** nadya has joined #openstack-infra09:05
openstackgerritJamie Lennox proposed openstack-infra/project-config: Revert "Revert "Actually use the service domain in V3 jobs""  https://review.openstack.org/31596909:05
*** electrofelix has joined #openstack-infra09:07
*** dmk0202 has joined #openstack-infra09:09
*** thorst_ has joined #openstack-infra09:12
*** esikachev has quit IRC09:16
*** javeriak has quit IRC09:17
*** nkinder has joined #openstack-infra09:17
*** thorst_ has quit IRC09:20
*** esikachev has joined #openstack-infra09:28
*** javeriak has joined #openstack-infra09:29
*** javeriak has quit IRC09:30
*** javeriak has joined #openstack-infra09:30
*** lewo has quit IRC09:33
*** e0ne has joined #openstack-infra09:33
*** markvoelker has joined #openstack-infra09:36
openstackgerritNikita Konovalov proposed openstack-infra/project-config: Enable api-ref jobs in Sahara  https://review.openstack.org/31548009:38
*** jcoufal has quit IRC09:39
*** asilenkov_ has quit IRC09:40
*** markvoelker has quit IRC09:40
*** asettle has joined #openstack-infra09:40
*** chem has joined #openstack-infra09:45
*** andymaier has quit IRC09:46
*** amitgandhinz has joined #openstack-infra09:49
*** sree has quit IRC09:53
*** amitgandhinz has quit IRC09:54
*** sree has joined #openstack-infra09:54
*** tosky has joined #openstack-infra09:55
*** _amrith_ is now known as amrith09:56
*** amotoki has quit IRC09:58
*** rcarrillocruz has quit IRC09:58
*** hichihara has quit IRC10:00
*** zhurong has quit IRC10:06
*** jlanoux_ has joined #openstack-infra10:07
*** e0ne has quit IRC10:07
*** mhickey has quit IRC10:09
*** jlanoux has quit IRC10:10
*** DevBox has joined #openstack-infra10:13
*** yamahata has quit IRC10:13
*** sdague has joined #openstack-infra10:14
*** amotoki has joined #openstack-infra10:18
*** matrohon has quit IRC10:18
*** slaweq has quit IRC10:18
*** thorst_ has joined #openstack-infra10:19
*** slaweq has joined #openstack-infra10:19
*** slaweq has quit IRC10:19
*** slaweq has joined #openstack-infra10:20
*** oanson has joined #openstack-infra10:20
*** d0ugal has quit IRC10:20
*** slaweq has quit IRC10:20
*** d0ugal has joined #openstack-infra10:21
*** amrith is now known as _amrith_10:22
sdaguejhesketh: you happen to still be awake?10:23
*** slaweq has joined #openstack-infra10:24
*** slaweq has quit IRC10:25
*** thorst_ has quit IRC10:26
*** slaweq has joined #openstack-infra10:26
*** apevec has joined #openstack-infra10:32
*** apevec has left #openstack-infra10:32
*** apevec has joined #openstack-infra10:33
*** apevec has left #openstack-infra10:33
*** jtomasek_ has joined #openstack-infra10:33
*** lewo has joined #openstack-infra10:35
*** amotoki has quit IRC10:36
*** markvoelker has joined #openstack-infra10:36
*** markvoelker has quit IRC10:41
*** jtomasek_ has quit IRC10:42
*** ociuhandu has joined #openstack-infra10:42
*** amotoki has joined #openstack-infra10:43
*** amotoki has quit IRC10:44
*** rcarrillocruz has joined #openstack-infra10:50
*** Qiming_ has quit IRC10:50
*** amitgandhinz has joined #openstack-infra10:50
*** amitgandhinz has quit IRC10:54
*** claudiub has joined #openstack-infra10:58
*** rcarrillocruz has quit IRC10:58
*** rcarrillocruz has joined #openstack-infra10:59
*** devananda has quit IRC11:03
*** baoli has joined #openstack-infra11:04
*** baoli has quit IRC11:09
*** Na3iL has joined #openstack-infra11:13
*** devananda has joined #openstack-infra11:14
*** thorst_ has joined #openstack-infra11:23
penguinologHello, could anybody help: https://review.openstack.org/#/c/296457/13 - what happens? recheck -> no job on zuul, +W was set yesterday11:24
*** maishsk_ has joined #openstack-infra11:26
rcarrillocruzpenguinolog: it seems your patch parent it has not merged yet11:27
rcarrillocruzTest cluster upscaling and downscaling with Ironic11:28
*** asilenkov_ has joined #openstack-infra11:28
penguinologrcarrillocruz, Shame on me! I've forgotten about it!11:28
*** maishsk has quit IRC11:28
*** maishsk_ is now known as maishsk11:28
rcarrillocruznp11:28
*** dprince has quit IRC11:29
d0ugalAnyone got a moment to review this requirements change? We have one +2 so far. https://review.openstack.org/#/c/314638/11:29
d0ugals/change/addition/11:29
*** jaosorior has quit IRC11:30
*** jaosorior has joined #openstack-infra11:30
penguinologcould somebody llok on https://review.openstack.org/#/c/315948/ - additional chacker for code11:30
*** tpsilva has joined #openstack-infra11:30
*** thorst_ has quit IRC11:31
openstackgerritvinay kumar muddu proposed openstack/diskimage-builder: Included "sudo" for devuser element  https://review.openstack.org/30874711:31
*** sree has quit IRC11:34
*** Qiming_ has joined #openstack-infra11:35
*** _amrith_ is now known as amrith11:36
*** zeih has quit IRC11:37
*** markvoelker has joined #openstack-infra11:37
*** jyuso1 has joined #openstack-infra11:39
*** markvoelker has quit IRC11:42
*** jyuso has quit IRC11:42
openstackgerritvinay kumar muddu proposed openstack/diskimage-builder: Included "sudo" for devuser element  https://review.openstack.org/30874711:42
*** derekh has joined #openstack-infra11:42
*** lucasagomes is now known as lucas-hungry11:45
*** baoli has joined #openstack-infra11:45
*** baoli has quit IRC11:47
*** baoli has joined #openstack-infra11:47
*** baoli_ has joined #openstack-infra11:48
*** vincentll has quit IRC11:49
BobBallpatrickeast: Any chance you can review https://review.openstack.org/#/c/278541/ and https://review.openstack.org/#/c/278537/ ? :) Have been open for a while but I think they are quite simple and not controversial11:49
*** weshay has joined #openstack-infra11:50
*** amitgandhinz has joined #openstack-infra11:51
*** rfolco has joined #openstack-infra11:51
*** baoli has quit IRC11:52
*** rodrigods has quit IRC11:52
*** rodrigods has joined #openstack-infra11:52
*** regXboi has joined #openstack-infra11:54
* regXboi wanders in with a question about what looks like pypy rot11:55
*** amitgandhinz has quit IRC11:55
zigoWhat does it mean when the gate replies "UNSTABLE" instead of faile/success? https://review.openstack.org/#/c/31560311:59
*** ldnunes has joined #openstack-infra12:02
*** rmoats has joined #openstack-infra12:03
*** regXboi has quit IRC12:03
*** rmoats is now known as regXboi12:03
regXboiiirc it usually means the job was stopped in the middle - do you have a pointer?12:05
*** psilvad has joined #openstack-infra12:05
*** andymaier has joined #openstack-infra12:05
*** hashar has quit IRC12:07
regXboigreetings all, it looks like pypy needs to be updated to 2.6 or later12:09
regXboithe update to cryptography 1.0 is breaking all the jobs that use pypy12:09
regXboiwith the following error:12:09
*** Douhet has joined #openstack-infra12:10
regXboiRuntimeError: cryptography 1.0 is not compatible with PyPy < 2.6. Please upgrade PyPy to use this library.12:10
*** javeriak has quit IRC12:10
regXboil.o.o shows 63 hits in the last 7 days across the spectrum of jobs using pypy.12:10
openstackgerritVasyl Saienko proposed openstack-infra/devstack-gate: Allow to set TEMPEST_OS_TEST_TIMEOUT for grenade jobs  https://review.openstack.org/31605512:11
*** Na3iL has quit IRC12:12
*** links has quit IRC12:14
*** darrenc_ has joined #openstack-infra12:17
*** clif_h has quit IRC12:17
*** jroll has quit IRC12:17
*** darrenc has quit IRC12:17
*** kgiusti has joined #openstack-infra12:18
regXboiis that something best fixed here or in the tempest *requirements.txt file?12:18
*** brucet has joined #openstack-infra12:19
*** chem has quit IRC12:19
*** yamamot__ has quit IRC12:20
*** aarefiev has quit IRC12:20
*** amotoki has joined #openstack-infra12:20
*** asselin__ has joined #openstack-infra12:20
*** aarefiev has joined #openstack-infra12:21
*** raildo-afk is now known as raildo12:22
*** jroll has joined #openstack-infra12:22
*** jroll has quit IRC12:22
*** jroll has joined #openstack-infra12:22
*** sree has joined #openstack-infra12:22
*** darrenc_ is now known as darrenc12:22
*** chem has joined #openstack-infra12:23
*** asselin has quit IRC12:23
*** brucet has quit IRC12:24
*** _ari_ has joined #openstack-infra12:27
*** shardy has quit IRC12:28
*** alaski is now known as lascii12:29
*** clif_h has joined #openstack-infra12:31
*** matrohon has joined #openstack-infra12:31
fricklerzigo: the post processing failed, see http://logs.openstack.org/03/315603/4/check/pkgdeb-build-openstack-pkg-tools/4ec6cd0/console.html#_2016-05-13_12_05_38_47812:31
zigofrickler: Ah, thanks.12:32
zigofrickler: So that's indeed a problem with the publish job that got merged.12:32
*** ddieterly has joined #openstack-infra12:32
zigoWhat I don't understand, is that the publish job shouldn't be started unless we merge the patch !12:33
zigofrickler: https://review.openstack.org/#/c/311190/12:33
zigoCould you guess what's wrong?12:33
*** dprince has joined #openstack-infra12:34
*** denisra has joined #openstack-infra12:37
fricklerzigo: you have defined the job for both check and gate. I think you would need to create a non-publishing job for the check queue. but I'm only an amateur at that, maybe some infra core has more insight12:37
*** cbader_ has joined #openstack-infra12:38
*** markvoelker has joined #openstack-infra12:38
*** matt-borland has joined #openstack-infra12:40
*** ddieterly is now known as ddieterly[away]12:40
*** mtanino has joined #openstack-infra12:41
*** Goneri has joined #openstack-infra12:41
*** rcernin_ has joined #openstack-infra12:42
*** rcernin has quit IRC12:42
*** markvoelker has quit IRC12:43
*** yamamoto has joined #openstack-infra12:43
*** thorst_ has joined #openstack-infra12:45
fungiregXboi: those jobs are running the pypy provided by ubuntu 14.04 lts. i guess any projects now pip installing cryptography (for example, because of paramiko 2.x) won't work with pypy on trusty. one option would be to switch all the pypy jobs to run on ubuntu 16.04 lts12:47
regXboifungi: I don't believe any of those jobs are voting...12:48
regXboiso I'm not 100% sure what the best way forward is12:48
regXboiI mean, we could try the pypy jobs on 16.04, but what else will break?12:48
*** rlandy has joined #openstack-infra12:49
*** paul-carlton2 has quit IRC12:49
fungisince they're non-voting, it's probably simple enough to try with no impact. the real issue is that we'll either need to cap requirements which have started pulling in cryptography on stable branches, or stop running pypy jobs for stable branch changes12:49
*** mtanino has quit IRC12:49
regXboifungi: that's a big ack and I don't have an answer for that either12:50
*** thorst_ has quit IRC12:50
fungithe plan is for master branches of everything to switch to testing on ubuntu 16.04 lts any day now12:50
regXboiI just ran across this yesterday and went looking how far the rot extended and ... well ... didn't like what I found :(12:50
fungiand not just for pypy jobs12:50
*** amitgandhinz has joined #openstack-infra12:51
regXboias far as the stable branch question, it's "above my pay grade" but my first reaction would be that since I don't think anybody is paying attention to those jobs, we could stop running them on stable branches12:52
fungianyway, a bunch of our projects started capping paramiko<2 because it also brings non-backward-compatible api changes in addition to its new dependency on cryptography. i think that's where a lot of this is probably stemming from12:53
*** lucas-hungry is now known as lucasagomes12:53
fungithere are quite a few projects using paramiko12:53
*** baumann has joined #openstack-infra12:54
regXboithere are, but there appear to also be some that are pulling crypto in directly12:54
fungii wonder if cryptography only recently stopped working on older pypy?12:54
regXboidunno12:55
*** andreas_s has quit IRC12:55
regXboiI just ask the innocent questions12:55
regXboiand then find I've kicked over a rock12:55
fungia rock with vipers nesting beneath, yes12:56
*** amitgandhinz has quit IRC12:57
fungihttps://cryptography.io/en/latest/changelog/#id1212:57
*** e0ne has joined #openstack-infra12:57
*** amitgandhinz has joined #openstack-infra12:57
fungiso it's been that way for 8 months, since the 1.0.1 release12:57
regXboimeh...12:58
* regXboi quotes "asps... very dangerous.... you go first"12:58
*** ddieterly[away] is now known as ddieterly12:58
*** larainema has quit IRC13:00
*** ayoung has joined #openstack-infra13:00
*** amotoki has quit IRC13:00
*** thorst_ has joined #openstack-infra13:00
*** larainema has joined #openstack-infra13:00
*** piet has joined #openstack-infra13:02
*** puiterwijk has joined #openstack-infra13:04
*** Na3iL has joined #openstack-infra13:04
*** javeriak has joined #openstack-infra13:04
*** pilgrimstack1 has joined #openstack-infra13:06
*** fedexo has joined #openstack-infra13:06
*** pilgrimstack has quit IRC13:06
*** ddieterly has quit IRC13:07
*** javeriak has quit IRC13:09
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job  https://review.openstack.org/30447313:10
*** pilgrimstack has joined #openstack-infra13:10
*** doug-fis_ has joined #openstack-infra13:10
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job  https://review.openstack.org/30447313:10
*** dprince has quit IRC13:11
*** pilgrimstack1 has quit IRC13:11
*** doug-fis_ has quit IRC13:11
*** doug-fis_ has joined #openstack-infra13:11
*** dprince has joined #openstack-infra13:11
*** sdake has joined #openstack-infra13:14
puiterwijkjeblair: Hey, would you have time somewhere today to discuss Ipsilon?13:15
*** rcernin_ has quit IRC13:16
*** sree has quit IRC13:18
*** hashar has joined #openstack-infra13:18
zxiiroelectrofelix: This is the patch I mentioned https://review.openstack.org/314862/ earlier in the week that we'd like to get a release for. Can you take a look?13:18
*** sree has joined #openstack-infra13:19
*** fawadkhaliq has quit IRC13:20
*** fawadkhaliq has joined #openstack-infra13:20
*** odyssey4me has quit IRC13:21
*** |-paul-| has quit IRC13:21
*** odyssey4me has joined #openstack-infra13:21
*** awaugama has joined #openstack-infra13:22
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job  https://review.openstack.org/30447313:23
*** sree has quit IRC13:23
*** fedexo has quit IRC13:23
*** amotoki has joined #openstack-infra13:24
*** fawadkhaliq has quit IRC13:25
openstackgerritEmilien Macchi proposed openstack-infra/project-config: Fix generate_puppetfile.sh script  https://review.openstack.org/31609013:26
*** hferenc has quit IRC13:27
*** rcernin has joined #openstack-infra13:27
fungipuiterwijk: he may not be awake yet. it's still 06:30 in his locale13:27
openstackgerritJens Rosenboom proposed openstack-infra/project-config: Make neutron-lbaasv2 check non-voting for neutron  https://review.openstack.org/31609113:28
puiterwijkfungi: ah, thanks! I guess I'll wait for when he gets around then13:28
*** sree has joined #openstack-infra13:28
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Set Q_L3_ENABLED=False for networking-generic-switch  https://review.openstack.org/31609213:29
*** mriedem has joined #openstack-infra13:29
Shrewsyolanda: hi! around?13:30
*** mkwiek has left #openstack-infra13:32
*** jcoufal has joined #openstack-infra13:32
*** ggnel_t has quit IRC13:32
Shrewsyolanda: it seems you've enabled magnum in the shade-dsvm-ansible-dev-nv job and not the shade-dsvm-ansible job. Why only -nv? Also, this breaks the -nv job.  :(13:33
Shrewsyolanda: Our ansible test runner script assumes only cirros images, so it breaks when the magnum image is added.13:34
Shrewsyolanda: see extras/run-ansible-tests.sh13:35
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Set Q_L3_ENABLED=False for generic-switch jobs  https://review.openstack.org/31609213:35
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job  https://review.openstack.org/30447313:38
*** markvoelker has joined #openstack-infra13:39
pabelangermorning13:40
*** ddieterly has joined #openstack-infra13:40
*** jsavak has joined #openstack-infra13:40
dmsimardfungi, pabelanger: I'm annoying (and really sorry) with this but the openstack bot is _still_ not back in #rdo. Is there any explanations in the logs or something ? It is unbanned afaict.13:40
fungidmsimard: it hasn't been restarted yet (running since may 7). i'll make sure there are no running meetings and restart it quickly13:43
fungilooks all clear... restarting it now13:43
dmsimardfungi: I think pabelanger gave a shot at restarting it the other day (might've been may 7th) but let's see what happens, thanks.13:43
*** openstack has joined #openstack-infra13:45
pabelangerfungi: ack13:46
*** jcoufal has quit IRC13:47
fungidmsimard: logs claim it's still banned on #rdo too13:48
pabelangeryup, confirmed13:48
pabelangerINFO 2016-05-13T13:46:23 supybot Banned from #rdo, attempting ChanServ unban on FreeNode.13:48
fungithe more important logline there is13:49
fungiERROR 2016-05-13T13:46:23 supybot Unhandled error message from server: IrcMsg(prefix="wilhelm.freenode.net", command="474", args=('openstack', '#rdo', 'Cannot join channel (+b) - you are banned'))13:49
dmsimardTrying to see.. I did a simple /ban #rdo openstack and /unban #rdo openstack13:49
*** mtanino has joined #openstack-infra13:49
dmsimardChecking ban list.13:49
openstackgerritbenny@us.ibm.com proposed openstack-infra/project-config: New project request for SwiftOnHPSS  https://review.openstack.org/31609813:49
*** thorst_ has quit IRC13:49
*** esikachev has quit IRC13:50
*** salv-orlando has quit IRC13:51
*** zz_dimtruck is now known as dimtruck13:51
openstackgerritDavid Shrewsbury proposed openstack-infra/shade: Make sure Ansible tests only use cirros images  https://review.openstack.org/31609913:51
dmsimardfungi, pabelanger: ok, unbanned: http://paste.openstack.org/show/497069/13:51
dmsimardit looks like the simple /unban command wasn't picking up the right mask13:52
openstackgerritDavanum Srinivas (dims) proposed openstack-infra/project-config: New CI job for requirements repo  https://review.openstack.org/31558413:52
fungii'll give it another restart now13:52
*** openstack has joined #openstack-infra13:53
fungioh yeah, if you try to join too many channels too quickly, they will temporarily block you13:54
fungii'm not sure what the exact heuristic is13:54
fungibut most bots introduce some delay so they won't run afoul of join rate limiting thresholds13:54
dmsimardfungi: he's back! Thanks.13:55
*** markvoelker has joined #openstack-infra13:55
openstackgerritVasyl Saienko proposed openstack-infra/project-config: Add ironic cleaning job  https://review.openstack.org/30447313:55
*** kushal has quit IRC13:55
*** thorst_ has joined #openstack-infra13:56
fungiyou're welcome13:57
*** esikachev has joined #openstack-infra13:58
*** derekh has quit IRC13:59
*** bhunter has joined #openstack-infra13:59
openstackgerritMatt Riedemann proposed openstack-infra/elastic-recheck: Update the fernet token failure signature  https://review.openstack.org/31610513:59
*** thorst_ has quit IRC14:00
*** dimtruck is now known as zz_dimtruck14:01
*** dansmith is now known as superdan14:02
*** njohnston_afk is now known as njohnston__14:05
mordredcloudnull: Shrews and I are both poking at the fip thign with your script, thanks14:08
*** gordc has joined #openstack-infra14:08
cloudnullcool14:08
*** arxcruz has quit IRC14:09
cloudnullWe're starting the kilo>liberty upgrade in the OSIC now.14:09
mordredcloudnull: woot14:09
cloudnullso ill be beating on things again real soon.14:09
*** thorst_ has joined #openstack-infra14:10
pabelangercloudnull: \o/14:10
odyssey4mecloudnull I'll hold your beer. :)14:10
* cloudnull hands odyssey4me both beers14:11
*** zz_dimtruck is now known as zz_zz_dimtruck14:11
*** ddieterly is now known as ddieterly[away]14:12
fungiyeah, two-fisting beers makes it harder to type14:12
* fungi learned this the hard way14:13
*** salv-orlando has joined #openstack-infra14:13
cloudnullfungi: ++14:13
mordredfungi: just hit the keyboard with the beers14:15
*** matrohon has quit IRC14:16
mordredfungi: it may  not be accurate, but it probably expresses your actual thoughts at that point14:16
*** jcoufal has quit IRC14:16
fungithis is true14:16
openstackgerritMehdi Abaakouk (sileht) proposed openstack-infra/project-config: gnocchi:Fix typo  https://review.openstack.org/31611714:18
*** sigmavirus24_awa is now known as sigmavirus2414:19
*** jaosorior has quit IRC14:19
silehtCan I have some love for: https://review.openstack.org/#/c/316117/1 , this is a small bash typo in a patch that have just been landed14:19
*** links has joined #openstack-infra14:19
openstackgerritMerged openstack-infra/release-tools: change email topic tags based on summit feedback  https://review.openstack.org/31276214:20
cloudnullmordred: fungi: we just need a keyboard with bigger buttons14:21
*** mat128 is now known as mat128|away14:21
odyssey4mehmm, a beer keyboard - I can see a market for that14:21
mordredodyssey4me: something tells me we'd make more from that than from cloud14:22
*** rbrndt has joined #openstack-infra14:22
* odyssey4me registers a patent14:22
pabelangermordred: fungi: any change on a review, +A on https://review.openstack.org/#/c/315698/ adding the cloud repo for our centos mirror.  puppet-openstack team would like it14:22
pabelangers/change/chance14:23
mordredpabelanger: cool14:25
mordredpabelanger: lgtm14:25
*** piet has quit IRC14:25
*** piet has joined #openstack-infra14:26
*** d0ugal has quit IRC14:29
*** links has quit IRC14:29
silehtmordred, fungi can you take a look to : https://review.openstack.org/#/c/316117/114:29
*** zz_zz_dimtruck is now known as dimtruck14:29
*** d0ugal has joined #openstack-infra14:30
openstackgerritMerged openstack-infra/elastic-recheck: Update the fernet token failure signature  https://review.openstack.org/31610514:32
mordredsileht: done14:33
silehtmordred, thx!14:33
*** denisra has quit IRC14:34
*** akaszuba has quit IRC14:34
clarkbsileht: mordred does == work with test?14:34
*** denisra has joined #openstack-infra14:35
mordredclarkb: it does14:35
mordredclarkb: I just tested it locally14:35
mordredif [ "bar" == $foo ] ; then echo worked ; fi14:35
mordred(after doing foo=bar of course)14:36
clarkbok, the canonical string comparison is just =14:36
*** jcoufal has joined #openstack-infra14:37
fungiyeah, modern versions of /bin/test and equivalent shell builtins treat == as an alternate string comparison equivalent operator14:37
fungibut i don't recall if that's posix compliant14:37
persiaIt is not14:38
*** sree has quit IRC14:38
*** d0ugal has quit IRC14:38
persiaBut I seem to recall infra deciding bash was a safe assumption.14:38
mordredyup14:38
mordredwe don't support not-linux14:38
*** gyee_ has joined #openstack-infra14:38
*** sree has joined #openstack-infra14:38
*** gyee has quit IRC14:39
*** shardy has joined #openstack-infra14:39
persiamordred: I can provide a linux that does not support bash, if you like :p14:39
fungisure. it's more from a "i don't remember for sure why i use = instead of == but it was probably because posix"14:39
crinkle"The == comparison operator behaves differently within a double-brackets test than within single brackets." http://www.tldp.org/LDP/abs/html/comparison-ops.html14:40
clarkbeven bash says use = fwiw14:40
electricalcrinkle: o/14:40
persia= and == work subtly differently14:40
crinkleelectrical: hello14:40
fungiavoiding non-posix syntax in bourne shell scripts became a habit for me enough decades ago that i don't really remember that's why i do a lot of what i do any more14:40
electricalhow are you? been a long time14:40
crinkleelectrical: pretty good, you?14:40
clarkbcrinkle: with the real i fo14:41
electricalcrinkle: not to bad. messing around with puppet and some horrible administration :14:41
electrical:p14:41
*** sree has quit IRC14:43
*** salv-orlando has quit IRC14:44
*** ddieterly[away] is now known as ddieterly14:45
*** maishsk has quit IRC14:45
raildosdague: ping, about your suggestion yesterday to check the jobs manually, I was thinking on create a zuul locally, and runs the jobs related to v3-only before send to review. this sounds reasonable for you?14:46
openstackgerritBlair Bethwaite proposed openstack-infra/irc-meetings: Noticed a couple of minor wording nits when reading this, so fixed them.  https://review.openstack.org/31613314:46
*** psilvad has quit IRC14:46
*** oanson has quit IRC14:47
fungiraildo: running an instance of zuul for that is overkill. you can just set up devstack-gate on a virtual machine and run what the job would run14:48
fungiraildo: there's a (hopefully current) section in the openstack-infra/devstack-gate repo's readme on doing exactly that14:49
openstackgerritMerged openstack-infra/project-config: gnocchi:Fix typo  https://review.openstack.org/31611714:49
raildofungi: thank you :) I'll read about it14:49
*** hongbin has joined #openstack-infra14:50
*** thorst_ has quit IRC14:51
*** thorst_ has joined #openstack-infra14:52
openstackgerritBlair Bethwaite proposed openstack-infra/irc-meetings: Fixed a couple of minor wording nits in readme.  https://review.openstack.org/31613314:53
*** oanson has joined #openstack-infra14:54
openstackgerritMerged openstack-infra/project-config: Add new channel #openstack-requirements  https://review.openstack.org/31554314:54
openstackgerritJay Faulkner proposed openstack-infra/project-config: Ironic's agent_ssh job is deployed with IPA  https://review.openstack.org/31613814:55
*** vhosakot has joined #openstack-infra14:55
*** slaweq has quit IRC14:55
*** thorst_ has quit IRC14:56
*** esker has joined #openstack-infra14:56
*** ddieterly has quit IRC14:56
*** esker has quit IRC14:57
*** anteaya has joined #openstack-infra14:57
*** esker has joined #openstack-infra14:58
*** salv-orlando has joined #openstack-infra14:58
mordredcrinkle: I have learned something today14:59
jeblairpuiterwijk: hi!  yes!14:59
*** thorst_ has joined #openstack-infra14:59
*** eharney has joined #openstack-infra14:59
puiterwijkjeblair: cool! What time would work best for you?14:59
*** dalgaaf has quit IRC15:00
*** thorst_ has quit IRC15:00
*** thorst_ has joined #openstack-infra15:00
jeblairpuiterwijk: anytime -- right now?15:01
puiterwijkIn 5 minutes? Just in another meeting15:01
*** woodster_ has joined #openstack-infra15:01
jeblairpuiterwijk: sure15:01
*** ddieterly has joined #openstack-infra15:01
*** jsavak has quit IRC15:02
*** e is now known as Augustus15:02
*** rbrndt has quit IRC15:02
*** jsavak has joined #openstack-infra15:02
*** jamesmcarthur has joined #openstack-infra15:05
*** d0ugal has joined #openstack-infra15:05
*** julim has quit IRC15:05
*** Qiming_ has quit IRC15:05
*** rbrndt has joined #openstack-infra15:07
openstackgerritJeremy Stanley proposed openstack-infra/groups-static-pages: Content out of date  https://review.openstack.org/31615215:07
*** jpr has joined #openstack-infra15:07
*** jsavak has quit IRC15:07
puiterwijkjeblair: okay. do you want to discuss on IRC or a vidconf or something? (not sure what point you are and what info you need)15:07
anteayaso I'm looking up a url for the upcoming manchester openstack meetup and I get http://datingly.xyz/OpenstackMeetupManchester15:07
*** ddieterly is now known as ddieterly[away]15:07
anteayamy mind is boggling15:07
*** julim has joined #openstack-infra15:08
jeblairpuiterwijk: let's try here on irc; my voice isn't so great atm15:09
fungitoday i learned that if you add .patch on the end of a github commit url, you get something suitable for piping into git am -15:09
fungisurprising15:10
anteayafungi: interesting15:10
puiterwijkjeblair: sure, works for me. I saw the etherpad with the comparison. What would be the next step for you, and where can I help you with?15:10
*** aysyd has joined #openstack-infra15:11
puiterwijkI got that etherpad, and "speak with jeblair". So I'm just looking to where you are at this moment15:12
*** ddieterly[away] is now known as ddieterly15:12
*** pilgrimstack has quit IRC15:12
*** mixos has joined #openstack-infra15:13
*** dmk0202 has quit IRC15:13
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add support for testfairy plugin  https://review.openstack.org/26158715:14
jeblairpuiterwijk: i am just starting on my post-summit backlog; i'm a little behind where i'd like to be, unfortunately.  i think the next step is for us to talk some more with the folks working on the current openstackid implementation, and find out what else they might have built on top of it (if there are other extensions or something off-spec, etc)...15:14
*** mixos_ has joined #openstack-infra15:14
jeblairpuiterwijk: aside from that, i think we can stand up an ipsilon service fairly quickly and start testing it15:14
puiterwijkjeblair: okay, no problem, and that sounds like a good start. Could you point me and the openstackid people to eachother?15:14
puiterwijkjeblair: yeah, that's one of our goals :). Just for my info: what distro are you using or would have your preference?15:15
jeblairpuiterwijk: yes i will, can you pm me your email address?15:15
puiterwijkpuiterwijk@redhat.com15:15
*** pilgrimstack has joined #openstack-infra15:15
jeblairpuiterwijk: we try to run everything on ubuntu15:15
puiterwijkmy email is not private in any way, so I'm fine with here15:15
jeblairkk15:15
*** pilgrimstack1 has joined #openstack-infra15:16
*** pilgrimstack has quit IRC15:16
puiterwijkOkay. So it should work there, but we do not yet have packages for ubuntu, because I don't know any Ubuntu/Debian packagers.15:16
puiterwijkBut it's all python, so it should be no problem to get it working.15:16
electrofelixzxiiro: just a tidy up on the docstring for that change needed, I've started asking the openstack release team about a stable branch and releases from it, doesn't seem to be any problem15:16
electrofelixzxiiro: course we could consider a 1.6 release from master, since none of the 2.0 patches have arrived in yet.15:17
fungipuiterwijk: there are a surprising number of debian package maintainers and official debian developers floating around here, so it's possible one of them will express interest in helping with that too15:17
jeblairpuiterwijk: yes, we will probably just install it from source.  i know from looking at it previously, it's a little rough in that area (i guessed rpm was the primary method of install).  but we have many experts on python build / install subjects around here, so we may be able to contribute some patches in that area)15:17
jeblairpuiterwijk: or what fungi said :)15:17
*** openstackgerrit has quit IRC15:17
*** mixos has quit IRC15:17
*** openstackgerrit has joined #openstack-infra15:18
fungialso, yes, maybe get it able to be pip-installed15:18
jeblairor, perhaps most likely, both :)15:18
puiterwijkfungi: well, if any of them want to help with that, I'd be glad to cooperate with them and help them wherever needed15:18
fungiwe have lots of prople with familiarity with that too15:18
fungiprople15:18
zeroDivisibleHey guys, got a question about Zuul (not sure if this is the right channel to ask?). I'm trying to add it to our CI pipeline, and I think that Gerrit / Zuul / Jenkins are mostly properly configured (zuul can talk to Gerrit and such) - but what I'm struggling with is that I don't know why gearman server (when checking status) does not show the line with build:jenkins-job-name workers? Connection test15:18
zeroDivisiblefrom Jenkins works, would you have any tips how this can be debugged?15:18
puiterwijkjeblair: installing from source should be possible. Our rpm install is mostly a python setup.py install from the sdist.15:19
puiterwijkI do think we are moving a few files, like the pam file, but not much of the core should need changing afte rpython develop.py install15:19
jeblairpuiterwijk: cool15:20
jeblairpuiterwijk: so i'll kick off a discussion with the openstackid folks next week, and loop you in.  i'll also let you know when we start setting something up for testing15:20
puiterwijkSounds good!15:20
fungiif python setup.py install works, it can probably be installed pretty easily with pip too (modulo files that need to go in specific places outside the python module load path, e.g. configuration)15:20
puiterwijkfungi: I think that most of that should Just Work. But since I never tested it, I haven't uploaded it to pypi15:21
fungiwell, pip can also install from local paths... git repo checkout or an sdist15:22
fungiso easy to test15:22
puiterwijkAh, that's good to know.15:22
puiterwijkI might test that in a bit then. Just never done that15:22
jeblairzeroDivisible: is there a slave that can run that job, and is it online?  try taking it offline, then online again.15:22
jeblairpuiterwijk: oh, one other thing i remember from my earlier investigation... some of the sql appears to assume sqlite15:23
jeblairpuiterwijk: i think we would like to have it talk to a mysql server instead, so that we can load balance it across hosts15:23
puiterwijkjeblair: we use sqlalchemy. It should never assume sqlite. Sqlite is just the default15:23
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add test and update documentation for mailer plugin  https://review.openstack.org/31281015:24
jeblairpuiterwijk: istr that the problems were not major, and could probably even be fixed without a schema change...  but just wanted to check on whether those kinds of changes would be welcome15:24
puiterwijkWe even have a testcase where we test against postgresql15:24
puiterwijkOh, absolutely.15:24
puiterwijkWe want to be database-agnostic, and work with any15:24
jeblairpuiterwijk: great.  we also have some mysql experts around here :)15:25
puiterwijkThe only part that I know about that is problematic with non-sqlite is the automatic cleanup, because of the comparison between types. But I'm working on fixing that for the next release15:25
*** jianghuaw has quit IRC15:25
puiterwijkjeblair: cool. If you find any bugs at all or rough edges, I'm more than glad to fix it. I have personally been running Ipsilon in production for Fedora for over a year, but more input is always welcome15:25
jeblairpuiterwijk: cool, i think we're on the same page then!15:26
zeroDivisiblejeblair: damn ... so I had been disabling and enabling gearman plugin, which didn't help with finding those executors, restarting Jenkins helped though :/15:26
puiterwijkI've even had a (temporary, never-committed) testcase where I test both our SAML stuff and OIDC stuff against Keystone.. The hardest part there was getting Keystone to work :)15:26
openstackgerritBlair Bethwaite proposed openstack-infra/irc-meetings: Setup IRC meetings for scientific working group.  https://review.openstack.org/31615615:26
zeroDivisiblethanks for the tip, don't know why I didn't tried it myself.15:27
*** roxanagh_ has joined #openstack-infra15:28
jeblairzeroDivisible: yeah, nodes coming on- or off-line is one of the triggers for the plugin to re-evaluate its jobs; i'm guessing en/disabling the plugin itself is not one of those triggers.  :|15:28
*** bpokorny has joined #openstack-infra15:28
jeblairpuiterwijk: i have to run for a bit; but i'll be in touch more next week15:29
jeblairpuiterwijk: thanks!15:29
puiterwijkjeblair: sounds good, thanks!15:29
zeroDivisiblejeblair: to be precise, the gearman plugin on jenkins was always off, but I've been going to it's settings and selecting enable / disable gearman checkbox, saving afterwards.15:30
openstackgerritMerged openstack-infra/storyboard: Allow lists of boards and worklists to be paged  https://review.openstack.org/30948115:31
*** sdague has quit IRC15:32
*** vhosakot has quit IRC15:32
zeroDivisiblejeblair: I'm doing this as a means of replicating another strange issue, when the build:jenkins-job-name:TAG line is being shown, it works perfectly for some time, but then something triggers Gearman to loose executors for a particualr job (it reports 0 as the number of executros when checking the status)15:32
*** ericksonsantos has joined #openstack-infra15:33
openstackgerritMerged openstack-infra/elastic-recheck: Remove queries with no hits  https://review.openstack.org/31576515:33
*** yamahata has joined #openstack-infra15:33
*** jsavak has joined #openstack-infra15:34
*** nadya has quit IRC15:36
*** mikelk has quit IRC15:36
*** armax has joined #openstack-infra15:37
*** tonytan4ever has joined #openstack-infra15:37
jeblairzeroDivisible: there's a parameter that we usually have zuul send which is OFFLINE_NODE_WHEN_COMPLETE, which tells the gearman plugin to set the node offline when a job finishes... is it setting your node offline?15:38
*** roxanagh_ has quit IRC15:40
*** kien-ha has joined #openstack-infra15:40
*** vhosakot has joined #openstack-infra15:40
*** nadya has joined #openstack-infra15:42
*** yarkot has quit IRC15:43
*** ddieterly is now known as ddieterly[away]15:45
*** sdague has joined #openstack-infra15:46
JayFThis is literally a 1 character change in Ironic job configurations; basically that job has been running without configuring devstack properly for a while, and it was just discovered while investigating test failures on another patch -> https://review.openstack.org/#/c/31613815:47
*** ddieterly[away] is now known as ddieterly15:48
JayFI'd greatly appreciate it if someone could help me get it in speedily, it is literally one character :) Thanks!15:48
jeblairJayF: those are the hardest to review! :)15:48
JayFI'm just glad I went to tackle changing this devstack default. Unearthing some bugs in our gate config in the process is a wonderful side effect :D15:49
*** psachin has quit IRC15:50
*** sridhar_ram has joined #openstack-infra15:51
*** ifarkas has quit IRC15:51
openstackgerritMatt Riedemann proposed openstack-infra/devstack-gate: DNM: test gate-tempest-dsvm-neutron-lvm-full config  https://review.openstack.org/31474415:52
*** esikachev has quit IRC15:53
JayFty sdague jeblair15:54
*** esker has quit IRC15:54
electrofelixzxiiro: is there any other patches you think you'll want to land? I'm tempted to do a 1.6 release instead to avoid some potential issues15:54
*** sree has joined #openstack-infra15:54
*** scottynomad has quit IRC15:55
*** schipiga has quit IRC15:56
*** tesseract has quit IRC15:56
*** gyee_ has quit IRC15:56
*** hongbin_ has joined #openstack-infra15:57
*** andymaier has quit IRC15:57
zxiiroelectrofelix: nope that patch is the most important one to me at the moment15:59
zxiiroelectrofelix: I'll ping my intern to fix up the docs15:59
*** mixos_ has quit IRC15:59
openstackgerritMerged openstack-infra/project-config: Ironic's agent_ssh job is deployed with IPA  https://review.openstack.org/31613815:59
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add support for http request plugin  https://review.openstack.org/31486215:59
zxiiroelectrofelix: actually kien-ha's in this channel, you guys can ping each other directly :)16:00
*** jcoufal has quit IRC16:00
*** hongbin has quit IRC16:00
*** sree has quit IRC16:00
kien-haYeah I just finished fixing it16:00
*** mixos has joined #openstack-infra16:01
*** jsavak has quit IRC16:01
*** degorenko is now known as _degorenko|afk16:02
*** gyee has joined #openstack-infra16:02
*** rcernin has quit IRC16:02
*** thorst_ has quit IRC16:02
*** rbrndt has quit IRC16:02
d0ugalTrying to figure out if I should change the order in this review or not, anyone here with thoughts on the order of versions in global requirements? https://review.openstack.org/#/c/314638/16:02
*** jsavak has joined #openstack-infra16:02
d0ugalI don't have a strong preference either way!16:03
electrofelixkien-ha zxiiro: great, lets consider trying to roll up any other changes from 1.x that appear sensible and do a release as normal until we actually start landing the 2.0 patches.16:03
*** ddieterly has quit IRC16:03
electrofelixNot that we should delay 2.0 changes from landing as soon as they are ready. just lets not be rigid about 1.5 being the last 1.x release if it makes things easier to do a 1.6 release16:03
*** ewilson_ has joined #openstack-infra16:04
jeblairfungi, clarkb, mordred: there are some "topic: v25" changes with no reviews, though most have 1 or 2 +2s; do you want to review the rest, or should i self-approve to get this thing going?16:04
*** kjorgensen has joined #openstack-infra16:05
*** jlanoux_ has quit IRC16:06
*** tphummel has joined #openstack-infra16:06
openstackgerritKhai Do proposed openstack-infra/puppet-gerrit: Allow puppet to configure commitmessage.maxLineLength  https://review.openstack.org/31617516:06
anteayajeblair: yesterday fungi announced he has guests currently so is on and offline, not sure if you saw that bit or not16:07
anteayaand yay v2516:07
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add zuul launcher hosts  https://review.openstack.org/31578116:07
*** Guest40739 has quit IRC16:08
*** esker has joined #openstack-infra16:08
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add support for http request plugin  https://review.openstack.org/31486216:09
*** thorst_ has joined #openstack-infra16:09
clarkbjeblair: I am currently catching up on email but I would like to continue reviewing this morning if possible, however I will be afk aroun dmiddle of day so don't want to put a stop to work16:10
*** ddieterly has joined #openstack-infra16:10
*** rbrndt has joined #openstack-infra16:10
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Make grenade-dsvm-neutron-multinode voting  https://review.openstack.org/29984316:10
notmorganjeblair: i16:10
mordredjeblair: I am fine with you just moving forward16:10
notmorganm looking over the changes, but... i'm still getting my head around zuul16:10
*** ewilson_ has quit IRC16:11
notmorganso, not super useful16:11
openstackgerritArmando Migliaccio proposed openstack-infra/project-config: Add failure rate graphs for grenade jobs to Neutron Grafana dashboard  https://review.openstack.org/31468916:11
openstackgerritMerged openstack-infra/project-config-example: Update recheck syntax to avoid the global namespace  https://review.openstack.org/27853716:11
*** thorst__ has joined #openstack-infra16:12
jeblairclarkb, notmorgan: okay, i'm going to try to get them merged, but this is ongoing stuff (i'm sure it will be going in and out of production a bit while we work through it), so post-hoc reviews are still helpful :)16:12
* notmorgan nods.16:13
*** thorst_ has quit IRC16:13
*** ewilson_ has joined #openstack-infra16:13
*** ewilson_ has quit IRC16:14
*** slaweq has joined #openstack-infra16:17
*** roxanagh_ has joined #openstack-infra16:17
*** thorst__ has quit IRC16:18
electrofelixkien-ha: review looks good, just waiting on the check jobs to finish to review the resulting docs16:18
*** markvoelker has quit IRC16:18
*** mriedem is now known as mriedem_lunch16:19
*** yamamoto has quit IRC16:20
*** Swami has joined #openstack-infra16:20
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add support for http request plugin  https://review.openstack.org/31486216:20
pabelangerjeblair: I left some comments on https://review.openstack.org/#/c/309221/ but happy to submit a follow up patch if needed16:22
*** markvoelker has joined #openstack-infra16:22
jeblairpabelanger: yeah, a followup patch would be great.  i think the flow_style change is good; the json/yaml thing seems weird to me, so i'd like to dig into that a bit more16:23
openstackgerritKien Ha proposed openstack-infra/jenkins-job-builder: Add support for http request plugin  https://review.openstack.org/31486216:24
*** e0ne has quit IRC16:24
pabelangerjeblair: Ya, likely a better way for json / yaml bit.16:25
mordredjeblair, pabelanger: the json/yaml thing might be unicode/utf8 thing16:25
jeblairyep16:25
*** esker has quit IRC16:25
pabelangerYa, I left some output examples in the review16:25
mordredalso - ++ to default_flow_style fo sho16:26
zeroDivisiblejeblair: I wasn't aware about OFFLINE_NODE_WHEN_COMPLETE - I think it's not being sent in the setup which I have, but I'll confirm. Thanks!16:26
pabelangerjeblair: while we are waiting, do you mind +A 315698? adding cloud repo to centos AFS mirror16:27
*** Dell-LT_ has joined #openstack-infra16:28
openstackgerritRaildo Mascena proposed openstack-infra/project-config: Run novaclient functional tests in Identity v3-only  https://review.openstack.org/31358816:28
jeblairpabelanger: sure, did you push up the zuul dib change (to fix selinux?)16:28
pabelangerjeblair: not yet, but I can do that after zuulv25 merges.  will redeploy locally to test it16:29
clarkbpabelanger: were we using the cloud repo before?16:29
pabelangerclarkb: not in our default images, but puppet openstack uses them in the gate.  So figured we can mirror it and let them manually configure the mirror16:29
jeblairokay; if we manage to run this a bit, we'll probably just end up failing any centos jobs16:29
*** psilvad has joined #openstack-infra16:29
clarkbpabelanger: I see16:30
clarkbpabelanger: speaking of selinux kolla get back to you/us on their potential selinux thing?16:30
pabelangerjeblair: Ya, have some ideas for a dirty hacks to add it16:30
pabelangerclarkb: nothing yet16:30
jeblairbtw, all of the flaky zuul tests at this point are timeouts that i can't debug because we don't get output from testr :(16:31
*** lakshmiS has joined #openstack-infra16:31
*** shardy has quit IRC16:32
*** hongbin has joined #openstack-infra16:32
*** asettle has quit IRC16:33
*** asettle has joined #openstack-infra16:33
*** asettle has quit IRC16:33
*** hongbin_ has quit IRC16:34
*** vkramskikh_ has quit IRC16:35
*** ddieterly is now known as ddieterly[away]16:36
*** sdake_ has joined #openstack-infra16:36
Shrewsjeblair: re: the 2.5 stuff, yeah, hadn't worked my way through all of them, but what I had tested was working as expected. happy to just pick up at the end of the stack and catch bugs from there16:37
*** Dell-LT_ has quit IRC16:37
openstackgerritMerged openstack-infra/system-config: Also mirror centos 7 cloud repo  https://review.openstack.org/31569816:37
jeblairShrews: cool, i reckon we might be doing that for a bit16:37
*** ddieterly[away] is now known as ddieterly16:38
* Shrews notes the NC coming out of jeblair with his reckoning16:38
*** yamahata has quit IRC16:38
*** sdake has quit IRC16:39
mordredShrews: people reckon over yonder16:40
* nibalizer chews on some grass16:40
*** hashar has quit IRC16:40
*** claudiub has quit IRC16:42
*** jistr has quit IRC16:42
*** Goneri has quit IRC16:44
*** daemontool_ has joined #openstack-infra16:45
*** lucasagomes is now known as lucas-afk16:45
*** claudiub has joined #openstack-infra16:47
*** abregman has joined #openstack-infra16:47
*** daemontool has quit IRC16:48
*** kushal has joined #openstack-infra16:48
openstackgerritPaul Belanger proposed openstack-infra/puppet-nodepool: Add nodepool_ssh_public_key  https://review.openstack.org/31618716:50
*** bpokorny has quit IRC16:51
*** pvaneck has joined #openstack-infra16:51
openstackgerritPaul Belanger proposed openstack-infra/puppet-openstackci: Add nodepool_ssh_public_key  https://review.openstack.org/31618816:52
*** jamesmcarthur has quit IRC16:52
openstackgerritDavid Shrewsbury proposed openstack-infra/zuul: Ansible launcher: Fix module main calls  https://review.openstack.org/31618916:52
*** roxanagh_ has quit IRC16:52
*** bpokorny has joined #openstack-infra16:52
*** salv-orlando has quit IRC16:52
Shrewsjeblair: ^^^ future proofing16:53
*** nadya has quit IRC16:53
jeblairpabelanger, mordred, Shrews: to address the unicode tags in yaml, we may want to do:   yaml.safe_dump({u'foo':u'bar'}, encoding='utf-8', allow_unicode=True)16:53
*** slaweq has quit IRC16:53
*** sdake_ has quit IRC16:54
clarkbyaml is utf8 by default I think16:54
clarkbyou shouldn't need to do anything special to have that owrk16:54
jeblairso then just safe_dump i guess16:54
jeblairi'll try some variations with unicode input16:55
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add nodepool_ssh_public_key to nodepool.o.o  https://review.openstack.org/31619116:55
pabelangerjeblair: ack16:55
*** ddieterly is now known as ddieterly[away]16:56
*** zxiiro has quit IRC16:56
*** monester has quit IRC16:56
*** kgalanov has quit IRC16:56
*** jpmaxman has quit IRC16:56
*** kozhukalov has quit IRC16:56
*** dtardivel has quit IRC16:56
*** ogelbukh has quit IRC16:56
*** rguillebert has quit IRC16:56
*** yonglihe has quit IRC16:56
*** rajinir has quit IRC16:56
*** evgenyl has quit IRC16:56
*** tpeoples has quit IRC16:56
*** teran has quit IRC16:56
*** nikhil has quit IRC16:56
*** auggy has quit IRC16:56
*** dham1 has quit IRC16:56
*** GheRivero has quit IRC16:56
*** jed56 has quit IRC16:56
*** igorbelikov has quit IRC16:56
*** fmccrthy has quit IRC16:56
*** jaranovich has quit IRC16:56
*** claudiub has quit IRC16:56
*** mixos has quit IRC16:57
openstackgerritPaul Belanger proposed openstack-infra/project-config: Initial commit of zuul-slave DIB element  https://review.openstack.org/31619316:58
*** electrofelix has quit IRC16:59
*** jamesmcarthur has joined #openstack-infra16:59
*** nikhil has joined #openstack-infra16:59
openstackgerritPaul Belanger proposed openstack-infra/project-config: Initial commit of zuul-slave DIB element  https://review.openstack.org/31619316:59
*** bpokorny has quit IRC17:00
*** psilvad has quit IRC17:00
jeblairclarkb, pabelanger: yeah, i think we want yaml.safe_dump({..., allow_unicode=True)17:00
jeblairso, omit the encoding17:00
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add nodepool_ssh_public_key to nodepool.o.o  https://review.openstack.org/31619117:01
jeblairpabelanger: zuul doesn't use the word slave -- that's a jenkins term17:01
*** bpokorny has joined #openstack-infra17:01
openstackgerritPaul Belanger proposed openstack-infra/project-config: Initial commit of zuul-slave DIB element  https://review.openstack.org/31619317:01
jeblairpabelanger: (zuul has workers, and nodepool has nodes)17:01
pabelangerjeblair: sure, I can switch to zuul-worker element17:02
jeblair++17:02
openstackgerritKhai Do proposed openstack-infra/system-config: Change commit message length validation to 72 chars  https://review.openstack.org/31619717:02
anteayayay workers and nodes17:02
*** ddieterly[away] is now known as ddieterly17:02
openstackgerritPaul Belanger proposed openstack-infra/project-config: Initial commit of zuul-worker DIB element  https://review.openstack.org/31619317:03
*** jamesmcarthur has quit IRC17:03
openstackgerritPaul Belanger proposed openstack-infra/system-config: Add nodepool_ssh_public_key to nodepool.o.o  https://review.openstack.org/31619117:04
pabelangerokay, zuul-worker element marked WIP17:05
pabelangerwill test it shortly17:05
*** jsavak has quit IRC17:07
openstackgerritgreghaynes proposed openstack/diskimage-builder: Install docker for tests  https://review.openstack.org/27802117:07
openstackgerritgreghaynes proposed openstack/diskimage-builder: Fail functests if refusing to run tests  https://review.openstack.org/17700217:07
*** jsavak has joined #openstack-infra17:07
*** apoorvad has joined #openstack-infra17:08
*** jamesmcarthur has joined #openstack-infra17:09
fungijeblair: anteaya: yeah, i'm semi-around. i have a bit of time now to catch up and can review some zuulishness17:10
*** nadya has joined #openstack-infra17:10
*** rajinir has joined #openstack-infra17:12
fungiShrews: i bet it's dead reckoning17:12
*** ccamacho is now known as ccamacho|hagw17:12
*** GheRivero has joined #openstack-infra17:12
*** kushal has quit IRC17:12
*** jamesmcarthur has quit IRC17:13
greghayneszuul-worker element?17:14
* greghaynes tries to wrap brain around that17:14
*** kozhukalov has joined #openstack-infra17:14
*** evgenyl has joined #openstack-infra17:15
greghaynesis that to create nodes that zuul uses to run tests/other stuff on?17:15
fungijeblair: if you want especially fancy dumps from pyyaml, try allow_unicode=True, default_flow_style=False17:15
*** jaranovich has joined #openstack-infra17:15
fungithough the allow_unicode=True is only if you want to emit non-ascii characters rather than the default hex representation17:16
jeblairfungi: yeah, i think that's what we want17:16
pabelangergreghaynes: we'll be using the element to create the bits that zuul needs to ssh into the image. Along with additional things ansible will need17:16
greghaynespabelanger: ah, awesome17:16
jeblair(so we can dial back the puppet some more, eventually completely)17:16
fungii tend to like default_flow_style=False because it expands nested arrays and tends to be a lot more readable17:17
jeblairyep, pabelanger suggested that too17:17
pabelangergreghaynes: we can then slowly remove the slave.pp bits from system-config related to jenkins17:17
*** jamesmcarthur has joined #openstack-infra17:17
greghaynespabelanger: Ya, thatd be awesome17:17
*** roxanagh_ has joined #openstack-infra17:17
*** zxiiro has joined #openstack-infra17:18
pabelangerinfact, we can likely remove thick_slave.pp today, now that we have dropped bare nodes17:18
pabelangerI should double check that17:18
*** teran has joined #openstack-infra17:19
*** tonytan4ever has quit IRC17:19
clarkbpabelanger: no we have the static slaves that use that17:19
*** jang has joined #openstack-infra17:20
*** rguillebert has joined #openstack-infra17:20
pabelangerclarkb: Ya, I know we have it for wheel slaves, but pretty sure we can remove it. https://review.openstack.org/#/c/303047/  Tested it locally and it had no impact I could see17:20
*** dtardivel has joined #openstack-infra17:20
*** yamahata has joined #openstack-infra17:20
*** kgalanov has joined #openstack-infra17:20
clarkbpabelanger: wheel slaves and proposal and so on iirc17:20
pabelangerclarkb: Ya, need to test the proposal slave see what is missing17:21
*** amotoki has quit IRC17:21
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add zuul launcher hosts  https://review.openstack.org/31578117:23
*** monester has joined #openstack-infra17:24
*** Jeffrey4l has quit IRC17:25
*** Sukhdev has joined #openstack-infra17:25
*** tpeoples has joined #openstack-infra17:25
*** ogelbukh has joined #openstack-infra17:26
*** gordc has quit IRC17:27
*** yonglihe has joined #openstack-infra17:29
*** mriedem_lunch is now known as mriedem17:29
*** jed56 has joined #openstack-infra17:29
*** tosky has quit IRC17:30
*** auggy has joined #openstack-infra17:30
*** yamahata has quit IRC17:30
*** jpmaxman has joined #openstack-infra17:31
*** sambetts is now known as sambetts|afk17:31
*** nadya has quit IRC17:33
cbader_Is anyone seeing an issue with libvirt and a package libnetcf1 not being install during devstack?17:33
*** jamesmcarthur has quit IRC17:34
*** yamahata has joined #openstack-infra17:34
*** kien-ha has quit IRC17:34
*** dham1 has joined #openstack-infra17:35
*** fmccrthy has joined #openstack-infra17:35
*** pilgrimstack1 has quit IRC17:36
*** igorbelikov has joined #openstack-infra17:36
*** gordc has joined #openstack-infra17:37
*** jamesmcarthur has joined #openstack-infra17:38
anteayacbader_: when you ask a question like that, posting a paste with details is really beneficial to getting a useful response17:38
anteayafor instance I could say no, and while it is the truth it isn't very helpful to you17:38
cbader_anteaya: very sorry for the poor post.17:38
*** jsavak has quit IRC17:39
anteayathat's okay, just work on improving your posting habits17:39
*** nikhil_ has joined #openstack-infra17:39
*** nikhil_ is now known as Guest5308917:40
fungicbader_: yeah, if you have a log you can link us to or something, that makes the question a lot more likely to get useful answers17:40
cbader_fungi, working on putting into pastebin17:41
*** pblaho has quit IRC17:41
*** jamesmcarthur has quit IRC17:42
*** slaweq has joined #openstack-infra17:42
*** mat128|away is now known as mat12817:42
cbader_fungi: anteaya: here is a pastebin of the issue on apt-get libvirt-bin and libvirt-dev install failing with libnetcf1 unmet http://paste.openstack.org/show/497110/17:43
openstackgerritMatt Riedemann proposed openstack-infra/devstack-gate: DNM: test gate-tempest-dsvm-neutron-lvm-full config  https://review.openstack.org/31474417:45
*** bryan_att has joined #openstack-infra17:46
fungicbader_: that looks like it might be a broken package mirror you're hitting, or that you've put the libnetcf1 package or one of its dependencies on hold for some reason17:47
*** ri0 has joined #openstack-infra17:47
*** ddieterly is now known as ddieterly[away]17:47
*** piet has quit IRC17:47
*** jang has quit IRC17:48
cbader_fungi: thank you for reply, it looks like I am hitting this from upstream no changes on my environment and this is during devstack call. I guess double check for other peoples checkins.17:49
fungicbader_: can you put the output of `apt-cache show libvirt-bin libvirt-dev libnetcf1` on paste.openstack.org?17:49
*** awaugama has quit IRC17:50
*** thorst_ has joined #openstack-infra17:50
*** asilenkov_ has quit IRC17:50
*** roxanagh_ has quit IRC17:50
fungicbader_: also, what distro/release are you running this on?17:51
fungiubuntu 14.04 lts, or something else?17:51
cbader_fungi: I will have to generate error again since vm was flushed after fail to build. I am testing against master. ubuntu 14.04 lts.17:51
*** roxanagh_ has joined #openstack-infra17:52
*** mriedem1 has joined #openstack-infra17:53
anteayadhellmann: the email about emails, a friday kind of thing17:53
*** mriedem has quit IRC17:53
openstackgerritgreghaynes proposed openstack/diskimage-builder: Allow setting per-release mirrors for tests  https://review.openstack.org/27969117:54
*** thorst_ has quit IRC17:55
*** abregman has quit IRC17:56
*** thorst_ has joined #openstack-infra17:56
*** bpokorny_ has joined #openstack-infra17:57
*** abregman has joined #openstack-infra17:57
*** ffrank has joined #openstack-infra17:58
*** SumitNaiksatam has joined #openstack-infra17:59
anteayammedvede or asselin_ I'm in Manchester on Monday for the StoryBoard mid-cycle, are either of you available to chair the Monday 15:00 utc third party meeting?18:00
*** thorst_ has quit IRC18:01
*** bpokorny has quit IRC18:01
*** thorst_ has joined #openstack-infra18:01
asselin__anteaya, I have a conflict on monday morning18:03
anteayaasselin__: thanks for considering it18:03
*** jcooley has quit IRC18:03
anteayaI'll see what mmedvede has to say18:03
* mmedvede checks calendar18:04
openstackgerritMerged openstack-infra/puppet-zuul: Add support for zuul launcher  https://review.openstack.org/31020518:04
mmedvedeanteaya: yes, I can host the meeting18:05
*** mriedem1 is now known as mriedem18:05
openstackgerritMerged openstack-infra/zuul: Properly shutdown apscheduler on reconfigure  https://review.openstack.org/31571518:06
anteayammedvede: ah thank you18:07
anteayammedvede: I appreciate it18:07
openstackgerritMerged openstack-infra/zuul: Ansible launcher: register jobs from JJB  https://review.openstack.org/30751518:07
anteayaI'll be chairing the Tuesday 08:00 utc meeting which will probably be the last one18:07
openstackgerritMerged openstack-infra/zuul: Ansible launcher: send ZMQ start/complete events  https://review.openstack.org/30805318:07
openstackgerritMerged openstack-infra/zuul: Ansible launcher: run ansible  https://review.openstack.org/30808218:07
anteayaas noone has responded to my email thread asking if anyone feels it brings them value18:07
openstackgerritMerged openstack-infra/zuul: Ansible launcher: run shell builders defined in JJB  https://review.openstack.org/30809918:07
anteayawell thingee did to say thank you18:08
anteayawhich was nice18:08
anteayathank you thingee18:08
mmedvedeanteaya: I have no objections, never could attend the Tue meeting18:08
anteayammedvede: I understand18:08
anteayaand thanks for letting me know how you feel about it18:08
anteayaI appreciate that18:09
*** abregman has quit IRC18:09
*** Na3iL has quit IRC18:09
*** doug-fish has joined #openstack-infra18:12
dhellmannanteaya : I've always been a little meta18:13
fungidhellmeta18:13
*** keedya has joined #openstack-infra18:13
dhellmannfungi wins18:13
*** mixos has joined #openstack-infra18:14
anteayahe does so18:14
openstackgerritDoug Hellmann proposed openstack-infra/project-config: ensure all projects syncing global requirements use check-requirements  https://review.openstack.org/31576118:15
*** doug-fi__ has joined #openstack-infra18:15
*** tonytan4ever has joined #openstack-infra18:15
*** doug-fis_ has quit IRC18:15
jeblairbwahahaha: http://logs.openstack.org/28/310228/3/gate/gate-puppet-zuul-puppet-beaker-rspec-ubuntu-trusty/972b684/console.html#_2016-05-13_18_08_30_65218:16
*** sdague has quit IRC18:16
anteayadhellmann: just looking at your patch, a while back we had some projects running check-requirements as a non-voting job18:16
*** sdague has joined #openstack-infra18:16
anteayadhellmann: not sure if you were aware of that18:16
* anteaya checks to see if bwahahaha is an irc nick18:16
*** nadya has joined #openstack-infra18:17
jeblairi think people may be amused by why that job failed18:17
jeblairit is subtle18:17
dhellmannanteaya : no, I wasn't. my current changes will make it easier to find projects that don't run them at all. we can extend that to find projects not allowing them to vote18:17
*** doug-fish has quit IRC18:17
anteayadhellmann: awesome thank you18:17
*** doug-fi__ has quit IRC18:18
anteayadhellmann: I've been in a stale mate over this patch for a while: https://review.openstack.org/#/c/249318/18:18
dhellmannanteaya : thanks for letting me know that case18:18
anteayadhellmann: would be interested to hear your thoughts18:18
anteayadhellmann: welcome18:18
openstackgerritbenny@us.ibm.com proposed openstack-infra/project-config: Fix zuul layout for new project SwiftOnHPSS  https://review.openstack.org/31623618:18
anteayajeblair: I bet I miss it, I tend to miss the subtle things18:19
anteayabut I'll give others time to find it18:19
anteayawhy spoil the fun?18:19
dhellmannanteaya : networking-cisco is not currently asking us to sync requirements, so if they want to run the jobs non-voting that's ok (though I agree it's not ideal and would not object to a policy from infra saying not to do it)18:19
anteayawell I had thought that patch was following a policy from requirements not to do it18:20
*** sdake has joined #openstack-infra18:20
anteayaso we agree that should someone make a policy saying don't do that we both would be happy to review in compliance with that18:20
anteayaso who makes the policy in this case?18:20
anteayaI know it is not me personally18:20
anteayathat's all I know18:21
jeblaira cookie for the first person to get the answer :)18:21
anteayaI say it is doug18:21
anteayadoug makes that policy18:21
* anteaya holds out her hand for a cookie18:21
*** ccamacho|hagw has quit IRC18:21
jeblairi mean about the puppet failure :)18:21
anteayaoh :(18:21
anteayaI'm not going to get that cookie18:21
*** nadya has quit IRC18:22
* jeblair hands anteaya a cat18:22
anteayaha ha ha18:22
anteayathanks18:22
anteayalove all my cats18:22
jeblairit's a policy cat18:22
anteayaI see that18:23
anteayait already is looking around and examing everything18:23
*** doug-fish has joined #openstack-infra18:23
anteayaI hope I am up to standard18:23
openstackgerritCsaba Henk proposed openstack-infra/project-config: devstack-plugin-glusterfs: make the Cinder job non-voting  https://review.openstack.org/31623718:24
*** ociuhandu has quit IRC18:24
bkero /win 3318:25
fungifull of /win18:25
jeblairFriday brain teaser!  Why did this job fail?  http://logs.openstack.org/28/310228/3/gate/gate-puppet-zuul-puppet-beaker-rspec-ubuntu-trusty/972b684/console.html  Reward: one cookie!18:25
*** sdake_ has joined #openstack-infra18:26
*** psilvad has joined #openstack-infra18:26
*** abregman has joined #openstack-infra18:26
*** xyang1 has joined #openstack-infra18:27
jeblair(also, Saturday brain teaser for some folks)18:27
*** sdake has quit IRC18:28
*** scottynomad has joined #openstack-infra18:28
openstackgerritDoug Hellmann proposed openstack-infra/project-config: ensure all projects syncing global requirements use check-requirements  https://review.openstack.org/31576118:29
fungii see this is a devious ploy to get more people to look at topic:v25 ;)18:29
fungiit's working!18:29
dhellmannanteaya : I'd be happy to have the new requirements team make that policy18:30
anteayadhellmann: wonderful, I'm going to be delighted to hear them post that policy so we can review accordingly18:30
anteayaand then perhaps someone can weigh in on that stale patch and we can get it moving18:31
anteayathank you18:31
*** _ari_ is now known as _ari_|ooo18:31
*** kzaitsev_mb has joined #openstack-infra18:32
*** bpokorny_ has quit IRC18:33
*** kushal has joined #openstack-infra18:34
*** shashank_hegde has joined #openstack-infra18:35
*** esker has joined #openstack-infra18:35
anteayafungi: and there's cookies18:36
*** jtomasek_ has joined #openstack-infra18:37
fungijeblair: did another commit merge to the zuul repo in the middle of the idempotency test?18:37
fungior maybe i'm misreading the log18:37
* jeblair gives fungi a cookie!18:38
*** jtomasek_ has quit IRC18:38
openstackgerritMathieu Gagné proposed openstack-infra/glean: Nova exposes network info in network_data.json  https://review.openstack.org/31268318:38
anteayayay!18:38
jeblairapparently, don't merge changes to zuul and puppet-zuul at the same time18:38
anteayafungi wins a cookie18:38
*** esker has quit IRC18:39
fungipretty hilarious race baked into the assumptions of that test18:39
anteayaha ha ha18:39
jeblairyup!18:39
jeblairlike, this would be really bad for nova, huh?18:39
*** jtomasek_ has joined #openstack-infra18:39
*** esker has joined #openstack-infra18:39
fungii suppose this test works better on modules that deploy released software18:39
fungistill a race, but probably less frequently triggered than for cd18:40
*** sree has joined #openstack-infra18:41
*** ayoung has quit IRC18:42
*** e0ne has joined #openstack-infra18:43
*** roxanagh_ has quit IRC18:44
*** awaugama has joined #openstack-infra18:44
*** sree has quit IRC18:46
*** oanson has quit IRC18:47
*** ddieterly[away] has quit IRC18:47
cbader_fungi: i have the output from the apt-cache show libvirt-bin libvirt-dev libnetcf1 in paste bin. http://paste.openstack.org/show/497119/ if you can look at it and advise I would appreciate it.18:48
*** roxanagh_ has joined #openstack-infra18:48
*** thorst_ has quit IRC18:49
*** thorst_ has joined #openstack-infra18:50
*** doug-fish has quit IRC18:51
*** doug-fish has joined #openstack-infra18:52
*** mhickey has joined #openstack-infra18:52
*** sdake_ has quit IRC18:52
*** kushal has quit IRC18:53
*** doug-fish has quit IRC18:53
*** sdake has joined #openstack-infra18:53
*** sdake has quit IRC18:53
*** thorst__ has joined #openstack-infra18:53
*** doug-fish has joined #openstack-infra18:54
*** thorst_ has quit IRC18:54
openstackgerritMerged openstack-infra/zuul: Ansible launcher: support job timeouts  https://review.openstack.org/30848818:55
*** Goneri has joined #openstack-infra18:56
*** bpokorny has joined #openstack-infra18:56
*** sridhar_ram is now known as sridhar_ram_afk18:56
*** sridhar_ram_afk has quit IRC18:57
*** thorst__ has quit IRC18:58
*** thorst_ has joined #openstack-infra18:59
*** doug-fish has quit IRC18:59
*** reed has quit IRC18:59
rcarrillocruzfolks, out of curiosity: is there any job out there in post that does a push merge on any git repo? something like 'check-gate passed, ok now on post push merge this thing on this git repo'19:01
rcarrillocruzany job with that pattern?19:01
rcarrillocruzfungi: ^19:01
*** bpokorny has quit IRC19:01
*** doug-fish has joined #openstack-infra19:02
*** thorst_ has quit IRC19:03
*** reed has joined #openstack-infra19:03
*** roxanagh_ has quit IRC19:06
*** daemontool_ has quit IRC19:06
*** kzaitsev_mb has quit IRC19:08
*** bpokorny has joined #openstack-infra19:08
SpamapSrcarrillocruz: a job? I've not heard of that.19:09
SpamapSrcarrillocruz: there's the openstack/openstack repo, which gerrit advances every time a commit lands in a tracked repo.19:09
rcarrillocruzyeah, instead of a proposal (which i know there are some, translation, app-catalog, etc), i wonder if there's anything that push merges straightaway19:10
fungicbader_: nothing's jumping out at me with that... i wonder what does `sudo apt-get install libnetcf1` say?19:10
fungircarrillocruz: so far "automatically merge content into a git repo" is not a pattern we've embraced. we have a pretty heavy culture of putting humans between automation and the decision to merge git commits19:10
*** roxanagh_ has joined #openstack-infra19:11
rcarrillocruzk, so always having a human +Aing...19:11
cbader_fungi: if I run it after the libvirt-dev it installs. If I run it before I get a bunch requirements not meet. NetApp is seeing the same issue on there ci. Looking for someone their to ask.19:11
*** dimtruck is now known as zz_dimtruck19:11
*** zz_dimtruck is now known as dimtruck19:12
*** Sukhdev has quit IRC19:12
fungicbader_: and this is happening on a fresh deployment of devstack on a previously unused server?19:13
*** salv-orlando has joined #openstack-infra19:14
*** ddieterly has joined #openstack-infra19:14
fungicbader_: and yeah, libnetcf1 does have quite a few dependencies listed. which ones does it say aren't met? and how recently did it start breaking like this? if it's in the last 24 hours, i still have a feeling this is being caused by one of the official ubuntu mirrors being out of sync.19:15
*** Sukhdev has joined #openstack-infra19:15
openstackgerritMathieu Gagné proposed openstack-infra/glean: Nova exposes network info in network_data.json  https://review.openstack.org/31268319:15
*** yarkot has joined #openstack-infra19:17
*** Swami has quit IRC19:19
fungigrr... my devstack-gate fishing expedition to catch a rax-ord node with broken networking got a bite on one of the non-devstack-gate jobs, so didn't spin in busy-wait long enough for me to hold it19:19
*** pradk has quit IRC19:19
fungipeople keep saying i should go fishing on my days off, but i don't think this is what they meant19:19
*** salv-orlando has quit IRC19:20
*** mugsie has quit IRC19:21
*** roxanagh_ has quit IRC19:21
*** Swami has joined #openstack-infra19:21
cbader_fungi, Yes happening on a clean deploy on vm spun up at patch request, unused server. nodepool refresh. It started happening at 8:45am PDT today.19:21
fungidoes `apt-get update` throw any errors about bad signatures on package indices or anything?19:21
openstackgerritbenny@us.ibm.com proposed openstack-infra/project-config: New project request for SwiftOnHPSS  https://review.openstack.org/31609819:22
cbader_fungi, no not that I see.19:22
*** bpokorny has quit IRC19:23
*** nadya has joined #openstack-infra19:23
openstackgerritMerged openstack-infra/shade: Make sure Ansible tests only use cirros images  https://review.openstack.org/31609919:25
anteayafungi: yeah not what I would mean if I suggested fishing to you19:25
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add zuul launcher hosts  https://review.openstack.org/31578119:25
eskercbader_: At NetApp?  Try akerr  or #openstack-netapp19:26
*** pradk has joined #openstack-infra19:26
sdagueit's been a while since I've imported a project to gerrit19:27
*** jtomasek_ has quit IRC19:27
sdagueif I've got a few commit git repo, should I jam it up to github to do the import, or is there another reasonable way to direct import those changes19:28
*** Sukhdev has quit IRC19:28
*** Sukhdev has joined #openstack-infra19:28
jeblairsdague: best way is any remote repo (github will do), or if it's only a few, you can push them through gerrit real quick (maybe with noop jobs)19:29
notmorgansdague: i'd go github19:29
sdagueit's only 4 commits, so I could just restack them and drive them through gerrit19:30
*** dtardivel has quit IRC19:30
jeblairi'd probably do that then19:30
sdagueok, cool, I'll go build the project-config request19:30
*** ayoung has joined #openstack-infra19:31
notmorganph 4 commits... hehe19:31
fungii tend to just push a git repo up to my personal webserver and reference that for the import, but yeah whatever's easy19:31
fungicbader_: one thing worth trying is to change our which ubuntu mirror you're using in /etc/apt/sources.list19:32
jeblairwe could make afs homedirs for everyone, then ppl could just stage them in afs19:32
fungicbader_: it's possible you're hitting one out of sync and some others may be properly intact19:33
* fungi needs to step away for a few and run an errand... bbiab19:33
cbader_fungi, thanks good suggestion our mirror was having network issues so I switch back yesterday to nova.cloud maybe they are having issues.19:33
openstackgerritMerged openstack-infra/zuul: Ansible launcher: support scp publisher  https://review.openstack.org/30865619:34
jeblairugh, these test timeouts are killing us19:39
jeblairi'm running them continuously locally with no problems.  having them fail on the workers with no actionable output is not good.19:40
pabelangerCleaned 99 FIPs from openstackjenkins-osic-cloud119:41
pabelangerhttp://grafana.openstack.org/dashboard/db/nodepool-osic much happier19:41
*** tonytan4ever has quit IRC19:43
cloudnullpabelanger mordred kevinbenton been testing the FIP bits since the upgrade this morning and its still an issue in liberty19:44
openstackgerritMerged openstack-infra/zuul: Ansible launcher: support ftp publisher  https://review.openstack.org/30909519:45
samueldmqhi, I have a question regarding jenkins jobs showed in zuul.o.o19:45
samueldmqpatch 316227 is on the gate, and if I search by its number on zuul, I can see that gate-tempest-dsvm-neutron-full19:46
samueldmqhowever, if I try to access jenkins output (https://jenkins07.openstack.org/job/gate-tempest-dsvm-neutron-full/28040/)19:46
samueldmqI don't get anything, it keeps loading and connection times out19:46
pabelangercloudnull: :( at atleast we know how to reproduce it19:47
rcarrillocruzyeah, jenkins ui job logs access has been removed19:47
samueldmqis this expected behavior ? (since all jobs haven't finished yet?)19:47
*** shamail has joined #openstack-infra19:47
samueldmqrcarrillocruz: oh, so I need to wait until all jobs finish and then the results will be posted in the gerrit review ?19:47
*** salv-orlando has joined #openstack-infra19:47
rcarrillocruzyeah, although you can also go to logs.openstack.org and build the url19:48
rcarrillocruzso you can see the logs as soon as jobs fail/pass and upload the job logs there19:48
anteayaI'd take an afs homedir19:48
samueldmqrcarrillocruz: is it hard to build the url? I have no idea how to do it19:49
cloudnullpabelanger: I know its not ideal however if we add a random sleep to shade before it provisions the FIP it seems to help. In the shade script I worked on yesterday adding a random sleep to the server create called make it work as expected.19:49
openstackgerritSean Dague proposed openstack-infra/project-config: create os-api-ref project  https://review.openstack.org/31626019:49
cloudnull**made it19:49
sdagueok, review appreciated ^^^19:49
pabelangercloudnull: okay, good to know. I'll defer to mordred on that call19:49
cloudnullits a miserable hack19:49
cloudnullbut it worked in my test19:50
*** amrith is now known as _amrith_19:50
jeblairsdague: will the first patch pass pep8?19:50
*** abregman has quit IRC19:51
anteayasdague: you decided to start with an empty repo, yes?19:51
cloudnullim picking on the env post upgrade to make sure we've not broke something in a way it wasnt broke before.19:51
sdaguejeblair: the first patch is cookiecutter, so I hope so19:51
cloudnullif you all see anything a miss in the OSIC please let me know19:51
jeblairsdague: cool, lgtm19:51
sdagueI can find out though19:51
pabelangercloudnull: ack19:51
sdaguejeblair: yeh, first patch passes pep819:52
mordredcloudnull: that sounds terrible19:52
anteayasdague: anne has a comment19:52
cloudnullit is/was19:52
rcarrillocruzsamueldmq: from memory, i believe the scheme is logs.openstack.org, then last two digits of change, full change, name of test, commit sha19:52
mordredcloudnull: btw (sdague you might find this interesting too)19:52
sdagueanteaya: I've only got 4 commits, so I figured I'd just push them through gerrit19:52
rcarrillocruzsamueldmq: http://logs.openstack.org/70/302770/1/check/gate-shade-dsvm-functional-nova/f4c5cba/19:53
sdagueanteaya: cool, looking19:53
* cloudnull sitting on the endge of the seat19:53
rcarrillocruzso 70, last two digits of 30277019:53
mordredcloudnull: Shrews has also replicated the duplicate hostname problem - and has verified that we're sending the names to nova corectly19:53
rcarrillocruzthen patcheset19:53
anteayasdague: sounds good, just confirming before I hit go19:53
rcarrillocruzqueue name19:53
rcarrillocruzjob name19:53
rcarrillocruzgit sha19:53
shamailHi everyone.  I would like to help with the wiki situation (if possible) and wanted to know what skill-set is needed and activities that might be helpful?   If in my abilities, I’d like to be a resource.19:53
sdagueok, let me fix anne's nit19:54
openstackgerritSean Dague proposed openstack-infra/project-config: create os-api-ref project  https://review.openstack.org/31626019:54
samueldmqrcarrillocruz: thanks19:54
anteayasdague: standing by19:54
anteayashamail: hello, this is Anita19:55
cloudnullmordred: kevinbenton had a suggestion to make sure the neutron client is always refreshed but, no joy.19:55
shamailHey anteaya o/19:55
anteayashamail: nice to see you19:55
rcarrillocruznp19:55
anteayashamail: so the first skill would be to be on the wiki and clean up the pages19:55
* jeblair aligns rocketships19:55
anteayaI think that is the best place to start19:55
mordredcloudnull: isn't this a fascinating problem?19:55
rcarrillocruzmordred: are you planning to make a shade release soonish?19:55
anteayajeblair: you're favourite19:55
anteayayour*19:56
jeblairthey would be so proud of me back home19:56
shamailYeah I saw Tom’s message and thought it is a good start pointing….. trim down older content and make less pages available that have to be watched.19:56
anteayayup19:56
jeblairwhen people ask me "What do you do?" i have struggled to explain cloud computing and our place in it... but now, i can say "I align rocketships!"19:56
cbader_fungi, so my local mirror must be in parity with upstream mirror same error on it.19:56
anteayaI'm about to make shamail an admin on the wiki, if anyone has any questions or objections now is the time to voice them19:57
shamailGreat first step recommendation anteaya :)19:57
sdaguemordred: I'm going to need way more background to know what the conversation is :)19:57
mordredrcarrillocruz: I don't have one planned in mind - we released last week though19:57
anteayajeblair: ah ah aha19:57
mordredsdague: heh. SO - we're working on the FIP leak thing19:57
shamailIs there a recommended place that I should share the plan before executing?19:57
rcarrillocruzk19:57
cloudnullmordred:  its is19:57
anteayajeblair: fits well on a business card19:57
jeblairanteaya: i can not believe i didn't put that one on my last batch19:57
anteayashamail: well I think looking at who has been acitive lately deleting things might not be a bad place to begin19:58
*** roxanagh_ has joined #openstack-infra19:58
cloudnullI think its an interesting case for sure.19:58
shamailanteaya: thanks19:58
anteayajeblair: I predict I will see it on the next batch19:58
mordredsdague: but as part of running through that - we've found times when we're getting duplicate instance names in nova19:58
*** claudiub has joined #openstack-infra19:58
mordredsdague: even though we're sending in creates with different names19:58
jeblairJunior Rocketship Aligner (someday i'll make PRINCIPLE Rocketship Aligner!)19:58
anteayahearing no objections, I will now look at the wiki admin bits and see if I can find the username shamail19:58
mordredsdague: still don't have a TON of info for you on that19:58
mordredbut we've gotten it reproduced by a second person19:58
*** asettle has joined #openstack-infra19:59
*** e0ne has quit IRC19:59
*** asettle has quit IRC19:59
shamailanteaya: username is kaizen, not planned :)19:59
mordredsdague: something something concurrency something something19:59
cloudnullhhahahahaha19:59
sdaguemordred: hmmm... interesting19:59
anteayashamail: ah ha19:59
anteayashamail: I will look for username kaizen then19:59
pabelangerjeblair: I'd take a paycheck with that title19:59
sdaguewell, if you can write down the call sequence it would make a good bug19:59
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add zuul launcher hosts  https://review.openstack.org/31578120:00
openstackgerritSpencer Krum proposed openstack-infra/system-config: Move public ssh keys into publi hiera  https://review.openstack.org/31626220:00
cloudnullsdague: https://gist.github.com/cloudnull/2f3931e51062dc7b325faf9a24974006 -- thats what i've been testing with20:00
*** tonytan4ever has joined #openstack-infra20:01
openstackgerritSpencer Krum proposed openstack-infra/system-config: Move public ssh keys into public hiera  https://review.openstack.org/31626220:01
cloudnull25 instances, w/ 25 floats, built at the same time20:01
anteayashamail: please log into the wiki or refresh if you are logged in20:01
*** ri0 has quit IRC20:01
anteayashamail: I added you as an admin and a bureaucrat20:02
shamailanteaya: Thank you, validated on refresh.20:02
anteayaI think bureaucrat means you can admin others?20:02
openstackgerritMerged openstack-infra/puppet-zuul: Exercise the launcher in beaker tests  https://review.openstack.org/31022820:02
openstackgerritMerged openstack-infra/puppet-zuul: Add support for additional launcher config options  https://review.openstack.org/31577420:02
anteayashamail: great, look around and explore, ask questions20:02
*** rfolco has quit IRC20:02
openstackgerritMerged openstack-infra/puppet-zuul: Install extra packages for ansible launcher  https://review.openstack.org/31578720:02
sdaguecloudnull / mordred it would be good to get a REST level dump in shade about the requests being sent20:02
shamailThanks anteaya! Will do.  Look forward to contributing.20:02
mordredsdague: we can totally do that20:02
anteayashamail: if you want to admin someone just announce in here and give folks a chance to speak up if they have any concerns or objections20:03
*** ddieterly is now known as ddieterly[away]20:03
cloudnullmordred: I played with debug logging all the things . do you have some magics to make that go  ?20:03
*** dmk0202 has joined #openstack-infra20:03
anteayashamail: I doubt anyone will but it is always nice to ask and to archive that you did20:03
*** psilvad has quit IRC20:03
shamailanteaya: +120:03
mordredcloudnull: do "http_debug=True" in the simple_logging call20:03
sdagueto make sure that it hit the wire correctly20:03
anteayashamail: welcome to the wiki maintainance team20:03
anteayashamail: ask lots of questions20:03
cloudnulli have that queued up20:03
cloudnulljust a sec20:03
shamailanteaya: thank you20:03
anteayashamail: thank you20:03
mordredcloudnull: also - if you don't have my latest two patches ...20:03
* shamail off to read up on wiki20:03
*** psilvad has joined #openstack-infra20:04
cloudnulllinks?20:04
cloudnullill pull them in20:04
anteayashamail: there will be a lot, take it in small chunks20:04
*** asilenkov_ has joined #openstack-infra20:04
anteayabite sized pieces you might say20:04
jeblairshamail: thanks for pitching in!20:04
sdaguetimestamps on the POST calls would be good as well, and which ones end up clobbering to see if there is a timing item there20:04
mordredcloudnull: https://review.openstack.org/#/c/315713 and the one before it20:05
shamailThanks for the guidance anteaya, and thank you for allowing me to pitch in jeblair.  As an active user of the wiki, I wanted to do my part.20:05
anteayashamail: I understand, thanks for stepping forward20:05
anteayashamail: if you ever make what you think might be a mistake please tell us20:05
mordredcloudnull: if you do those, you can add: http://paste.openstack.org/show/497126/ to your clouds.yaml and it'll batch up the calls to list_server and list_floating_ips20:05
shamailanteaya: will do20:06
anteayathank you20:06
Shrewscloudnull: it doesn't take a high concurrency number to reproduce this. and it's ALWAYS on the first create20:07
*** abregman has joined #openstack-infra20:07
*** jamesmcarthur has joined #openstack-infra20:07
anteayasdague: hoping anne takes another look at your edit20:08
openstackgerritMerged openstack-infra/zuul: Ansible launcher: support zuul stop commands  https://review.openstack.org/30914820:08
*** jamesmcarthur has quit IRC20:08
openstackgerritMerged openstack-infra/zuul: Ansible launcher: add zuul_runner module  https://review.openstack.org/30922120:08
*** jamesmcarthur has joined #openstack-infra20:08
fungiokay, back but ducking out again to grab dinner before the tourists take over all the restaurants... back even later i guess20:08
anteayafungi: tourist dodging already for you20:08
anteayathey are starting here too, them and the blackflies20:09
openstackgerritbenny@us.ibm.com proposed openstack-infra/project-config: New project request for SwiftOnHPSS  https://review.openstack.org/31609820:09
Shrewscloudnull: and i've found that putting a short sleep between process start()'s eliminates the problem. doesn't get me closer to knowing if it's shade or nova or something else, though20:09
*** med_ has quit IRC20:09
*** roxanagh_ has quit IRC20:09
cloudnull++ the sleep worked for me too .20:09
sdagueanteaya: I changed to her wording, so it should be good. Though apparently I had a missing newline so the tests failed, looking at local fixes now20:09
Shrewscloudnull: mordred: SERVER_COUNT=2  is all it takes to reproduce it, fwiw20:11
anteayasdague: okay20:11
anteayasdague: ah yes, she gave you her preferred wording, there it is20:12
anteayasdague: once tests are happy so amI20:12
anteayaam I20:12
rbrndtA recent change in the global requirements https://review.openstack.org/#/c/316259/ has broken several monasca gate jobs20:12
sdagueanteaya: http://logs.openstack.org/60/316260/2/check/gate-project-config-jenkins-project/3ff441a/console.html I can't quite figure out, do you have a thought?20:12
rbrndtIs there any way to rollback some libraries? specifically kaka-python is a big one for us20:13
*** sputnik13 has joined #openstack-infra20:13
anteayaI have many, let's see if I have a useful one20:13
*** raildo is now known as raildo-afk20:13
rbrndtkafka-python*20:13
sdagueoh, I think I found it20:13
sdaguea missing space20:13
cloudnullmordred: patches applied. sdague how would you like your mountain of data?20:13
sdaguecloudnull: it should probably be in a nova bug report. It's 4:15 on a Friday in this TZ, so I'm going to be offline soon20:14
sdaguebut I can sift a little next week on it20:14
cloudnullShrews sdague do we have a nova bug made already ?20:15
openstackgerritSean Dague proposed openstack-infra/project-config: create os-api-ref project  https://review.openstack.org/31626020:15
sdagueanteaya: ok, I think that passes tests now20:15
sdaguethough, it's still running locally. At least it didn't error out20:15
*** roxanagh_ has joined #openstack-infra20:17
anteayaI'll give it a minute20:17
mordredrbrndt: any chance you have a link to the change that removed the cap?20:17
rbrndtmordred: Still looking for that20:18
*** edmondsw has quit IRC20:18
sdagueok, tox passed fully locally, so it should pass on the server, I hope20:18
sdaguethat jenkins job computation takes a while :)20:18
*** jamesmcarthur has quit IRC20:19
anteayaokay your local is happy anne is happy jim is happy I'm happy20:19
anteayaso much happiness20:19
sdagueand it's friday20:19
sdagueso that's happy20:19
mordredrbrndt: looks to have been Idcccce21968a3188cf489d91e9acb35a875d28cd20:20
rbrndtmordred: just found https://review.openstack.org/#/c/297995/20:20
Shrewscloudnull: i'm not convinced it's nova yet20:20
anteayafriday is happy-making yes20:20
anteayasun is shining where I am20:20
*** hashar has joined #openstack-infra20:20
mordredrbrndt: we should talk with dims20:21
mordreddims: the removal of the cap on python-kafka is brekaing monasca, and there are also stability/performance issues with 1.0 currently20:21
*** dmk0202 has quit IRC20:22
dimsmordred : i was just reviewing that revert https://review.openstack.org/#/c/316259/20:22
mordredyay you're around :)20:22
*** eharney has quit IRC20:22
mordredrbrndt: I don't suppose you're using the kafka driver for oslo.messaging yet are you?20:22
dimsmordred : i'd like to see what those issues are.20:22
dimsmordred : no links in commit message for the problems mentioned20:23
dimsrbrndt : ^^20:23
rbrndtmordred: all our changes to our API are failing in gate, let me grab a few20:23
dimsrbrndt : those would be breaking semver api changes, not performance regressions20:23
rbrndtdims: oh, sorry, just read the note on the review20:24
rbrndtlet me find those20:24
dimsrbrndt : and you don't subscribe to requirements process, so you should feel free to use whatever version that works for you20:24
Shrewsmordred: cloudnull: i'm beginning to highly suspect https://github.com/openstack-infra/shade/blob/master/shade/task_manager.py#L10820:25
*** _ari_|ooo is now known as _ari_20:25
dimsmordred : rbrndt : heading out in 5 mins. back in about 3 hours.20:25
Shrewsseeing as we get that "connection failure" message20:25
*** jamesmcarthur has joined #openstack-infra20:26
*** wrightspace has joined #openstack-infra20:27
*** roxanagh_ has quit IRC20:27
Shrewsi would wager if we throw in a shade call that uses the nova client before we create servers, it will magically work20:27
sdagueanteaya / jeblair thanks, looks like it passed all tests as is on to gate now20:27
rbrndtdims: alright, I'll collect some more data then20:27
sdaguehow often does the project create get pushed to gerrit?20:27
anteayasdague: glad you are on your way20:27
mordredShrews: a list_servers call would be easy enough20:27
dimsrbrndt : first step to unclog your CI would be to use gate hooks to install the version you want and not rely on upper-constraints20:28
mordredShrews: OH - you mean you're thinking that with the server issue we're getting an error so we're retrying20:28
anteayasdague: puppet triggers the manage project script to run on gerrit I'd give it about an hour to show up once it merges20:28
mordredShrews: but it actually might have succeeded?20:28
dimsrbrndt : thanks. ttyl20:28
sdagueanteaya: cool, if you happen to be around in an hour, could you add me to the os-api-ref-core & os-api-ref-release teams?20:28
anteayaI would if I could, I don't have those permisisons20:29
*** awaugama has quit IRC20:29
sdagueah, ok20:29
anteayayou would be looking for infra-root for that20:29
Shrewsmordred: eh, there's already a nova call for flavor list.20:29
Shrewsmordred: oh, we pass the cloud object down to the processes20:29
Shrewsmordred: sharing that might cause weird things20:30
mordredyah. was just thinking that20:30
mordredShrews: maybe put a list_flavors at the top of create_server() in shade and see if that clears it up20:30
*** e0ne has joined #openstack-infra20:31
sdagueok, cool. I'll probably just poke folks on monday to get that sorted so I can push this through, as it's about end of day.20:31
Shrewsmordred: i think the *proper* thing to do is to have each process initiate their own client20:31
openstackgerritSpencer Krum proposed openstack-infra/system-config: Stop using data in openstack_project class  https://review.openstack.org/31627720:31
mordredbtw - remind me to plumb through the flag for "don't get extra specs" to get_flavor20:31
mordredShrews: I agree20:31
*** rfolco has joined #openstack-infra20:31
anteayasdague: yup, makes sense, enjoy your weekend20:31
Shrewsb/c i think the thing we are debugging is the actual test script20:31
nibalizerpabelanger: what do you think of 316277, kinda related to your changes around jenkins20:31
Shrewswhich is doing bad things20:31
*** roxanagh_ has joined #openstack-infra20:34
openstackgerritMerged openstack-infra/project-config: create os-api-ref project  https://review.openstack.org/31626020:34
mordredShrews: ++20:35
*** ddieterly[away] is now known as ddieterly20:35
*** ddieterly is now known as ddieterly[away]20:40
Shrewsmordred: cloudnull: yeah, this is neither a shade nor nova bug, but a fault of the test script. we have not lock around the client connections, so it's surprising this doesn't fail in more spectacular ways20:42
Shrewss/have not/have no/20:42
*** DevBox has quit IRC20:42
*** roxanagh_ has quit IRC20:42
mordredShrews: well, once multiprocess forks, nothing is sharing the cloud20:43
*** rfolco_ has joined #openstack-infra20:44
Shrewsmordred: all open file descriptors in the parent are shared by the children20:44
mordredShrews: oh right20:44
*** bpokorny has joined #openstack-infra20:44
*** roxanagh_ has joined #openstack-infra20:45
*** _ari_ has quit IRC20:45
Shrewsbeen a while since i've had to actually deal with this stuff, but Richard Stevens agrees with me (or I him rather)20:45
*** rfolco has quit IRC20:46
*** daemontool has joined #openstack-infra20:46
jeblairShrews, mordred: you're talking about python's multiprocessing module?20:46
*** gordc has quit IRC20:47
mordredjeblair: yes20:47
*** chem` has joined #openstack-infra20:47
*** scottynomad has quit IRC20:47
*** scottynomad has joined #openstack-infra20:48
*** psilvad has quit IRC20:48
jeblairi thought maybe it closes them?20:48
*** shamail has quit IRC20:49
*** wrightspace has quit IRC20:49
*** chem has quit IRC20:49
jeblairwhat script are we talking about?20:49
*** kzaitsev_mb has joined #openstack-infra20:49
*** e0ne has quit IRC20:51
*** psilvad has joined #openstack-infra20:52
*** jamesmcarthur has quit IRC20:52
*** daemontool has quit IRC20:52
*** jamesmcarthur has joined #openstack-infra20:54
Shrewsjeblair: nothing infra related. something cloudnull cooked up, i think20:54
*** doug-fis_ has joined #openstack-infra20:55
*** doug-fis_ has quit IRC20:55
clarkbyes it was an attempt to reproduce the failures nodepool was creating with floating ip attach timeouts20:56
*** mhickey has quit IRC20:57
*** Sukhdev has quit IRC20:57
*** eharney has joined #openstack-infra20:57
*** doug-fish has quit IRC20:58
openstackgerritDan Prince proposed openstack-infra/tripleo-ci: Update the cistatus report  https://review.openstack.org/31318920:58
*** sridhar_ram has joined #openstack-infra20:58
openstackgerritMerged openstack-infra/tripleo-ci: Update the cistatus report  https://review.openstack.org/31318921:00
*** rfolco_ has quit IRC21:01
*** ddieterly[away] is now known as ddieterly21:01
*** aysyd has quit IRC21:02
openstackgerritSpencer Krum proposed openstack-infra/system-config: Playbook to run upgrades  https://review.openstack.org/31226121:05
cloudnullShrews: sorry was afk whats up ?21:07
*** bauwser is now known as bauzas21:07
cloudnullah i cooked up that test script to try and reproduce issues infra was having in the osic cluster when creating a VM and attaching a float21:08
*** psilvad has quit IRC21:09
openstackgerritAndreas Florath proposed openstack/diskimage-builder: partitioning-parted: extraced and adapted element  https://review.openstack.org/31393821:09
cloudnullthe intent was to see why nodes weren't getting a float and doing the op in parallel was the only way I could reproduce it21:09
*** mixos has quit IRC21:11
cloudnullit could be an issue with the script but the error the script was producing was in line with what pabelanger and mordred were seeing from the infra side.21:11
*** regXboi has quit IRC21:11
openstackgerritMerged openstack-infra/system-config: Install the cloud launcher role on puppetmaster  https://review.openstack.org/31121321:11
openstackgerritMerged openstack-infra/system-config: Add run_cloud_launcher playbook  https://review.openstack.org/31124421:12
openstackgerritMerged openstack-infra/system-config: Remove unused param from puppetmaster class  https://review.openstack.org/31126721:13
openstackgerritMerged openstack-infra/system-config: Correct link to Freenode channel guidelines  https://review.openstack.org/30604221:14
*** ldnunes has quit IRC21:14
openstackgerritMerged openstack-infra/system-config: Link to Freenode's channel registration FAQ  https://review.openstack.org/30604321:15
*** tonytan4ever has quit IRC21:21
*** cbader_ has quit IRC21:24
*** amitgandhinz has quit IRC21:25
*** amitgandhinz has joined #openstack-infra21:25
*** amitgandhinz has quit IRC21:26
*** markvoelker has quit IRC21:26
*** lakshmiS has quit IRC21:26
openstackgerritKaiyan Sheng proposed openstack-infra/project-config: Add Tempest Jobs as non-voting for monasca repos  https://review.openstack.org/31629321:27
*** roxanagh_ has quit IRC21:27
*** baumann has left #openstack-infra21:28
*** lascii is now known as alaski21:28
cloudnullShrews: I modified the test script to instantiate the client in the job function -- https://gist.github.com/cloudnull/2f3931e51062dc7b325faf9a24974006#file-test-shade-with-isolated-client-py  -- on my last run i didn't have any duplicate VMs however I did still have instances without FIPs.21:30
*** xyang1 has quit IRC21:30
cloudnullidk if that helps at all .21:30
*** salv-orlando has quit IRC21:32
*** roxanagh_ has joined #openstack-infra21:32
*** _amrith_ is now known as amrith21:33
*** matt-borland has quit IRC21:33
mordredcloudnull: well that's good - the FIP problem is the one we really care about!21:36
*** salv-orlando has joined #openstack-infra21:37
*** tphummel has quit IRC21:42
*** resker has joined #openstack-infra21:43
*** keedya has quit IRC21:43
openstackgerritMatt Riedemann proposed openstack-infra/project-config: Add gate-tempest-dsvm-lvm job to nova's experimental queue  https://review.openstack.org/31629821:44
*** dprince has quit IRC21:45
*** esker has quit IRC21:46
*** jamesmcarthur has quit IRC21:46
*** jamesmcarthur has joined #openstack-infra21:46
*** esker has joined #openstack-infra21:47
*** resker has quit IRC21:48
*** roxanagh_ has quit IRC21:50
*** vhosakot has quit IRC21:50
*** tphummel has joined #openstack-infra21:51
*** MarkAtwood has joined #openstack-infra21:51
*** resker has joined #openstack-infra21:52
*** dmk0202 has joined #openstack-infra21:53
*** esker has quit IRC21:53
*** roxanagh_ has joined #openstack-infra21:53
dimsrbrndt : mordred : which CI tests are failing?21:54
*** jamesmcarthur has quit IRC21:54
jeblairsdague: i added you to the groups21:55
*** keedya has joined #openstack-infra21:56
rbrndtdims: anything on monasca-api repo will fail21:57
*** Sukhdev has joined #openstack-infra21:57
*** woodster_ has quit IRC21:58
*** mriedem has quit IRC21:59
dimsrbrndt : the dsvm tests or py27 tests or both?21:59
*** dimtruck is now known as zz_dimtruck21:59
*** daemontool has joined #openstack-infra21:59
rbrndtdims: both. There are other repos that will probably fail too, though they haven't been tested yet21:59
*** kzaitsev_mb has quit IRC22:00
*** ddieterly is now known as ddieterly[away]22:00
*** ddieterly[away] is now known as ddieterly22:03
*** claudiub has quit IRC22:04
*** rlandy has quit IRC22:05
*** dmk0202 has quit IRC22:06
*** asilenkov_ has quit IRC22:08
*** nadya has quit IRC22:09
openstackgerritMerged openstack-infra/zuul: Ansible launcher: add streaming console support  https://review.openstack.org/30950122:09
openstackgerritMerged openstack-infra/zuul: Add private_key_file configuration for launcher  https://review.openstack.org/31163922:09
openstackgerritMerged openstack-infra/zuul: Add usernname configuration option for launcher  https://review.openstack.org/31172522:09
*** ddieterly has quit IRC22:12
*** mixos has joined #openstack-infra22:12
*** jang has joined #openstack-infra22:12
*** jpr has quit IRC22:14
*** annegentle has joined #openstack-infra22:15
jeblairif there are any other infra-roots around, i wouldn't mind a review of https://review.openstack.org/31578122:17
*** hashar has quit IRC22:20
pabelangerjeblair: left a couple questions, but LGTM in general22:24
*** markvoelker has joined #openstack-infra22:27
*** amitgandhinz has joined #openstack-infra22:27
*** tpsilva has quit IRC22:27
openstackgerritJames E. Blair proposed openstack-infra/system-config: Add zuul launcher hosts  https://review.openstack.org/31578122:27
jeblairpabelanger: thanks!22:27
*** alex_xu has quit IRC22:30
*** daemontool has quit IRC22:31
*** markvoelker has quit IRC22:31
*** yamahata has quit IRC22:31
*** amitgandhinz has quit IRC22:32
*** _ari_ has joined #openstack-infra22:32
*** _ari_ has quit IRC22:33
*** alex_xu has joined #openstack-infra22:33
*** slaweq has quit IRC22:34
*** yamahata has joined #openstack-infra22:34
*** yamamoto has joined #openstack-infra22:35
*** |-paul-| has joined #openstack-infra22:35
*** jamesmcarthur has joined #openstack-infra22:36
*** abregman has quit IRC22:37
*** yamamoto has quit IRC22:38
*** yamamoto has joined #openstack-infra22:39
odyssey4mepabelanger what's the readiness in infra for having xenial jobs move to voting?22:40
*** jamesmcarthur has quit IRC22:40
*** rbrndt has quit IRC22:40
odyssey4mewe have several jobs ready to move to voting for both xenial and centos :)22:41
*** keedya has quit IRC22:41
pabelangerodyssey4me: I think were fine having them voting now. We are still missing a xenial wheel server, so build times will be slightly longer22:41
pabelangerodyssey4me: our mass migration is happening after we upgrade ubuntu-precise server to ubuntu-trusty, IIRC22:42
odyssey4meah ok, I think we're ok with that for now - most of the roles are infrastructure roles which don't have a lot of wheels needed22:43
odyssey4mealright, I'll probably start shifting things next week22:45
*** sridhar_ram has quit IRC22:46
*** hongbin has quit IRC22:46
openstackgerritMerged openstack-infra/system-config: Add zuul launcher hosts  https://review.openstack.org/31578122:46
*** yamamoto has quit IRC22:47
*** jpr has joined #openstack-infra22:47
*** sridhar_ram has joined #openstack-infra22:47
*** jang has quit IRC22:48
*** yamamoto has joined #openstack-infra22:48
*** yamamoto has quit IRC22:49
openstackgerritMerged openstack-infra/irc-meetings: Change time for FWaaS meeting  https://review.openstack.org/31530822:49
*** ddieterly has joined #openstack-infra22:50
odyssey4meI'm out for the weekend. Cheerio all!22:53
*** annegentle has quit IRC22:55
*** woodster_ has joined #openstack-infra22:58
*** lucas-afk has quit IRC23:05
*** ddieterly is now known as ddieterly[away]23:08
*** ddieterly[away] is now known as ddieterly23:09
*** lucasagomes has joined #openstack-infra23:12
*** ajmiller has quit IRC23:12
*** sdague has quit IRC23:13
*** salv-orlando has quit IRC23:16
*** roxanagh_ has quit IRC23:17
*** roxanagh_ has joined #openstack-infra23:18
*** baoli_ has quit IRC23:23
*** ekarlso has quit IRC23:23
*** timl0101 has quit IRC23:25
*** MarkAtwood has quit IRC23:25
nibalizerwell that's neat...23:26
nibalizerpuppetdb latest requires postgres 9.4+ and trusty apparently only has 9.323:26
*** MarkAtwood has joined #openstack-infra23:27
*** amitgandhinz has joined #openstack-infra23:27
*** markvoelker has joined #openstack-infra23:28
*** roxanagh_ has quit IRC23:28
*** cody-somerville has joined #openstack-infra23:29
*** roxanagh_ has joined #openstack-infra23:30
*** markvoelker has quit IRC23:32
*** ekarlso has joined #openstack-infra23:32
*** roxanagh_ has quit IRC23:32
*** amitgandhinz has quit IRC23:32
*** sputnik13 has quit IRC23:34
*** shashank_hegde has quit IRC23:37
*** mtanino has quit IRC23:41
*** jamesmcarthur has joined #openstack-infra23:43
*** r-mibu has quit IRC23:45
*** r-mibu has joined #openstack-infra23:45
*** sdague has joined #openstack-infra23:45
*** jamesmcarthur has quit IRC23:47
*** gyee has quit IRC23:49
*** yamamoto has joined #openstack-infra23:49
*** Qiming_ has joined #openstack-infra23:56
*** yamamoto has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!