| *** masber has joined #openstack-ironic | 00:21 | |
| *** jrist has quit IRC | 00:24 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 00:24 | |
| *** rpioso is now known as rpioso|afk | 00:27 | |
| *** AlexeyAbashkin has quit IRC | 00:28 | |
| *** jrist has joined #openstack-ironic | 00:36 | |
| *** pmannidi has quit IRC | 00:37 | |
| openstackgerrit | Paul Belanger proposed openstack/ironic stable/queens: Stop running non-voting jobs in gate https://review.openstack.org/546011 | 00:37 |
|---|---|---|
| *** pmannidi has joined #openstack-ironic | 00:40 | |
| *** priteau has joined #openstack-ironic | 00:47 | |
| *** priteau has quit IRC | 00:52 | |
| *** hshiina has joined #openstack-ironic | 01:01 | |
| openstackgerrit | Merged openstack/ironic master: Build instance PXE options for unrescue https://review.openstack.org/544278 | 01:11 |
| *** jlabarre has quit IRC | 01:20 | |
| *** mjturek has quit IRC | 01:21 | |
| openstackgerrit | Merged openstack/ironic stable/queens: Fix rare HTTP 400 from port list API https://review.openstack.org/545892 | 01:22 |
| openstackgerrit | Merged openstack/ironic stable/queens: Clean nodes stuck in CLEANING state when ir-cond restarts https://review.openstack.org/545893 | 01:22 |
| openstackgerrit | Merged openstack/ironic stable/queens: Allow sqalchemy filtering by id and uuid https://review.openstack.org/545806 | 01:23 |
| openstackgerrit | Merged openstack/ironic stable/pike: Allow sqalchemy filtering by id and uuid https://review.openstack.org/545854 | 01:23 |
| openstackgerrit | Merged openstack/ironic stable/ocata: Allow sqalchemy filtering by id and uuid https://review.openstack.org/545855 | 01:23 |
| *** khyr0n has quit IRC | 01:49 | |
| openstackgerrit | Michael Bayer proposed openstack/ironic master: Use oslo_db.sqlalchemy.test_fixtures https://review.openstack.org/545874 | 01:51 |
| *** vishwanathj has joined #openstack-ironic | 02:20 | |
| openstackgerrit | Merged openstack/networking-generic-switch stable/ocata: Zuul: Remove project name https://review.openstack.org/543938 | 02:23 |
| *** yangyapeng has quit IRC | 02:47 | |
| *** yangyapeng has joined #openstack-ironic | 02:47 | |
| *** harlowja has quit IRC | 02:52 | |
| *** yangyape_ has joined #openstack-ironic | 03:00 | |
| *** yangyapeng has quit IRC | 03:01 | |
| openstackgerrit | Merged openstack/networking-generic-switch stable/pike: Zuul: Remove project name https://review.openstack.org/543655 | 03:04 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Disable .pyc files for grenade multinode https://review.openstack.org/544750 | 03:10 |
| *** AlexeyAbashkin has joined #openstack-ironic | 03:24 | |
| *** AlexeyAbashkin has quit IRC | 03:29 | |
| openstackgerrit | Michael Bayer proposed openstack/ironic master: Use oslo_db.sqlalchemy.test_fixtures https://review.openstack.org/545874 | 03:33 |
| *** stendulker has joined #openstack-ironic | 03:47 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic stable/queens: DNM Test disabling .pyc files for Grenade https://review.openstack.org/545089 | 03:48 |
| openstackgerrit | Julia Kreger proposed openstack/ironic stable/queens: Build instance PXE options for unrescue https://review.openstack.org/546026 | 03:54 |
| *** links has joined #openstack-ironic | 04:21 | |
| *** bnemec-pto has quit IRC | 04:36 | |
| *** dpawar has joined #openstack-ironic | 04:37 | |
| *** l_jacob has joined #openstack-ironic | 04:43 | |
| *** l_jacob has quit IRC | 04:43 | |
| *** harlowja has joined #openstack-ironic | 04:54 | |
| openstackgerrit | Merged openstack/ironic master: Add docs for ansible deploy interface https://review.openstack.org/525501 | 05:04 |
| openstackgerrit | Ankit Kumar proposed openstack/ironic-tempest-plugin master: Test cases for iLO drivers in standalone ironic https://review.openstack.org/535652 | 05:13 |
| *** dpawar has quit IRC | 05:33 | |
| *** dpawar has joined #openstack-ironic | 05:43 | |
| *** dpawar has quit IRC | 05:43 | |
| *** dpawar has joined #openstack-ironic | 05:46 | |
| *** marios has joined #openstack-ironic | 06:21 | |
| *** priteau has joined #openstack-ironic | 06:23 | |
| *** priteau has quit IRC | 06:26 | |
| *** ptx0 has quit IRC | 06:27 | |
| *** ptx0 has joined #openstack-ironic | 06:28 | |
| *** bnemec has joined #openstack-ironic | 06:28 | |
| *** bnemec is now known as bnemec-pto | 06:29 | |
| *** dpawar has quit IRC | 06:32 | |
| *** mjura has joined #openstack-ironic | 06:37 | |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Add check for (i)PXE and Ironic location coherence https://review.openstack.org/545711 | 07:09 |
| *** threestrands has quit IRC | 07:10 | |
| *** harlowja has quit IRC | 07:10 | |
| *** rcernin has quit IRC | 07:12 | |
| openstackgerrit | Merged openstack/ironic master: Update comment and mock about autospec not working on staticmethods https://review.openstack.org/545866 | 07:22 |
| pas-ha | morning ironic :) | 07:24 |
| *** dpawar has joined #openstack-ironic | 07:25 | |
| *** ijw has joined #openstack-ironic | 07:33 | |
| hshiina | morning pas-ha | 07:33 |
| *** ijw has quit IRC | 07:33 | |
| *** ijw has joined #openstack-ironic | 07:34 | |
| *** ijw has quit IRC | 07:34 | |
| *** ijw has joined #openstack-ironic | 07:35 | |
| *** vsaienk0 has joined #openstack-ironic | 07:35 | |
| *** pcaruana has joined #openstack-ironic | 07:35 | |
| openstackgerrit | Ankit Kumar proposed openstack/ironic-tempest-plugin master: Test cases for iLO drivers in standalone ironic https://review.openstack.org/535652 | 07:45 |
| *** AlexeyAbashkin has joined #openstack-ironic | 07:53 | |
| *** MattMan has quit IRC | 08:03 | |
| *** MattMan has joined #openstack-ironic | 08:03 | |
| *** yangyape_ has quit IRC | 08:10 | |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Add check for (i)PXE and Ironic location coherence https://review.openstack.org/545711 | 08:15 |
| *** yangyapeng has joined #openstack-ironic | 08:17 | |
| openstackgerrit | Merged openstack/ironic-ui master: Imported Translations from Zanata https://review.openstack.org/541143 | 08:17 |
| *** tesseract has joined #openstack-ironic | 08:20 | |
| *** hoonetorg has quit IRC | 08:24 | |
| *** serlex has joined #openstack-ironic | 08:25 | |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Raw image size estimation improved https://review.openstack.org/544839 | 08:26 |
| *** yangyapeng has quit IRC | 08:27 | |
| *** milan_ has quit IRC | 08:28 | |
| *** yangyapeng has joined #openstack-ironic | 08:38 | |
| *** hoonetorg has joined #openstack-ironic | 08:42 | |
| *** dtantsur|afk is now known as dtantsur | 08:47 | |
| dtantsur | morning ironic | 08:47 |
| *** yangyape_ has joined #openstack-ironic | 08:49 | |
| *** yangyapeng has quit IRC | 08:50 | |
| *** priteau has joined #openstack-ironic | 08:56 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/queens: Add docs for ansible deploy interface https://review.openstack.org/546079 | 08:59 |
| *** hshiina is now known as hshiina|afk | 09:00 | |
| *** serlex has quit IRC | 09:03 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/pike: Clean nodes stuck in CLEANING state when ir-cond restarts https://review.openstack.org/546083 | 09:04 |
| *** bfournie has quit IRC | 09:06 | |
| *** bfournie has joined #openstack-ironic | 09:07 | |
| *** bfournie has quit IRC | 09:07 | |
| *** hshiina|afk has quit IRC | 09:08 | |
| *** milan_ has joined #openstack-ironic | 09:12 | |
| dtantsur | stendulker, TheJulia, hi, if/when you're around: https://review.openstack.org/#/c/545285/ | 09:16 |
| patchbot | patch 545285 - ironic-inspector - Switch documentation to hardware types | 09:16 |
| *** pmannidi has quit IRC | 09:16 | |
| stendulker | sure dtantsur | 09:16 |
| *** e0ne has joined #openstack-ironic | 09:18 | |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Remove some hardcoded values and use variables instead https://review.openstack.org/546089 | 09:19 |
| *** mgoddard_ has joined #openstack-ironic | 09:30 | |
| *** racedo has joined #openstack-ironic | 09:32 | |
| *** derekh has joined #openstack-ironic | 09:41 | |
| *** etingof has quit IRC | 09:59 | |
| *** milan_ has quit IRC | 10:10 | |
| *** milan_ has joined #openstack-ironic | 10:16 | |
| *** d0ugal_ has joined #openstack-ironic | 10:31 | |
| *** etingof has joined #openstack-ironic | 10:33 | |
| *** parlos has joined #openstack-ironic | 10:34 | |
| *** d0ugal has quit IRC | 10:34 | |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Support nested objects and object lists in as_dict https://review.openstack.org/545830 | 10:37 |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Register traits on nodes in devstack https://review.openstack.org/545370 | 10:37 |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Validate instance_info.traits against node traits https://review.openstack.org/543461 | 10:37 |
| *** rajinir has quit IRC | 10:43 | |
| openstackgerrit | Mark Goddard proposed openstack/bifrost master: Support storage of introspection data in Nginx https://review.openstack.org/460005 | 10:44 |
| *** _milan_ has joined #openstack-ironic | 10:46 | |
| *** milan_ has quit IRC | 10:46 | |
| *** rajinir has joined #openstack-ironic | 10:46 | |
| *** d0ugal_ has quit IRC | 10:50 | |
| *** d0ugal has joined #openstack-ironic | 10:51 | |
| *** d0ugal has quit IRC | 10:51 | |
| *** d0ugal has joined #openstack-ironic | 10:51 | |
| *** dtantsur is now known as dtantsur|brb | 10:54 | |
| *** _milan_ has quit IRC | 10:58 | |
| *** ijw has quit IRC | 11:02 | |
| openstackgerrit | Merged openstack/ironic stable/queens: Build instance PXE options for unrescue https://review.openstack.org/546026 | 11:03 |
| *** lucas-afk is now known as lucasagomes | 11:13 | |
| *** vsaienk0 has quit IRC | 11:25 | |
| *** vsaienk0 has joined #openstack-ironic | 11:26 | |
| *** stendulker has quit IRC | 11:27 | |
| *** _milan_ has joined #openstack-ironic | 11:49 | |
| *** vabada has joined #openstack-ironic | 11:50 | |
| *** crushil_ has quit IRC | 11:54 | |
| *** zshi has joined #openstack-ironic | 11:54 | |
| *** crushil_ has joined #openstack-ironic | 11:54 | |
| *** Goneri has quit IRC | 12:34 | |
| *** dprince has joined #openstack-ironic | 12:40 | |
| *** jlabarre has joined #openstack-ironic | 12:43 | |
| *** vsaienk0 has quit IRC | 12:47 | |
| *** vsaienk0 has joined #openstack-ironic | 12:49 | |
| *** bnemec-pto has quit IRC | 12:49 | |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Add parametrization of Ironic locations https://review.openstack.org/545373 | 12:49 |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Add check for (i)PXE and Ironic location coherence https://review.openstack.org/545711 | 12:49 |
| *** bnemec has joined #openstack-ironic | 12:51 | |
| *** _milan_ is now known as milan_ | 13:00 | |
| *** milan_ has quit IRC | 13:00 | |
| *** milan_ has joined #openstack-ironic | 13:01 | |
| openstackgerrit | Ilya Etingof proposed openstack/ironic master: Raw image size estimation improved https://review.openstack.org/544839 | 13:02 |
| jroll | morning y'all | 13:06 |
| *** dpawar has quit IRC | 13:25 | |
| *** dpawar has joined #openstack-ironic | 13:25 | |
| *** dpawar has quit IRC | 13:27 | |
| *** jcoufal has joined #openstack-ironic | 13:28 | |
| *** dtantsur|brb is now known as dtantsur | 13:32 | |
| dtantsur | morning jroll | 13:32 |
| *** cdearborn has joined #openstack-ironic | 13:45 | |
| *** rloo has joined #openstack-ironic | 13:54 | |
| *** jcoufal_ has joined #openstack-ironic | 13:59 | |
| *** jcoufal has quit IRC | 14:01 | |
| TheJulia | Good morning everyone | 14:05 |
| jroll | \o | 14:08 |
| *** Goneri has joined #openstack-ironic | 14:08 | |
| * TheJulia makes coffee | 14:10 | |
| jroll | does anyone know a good US vendor for buying bulk cat6 cable? monoprice looks good, but they want $100 to ship 2 1000 ft spools | 14:14 |
| *** links has quit IRC | 14:15 | |
| dtantsur | morning TheJulia | 14:17 |
| TheJulia | jroll: do you have a local graybar? | 14:19 |
| jroll | TheJulia: apparently! | 14:20 |
| jroll | you're the second person that said check locally, gonna call some places. thanks :) | 14:21 |
| TheJulia | See if you can buy from them, sometimes they don't like consumer customers... but their prices are reasonable | 14:21 |
| jroll | awesome, ty | 14:21 |
| TheJulia | graybar ws my go-to place when I was doing datacenter or work on remote office networks | 14:22 |
| TheJulia | Something about wiring is cathartic for me... | 14:22 |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Register traits on nodes in devstack https://review.openstack.org/545370 | 14:25 |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Validate instance_info.traits against node traits https://review.openstack.org/543461 | 14:25 |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Add check for (i)PXE and Ironic location coherence https://review.openstack.org/545711 | 14:29 |
| *** mjturek has joined #openstack-ironic | 14:29 | |
| *** vsaienk0 has quit IRC | 14:30 | |
| TheJulia | dtantsur: https://review.openstack.org/#/c/545285/2 looks pretty good, a couple minor inconsistencies though | 14:32 |
| patchbot | patch 545285 - ironic-inspector - Switch documentation to hardware types | 14:32 |
| TheJulia | olivierbourdon38: <3 | 14:32 |
| dtantsur | ack, will fix | 14:32 |
| TheJulia | dtantsur: awesome | 14:33 |
| olivierbourdon38 | Hello, TheJulia | 14:33 |
| rloo | Good morning olivierbourdon38, TheJulia, dtantsur, jroll and everyone else! | 14:42 |
| dtantsur | morning rloo | 14:42 |
| olivierbourdon38 | morning rloo | 14:43 |
| jroll | morning rloo, welcome back | 14:43 |
| rloo | TheJulia (and others): wrt https://review.openstack.org/#/c/334967/, I'm not that knowledgeable about dbs. wrt rolling upgrades: we update the db, an upgraded conductor adds a BIG config drive, an old conductor tries to read instance-info/configdrive. will it cut off at TEXT size? | 14:44 |
| patchbot | patch 334967 - ironic - Increase the instance_info column size to LONGTEXT... | 14:44 |
| rloo | TheJulia: david edery explained in comment, patch set 8, but I don't grok it. | 14:44 |
| rloo | TheJulia: and i might add, I feel said that it took this long to get this patch in :-( | 14:45 |
| *** vsaienk0 has joined #openstack-ironic | 14:45 | |
| rloo | s/said/sad/ | 14:45 |
| openstackgerrit | Julia Kreger proposed openstack/ironic stable/queens: DNM Test disabling .pyc files for Grenade https://review.openstack.org/545089 | 14:46 |
| TheJulia | rloo: I was more thinking from upgrade strategy standpoint, although it is a column locking schema change, it shouldn't lock the table for long nor rewrite the table | 14:46 |
| rloo | TheJulia: if the multinode grenade were working, wondering if we could test this | 14:47 |
| TheJulia | I don't think the other conductor will care, we've also had people come in here and say that they have changed the column type | 14:47 |
| TheJulia | without issues to fix this issue | 14:48 |
| jroll | I suspect sqlalchemy will just read the whole thing | 14:48 |
| TheJulia | what jroll said | 14:48 |
| rloo | i guess i am curious. if the whole thing will get read, why would we need to do L139: https://review.openstack.org/#/c/334967/11/ironic/db/sqlalchemy/models.py | 14:48 |
| patchbot | patch 334967 - ironic - Increase the instance_info column size to LONGTEXT... | 14:48 |
| TheJulia | rloo: oh please no, not something on top of our most unstable test ever | 14:48 |
| rloo | TheJulia: heh, c'mon, it'd be fun! | 14:49 |
| TheJulia | Speaking of which, the patch I just pushed should be intresting to watch. seems ironic's api was down for far too long, so trying a restart... | 14:49 |
| TheJulia | of n-cpu | 14:49 |
| * TheJulia expects it to all explode | 14:49 | |
| jroll | rloo: alembic uses those models to generate the schema for migrations. and there's likely validation on write there | 14:50 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: [ansible] use manual-mgmt hw type in unit tests https://review.openstack.org/546165 | 14:50 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: [ansible] extend root device hints support https://review.openstack.org/546166 | 14:50 |
| *** parlos has quit IRC | 14:50 | |
| rloo | jroll: ok, so needed for writes, but not for reads. | 14:50 |
| jroll | rloo: I'm nowhere near 100%, that's just my best guess | 14:50 |
| jroll | TheJulia: if ironic's API is down for too long, n-cpu should pick back up at the next RT run | 14:50 |
| jroll | (with caveats that it's totally f'd if placement is also down) | 14:51 |
| TheJulia | jroll: http://logs.openstack.org/89/545089/10/check/ironic-grenade-dsvm-multinode-multitenant/c023e10/logs signal 11'ed, n-cond still running in those logs | 14:51 |
| TheJulia | err | 14:52 |
| TheJulia | no | 14:52 |
| jroll | TheJulia: which service segv'd? | 14:52 |
| TheJulia | nova-conductor is dead | 14:52 |
| jroll | wtf | 14:52 |
| jroll | Feb 20 05:40:06 ubuntu-xenial-rax-iad-0002626633 kernel: nova-conductor[28342]: segfault at d0 ip 00000000004f8f8e sp 00007ffe4f382fc0 error 4 in python2.7[400000+2de000] | 14:52 |
| jroll | -.- | 14:53 |
| *** hoonetorg has quit IRC | 14:54 | |
| TheJulia | and the conductor log ends a few minutes prior, no rspawning task | 14:55 |
| jroll | yeah, I suspect n-cond's main process doesn't log anything, only the workers it spawns (which segfault here) log | 14:56 |
| TheJulia | by 5:35:58 we're already moving to restart ironic, before the system logs the first segfault | 14:57 |
| jroll | TheJulia: naturally, ansible skipped your debug log | 14:58 |
| TheJulia | if you look at the task before | 14:58 |
| TheJulia | you'll see output that would hav ebene otherwise supressed | 14:58 |
| jroll | ah right | 14:59 |
| TheJulia | Feb 20 05:35:37.393353 ubuntu-xenial-rax-iad-0002626633 systemd[1]: devstack@n-cpu.service: Main process exited, code=killed, status=11/SEGV | 14:59 |
| TheJulia | interesting | 14:59 |
| *** d0ugal has quit IRC | 14:59 | |
| jroll | hrm | 14:59 |
| *** d0ugal has joined #openstack-ironic | 15:00 | |
| *** milan_ has quit IRC | 15:00 | |
| TheJulia | http://logs.openstack.org/89/545089/10/check/ironic-grenade-dsvm-multinode-multitenant/c023e10/logs/grenade.sh.txt.gz#_2018-02-20_05_35_38_178 | 15:02 |
| *** lucasagomes is now known as lucas-hungry | 15:02 | |
| TheJulia | http://logs.openstack.org/89/545089/10/check/ironic-grenade-dsvm-multinode-multitenant/c023e10/logs/grenade.sh.txt.gz#_2018-02-20_05_35_38_178 | 15:03 |
| TheJulia | err, yeah, pasted it the first time | 15:03 |
| jroll | hm | 15:05 |
| * jroll needs to step away for a few | 15:05 | |
| hjensas | Anyone who have experience with docker/kolla? I am trying to do something here: https://review.openstack.org/546173 , but I have no idea what I'm doing. | 15:05 |
| patchbot | patch 546173 - kolla - Add networking-baremetal - ironic-neutron-agent | 15:05 |
| *** dpawar has joined #openstack-ironic | 15:06 | |
| *** r-daneel has joined #openstack-ironic | 15:07 | |
| *** baha has joined #openstack-ironic | 15:09 | |
| *** dtantsur is now known as dtantsur|brb | 15:11 | |
| *** vsaienk0 has quit IRC | 15:12 | |
| *** vsaienk0 has joined #openstack-ironic | 15:17 | |
| rloo | dtantsur|brb: you going to finish this patch too? (related to the CLEANING one you just did): https://review.openstack.org/#/c/350439/ | 15:18 |
| patchbot | patch 350439 - ironic - Clean nodes stuck in DELETING state when ir-cond r... | 15:18 |
| *** rpioso|afk is now known as rpioso | 15:20 | |
| rpioso | Good morning, all | 15:20 |
| *** hoonetorg has joined #openstack-ironic | 15:25 | |
| NobodyCam | Good Morning Ironic'ers :) | 15:32 |
| TheJulia | good morning NobodyCam | 15:35 |
| NobodyCam | :) Good Morning TheJulia :) | 15:36 |
| *** d0ugal has quit IRC | 15:36 | |
| *** d0ugal has joined #openstack-ironic | 15:40 | |
| rloo | TheJulia: out of curiosity, what was the story wrt this revert? Should we update some documentation? https://review.openstack.org/#/c/544743/ | 15:43 |
| patchbot | patch 544743 - ironic - Revert "Clean up RPC versions and database migrati... (ABANDONED) | 15:43 |
| TheJulia | rloo: to;Dr we started to make breaking changes on rocket before the default job settings landed for Rocky to really start in terms of what the upgrades should be | 15:44 |
| rloo | TheJulia: so we need to wait til that switch is done, for grenade to test queens -> master? | 15:45 |
| TheJulia | Basically yeah | 15:46 |
| rloo | TheJulia: argh. ok. will update our docs. sigh. | 15:46 |
| TheJulia | But infra/qa landed the change within 24 hours | 15:46 |
| rloo | TheJulia: w/i 24 hours of what? someone proposing the patch? | 15:46 |
| TheJulia | Of me inquiring when it would land | 15:47 |
| TheJulia | Actually, it was an hour after my inquery, within 24 hours of being found | 15:48 |
| rloo | TheJulia: heh. ok, so we can poke them then :) | 15:48 |
| *** dpawar has quit IRC | 15:51 | |
| *** dpawar has joined #openstack-ironic | 15:51 | |
| *** d0ugal has quit IRC | 15:52 | |
| *** dpawar has quit IRC | 15:55 | |
| openstackgerrit | Merged openstack/ironic master: Implements validate_rescue() for IloVirtualMediaBoot https://review.openstack.org/453012 | 15:57 |
| mgoddard_ | anyone good with grenade? | 16:00 |
| mgoddard_ | https://review.openstack.org/#/c/545370/ | 16:00 |
| patchbot | patch 545370 - ironic - Register traits on nodes in devstack | 16:00 |
| mgoddard_ | I want to wait for traits to appear in placement, like we do for resource providers already | 16:00 |
| mgoddard_ | but in the grenade tests, my wait never completes, presumably because nova is pike | 16:01 |
| jroll | mmm, ironic-grenade-dsvm should upgrade everything | 16:01 |
| mgoddard_ | oh | 16:01 |
| jroll | iirc | 16:02 |
| TheJulia | it does not | 16:02 |
| TheJulia | it skips nova | 16:02 |
| jroll | well, unless ironic is upgraded first | 16:02 |
| *** mjura has quit IRC | 16:02 | |
| jroll | O_o | 16:02 |
| TheJulia | because we can't control the upgrade order | 16:02 |
| TheJulia | well | 16:02 |
| TheJulia | there are two scenarios | 16:02 |
| TheJulia | and I'm thinking of the one we don't upgrade which is multinode | 16:02 |
| jroll | right, this is "regular" grenade | 16:02 |
| TheJulia | yeah | 16:03 |
| jroll | but yeah, nova is pike at the failure point | 16:03 |
| * jroll thinks there must be something to indicate the nova version | 16:04 | |
| mgoddard_ | I tried checking the placement API version, but that seems to be queens | 16:04 |
| mgoddard_ | perhaps placement is upgraded but nova is not? | 16:05 |
| *** afazekas is now known as afazekas|air | 16:05 | |
| jroll | hrm | 16:05 |
| * TheJulia loads the logs | 16:05 | |
| TheJulia | so in that scenario, nova should be getting upgraded, but nova-compute may not have been restarted | 16:06 |
| TheJulia | we have to explicitly restart it later | 16:06 |
| *** dtantsur|brb is now known as dtantsur | 16:06 | |
| jroll | that's what I was wondering | 16:06 |
| *** milan_ has joined #openstack-ironic | 16:06 | |
| TheJulia | As part of the upgrade sequence | 16:06 |
| mgoddard_ | ah, I see | 16:06 |
| TheJulia | Yeah.... | 16:06 |
| mgoddard_ | that sounds hard to check for :( | 16:06 |
| dtantsur | rloo: I'm planning on, but it's less urgent as it's much harder to catch a node in DELETING | 16:06 |
| *** d0ugal has joined #openstack-ironic | 16:07 | |
| jroll | yeah, looks like the last time n-cpu restarts is pike | 16:07 |
| rloo | dtantsur: ok, no worries, but figured we might as well get that all done. and it is an easy code change since you refactored it. just needs tests maybe :) | 16:07 |
| TheJulia | mgoddard_: it will never won't work on multinode as nova never gets upgraded in that scenario. | 16:08 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic-inspector master: Switch documentation to hardware types https://review.openstack.org/545285 | 16:09 |
| mgoddard_ | TheJulia, jroll: is there an easy place to see the grenade job sequences? | 16:10 |
| jroll | yeah.... about that | 16:10 |
| jroll | not really, AIUI :( | 16:10 |
| dtantsur | rloo, TheJulia, so what's the conclusion re https://review.openstack.org/#/c/334967/ ? we have 3x +2 and nobody dares +A :) | 16:11 |
| patchbot | patch 334967 - ironic - Increase the instance_info column size to LONGTEXT... | 16:11 |
| rloo | dtantsur: OH. I thought it was only me that didn't dare. | 16:11 |
| jroll | mgoddard_: oh, actually, this is the order: https://github.com/openstack-dev/grenade/tree/master/projects | 16:12 |
| TheJulia | re: pike->queens multinode grenade, we're basically back to the incompatability issues between the two sitting in the same venv. Nova might go sideways upon being able to talk to an ironic api again, and we simply can't restart. Why not just call the subnode api and upgrade the local api to queens? | 16:12 |
| rloo | dtantsur: we're not going to backport that, right? | 16:12 |
| dtantsur | rloo: I was thinking of backporting to queens. we cannot backport the migration any further | 16:12 |
| TheJulia | mgoddard_: so the thing to keep in mind is that since ironic is not a "core" project for grenade and since we use a plugin, we execute after nova. | 16:12 |
| rloo | dtantsur: OH. | 16:13 |
| jroll | mgoddard_: and this adds ironic to the list: https://github.com/openstack/ironic/blob/master/devstack/upgrade/settings#L10 | 16:13 |
| rloo | dtantsur: I guess the question is if anyone is confident that this will work. otherwise, we're going to have a mess on our hands. | 16:13 |
| * dtantsur double-checks on his devstack | 16:13 | |
| TheJulia | mgoddard_: line 27 is how we also rip nova out of grenade for multinode | 16:14 |
| * jroll wonders where our regular grenade job stops n-cpu from restarting | 16:14 | |
| rloo | dtantsur: what is needed to stop saving configdrive to DB? is it straightforward code? | 16:14 |
| TheJulia | jroll: it is deep inside of nova's upgrade job | 16:14 |
| TheJulia | s/job/script/ | 16:14 |
| mgoddard_ | TheJulia: thanks, that helps | 16:14 |
| dtantsur | rloo: I don't if we can do it at all.. what should we do about people who do not supply configdrive with the rebuild command? | 16:15 |
| jroll | oh jeez | 16:15 |
| dtantsur | * don't know | 16:15 |
| TheJulia | rloo: it is a behavior change | 16:15 |
| *** links has joined #openstack-ironic | 16:15 | |
| TheJulia | rloo: tl;dr there is no good solution for now except to shift the burden to the db | 16:15 |
| rloo | dtantsur, TheJulia: OH. ok, so nothing that will happen in the very near future wrt not saving configdrive. | 16:16 |
| TheJulia | also, it is likely too late to try and hack that out to drop into queens to release | 16:16 |
| rloo | dtantsur, TheJulia: would be good to land that then. But -- has it been tested? | 16:16 |
| TheJulia | rloo: what been tested? | 16:16 |
| TheJulia | the column width? | 16:16 |
| *** d0ugal has quit IRC | 16:17 | |
| rloo | TheJulia: the DB resize thing. with a big DB, during rolling upgrades. | 16:17 |
| rloo | TheJulia: someone needs to be confident that it works... | 16:17 |
| * TheJulia pulls the rolling upgrade instructions up | 16:17 | |
| TheJulia | I'm confident in that it is a schema only change and that the db is not going to re-write the table | 16:18 |
| dtantsur | rloo: if someone has a big DB with rolling upgrades... | 16:18 |
| TheJulia | and besides, big databases with any changes can take time when data needs to be massaged/changed | 16:18 |
| dtantsur | just ran it locally, works is expected. but I only have 3 nodes.. | 16:19 |
| rloo | dtantsur: yeah, which isn't me. jroll, are you interested in https://review.openstack.org/#/c/334967/? any chance you tested it? | 16:19 |
| patchbot | patch 334967 - ironic - Increase the instance_info column size to LONGTEXT... | 16:19 |
| jroll | rloo: I'm not more interested than anyone else, and no I haven't tested it | 16:20 |
| rloo | jroll: thx | 16:20 |
| *** pcaruana has quit IRC | 16:21 | |
| *** lucas-hungry is now known as lucasagomes | 16:24 | |
| *** AlexeyAbashkin has quit IRC | 16:26 | |
| TheJulia | I'm going to +a the schema change if nobody objects in the next ten minutes | 16:27 |
| * jroll is fine | 16:28 | |
| * jroll -> lunch | 16:28 | |
| *** ricardoas has quit IRC | 16:30 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic stable/queens: DNM Test disabling .pyc files for Grenade https://review.openstack.org/545089 | 16:33 |
| *** vsaienk0 has quit IRC | 16:33 | |
| *** d0ugal has joined #openstack-ironic | 16:34 | |
| * TheJulia hopes there will be copious tasty beverages after dealing with grenade | 16:39 | |
| * TheJulia begins pondering rewrite | 16:42 | |
| *** e0ne has quit IRC | 16:47 | |
| openstackgerrit | Ruby Loo proposed openstack/ironic master: Update release instructions wrt grenade https://review.openstack.org/546229 | 16:47 |
| *** r-daneel has quit IRC | 16:55 | |
| *** d0ugal has quit IRC | 16:59 | |
| *** crushil_ has quit IRC | 17:00 | |
| *** akhilaki has joined #openstack-ironic | 17:01 | |
| *** baha has quit IRC | 17:02 | |
| *** d0ugal has joined #openstack-ironic | 17:03 | |
| *** milan_ has quit IRC | 17:10 | |
| *** r-daneel has joined #openstack-ironic | 17:13 | |
| rloo | TheJulia: this conflicts with the column resize patch: https://review.openstack.org/#/c/545874/ | 17:16 |
| patchbot | patch 545874 - ironic - Use oslo_db.sqlalchemy.test_fixtures | 17:16 |
| rloo | TheJulia: I'd like to +A but if you were going to +A the column resize, easier to rebase this one. dunno. | 17:16 |
| * TheJulia sighs | 17:19 | |
| TheJulia | yeah | 17:19 |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Register traits on nodes in devstack https://review.openstack.org/545370 | 17:21 |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Validate instance_info.traits against node traits https://review.openstack.org/543461 | 17:21 |
| openstackgerrit | Julia Kreger proposed openstack/ironic master: Increase the instance_info column size to LONGTEXT on MySQL/MariaDB https://review.openstack.org/334967 | 17:22 |
| *** ricardoas has joined #openstack-ironic | 17:23 | |
| *** harlowja has joined #openstack-ironic | 17:23 | |
| TheJulia | rloo: I put my +2 on the column width change after rebasing it | 17:24 |
| *** vsaienk0 has joined #openstack-ironic | 17:24 | |
| rloo | TheJulia: thx! | 17:24 |
| dtantsur | thanks TheJulia | 17:25 |
| dtantsur | so we'll need to backport them in the same sequence | 17:25 |
| *** marios has quit IRC | 17:25 | |
| TheJulia | yup | 17:27 |
| *** crushil_ has joined #openstack-ironic | 17:29 | |
| mgoddard_ | shameless plug of my summit proposal on hardware discovery & provisioning: https://www.openstack.org/summit/vancouver-2018/vote-for-speakers/#/21146 | 17:36 |
| TheJulia | :) | 17:36 |
| *** pcaruana has joined #openstack-ironic | 17:36 | |
| mgoddard_ | a bit less relevant, but this one on kayobe (featuring bifrost) will also be great! https://www.openstack.org/summit/vancouver-2018/vote-for-speakers/#/20979 | 17:37 |
| *** links has quit IRC | 17:37 | |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: DNM experiment re-using devstack-tempest job https://review.openstack.org/520167 | 17:38 |
| openstackgerrit | Pavlo Shchelokovskyy proposed openstack/ironic master: DNM experiment re-using devstack-tempest job https://review.openstack.org/520167 | 17:38 |
| *** d0ugal has quit IRC | 17:38 | |
| * TheJulia smiles and thinks today is a good day | 17:39 | |
| *** ricardoas1 has joined #openstack-ironic | 17:41 | |
| *** derekh has quit IRC | 17:42 | |
| *** baha has joined #openstack-ironic | 17:43 | |
| *** ricardoas has quit IRC | 17:45 | |
| *** devananda has joined #openstack-ironic | 17:46 | |
| *** dprince has quit IRC | 17:47 | |
| dtantsur | mgoddard_: /me votes | 17:48 |
| dtantsur | I'll try to watch the recordings if they get accepted :) | 17:48 |
| mgoddard_ | thanks dtantsur. I'll try to ensure they don't make you fall asleep if they get accepted :) | 17:49 |
| *** ricardoas1 has quit IRC | 17:49 | |
| *** jtomasek has quit IRC | 17:54 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 17:57 | |
| *** d0ugal has joined #openstack-ironic | 18:00 | |
| *** dprince has joined #openstack-ironic | 18:01 | |
| *** AlexeyAbashkin has quit IRC | 18:02 | |
| *** mgoddard_ has quit IRC | 18:03 | |
| *** etingof has quit IRC | 18:03 | |
| *** openstackgerrit has quit IRC | 18:03 | |
| *** d0ugal has quit IRC | 18:05 | |
| *** d0ugal has joined #openstack-ironic | 18:11 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 18:13 | |
| *** pcaruana has quit IRC | 18:16 | |
| *** AlexeyAbashkin has quit IRC | 18:17 | |
| *** openstackgerrit has joined #openstack-ironic | 18:19 | |
| openstackgerrit | Merged openstack/ironic stable/queens: Add docs for ansible deploy interface https://review.openstack.org/546079 | 18:19 |
| *** harlowja has quit IRC | 18:23 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic stable/queens: DNM Test disabling .pyc files for Grenade https://review.openstack.org/545089 | 18:28 |
| *** d0ugal has quit IRC | 18:38 | |
| *** d0ugal has joined #openstack-ironic | 18:39 | |
| *** mgoddard_ has joined #openstack-ironic | 18:41 | |
| *** hamzy has quit IRC | 18:44 | |
| *** tesseract has quit IRC | 18:45 | |
| * dtantsur reworks handling orphaned nodes | 18:47 | |
| *** hamzy has joined #openstack-ironic | 18:48 | |
| *** d0ugal has quit IRC | 18:51 | |
| *** milan has joined #openstack-ironic | 18:52 | |
| *** harlowja has joined #openstack-ironic | 18:55 | |
| openstackgerrit | Merged openstack/ironic master: Fix default object versioning for Rocky https://review.openstack.org/545480 | 18:55 |
| openstackgerrit | Merged openstack/ironic master: Use oslo_db.sqlalchemy.test_fixtures https://review.openstack.org/545874 | 18:55 |
| *** d0ugal_ has joined #openstack-ironic | 18:57 | |
| *** harlowja_ has joined #openstack-ironic | 18:59 | |
| *** harlowja has quit IRC | 18:59 | |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic master: [WIP] Rework logic handling reserved orphaned nodes in the conductor https://review.openstack.org/546273 | 19:05 |
| dtantsur | jroll, TheJulia, how crazy is ^^^ wdyt? | 19:05 |
| openstackgerrit | Dmitry Tantsur proposed openstack/ironic stable/queens: Use oslo_db.sqlalchemy.test_fixtures https://review.openstack.org/546274 | 19:06 |
| * TheJulia ponders | 19:08 | |
| TheJulia | I kind of like it, and it makes sense + fixes some of the interaction headaches that can be had when one is intentionally breaking things | 19:12 |
| *** mjturek has quit IRC | 19:15 | |
| *** athomas has quit IRC | 19:16 | |
| * dtantsur will play with it tomorrow to see how it behaves | 19:16 | |
| dtantsur | and wow, so many interesting talks proposed involving ironic! | 19:17 |
| *** mjturek has joined #openstack-ironic | 19:17 | |
| TheJulia | indeed! I'm super excited about it all. | 19:19 |
| *** hamzy has quit IRC | 19:19 | |
| * TheJulia resumes containing excitement | 19:19 | |
| dtantsur | already a few talks about ironic in a public cloud, w00t! | 19:21 |
| dtantsur | I already imagine how I pull the armchair closer to the screen, get beer and snacks and watch the talks :D | 19:23 |
| jroll | nice :) | 19:23 |
| * jroll clicks the crazy patch | 19:23 | |
| openstackgerrit | Mark Goddard proposed openstack/ironic master: Register traits on nodes in devstack https://review.openstack.org/545370 | 19:24 |
| *** hamzy has joined #openstack-ironic | 19:25 | |
| * dtantsur sees jroll with a new haircut, cool :) | 19:27 | |
| jroll | dtantsur: ha! I wasn't sure if I got it cut right before boston or right after | 19:27 |
| dtantsur | jroll: certainly before you submitted your talk ;) | 19:28 |
| jroll | yes, it was last spring/summer sometime | 19:28 |
| jroll | dtantsur: that patch seems like a good idea in general | 19:31 |
| *** mgoddard_ has quit IRC | 19:31 | |
| jroll | doesn't look like you're handling CLEANING yet, but easy to fix | 19:31 |
| openstackgerrit | Merged openstack/ironic stable/queens: Use oslo_db.sqlalchemy.test_fixtures https://review.openstack.org/546274 | 19:36 |
| dtantsur | jroll: I had cleaning there, and then removed it before submission to reduce the scope of this patch :) | 19:40 |
| jroll | dtantsur: fair enough, it's in your docstring though :P | 19:40 |
| dtantsur | daaamn :) | 19:40 |
| dtantsur | it will be the next patch | 19:41 |
| * dtantsur wonders if he needs to bribe someone with beer at the PTG to approve https://review.openstack.org/#/c/334967/ :D | 19:42 | |
| patchbot | patch 334967 - ironic - Increase the instance_info column size to LONGTEXT... | 19:42 |
| * jroll would do it if he could | 19:43 | |
| *** d0ugal_ has quit IRC | 19:45 | |
| dtantsur | mmm, 9pm is approaching, time to close the lid | 19:46 |
| *** dtantsur is now known as dtantsur|afk | 19:46 | |
| dtantsur|afk | see you tomorrow | 19:46 |
| jroll | nn \o | 19:46 |
| *** etingof has joined #openstack-ironic | 19:49 | |
| *** d0ugal_ has joined #openstack-ironic | 19:56 | |
| TheJulia | dtantsur|afk: +a'ed | 19:58 |
| *** jroll has quit IRC | 19:58 | |
| *** vsaienk0 has quit IRC | 19:58 | |
| *** vsaienk0 has joined #openstack-ironic | 19:59 | |
| *** mjturek has quit IRC | 20:00 | |
| *** d0ugal_ has quit IRC | 20:03 | |
| *** milan has quit IRC | 20:04 | |
| *** d0ugal_ has joined #openstack-ironic | 20:04 | |
| rloo | dtantsur|afk, TheJulia, other cores (not sure who else is here), let me know if you're good with approving this rfe: https://bugs.launchpad.net/ironic/+bug/1748515 | 20:04 |
| openstack | Launchpad bug 1748515 in Ironic "[RFE] support healthcheck middleware" [Wishlist,In progress] - Assigned to Jim Rollenhagen (jim-rollenhagen) | 20:04 |
| *** lucasagomes is now known as lucas-pto | 20:05 | |
| openstackgerrit | Julia Kreger proposed openstack/ironic stable/queens: DNM Test disabling .pyc files for Grenade https://review.openstack.org/545089 | 20:05 |
| *** jroll has joined #openstack-ironic | 20:07 | |
| *** d0ugal_ has quit IRC | 20:10 | |
| TheJulia | rloo: I'm good with it, commented as such, did not change tagging | 20:11 |
| rloo | thx TheJulia! | 20:11 |
| *** e0ne has joined #openstack-ironic | 20:11 | |
| * rloo changes tag to approved... | 20:11 | |
| *** d0ugal_ has joined #openstack-ironic | 20:13 | |
| *** mgoddard_ has joined #openstack-ironic | 20:19 | |
| *** bnemec is now known as bnemec-pto | 20:19 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 20:23 | |
| *** AlexeyAbashkin has quit IRC | 20:27 | |
| *** mgoddard_ has quit IRC | 20:27 | |
| *** d0ugal_ has quit IRC | 20:30 | |
| openstackgerrit | Olivier Bourdon proposed openstack/bifrost master: Add check for (i)PXE and Ironic location coherence https://review.openstack.org/545711 | 20:37 |
| *** pcaruana has joined #openstack-ironic | 20:40 | |
| *** e0ne has quit IRC | 20:47 | |
| TheJulia | \o/ | 20:47 |
| *** e0ne has joined #openstack-ironic | 20:51 | |
| *** d0ugal_ has joined #openstack-ironic | 20:56 | |
| *** dmellado has quit IRC | 20:58 | |
| *** r-daneel_ has joined #openstack-ironic | 20:59 | |
| *** r-daneel has quit IRC | 21:00 | |
| *** r-daneel_ is now known as r-daneel | 21:00 | |
| *** priteau has quit IRC | 21:02 | |
| *** dprince has quit IRC | 21:09 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 21:23 | |
| *** akhilaki_ has joined #openstack-ironic | 21:25 | |
| *** akhilaki has quit IRC | 21:27 | |
| *** AlexeyAbashkin has quit IRC | 21:27 | |
| *** Goneri has quit IRC | 21:29 | |
| *** pcaruana has quit IRC | 21:37 | |
| *** jcoufal_ has quit IRC | 22:02 | |
| *** baha has quit IRC | 22:02 | |
| *** d0ugal_ has quit IRC | 22:03 | |
| *** crushil_ has quit IRC | 22:07 | |
| *** vsaienk0 has quit IRC | 22:09 | |
| *** devananda has quit IRC | 22:09 | |
| *** khyr0n has joined #openstack-ironic | 22:12 | |
| khyr0n | #thanks TheJulia | 22:13 |
| openstackstatus | khyr0n: Added your thanks to Thanks page (https://wiki.openstack.org/wiki/Thanks) | 22:13 |
| TheJulia | I'm soooo confused | 22:13 |
| TheJulia | :) | 22:13 |
| khyr0n | for helping me with a problem last week, it was really a networking problem issue, like you said so :) | 22:15 |
| JayF | everything is either networking or dns | 22:15 |
| JayF | that's all problems in tech. | 22:16 |
| *** dmellado has joined #openstack-ironic | 22:18 | |
| openstackgerrit | Merged openstack/ironic master: Increase the instance_info column size to LONGTEXT on MySQL/MariaDB https://review.openstack.org/334967 | 22:20 |
| TheJulia | JayF: What about software race conditions or ENOCOFFEE/ENOBEER/ENOLIQUOR? | 22:22 |
| *** r-daneel has quit IRC | 22:22 | |
| JayF | the software would behave consistently | 22:22 |
| JayF | if all connections performed consistently | 22:22 |
| JayF | blame: network | 22:22 |
| *** r-daneel has joined #openstack-ironic | 22:22 | |
| TheJulia | khyr0n: Awesome, glad to hear you got it worked out :) | 22:22 |
| TheJulia | JayF: I guess that makes sense | 22:22 |
| JayF | you just have to expand the definition to network to be like, silicon between cores in some cases :P | 22:22 |
| jroll | ENOCOFFEE/ENOBEER/ENOLIQUOR is a people problem, not a tech problem :) | 22:23 |
| JayF | Not at my current job :P | 22:23 |
| *** threestrands has joined #openstack-ironic | 22:23 | |
| * JayF works on Point-of-sale systems nowadays | 22:23 | |
| TheJulia | How do we shift that to a tech problem? I feel I need some robots | 22:23 |
| jroll | heh. | 22:23 |
| JayF | I have an api to call to order more beer. | 22:23 |
| JayF | Dead serious. lol | 22:23 |
| TheJulia | awesome! | 22:23 |
| * TheJulia has written an impact assessment and her head hurts | 22:24 | |
| JayF | https://vimeo.com/191816723 for instance (literally a push-button-recieve-beer app POC) | 22:24 |
| jroll | that is quite the sad looking beer :P | 22:25 |
| *** vsaienk0 has joined #openstack-ironic | 22:26 | |
| *** Goneri has joined #openstack-ironic | 22:31 | |
| TheJulia | I would guess a clarified cidre | 22:32 |
| *** rcernin has joined #openstack-ironic | 22:33 | |
| rpioso | I'm deploying a node. About 10 minutes after the node transitioned from 'deploying' to 'wait call-back', an error occurred. The error was "Timeout reached while waiting for callback for node dcb90940-9f18-4d5c-bdd2-0950bfec5f26". What is that about? | 22:34 |
| jroll | rpioso: "wait call-back" is when the node is booting the ramdisk or otherwise waiting for IPA to do something and check in | 22:36 |
| jroll | a timeout there means IPA did not check in | 22:36 |
| *** vsaienk0 has quit IRC | 22:36 | |
| rpioso | Is the duration of that timeout configurable? | 22:36 |
| *** Goneri has quit IRC | 22:36 | |
| jroll | great question, probably | 22:37 |
| jroll | rpioso: looks like [conductor]/deploy_callback_timeout | 22:37 |
| rpioso | The iDRAC is excecuting a configuration job during the reboot. That job sets the server to one-time PXE boot from a network device. It can take a number of minutes. | 22:38 |
| rpioso | jroll: Thank you. I'm looking that up. | 22:38 |
| jroll | gotcha, and no problem | 22:39 |
| jroll | relevant code is in ironic.conductor.manager - _check_deploy_timeouts | 22:39 |
| jroll | rpioso: when we do the "deploy steps" thing, I think we'll want to be able to set in the driver and/or config individual timeouts for different steps | 22:40 |
| rpioso | jroll: Hrm ... The default value is 1800 seconds. That's three times as long as the amount of time that transpired. | 22:46 |
| rloo | jroll: nah, i think for the first version, we'll use the same deploy timeout, but it'll be used for each step. similar to cleaning :) anyway, my thoughts right now on the matter. could change. | 22:46 |
| jroll | rloo: I always assume "eventually" for most future things we talk about :) | 22:47 |
| jroll | rpioso: interesting, hrm | 22:47 |
| rloo | jroll: :D | 22:47 |
| JayF | Having deploy steps not being able to configure their own timeout for a given step would be sad for the functionality. Setting the timeout to the longest pole in the worst case is going to lead to a lot of breakages taking a long time to be discovered. | 22:48 |
| * jroll sees JayF slowly increasing his activity in this channel, rubs his hands together with an evil grin | 22:48 | |
| TheJulia | muahahahahaha | 22:49 |
| JayF | Honestly ,that just means last time I looked at IRC I left this channel up, and didn't have the discipline to ignore it when I saw chat moving | 22:49 |
| * rloo wonders which bait to use next... | 22:49 | |
| * jroll leaves a plate of barbecue out | 22:50 | |
| rpioso | jroll: Just before the error, the conductor log contains a number of ConductorManager._check_... messages. | 22:50 |
| TheJulia | jroll: I was kind of thinking the same thing, also might be good to be able to query another interface because it might know better... anyway just a thought | 22:51 |
| jroll | rpioso: yes, we have a number of tasks like that | 22:51 |
| JayF | rloo: jroll: I've never seen someone so happy that I'm trying to add requirements to a overly-delayed project :P | 22:51 |
| TheJulia | BBQ might just work.... | 22:51 |
| rpioso | jroll: The last one is a bit different, ConductorManager._sync_power_states. And within a second of that, the error occurs. | 22:51 |
| * TheJulia puts both north carolina style sauces next to the BBQ | 22:51 | |
| jroll | ++ | 22:51 |
| peitolm | bah, you're making me hungry :P | 22:52 |
| * TheJulia should like... put the expensive whiskey in her backpack and just go ahead and drive to her shiny new house | 22:52 | |
| jroll | :o | 22:52 |
| TheJulia | peitolm: #success ? | 22:52 |
| jroll | did you close? | 22:52 |
| peitolm | someone say Whisky? | 22:52 |
| TheJulia | jroll: we were released to close with the county today | 22:52 |
| jroll | \o/ | 22:52 |
| rloo | congrats TheJulia! | 22:53 |
| TheJulia | so... the next couple days, I'm going to be stupidly busy | 22:53 |
| peitolm | congrats | 22:53 |
| rpioso | TheJulia: Nice! | 22:53 |
| * peitolm goes to find a nice bruichladdich to raise in salute | 22:53 | |
| jroll | rpioso: that's odd, the error you're getting is certainly related to deploy timeouts | 22:53 |
| TheJulia | step 0: setup internet at the house, step 1: receive couch, step 3: fly to dublin | 22:53 |
| peitolm | sounds familiar :P | 22:54 |
| rpioso | step 4: Raise Guinesses | 22:54 |
| jroll | TheJulia: we've got everything done and ready to close, but it isn't happening til the 12th, so antsy | 22:54 |
| * TheJulia likes step 4 | 22:55 | |
| * TheJulia forgot step 2... it might be laundry or pack or something | 22:55 | |
| *** e0ne has quit IRC | 22:55 | |
| rpioso | s/Guinesses/Guinnesses/ | 22:55 |
| TheJulia | jroll: ugh, that is stressful. :( | 22:55 |
| jroll | TheJulia: not too stressful, just restless, I wanna get in there :) | 22:56 |
| peitolm | one Guinness, two Guinness | 22:56 |
| peitolm | TheJulia: step 2 for me was set off the burgler alarm, yes, after being in the house for 3 hours and setting up the internet/cable | 22:57 |
| TheJulia | peitolm: nice! :) | 23:03 |
| *** pmannidi has joined #openstack-ironic | 23:03 | |
| *** openstackgerrit has quit IRC | 23:04 | |
| rpioso | jroll: How can I determine the source of the 'fail' event that resulted in the state change and error? | 23:05 |
| *** akhilaki_ has quit IRC | 23:06 | |
| jroll | rpioso: grepping log messages in the code, I guess? I'm not sure | 23:07 |
| rloo | TheJulia: thx for doing the PTG schedule. where did the deploy steps/traits stuff end up? I didn't see it but might have missed it. | 23:15 |
| TheJulia | offhand, I don't remember | 23:16 |
| TheJulia | hmm | 23:16 |
| jroll | rloo: https://etherpad.openstack.org/p/ironic-rocky-ptg-cleaning-evolved has a bit about deploy steps | 23:17 |
| jroll | TheJulia: is friday wide open then or? | 23:17 |
| rloo | jroll: yes, i saw that. which is what reminded me. cuz i was thinking, seems premature to talk about that if we haven't even gotten the basic stuff done yet! | 23:17 |
| TheJulia | rloo: I may have accidently dropped it | 23:18 |
| TheJulia | :( | 23:18 |
| jroll | rloo: I'm not sure that was necessarily referring to the "deploy steps" feature we've talked about, rather the generic words to describe a part of the deploy process | 23:18 |
| TheJulia | jroll: Open. I have a morning session, and many people expressed a desire to leave on friday | 23:18 |
| jroll | cool | 23:18 |
| * TheJulia puts scheduling hat back on | 23:18 | |
| rloo | TheJulia: pick it up, pick it up and dust it off! :) | 23:19 |
| rloo | jroll: oh, well, if it wasn't, it should be. BIOS was there too, and we haven't even approved that spec yet :-( | 23:19 |
| jroll | rloo: I guess you could ask rpioso what his intent was there :) | 23:19 |
| rloo | jroll: wrt friday. maybe best to see who is around? i'm only there in the AM and not all of it i think (can't recall now) | 23:20 |
| jroll | rloo: was just curious, I'm sure I can find something to do :) | 23:20 |
| rloo | jroll: don't get me started on asking. cuz i don't even want to schedule anything that doesn't have a spec or some documentation associated with it. i am afriad of hand-waving, general conversations. we don't get far with those. we're bad enough just trying to pin down details. | 23:21 |
| jroll | mmmkay | 23:21 |
| * jroll backs off | 23:21 | |
| *** vsaienk0 has joined #openstack-ironic | 23:22 | |
| rloo | jroll: we're going to have like 10+ people in a room. we've done this for how many years. we ought to figure out how to do this better. <end of stream of ...> i think it is the end of the day for me :) | 23:22 |
| * TheJulia slides rloo tea | 23:23 | |
| rloo | thx TheJulia! | 23:23 |
| rloo | talk to youse all demain! | 23:23 |
| *** rloo has quit IRC | 23:23 | |
| *** AlexeyAbashkin has joined #openstack-ironic | 23:23 | |
| *** cdearborn has quit IRC | 23:26 | |
| *** AlexeyAbashkin has quit IRC | 23:27 | |
| TheJulia | Okay, fixed deploy steps, readded to schedule | 23:30 |
| *** vsaienk0 has quit IRC | 23:32 | |
| *** r-daneel has quit IRC | 23:34 | |
| *** r-daneel has joined #openstack-ironic | 23:35 | |
| rpioso | jroll: Ugh! The log from the test build contains, "ironic-conductor[19277]: DEBUG oslo_service.service [-] conductor.deploy_callback_timeout = 600". | 23:39 |
| jroll | heh, that'll do it | 23:39 |
| rpioso | jroll: Perhaps the default is being overridden in ironic.conf. | 23:40 |
| jroll | yep | 23:40 |
| rpioso | jroll: Thanks, again, for your help. | 23:41 |
| jroll | rpioso: sure thing :) | 23:41 |
| *** r-daneel has quit IRC | 23:50 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!