| opendevreview | pangliye proposed openstack/releases master: Zed Cycle Highlights for Venus https://review.opendev.org/c/openstack/releases/+/855613 | 01:13 |
|---|---|---|
| opendevreview | Boxiang Zhu proposed openstack/releases master: Add release liaison for Skyline project https://review.opendev.org/c/openstack/releases/+/855844 | 02:17 |
| opendevreview | Pranali Deore proposed openstack/releases master: Add release liaison for Glance project https://review.opendev.org/c/openstack/releases/+/855849 | 05:35 |
| frickler | everyone please have a look at https://review.opendev.org/c/openstack/requirements/+/855153/comments/d1805059_3427cf26, IIUC we are in a very critcal situation, the latest oslo.db release will hard break most services. | 07:25 |
| elodilles | frickler: thanks, looking! | 07:26 |
| elodilles | hberaud ttx : i've collected the list of deliverables with broken gates and sent this mail: https://lists.openstack.org/pipermail/openstack-discuss/2022-September/030312.html | 07:27 |
| hberaud | ack | 07:28 |
| elodilles | oh, this oslo.db thing sounds... interesting... :S | 07:35 |
| elodilles | as i understand some services already fixed their code to make it work with oslo.db 12.1.0 | 07:35 |
| elodilles | hberaud damani : do you have any thoughts from oslo perspective about what solution is feasible? | 07:37 |
| hberaud | elodilles: you mean those gates are broken by oslo? | 07:38 |
| elodilles | for services we have passed Feature Freeze, but we still have time to fix bugs until RC1. the question is if this can be handled like that | 07:38 |
| hberaud | no idea | 07:39 |
| elodilles | hberaud: as i understand, yes, with latest oslo.db 12.1.0 some services gates are broken, see frickler's message above | 07:39 |
| elodilles | so we either revert that oslo.db patch (which is actually needed for SQLalchemy 2.0 compatibility according to the patch author) and release another oslo.db, or the services needs to fix their gates to pass with oslo.db 12.1.0 as soon as possible | 07:41 |
| elodilles | (let me know if i misunderstood something) | 07:42 |
| hberaud | stephenfin: FYI ^ this commit seems Seems it is causing widespread failures https://review.opendev.org/c/openstack/oslo.db/+/804775 | 07:42 |
| hberaud | elodilles: no I think you are right | 07:43 |
| hberaud | s/seems Seems/seems/ | 07:44 |
| hberaud | However, the requirements bump is not yet merged | 07:45 |
| elodilles | yes. and it cannot be bumped until most of the services are fixed | 07:56 |
| hberaud | yes | 08:13 |
| frickler | as I wrote, afaict it took Neutron a whole cycle and I'm not sure they really found every spot. not very likely for umpteen severely understaffed projects to do the same in a couple of weeks | 08:20 |
| frickler | oh, I actually didn't write that, thought I did | 08:21 |
| frickler | slaweq: lajoskatona: ^^ maybe one of you can share your view from the Neutron side | 08:22 |
| frickler | also one more thing to note: the reqs patch only shows unit tests. many issues in neutron were only found by checking logs in real deployments, so even when all unit tests would get fixed, that's likely not the end of the story | 08:27 |
| lajoskatona | frickler: reading | 08:30 |
| lajoskatona | In Neutron and stadiums some work already done, but we havent covered all | 08:37 |
| slaweq | frickler: the best guy to ask about feedback with this effort is ralonsoh but he's on PTO this week | 08:41 |
| lajoskatona | frickler, slaweq: our periodic unit test job with oslo.master seems to be flapping, last week as I remember we discussed it with ralonsoh, we still miss some context wrapper I think the conclusion was | 08:46 |
| frickler | lajoskatona: oh, so even neutron isn't completely done, thx for that update. I have no idea whether reverting that oslo.db locking change for this cycle would be feasible, but that seems to be the only option then | 08:48 |
| elodilles | frickler: according to what you wrote i tend to agree: the revert seems to be the 'least-worse' solution | 08:59 |
| elodilles | and add it back in Antelope cycle as soon as possible | 08:59 |
| lajoskatona | frickler, elodilles: am I understand right that other projects also havent adopted fully for this change? | 09:12 |
| elodilles | lajoskatona: seems so | 09:16 |
| frickler | lajoskatona: I'd say not at all for most of those who are failing on the reqs patch | 09:22 |
| lajoskatona | frickler, elodilles: thanks | 09:28 |
| hberaud | what's about those who already migrated (over these oslo.db changes) if we revert those changes? | 10:29 |
| ttx | At this point in the cycle, if only a few well-maintained projects have migrated to the new version, it will be easier to revert their migration (since they are active) than chasing down every less-maintained project to get them to fix theirs | 10:49 |
| ttx | But yes we should reinsert that change early enough in the Antelope cycle | 10:49 |
| *** marios is now known as marios|fooood | 10:50 | |
| ttx | It's a tricky call because not that many are broken, and reverting might be painful. We need a complete assessment of the two scenarios | 10:54 |
| *** marios|fooood is now known as marios | 11:13 | |
| frickler | ttx: IIUC all the changes that were made should be backwards compatible? since they work with unpatched oslo.db currently? | 11:14 |
| frickler | so nothing to revert except the oslo.db patch afaict, but there may be dragons | 11:15 |
| *** dviroel|out is now known as dviroel | 11:28 | |
| elodilles | frickler: that was my impression, too | 11:35 |
| elodilles | that it's backward compatible | 11:35 |
| elodilles | so nothing needs to be done for those who already did the change | 11:36 |
| elodilles | as still the old oslo.db is used on their branch | 11:36 |
| *** gthiemon1e is now known as gthiemonge | 12:17 | |
| *** tosky_ is now known as tosky | 12:23 | |
| opendevreview | Dmitriy Rabotyagov proposed openstack/releases master: Release OpenStack-Ansible Xena https://review.opendev.org/c/openstack/releases/+/855879 | 12:38 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/releases master: Release OpenStack-Ansible Yoga https://review.opendev.org/c/openstack/releases/+/855880 | 12:40 |
| damani | hi | 12:41 |
| damani | i would like to know if eventually someone can help me here https://review.rdoproject.org/r/c/openstack/oslo-cache-distgit/+/39744 | 12:42 |
| opendevreview | Dmitriy Rabotyagov proposed openstack/releases master: Release OpenStack-Ansible Wallaby https://review.opendev.org/c/openstack/releases/+/855882 | 12:45 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [oslo] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855893 | 13:48 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [blazar] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855894 | 13:51 |
| ttx | frickler, elodilles do we have a complete list of what's broken by this change specifically? | 13:52 |
| ttx | Is it just what's reporting FAILURE on https://review.opendev.org/c/openstack/requirements/+/855153 ? Or is there more to it | 13:54 |
| ttx | Once we have that visibility I'd recommend starting a thread specifically on oslo.db 12.1.0 and how it creates a release-blocking issue, to raise attention | 13:56 |
| elodilles | i don't have any list but i guess requirements doesn't test everything | 13:56 |
| ttx | elodilles: yeah that's my fear | 13:57 |
| elodilles | though at least it tests quite many services | 13:57 |
| ttx | On that thread we should propose the oslo.db revert, and see how well that flies | 13:58 |
| elodilles | OK, i'll try to send some summary and send it to ML, should it be tagged with [all]? | 13:59 |
| elodilles | i guess so | 13:59 |
| ttx | yeah I'd say [all][release] | 13:59 |
| elodilles | ++ | 13:59 |
| ttx | "[all][release] Zed release critical issue with oslo.db 12.1.0" | 14:00 |
| ttx | that should attract attention | 14:00 |
| elodilles | ++ | 14:01 |
| ttx | today is labor day so we won;t have all hands on deck anyway | 14:04 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [telemetry] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855898 | 14:07 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [OpenStackSDK] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855902 | 14:10 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [ironic] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855903 | 14:18 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [keystone] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855904 | 14:19 |
| elodilles | ttx: yepp, just wanted to mention that | 14:20 |
| elodilles | nevertheless, here's the mail: https://lists.openstack.org/pipermail/openstack-discuss/2022-September/030317.html | 14:21 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [monasca] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855905 | 14:21 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [neutron] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855907 | 14:24 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [OpenStackSDK] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855902 | 14:27 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [neutron] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855907 | 14:28 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [mistral] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855908 | 14:30 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [kuryr] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855910 | 14:31 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [nova] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855911 | 14:33 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [octavia] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855912 | 14:34 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [heat] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855914 | 14:37 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [cinder] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855915 | 14:39 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [winstackers] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855916 | 14:40 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [heat] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855914 | 14:41 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [barbican] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855917 | 14:42 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [cloudkitty] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855918 | 14:42 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [cyborg] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855920 | 14:44 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [designate] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855922 | 14:46 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [freezer] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855923 | 14:46 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [magnum] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855924 | 14:47 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [manila] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855925 | 14:48 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [masakari] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855926 | 14:49 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [murano] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855928 | 14:50 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [sahara] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855929 | 14:51 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [senlin] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855930 | 14:51 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [solum] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855932 | 14:52 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [swift] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855933 | 14:53 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [tacker] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855934 | 14:53 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [trove] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855936 | 14:54 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [venus] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855937 | 14:55 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [vitrage] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855938 | 14:56 |
| opendevreview | Hervé Beraud proposed openstack/releases master: [zun] Create zed branch for client and non-client libs https://review.opendev.org/c/openstack/releases/+/855940 | 14:57 |
| *** dviroel is now known as dviroel|lunch | 15:32 | |
| *** marios is now known as marios|out | 15:51 | |
| *** dviroel|lunch is now known as dviroel | 16:41 | |
| opendevreview | Sylvain Bauza proposed openstack/releases master: Nova Zed cycle highlights https://review.opendev.org/c/openstack/releases/+/855974 | 17:25 |
| *** haleyb_ is now known as haleyb | 20:12 | |
| *** dviroel is now known as dviroel|out | 21:29 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!