| *** LiangFang has quit IRC | 00:00 | |
| *** jamesmcarthur has quit IRC | 00:00 | |
| *** jamesmcarthur has joined #openstack-meeting | 00:07 | |
| *** tetsuro has quit IRC | 00:07 | |
| *** tetsuro has joined #openstack-meeting | 00:10 | |
| *** armax has joined #openstack-meeting | 00:13 | |
| *** mriedem has quit IRC | 00:17 | |
| *** a-pugachev has quit IRC | 00:25 | |
| *** yamamoto has quit IRC | 00:34 | |
| *** longkb has joined #openstack-meeting | 00:38 | |
| *** longkb has quit IRC | 00:38 | |
| *** jamesmcarthur has quit IRC | 01:05 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:08 | |
| *** jamesmcarthur has quit IRC | 01:17 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:18 | |
| *** jamesmcarthur has quit IRC | 01:22 | |
| *** iyamahat has quit IRC | 01:47 | |
| *** yamahata has quit IRC | 01:47 | |
| *** jamesmcarthur has joined #openstack-meeting | 01:56 | |
| *** rbudden has joined #openstack-meeting | 02:19 | |
| *** mhen has quit IRC | 02:50 | |
| *** anteaya has quit IRC | 02:51 | |
| *** mhen has joined #openstack-meeting | 02:52 | |
| *** zaneb has quit IRC | 03:23 | |
| *** zaneb has joined #openstack-meeting | 03:42 | |
| *** yamamoto has joined #openstack-meeting | 04:05 | |
| *** psachin has joined #openstack-meeting | 04:14 | |
| *** janki has joined #openstack-meeting | 04:42 | |
| *** iyamahat has joined #openstack-meeting | 04:52 | |
| *** iyamahat has quit IRC | 04:54 | |
| *** iyamahat has joined #openstack-meeting | 04:54 | |
| *** sridharg has joined #openstack-meeting | 04:54 | |
| *** zbitter has joined #openstack-meeting | 05:05 | |
| *** zaneb has quit IRC | 05:08 | |
| *** yamahata has joined #openstack-meeting | 05:11 | |
| *** yamamoto has quit IRC | 05:20 | |
| *** yamamoto has joined #openstack-meeting | 05:24 | |
| *** rbudden has quit IRC | 05:37 | |
| *** yamamoto has quit IRC | 05:47 | |
| *** yamamoto has joined #openstack-meeting | 05:51 | |
| *** rbudden has joined #openstack-meeting | 05:57 | |
| *** yamamoto has quit IRC | 06:07 | |
| *** apetrich has joined #openstack-meeting | 06:40 | |
| *** yamamoto has joined #openstack-meeting | 06:41 | |
| *** mahatic has quit IRC | 06:55 | |
| *** mahatic has joined #openstack-meeting | 06:56 | |
| *** rfolco has quit IRC | 07:06 | |
| *** rcernin has quit IRC | 07:26 | |
| *** yamahata has quit IRC | 08:03 | |
| *** iyamahat has quit IRC | 08:04 | |
| *** artom has quit IRC | 08:08 | |
| *** artom has joined #openstack-meeting | 08:12 | |
| *** artom has quit IRC | 08:13 | |
| *** artom has joined #openstack-meeting | 08:13 | |
| *** rubasov has left #openstack-meeting | 08:16 | |
| *** yamahata has joined #openstack-meeting | 08:23 | |
| *** yamamoto has quit IRC | 08:24 | |
| *** kailun has quit IRC | 08:27 | |
| *** iyamahat has joined #openstack-meeting | 08:41 | |
| *** bobh has joined #openstack-meeting | 08:43 | |
| *** yamamoto has joined #openstack-meeting | 08:47 | |
| *** ralonsoh has joined #openstack-meeting | 08:50 | |
| *** e0ne has joined #openstack-meeting | 09:03 | |
| *** rfolco has joined #openstack-meeting | 09:09 | |
| *** whoami-rajat has joined #openstack-meeting | 09:09 | |
| *** tetsuro has quit IRC | 09:12 | |
| *** Fdaisuke has joined #openstack-meeting | 09:14 | |
| *** Fdaisuke has left #openstack-meeting | 09:15 | |
| *** rossella_s has joined #openstack-meeting | 09:19 | |
| *** erlon has quit IRC | 09:24 | |
| *** tssurya has joined #openstack-meeting | 09:32 | |
| *** pcaruana has joined #openstack-meeting | 09:48 | |
| *** yamamoto has quit IRC | 09:55 | |
| *** kopecmartin|off is now known as kopecmartin | 10:00 | |
| *** gibi has quit IRC | 10:01 | |
| *** bobh has quit IRC | 10:01 | |
| *** arne_wiebalck_ has joined #openstack-meeting | 10:07 | |
| *** gibi has joined #openstack-meeting | 10:08 | |
| *** Elwell has joined #openstack-meeting | 10:11 | |
| *** a-pugachev has joined #openstack-meeting | 10:11 | |
| Elwell | have I missed the Scientific-SIG? | 10:13 |
|---|---|---|
| *** yamamoto has joined #openstack-meeting | 10:22 | |
| frickler | Elwell: iiuc it should be at 11 UTC, i.e. in a bit more than half an hour | 10:22 |
| * Elwell failed at TZ calculation. 11+11 != 21 | 10:25 | |
| *** yamamoto has quit IRC | 10:28 | |
| *** yamamoto has joined #openstack-meeting | 10:30 | |
| *** enolfc has joined #openstack-meeting | 10:33 | |
| *** shrasool has joined #openstack-meeting | 10:34 | |
| *** dh3 has joined #openstack-meeting | 10:37 | |
| *** priteau has joined #openstack-meeting | 10:37 | |
| *** erlon has joined #openstack-meeting | 10:40 | |
| *** oneswig has joined #openstack-meeting | 10:48 | |
| *** mgoddard has joined #openstack-meeting | 10:57 | |
| oneswig | #startmeeting scientific-sig | 11:00 |
| openstack | Meeting started Wed Nov 21 11:00:03 2018 UTC and is due to finish in 60 minutes. The chair is oneswig. Information about MeetBot at http://wiki.debian.org/MeetBot. | 11:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 11:00 |
| *** openstack changes topic to " (Meeting topic: scientific-sig)" | 11:00 | |
| openstack | The meeting name has been set to 'scientific_sig' | 11:00 |
| oneswig | Hello \o/ | 11:00 |
| priteau | Good morning | 11:00 |
| oneswig | #link Agenda for today https://wiki.openstack.org/wiki/Scientific_SIG#IRC_Meeting_November_21st_2018 | 11:00 |
| mgoddard | \o | 11:00 |
| verdurin | Morning. | 11:00 |
| oneswig | Greetings all | 11:00 |
| dh3 | morning | 11:00 |
| Elwell | Hi Folks, Mostly lurking for #3 on agenda | 11:01 |
| oneswig | It's thanksgiving over the pond, we'll not be hearing from them I guess | 11:01 |
| oneswig | Hi Elwell - good to see you | 11:01 |
| oneswig | dh3: I heard from Komathy, she's waiting for confirmation from Sanger on their visit | 11:02 |
| dh3 | oneswig: OK, I will prod Pete to give a definite "yes" (I thought I had already) | 11:02 |
| oneswig | Elwell: We could move #3 to #1 - no problem at all | 11:02 |
| Elwell | I can wait :-) | 11:03 |
| oneswig | Let's tee off with that? | 11:03 |
| oneswig | I'm curious myself! | 11:03 |
| oneswig | #topic Lustre and Manila | 11:03 |
| *** openstack changes topic to "Lustre and Manila (Meeting topic: scientific-sig)" | 11:03 | |
| oneswig | Elwell: can you describe what you're looking for? | 11:04 |
| *** miloa has joined #openstack-meeting | 11:04 | |
| Elwell | I've been tasked with "investigate how possible it is to export our lustre filesystem(s) to on-prem openstack, securely" | 11:04 |
| oneswig | IB or IP? | 11:04 |
| Elwell | My current plan is probably to reproduce the NCI (manual NFS export) way, but wondeered how automatic Manila would help | 11:04 |
| *** janders has joined #openstack-meeting | 11:04 | |
| janders | g'day everyone | 11:05 |
| oneswig | hey janders, you made it home | 11:05 |
| dh3 | Sanger are interested in the Manila approach too but haven't got further than looking at the generic manila plugin and going "not enough time". We have Lustre connected to OpenStack in two ways though | 11:05 |
| Elwell | Storage is IB, cloud is IP, so I'm expecting to either throw router or (ib client, nfs export to IP) into mix | 11:05 |
| janders | I indeed have, however I may still be on Singapore time | 11:05 |
| dh3 | 1. "isolated" - Lustre FS connected to a separate VLAN which is exposed to a single project as a provider network | 11:06 |
| dh3 | 2. "secure Lustre" - in the scientific sig book - proper multi-tenant using Lustre routers, full isolation but costs in terms of performance (and complexity to set up) | 11:06 |
| dh3 | we are all IP/ethernet though | 11:06 |
| oneswig | We did a project at Cambridge University for https://www.euclid-ec.org/ which pretty closely matched #1, but all-IB and bare metal OpenStack | 11:07 |
| janders | could Lustre work with a purely hardware based IB router? | 11:07 |
| janders | http://www.mellanox.com/page/products_dyn?product_family=255&mtag=sb7780 | 11:08 |
| janders | this sort of a thing | 11:08 |
| Elwell | ah by router I mean LNET routeer | 11:08 |
| dh3 | different beast :) | 11:08 |
| oneswig | Elwell: The book dh3 is referring to is here: https://www.openstack.org/assets/science/CrossroadofCloudandHPC.pdf | 11:09 |
| Elwell | our storage is still on FDR, we have a mix of EDR and OPA lustre clients (and Aires) | 11:09 |
| oneswig | Sanger contributed their method for multi-tenant Lustre | 11:09 |
| Elwell | https://nci.org.au/wp-content/uploads/2016/07/LUG-2016-sjjfowler-hpc-data-in-the-cloud.pdf is probably what I'll follow for now | 11:09 |
| oneswig | Aries + OpenStack, I remember something faintly about that... | 11:10 |
| Elwell | <shudder> | 11:10 |
| *** arne_wiebalck_ has quit IRC | 11:10 | |
| oneswig | Thanks for the link - will study it! | 11:10 |
| Elwell | OK - so looks like noone's using Manila in that role yet, but a few sites interested (if lacking time/manpower) right? | 11:11 |
| oneswig | Elwell: what's the ideal mode of usage? | 11:11 |
| Elwell | openstack user / project mapped to their own / project part of lustre tree and can read / write there from cloud. | 11:12 |
| oneswig | As I understand it, with Manila we can provision filesystems on the fly for cloud use. I think we can also use Manila as a broker for providing access to existing "provider filesystems" | 11:13 |
| Elwell | so pre-post processing on cloud, HPC on $bigsystems, | 11:13 |
| dh3 | Elwell: do you want the client to be a Lustre client or an NFS client? (we provide images with Lustre ready-baked for less technical users) | 11:13 |
| Elwell | tbh, probably just NFS | 11:14 |
| Elwell | as we can all_smash permissions down, rather than letting random cloud user hit us with a real lustre client | 11:15 |
| Elwell | all_squash even | 11:15 |
| dh3 | the Lustre uid mapping is neat for that | 11:15 |
| Elwell | yep, but only 2/3 of our systems are on 2.10, the other is still 2.5 | 11:16 |
| dh3 | fair point, the majority of ours are 2.5 too | 11:16 |
| Elwell | (appliance so unlikely to be upgraded | 11:16 |
| oneswig | I assume it's easier to develop this NFS interposer than it is to upgrade Lustre | 11:16 |
| oneswig | Elwell: your OpenStack is virtualised or bare metal? | 11:17 |
| Elwell | I *think* virtualised - I'm not in the nimbus team | 11:18 |
| *** belmoreira has joined #openstack-meeting | 11:19 | |
| oneswig | The NFS re-export is a well established pattern in Manila. But I think currently the solution is not designed to scale out. | 11:19 |
| oneswig | There are plans for that, I believe, but it's not there today. | 11:20 |
| *** sambetts_ has joined #openstack-meeting | 11:20 | |
| Elwell | OK - that's probably not too big a blocker for us at the moment as it's more a proof-of-concept for now | 11:21 |
| *** sambetts_ is now known as sambetts|afk | 11:21 | |
| Elwell | Thanks all. | 11:21 |
| oneswig | Elwell: do you think you / your group would be up for developing this poc? | 11:21 |
| oneswig | I'm pretty sure we could gather together a decent group of interested people. | 11:22 |
| Elwell | It'll depend on staff availability I guess. We're about to kick off some heavy procurements and not sure how much time that'll suck up | 11:22 |
| Elwell | (OT- we're recuiting a project manager...) | 11:23 |
| oneswig | Sounds familiar. | 11:23 |
| Elwell | but yeah - happy to share progress with others | 11:23 |
| oneswig | OK, I'll make a note, we should come back to this again. Are you in Perth? | 11:24 |
| Elwell | I'm actually in Tasmania - I work remotely | 11:24 |
| oneswig | There are few places more remote, from here... | 11:25 |
| Elwell | (and I'm normally loitering on IRC anyway) | 11:25 |
| oneswig | #action oneswig to follow up on Lustre + Manila interest group | 11:25 |
| oneswig | OK - thanks Elwell, I hope we can gather some requirements in the next couple of weeks. | 11:26 |
| oneswig | Move on? | 11:26 |
| Elwell | +1 | 11:26 |
| oneswig | Thanks! | 11:26 |
| oneswig | #topic Berlin wash-up | 11:26 |
| *** openstack changes topic to "Berlin wash-up (Meeting topic: scientific-sig)" | 11:26 | |
| oneswig | For those that joined in Berlin, thanks for taking part, it was on a large scale and good with it, I thought | 11:27 |
| janders | +1 | 11:27 |
| oneswig | janders: how was the wine? :-) | 11:27 |
| oneswig | A well-deserved win | 11:27 |
| janders | it's waiting in the cellar for a good occasion :) | 11:28 |
| oneswig | #link Etherpad from the meeting https://etherpad.openstack.org/p/Berlin-Scientific-SIG-Meeting | 11:28 |
| janders | I think it will go perfectly for a spicy Asian pork dish like bun cha | 11:28 |
| oneswig | Sounds great :-) | 11:29 |
| janders | thanks oneswig :) | 11:29 |
| oneswig | There were several topics discussed in the meeting that seemed to get a positive response | 11:29 |
| oneswig | Ongoing developments with federation being a major one. It was great that Colleen joined us, from the Keystone project | 11:30 |
| oneswig | Probably the biggest area of discussion was on how to manage one infrastructure for virt, bare metal and containers (in particular, kubernetes) | 11:32 |
| janders | keystone - ocp/k8s integration sounds promising however I believe it has some limitations (especially if we put Kuryr into the picture) | 11:33 |
| oneswig | what specifically? | 11:35 |
| janders | I believe keystone projects can translate 1:1 to ocp/k8s projects | 11:35 |
| janders | however | 11:35 |
| janders | kuryr creates all per-project networks in one designated "kuryr" tenant | 11:35 |
| janders | that's my understanding | 11:35 |
| janders | there might be some confusion here as the kuryr guys aren't 100% across the keystone integration part but that was their take on it | 11:36 |
| miloa | Hi, i was at the scientific-sig meeting at Berlin. I would like to give if it is also part of this discution some feedbacks as it was my first scientific-sig meeting. | 11:37 |
| oneswig | Hi miloa - welcome! | 11:37 |
| miloa | thanks :) | 11:37 |
| oneswig | janders: so on the openstack side there is 1 project, on the kubernetes side, many projects? | 11:38 |
| oneswig | miloa: go ahead | 11:38 |
| miloa | It was very interresting, thanks for the meeting. We were a lot of people from different scientific area | 11:38 |
| *** aojea has joined #openstack-meeting | 11:39 | |
| miloa | I was wondering if it would be possible to have a sort of Scientific SIG On boarding session to not be get lost :) | 11:39 |
| oneswig | miloa: That's an interesting point. The meeting session should cover that, but perhaps it does not cover it enough. | 11:40 |
| miloa | And if it would be possible to for example do little group organized in scientific aera (biology, physics...) to know each others and discuss then go back in big group and share ? | 11:41 |
| oneswig | Are you thinking of something like a presentation to introduce the SIG and what it does? | 11:41 |
| miloa | yes :) something like that, and a presentation of the communication tools the SIG is using for example. | 11:42 |
| oneswig | miloa: small spin-off groups, that can sometimes work. We don't get much time to do it in 40 minutes. I recall we did something like this with the session at the Austin summit a couple of years ago | 11:42 |
| miloa | ok i didn't know :) | 11:42 |
| oneswig | I think it's a good idea. Perhaps we should just get people sitting together anyway! | 11:43 |
| *** enolfc has quit IRC | 11:43 | |
| oneswig | miloa: where are you from? | 11:43 |
| miloa | France | 11:43 |
| oneswig | bienvenue :-) | 11:43 |
| miloa | merci :) | 11:43 |
| oneswig | I was really encouraged to see how many new people were at the SIG for the first time. | 11:44 |
| oneswig | You make a good point, we should focus more on introductions | 11:44 |
| *** yamamoto has quit IRC | 11:45 | |
| miloa | Perhaps scientifics SIG breakfirst and/or speed-mentoring will help too. | 11:45 |
| mgoddard | there is https://wiki.openstack.org/wiki/Scientific_SIG | 11:45 |
| mgoddard | for information about communication etc. | 11:46 |
| oneswig | Thanks mgoddard, good link :-) | 11:46 |
| miloa | thanks mgoddard :) | 11:46 |
| oneswig | The other major topic we discussed in the session was AI/ML and in particular GPUs. There were ~10 people there representing institutions interested in this. | 11:47 |
| oneswig | I don't think there are major gaps at an infrastructure level here, only a gathering of all the current best practice to help share knowledge. | 11:47 |
| janders | oneswig: (sorry for the delayed response, didn't want to interrupt the valuable onboarding thread) my understanding is that each ocp/k8s namespace/project can have its own private neutron network | 11:47 |
| janders | however all of these networks live in a designated openstack project assigned to kuryr | 11:48 |
| oneswig | janders: that does seem strange. It's like the transposition of what Magnum does. | 11:48 |
| janders | which is a little weird on its own but gets weirder if there is ocp/k8s keystone integration | 11:49 |
| janders | I will try to work with RHAT to see if we can propose something more sane | 11:49 |
| *** njohnston has quit IRC | 11:49 | |
| *** mugsie has joined #openstack-meeting | 11:49 | |
| oneswig | I saw Kuryr on several RH slides, they do seem to be pushing it. | 11:49 |
| *** njohnston_ has joined #openstack-meeting | 11:49 | |
| *** vishalmanchanda has joined #openstack-meeting | 11:50 | |
| oneswig | ok, thanks janders, would be great to understand more about how these fit together | 11:50 |
| *** janki has quit IRC | 11:50 | |
| janders | I will do my best to progress on this in the coming weeks/months and I shall report back | 11:50 |
| oneswig | On the GPU side, I was wondering if we might prevail on Blair - but now he's in NZ the meetings really are at antisocial hours for him. | 11:51 |
| janders | perhaps next week? | 11:51 |
| janders | it'll be the morning meeting, easier for NZ peeps | 11:51 |
| oneswig | I'll drop him a mail - I think it's at a time when he's often en route to the airport for an early morning flight! | 11:51 |
| janders | good call | 11:52 |
| janders | I didnt mean to interrupt the lustre-manila chat but as we're approaching the end of the meeting: | 11:52 |
| janders | what's the appetite for manila-beegfs integration | 11:52 |
| oneswig | #action oneswig to contact Blair re state of knowledge on GPUs | 11:52 |
| janders | as well as wider adoption of beegfs as an openstack storage backend? | 11:53 |
| janders | I think beegfs is perfect material for ceph of HPC OpenStack | 11:53 |
| dh3 | janders: we keep hearing anecdotal good things about beegfs but have no experience. Potentially interested | 11:53 |
| oneswig | janders: plenty of appetite over here, that's for sure. Can it do the necessary functions? | 11:53 |
| Elwell | janders: "possible, depends if we go down beegfs" | 11:53 |
| janders | I havent done much prep, however my thinking is - if GPFS can do it, why beegfs can't? | 11:54 |
| verdurin | I would consider it strictly for scratch-type storage at the moment | 11:54 |
| janders | some R&D would need to happen but I think it's well worth it | 11:54 |
| oneswig | I'm hoping to meet Sven the BeeGFS creator at a conference in a few weeks (ciuk). Perhaps if we can figure out what's needed of it, I can put it to him. | 11:54 |
| janders | I had a chat to RHAT about it but I also feel we need to speak to BeeGFS guys first | 11:54 |
| *** tssurya has quit IRC | 11:55 | |
| janders | personally I think manila+BeeGFS-OND = nirvana of HPC Cloud stoarge | 11:55 |
| oneswig | janders: would you mind looking into what's needed? | 11:55 |
| janders | not at all | 11:55 |
| *** janki has joined #openstack-meeting | 11:56 | |
| oneswig | #action janders to research BeeGFS functional requirements for Manila | 11:56 |
| oneswig | thanks janders, already looking forward to it :- | 11:56 |
| oneswig | just time for ... | 11:56 |
| oneswig | #topic AOB | 11:56 |
| *** openstack changes topic to "AOB (Meeting topic: scientific-sig)" | 11:56 | |
| janders | I also think that what you guys have going with ansible (no manila involved) is a pretty powerful demo of what OpenStack+BeeGFS are capable of | 11:56 |
| oneswig | thanks janders - it's proving quite popular! | 11:56 |
| oneswig | Had a really useful session yesterday in London - the UKRI Cloud Working Group. Totally recommend it for next time for the UK contingent here. | 11:57 |
| verdurin | Glad it was useful, oneswig - couldn't attend, unfortunately | 11:58 |
| janders | re AOB - just wanted to say it was great to see some of you in Berlin. Oneswig: thanks for organising a great dinner meetup, really enjoyed it (and heard more good feedback from others) | 11:58 |
| janders | good stuff | 11:59 |
| oneswig | You're very welcome. It was great to see so many | 11:59 |
| dh3 | next time James and I will do the dinner not the bar crawl :) | 11:59 |
| *** raildo has joined #openstack-meeting | 11:59 | |
| janders | how many were brave enough to try the cheese? | 11:59 |
| janders | was pretty full on | 11:59 |
| janders | good though! | 11:59 |
| oneswig | Ah, the cheese. Despite the alpine theme, I didn't get round to it. | 12:00 |
| oneswig | one last thing - have you seen this box - http://www.eenewsanalog.com/news/graphcores-toon-tips-dell-ai-server | 12:00 |
| verdurin | You can't miss the cheese. | 12:00 |
| oneswig | Makes the DGX-1 look like a mere abacus :-) | 12:00 |
| janders | was about to say - is this the DGX killer? | 12:00 |
| oneswig | who knows... | 12:01 |
| oneswig | OK we are over time, alas | 12:01 |
| janders | DGXes seem quite capable of killing themselves :P | 12:01 |
| verdurin | Bye. | 12:01 |
| oneswig | thanks all | 12:01 |
| *** psachin has quit IRC | 12:01 | |
| oneswig | #endmeeting | 12:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 12:01 | |
| janders | thank you | 12:01 |
| openstack | Meeting ended Wed Nov 21 12:01:17 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 12:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-11-21-11.00.html | 12:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-11-21-11.00.txt | 12:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/scientific_sig/2018/scientific_sig.2018-11-21-11.00.log.html | 12:01 |
| priteau | Bye everyone | 12:01 |
| dh3 | thanks, bye! | 12:01 |
| *** oneswig has quit IRC | 12:02 | |
| *** mgoddard has left #openstack-meeting | 12:07 | |
| *** yamamoto has joined #openstack-meeting | 12:07 | |
| *** dh3 has quit IRC | 12:07 | |
| *** janki has quit IRC | 12:12 | |
| *** Elwell has left #openstack-meeting | 12:17 | |
| *** kopecmartin has quit IRC | 12:23 | |
| *** kopecmartin has joined #openstack-meeting | 12:25 | |
| *** yamamoto has quit IRC | 12:36 | |
| *** a-pugachev has quit IRC | 12:38 | |
| *** e0ne has quit IRC | 12:45 | |
| *** aojea has quit IRC | 12:45 | |
| *** geguileo has quit IRC | 12:48 | |
| *** Guest93279 has joined #openstack-meeting | 12:50 | |
| *** Guest93279 is now known as geguileor | 12:51 | |
| *** tssurya has joined #openstack-meeting | 13:02 | |
| *** e0ne has joined #openstack-meeting | 13:02 | |
| *** e0ne has quit IRC | 13:03 | |
| *** e0ne has joined #openstack-meeting | 13:03 | |
| *** yamamoto has joined #openstack-meeting | 13:06 | |
| *** yamamoto has quit IRC | 13:18 | |
| *** Fdaisuke_ has joined #openstack-meeting | 13:38 | |
| *** tobiash has left #openstack-meeting | 13:49 | |
| *** mriedem has joined #openstack-meeting | 13:49 | |
| *** whoami-rajat has quit IRC | 13:54 | |
| *** janki has joined #openstack-meeting | 13:59 | |
| *** vishalmanchanda has quit IRC | 14:02 | |
| *** dustins has joined #openstack-meeting | 14:06 | |
| *** zbitter is now known as zaneb | 14:06 | |
| *** Fdaisuke_ has left #openstack-meeting | 14:10 | |
| *** Douhet has quit IRC | 14:13 | |
| *** bobh has joined #openstack-meeting | 14:21 | |
| *** Douhet has joined #openstack-meeting | 14:26 | |
| *** njohnston_ has quit IRC | 14:29 | |
| *** njohnston has joined #openstack-meeting | 14:29 | |
| *** vishalmanchanda has joined #openstack-meeting | 14:29 | |
| *** whoami-rajat has joined #openstack-meeting | 14:43 | |
| *** Douhet has quit IRC | 14:56 | |
| *** hongbin has joined #openstack-meeting | 15:03 | |
| *** Douhet has joined #openstack-meeting | 15:04 | |
| *** shrasool has quit IRC | 15:13 | |
| *** a-pugachev has joined #openstack-meeting | 15:30 | |
| *** walshh_ has joined #openstack-meeting | 15:50 | |
| *** tssurya has quit IRC | 15:50 | |
| *** rosmaita has joined #openstack-meeting | 15:52 | |
| jungleboyj | #startmeeting Cinder | 16:00 |
| openstack | Meeting started Wed Nov 21 16:00:18 2018 UTC and is due to finish in 60 minutes. The chair is jungleboyj. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:00 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:00 |
| *** openstack changes topic to " (Meeting topic: Cinder)" | 16:00 | |
| openstack | The meeting name has been set to 'cinder' | 16:00 |
| whoami-rajat | Hi | 16:00 |
| yikun | hello | 16:00 |
| rosmaita | o/ | 16:00 |
| jungleboyj | Courtesy ping: jungleboyj diablo_rojo, diablo_rojo_phon, rajinir tbarron xyang xyang1 e0ne gouthamr thingee erlon tpsilva ganso patrickeast tommylikehu eharney geguileo smcginnis lhx_ lhx__ aspiers jgriffith moshele hwalsh felipemonteiro lpetrut lseki _alastor_ whoami-rajat yikun rosmaita | 16:00 |
| e0ne | hi | 16:00 |
| xyang | hi | 16:00 |
| jungleboyj | @! | 16:01 |
| _pewp_ | jungleboyj (◍˃̶ᗜ˂̶◍)ﾉ” | 16:01 |
| walshh_ | hi | 16:01 |
| enriquetaso | o/ | 16:01 |
| geguileor | o/ | 16:01 |
| *** geguileor is now known as geguileo | 16:01 | |
| jungleboyj | geguileo: Make your flight last week? | 16:02 |
| geguileo | jungleboyj: yup, I did :-) | 16:02 |
| jungleboyj | :-) Good. | 16:02 |
| jungleboyj | Ok. smcginnis Is on a plane somewhere. So, we have everyone else I expect today. | 16:03 |
| jungleboyj | So, lets get started | 16:03 |
| jungleboyj | #topic Announcements | 16:03 |
| *** openstack changes topic to "Announcements (Meeting topic: Cinder)" | 16:03 | |
| jungleboyj | I have the Cinder on-boarding presentation posted: | 16:03 |
| jungleboyj | #link https://www.slideshare.net/JayBryant2/cinder-onboarding-room-berlin-11132018 | 16:03 |
| jungleboyj | Thank you to rosmaita who reviewed it and found some mistakes. | 16:04 |
| rosmaita | :) | 16:04 |
| jungleboyj | I have fixed those so they will be right when I start with that for Denver. :-) | 16:04 |
| jungleboyj | rosmaita: That was after I fixed other issues found during the presentation. Ooops. | 16:04 |
| jungleboyj | Might have phoned that one in. | 16:04 |
| jungleboyj | There was good turnout for it and good questions so I think it was worth the time to do. | 16:04 |
| jungleboyj | So, that is all I have there. | 16:05 |
| jungleboyj | I am working on getting the audio from the forum sessions posted. I would like to say I will have that done today, but we will see. | 16:05 |
| jungleboyj | I will work to get it posted soon. | 16:06 |
| rosmaita | just out of curiosity, have we gotten any contributors in the past from the onboarding sessions? | 16:06 |
| jungleboyj | rosmaita: Yes, a couple. | 16:07 |
| rosmaita | great! | 16:07 |
| *** miloa has quit IRC | 16:07 | |
| jungleboyj | I think that Brian Pawlik started with an on-boarding session. | 16:08 |
| jungleboyj | Same for the DRBD driver developers. | 16:08 |
| rosmaita | that's about 200% better than glance | 16:08 |
| jungleboyj | So, not a lot, but something. | 16:08 |
| jungleboyj | Also the group working on the encryption changes sat in on the session in Berlin so I think that was helpful for them. | 16:09 |
| jungleboyj | We had a good discussion around their needs and actually may have solved their issues. | 16:09 |
| jungleboyj | :-) So ... it has been useful time. | 16:09 |
| jungleboyj | Ok. Moving on: | 16:10 |
| geguileo | jungleboyj: yeah, they did | 16:10 |
| geguileo | jungleboyj: because they talked with the Oslo team | 16:10 |
| jungleboyj | geguileo: Awesome. | 16:10 |
| geguileo | which is what we recommended they should do | 16:11 |
| jungleboyj | And then they spent some time talking to eharney as well. | 16:11 |
| geguileo | they'll be proposing a new olso project | 16:11 |
| jungleboyj | geguileo: Good news. | 16:11 |
| rosmaita | that's good news | 16:11 |
| *** kukacz has joined #openstack-meeting | 16:11 | |
| *** woojay has joined #openstack-meeting | 16:11 | |
| jungleboyj | That makes more sense than the SDK idea. | 16:12 |
| rosmaita | jungleboyj: ++ | 16:12 |
| jungleboyj | Anyway ... | 16:13 |
| jungleboyj | #topic Paying attention to Bugs | 16:13 |
| *** openstack changes topic to "Paying attention to Bugs (Meeting topic: Cinder)" | 16:13 | |
| jungleboyj | Ok, so this was smcginnis but I think what he is trying to say is pretty obvious. | 16:13 |
| jungleboyj | If you look at the link 3Par has a lot of bugs that haven't been addressed. | 16:14 |
| jungleboyj | The contribution wiki clearly says that bugs need to be addressed. | 16:15 |
| jungleboyj | Is there anyone here that works with 3Par? | 16:15 |
| jungleboyj | _hemna: ^^ | 16:15 |
| jungleboyj | hemna^^ | 16:15 |
| enriquetaso | jungleboyj: to be addressed is to be confirmed? | 16:15 |
| *** diablo_rojo has joined #openstack-meeting | 16:16 | |
| jungleboyj | enriquetaso: Confirmed, responded to and a plan to mitigate the issue. | 16:16 |
| whoami-rajat | i see some of them assigned long ago but no progress since a year. | 16:16 |
| jungleboyj | whoami-rajat: Right. | 16:17 |
| enriquetaso | jungleboyj: thanks | 16:17 |
| *** jamesmcarthur has quit IRC | 16:17 | |
| *** jamesmcarthur_ has joined #openstack-meeting | 16:18 | |
| jungleboyj | Some of them have had no response. | 16:18 |
| whoami-rajat | https://bugs.launchpad.net/cinder/+bug/1645136 this can be closed i think | 16:18 |
| openstack | Launchpad bug 1645136 in Cinder "create_cloned_volume of HPE 3PAR Cinder Driver has a performance bottleneck when source/target volume size are different" [Undecided,New] | 16:18 |
| jungleboyj | I am sure that 3Par is not the only example here. | 16:18 |
| jungleboyj | whoami-rajat: True. I will close that one out. | 16:19 |
| *** bobh has quit IRC | 16:19 | |
| jungleboyj | Anyway, we don't need to go through all of these right now. | 16:20 |
| whoami-rajat | jungleboyj: how can we proceed for these driver specific bugs? | 16:20 |
| jungleboyj | Point is, if you are a driver maintainer, please take some time to review the list of bugs and respond to any bugs that may be filed against your driver. | 16:21 |
| jgriffith | jungleboyj: whoami-rajat the policy is that if there's not an active maintainer of the driver then it gets deprecated | 16:21 |
| jgriffith | actively maintaining means dealign with bugs in LP related to said driver | 16:22 |
| jungleboyj | I am going to follow up with a note to the mailing list and indicate that this is required. | 16:22 |
| whoami-rajat | jgriffith: ok. Thanks for the info. | 16:22 |
| jungleboyj | jgriffith: I am thinking I should indicate that drivers that are not dealing with their bugs will be marked unsupported just like not having CI running. | 16:22 |
| jgriffith | In other words how you deal with the driver related bugs is by maintaining your driver. The Cinde repo isn't a dumping ground for stuff | 16:22 |
| jungleboyj | jgriffith: ++ | 16:23 |
| jgriffith | jungleboyj: yeah, we've done that before actually | 16:23 |
| jungleboyj | Ok. So... | 16:24 |
| jungleboyj | #action jungleboyj to e-mail ml about keeping up with bugs and that if you don't you will be marked unsupported. | 16:24 |
| jungleboyj | #action jungleboyj and smcginnis to review open bugs to figure out who the offenders are. | 16:24 |
| *** kopecmartin is now known as kopecmartin|off | 16:25 | |
| jungleboyj | Everyone ok with the plan above? | 16:25 |
| enriquetaso | +1 | 16:25 |
| whoami-rajat | +1 | 16:26 |
| e0ne | +1 | 16:26 |
| yikun | ++ | 16:26 |
| walshh_ | +1 | 16:26 |
| jungleboyj | Excellent. | 16:26 |
| jungleboyj | #topic User Survey Feedback Blog Post | 16:26 |
| *** openstack changes topic to "User Survey Feedback Blog Post (Meeting topic: Cinder)" | 16:26 | |
| jungleboyj | #link https://docs.google.com/document/d/1d4_nUfuZacGABG2hqqCz3hC238uoVqdloi_qVGRNoRY/edit?usp=sharing | 16:26 |
| jungleboyj | I have created a blog post to respond to our user survey feedback based on discussion we had at the Forum. | 16:27 |
| jungleboyj | I would appreciate the rest of the team taking a look at it and making comments/updates. | 16:27 |
| e0ne | jungleboyj: I read it really fast, could miss something. but it looks great! I'll read it more carefully after later today | 16:27 |
| jungleboyj | I would like to get it sent off to SuperUser soon so that it is still fresh. | 16:27 |
| jungleboyj | e0ne: Awesome. Thank yoU! | 16:28 |
| jungleboyj | jgriffith and geguileo I would appreciate your input as well. | 16:28 |
| geguileo | jungleboyj: thanks for writting it ! | 16:28 |
| jungleboyj | geguileo: No problem. I have wanted to start doing that kind of thing. So, it was a good time to do it. | 16:28 |
| jungleboyj | Any comments or questions to address on the document now? | 16:30 |
| rosmaita | ++ on keeping backups scheduling out of cinder | 16:31 |
| jungleboyj | rosmaita: :-) Yeah, so many people asked for that and it is just not what we do. | 16:31 |
| jungleboyj | Anyway, please review and leave your comments. I will get it updated and have one last call on it next week before submission. | 16:32 |
| jungleboyj | That was all I had on the agenda for topics. Anything else to discuss or should we talk quickly about bugs? | 16:32 |
| enriquetaso | I have something for "Ceph driver should respect the `--incremental` option for backups", but I'm not sure if this is the place to ask for more opinions about the bug. | 16:32 |
| enriquetaso | #link https://review.openstack.org/#/c/612503/ | 16:33 |
| jungleboyj | enriquetaso: I think we could talk about that. | 16:33 |
| jungleboyj | #topic Ceph driver should respect the `--incremental` option for backups | 16:34 |
| *** openstack changes topic to "Ceph driver should respect the `--incremental` option for backups (Meeting topic: Cinder)" | 16:34 | |
| whoami-rajat | jungleboyj: Looks good. i will read it in detail.i found some minor spelling mistakes, can we correct them ourselves to not to bother you with it? | 16:34 |
| jungleboyj | whoami-rajat: Go ahead and fix them. | 16:34 |
| enriquetaso | :) | 16:34 |
| whoami-rajat | jungleboyj: i've requested edit access. | 16:34 |
| jungleboyj | Granted. | 16:35 |
| enriquetaso | I'll appreciate any opinions about changing the default behavior of the backups and reviews of course :) | 16:35 |
| jungleboyj | enriquetaso: Go ahead. | 16:35 |
| whoami-rajat | jungleboyj: Thanks! | 16:35 |
| *** janki has quit IRC | 16:36 | |
| geguileo | enriquetaso: you have to explain on what you want us to give you feedback here | 16:37 |
| jungleboyj | geguileo: Thank you. :-) | 16:38 |
| jungleboyj | enriquetaso: Are you just looking for follow-up reviews? | 16:38 |
| enriquetaso | oh, i'm looking for reviews u.u geguileo and jungleboyj | 16:39 |
| jungleboyj | Ok. Can take a look and review. | 16:40 |
| geguileo | enriquetaso: only for reviews? or do you want to hear about keeping backward compatibility? | 16:40 |
| jungleboyj | Just wanted to make sure you weren't looking for something more specific. | 16:40 |
| geguileo | jungleboyj: there is an issue with keeping it backward compatible | 16:40 |
| geguileo | or making it behave like the other drivers that support incremental backup | 16:41 |
| jungleboyj | Doh. Ok. What is the issue? | 16:41 |
| geguileo | ceph backups cannot create full backups (except the first one) | 16:41 |
| geguileo | since they are doing incremental by default | 16:41 |
| geguileo | the patch fixes this | 16:41 |
| geguileo | but if it behaves like other drivers | 16:41 |
| jungleboyj | Right. Remember that discussion. | 16:41 |
| geguileo | only doing incremental when requested, then it's not backward compatible | 16:42 |
| geguileo | and if it's backward compatible, then it's not consistent with other drivers | 16:42 |
| e0ne | :( | 16:42 |
| jungleboyj | Hmmm. | 16:42 |
| jungleboyj | :-( Indeed. | 16:42 |
| geguileo | so it's a matter of preference/choosing our favourite evil | 16:43 |
| e0ne | I'm wondered I we didn't catch anything of this on our gates | 16:43 |
| enriquetaso | thanks geguileo, yup. So my patch make the driver consistent with other drivers | 16:43 |
| jungleboyj | What are other drivers doing? | 16:43 |
| geguileo | they create full by default | 16:44 |
| geguileo | if you specify incremental, then they do incremental using the latest full as the base | 16:44 |
| jungleboyj | geguileo: Ok. Makes sense. | 16:44 |
| geguileo | sorry, latest full, or latest incremental | 16:44 |
| jungleboyj | And I forget, why can't we make Ceph do the same? | 16:44 |
| geguileo | but ceph just tries to do incremental if it can, and does full if it can't | 16:44 |
| e0ne | I'm +1 for consistency even if we have to change our default behaviour | 16:45 |
| geguileo | jungleboyj: we can do it, but then we change the default behavior | 16:45 |
| geguileo | maybe it's enough to add an upgrade note | 16:45 |
| jungleboyj | e0ne: Yeah. | 16:45 |
| geguileo | to make sure that any automation is changed | 16:46 |
| jungleboyj | I think consistency is best. | 16:46 |
| geguileo | enriquetaso: looks like what you have is OK, maybe update the release note, and change the "features" section for an upgrade one | 16:46 |
| enriquetaso | great! | 16:47 |
| jungleboyj | geguileo: ++ | 16:47 |
| enriquetaso | thanks!! | 16:47 |
| enriquetaso | geguileo++ | 16:47 |
| jungleboyj | Honestly, it seems like a bug that it didn't work the same as other drivers in the first place. | 16:47 |
| enriquetaso | It's reported as a bug | 16:48 |
| whoami-rajat | https://bugs.launchpad.net/cinder?field.searchtext=ceph+incremental&search=Search&field.status%3Alist=NEW&field.status%3Alist=INCOMPLETE_WITH_RESPONSE&field.status%3Alist=INCOMPLETE_WITHOUT_RESPONSE&field.status%3Alist=CONFIRMED&field.status%3Alist=TRIAGED&field.status%3Alist=INPROGRESS&field.status%3Alist=FIXCOMMITTED&field.assignee=&field.bug_reporter=&field.omit_dupes=on&field.has_patch=&field.has_no_package | 16:48 |
| whoami-rajat | = | 16:48 |
| whoami-rajat | looks like many people want the incremental functionality with ceph. | 16:48 |
| *** shrasool has joined #openstack-meeting | 16:48 | |
| whoami-rajat | full backup* | 16:48 |
| geguileo | jungleboyj: it's not a real bug | 16:48 |
| geguileo | jungleboyj: Ceph was the first backup driver that did incremental | 16:48 |
| jungleboyj | Oh ... ok. :-) | 16:49 |
| geguileo | jungleboyj: then we introduced incremental, but the driver was not updated | 16:49 |
| geguileo | jungleboyj: so it was inconsistent with the others | 16:49 |
| jungleboyj | geguileo: Gotcha. Ok. So, I think it is good to get it caught up. | 16:49 |
| geguileo | in any case, this will fix it, and our drivers will be more consistent :-) | 16:49 |
| jungleboyj | \o/ | 16:49 |
| jungleboyj | Moving on | 16:50 |
| jungleboyj | #topic Bug Triage | 16:50 |
| *** openstack changes topic to "Bug Triage (Meeting topic: Cinder)" | 16:50 | |
| jungleboyj | So, I wanted to bring up the following bug: | 16:50 |
| *** pcaruana has quit IRC | 16:50 | |
| jungleboyj | #link https://bugs.launchpad.net/openstack-ansible/+bug/1802070 | 16:50 |
| openstack | Launchpad bug 1802070 in openstack-ansible "Add resource_filter field in cinder.conf for non-admin user can retrieve volume & snapshot volume" [Undecided,In progress] - Assigned to KimMinsik (for-beatitudo) | 16:50 |
| jungleboyj | OpenStack Ansible needed to make a change to fix an issue they were seeing. | 16:50 |
| jungleboyj | It seems to me, however, they are working around a Cinder bug. | 16:51 |
| *** efried_back_mon has quit IRC | 16:51 | |
| jungleboyj | I don't remember who was working on the resource_filter stuff. I am thinking it might have been tommylike ? | 16:51 |
| e0ne | jungleboyj: I agree that we need to fix it in cinder too | 16:52 |
| jungleboyj | e0ne: That was my thought as well. | 16:53 |
| jungleboyj | It seems like there should be some default behavior if the file doesn't exit. | 16:53 |
| e0ne | jungleboyj: +1 | 16:54 |
| jungleboyj | A 400 isn't right. | 16:54 |
| jungleboyj | e0ne: Are you familiar enough with that code path to fix it up? | 16:54 |
| jungleboyj | Since this was causing issues for Horizon it would be up your alley to fix/test. | 16:55 |
| e0ne | jungleboyj: at lease I think so:) | 16:55 |
| e0ne | I'll take it as my priority for tomorrow morning | 16:55 |
| jungleboyj | :-) | 16:55 |
| jungleboyj | e0ne: Ok. Cool. I can open a bug based on the one in OpenStack ansible to track it against Cinder. | 16:56 |
| jungleboyj | Make sense? | 16:56 |
| e0ne | I just add Cinder project to the existing bug | 16:56 |
| e0ne | *added | 16:56 |
| jungleboyj | Oh ... yeah. That probably makes more sense. | 16:56 |
| jungleboyj | e0ne: Cool. Thanks for taking that one. | 16:57 |
| e0ne | jungleboyj: np. I'm happy to be useful for the team :) | 16:57 |
| jungleboyj | geguileo: Did you open a follow up bug to | 16:58 |
| jungleboyj | #link https://bugs.launchpad.net/cinder/+bug/1782714 | 16:58 |
| openstack | Launchpad bug 1782714 in Cinder "Properties of an attached volume are lost after live migration" [Medium,New] | 16:58 |
| jungleboyj | e0ne: You are always useful to the team. :-) | 16:58 |
| e0ne | jungleboyj: thanks, Jay! | 16:58 |
| geguileo | jungleboyj: yes, and I proposed a fix | 16:59 |
| jungleboyj | Ok. Cool. | 16:59 |
| * jungleboyj is behind on reviews. :-( | 16:59 | |
| geguileo | jungleboyj: it's in the last comment of the bug for reference | 16:59 |
| geguileo | it's a 4 lines patch | 16:59 |
| geguileo | lol | 16:59 |
| jungleboyj | Nice! Ok. I will follow up on that. | 17:00 |
| geguileo | thanks | 17:00 |
| whoami-rajat | jungleboyj: Sorry for interrupting, there is a frequent gate failure that yikun and I have been looking at, https://bugs.launchpad.net/cinder/+bug/1803648 . can the cinder team take a look at the patches for it? Thanks. | 17:00 |
| openstack | Launchpad bug 1803648 in Cinder "gate failure : testtools.matchers._impl.MismatchError: 'volume.retype' != 'backup.createprogress'" [Undecided,In progress] - Assigned to Rajat Dhasmana (whoami-rajat) | 17:00 |
| jungleboyj | And on that note. We are out of time. | 17:00 |
| jungleboyj | whoami-rajat: Sure. Can look at that as well. | 17:00 |
| jungleboyj | Ok. Lets wrap up. | 17:00 |
| jungleboyj | Thanks team for a good meeting. | 17:00 |
| jungleboyj | Hope those of you in the US have a Happy Thanksgiving! | 17:00 |
| jungleboyj | Talk to you all next week. | 17:01 |
| whoami-rajat | jungleboyj: Thanks! :) | 17:01 |
| enriquetaso | Happy thanksgiving! | 17:01 |
| jungleboyj | #endmeeting | 17:01 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 17:01 | |
| openstack | Meeting ended Wed Nov 21 17:01:27 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:01 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/cinder/2018/cinder.2018-11-21-16.00.html | 17:01 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/cinder/2018/cinder.2018-11-21-16.00.txt | 17:01 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/cinder/2018/cinder.2018-11-21-16.00.log.html | 17:01 |
| *** e0ne has quit IRC | 17:02 | |
| *** woojay has left #openstack-meeting | 17:05 | |
| *** sambetts|afk has quit IRC | 17:14 | |
| *** sambetts_ has joined #openstack-meeting | 17:16 | |
| *** yamamoto has joined #openstack-meeting | 17:16 | |
| *** alex_xu has quit IRC | 17:17 | |
| *** sridharg has quit IRC | 17:20 | |
| *** yamamoto has quit IRC | 17:20 | |
| *** shrasool has quit IRC | 17:30 | |
| *** vishalmanchanda has quit IRC | 17:32 | |
| *** yamahata has quit IRC | 17:39 | |
| *** iyamahat has quit IRC | 17:39 | |
| *** jamesmcarthur_ has quit IRC | 17:41 | |
| *** rosmaita has left #openstack-meeting | 17:42 | |
| *** jamesmcarthur has joined #openstack-meeting | 17:42 | |
| *** iyamahat has joined #openstack-meeting | 17:52 | |
| *** jamesmcarthur has quit IRC | 17:54 | |
| *** jamesmcarthur has joined #openstack-meeting | 17:54 | |
| *** jamesmcarthur has quit IRC | 18:07 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:09 | |
| *** jamesmcarthur has quit IRC | 18:14 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:15 | |
| *** jamesmcarthur has quit IRC | 18:20 | |
| *** yamahata has joined #openstack-meeting | 18:21 | |
| *** jamesmcarthur has joined #openstack-meeting | 18:23 | |
| *** mriedem has quit IRC | 18:26 | |
| *** mriedem has joined #openstack-meeting | 18:37 | |
| *** ralonsoh has quit IRC | 18:40 | |
| *** shrasool has joined #openstack-meeting | 18:49 | |
| *** apetrich has quit IRC | 19:00 | |
| *** jamesmcarthur has quit IRC | 19:02 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:12 | |
| *** jamesmcarthur has quit IRC | 19:13 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:14 | |
| *** apetrich has joined #openstack-meeting | 19:15 | |
| *** e0ne has joined #openstack-meeting | 19:33 | |
| *** bobh has joined #openstack-meeting | 19:35 | |
| *** dklyle has quit IRC | 19:38 | |
| *** jamesmcarthur has quit IRC | 19:40 | |
| *** whoami-rajat has quit IRC | 19:41 | |
| *** raildo has quit IRC | 19:43 | |
| *** raildo has joined #openstack-meeting | 19:43 | |
| *** jamesmcarthur has joined #openstack-meeting | 19:44 | |
| *** dklyle has joined #openstack-meeting | 19:46 | |
| *** erlon has quit IRC | 19:49 | |
| *** apetrich has quit IRC | 20:01 | |
| *** shrasool has quit IRC | 20:06 | |
| *** jamesmcarthur has quit IRC | 20:25 | |
| *** bobh has quit IRC | 20:29 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:29 | |
| *** raildo has quit IRC | 20:35 | |
| *** dustins has quit IRC | 20:35 | |
| *** bobh has joined #openstack-meeting | 20:39 | |
| *** jamesmcarthur has quit IRC | 20:46 | |
| *** jamesmcarthur has joined #openstack-meeting | 20:49 | |
| *** timburke has joined #openstack-meeting | 21:01 | |
| mattoliverau | #startmeeting swift | 21:01 |
| openstack | Meeting started Wed Nov 21 21:01:10 2018 UTC and is due to finish in 60 minutes. The chair is mattoliverau. Information about MeetBot at http://wiki.debian.org/MeetBot. | 21:01 |
| openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 21:01 |
| *** openstack changes topic to " (Meeting topic: swift)" | 21:01 | |
| openstack | The meeting name has been set to 'swift' | 21:01 |
| mattoliverau | hey everyone | 21:01 |
| mattoliverau | who's here for the swift team meeting? | 21:01 |
| timburke | o/ | 21:01 |
| kota_ | hello | 21:01 |
| rledisez | hi o/ | 21:01 |
| mattoliverau | still waiting on tdasilva | 21:02 |
| mattoliverau | who seems to be in channel | 21:02 |
| *** tdasilva has joined #openstack-meeting | 21:02 | |
| tdasilva | hello | 21:02 |
| mattoliverau | Not expecting a lot of turn out this week, because of thanksgiving in the US | 21:02 |
| mattoliverau | So this will just be a status meeting. So should go pretty quick | 21:03 |
| mattoliverau | #link https://wiki.openstack.org/wiki/Meetings/Swift | 21:03 |
| mattoliverau | before we get to the agenda, I'm curius to those who where there, kota_ and rledisez, how was the summit? | 21:04 |
| *** shrasool has joined #openstack-meeting | 21:04 | |
| kota_ | that was good except notmyname absent project onboarding. | 21:05 |
| mattoliverau | yeah, opps. :( | 21:05 |
| kota_ | absent from | 21:05 |
| mattoliverau | other then that how'd the onboarding go? | 21:05 |
| rledisez | it was ok. some interesting sessions on various topics | 21:05 |
| rledisez | not a lot related to swift, sadly :) | 21:05 |
| timburke | apparently somebody *cough*rledisez*cough* kept him out too late the night before ;-) | 21:05 |
| mattoliverau | :( | 21:05 |
| mattoliverau | ahhh, so that's what happended ;) | 21:06 |
| rledisez | timburke: there is no proof :p | 21:06 |
| mattoliverau | lol | 21:06 |
| tdasilva | rofl | 21:06 |
| kota_ | one interesting session I found, wait a moment, i'm looking for the slide... | 21:06 |
| mattoliverau | re: not a lot related to swift, sadly: We may need to make swift less stable so people take more notice ;) | 21:07 |
| mattoliverau | kk | 21:07 |
| timburke | or find other conferences to check out... | 21:07 |
| kota_ | #link https://dirkmueller.github.io/presentation-berlin-log-classify/#/ | 21:07 |
| mattoliverau | true, maybe something storage focused | 21:07 |
| kota_ | that was present by Tristan@RedHat | 21:08 |
| kota_ | introducing how we reduce noisy logs in the gerrit/zuul. | 21:08 |
| timburke | kota_: that *does* sound interesting! | 21:08 |
| mattoliverau | and Dirk it seems | 21:09 |
| mattoliverau | I work with him | 21:09 |
| kota_ | basically, that reduces anoying setup logs. | 21:09 |
| *** jamesmcarthur has quit IRC | 21:09 | |
| kota_ | then, it will show anomaly logs when the gate failed. | 21:09 |
| kota_ | timburke: i thought you like it ;) | 21:10 |
| mattoliverau | cool. I shall go and actaully watch that one.. I asusme it would have been recorded | 21:10 |
| mattoliverau | any other highlights? | 21:10 |
| mattoliverau | we can always ask again next week to get notmyname's summit highlights too :) | 21:11 |
| kota_ | i think it was recorded but it seems like the video has been delayed in this summit. | 21:11 |
| kota_ | mattoliverau: good idea | 21:11 |
| mattoliverau | well no links here then, but will keep my eye out. | 21:12 |
| mattoliverau | let's move on then. | 21:12 |
| mattoliverau | #topic Priority Reviews | 21:12 |
| *** openstack changes topic to "Priority Reviews (Meeting topic: swift)" | 21:12 | |
| mattoliverau | #link https://wiki.openstack.org/wiki/Swift/PriorityReviews | 21:12 |
| *** jamesmcarthur has joined #openstack-meeting | 21:13 | |
| mattoliverau | we seem to have a general task queue topic later.. so we can talk about that then. | 21:13 |
| mattoliverau | Seems to not have changed much. Which is fine. | 21:14 |
| mattoliverau | timburke, kota_ hows the s3api patches.. need any love from us? | 21:14 |
| timburke | i've got a couple new s3api patches, too :-) https://review.openstack.org/#/c/618301/ adds a concurrency factor for multi-delete requests, similar to what we already have for bulk, and https://review.openstack.org/#/c/619127/ adds a config option to allow some specific subset of AWS's server-side-encryption options | 21:14 |
| timburke | i know tdasilva was interested in kota_'s opinion on https://review.openstack.org/#/c/592231/ | 21:15 |
| kota_ | ah... I know them, sorry no updates for this time, I just finished another one than the last 2 things. | 21:15 |
| mattoliverau | cool | 21:15 |
| mattoliverau | ahh no notmyname means no patchbot. shame | 21:15 |
| kota_ | then, I won't have this week and the next week because of the technical *NTT* conference in my office location. | 21:16 |
| mattoliverau | timburke: did you want to add them to the s3api list there? or do you feel their not a priority | 21:16 |
| kota_ | sorry. | 21:16 |
| mattoliverau | kota_: no worries, these things happen | 21:16 |
| timburke | mattoliverau: yeah, i'll probably do that. they came up as customer issues, so i'm gonna carry some (more) patches on swift3, which puts me further off from being able to switch to s3api :-( | 21:17 |
| timburke | kota_: don't worry :-) enjoy the work conference! | 21:17 |
| mattoliverau | timburke: yeah, we don't want that. I'd rathere have you pushing patches upstream then loose you to maintain downstream patches! | 21:18 |
| mattoliverau | ;et | 21:18 |
| mattoliverau | let's add them | 21:18 |
| timburke | i can do both :-) | 21:19 |
| mattoliverau | maybe I should finally stop being lazy and learn more of the s3 api so I can help review | 21:19 |
| timburke | at least for a while | 21:19 |
| mattoliverau | :) | 21:19 |
| mattoliverau | cool | 21:19 |
| mattoliverau | The undelete accounts is on me, but I haven't really gone and helped like I said yet. Been too busy with SUSE work :( | 21:19 |
| kota_ | mattoliverau: no worries | 21:20 |
| timburke | fwiw https://github.com/swiftstack/vagrant-swift-all-in-one configures s3cmd pretty well, and i've got a patch up to have it also configure awscli for you | 21:20 |
| timburke | i like that i can use aws's own tooling to test my changes :-) | 21:21 |
| mattoliverau | but from what I can see, if we add the ability to undelete accounts (officially) then we need to support it. and there is a eventual consistency issue when a reaper may delete _everything_ if something has been undeleted. So I think some kind of qourum needs to be added, if we want to support it. | 21:21 |
| mattoliverau | timburke: ahh cool, I should take a look at that | 21:21 |
| mattoliverau | I offered to help write some quorum check, but haven't had a chance... | 21:22 |
| mattoliverau | I should go and at least let them know I'm not dead. | 21:22 |
| *** radeks_ has quit IRC | 21:22 | |
| mattoliverau | The only other patch on the priority reviews is the keymaster nice to have. and the swift-object-info one. | 21:23 |
| mattoliverau | I did review it a while ago. timburke is it ready for another review? | 21:23 |
| timburke | oh, i forget. i'll take a look today | 21:24 |
| mattoliverau | I know you have alot of patches in the air, so maybe this one isn't really a hight priority | 21:24 |
| timburke | speaking of keymasters, i keep meaning to review your https://review.openstack.org/#/c/591555/ mattoliverau | 21:24 |
| timburke | i guess i'll break down and actually have my barbican config under /etc/ -- i managed to get keystone happy running from somewhere else, but i haven't been able to do the same for barbican... | 21:25 |
| mattoliverau | yeah, I'd love to see that in the next release, just so all our keymasters (upstream) have the same set of features. maybe I should add that to the priority reviews section? | 21:25 |
| timburke | i like it. i feel like it ought to be higher priority than the object-info guy, anyway | 21:26 |
| mattoliverau | timburke: I used the saio install script/env that tdasilva forked when we were first reviewing the kms keymaster orginially :) | 21:26 |
| timburke | it all *looks* right -- i just wanna remember how to functionally test again :-) | 21:26 |
| mattoliverau | :) | 21:26 |
| mattoliverau | I'll add it to the page. | 21:27 |
| timburke | then maybe i could add barbican to our dsvm job... | 21:27 |
| mattoliverau | not a bad idea | 21:27 |
| tdasilva | https://github.com/thiagodasilva/barbican-swift | 21:27 |
| *** bobh has quit IRC | 21:28 | |
| mattoliverau | also makes us look better doing more cross project testing | 21:28 |
| mattoliverau | not that we'd install barbican master tho | 21:28 |
| mattoliverau | tdasilva: that's the one, I forked and use that when I want to test kms, because I'm lazy | 21:28 |
| tdasilva | cool! | 21:29 |
| mattoliverau | why reinvent the wheel, when tdasilva or timburke has already invented it ;) | 21:29 |
| timburke | but what if i can *make a better wheel*!? :P | 21:29 |
| mattoliverau | lol, it's called a PR ;) | 21:30 |
| *** janders has quit IRC | 21:30 | |
| tdasilva | if you are in the business of making wheels... | 21:30 |
| mattoliverau | then that's a different story I guess. | 21:30 |
| mattoliverau | if there's nothing else on this topic, lets move on. | 21:30 |
| mattoliverau | #topic task queue | 21:31 |
| *** openstack changes topic to "task queue (Meeting topic: swift)" | 21:31 | |
| mattoliverau | Any updates on this? | 21:31 |
| mattoliverau | tdasilva and myself worked on a documentation follow up patch. | 21:31 |
| kota_ | great | 21:31 |
| *** e0ne has quit IRC | 21:32 | |
| mattoliverau | did that get sqashed in? | 21:32 |
| kota_ | no idea, m_kazuhiro doesn't seem to be here. | 21:33 |
| mattoliverau | https://review.openstack.org/#/c/616076/ | 21:33 |
| mattoliverau | ^ documentation patch | 21:33 |
| kota_ | can i ping him in the day time in my time zone? | 21:33 |
| mattoliverau | kazahiro left a comment saying he'd like to get rledisez review on it before sqashing it in. | 21:33 |
| kota_ | i see | 21:34 |
| rledisez | mattoliverau: i'll try to have a look at it this week | 21:34 |
| mattoliverau | And I have no doubt rledisez english skills are better then mine (Australian english == bad english) :P | 21:34 |
| mattoliverau | ta. | 21:34 |
| kota_ | lol | 21:35 |
| mattoliverau | but the doc patch doesn't stop people looking at the task queue patch. | 21:35 |
| mattoliverau | anyway, this is just a reminder. If you have the time, I know we're all busy | 21:35 |
| mattoliverau | next topic | 21:35 |
| mattoliverau | #topic LOSF | 21:35 |
| *** openstack changes topic to "LOSF (Meeting topic: swift)" | 21:35 | |
| mattoliverau | rledisez: anything to update? | 21:36 |
| mattoliverau | any reviews you want to point us at that we really should be reviewing for you? | 21:36 |
| rledisez | not for this week. it's quiet on the losf side | 21:36 |
| rledisez | we've been struggling with bugs that might be related to eventlet more than losf | 21:36 |
| rledisez | a proper bugreport + patch is on the way about one of them, still digging for the others | 21:37 |
| kota_ | rledisez: it seems like Norio succeeded to run the Alex's branch in his env, he is now looking the diff to know how was implemented. | 21:37 |
| rledisez | kota_: awesome, it's not only OVH work now ;) | 21:37 |
| kota_ | rledisez: that's my plan ;) | 21:38 |
| mattoliverau | \o/ | 21:38 |
| mattoliverau | that's awesome news | 21:38 |
| mattoliverau | I look forward to reading the bugreport. | 21:39 |
| mattoliverau | maybe that reads bad. is it bad to look forward to reading bug reports? | 21:39 |
| mattoliverau | i dunno, still pre coffee for me :p | 21:39 |
| rledisez | mattoliverau: you loof forward to reading the bugreport that will contain a link to the patch, right? :D | 21:40 |
| mattoliverau | oh yeah, well that certainly is true ;) | 21:40 |
| kota_ | lol | 21:40 |
| mattoliverau | but if you get blocked and need more eyes and heads then get the bugreport in. Especially if it's due to eventlet, clayg would love more fodder against eventlet I'm sure :) | 21:41 |
| mattoliverau | Cool, then lets move on the last topic. | 21:41 |
| mattoliverau | #topic open discussion | 21:41 |
| *** openstack changes topic to "open discussion (Meeting topic: swift)" | 21:41 | |
| mattoliverau | Anything else anyone wants to bring up? | 21:42 |
| rledisez | mattoliverau: back to the subject, the more we go, the more I want to drop eventlet. is there somewhere an idea of a plan to do that? | 21:42 |
| timburke | encryption got ported to py3! | 21:42 |
| rledisez | my first though was to get uwsgi in, to do the "prefork" stuff, then remove eventlet step by step. does it sounds crazy? what about having uwsgi as dependency… so man questions :) | 21:43 |
| timburke | rledisez: i know clayg feels the same way -- not sure about a concrete plan, though | 21:43 |
| mattoliverau | yeah, that's similar to the plan clayg has | 21:44 |
| mattoliverau | And I think makes sense. | 21:44 |
| mattoliverau | Not sure we documented it anywhere. | 21:44 |
| mattoliverau | I'll see if I can find any clay ramblings in etherpads about it. And let's add it to ideas to start fleshing out some more. | 21:44 |
| timburke | were you thinking mainly for the backend servers, or proxy server as well? i could maybe see eventlet still kinda making sense on the proxy... idk. haven't thought about it enough. | 21:44 |
| mattoliverau | based on that we'd hopefully know if it sinks or swims and can move on it, either way | 21:45 |
| rledisez | timburke: yes, object server first. for proxy, it might be a good idea to keep it for now | 21:45 |
| rledisez | i think i'll try something simple first, running object server in uwsgi with eventlet_tpool_size to 0 and see how it goes (performance & co). after that, we'll see if there is something to fo from there | 21:46 |
| mattoliverau | with all the worker stuff starting to happen in the back end, it makes sense. currently I think we need to fork before eventlet monkey patches breaks things, so it definitely gets in the way. | 21:47 |
| timburke | i think zaitcev's https://review.openstack.org/#/c/427911/ might still be a pre-req -- kinda depends on what the new server would do with the stray zero-byte chunk we stick into the mime doc PUT stream... | 21:47 |
| rledisez | timburke: hum, i see, i will try to run func test on it to see what happen | 21:48 |
| mattoliverau | rledisez: nice, see how that goes. But eventley does a bunch of monkey patching to other areas of python, so would a eventlet_tpool_size of 0 stop that, you may still end up fighting evenlet to some extent. | 21:49 |
| mattoliverau | but only testing will tell | 21:49 |
| timburke | yeah -- EC is where it'd bite you. see https://bugs.launchpad.net/swift/+bug/1496636 | 21:49 |
| openstack | Launchpad bug 1496636 in OpenStack Object Storage (swift) "EC: Chunked transfer/commit protocol is *not* HTTP" [Medium,In progress] - Assigned to Pete Zaitcev (zaitcev) | 21:49 |
| kota_ | :/ | 21:50 |
| rledisez | ok, so back to square one i guess | 21:50 |
| *** yamamoto has joined #openstack-meeting | 21:50 | |
| mattoliverau | to go back a step, timburke yeah py3 encrption, nice! | 21:51 |
| timburke | or, we keep moving forward on getting our "HTTP" protocol to actually be HTTP! and then we can (theoretically) use whatever WSGI server we want! | 21:51 |
| mattoliverau | timburke: hows the py3 stuff going, I've seen patches for the account server, so you and zaitcev are doing awesome there. | 21:52 |
| mattoliverau | timburke: +1 | 21:52 |
| mattoliverau | that's the whole point of using a standard :) | 21:52 |
| timburke | ¯\_(ツ)_/¯ | 21:52 |
| timburke | who knows | 21:52 |
| timburke | someday it'll all run under py3 -- hopefully it'll even upgrade all nice | 21:53 |
| mattoliverau | lol | 21:53 |
| mattoliverau | py2 > py3 is much more of a rewrite then I expected, and it always comes down to unicode and byte strings. | 21:54 |
| timburke | there's probably going o be a long tail of fixes before we declare full support. like, we thought we had common.utils ported already, but nope: https://review.openstack.org/#/c/619109/1/swift/common/utils.py | 21:54 |
| timburke | (thanks for merging that btw, mattoliverau) | 21:54 |
| timburke | occasionally there are other issues -- like lists becoming iterators :-) | 21:55 |
| mattoliverau | we may need to add to our developer documentation, for devs, on how to write code that behaves correctly (ie how and when to use str_to_wsgi etc) | 21:56 |
| mattoliverau | timburke: yeah | 21:56 |
| mattoliverau | and moving everything :P | 21:56 |
| mattoliverau | ok only 4 minutes to go | 21:56 |
| mattoliverau | I didn't expect the meeting to go as long.. but then again, I'm not very short winded. | 21:57 |
| mattoliverau | Anything else to bring up before the end of the meeting? | 21:57 |
| mattoliverau | going 1... | 21:58 |
| mattoliverau | 2... | 21:58 |
| mattoliverau | ...3 | 21:58 |
| mattoliverau | the channel my inner notmyname: thanks for your work on swift! | 21:58 |
| kota_ | thanks mattoliverau | 21:58 |
| mattoliverau | #endmeeting | 21:58 |
| *** openstack changes topic to "OpenStack Meetings || https://wiki.openstack.org/wiki/Meetings/" | 21:58 | |
| openstack | Meeting ended Wed Nov 21 21:58:40 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 21:58 |
| openstack | Minutes: http://eavesdrop.openstack.org/meetings/swift/2018/swift.2018-11-21-21.01.html | 21:58 |
| openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/swift/2018/swift.2018-11-21-21.01.txt | 21:58 |
| openstack | Log: http://eavesdrop.openstack.org/meetings/swift/2018/swift.2018-11-21-21.01.log.html | 21:58 |
| timburke | thanks mattoliverau! | 21:58 |
| *** timburke has left #openstack-meeting | 21:59 | |
| *** mriedem has quit IRC | 21:59 | |
| *** shrasool has quit IRC | 22:02 | |
| *** shrasool has joined #openstack-meeting | 22:04 | |
| *** rcernin has joined #openstack-meeting | 22:09 | |
| *** priteau has quit IRC | 22:16 | |
| *** shrasool has quit IRC | 22:17 | |
| *** erlon has joined #openstack-meeting | 22:26 | |
| *** dtrainor_ has joined #openstack-meeting | 22:37 | |
| *** dtrainor has quit IRC | 22:40 | |
| *** imacdonn has quit IRC | 22:42 | |
| *** imacdonn has joined #openstack-meeting | 22:42 | |
| *** a-pugachev has quit IRC | 22:54 | |
| *** diablo_rojo has quit IRC | 23:02 | |
| *** dtrainor__ has joined #openstack-meeting | 23:12 | |
| *** dtrainor_ has quit IRC | 23:15 | |
| *** slaweq has quit IRC | 23:45 | |
| *** lbragstad is now known as lbragstad_turkey | 23:46 | |
| *** lbragstad_turkey has quit IRC | 23:56 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!