| *** csmart has quit IRC | 00:24 | |
| *** csmart has joined #openstack-swift | 00:34 | |
| *** ccamacho has quit IRC | 00:42 | |
| kota_ | hello world | 00:44 |
|---|---|---|
| *** onovy has quit IRC | 00:54 | |
| *** onovy has joined #openstack-swift | 01:01 | |
| *** onovy has quit IRC | 01:14 | |
| *** onovy has joined #openstack-swift | 01:26 | |
| *** threestrands has joined #openstack-swift | 01:37 | |
| *** e0ne has joined #openstack-swift | 03:47 | |
| *** gkadam has joined #openstack-swift | 03:50 | |
| *** mvkr has joined #openstack-swift | 04:14 | |
| *** e0ne has quit IRC | 04:49 | |
| *** e0ne has joined #openstack-swift | 04:50 | |
| *** e0ne has quit IRC | 04:51 | |
| *** e0ne has joined #openstack-swift | 05:08 | |
| *** e0ne has quit IRC | 05:16 | |
| *** e0ne has joined #openstack-swift | 06:00 | |
| *** e0ne has quit IRC | 06:03 | |
| *** e0ne has joined #openstack-swift | 06:12 | |
| *** e0ne has quit IRC | 06:20 | |
| *** ccamacho has joined #openstack-swift | 06:33 | |
| alecuyer | kota_o/ | 07:03 |
| kota_ | alecuyer: o/ | 07:03 |
| *** pcaruana has joined #openstack-swift | 07:06 | |
| *** tesseract has joined #openstack-swift | 07:06 | |
| *** threestrands has quit IRC | 07:18 | |
| *** rcernin has quit IRC | 07:23 | |
| *** tkajinam has quit IRC | 08:02 | |
| *** e0ne has joined #openstack-swift | 08:09 | |
| *** mikecmpbll has joined #openstack-swift | 08:32 | |
| *** tesseract has quit IRC | 08:40 | |
| *** rcernin has joined #openstack-swift | 09:00 | |
| openstackgerrit | Alexandre Lécuyer proposed openstack/swift feature/losf: WIP - Support RPC over plain HTTP (vs gRPC) https://review.opendev.org/679022 | 09:41 |
| *** tkajinam has joined #openstack-swift | 09:48 | |
| *** tkajinam has quit IRC | 10:18 | |
| *** hoonetorg has quit IRC | 10:44 | |
| *** hoonetorg has joined #openstack-swift | 10:57 | |
| *** jistr has quit IRC | 12:29 | |
| *** jistr has joined #openstack-swift | 12:29 | |
| *** jistr has quit IRC | 12:30 | |
| *** gkadam has quit IRC | 12:37 | |
| *** jistr has joined #openstack-swift | 12:40 | |
| *** binwiederhier has joined #openstack-swift | 12:48 | |
| binwiederhier | Hello everyone, I'm sure this comes up a lot, so feel free to point me to the correct place: I know there have been discussions about the "lots of small files" problem, and I've seen pull requests and slides and whatnot when I google, but nothing concrete. What's the status of the LOSF efforts? | 12:49 |
| binwiederhier | (I am referring to https://github.com/alecuyer/swift/pull/1 and https://archive.fosdem.org/2019/schedule/event/small_files_in_swift_cluster/) | 12:49 |
| alecuyer | binwiederhier: We use it at OVH for some clusters. The public feature branch is feature/losf on gerrit, | 12:53 |
| alecuyer | we're currently removing gRPC because of incompatibilities with eventlet (it currently requires running an old version of gRPC). and then I'll still have a few patches to send for reviews and tests to write | 12:54 |
| binwiederhier | alecuyer: Oh hey! Great talk and thanks for responding. | 12:55 |
| binwiederhier | So the feature is still in active development then, I presume? | 12:55 |
| *** redrobot has quit IRC | 12:55 | |
| binwiederhier | I'm exploring options for my company and we have billions/trillions fo 1-2 KB objects to store. | 12:56 |
| alecuyer | binwiederhier: Yes, I can't be working on it 100% but I'd like to "finish" (at least the list of things that I know are stil "wrong", such as the gRPC thing) | 12:56 |
| binwiederhier | Are there any instructions for how to test it out? | 12:57 |
| alecuyer | If you're testing on a SAIO that should quite straightforward, if you want to test on a "real" cluster you'd have to look at the ansible playbooks and see how to apply that to your environment | 12:59 |
| alecuyer | Happy to help either way if I can | 12:59 |
| alecuyer | Also.. if the objects are not there yet, maybe see if there is any way you could aggregate them and store larger objects ;) 1-2KB sounds really small | 13:00 |
| binwiederhier | Can't change user data. We're backing up SaaS services such as GSuite, O365 and others. Emails and calendar entries and such are pretty small after compression. | 13:02 |
| *** pcaruana has quit IRC | 13:03 | |
| binwiederhier | I'll give it a shot this week and get back to you if I have any trouble. Great work and thanks for responding!! | 13:03 |
| alecuyer | Right. I said "SAIO", I meant this : https://docs.openstack.org/swift/latest/development_saio.html - I don't know if you're familiar with it | 13:03 |
| alecuyer | so if you clone this https://github.com/alecuyer/vagrant-swift-all-in-one and run "vagrant up" it should set it up for you | 13:04 |
| binwiederhier | Oh that's cool. I'll do that!! Thanks | 13:04 |
| binwiederhier | I read that guide^ once on my phone and I thought "that's how you set up swift???", I didn't realize I was reading the dev guide haha. | 13:05 |
| alecuyer | hehe yes :) | 13:05 |
| *** zaitcev has joined #openstack-swift | 13:34 | |
| *** ChanServ sets mode: +v zaitcev | 13:34 | |
| *** pcaruana has joined #openstack-swift | 13:34 | |
| *** redrobot_ has joined #openstack-swift | 13:36 | |
| *** redrobot_ is now known as redrobot | 13:37 | |
| tdasilva | binwiederhier: just fyi, looks like LOSF is becoming more of a focus for the community, see timburke candidacy for swift ptl: http://lists.openstack.org/pipermail/openstack-discuss/2019-August/008957.html | 13:38 |
| binwiederhier | Cool! Thanks for the link. | 13:40 |
| *** eckesicle has joined #openstack-swift | 13:45 | |
| *** pcaruana has quit IRC | 13:47 | |
| *** pcaruana has joined #openstack-swift | 13:57 | |
| *** pcaruana has quit IRC | 14:07 | |
| *** pcaruana has joined #openstack-swift | 14:10 | |
| *** rcernin has quit IRC | 14:32 | |
| timburke | alecuyer, fyi -- we publish the branch docs, too: https://docs.openstack.org/swift/feature/losf/development_saio.html | 15:06 |
| timburke | so if there's anything that would be worth documenting about how to set it up, so much the better ;-) | 15:06 |
| alecuyer | timburke: oh thanks! I'll check it | 15:07 |
| *** pcaruana has quit IRC | 15:27 | |
| tdasilva | donnyd: just catching up with the convo from last week. I remember you just setup a swift cluster right? not sure if you are storing lots of objects in a single container, but you might want to take a look at container sharding feature and monitor your async pendings | 15:45 |
| donnyd | Yes I did just set it up. I haven't really looked how infra is pushing objects. | 15:46 |
| tdasilva | donnyd: ok, just concerned about the volume you are seeing :) | 15:48 |
| donnyd | I haven' | 15:48 |
| donnyd | ugg... I haven't heard any complaints yet, so I assume everything is "just working" | 15:48 |
| donnyd | LOL - but thats mainly because I have other things that really need my focus atm | 15:49 |
| tdasilva | yeah, swift is really good at "just keeps working" even when things are failing, until you are at a breaking point and you start running into issues.. so it's a good idea to setup good monitoring, don't let disks fill up, check that you have enough resources to keep up with replication, expiration, etc...it's easy to neglect it, that's all | 15:51 |
| *** e0ne has quit IRC | 16:00 | |
| *** gyee has joined #openstack-swift | 16:12 | |
| *** BjoernT has joined #openstack-swift | 16:14 | |
| *** NM has joined #openstack-swift | 16:58 | |
| *** mikecmpbll has quit IRC | 17:03 | |
| donnyd | thanks tdasilva | 17:04 |
| donnyd | Its on the list of things that need to get done | 17:04 |
| *** e0ne has joined #openstack-swift | 17:12 | |
| donnyd | tdasilva: https://grafana.fortnebula.com/d/9MMqh8HWk/openstack-utilization?orgId=2&refresh=30s | 17:22 |
| *** e0ne has quit IRC | 17:23 | |
| donnyd | If you look at the bottom there is now a metric for swift | 17:23 |
| *** e0ne has joined #openstack-swift | 17:23 | |
| donnyd | I will make a whole dashboard for it when i get a few minutes | 17:23 |
| *** pcaruana has joined #openstack-swift | 17:29 | |
| *** e0ne has quit IRC | 17:30 | |
| *** eckesicle has quit IRC | 17:54 | |
| *** e0ne has joined #openstack-swift | 18:15 | |
| *** mvkr has quit IRC | 18:18 | |
| *** gyee has quit IRC | 18:53 | |
| *** gyee has joined #openstack-swift | 19:07 | |
| *** e0ne_ has joined #openstack-swift | 19:24 | |
| *** e0ne_ has quit IRC | 19:26 | |
| *** e0ne has quit IRC | 19:27 | |
| *** NM has quit IRC | 19:33 | |
| *** NM has joined #openstack-swift | 19:38 | |
| *** NM has quit IRC | 19:45 | |
| *** pcaruana has quit IRC | 20:00 | |
| *** NM has joined #openstack-swift | 22:04 | |
| *** NM has quit IRC | 22:18 | |
| *** BjoernT has quit IRC | 22:33 | |
| *** tkajinam has joined #openstack-swift | 22:55 | |
| *** diablo_rojo has joined #openstack-swift | 22:56 | |
| *** rcernin has joined #openstack-swift | 23:06 | |
| *** threestrands has joined #openstack-swift | 23:26 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!