Monday, 2017-04-24

*** mattoliverau_ has quit IRC00:02
*** mattoliverau_ has joined #openstack-swift00:03
*** klrmn has quit IRC00:28
*** tone_zrt has joined #openstack-swift01:01
*** m_kazuhiro has joined #openstack-swift01:11
m_kazuhirogood morning01:19
kota_good morning01:21
m_kazuhirokota_: o/01:21
kota_m_kazuhiro: o/01:21
kota_it looks like timburke found something on erasure code?01:21
kota_scrolling back to the irc logs...01:22
notmynamemahatic: that's fantastic!01:23
notmynamekota_: hmm.. he said something to me in the office last week, I think01:23
notmynameunfortunately, I don't remember details01:23
kota_notmyname: no problem, I'll ask him again on his working time (i think you and he are in weekend ;-))01:24
notmynameya. Sunday evening here01:26
notmynameabout 6:30pm01:26
kota_notmyname: enjoy your time ;-)01:26
notmynamethanks01:27
*** jamielennox is now known as jamielennox|away01:33
mattoliveraukota_, m_kazuhiro: morning01:42
mattoliveraunotmyname: o/01:42
notmynameo/01:42
kota_mattoliverau: hello01:42
*** jamielennox|away is now known as jamielennox01:44
m_kazuhiromattoliverau: o/01:46
openstackgerritPete Zaitcev proposed openstack/swift master: PUT+POST and its development test  https://review.openstack.org/42791101:49
*** mattoliverau has quit IRC02:04
*** mattoliverau_ is now known as mattoliverau02:04
*** ChanServ sets mode: +v mattoliverau02:04
*** abhitechie has joined #openstack-swift02:33
*** abhitechie has quit IRC02:43
*** winggundamth has joined #openstack-swift02:48
*** klrmn has joined #openstack-swift02:51
*** psachin has joined #openstack-swift02:59
*** winggundamth has quit IRC03:45
*** gkadam has joined #openstack-swift03:46
*** oshritf has joined #openstack-swift03:56
*** oshritf has quit IRC04:04
*** Dinesh_Bhor has joined #openstack-swift04:06
*** m_kazuhiro has quit IRC04:13
*** m_kazuhiro has joined #openstack-swift04:15
*** chsc has joined #openstack-swift04:24
*** chsc has joined #openstack-swift04:24
*** chsc has quit IRC04:34
*** PavelK has joined #openstack-swift05:02
*** ivru has joined #openstack-swift05:19
PavelKclayg: I reduced probe tests from patch 448480 as you suggested. Is it ready to be merged?05:25
patchbothttps://review.openstack.org/#/c/448480/ - swift - DB replicator cleanup05:25
*** bkopilov has quit IRC05:26
*** arunman has joined #openstack-swift05:39
*** cshastri has joined #openstack-swift05:41
*** bkopilov has joined #openstack-swift05:48
*** adriant has quit IRC06:08
*** Dinesh_Bhor has quit IRC06:13
*** Dinesh_Bhor has joined #openstack-swift06:27
*** oshritf has joined #openstack-swift06:32
*** hseipp has joined #openstack-swift06:41
*** oshritf has quit IRC06:51
*** klrmn has quit IRC06:52
*** SkyRocknRoll has joined #openstack-swift07:08
*** ChubYann has quit IRC07:12
*** m_kazuhiro has quit IRC07:19
*** pcaruana has joined #openstack-swift07:24
*** arunman has quit IRC07:26
*** oshritf has joined #openstack-swift07:32
*** jaosorior has joined #openstack-swift07:33
*** arunman has joined #openstack-swift07:34
*** rcernin has joined #openstack-swift07:43
*** arunman has quit IRC07:49
*** d0ugal has joined #openstack-swift07:50
*** d0ugal has quit IRC07:50
*** d0ugal has joined #openstack-swift07:50
acolesgood morning07:59
*** cbartz has joined #openstack-swift08:10
*** rcernin has quit IRC08:23
*** SkyRocknRoll has quit IRC08:30
mattoliverauacoles: morning08:40
*** Craig_ has joined #openstack-swift08:45
Craig_Hello everyone08:47
Craig_Just want to ask if anyone knows the mechanism of Swift's "graceful restart"08:48
Craig_I send SIGHUP signal to swift-object-server or swift-proxy-server while uploading a large file to Swift08:49
Craig_Then the connection broke immediately08:50
Craig_Do I misunderstand the meaning of graceful shutdown/restart?08:51
Craig_I thought it should wait for my current request finishing08:51
*** arunman has joined #openstack-swift08:52
mahaticacoles: mattoliverau hi09:00
mahaticnotmyname: re: "That's fantastic", I think that's for mattoliverau making it to Boston :)09:01
mahaticsorry for not being as much active, caught up with some stuff at work and personally too09:04
mahaticoh and I'll be making it to Boston!09:05
acolesCraig_: I'm not really familiar with that but I just tried 'swift-init --graceful stop proxy-server' while I had a large object upload in flight and it appears to have waited for the object upload to complete09:22
acolesCraig_: my proxy log also differentiates between a graceful/non-graceful stop with either 'SIGHUP received'  or 'SIGTERM received'09:25
acolesmahatic: hi! great news!09:25
Craig_acoles: I can see 'SIGHUP received' in my log too, but the line immediate following is 'Removing dead child 862126'09:27
Craig_acoles: thank you very much for your test09:28
Craig_acoles: BTW, I am on Mitaka 2.7.109:28
*** SkyRocknRoll has joined #openstack-swift09:31
*** SkyRocknRoll has quit IRC09:37
acolesCraig_: I just rolled back to 2.7.1 , same as before: http://paste.openstack.org/show/607644/09:41
acolesI also tried stopping the object servers gracefully, also ok (PUT completes)09:42
Craig_acoles: would you please test sending SIGHUP signal to your proxy pid?09:43
Craig_acoles: because I am using systemd unit file to control my Swift services09:43
Craig_acoles: maybe I have some misconfiguration09:45
Craig_acoles: great, I have the same result as yours when using swift-init --graceful09:49
Craig_acoles: then I have to figure out the reason why directly sending signal doesn't work09:50
Craig_acoles: much appreciate your help!09:51
*** mvk has quit IRC09:54
acolesCraig_: remember I said i wasn't hugely familiar with this, but the key may be here https://github.com/openstack/swift/blob/4d3aa4ea78d1867acc8c7520790a90c748b3285c/swift/common/wsgi.py#L925-L933 - the wsgi process handles the SIGHUP gracefully, but if the SIGHUP is sent to it's child then that will exit immediately (I can reproduce that just like you're seeing)09:54
acolesCraig_: OMM 'swift-oldies -a 0' shows me two proxy-server pids. SIGHUP to the parent gets a graceful exit, SIGHUP to the child does not.09:56
*** klrmn has joined #openstack-swift10:03
Craig_acoles: Interesting. By using swift-init, I got the result identical to yours. But using systemd managed service framework (deployed by openstack-ansible), sending signal to either parent or child gets the same undesired result10:04
acolesCraig_: hmm. try asking here later (US timezone) you may get someone who has more hand-on experience than me10:06
Craig_acoles: sure. thank you very much, you helped me a lot :)10:08
*** abhitechie has joined #openstack-swift10:11
Craig_acoles: I just found the answer. systemd's default KillMode=control-group will send signal to all process in the same control group (so as the child process). After changed to KillMode=process, it reacts as what I want.10:20
acolesCraig_: ah. glad you found that :)10:21
Craig_acoles: thank you. here is really a magic place :D10:23
*** mvk has joined #openstack-swift10:23
*** abhitechie has quit IRC10:23
*** abhitechie has joined #openstack-swift10:24
*** kei_yama has quit IRC10:47
*** Craig_ has quit IRC11:04
*** Dw_Sn has joined #openstack-swift11:10
Dw_Snhello, can I compute the multipart etag manually ? lets say I have 6G file that split into 5G chunk and 1G chunk, that means md5sig1md5sig2 | md5sum ? it doesn't show the same one as the one uploaded...11:11
*** zhugaoxiao has quit IRC11:13
*** zhurong has joined #openstack-swift11:17
*** zhugaoxiao has joined #openstack-swift11:17
*** abhitechie has quit IRC11:25
*** abhinavtechie has joined #openstack-swift11:25
*** abhinavtechie has quit IRC11:25
*** abhinavtechie has joined #openstack-swift11:26
*** necmeddin has quit IRC11:26
Dw_Sni get the uploaded one via s3cmd ls --list-md511:27
*** abhinavtechie has quit IRC11:28
*** silor has joined #openstack-swift11:29
*** flwang1 has joined #openstack-swift11:32
flwang1greetings, for swift, is there any way to post many objects in same call? thanks11:33
flwang1the background is Zaqar is using swift as a backend, and I'm trying to figure out if there is any way to create many objects in same request, thanks in advance11:34
flwang1notmyname: ^11:34
*** zhugaoxiao has quit IRC11:34
*** zhugaoxiao has joined #openstack-swift11:35
*** silor has quit IRC11:37
acolesflwang1: the bulk middleware supports uploading multiple objects to a container via a tar file https://docs.openstack.org/developer/swift/middleware.html#module-swift.common.middleware.bulk11:41
acolesflwang1: assuming that middleware is installed11:41
flwang1acoles: thanks, that's interesting11:41
flwang1but for our case, it's not really efficient if it needs to make a tar in the air11:42
flwang1actually, the object zaqar posted to swift is just a json file created dynamitically11:42
flwang1acoles: is it possible to create a middleware to accept a json list and then create object in the middle ware?11:43
flwang1i think gnocchi will love it as well11:43
acolesflwang1: what would be in the list? the object names and content?11:45
flwang1acoles: see https://github.com/openstack/zaqar/blob/master/zaqar/storage/swift/messages.py#L21411:46
flwang1acoles: as you can see, for now, we have to create message separately and post them one by one11:48
flwang1for a messaging system, it's not a good way obviously11:48
*** afazekas has joined #openstack-swift11:55
ivruHey guys. When trying to synchronize 2 containers on different region, when I try to sync-to de source using the swift cli, I get an error : 400 Bad Request  [first 60 chars of response] Full URLs are not allowed for X-Container-Sync-To values. On11:56
ivruAny idea what could be wrong ?11:56
ivru(I'm following this guide https://www.ovh.com/us/g1919.synchronise_object_containers)11:56
acolesflwang1: in principle I guess it would be possible to extract objects from deserialized json. if your use case required 'all or none' put semantics then it could be tricky to achieve that.11:59
*** silor has joined #openstack-swift11:59
flwang1acoles: would you mind explaining 'all or none'?12:00
flwang1we can ensure there are data before posting to swift?12:00
*** vinsh has joined #openstack-swift12:00
acoleseither all 'objects'  in the list are successfully put or if any fails then none are put and the response indicates failure - that would be hard to achieve12:01
flwang1acoles: ah, i can see your point12:02
flwang1acoles: but i can i should be able to follow the same way like the existing bulk middleware?12:02
*** arunman has quit IRC12:09
*** klamath has joined #openstack-swift12:11
*** vinsh has quit IRC12:13
openstackgerritMerged openstack/swift master: Update version in finalize-installation-rdo  https://review.openstack.org/45680112:29
openstackgerritMerged openstack/swift master: Update version in finalize-installation-ubuntu  https://review.openstack.org/45680412:31
acolesflwang: sorry I had to step away. yes, bulk would give an example.12:32
*** catintheroof has joined #openstack-swift12:37
*** zhurong has quit IRC12:39
*** PavelK has quit IRC12:55
*** kencjohnston has quit IRC13:02
*** jerrygb has joined #openstack-swift13:02
*** klamath has quit IRC13:06
*** gkadam has quit IRC13:07
*** klamath has joined #openstack-swift13:08
ivruanyone knows how to allow full url with the python client?13:08
acolesivru: re your query about container sync, allowing full-url for destination container is a server-side conf option so you'll need to check with your service provider13:29
ivruThanks acoles13:31
*** klrmn has quit IRC13:31
*** joeljwright has joined #openstack-swift13:39
*** ChanServ sets mode: +v joeljwright13:39
Dw_Snanywah I can look into the manifest file for a multipart upload ?13:44
Dw_Snanyway *13:44
*** d0ugal_ has joined #openstack-swift13:46
*** d0ugal has quit IRC13:48
*** oshritf has quit IRC13:50
*** d0ugal_ has quit IRC13:55
*** d0ugal has joined #openstack-swift13:59
*** d0ugal has quit IRC14:01
acolesDw_Sn: you can get the manifest content by adding multipart-manifest=get query string to a GET request https://developer.openstack.org/api-ref/object-storage/?expanded=get-object-content-and-metadata-detail14:02
*** arunman has joined #openstack-swift14:06
Dw_Snacoles: thanks, will try that14:08
*** psachin has quit IRC14:08
*** jordanP has quit IRC14:30
*** klamath has quit IRC14:31
*** klamath has joined #openstack-swift14:31
*** d0ugal has joined #openstack-swift14:32
*** oshritf has joined #openstack-swift14:36
*** cshastri has quit IRC14:37
Dw_Snany idea what is s3cmd --list-md5 is outputting as md5sum ? it is not the etag, nor the actual md5sum of the "big file" is that the md5sum of the manifest file ?14:37
Dw_Snyep it is !14:38
*** ivru has quit IRC14:41
*** jordanP has joined #openstack-swift14:42
*** vinsh has joined #openstack-swift14:51
*** oshritf has quit IRC14:53
*** oshritf has joined #openstack-swift14:55
*** oshritf has quit IRC14:58
*** oshritf has joined #openstack-swift14:59
*** chsc has joined #openstack-swift15:01
*** chsc has joined #openstack-swift15:01
*** Dw_Sn has quit IRC15:02
*** jordanP has quit IRC15:03
*** oshritf has quit IRC15:14
*** oshritf has joined #openstack-swift15:16
*** jordanP has joined #openstack-swift15:19
*** klrmn has joined #openstack-swift15:23
*** oshritf has quit IRC15:24
*** silor has quit IRC15:34
*** silor has joined #openstack-swift15:35
notmynamegood morning15:37
notmynamemahatic: great to hear you'll be in boston!15:40
*** zhurong has joined #openstack-swift15:42
*** zhurong has quit IRC15:57
*** gyee has joined #openstack-swift16:00
*** zhurong has joined #openstack-swift16:03
*** zhurong has quit IRC16:07
*** vinsh has quit IRC16:09
*** vinsh has joined #openstack-swift16:12
*** klrmn has quit IRC16:14
*** jerrygb has quit IRC16:16
*** aNuposic has joined #openstack-swift16:24
*** hseipp has quit IRC16:24
*** aNuposic has left #openstack-swift16:24
*** chsc has quit IRC16:24
*** vinsh has quit IRC16:31
*** gyee has quit IRC16:32
*** vinsh has joined #openstack-swift16:33
*** jerrygb has joined #openstack-swift16:33
*** cbartz has quit IRC16:34
*** JimCheung has joined #openstack-swift16:35
*** mvk has quit IRC16:39
*** arunman has quit IRC16:42
*** gyee has joined #openstack-swift16:42
*** arunman has joined #openstack-swift16:56
*** jaosorior is now known as jaosorior_away16:59
*** klrmn has joined #openstack-swift17:02
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873617:03
*** klrmn has left #openstack-swift17:05
*** zhugaoxiao has quit IRC17:06
*** arunman has quit IRC17:07
*** zhugaoxiao has joined #openstack-swift17:07
*** klrmn has joined #openstack-swift17:07
*** klrmn has quit IRC17:10
*** klrmn has joined #openstack-swift17:10
*** chsc has joined #openstack-swift17:17
*** chsc has joined #openstack-swift17:17
*** mvk has joined #openstack-swift17:18
*** zaitcev has joined #openstack-swift17:23
*** ChanServ sets mode: +v zaitcev17:23
*** arunman has joined #openstack-swift17:25
*** arunman has quit IRC17:30
*** tonanhngo has joined #openstack-swift17:45
*** chsc has quit IRC17:57
claygtdasilva: don't we have an open issue/bug about how to handle multipart-manifest=get with server side COPY?17:58
claygwell... rather PUT X-Copy-From17:59
claygor is there a prescribed use of the api to make server-side-copy of a large object manifest just copy the manifest?17:59
*** chlong has joined #openstack-swift17:59
*** catintheroof has quit IRC18:01
*** chsc has joined #openstack-swift18:03
*** chsc has joined #openstack-swift18:03
notmynamethis week I want to tag the 2.14.0 release18:10
notmynamehttps://wiki.openstack.org/wiki/Swift/PriorityReviews and https://bugs.launchpad.net/swift is what I'm checking18:10
*** mwheckmann has joined #openstack-swift18:29
*** catintheroof has joined #openstack-swift18:38
tdasilvaclayg: I thought you were able to use PUT X-Copy-From with a multipart-manifest=get to copy just the manifest?? is that not working?18:39
openstackgerritJohn Dickinson proposed openstack/swift master: authors/changelog for 2.14.0  https://review.openstack.org/45942318:39
notmynamepreliminary 2.14.0 changelog updates ^18:39
tdasilvaclayg: https://github.com/openstack/swift/blob/master/test/functional/test_slo.py#L62618:41
*** chsc has quit IRC18:45
*** chsc has joined #openstack-swift18:56
*** chsc has joined #openstack-swift18:56
*** ChubYann has joined #openstack-swift19:10
*** joeljwright has quit IRC19:30
claygjungleboyj: did you send something out tagged Swift for the os-upstream-institute stuff?19:33
claygjungleboyj: do you go to this meeting?  http://lists.openstack.org/pipermail/openstack-dev/2017-April/115221.html19:33
jungleboyjclayg: I didn't because tdasilva sounded like he could cover it.19:34
jungleboyjclayg: Yes, I am going to that meeting.  :-)19:34
zaitcevI need someone to critique my patch that institutes a new 2-phase store protocol for EC.19:40
tdasilvajungleboyj: looking at the links on that email, and it is not super clear to me what the role of the mentor is??19:42
*** jerrygb has quit IRC19:42
tdasilvado I need to be there all day? do I need to prepare a presentation?19:42
jungleboyjtdasilva:  So, it is pretty free form.  The mentors are there to answer questions about specific projects.19:42
tdasilvaand looks like it's both sat and sunday or only sunday?19:43
jungleboyjWe split people up to tables based on the project they are interested in and it is good to have someone active in that project to help out.19:43
jungleboyjSaturday is going to be mostly about familiarizing people with OpenStack in general.  Mentors are more important on Sunday as we get more technical.19:44
tdasilvajungleboyj: got it19:47
jungleboyjtdasilva:  Let me find out if there is anyone who has indicated interest in Swift in today's meeting.  Will get back to you.19:48
tdasilvajungleboyj: ok, thanks! I need to step out now, but will be back later today and back to a more normal schedule tomorrow19:49
jungleboyjtdasilva:  Sounds good.19:53
*** silor has quit IRC19:56
*** pcaruana has quit IRC20:01
*** tonanhngo_ has joined #openstack-swift20:12
*** jamielennox is now known as jamielennox|away20:13
*** tonanhngo has quit IRC20:14
*** jerrygb has joined #openstack-swift20:17
claygman I struggle with our functest helper/client thing so much20:19
*** tonanhngo has joined #openstack-swift20:20
*** jamielennox|away is now known as jamielennox20:20
*** jerrygb has quit IRC20:21
*** tonanhngo_ has quit IRC20:22
*** Sukhdev has joined #openstack-swift20:44
*** _JZ_ has joined #openstack-swift21:07
*** catintheroof has quit IRC21:15
openstackgerritOndřej Nový proposed openstack/swift master: Fix unit tests on i386 and other archs  https://review.openstack.org/45853921:26
*** clayg_ has joined #openstack-swift21:33
clayg_irccloud.com took me 10 seconds to get in IRC21:34
clayg_I might start recommending that21:35
clayg_they seem to have some some sort of bouncer sort of situation/offering going on....21:35
clayg_$50/yr is quite a bit less than my amazon bill ... but I don't really have any idea of how much of my spend with aws goes to the machine my irssi client runs on21:37
openstackgerritOndřej Nový proposed openstack/swift master: Fix unit tests on i386 and other archs  https://review.openstack.org/45853921:40
clayg_Zomg on my phone!?21:40
clayg_All free so far. I can see my scroll back.21:41
claygwell that was fun21:41
claygclayg_: do you still have the app open?!21:41
claygclayg_: this could quite possibly be the worst thing ever21:42
notmynameclayg_: clayg: having it on a phone would be nice21:42
claygclayg_: and with the tag closed?21:42
claygwow - my phone is a buzz!21:42
claygirccloud folks - sign up21:42
claygit will ruin your life21:42
mattoliverauMy phone has been buzzing a while, and yeah, it can ruin your life ;p21:44
clayg_ahem ctrl-U doesn't work in the web client it seems21:45
mattoliverauI'm playing with weechat's relay and weechatandroid, which is pretty nice. I love that they'd out a tab so you can autocomplete names :)21:46
mattoliverau*put21:47
mattoliverauAlso... Morning o/21:47
notmynamemattoliverau: hello. happy to hear you'll be in boston21:48
notmynameseems my autocomplete failed last time I tried to say that21:48
clayg_notmyname: auto complete works great in irccloud's web client FYI ;)21:49
mattoliveraunotmyname:  thanks, yeah glad I'll be able to come21:49
notmynameclayg_: I'll look at IRC cloud when they finish the "in dev" feature of allowing other clients to connect21:50
mattoliverauSo I can hang with y'all and try and trick someone into needing a Swift Dev ;)21:50
notmynameservice provider problem reports: so interesting, yet so unhelpful21:50
notmynamebriancline: oh hi!21:51
notmyname[related to swift requests] "Engineers identified the source of the latency for Keystone-authorized requests and took several steps to mitigate the underlying issue"21:51
notmynamewhat was the problem between swift and keystone that caused "intermittent latency"??!?21:51
clayg_notmyname: lazy packets21:52
notmynameI don't believe it! every packet I've met is very hard working! surely there was some good reason21:55
*** klamath has quit IRC22:06
clayg_look, i'm not saying *all* packets are lazy; some (I've heard) are very good abstract units of data - but we live in a world with very dangerous networks you have to be prepared to take several steps in order to mitigate underlying issues (i.e. reboot things)22:11
notmynamemaybe we should build a firewall22:14
notmyname(...and make keystone pay for it)22:15
*** JimCheung has quit IRC22:28
*** JimCheung has joined #openstack-swift22:29
openstackgerritJohn Dickinson proposed openstack/swift master: authors/changelog for 2.14.0  https://review.openstack.org/45942322:38
mattoliverauLol, a very random, but awesome conversation. Now I'm hoping for a Pixar movie about poor packets needing to route through the dark net22:41
mattoliverauAlso, it's Anzac Day here, so another public holiday, so might be in and out quite a bit.22:43
notmynameyay holiday!22:44
*** spotz_ has quit IRC23:34
*** kei_yama has joined #openstack-swift23:34
*** chsc has quit IRC23:39
*** tonanhngo has quit IRC23:43
*** tonanhngo has joined #openstack-swift23:55
*** spotz_ has joined #openstack-swift23:56
*** spotz_ has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!