Monday, 2016-05-09

*** manous has quit IRC00:00
*** darrenc is now known as darren_afk00:09
*** natarej has quit IRC00:16
*** natarej has joined #openstack-swift00:16
*** klamath has joined #openstack-swift00:17
*** darren_afk is now known as darrenc00:23
*** klamath has quit IRC00:26
kota_hello, back to online.00:47
*** itlinux has joined #openstack-swift00:48
kota_jrichli: thanks for sharing simlink etherpad, will see.00:48
mattoliveraukota_: morning00:48
kota_mattoliverau: morning00:48
mattoliveraukota_: hows bub and mum doing?00:48
kota_mattoliverau: everything is well, my parents is taking care of them in day time instead of me )00:49
kota_thanks!00:49
mattoliveraukota_: nice, well glad to have you back then :)00:51
kota_mattoliverau: thanks :)00:51
*** catintheroof has joined #openstack-swift00:55
*** itlinux has quit IRC00:57
*** mingdang1 has joined #openstack-swift02:19
*** itlinux has joined #openstack-swift02:33
*** amit213 has quit IRC02:34
*** amit213 has joined #openstack-swift02:34
*** sorrison_laptop has quit IRC03:05
*** sheel has joined #openstack-swift03:14
*** dmorita has joined #openstack-swift03:26
*** nadeem has joined #openstack-swift03:27
*** furlongm has joined #openstack-swift03:28
*** dmorita has quit IRC03:34
*** links has joined #openstack-swift03:44
*** klrmn has quit IRC03:53
*** catintheroof has quit IRC03:56
*** takashi has joined #openstack-swift04:08
*** silor has joined #openstack-swift04:16
*** psachin has joined #openstack-swift04:27
*** mingdang1 has quit IRC04:58
*** psachin has quit IRC05:18
*** ChubYann has quit IRC05:29
*** itlinux has quit IRC05:31
*** ppai has joined #openstack-swift05:34
*** rcernin has joined #openstack-swift05:40
*** SkyRocknRoll has joined #openstack-swift05:47
*** nadeem has quit IRC06:24
*** jmccarthy has joined #openstack-swift06:29
*** nadeem has joined #openstack-swift06:36
*** mingdang1 has joined #openstack-swift06:39
*** openstackgerrit has quit IRC06:47
*** openstackgerrit has joined #openstack-swift06:48
*** tesseract has joined #openstack-swift07:01
*** mmcardle has joined #openstack-swift07:12
*** rledisez has joined #openstack-swift07:12
*** ntt has joined #openstack-swift07:35
nttHi, I have a test environment with swift (kilo). Actually I have replica=2 with 2 zones and I'm trying wo verify quorum on writes. I turned off one zone and I tried to upload an object .... and it works! how is this possible?07:37
nttquorum should be 2 because Q = (replicas / 2) + 107:38
hosanaintt: i think it uses a hand-off node07:41
ntthosanai: ok....07:44
*** daemontool has joined #openstack-swift07:45
nttChecked... ok... it seems right. Thank you hosanai07:47
mattoliverauntt: hosanai is write, swift still wants to keep your data durable so if it can't talk to the other primary node, it'll pick another node in the cluster to store it (a handoff node). And backend replication will place it on the write handoff node once it's back online.07:48
mattoliveraus/write/right07:48
nttmattoliverau: checked now... and it seems ok. Thank you07:49
mattoliverauMy brain says right.. but fingers type write.. I've been programming too long :P07:49
nttActually I'm trying to count objects between 2 zones ... I have 464 folders in objects folder in Z1 and 458 in Z2.... Is this normal?07:50
nttthis is due to handoff?07:50
nttops... no ... I'm sorry07:51
nttIt's ok07:51
nttmattoliverau: Count the number of folders in objects is a good or a stupid check?07:51
ahalecounting out-of-place partitions might make more sense07:55
nttahale I'm using ls -alh /srv/node/sdX1/account | wc -l  where X = b,c,d,....07:56
ahaleoh yeah thats not what i was thinking you were asking :)07:57
ahalesometimes i use something like this- https://gist.github.com/racker-andrew-hale/04d78e73f92d71c20cefec71f5561e5a07:57
ahaleor finding if handoff happened for a specific put, doesnt proxy log that07:59
nttinteresting.... thank you07:59
nttI have to add 1 zone with 4 new disks and +1 replica to a production (kilo) cluster. Can I modify the ring and add all using just one rebalance? I know that this will cause a lot of copy on the new server, but data are only 800GB and the new server is fast enough08:01
*** jordanP has joined #openstack-swift08:01
ahaleoh i also have a 'handoff analysis' tool , that'll take a ring and a list of down host ips and show you where handoff would go for every part, i can find that if you're interested08:01
*** joeljwright has joined #openstack-swift08:01
*** ChanServ sets mode: +v joeljwright08:01
ahalemaybe - i dont know what the implications of adding capacity and replicas at the same time is08:03
nttahale: I think that every thing that con simplify the sysadmin life is welcome :)08:03
ahalei dont know - sometimes knowing more about the ring doesnt simplify life ;)08:04
nttbut if I have to add a replica, I have to add one replica and at least one disk in a separate zone.... otherwise I write datas on the same zone and I think that is not so useful08:04
ahaleyeah08:06
nttyou're right .... sometimes knowing more abount the ring could be worse :)08:06
nttThis morning I will give a try on a test environment where I have 1 zone , 1 replica and 2 disks. I will try to add 1 zone, 1 replica and 2 disks using one rebalance08:07
nttThe alternative could be to add 1 zone, 1 replica and 1 disk using weight gradually08:07
nttI think if I forget to add simultaneously 1 zone and 1 replica when I add the disk, datas will be distributed over the new disk in the second zone.... is this right?08:08
*** takashi has quit IRC08:11
ahaleah found that script for looking at handoff, its at the bottom of https://gist.github.com/ahale/b91fc9bc745e710e070a08:11
ahaleyeah i would expect it to just add 1 new replica to the new set of disks, that would make sense08:12
ahaleand 800G total probably isnt that much to need adding weight gradually, i dunno - i prefer larger single ring changes than lots of small ones anyway08:13
*** nadeem has quit IRC08:14
nttahale: thank you..... I'm doing test adding 2 disks using one rebalance08:15
*** openstackgerrit has quit IRC08:17
*** Shashikant86 has joined #openstack-swift08:18
*** openstackgerrit has joined #openstack-swift08:18
nttahale: I'm trying to remove 1 zone , 1 replica and 1 disk from the cluster (before trying to add 2 disks). I'm using 1) set_weight 0, set_replicas 1 (was2) and rebalance. For accounts and containers all works well, but with objects it tells me that no partitions could be reassigned08:19
ahalehmm not sure, wasnt there a bug about that recently ?08:19
ahalealso - pm'd you another ring thing08:20
*** daemontool has quit IRC08:21
nttactually I have:  1024 partitions, 1.000000 replicas, 1 regions, 2 zones, 3 devices, 999.99 balance, 0.00 dispersion08:21
nttbut rebalance tells me that not partitions could be reassigned08:21
nttI used pretend_min_part_hours08:21
*** Shashikant86 has quit IRC08:32
*** jistr has joined #openstack-swift08:32
*** natarej has quit IRC08:33
*** natarej has joined #openstack-swift08:33
*** jamielennox is now known as jamielennox|away08:40
*** cbartz has joined #openstack-swift09:02
*** kei_yama_ has joined #openstack-swift09:09
*** kei_yama has quit IRC09:09
*** acoles_ is now known as acoles09:12
*** Jeffrey4l_ has quit IRC09:16
*** takashi has joined #openstack-swift09:17
*** Jeffrey4l_ has joined #openstack-swift09:23
*** mvk has joined #openstack-swift09:23
*** psachin has joined #openstack-swift09:29
*** daemontool has joined #openstack-swift09:45
*** admin6 has joined #openstack-swift09:46
*** asettle has joined #openstack-swift09:54
*** ppai has quit IRC10:06
*** silor has quit IRC10:07
openstackgerritAlistair Coles proposed openstack/swift: Rename hash_cleanup_listdir tests  https://review.openstack.org/29039110:10
*** daemontool_ has joined #openstack-swift10:11
*** daemontool has quit IRC10:14
*** ppai has joined #openstack-swift10:15
*** hosanai has quit IRC10:17
*** asettle_ has joined #openstack-swift10:22
*** asettle has quit IRC10:24
*** daemontool__ has joined #openstack-swift10:31
*** asettle_ has quit IRC10:31
openstackgerritjanonymous proposed openstack/swift: Unable to read test.conf while executing unit tests  https://review.openstack.org/31404110:31
*** daemontool_ has quit IRC10:34
*** daemontool has joined #openstack-swift10:36
*** takashi has quit IRC10:37
*** daemontool__ has quit IRC10:37
acolestimburke: clayg: thanks for reviews, patch 290391 will need a fresh +A (merge conflicts - see my comment on patch)10:39
patchbotacoles: https://review.openstack.org/#/c/290391/ - swift - Rename hash_cleanup_listdir tests10:39
*** asettle has joined #openstack-swift10:40
*** daemontool_ has joined #openstack-swift10:40
*** daemontool__ has joined #openstack-swift10:43
*** daemontool has quit IRC10:44
*** mariusv has joined #openstack-swift10:45
*** daemontool_ has quit IRC10:46
*** dmellado|off is now known as dmellado10:47
*** daemontool_ has joined #openstack-swift10:51
*** daemontool__ has quit IRC10:55
*** asettle has quit IRC10:58
*** daemontool__ has joined #openstack-swift10:59
*** daemontool_ has quit IRC11:03
*** daemontool has joined #openstack-swift11:04
*** ppai has quit IRC11:04
*** daemontool_ has joined #openstack-swift11:06
*** daemontool__ has quit IRC11:07
*** daemontool__ has joined #openstack-swift11:08
*** daemontool has quit IRC11:10
*** daemontool has joined #openstack-swift11:11
*** daemontool_ has quit IRC11:12
*** daemontool_ has joined #openstack-swift11:14
*** daemontool__ has quit IRC11:15
*** daemontool has quit IRC11:18
*** ppai has joined #openstack-swift11:18
*** kei_yama_ has quit IRC11:45
*** kei_yama has joined #openstack-swift11:46
openstackgerritjanonymous proposed openstack/swift: Using ostestr to run unittests  https://review.openstack.org/25705311:49
*** silor has joined #openstack-swift12:02
*** silor has quit IRC12:04
*** silor has joined #openstack-swift12:05
openstackgerritjanonymous proposed openstack/swift: Using ostestr to run unittests  https://review.openstack.org/25705312:07
*** pauloewerton has joined #openstack-swift12:08
*** early` has quit IRC12:14
*** ppai has quit IRC12:34
*** daemontool__ has joined #openstack-swift12:41
*** early has joined #openstack-swift12:43
*** daemontool_ has quit IRC12:45
psachinHi, can we re-configure replication time?12:45
*** bsdkurt has quit IRC12:46
*** bsdkurt has joined #openstack-swift12:49
*** zul has quit IRC12:50
*** chuck__ has joined #openstack-swift12:51
*** chuck__ has quit IRC12:51
*** chuck__ has joined #openstack-swift12:52
*** km has quit IRC12:54
acolespsachin: replicator config options are shown in [object-replicator] section here https://github.com/openstack/swift/blob/master/etc/object-server.conf-sample12:55
*** kei_yama has quit IRC13:02
*** links has quit IRC13:02
*** SkyRocknRoll has quit IRC13:05
* jrichli will be out for the next 5 hours.13:07
psachinthanx acoles13:14
openstackgerritBrian Ober proposed openstack/swift: Container Object Count Quota Functional Test  https://review.openstack.org/31409913:29
*** david-lyle_ has joined #openstack-swift13:48
*** david-lyle has quit IRC13:50
*** cdelatte has joined #openstack-swift13:53
*** ametts has joined #openstack-swift13:53
*** klamath has joined #openstack-swift13:57
*** klamath has quit IRC13:58
*** klamath has joined #openstack-swift13:59
*** zaitcev has joined #openstack-swift13:59
*** ChanServ sets mode: +v zaitcev13:59
*** catintheroof has joined #openstack-swift14:03
*** d0ugal has quit IRC14:07
*** links has joined #openstack-swift14:08
*** links has quit IRC14:11
*** vinsh has joined #openstack-swift14:13
*** mingdang1 has quit IRC14:21
*** pgbridge has joined #openstack-swift14:38
*** _JZ_ has joined #openstack-swift14:45
*** natarej has quit IRC14:46
*** psachin has quit IRC14:46
*** natarej has joined #openstack-swift14:47
*** d0ugal has joined #openstack-swift14:55
*** esker has joined #openstack-swift15:03
*** d0ugal has quit IRC15:08
*** klrmn has joined #openstack-swift15:11
*** klamath has quit IRC15:15
openstackgerritBrian Ober proposed openstack/swift: Storage Account Object Count Quota Support  https://review.openstack.org/31260315:17
*** dmorita has joined #openstack-swift15:18
*** arch-nemesis has joined #openstack-swift15:20
*** klamath has joined #openstack-swift15:20
*** d0ugal has joined #openstack-swift15:26
*** jistr has quit IRC15:33
*** Jeffrey4l_ has quit IRC15:34
*** daemontool__ has quit IRC15:41
*** d0ugal has quit IRC15:51
*** morgan has joined #openstack-swift15:52
morgannotmyname timburke: https://review.openstack.org/#/c/310892/ as discussed at the summit. just following up on it15:52
patchbotmorgan: patch 310892 - swift3 - Add s3_token middleware to the swift3 project15:52
*** jistr has joined #openstack-swift15:54
admin6Hi there, Is that a normal behavior to have a lot of STDERR: UnicodeDecodeError in the object-replicator logs after rebalancing my replica3 object ring and it last until it is completely rebalanced (more logs in http://pastebin.com/nUprVRrk)15:58
*** tesseract has quit IRC16:01
*** rledisez has quit IRC16:05
*** rcernin has quit IRC16:06
*** d0ugal has joined #openstack-swift16:06
notmynamegood morning, world16:06
notmynamemorgan: thanks. probably best to put that into the #swift3 channel (there's a channel for everything!)16:07
*** ejat is now known as fenris-16:07
*** fenris- is now known as ejat16:07
*** ejat is now known as fenris-16:08
*** fenris- is now known as ejat16:08
*** NM has joined #openstack-swift16:19
*** klrmn has quit IRC16:20
*** gyee has joined #openstack-swift16:22
openstackgerritMohit Motiani proposed openstack/swift: ng chkconfig to sysv-rc-conf in SAIO installation doc: Below step in SAIO installation always throws an error: sudo chkconfig memcached on  https://review.openstack.org/31420016:24
*** esker has quit IRC16:29
clayglol @ "sometimes knowing more abount the ring could be worse"16:29
mmotiani_notmyname, I was looking at this patch https://review.openstack.org/#/c/309219/16:30
patchbotmmotiani_: patch 309219 - swift - created other-requirements.txt16:30
notmynameok16:30
mmotiani_and I was wondering if sysv-rc-conf (an alternative of chckconfig) is also a non-python requirement.16:30
notmynameI honestly don't know16:32
ahalemmotiani_: isnt that a rhel command you are trying to run on ubuntu?16:32
ahalelike immediately before the chkconfig command it says "On non-Ubuntu distros you need to ensure memcached is running"16:32
*** lyrrad has joined #openstack-swift16:33
*** cbartz has quit IRC16:34
claygisn't xenial going systemd too?16:34
*** SkyRocknRoll has joined #openstack-swift16:35
*** dmorita has quit IRC16:36
*** rcernin has joined #openstack-swift16:37
mmotiani_ahale, I thought that patch is for all Linux machines :)16:38
*** diogogmt has joined #openstack-swift16:38
mmotiani_chkconfig was also an ubuntu command till ubuntu 12.01. Now, its replacement is sysv-rc-conf :)16:39
ahaleoh live and learn :) never bothered using it on debuntu, just update-rc16:40
notmynameyeah, we can put non-ubuntu stuff in other-requirements.txt. it's got some DSL for describing that16:41
brianclineit's too early on a monday for systemd16:42
ahaleyeah - im about to leave work for the day and its still too early for that16:42
brianclinelol16:43
notmynameso yeah, if there's something missing from other-requirements, then it should be added16:45
notmynamebut there's gotta be a limit somewhere16:45
*** david-lyle_ is now known as david-lyle16:45
notmynameit's not like we're saying "must have libc and a linux kernel"16:45
notmynameso if it's stuff that's in a base install, I don't think we need to add it. but I also don't really know the definition of "base"16:46
*** jordanP has quit IRC16:51
*** nadeem has joined #openstack-swift16:54
openstackgerritAlistair Coles proposed openstack/swift: crypto - cleanup decrypter exception handling  https://review.openstack.org/30480617:02
*** jistr has quit IRC17:02
*** daemontool__ has joined #openstack-swift17:09
notmynametdasilva: are you working on a follow-up for https://review.openstack.org/#/c/156923/ today? or is timburke wrong and you're looking for another reviewer? ;-)17:10
patchbotnotmyname: patch 156923 - swift - Refactor server side copy as middleware17:10
*** pgbridge has quit IRC17:10
tdasilvaworking for a follow-up for today17:13
notmynamethanks17:14
tdasilvanp, just trying to figure out the logging issue17:14
notmynamesgundur-: what's the WIP flag on patch 313150 for?17:17
patchbotnotmyname: https://review.openstack.org/#/c/313150/ - swift - To fix probe tests failing from commit cf48e7517:17
*** klrmn has joined #openstack-swift17:17
sgundur-notmyname:  there are still some references to ports in 6000 range , so was wondering should I add all these changes in this patch or not17:19
notmynameat this very moment, I don't really care. what I care very much about is that probetests work. either or both or whatever of patch 313150 and patch 311899 need to land, preferably today17:21
patchbotnotmyname: https://review.openstack.org/#/c/313150/ - swift - To fix probe tests failing from commit cf48e7517:21
patchbotnotmyname: https://review.openstack.org/#/c/311899/ - swift - Fix probe tests from commit cf48e7517:21
notmynamehttps://wiki.openstack.org/wiki/Swift/PriorityReviews is updated17:21
notmynameacoles: jrichli: ^ I wasn't sure of the current top crypto patch, so I left it as-is (although i removed the reference to the already landed one)17:22
sgundur-notmyname: ok, with either of the above patches the probetests failing because of port change is fixed - but getting this error http://paste.openstack.org/show/496139/17:24
*** klrmn has quit IRC17:24
acolesnotmyname: ok thanks. looking...17:25
sgundur-notmyname: in the test_container_sync:TestContainerSync._test_sync ; put_object returns with 201 but after the container-sync the get_object fails with 404 not found17:25
sgundur-notmyname: I ll try to debug this error today17:25
notmynamesgundur-: ok. please let me know if you need help17:25
sgundur-notmyname: yep, I ll. thanks :)17:26
*** klrmn has joined #openstack-swift17:26
acolesnotmyname: I added one more. the next I'd like to land is patch 304806 which is large (lots of cleanup) but timburke has been reviewing so I'm hoping we can get that donean d if there are spare eyes focus them on those listed on priority reviews17:29
patchbotacoles: https://review.openstack.org/#/c/304806/ - swift (feature/crypto) - crypto - cleanup decrypter exception handling17:29
*** dmorita has joined #openstack-swift17:34
acolestimburke: re your comment here https://review.openstack.org/#/c/312662/2/swift/common/middleware/encrypter.py@203 - slo appends size to content-type but i can't see etag there? am I missing it?17:34
patchbotacoles: patch 312662 - swift (feature/crypto) - crypto - cleanup encrypter error handling17:34
*** pgbridge has joined #openstack-swift17:36
*** mmcardle has quit IRC17:39
*** lakshmiS has joined #openstack-swift17:42
notmynameacoles: in here you said patch 304806 but you added patch 313640 to the wiki17:42
patchbotnotmyname: https://review.openstack.org/#/c/304806/ - swift (feature/crypto) - crypto - cleanup decrypter exception handling17:42
patchbotnotmyname: https://review.openstack.org/#/c/313640/ - swift (feature/crypto) - crypto - wrap random body key17:42
acolesnotmyname: yes. my thinking was that since timburke (and jrichli) is already on 304806 then it may not need to be on the priority list17:44
notmynameok :-)17:44
openstackgerritNandini Tata proposed openstack/swift: add Tempest Plugin for functional tests  https://review.openstack.org/31367617:47
*** garthb has joined #openstack-swift17:51
openstackgerritAlistair Coles proposed openstack/swift: crypto - cleanup encrypter error handling  https://review.openstack.org/31266217:53
*** acoles is now known as acoles_17:57
*** ChubYann has joined #openstack-swift17:59
*** mvk has quit IRC18:12
*** CaioBrentano has joined #openstack-swift18:15
*** openstackgerrit has quit IRC18:33
*** openstackgerrit has joined #openstack-swift18:33
openstackgerritThiago da Silva proposed openstack/swift: Refactor server side copy as middleware  https://review.openstack.org/15692318:35
pdardeaunotmyname: i vaguely remember seeing some kind of autodoc comment in the new contributor doc reviews. now i don't see it. was i dreaming?18:35
*** jmccarthy1 has joined #openstack-swift18:37
*** ozialien10 has quit IRC18:43
*** ozialien10 has joined #openstack-swift18:44
*** ozialien10 has quit IRC18:44
*** tqtran has joined #openstack-swift18:45
*** ozialien10 has joined #openstack-swift18:45
*** portante has quit IRC18:46
*** dmellado has quit IRC18:47
*** ndk_ has quit IRC18:47
*** natarej has quit IRC18:55
*** natarej has joined #openstack-swift18:56
*** silor has quit IRC19:00
*** garthb has quit IRC19:07
*** SkyRocknRoll has quit IRC19:32
*** jmccarthy1 has quit IRC19:34
notmynamepdardeau: that was probably on the "movie script" page that i took out. vSAIO has autodoc set up19:50
*** kaleta has quit IRC19:51
*** onovy has quit IRC19:51
*** peterlisak has quit IRC19:51
*** onovy has joined #openstack-swift19:53
*** onovy has quit IRC19:53
*** onovy has joined #openstack-swift19:53
*** peterlisak has joined #openstack-swift19:56
*** kaleta has joined #openstack-swift19:56
sgundur-notmyname: I checkedout from one commit previous to port changes i.e. https://github.com/openstack/swift/commit/ae2b86129e1606b8dbdae45a0074e5b9add13c1a20:11
sgundur-notmyname: the probetests still fail with - http://paste.openstack.org/show/496139/20:11
sgundur-notmyname: I was wondering if the probetests for - container-sync supposed to work in SAIO setup ?20:11
notmynamesgundur-: supposed to work? yes. do they work? seems like maybe not?20:14
sgundur-notmyname: in /srv/1/node/sdb1 ; sync_containers is created and also the .db file is symlinked to /srv/..containers... .db20:15
sgundur-notmyname: I can trace till the object being put in the source containers, returns with 20120:15
*** rcernin has quit IRC20:15
sgundur-notmyname: after the Manager(['container-sync']).once() ; get object from dest_container is failing with 40420:16
sgundur-notmyname: I was trying to find if the error was in src/dest containers being created or being pointed to wrong container/object20:18
sgundur-notmyname: pls give me some pointers to debug or what to look for20:20
*** klamath has quit IRC20:22
jrichlisgundur- notmyname : I will give oshritf and eranrom a heads up - they might be able to help if we havent solved it by the time their next work day starts20:22
jrichliI can take a look now as well - but i am pretty new to the area20:22
jrichlinotmyname: i probably missed when people discussed this before.  but why were the probetest gates not in place?20:24
sgundur-jrichli: thanks :) , let me know what to look for20:25
notmynamejrichli: probetest gates have never been "gates" (ie voting) because they are set up to run against the SAIO. and nobody has figured out how to do that with the gate images. there are probetests running in the community qa cluster though, but they aren't voting20:31
jrichlinotmyname: ah, ok thanks20:32
*** jeblair has quit IRC20:33
*** jeblair has joined #openstack-swift20:33
*** suyash has joined #openstack-swift20:34
openstackgerritPaul Dardeau proposed openstack/swift: resurrect gholt blog posts on building consistent hashing ring  https://review.openstack.org/31427020:36
notmynamepdardeau: thanks!20:40
pdardeaunotmyname: np, happy to do that20:43
notmynameI feel like I've unlocked an openstack merit badge or something. my email started quite a nice little bikeshed and will maybe grow into it's own flamewar?20:45
notmynamepersonal preference opinion poll time20:54
notmynamedo you prefer "range(10)[:-6:-1]" or "list(reversed(range(10)[-5:]))"20:55
pdardeaunotmyname: dang, i thought the poll was going to be on what should be the first pluggable backend :-)20:55
*** mvk has joined #openstack-swift20:57
notmynamelist(reversed())21:08
notmyname[1.3574769496917725, 1.336827039718628, 1.3806898593902588]21:08
notmynameslicing21:08
notmyname[0.2137138843536377, 0.21651601791381836, 0.2115950584411621]21:08
notmynameso there's the answer21:08
*** mingdang1 has joined #openstack-swift21:14
*** sheel has quit IRC21:15
*** pauloewerton has quit IRC21:17
*** esker has joined #openstack-swift21:19
*** lakshmiS has quit IRC21:22
*** d0ugal has quit IRC21:26
*** esker has joined #openstack-swift21:27
*** gyee has quit IRC21:33
*** resker has joined #openstack-swift21:38
*** esker has quit IRC21:40
ahaleyeah that thread is awful. if you dd want to grow a flamewar then "perhaps Swift will start to look more like the rest of the projects in OpenStack " looks a tempting place to start21:40
notmynameoh, I'm on fire today. I just pasted a 15 paragraph review comment against a cross-project spec :-)21:41
notmynamepatch 31271821:41
patchbotnotmyname: https://review.openstack.org/#/c/312718/ - governance - add resolution explaining which tests we think def...21:41
*** esker has joined #openstack-swift21:41
brianclineoh, *that* spec21:42
*** CaioBrentano has quit IRC21:43
*** resker has quit IRC21:43
zaitcevI hope "defcore" does not mean "defective core".21:44
notmynamethat's way too easy of a setup. I'd feel bad just for making the joke ;-)21:44
notmynameI like how I get to spend time on that instead of, you know, writing or reviewing code21:45
zaitcevAnd now I'm pondering if I should write my own Swift client in Python.21:46
bkeller`can we rewrite it in Piet?21:46
notmynamebkeller`: only after you fully define the testing, documentation, deployment, and cross-project library processes for all projects written in Piet21:47
brianclineTIL a new esoteric language21:48
notmynamebkeller`: lol, I was actually thinking of a reply referencing "mondrian". I had mis-remembered the name :-)21:49
*** _JZ_ has quit IRC21:50
brianclinewhat are the chances of patch 309524 being merged in the next few days?21:54
patchbotbriancline: https://review.openstack.org/#/c/309524/ - swift - SwiftLogFormatter will log transaction IDs on INFO...21:54
notmynamebriancline: IIRC torgomatic asked me about that last week. where are you seeing this cause problems for you? INFO level is the access logs, so that's already done21:57
notmynameI mean, it sure looks like we did that on purpose (test for it and everything)21:58
notmynamebut torgomatic said this patch doesn't result in double-logging the txn_id, so I don't really know why it is the way it is21:58
brianclinenotmyname: on anything that middlewares log. the keystone middleware is the most painful of the lot. it logs plenty of useful info, but with lots of keystone requests, there's no helpful way of tying back its messages to the originating request21:59
notmynamethat's true21:59
brianclinecustom middlewares is another. we have one or two middlewares that i think have done it in hackier ways, but it's not always effective, somehow22:00
*** catintheroof has quit IRC22:01
torgomaticyeah, it's a weird decision to skip txid for just INFO. I suspect it started out sane, then got twisted up in a couple different patch sets and now it's all wonky22:02
torgomaticbut since it checks that txid isn't in the log message before adding it, removing the INFO check seems harmless at worst22:03
*** NM has quit IRC22:09
notmynamehttp://d.not.mn/python_vs_golang_gets.png22:13
notmynamehttp://d.not.mn/python_vs_golang_puts.png22:13
notmynamepython vs golang on the object server, from numbers provided by dfg_ ^22:13
notmynamealso, what's not shown there is the dramatically smaller cpu time for the golang ones22:14
mattoliveraumorning22:17
brianclineI traced back a bit since I got curious. the INFO level check seems to have been originally introduced here: https://github.com/openstack/swift/commit/442e3c8a1a92eb3da140fc39f78b4ff86c50d11a#diff-67e43d32a534c1f6d2e1ca157dc8a1a0R34522:19
*** greghaynes has joined #openstack-swift22:22
torgomaticbriancline: good call... and you can see there that it doesn't have the check for duplicate txids, so this made some sense as a way to not crud up the access logs22:23
brianclineyeah. probably a bit closer to constant time compared to how its done today as well, but i doubt anyone would ever notice the difference22:29
brianclinenotmyname: those are really nice numbers.. are there similar ones for avg time to first byte or avg request duration?22:30
*** nadeem has quit IRC22:31
notmynamebriancline: no, but slowet 1% on golang was about 30% of the python number (for 1byte) and 62% for 1M object (for PUTs)22:32
*** jamielennox|away is now known as jamielennox22:35
notmyname(lower is better)22:35
notmynameIOW, the long tail also sees improvements22:35
*** klamath has joined #openstack-swift22:45
*** cdelatte has quit IRC22:47
*** cdelatte has joined #openstack-swift22:48
*** cdelatte has quit IRC22:51
*** cdelatte has joined #openstack-swift22:51
*** ametts has quit IRC22:58
jrichliI am about to be offline for a few hours, but I am gonna put a question out there:23:03
jrichliis it only sgundur- and I that see the container-sync probetest failures?  how about somebody not using Ubuntu 14 ?  I am testing out older versions and I keep getting these failures on my VM23:04
notmynamejrichli: after which patch?23:05
jrichliI keep going backwards trying to find one that affected container-sync where I DONT get the failures.  but i have gone back all the way to patch 270961 and my VM shows the same failures there too23:06
patchbotjrichli: https://review.openstack.org/#/c/270961/ - swift - Container-Sync to perform HEAD before PUT object o... (MERGED)23:06
jrichlibut the vm-saio-probe passed when that was merged23:06
*** diogogmt has quit IRC23:06
jrichliso I think my setup is wrong somehow23:07
jrichliI guess I would like to know if somebody has all container-sync tests passing for probetests against master right now23:07
notmynametesting with patch 311899 right now23:08
patchbotnotmyname: https://review.openstack.org/#/c/311899/ - swift - Fix probe tests from commit cf48e7523:08
jrichlithanks!  ok, gotta run.  bb in a few hours23:08
*** mingdang1 has quit IRC23:09
notmynamehmm...no new wiki accounts for anyone. I just learned that http://lists.openstack.org/pipermail/openstack-dev/2016-May/094408.html23:11
notmynamethat will make our no-specs thing harder if you can't actually go update the ideas page23:12
*** cdelatte has quit IRC23:17
mattoliverauhmmm, bugger23:20
sgundur-mattoliverau: hi23:22
*** kei_yama has joined #openstack-swift23:28
*** chlong has joined #openstack-swift23:33
*** km has joined #openstack-swift23:34
notmynamejrichli: I can say that I do not see those errors in my probetests23:35
notmynamehttps://gist.github.com/notmyname/c7514864290cd29524b4e6058dc7551623:39
sgundur-notmyname: curious to know if u get the above results with current code and torgomatic's patch or older version ?23:46
notmynameyeah, that was with master + patch 31189923:46
patchbotnotmyname: https://review.openstack.org/#/c/311899/ - swift - Fix probe tests from commit cf48e7523:46
sgundur-notmyname: last time I had checked I had got different results, let me recreate again23:48
notmynameFWIW, I don't think any of the errors I'm seeing have to do with your port numbers patch23:48
*** hosanai has joined #openstack-swift23:52
*** ChanServ sets mode: +v hosanai23:52
kota_morning23:53
torgomaticnotmyname: I was also seeing some probetest failures that appeared to be related to busted info-cache stuff around container-sync (I think)23:54
mattoliveraukota_: morning23:54
kota_mattoliverau: o/23:55
*** morgan has left #openstack-swift23:56

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!