Friday, 2018-04-27

openstackgerritMerged openstack/swift feature/deep: Clean up logs a bit  https://review.openstack.org/56461300:06
openstackgerritMerged openstack/swift feature/deep: Catch more exceptions when recording progress  https://review.openstack.org/56460500:06
*** brimestone has quit IRC00:08
*** vint_bra has joined #openstack-swift00:47
*** psachin has joined #openstack-swift01:01
*** vint_bra has quit IRC01:27
*** vint_bra has joined #openstack-swift01:35
*** vint_bra has quit IRC02:08
openstackgerritMerged openstack/swift feature/deep: Commit from pending file less often  https://review.openstack.org/56463002:08
openstackgerritMerged openstack/swift feature/deep: Reclaim deleted shard range rows after 2 * reclaim_age  https://review.openstack.org/56454002:24
*** wangyx has joined #openstack-swift02:35
kota_good morning02:50
*** gkadam has joined #openstack-swift02:51
*** gkadam has quit IRC02:58
*** gkadam has joined #openstack-swift03:01
*** kei_yama has quit IRC03:36
*** kei_yama has joined #openstack-swift03:37
*** wangyx has quit IRC03:38
*** brimestone has joined #openstack-swift04:01
*** brimestone has quit IRC04:02
*** links has joined #openstack-swift05:04
*** armaan has joined #openstack-swift05:04
*** links has quit IRC05:08
*** wangyx has joined #openstack-swift05:09
*** links has joined #openstack-swift05:13
*** links has quit IRC05:13
*** onovy has quit IRC05:32
*** armaan has quit IRC05:42
*** germs has quit IRC05:46
*** germs has joined #openstack-swift05:47
*** germs has quit IRC05:47
*** germs has joined #openstack-swift05:47
*** armaan has joined #openstack-swift05:58
*** armaan has quit IRC05:58
*** armaan has joined #openstack-swift05:59
*** armaan has quit IRC06:04
*** armaan has joined #openstack-swift06:04
*** onovy has joined #openstack-swift06:14
*** armaan has quit IRC06:21
*** armaan has joined #openstack-swift06:21
*** cbartz has joined #openstack-swift06:25
*** pcaruana has joined #openstack-swift06:33
*** geaaru has joined #openstack-swift06:35
*** pcaruana has quit IRC06:50
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Import swift3 into swift repo as s3api middleware  https://review.openstack.org/56294306:54
*** pcaruana has joined #openstack-swift07:06
*** ccamacho has quit IRC07:17
*** rcernin has quit IRC07:17
*** ccamacho has joined #openstack-swift07:18
*** tesseract has joined #openstack-swift07:27
*** armaan has quit IRC07:35
*** armaan has joined #openstack-swift07:35
*** gkadam has quit IRC07:43
*** armaan has quit IRC07:52
*** armaan has joined #openstack-swift07:53
*** tesseract has quit IRC07:53
openstackgerritHajime Kondo proposed openstack/slogging master: Add X-Timestamp header to upload file to swift  https://review.openstack.org/56469407:56
*** tesseract has joined #openstack-swift07:56
*** gkadam has joined #openstack-swift08:07
acolesgood morning08:12
acolestimburke: I was thinking same overnight about not repeating merges when re-cleaving, going to work on a patch today08:24
openstackgerritKota Tsuyuzaki proposed openstack/swift master: WIP: Add ceph-s3 test non-voting job  https://review.openstack.org/56470008:29
*** pcaruana has quit IRC08:56
openstackgerritHajime Kondo proposed openstack/slogging master: First commit of devstack directory  https://review.openstack.org/56470809:05
*** pcaruana has joined #openstack-swift09:07
*** viks has quit IRC09:11
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Improve test coverage for metadata reclaim  https://review.openstack.org/56471009:20
*** kei_yama has quit IRC09:28
openstackgerritMerged openstack/slogging master: Add X-Timestamp header to upload file to swift  https://review.openstack.org/56469409:33
openstackgerritMerged openstack/swift feature/deep: Parameterize SQL args  https://review.openstack.org/56465109:50
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Always update shard brokers with their own range and sharding metadata  https://review.openstack.org/56471610:01
openstackgerritMerged openstack/swift feature/deep: Stop internal client txn_id bleeding into sharder logs  https://review.openstack.org/56448810:03
*** l4yerffej has quit IRC10:15
*** l4yerffej has joined #openstack-swift10:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Always update shard brokers with their own range and sharding metadata  https://review.openstack.org/56471610:25
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Store root/parent container in shard ranges table  https://review.openstack.org/56260310:25
*** itlinux has joined #openstack-swift11:45
*** wangyx has quit IRC11:59
*** wangyx has joined #openstack-swift12:00
*** wangyx has quit IRC12:04
*** NM has joined #openstack-swift12:15
*** wangyx has joined #openstack-swift12:15
*** wangyx has quit IRC12:19
*** psachin has quit IRC12:41
*** wangyx has joined #openstack-swift13:02
*** wangyx has quit IRC13:06
*** geaaru has quit IRC13:29
*** vint_bra has joined #openstack-swift13:50
*** silor has joined #openstack-swift14:01
*** itlinux has quit IRC14:19
*** ukaynar has joined #openstack-swift14:27
*** vint_bra has quit IRC14:38
*** itlinux has joined #openstack-swift14:43
*** itlinux has quit IRC14:53
*** itlinux has joined #openstack-swift14:56
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Don't repeat merges when re-cleaving to existing shard db  https://review.openstack.org/56479214:56
acolestimburke: clayg mattoliverau ^^14:56
*** cbartz has quit IRC14:57
notmynamegood morning15:09
*** pcaruana has quit IRC15:11
tdasilvanotmyname: o/15:11
notmynametdasilva: how does tuesday work for you to host a video chat about feature/deep-review?15:13
notmynamecschwede: today were you able to do the other testing/review you wanted to do on s3api?15:13
cschwedenotmyname: still doing it, but will finish within next ~hour :) so far i'm mostly fine with the patch, no blockers15:14
notmynamecschwede: thanks :-)15:14
tdasilvai was just spinning up my s3api vm too, running tests atm...15:14
cschwedeno problem, you're welcome :)15:14
tdasilvanotmyname: what time did you have in mind for the video chat?15:15
tdasilvai was wondering if it would make sense to do it at the same time as the community meeting as that would increase the likelihood that others could join, but i'm not sure it is necessary and it would be really late for acoles15:16
tdasilvawho i imagine would be driving most of the meeting15:16
*** NM has quit IRC15:16
notmynameI was thinking 9am pacific, noon eastern, 1600utc15:17
*** silor has quit IRC15:18
notmynamethat's not a bad thought (doing it during the meeting)15:18
notmynamebut yeah, it would be really late for acoles15:18
notmynameand I'm afraid people aren't going to start reviewing it until after the meeting. so I don't want to let half the week go by before then15:18
*** NM has joined #openstack-swift15:19
tdasilvanotmyname: yeah, I was thinking same time but Tuesday...15:23
notmynameah, I see15:23
tdasilvaeitherway Tuesday at noon  works for me too, so whatever you prefer...15:24
*** NM has quit IRC15:27
notmynamehttps://doodle.com/poll/w5uar77ehiig3mcn15:28
notmynamehttps://doodle.com/poll/w5uar77ehiig3mcn#calendar is easier to read15:28
notmynamebah. hang on15:29
notmynameI missed a time slot15:29
tdasilvanotmyname: just fyi...11am EST would *not* work for me :/15:30
notmynameoh, nice. I could update it15:30
notmynamefill out the poll :-)15:30
notmynameacoles: clayg: torgomatic: cschwede: zaitcev_: kota_: mattoliverau: timburke: please fill out https://doodle.com/poll/w5uar77ehiig3mcn#calendar to help plan when we should have a feature/deep-review overview video chat15:33
notmynamewe'll choose the best possible time, but tdasilva will record it so anyone who can't make it will be able to watch15:33
zaitcev_notmyname, oh boy15:33
tdasilvarledisez: ^15:34
zaitcev_I have teeth cleaning on Monday...15:35
notmynameyes! rledisez too. thanks tdasilva15:35
rledisezi'm on vacation for two weeks starting in 25 minutes, i'll be travelling, so i'll miss it15:36
*** gyee has joined #openstack-swift15:36
notmynamerledisez: ok (I hope you have a relaxing vacation)15:37
tdasilvarledisez: enjoy!15:42
*** wangyx has joined #openstack-swift15:46
acolesnotmyname: I just ticked all the boxes on the doodle form. I ticked the late ones not because I prefer late but because I'd prefer kota_ and mattoliverau to be able to make it, so I they cannot make it I'd prefer to avoid the last slot each day at least (2100 UTC). An alternative would be for me to meet up with them separately.16:05
notmynameok16:05
*** itlinux has quit IRC16:15
openstackgerritMerged openstack/swift feature/deep: Always update shard brokers with their own range and sharding metadata  https://review.openstack.org/56471616:17
*** silor has joined #openstack-swift16:23
*** wangyx has quit IRC16:27
*** geaaru has joined #openstack-swift16:31
*** ccamacho has quit IRC16:35
notmynametdasilva: have you ever run `bindep` from ansible? it exits with an rc of 1 if there's stuff to install, but ansible treats that as a failed task16:51
notmynameand whenI set ignore_errors: true, then it's ignoring the results and not putting the output into the registered variable16:52
tdasilvanotmyname: one sec, pretty sure i did16:52
tdasilvanotmyname: actually....i did not, in my ansible scripts i just 'manually' install whatever is listed in the bindep.txt files, but infra team appears to have a bindep role somewhere: https://github.com/openstack/pyeclib/blob/master/playbooks/legacy/libec-pyeclib-unit-centos-7/run.yaml#L416:57
notmynameok, thanks for checking16:59
tdasilvanotmyname: if i'm reading this right, you don't have to run bindep from command line, but ansible itself has support for bindep: https://github.com/openstack/ansible-role-bindep17:02
timburkemost recent commit is "Update bindep.txt to make jobs pass again" -- is it an ouroboros? :P17:03
notmynameI found "failed_when: ( bindep_output.rc not in [ 0, 1 ] )"17:04
notmynameso that sortof helps17:04
notmynamebut it didn't fix the problem I was having (but it's probably needed anyway)17:05
notmynameoh. nice. https://ansible-role-bindep.readthedocs.io17:05
*** NM has joined #openstack-swift17:06
notmynamethis is what I am getting https://gist.github.com/notmyname/b5f9826c91dde0e199006b62c720b3a317:06
notmynameI thought the undefined attribute was the bindep_output because it was "failing" with an rc == 1 and I had ignore_errors: true.17:06
notmynamehowever, now I've got the allowed response codes of 0,1 and so it's not being ignored, but I don't know what the undefined attribute is17:07
*** gkadam has quit IRC17:08
*** tesseract has quit IRC17:09
*** itlinux has joined #openstack-swift17:10
tdasilvanotmyname: so you are just reading bindep.txt and then installing with apt ?17:11
notmyname"just reading" is really "running bindep with the appropriate platform and tags" but yes17:12
notmynameI've got another ansible task that does the same thing for rpm17:12
notmynameput another way, I'm trying to ansible-ify this: `bindep platform:centos -b | xargs yum -y install`17:13
notmynameor `bindep platform:dpkg -b | xargs apt-get install -y`17:13
notmynamethis is what I've got so far: https://gist.github.com/notmyname/59afa6c1dbcc988070e7e64715a3573917:15
notmynamebut I don't know what the undefined attribute in "install requirements from bindep (debian)" is17:16
openstackgerritSamuel Merritt proposed openstack/swift master: Refactor replicators' statistics  https://review.openstack.org/56464617:19
*** germs has quit IRC17:22
*** germs has joined #openstack-swift17:23
*** germs has quit IRC17:23
*** germs has joined #openstack-swift17:23
*** ukaynar has quit IRC17:29
notmynameoh wow17:38
notmynameI figured it out17:38
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Don't repeat merges when re-cleaving to existing shard db  https://review.openstack.org/56479217:38
acolestimburke: good spot on ^^ fixed17:39
*** ukaynar has joined #openstack-swift17:40
notmynameansible fills in the "register" value every time, even if the task is skipped. so if you have 2 tasks, one for each OS, and they both register the same value because you're using it later, that won't work17:40
notmynamethe second task that registers the value overwrites the first (even though the second task is skipped). which means you need to register unique variable names for each os (or whatever conditional you're doing)17:41
acolestimburke: clayg mattoliverau assuming s3api merges I'll be starting to get feature/deep ready for review on Monday so we need decisions on remaining patches https://tinyurl.com/yc2cbwsm17:43
claygacoles: thanks!17:44
acolesIMHO these should land in some shape or form: p 563076, p 56393917:44
patchbothttps://review.openstack.org/#/c/563076/ - swift (feature/deep) - Fix unicode errors with non-ascii object names17:44
patchbothttps://review.openstack.org/#/c/563939/ - swift (feature/deep) - Move objects in all storage policies to shards17:44
acolesthese we could continue to debate during review: p 564181 p 56418417:45
patchbothttps://review.openstack.org/#/c/564181/ - swift (feature/deep) - Remove sharding_lock()17:45
patchbothttps://review.openstack.org/#/c/564184/ - swift (feature/deep) - Remove TODO re taking lock before deleting retirin...17:45
acolesthis is my wildcard : p 56260317:46
patchbothttps://review.openstack.org/#/c/562603/ - swift (feature/deep) - Store root/parent container in shard ranges table17:46
*** armaan has quit IRC17:46
acolesand timburke has a few pending too17:46
acoleshave a good weekend everyone!17:47
notmynameyou too acoles17:48
*** armaan has joined #openstack-swift17:55
*** NM has quit IRC18:04
*** NM has joined #openstack-swift18:07
*** NM has quit IRC18:14
*** NM has joined #openstack-swift18:15
*** silor has quit IRC18:23
*** wangyx has joined #openstack-swift18:28
*** wangyx has quit IRC18:32
*** itlinux has quit IRC18:32
*** armaan has quit IRC18:35
openstackgerritMerged openstack/swift feature/deep: Improve test coverage for metadata reclaim  https://review.openstack.org/56471018:49
*** ukaynar has quit IRC18:54
*** spsurya has quit IRC19:01
*** NM has quit IRC19:17
*** NM has joined #openstack-swift19:27
*** ukaynar has joined #openstack-swift19:45
*** NM has quit IRC19:59
*** NM has joined #openstack-swift20:01
openstackgerritSamuel Merritt proposed openstack/swift master: Emit periodic stats from account and container replicators  https://review.openstack.org/56487520:17
*** zaitcev_ is now known as zaitcev20:18
*** NM has quit IRC20:33
*** NM has joined #openstack-swift20:35
*** NM has quit IRC20:37
tdasilvanotmyname: I've added a second +2 on s3api patch, but haven't put the +A in case mattoliverau, zaitcev or timburke wanted to take an additional look, wdyt?20:38
*** NM has joined #openstack-swift20:38
zaitcevtdasilva: I'm going to have a follow-up, I think. It does not change anything.20:39
tdasilvazaitcev: yeah, i think the patch does warrant a number of different follow-ups and even kota_ has said so, but overall I think we can merge as is and then work on the minor stuff after...just my 2 cents20:41
tdasilvaneed to step away for a bit, be right back20:45
*** itlinux has joined #openstack-swift20:50
zaitcevexploding test requirements are holding me back20:53
zaitcevImportError: No module named requests_mock.contrib20:54
zaitcevImportError: No module named keystonemiddleware.auth_token20:54
timburke`pip install -r test-requirements.txt` ? they should be listed... note that bindep.txt also got updated21:06
zaitcevYeah21:15
zaitcevI verified that test-requirements.txt is correct. But I'm not going to pollute my laptop with pip.21:16
*** armaan has joined #openstack-swift21:31
*** brimestone has joined #openstack-swift21:43
*** NM has quit IRC22:03
*** NM has joined #openstack-swift22:04
*** itlinux has quit IRC22:05
*** itlinux has joined #openstack-swift22:10
*** NM has quit IRC22:11
*** brimestone has quit IRC22:12
*** NM has joined #openstack-swift22:14
*** NM has quit IRC22:19
notmynametdasilva: awesome. thanks22:20
notmynamezaitcev: thanks22:20
zaitcevnotmyname: I've done nothing yet... Just about now logging into a victim VM where I can run pip :-)22:20
notmyname:-)22:21
openstackgerritMerged openstack/swift feature/deep: Don't repeat merges when re-cleaving to existing shard db  https://review.openstack.org/56479222:31
openstackgerritTim Burke proposed openstack/swift feature/deep: Move objects in all storage policies to shards  https://review.openstack.org/56393922:53
*** itlinux has quit IRC23:01
zaitcevGah. I need to run to the dojo for tonight. I'll finish tomorrow.23:07
*** ukaynar has quit IRC23:18
*** ukaynar has joined #openstack-swift23:19
*** ukaynar has quit IRC23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!