Friday, 2018-03-23

openstackgerritmelissaml proposed openstack/swift master: fix a typo in documentation  https://review.openstack.org/55551300:10
*** OrionX has joined #openstack-swift00:14
*** OrionX has quit IRC00:19
*** gyee has quit IRC00:21
*** vint_bra has joined #openstack-swift00:24
openstackgerritMerged openstack/swift feature/deep: Require own_shard_range to be in sharding state before sharding db  https://review.openstack.org/55506700:25
*** vint_bra has quit IRC00:26
*** mikecmpbll has quit IRC00:33
*** yashmurty has joined #openstack-swift00:37
*** yashmurty has quit IRC00:47
*** vint_bra has joined #openstack-swift00:49
*** tovin07_ has joined #openstack-swift00:50
openstackgerritSamuel Merritt proposed openstack/swift master: Remove object replicator's lockup detector/mitigator.  https://review.openstack.org/55265901:10
openstackgerritSamuel Merritt proposed openstack/swift master: Multiprocess object replicator  https://review.openstack.org/55556301:10
*** ggine has joined #openstack-swift01:17
*** ggine has quit IRC01:18
*** gerardgine has quit IRC01:18
*** germs has left #openstack-swift01:26
*** vint_bra has quit IRC01:33
*** gerardgine has joined #openstack-swift01:40
kota_good morning01:48
*** zaitcev__ has joined #openstack-swift01:52
*** ChanServ sets mode: +v zaitcev__01:52
*** zaitcev_ has quit IRC01:56
*** gerardgine has quit IRC01:56
*** gerardgine has joined #openstack-swift01:57
*** m_kazuhiro has joined #openstack-swift01:59
m_kazuhirogood morning01:59
kota_m_kazuhiro: o/02:13
m_kazuhirokota_: o/02:14
*** gerardgine has quit IRC02:20
*** germs has joined #openstack-swift02:28
*** gerardgine has joined #openstack-swift02:34
*** gerardgine has quit IRC02:38
*** psachin has joined #openstack-swift02:51
*** OrionX has joined #openstack-swift03:21
*** OrionX has quit IRC03:23
*** OrionX has joined #openstack-swift03:23
*** OrionX has quit IRC03:27
openstackgerritMerged openstack/swift master: fix a typo in documentation  https://review.openstack.org/55551303:29
openstackgerritMerged openstack/swift feature/deep: Move auto_create_account_prefix option to DEFAULT section  https://review.openstack.org/55040903:38
*** gerardgine has joined #openstack-swift03:41
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: WIP: Add "Manual" Tiering Feature  https://review.openstack.org/54695803:54
*** itlinux has quit IRC03:59
*** germs has quit IRC04:01
*** germs has joined #openstack-swift04:02
*** early has quit IRC04:16
*** early has joined #openstack-swift04:19
*** persia has joined #openstack-swift04:21
*** links has joined #openstack-swift04:26
*** gerardgine has quit IRC04:34
*** gerardgine has joined #openstack-swift04:34
*** m_kazuhiro has quit IRC04:46
*** m_kazuhiro has joined #openstack-swift05:02
*** gyankum has joined #openstack-swift05:23
*** armaan has joined #openstack-swift06:09
*** armaan has quit IRC06:10
*** gerardgine has quit IRC06:12
*** armaan has joined #openstack-swift06:44
*** cbartz has joined #openstack-swift06:53
*** cbartz has quit IRC07:09
openstackgerritTovin Seven proposed openstack/swift master: OSprofiler in OpenStack Swift  https://review.openstack.org/46831607:12
*** pcaruana has joined #openstack-swift07:21
*** OrionX has joined #openstack-swift07:25
*** OrionX has quit IRC07:29
*** cbartz has joined #openstack-swift07:31
*** gkadam has joined #openstack-swift07:41
*** ianychoi has quit IRC08:00
*** ianychoi has joined #openstack-swift08:00
*** m_kazuhiro has quit IRC08:06
alecuyerGood morning08:10
*** pallavi has joined #openstack-swift08:14
pallavihi... I am getting 401 unauthorized error while accessing the swift using curl....08:15
pallaviplease help me to solve this issue08:15
DHEstarting with the obvious, you have an X-Auth-Token header in your request?08:16
pallavino... I didnt specify...08:16
pallaviactually I want to use this with alluxio08:17
*** geaaru has joined #openstack-swift08:20
*** tesseract has joined #openstack-swift08:20
*** _alastor_ has quit IRC08:31
acolesgood morning08:36
*** cshastri has joined #openstack-swift08:37
*** armaan has quit IRC08:40
*** armaan has joined #openstack-swift08:44
*** armaan has quit IRC08:51
*** cshastri has quit IRC08:58
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Fix versioned writes error with url-encoded object name  https://review.openstack.org/55524509:07
*** mikecmpbll has joined #openstack-swift09:08
kota_timburke: the translation quote <-> unquote should be pain for us, imo.09:11
kota_timburke: exactly, we could touch around the unquote in swift.wsgi module but i don't want to do it in *the bug fix* because that refactor could enbug into the swift master.09:13
*** rcernin has quit IRC09:20
*** OrionX has joined #openstack-swift09:26
*** joeljwright has joined #openstack-swift09:28
*** ChanServ sets mode: +v joeljwright09:28
*** OrionX has quit IRC09:30
*** gkadam is now known as gkadam-afk09:36
*** gkadam-afk is now known as gkadam09:43
*** cbartz has quit IRC09:52
*** hseipp has joined #openstack-swift09:59
openstackgerritMerged openstack/swift feature/deep: Store epoch in shard ranges table  https://review.openstack.org/55266810:08
*** rcernin has joined #openstack-swift10:08
openstackgerritMerged openstack/swift feature/deep: Enable sharding via own_shard_range in manage_shard_ranges.py  https://review.openstack.org/55534310:08
openstackgerritMerged openstack/swift feature/deep: Stop unnecessarily instantiating new Timestamps in shard-info  https://review.openstack.org/55546710:08
*** cbartz has joined #openstack-swift10:14
*** tovin07_ has quit IRC10:18
*** m_kazuhiro has joined #openstack-swift10:24
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: WIP: Add "Manual" Tiering Feature  https://review.openstack.org/54695810:24
*** m_kazuhiro has quit IRC10:25
*** OrionX has joined #openstack-swift11:27
*** pcaruana has quit IRC11:27
*** OrionX has quit IRC11:31
*** kei_yama has quit IRC11:42
*** gkadam_ has joined #openstack-swift12:07
*** gkadam has quit IRC12:09
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add _make_shard_ranges helper in test_sharder.py  https://review.openstack.org/55574912:24
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add set_deleted helper method to ShardRange  https://review.openstack.org/55575012:24
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Use mock_timestamp_now more  https://review.openstack.org/55575112:24
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Remove race between checking for state shrinking and acting upon it  https://review.openstack.org/55575212:24
*** tovin07 has quit IRC12:29
*** NM has joined #openstack-swift12:30
*** pcaruana has joined #openstack-swift12:30
*** rcernin has quit IRC12:30
*** OrionX has joined #openstack-swift13:28
*** OrionX has quit IRC13:33
*** d0ugal_ has joined #openstack-swift13:56
*** d0ugal has quit IRC13:57
*** links has quit IRC13:58
openstackgerritMerged openstack/swift feature/deep: Add _make_shard_ranges helper in test_sharder.py  https://review.openstack.org/55574914:21
*** sai-mtg is now known as sai-intrw14:36
*** mikecmpb_ has joined #openstack-swift14:36
*** mikecmpbll has quit IRC14:38
*** psachin has quit IRC14:42
-openstackstatus- NOTICE: zuul.o.o has been restarted to pick up latest code base and clear memory usage. Both check / gate queues were saved, be sure to check your patches and recheck when needed.14:52
*** NM has quit IRC14:55
*** NM has joined #openstack-swift14:59
*** d0ugal_ has quit IRC15:01
*** d0ugal__ has joined #openstack-swift15:01
*** d0ugal__ has quit IRC15:02
*** d0ugal has joined #openstack-swift15:02
*** OrionX has joined #openstack-swift15:08
*** _alastor_ has joined #openstack-swift15:11
*** itlinux has joined #openstack-swift15:21
*** cbartz has quit IRC15:22
rledisezhi all, i'm having a look at https://review.openstack.org/#/c/427911/27 to understand what's gonna happen in Swift. is there any design doc about the patch?15:26
patchbotpatch 427911 - swift - Replace MIME with PUT+POST for EC and Encryption15:26
tdasilvazaitcev__: ^^^15:26
zaitcev__rledisez, sorry, no doc. I probably should add something to the changelog. Personally I only experienced the impossibility of implementing the existing protocol in Go. But I heard people had problems with other HTTP implementations too, such as py3, grpc.15:29
rledisezyeah, I get the reason of the patch. i'm looking at the code and it seems more complex than what I first though (gotta admit I didn't think much ;)). I guess there is corner case you need to manage. that's what i'm looking for (the corner case) to explain the implementation15:30
rledisezzaitcev__: ^15:30
zaitcev__I think I pared it down to the minimum required. If there's something you think is extaneous, it would be most helpful if you left a comment in the review. I think Sam's replacement of yield in df.open() causes the most questions. I have to admit that I'm not entirely clear on the concept either.15:32
*** zaitcev__ is now known as zaitcev15:39
zaitcevbrb food15:39
*** links has joined #openstack-swift15:40
*** gyee has joined #openstack-swift15:41
*** NM has quit IRC15:41
notmynamegood morning15:41
*** links has quit IRC15:46
-openstackstatus- NOTICE: Gerrit will be temporarily unreachable as we restart it to complete the rename of some projects.15:50
*** NM has joined #openstack-swift15:58
*** joeljwright has quit IRC16:00
*** gyankum has quit IRC16:00
*** mikecmpb_ has quit IRC16:00
*** mikecmpbll has joined #openstack-swift16:01
*** mikecmpbll has quit IRC16:04
*** mikecmpbll has joined #openstack-swift16:05
*** wes_dillingham has joined #openstack-swift16:10
alecuyerHello all, for those interested in LOSF (lots of small files), I have updated the document at https://wiki.openstack.org/wiki/Swift/ideas/small_files/implementation.16:13
acolesalecuyer: thanks!16:16
alecuyeracoles: you're welcome! I hope to make some code available soon16:17
notmynamealecuyer: nice!16:19
tdasilvanice slides16:20
alecuyerAh, speaking of slides, I have just posted newer ones that we used for a talk in Paris. https://fr.slideshare.net/AlexandreLecuyer/openstack-swift-lots-of-small-files (linked in the wiki as well)16:26
*** germs has quit IRC16:26
timburkegood morning16:26
*** germs has joined #openstack-swift16:27
*** germs has quit IRC16:27
*** germs has joined #openstack-swift16:27
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Use mock_timestamp_now more  https://review.openstack.org/55575116:28
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add set_deleted helper method to ShardRange  https://review.openstack.org/55575016:28
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Remove race between checking for state shrinking and acting upon it  https://review.openstack.org/55575216:28
timburkeacoles: got a sec to look at p 555437 and p 555438?16:28
patchbothttps://review.openstack.org/#/c/555437/ - swift (feature/deep) - Tolerate stale reads in manage_shard_ranges16:28
patchbothttps://review.openstack.org/#/c/555438/ - swift (feature/deep) - Emit progress during swift-manage-shard-ranges find16:28
acolestimburke: sure, in fact it was next up for me, just finishing off something else16:29
timburkeyay! thanks16:29
timburkei was utterly unaware of mock_timestamp_now ...16:32
acolestimburke: every time I needed to do it i had to remember about classmethod. sometimes I didn't remember so ended up mocking time.time. now I just need to remember that there is a helper.16:34
acolesset_delete turned out to be less useful that anticipated, but having written it I decided to keep it ;)16:35
*** NM has quit IRC16:48
*** armaan has joined #openstack-swift16:52
*** OrionX has quit IRC16:53
*** gkadam_ has quit IRC16:54
*** gerardgine has joined #openstack-swift16:58
*** NM has joined #openstack-swift16:59
*** mikecmpbll has quit IRC17:02
*** OrionX has joined #openstack-swift17:22
*** pcaruana has quit IRC17:23
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Require sufficient replication of each cleaved shard range  https://review.openstack.org/55333717:26
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Require sufficient replication before deleting misplaced objects  https://review.openstack.org/55545917:26
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Only delete misplaced objects that were moved  https://review.openstack.org/55587417:26
*** hseipp has quit IRC17:26
*** itlinux has quit IRC17:27
*** OrionX has quit IRC17:27
*** SkyRocknRoll has joined #openstack-swift17:28
*** wes_dillingham has quit IRC17:31
*** wes_dillingham has joined #openstack-swift17:35
acolestimburke: +A on those two manage_shard_ranges patches, thanks17:36
timburkei'll need to rebase after https://review.openstack.org/#/c/555752/ lands, but nbd17:37
patchbotpatch 555752 - swift (feature/deep) - Remove race between checking for state shrinking a...17:37
*** ukaynar has joined #openstack-swift17:38
*** armaan has quit IRC17:43
*** psachin has joined #openstack-swift17:44
*** OrionX has joined #openstack-swift17:45
acolestimburke: ah, sorry! you go ahead and merge once rebased17:47
timburkethat was my plan :-)17:47
*** OrionX has quit IRC17:50
*** zaitcev_ has joined #openstack-swift17:54
*** ChanServ sets mode: +v zaitcev_17:54
*** zaitcev has quit IRC17:57
*** wes_dillingham has quit IRC17:59
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Use manage_shard_ranges arg for shards account prefix  https://review.openstack.org/55589318:00
*** wes_dillingham has joined #openstack-swift18:03
*** OrionX has joined #openstack-swift18:07
*** OrionX has quit IRC18:12
*** gerardgine has quit IRC18:12
*** armaan has joined #openstack-swift18:21
*** cshastri has joined #openstack-swift18:22
*** psachin has quit IRC18:26
*** SkyRocknRoll has quit IRC18:29
*** gerardgine has joined #openstack-swift18:32
*** itlinux has joined #openstack-swift18:32
*** wes_dillingham has quit IRC18:34
*** itlinux has quit IRC18:47
*** itlinux has joined #openstack-swift18:50
*** armaan has quit IRC18:55
mlannertdasilva cschwede Given our conversations at PTG, here's the link to the opened up repo for Logstash grok patterns: https://github.com/swiftstack/swift-grok-patterns18:57
*** wes_dillingham has joined #openstack-swift18:58
*** geaaru has quit IRC19:01
torgomaticdid something happen to sphinx recently? I had a patch fail CI because one of the doc strings had a :returns: line that Sphinx refused to even consider.19:04
openstackgerritMerged openstack/swift feature/deep: Tolerate stale reads in manage_shard_ranges  https://review.openstack.org/55543719:07
*** itlinux has quit IRC19:08
*** cshastri has quit IRC19:11
*** wes_dillingham has quit IRC19:15
*** itlinux has joined #openstack-swift19:15
*** itlinux has quit IRC19:16
openstackgerritMerged openstack/swift feature/deep: Emit progress during swift-manage-shard-ranges find  https://review.openstack.org/55543819:17
openstackgerritMerged openstack/swift feature/deep: Use mock_timestamp_now more  https://review.openstack.org/55575119:17
*** OrionX has joined #openstack-swift19:26
*** bkopilov has quit IRC19:27
*** ukaynar has quit IRC19:27
*** ukaynar has joined #openstack-swift19:30
*** bkopilov has joined #openstack-swift19:31
*** OrionX has quit IRC19:33
*** openstackgerrit has quit IRC19:34
*** gerardgine has quit IRC20:03
*** OrionX has joined #openstack-swift20:04
*** itlinux has joined #openstack-swift20:07
*** itlinux has quit IRC20:09
*** OrionX has quit IRC20:09
*** tesseract has quit IRC20:09
*** gerardgine has joined #openstack-swift20:17
*** openstackgerrit has joined #openstack-swift20:34
openstackgerritMerged openstack/swift feature/deep: Add set_deleted helper method to ShardRange  https://review.openstack.org/55575020:34
openstackgerritMerged openstack/swift feature/deep: Remove race between checking for state shrinking and acting upon it  https://review.openstack.org/55575220:34
*** gerardgine has quit IRC20:40
*** neonpastor has joined #openstack-swift21:02
zaitcev_Hrumpf21:04
zaitcev_I have a working cluster where I deployed PUT+POST, and I noticed a bunch of these21:05
zaitcev_Mar 23 17:02:35 rhev-a24c-01 object-server[5372]: 192.168.50.3/a3/234447 EXCEPTION in ssync.Receiver: #012Traceback (most recent call last):#012  File "/usr/lib/python2.7/site-packages/swift/obj/ssync_receiver.py", line 165, in __call__#012    for data in self.updates():#012  File "/usr/lib/python2.7/site-packages/swift/obj/ssync_receiver.py", line 454, in updates#012    % (method, path))#012Exception: POST subrequest with content-length21:05
zaitcev_/AUTH_zaitcev/ec1cont/verify1.data21:05
zaitcev_Not sure if I triggered it, or if this was happening before.21:06
*** ukaynar has quit IRC21:13
openstackgerritSamuel Merritt proposed openstack/swift master: Multiprocess object replicator  https://review.openstack.org/55556321:22
*** NM has quit IRC21:40
*** gerardgine has joined #openstack-swift21:40
*** mikecmpbll has joined #openstack-swift21:44
openstackgerritMerged openstack/swift feature/s3api: Remove last vestiges of CONF  https://review.openstack.org/55509921:44
*** mikecmpbll has quit IRC22:04
*** wes_dillingham has joined #openstack-swift22:22
*** mikecmpbll has joined #openstack-swift22:26
*** wes_dillingham has quit IRC22:39
*** mikecmpbll has quit IRC22:43
*** wes_dillingham has joined #openstack-swift22:52
*** OrionX has joined #openstack-swift23:13
openstackgerritSamuel Merritt proposed openstack/swift master: Make reconstructor go faster with --override-devices  https://review.openstack.org/55595123:20
torgomaticaw, review 555555 is a global-requirements update from a bot23:21
*** geaaru has joined #openstack-swift23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!