Tuesday, 2018-04-17

*** Renich has quit IRC00:09
*** thurloat has quit IRC00:11
*** Raymii has quit IRC00:11
*** thurloat has joined #openstack-swift00:14
*** Raymii has joined #openstack-swift00:14
openstackgerritMerged openstack/swift feature/deep: Include shard range count in info output  https://review.openstack.org/56172300:19
DHEis ssync considered stable yet? or is rsync still the way to go00:22
mattoliverauDHE: depends on who you ask ;). OVH only use ssync, and if your using EC then your using ssync. So yeah I'd say it's stable. It just isn't as quick as rsync. So replication will take longer etc.00:26
DHEthe EC thing would have been my next question...00:27
DHEokay thanks. I guess I'll leave rsync up then...00:27
DHEI'm still in the "business case to management" phase of my deployment... :/00:28
*** knylander has quit IRC00:48
*** cshastri has joined #openstack-swift01:10
*** m_kazuhiro has joined #openstack-swift01:14
*** jhawk has quit IRC01:20
m_kazuhirogood morning01:20
*** mvk has quit IRC01:37
kota_good morning01:43
*** mvk has joined #openstack-swift01:51
*** portante_ has joined #openstack-swift02:01
*** portante has quit IRC02:02
*** ndk_ has quit IRC02:03
*** ndk_ has joined #openstack-swift02:03
*** portante has joined #openstack-swift02:04
*** portante_ has quit IRC02:06
*** wangyx has joined #openstack-swift02:15
mattoliveraum_kazuhiro, kota_: morning02:31
kota_mattoliverau: o/02:31
m_kazuhiromattoliverau: o/02:32
*** mvk has quit IRC02:39
*** wangyx has quit IRC02:57
*** wangyx has joined #openstack-swift02:58
*** wangyx has quit IRC03:00
*** wangyx has joined #openstack-swift03:00
*** jhawk has joined #openstack-swift03:02
*** kei_yama has quit IRC03:02
*** psachin has joined #openstack-swift03:09
*** kei_yama has joined #openstack-swift03:11
*** d0ugal_ has joined #openstack-swift03:14
*** d0ugal has quit IRC03:16
*** m_kazuhiro has quit IRC03:35
*** kei_yama has quit IRC03:37
*** kei_yama has joined #openstack-swift04:01
*** timburke_ has joined #openstack-swift04:02
*** ChanServ sets mode: +v timburke_04:02
*** timburke has quit IRC04:03
*** d0ugal_ has quit IRC04:03
*** d0ugal__ has joined #openstack-swift04:03
*** andymccr has quit IRC04:05
*** andymccr has joined #openstack-swift04:05
*** asettle_ has joined #openstack-swift04:14
*** asettle has quit IRC04:16
*** wangyx has quit IRC04:27
*** wangyx has joined #openstack-swift04:54
*** wangyx has joined #openstack-swift04:54
*** Renich has joined #openstack-swift05:06
*** paramite has joined #openstack-swift05:10
*** geaaru has quit IRC05:18
*** links has joined #openstack-swift05:23
*** wangyx has quit IRC05:36
*** wangyx has joined #openstack-swift05:36
*** wangyx has quit IRC05:41
*** ccamacho has quit IRC05:41
*** wangyx has joined #openstack-swift05:54
*** m_kazuhiro has joined #openstack-swift05:55
*** hoonetorg has quit IRC05:59
*** hoonetorg has joined #openstack-swift06:12
*** pcaruana has joined #openstack-swift06:16
*** ianychoi has joined #openstack-swift06:38
openstackgerritNguyen Hai proposed openstack/python-swiftclient master: Change python-swiftclient webpage to openstackdocstheme  https://review.openstack.org/55343306:41
*** cbartz has joined #openstack-swift06:47
*** hseipp has joined #openstack-swift06:49
*** yashmurty has joined #openstack-swift06:55
*** rcernin has quit IRC06:57
*** ccamacho has joined #openstack-swift06:58
*** neonpastor has quit IRC07:00
*** neonpastor has joined #openstack-swift07:01
*** ccamacho has quit IRC07:04
*** ccamacho has joined #openstack-swift07:05
*** jhawkinson has joined #openstack-swift07:13
*** tesseract has joined #openstack-swift07:14
*** jhawk has quit IRC07:16
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Minor refactor or broker empty() method  https://review.openstack.org/56181207:31
*** m_kazuhiro has quit IRC07:45
*** mikecmpbll has joined #openstack-swift07:55
*** geaaru has joined #openstack-swift07:55
*** ianychoi has quit IRC08:04
*** d0ugal__ has quit IRC08:05
*** d0ugal has joined #openstack-swift08:05
*** d0ugal has quit IRC08:05
*** d0ugal has joined #openstack-swift08:05
*** ianychoi has joined #openstack-swift08:10
*** kei_yama has quit IRC08:16
*** hseipp has quit IRC08:22
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Move misplaced objects when no active shard ranges  https://review.openstack.org/56162608:23
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Refactor so broker adds filler shard range when needed  https://review.openstack.org/56164308:23
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Use 'timestamp' name consistently in ShardRange  https://review.openstack.org/56183008:23
*** hseipp has joined #openstack-swift08:27
*** TobbeCN has joined #openstack-swift08:34
*** armaan has joined #openstack-swift08:51
*** ntt_ has joined #openstack-swift08:52
ntt_Hi, I need to replace a disk in my swift cluster (3 zones, 3 replicas, 1 region, 18 devices). Reading here -> https://wiki.openstack.org/wiki/OpsGuide-Maintenance-Storage#Replacing_a_Swift_Disk it seems I only need to umount the disk but I think this an incomplete procedure. Should I remove the disk from the ring first? (note: I'm using kilo version of openstack swift)08:54
*** TobbeCN has quit IRC08:56
*** TobbeCN has joined #openstack-swift08:56
*** bkopilov has quit IRC09:13
*** mvk has joined #openstack-swift09:22
*** mikecmpb_ has joined #openstack-swift09:22
*** mikecmpbll has quit IRC09:23
*** bkopilov has joined #openstack-swift09:29
*** m_kazuhiro has joined #openstack-swift09:35
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Add object-expirer new mode to execute tasks from general task queue  https://review.openstack.org/51738909:36
*** silor has joined #openstack-swift09:39
*** m_kazuhiro has quit IRC09:45
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Use max length container name in probe test  https://review.openstack.org/56185509:45
openstackgerritAlistair Coles proposed openstack/swift feature/deep: WIP Use non-ascii container name in a probe test  https://review.openstack.org/56185609:45
*** cshastri has quit IRC10:24
*** dr_gogeta86 has quit IRC10:26
*** armaan has quit IRC10:31
*** armaan has joined #openstack-swift10:31
*** mvk has quit IRC10:41
*** armaan has quit IRC10:46
*** armaan has joined #openstack-swift10:46
*** armaan has quit IRC10:46
*** armaan has joined #openstack-swift10:47
*** mvk has joined #openstack-swift10:54
*** wangyx has quit IRC10:58
*** cshastri has joined #openstack-swift11:06
openstackgerritMerged openstack/swift feature/deep: Minor refactor or broker empty() method  https://review.openstack.org/56181211:08
*** wangyx has joined #openstack-swift11:11
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Be willing to cleave on handoffs  https://review.openstack.org/55069711:12
*** TobbeCN has quit IRC11:16
*** TobbeCN has joined #openstack-swift11:17
*** TobbeCN has quit IRC11:17
*** TobbeCN has joined #openstack-swift11:17
*** armaan has quit IRC11:25
*** armaan has joined #openstack-swift11:25
*** cshastri has quit IRC11:30
*** knylander has joined #openstack-swift11:34
yashmurtyHello, is anyone there?11:35
yashmurtyI wanted to ask some questions regarding middleware/keystoneauth.py11:35
acolesyashmurty: go ahead and ask - I need to leave soon but may be able to answer11:37
yashmurtyThank you @acoles11:37
yashmurtyhttps://github.com/openstack/swift/blob/master/swift/common/middleware/keystoneauth.py#L21711:38
yashmurtyI'm just trying to figure out the scope of 'Authorizing as anonymous'11:38
yashmurtyI have Newton version of Swift deployed11:39
*** TobbeCN has quit IRC11:39
yashmurtyAnd when I do a POST request on /account/container/object without any X-Auth-Token, I receive a 40411:40
*** TobbeCN has joined #openstack-swift11:40
yashmurtyAnd when I do the same in latest master version, the response 40111:40
yashmurtySo I was trying to figure out from the source code, what exactly changed.11:40
yashmurtySorry if the question is very vague! :bow:11:40
*** TobbeCN has quit IRC11:42
*** TobbeCN has joined #openstack-swift11:43
*** armaan has quit IRC11:44
*** armaan has joined #openstack-swift11:45
acolesyashmurty: my initial reaction is that if the request is not authorized then a 401 would be the expected response, so maybe a bugfix changed the 404 to 40111:46
yashmurty@acoles I see! That makes sense.11:47
yashmurtyAlso, can I ask a follow up question.11:47
yashmurtyWhen I see the journalctl logs for my devstack deployment11:48
acoleskeystoneauth middleware only returns a 404 if the path is not valid format11:48
yashmurtyApr 17 11:45:04 vagrant proxy-server[2579]: Authorizing as anonymous11:48
yashmurtyThis log says it was generated by proxy-server11:49
yashmurtyAnd I found this exact statement in Keystoneauth.py file11:49
yashmurtyBut when I modified this log message11:50
yashmurtyhttps://github.com/openstack/swift/blob/master/swift/common/middleware/keystoneauth.py#L21811:50
yashmurtyAnd restarted my proxy-server11:50
yashmurty systemctl restart devstack@s-proxy.service11:50
yashmurtyThe logged message is still the same.11:50
yashmurtyCould you tell me where exactly these messages are coming from then?11:51
acoleshmm, line 218 seems to be the only place in the swift code that generates that log string. could it be that devstack is not picking up your change - I'm not familiar with how devstack installs swift. Try adding an info level debug at line 195 in keystoneauth and see if that appears in the proxy logs during service startup - the proxy app logs some stuff about the pipeline during startup so grep for 'Pipeline' may help11:57
acoles you find it.11:57
yashmurty@acoles Thanks for your help!11:59
acolesyashmurty: no problem, hope you figure it out11:59
* acoles away12:01
*** hseipp has quit IRC12:12
*** armaan has quit IRC12:14
*** armaan has joined #openstack-swift12:14
*** NM has joined #openstack-swift12:15
*** wangyx has quit IRC12:15
*** wangyx has joined #openstack-swift12:16
*** armaan has quit IRC12:19
*** NM has quit IRC12:20
*** wangyx has quit IRC12:20
*** armaan has joined #openstack-swift12:29
*** NM has joined #openstack-swift12:31
*** hseipp has joined #openstack-swift12:33
*** cshastri has joined #openstack-swift12:45
*** cshastri has quit IRC12:50
*** hseipp has quit IRC13:01
*** hseipp has joined #openstack-swift13:01
*** yashmurty has quit IRC13:02
*** armaan has quit IRC13:04
*** armaan has joined #openstack-swift13:04
*** ianychoi_ has joined #openstack-swift13:07
*** ianychoi has quit IRC13:10
*** NM has quit IRC13:11
*** NM has joined #openstack-swift13:15
*** armaan has quit IRC13:24
*** armaan has joined #openstack-swift13:24
*** armaan has quit IRC13:25
*** armaan has joined #openstack-swift13:25
*** armaan has quit IRC13:27
*** armaan has joined #openstack-swift13:28
*** zaitcev has joined #openstack-swift13:29
*** ChanServ sets mode: +v zaitcev13:29
*** silor has quit IRC13:31
*** armaan has quit IRC13:36
*** armaan has joined #openstack-swift13:36
*** links has quit IRC13:38
*** psachin has quit IRC13:40
*** asettle_ is now known as asettle13:47
*** rickflare has quit IRC14:02
*** AndyWojo has quit IRC14:11
*** NM has quit IRC14:15
*** NM has joined #openstack-swift14:17
*** AndyWojo has joined #openstack-swift14:19
*** mikecmpb_ has quit IRC14:34
*** mikecmpbll has joined #openstack-swift14:35
*** silor has joined #openstack-swift14:39
*** TobbeCN has quit IRC15:04
*** TobbeCN has joined #openstack-swift15:05
*** armaan has quit IRC15:05
*** armaan has joined #openstack-swift15:06
*** cshastri has joined #openstack-swift15:07
*** ccamacho has quit IRC15:11
*** TobbeCN has quit IRC15:12
*** cbartz has quit IRC15:15
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Split parsing/merging sync responses from deciding what to do next  https://review.openstack.org/55069615:18
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Stop replicating object rows when container could be sharded  https://review.openstack.org/54967815:18
*** geaaru has quit IRC15:25
*** pcaruana has quit IRC15:28
*** brimestone has joined #openstack-swift15:36
*** vinsh has joined #openstack-swift15:43
*** brimestoned has joined #openstack-swift15:59
*** brimestone has quit IRC16:02
*** TobbeCN has joined #openstack-swift16:04
*** TobbeCN has quit IRC16:09
*** silor has quit IRC16:10
notmynamegood morning16:12
*** links has joined #openstack-swift16:14
*** pcaruana has joined #openstack-swift16:18
*** gyee has joined #openstack-swift16:19
*** hseipp has quit IRC16:27
*** mikecmpbll has quit IRC16:48
*** brimestoned has quit IRC17:17
*** brimestone has joined #openstack-swift17:18
*** links has quit IRC17:35
*** links has joined #openstack-swift17:47
*** cshastri has quit IRC17:54
*** mikecmpbll has joined #openstack-swift17:58
*** brimestoned has joined #openstack-swift18:02
*** brimestone has quit IRC18:05
*** tesseract has quit IRC18:06
*** mvk has quit IRC18:07
openstackgerritMerged openstack/swift feature/deep: Use max length container name in probe test  https://review.openstack.org/56185518:08
openstackgerritMerged openstack/swift feature/deep: Use 'timestamp' name consistently in ShardRange  https://review.openstack.org/56183018:34
*** joeljwright has joined #openstack-swift18:38
*** ChanServ sets mode: +v joeljwright18:38
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Be willing to cleave on handoffs  https://review.openstack.org/55069718:59
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Split parsing/merging sync responses from deciding what to do next  https://review.openstack.org/55069618:59
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Stop replicating object rows when container could be sharded  https://review.openstack.org/54967818:59
acolesclayg: all yours ^^19:00
* clayg takes the baton19:00
acolesclayg: I left some TODO comments where tests are failing and where I changed assertions - there is some cleanup needed19:00
acolesmost obvious more work is replicating sharding -> missing which now only sends the fresh db but returns True - we need that to be a False so handoff is not deleted. But its a different code path to complete rsync than the nice override methods :/19:02
acolesclayg: I also needed to rebase to get it on gerrit so its up to date with feature/deep19:04
*** TobbeCN has joined #openstack-swift19:09
*** TobbeCN has quit IRC19:13
*** mrjk has quit IRC19:49
*** mrjk has joined #openstack-swift19:49
timburke_one of my former employers had a code review system that had the concept of a baton -- it was even a sortable column, so you could make sure that everything for which you held the baton would stay at the top19:55
*** verto has joined #openstack-swift20:22
*** links has quit IRC20:42
*** pcaruana has quit IRC20:42
*** mrjk has quit IRC20:56
*** mrjk has joined #openstack-swift20:58
*** mvk has joined #openstack-swift21:14
*** paramite has quit IRC21:14
*** NM has quit IRC21:32
openstackgerritTimur Alperovich proposed openstack/python-swiftclient master: Properly handle unicode headers.  https://review.openstack.org/56205921:44
*** mikecmpbll has quit IRC22:17
openstackgerritJohn Dickinson proposed openstack/swift master: updated associated projects page  https://review.openstack.org/56206622:20
*** brimestoned has quit IRC22:28
*** brimestone has joined #openstack-swift22:28
*** brimestone has left #openstack-swift22:29
mattoliveraumorning22:36
notmynamehello22:38
*** rcernin has joined #openstack-swift22:42
openstackgerritClay Gerrard proposed openstack/swift feature/deep: Stop replicating object rows when container could be sharded  https://review.openstack.org/54967822:43
openstackgerritTim Burke proposed openstack/swift feature/deep: Revert gatekeeper to master  https://review.openstack.org/56207622:51
*** joeljwright has quit IRC23:02
*** TobbeCN has joined #openstack-swift23:11
*** TobbeCN has quit IRC23:15
timurtimburke_: I think for this unicode patch I'm going to change it to use the parse_header_string function and then we can handle the non-UTF-8 characters correctly23:26
timburke_"correctly" -- there's no good way to handle them! you'll only be sad :-(23:28
mattoliverauor correctly == how someone else decided to do it so you yourself doesn't have to go down the rabbit hole :P23:31
timurtimburke_: what mattoliverau said!23:43
timurI will follow the tried and true ways of swiftclient, where non-UTF-8 characters are %-encoded and everything is stuffed into a unicode string. It's... great?23:43
timurI didn't notice the parse_header_string() function earlier, but that's the one I'm going to use23:44

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!