Wednesday, 2017-08-16

*** vint_bra has joined #openstack-swift00:09
*** vint_bra has quit IRC00:13
*** catintheroof has joined #openstack-swift00:23
*** lucasxu has joined #openstack-swift00:24
mattoliverauclarkb: it has, but the problem is when installing cryptographu from pip, the wheel comes with an _openssl.so binding that is incorrectly linked.. but turns out it's an easish fix.00:42
mattoliveraupip install --no-binary cryptography -r test-requirements.txt00:43
mattoliverauthat will make it build it with the local one, libssl.so.1.0.000:43
mattoliveraujust remember to clean your pip cache etc first, opps00:44
mattoliverautimburke: ^00:44
*** cshastri has joined #openstack-swift00:48
*** ChanServ sets mode: +v jrichli00:52
*** lucasxu has quit IRC00:54
*** kiennt has joined #openstack-swift01:01
*** tovin07_ has joined #openstack-swift01:03
*** lucasxu has joined #openstack-swift01:11
*** lucasxu has quit IRC01:13
mattoliverausorry that was meant to be pip install --no-binary cryptography -r requirements.txt01:20
*** ujjain has quit IRC01:23
*** gkadam has quit IRC01:28
*** ujjain has joined #openstack-swift01:29
*** ujjain has joined #openstack-swift01:29
openstackgerritMatthew Oliver proposed openstack/swift master: Add OpenSuse SAIO build instructions  https://review.openstack.org/49338501:36
openstackgerritMerged openstack/swift master: Use unique body content in EC test objects  https://review.openstack.org/49397501:44
*** catintheroof has quit IRC01:47
kota_good morning01:51
mattoliveraukota_: morning01:55
kota_o/01:56
kota_mattoliverau: ^^^^01:56
*** bkopilov has quit IRC02:11
*** mat128 has quit IRC02:48
*** catintheroof has joined #openstack-swift02:50
*** catintheroof has quit IRC03:03
*** bkopilov has joined #openstack-swift03:30
*** links has joined #openstack-swift03:47
*** mvk_ has joined #openstack-swift04:01
*** abhitechie has joined #openstack-swift04:17
*** klrmn has quit IRC04:26
*** abhinavtechie has joined #openstack-swift04:31
*** abhitechie has quit IRC04:32
*** two_tired has joined #openstack-swift04:35
*** abhinavtechie has quit IRC05:07
*** gyee has quit IRC05:17
*** shuyingy_ has joined #openstack-swift05:40
*** shuyingya has quit IRC05:40
*** kiennt has quit IRC05:43
*** pcaruana has joined #openstack-swift05:45
*** silor has joined #openstack-swift05:54
*** shuyingya has joined #openstack-swift06:01
*** kiennt has joined #openstack-swift06:02
*** shuyingy_ has quit IRC06:04
*** hoonetorg has quit IRC06:08
*** kiennt has quit IRC06:11
*** dja has quit IRC06:11
*** ChubYann has quit IRC06:14
*** kiennt has joined #openstack-swift06:16
*** dja has joined #openstack-swift06:18
*** hoonetorg has joined #openstack-swift06:20
*** geaaru has joined #openstack-swift06:26
*** skudlik has joined #openstack-swift06:29
*** skudlik has left #openstack-swift06:30
*** two_tired has quit IRC06:38
*** hseipp has joined #openstack-swift06:42
*** rcernin has joined #openstack-swift06:57
*** kiennt has quit IRC06:57
*** kiennt has joined #openstack-swift06:58
*** silor has quit IRC06:58
*** hseipp has quit IRC07:12
*** hseipp has joined #openstack-swift07:14
*** rcernin has quit IRC07:16
*** rcernin has joined #openstack-swift07:19
mattoliverautdasilva: fyi, i'm using your version of swift-ansible to deploy a vagrant cluster (2x proxies, 4x storage nodes) on my latop and it works great. I've pushed back to a branch on my fork where I'm tweaking a little, found some annoyances that I'll fix up and push there. When I have something ready I'll send you a PR.07:29
mattoliverauMaybe I'll finally get around to playbooking statsd + graphana cause it'll be useful to have when I use it for sharding :)07:30
mattoliverau*grafana07:30
*** fanzhang has joined #openstack-swift07:32
fanzhangHi, guys. I installed swift by following https://docs.openstack.org/project-install-guide/object-storage/ocata/get_started.html , with 1 controller node and 1 storage node. When I tried to do verify operation, I met an error. At first, output of  command " #swift stat " was fine. But when I was creating container, I met "Not Found (HTTP 404) (Request-ID: txf8b44450fefe46feb5fdf-005993e7ab)" . Logs in /var/log/messages showed http://paste.ubuntu.07:37
*** oshritf has joined #openstack-swift07:53
*** oshritf has quit IRC07:58
*** oshritf has joined #openstack-swift08:00
*** oshritf has quit IRC08:03
acolestimburke: thanks for cleaning up patch 49397508:04
patchbothttps://review.openstack.org/#/c/493975/ - swift - Use unique body content in EC test objects (MERGED)08:04
*** cbartz has joined #openstack-swift08:07
*** andymccr_ is now known as andymccr08:08
acolesfanzhang: your paste link is incomplete. do you have account_autocreate=true in proxy-server.conf [proxy-server] section?08:14
acolessorry I mean [app:proxy-server] section08:15
fanzhangacoles: Yes, I have. And also, allow_account_management = true.08:16
*** joeljwright has joined #openstack-swift08:22
*** ChanServ sets mode: +v joeljwright08:22
acolesfanzhang: can you give a link the pastebin of your logs08:23
acolesrledisez: thanks for updating patch 472659 - is the header name the *only* change from version 3 to 4? (the rebase has introduced noise into the 4-3 diff)08:24
patchbothttps://review.openstack.org/#/c/472659/ - swift - Allow to rebuild a fragment of an expired object08:24
fanzhangacoles: this link http://paste.ubuntu.com/25324208/ is the whole logs when I create a container in /var/log/messages.08:24
fanzhangacoles: I got these by tailf /var/log/messages.08:25
openstackgerritCharles Hsu proposed openstack/swift master: Fix wrong logs when reconstructor rebuild fragments.  https://review.openstack.org/49377408:27
fanzhangacoles: this link is the output of debuging create container http://paste.ubuntu.com/25324058/08:27
rledisezacoles: yes, it's the only change. i'm used to rebase everytime i push, i never though of that side effect. won't do it again ;)08:29
acolesrledisez: NP I'm not complaining :) you often *have* to rebase to escape merge conflicts08:30
acolesfanzhang: this line in the proxy-server logs shows a problem with the account server (it says 'From Container Server' but that is a side-effect of the account autocreate) - so you need to look at account server logs on 10.0.0.13 machine ... ERROR 500 Trying to PUT /AUTH_3a17b36efa604779a9e5377e06e2b880 From Container Server 10.0.0.13:6202/sda08:41
acolesfanzhang: the container PUT triggers an account autocreate - that is failing, which causes the account to not exist, which results in the 404 back to client08:42
fanzhangacoles: thanks man, but where should I find these logs? In /var/log/messages?08:42
fanzhangacoles: It seems like a Permission denied http://paste.ubuntu.com/25324449/08:44
fanzhangacoles: sorry, my fault. I must forget chown -R swift:swift /srv/node . Now I can create a container. Thanks so much for your answering.đź‘Ť08:46
acolesfanzhang: depends how you set up logging but likely to be same as your proxy /var/log/messages08:46
acolesfanzhang: yep, the object-replicator log error is a different process but the account server failing is almost certainly due to same permissions problem08:47
*** kei_yama has quit IRC08:47
fanzhangacoles: thanks soooo much :)08:48
acolesfanzhang: NP glad you are sorted08:48
*** hoonetorg has quit IRC09:07
*** hoonetorg has joined #openstack-swift09:10
*** abhitechie has joined #openstack-swift09:20
*** abhinavtechie has joined #openstack-swift09:23
*** abhitechie has quit IRC09:23
*** abhitechie has joined #openstack-swift09:25
*** abhinavtechie has quit IRC09:27
*** oshritf has joined #openstack-swift09:28
openstackgerritRajat Sharma proposed openstack/swift master: Inconsistencies in endpoint definitions  https://review.openstack.org/49414409:30
*** tovin07 has joined #openstack-swift09:35
*** cshastri has quit IRC09:47
*** hobz has joined #openstack-swift09:51
hobzhello guys, quick question - when adding a new storage node to my cluster, rebalancing and syncing the ring gz files across all nodes i get 404's on files that used to return 200's. removing the new node solves the problem. any idea?09:52
*** tovin07_ has quit IRC09:57
*** kiennt has quit IRC10:05
*** abhinavtechie has joined #openstack-swift10:08
*** aagrawal has joined #openstack-swift10:10
*** abhitechie has quit IRC10:10
*** abhinavtechie has quit IRC10:13
hobzis there any additional command to be run after rebalancing?10:19
hobzso apparanlty i was trying to add too much storage at once and opted for the gradual weight approach10:33
*** hobz has quit IRC10:34
*** aagrawal has quit IRC10:39
*** abhitechie has joined #openstack-swift10:39
*** abhitechie has quit IRC10:45
*** mkrcmari__ has joined #openstack-swift10:47
*** bkopilov has quit IRC10:50
*** mvk_ has quit IRC10:50
*** abhitechie has joined #openstack-swift10:51
*** skudlik has joined #openstack-swift10:58
*** skudlik has quit IRC11:10
*** szaher has joined #openstack-swift11:15
openstackgerritAlistair Coles proposed openstack/swift master: Fix flakey EC frag duplication policy test  https://review.openstack.org/49417211:21
acolestimburke: some to-and-fro with the ec test helpers ^^ but a new mixin now seems worthwhile11:22
*** skudlik has joined #openstack-swift11:24
*** xinli has quit IRC11:24
*** hseipp has quit IRC11:34
*** hseipp has joined #openstack-swift11:35
*** mat128 has joined #openstack-swift11:44
*** skudlik has left #openstack-swift11:50
*** hseipp has quit IRC12:00
*** bkopilov has joined #openstack-swift12:28
*** shuyingya has quit IRC12:38
*** cargreg has joined #openstack-swift12:38
cargregi guys someone can help me?12:39
*** catintheroof has joined #openstack-swift12:49
*** abhitechie has quit IRC12:54
*** hseipp has joined #openstack-swift13:01
*** baojg has joined #openstack-swift13:03
*** hseipp has quit IRC13:06
*** hseipp has joined #openstack-swift13:06
*** vint_bra has joined #openstack-swift13:10
*** chlong_ has joined #openstack-swift13:31
*** mat128 has quit IRC13:38
*** chlong_ has quit IRC13:59
tdasilvamattoliverau: that's great. I've been thinking about getting that going again and am curious about your patch. looking forward to your PR14:01
*** hfaria_baculasys has joined #openstack-swift14:17
*** mat128 has joined #openstack-swift14:20
*** lucasxu has joined #openstack-swift14:25
*** links has quit IRC14:32
*** shuyingya has joined #openstack-swift14:39
*** shuyingya has quit IRC14:44
*** gkadam has joined #openstack-swift14:45
*** tovin07_ has joined #openstack-swift14:52
*** klrmn has joined #openstack-swift14:59
*** gyee has joined #openstack-swift15:02
*** shuyingya has joined #openstack-swift15:03
timburkegood morning15:05
*** rcernin has quit IRC15:07
*** shuyingya has quit IRC15:08
*** cargreg has quit IRC15:12
openstackgerritAlistair Coles proposed openstack/swift master: Minor additions to TestPipeMutex  https://review.openstack.org/49424215:24
*** gkadam is now known as gkadam-afk15:24
*** baojg has quit IRC15:26
*** baojg has joined #openstack-swift15:27
*** cbartz has quit IRC15:27
*** oshritf has quit IRC15:29
*** gkadam-afk has quit IRC15:31
*** gkadam has joined #openstack-swift15:32
*** links has joined #openstack-swift15:33
tdasilvaoh cool, just realized mattoliverau is going to the PTG!15:45
acolestdasilva: yeah that's what I heard too :)15:46
*** links has quit IRC15:49
timburkeacoles: on https://review.openstack.org/#/c/493636/6/test/unit/common/test_utils.py@6389 -- that was kinda my fault. an older patchset had us clearing owner *before* writing to the pipe; this was my minimum test case demonstrating how that would be problematic15:52
patchbotpatch 493636 - swift - Fix deadlock when logging from a tpool thread.15:52
*** Sukhdev_ has joined #openstack-swift15:53
timburkein particular, with the owner being None, if pthread2 needed to reacquire the lock, it'd deadlock15:53
*** shuyingya has joined #openstack-swift15:56
*** pcaruana has quit IRC15:57
acolestimburke: OIC I added some assertions about owner here https://review.openstack.org/49424215:57
patchbotpatch 494242 - swift - Minor additions to TestPipeMutex15:57
acolestimburke: heh you already got there :)15:57
*** tovin07_ has left #openstack-swift16:02
*** shuyingya has quit IRC16:06
openstackgerritAlistair Coles proposed openstack/swift master: Minor additions to TestPipeMutex  https://review.openstack.org/49424216:08
*** klrmn has quit IRC16:17
notmynamegood morning16:19
*** tonanhngo has joined #openstack-swift16:19
*** itlinux has quit IRC16:22
*** xinli has joined #openstack-swift16:32
*** rcernin has joined #openstack-swift16:49
*** chsc has joined #openstack-swift16:51
*** chsc has joined #openstack-swift16:51
*** Sukhdev_ has quit IRC17:09
*** SkyRocknRoll has joined #openstack-swift17:14
*** klrmn has joined #openstack-swift17:18
*** hfaria_baculasys has quit IRC17:19
*** gkadam has quit IRC17:25
*** hseipp has quit IRC17:27
*** itlinux has joined #openstack-swift17:40
*** mvk_ has joined #openstack-swift17:54
*** mvk has joined #openstack-swift17:57
*** mkrcmari__ has quit IRC17:57
*** mvk_ has quit IRC17:59
*** ChubYann has joined #openstack-swift18:07
*** pcaruana has joined #openstack-swift18:09
*** geaaru has quit IRC18:17
*** mvk has quit IRC18:30
*** Sukhdev has joined #openstack-swift18:52
*** noxdafox_ has joined #openstack-swift18:52
*** noxdafox has quit IRC18:53
*** silor has joined #openstack-swift19:04
*** silor has quit IRC19:13
*** shuyingya has joined #openstack-swift19:35
*** vinsh_ has quit IRC19:40
*** shuyingya has quit IRC19:40
*** xinli has quit IRC19:41
*** Sukhdev has quit IRC19:43
*** rcernin has quit IRC19:55
*** Sukhdev has joined #openstack-swift20:13
*** mat128 has quit IRC20:17
*** oshritf has joined #openstack-swift20:26
*** pcaruana has quit IRC20:41
claygi'm ready - let's do this!20:50
notmynamewoooo!20:50
notmyname(in about 9 minutes)20:50
mattoliverauMorning20:51
*** lucasxu has quit IRC20:57
notmynamemeeting time21:00
notmynamenot sure if timburke will make it to the meeting or is sleeping off his new cold21:02
notmynamepatch 123421:04
patchbothttps://review.openstack.org/#/c/1234/ - tempest - Removing link doctoring in test_images (MERGED)21:04
*** oshritf has quit IRC21:05
openstackgerritSamuel Merritt proposed openstack/swift master: Fix deadlock when logging from a tpool thread.  https://review.openstack.org/49363621:10
torgomaticacoles: timburke: I've added the check to make sure you can't release someone else's lock, plus rolled in patch 494242.21:10
patchbothttps://review.openstack.org/#/c/494242/ - swift - Minor additions to TestPipeMutex21:10
*** SkyRocknRoll has quit IRC21:14
acolestorgomatic: ack. great work BTW21:20
torgomaticacoles: thanks21:20
*** catintheroof has quit IRC21:21
*** itlinux has quit IRC21:21
timburkejoeljwright: there's also a plan for a follow-up patch to have the tar headers get generated in middleware, yeah? might be handy for people to have a better idea of how the api feels21:48
joeljwrighttimburke: yeah, I'm working on an updated version that uses the current code21:49
joeljwrightI'll do my best to get it in a state people can see by the next meeting21:50
timburkeawesome, thanks! then i can put my money where my mouth is and see about what the diff would look like to have separate segment types :-)21:50
joeljwright:)21:54
acolesclayg: LOL "on principle"21:58
claygdid i spell it wrong...21:58
*** vinsh has joined #openstack-swift21:58
claygi need to afk - go team swift - hooray sam - 2.15.1 whoot!21:58
acolesno I just love the idea21:58
acolesclayg: ^^21:58
tdasilvamattoliverau: please send that PR on the swift-ansible work you did21:59
timburkelooking through some of my older patches, it'd be kinda nice to close out https://review.openstack.org/#/c/464216/ and https://review.openstack.org/#/c/464217/21:59
patchbotpatch 464216 - swift - domain_remap: be more careful about client-path ma...21:59
patchbotpatch 464217 - swift - domain_remap: stop mangling client-provided paths21:59
* kota_ is off to find breakfast22:00
* joeljwright is off for sleep22:00
*** joeljwright has quit IRC22:01
acolestimburke: clayg notmyname I  voted +2 on https://review.openstack.org/#/c/493636/ ... I lost track of whether we're leaving time for others to take a look so not +A'd but someone can do that while I sleep22:01
patchbotpatch 493636 - swift - Fix deadlock when logging from a tpool thread.22:01
notmynameacoles: thanks22:01
rlediseztimburke: i had cold feet on https://review.openstack.org/#/c/464217/ because of the "upgrade" issue. from what i remember, the default is breaking existing config, right? do we want to change the default value to avoid that?22:03
patchbotpatch 464217 - swift - domain_remap: stop mangling client-provided paths22:03
tdasilvanotmyname: I was quiet about joel's patch cause i haven't looked at the patch, but i was thinking more generally about our need to move faster. I've been thinking about tagging things beta or tech-preview, maybe it's something we can discuss at the PTG22:03
timburkerledisez: we could. i was thinking that it's enough of an edge case that most people would assume it was a bug rather than something intentional. but i suppose you may have more insight into how people use domain_remap?22:04
notmynametdasilva: yeah, that would be a good topic. we do a generally bad job at getting stuff landed22:05
timburketdasilva: i feel like the root problems for me are the fact that, at 50 rows per page, https://review.openstack.org/#/q/owner:tburke+is:open is up to two pages and https://review.openstack.org/#/q/reviewer:tburke+is:open is up to three22:09
timburkei've tried to find ways to make more-useful buckets (like https://review.openstack.org/#/q/owner:self+is:open+%2528label:Code-Review-1+OR+label:Verified-1+OR+label:Workflow-1%2529 ) but it's hard to keep things organized -- i always feel like stuffs falling through the cracks22:09
rlediseztimburke: you're probably right. i'll parse some logs tomorrow to see what users are doing on my clusters… i'll comment on review22:11
timburkethanks22:11
rlediseznow, sleep time for me22:11
rledisezbye22:11
timburkethat's fair :-) good night22:11
*** tonanhngo has quit IRC22:22
*** vint_bra has quit IRC22:53
*** patchbot has quit IRC23:17
timburkethanks mattoliverau! mind looking at https://review.openstack.org/#/c/461483/ too?23:18
*** notmyname has quit IRC23:19
mattoliverautimburke: sure np :)23:19
*** kei_yama has joined #openstack-swift23:20
*** notmyname has joined #openstack-swift23:23
*** ChanServ sets mode: +v notmyname23:23
*** patchbot has joined #openstack-swift23:23
*** chsc has quit IRC23:27
*** shuyingya has joined #openstack-swift23:37
mattoliverautimburke: done :)23:37
timburkethanks!23:37
timburkeand i *needed* to clean up the replica counts -- otherwise the check for unexpected requests would fail23:38
mattoliverauoh ok23:41
mattoliverauthen I eat my words23:41
*** shuyingya has quit IRC23:41

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!