Wednesday, 2017-12-27

« Tuesday, 2017-12-26 Index Thursday, 2017-12-28 »
*** itlinux has quit IRC00:25
*** tovin07_ has joined #openstack-swift01:03
*** links has joined #openstack-swift01:14
*** links is now known as Jaison|away01:14
*** itlinux has joined #openstack-swift01:33
*** cshastri_ has joined #openstack-swift01:48
*** psachin has joined #openstack-swift01:55
*** itlinux has quit IRC02:05
*** itlinux has joined #openstack-swift02:09
*** itlinux has quit IRC02:28
*** itlinux has joined #openstack-swift02:36
*** itlinux has quit IRC03:38
*** itlinux has joined #openstack-swift04:31
*** itlinux has quit IRC04:31
*** itlinux has joined #openstack-swift04:48
*** itlinux has quit IRC04:53
*** fungi has quit IRC05:23
*** itlinux has joined #openstack-swift05:40
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Fix InternalClient to drain response body if the request fails  https://review.openstack.org/53017505:44
openstackgerrityanwei proposed openstack/swift master: fix the swift-ring-builder's default command raises exception in command line environment  https://review.openstack.org/52979105:47
openstackgerrityanwei proposed openstack/swift master: fix the swift-ring-builder's default command raises exception in command line environment  https://review.openstack.org/52979105:52
*** fungi has joined #openstack-swift05:52
openstackgerrityanwei proposed openstack/swift master: fix the swift-ring-builder's default command raises exception in command line environment  https://review.openstack.org/52979105:54
*** SkyRocknRoll_ has joined #openstack-swift06:10
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Fix InternalClient to drain response body if the request fails  https://review.openstack.org/53017507:19
*** itlinux has quit IRC07:33
*** cbartz has joined #openstack-swift08:12
*** gkadam has joined #openstack-swift08:14
openstackgerrityanwei proposed openstack/swift master: fix the swift-ring-builder's default command raises exception in command line environment  https://review.openstack.org/52979108:31
*** kei_yama has quit IRC08:34
*** silor has joined #openstack-swift08:39
*** SkyRocknRoll has quit IRC09:29
*** Jaison|away has quit IRC09:32
*** cbartz has quit IRC09:41
*** SkyRocknRoll has joined #openstack-swift09:43
*** links has joined #openstack-swift09:49
*** cshastri_ has quit IRC10:09
*** tovin07_ has quit IRC10:14
kota_OK, let's finish up the last working day of this year.10:29
kota_thx, all swifters. Hope everyone will get great new year.10:30
kota_See you10:30
*** links has quit IRC11:25
*** links has joined #openstack-swift11:39
*** links has quit IRC12:49
*** gun1x has joined #openstack-swift13:46
gun1xhey guys13:46
gun1xhttps://docs.openstack.org/swift/pike/install/initial-rings.html13:46
gun1xhow come only management IP address is required?13:46
gun1xwhy not storage ip address?13:47
*** SkyRocknRoll_ has quit IRC14:24
*** cshastri_ has joined #openstack-swift14:31
*** ahale has quit IRC14:51
*** ahale has joined #openstack-swift14:59
*** cshastri_ has quit IRC15:13
notmynamegood morning15:37
*** cshastri_ has joined #openstack-swift15:38
*** psachin has quit IRC15:43
notmynamegun1x: yeah, that looks...odd15:44
notmynamegun1x: I think it's likely a holdover from when that doc was moved from a different location. the "management interface" doesn't make sense15:45
notmynamegun1x: you should use the IP address on the storage network. one that's routable from your proxy servers and other storage nodes (and should be isolated from other traffic)15:46
*** d0ugal has joined #openstack-swift15:48
*** d0ugal has quit IRC15:49
notmynamegun1x: at the top of that page, there's a bug icon. if you click that, you can easily file a bug against that docs page, and we'll be sure to fix it15:49
*** d0ugal has joined #openstack-swift15:49
*** d0ugal has quit IRC15:49
*** d0ugal has joined #openstack-swift15:49
*** itlinux has joined #openstack-swift15:52
*** cshastri_ has quit IRC15:58
*** itlinux has quit IRC16:00
gun1xnotmyname: do you know how i can turn on logging for swift?16:08
gun1xi got to some really strange errors16:08
gun1xhttps://bpaste.net/show/e7e7fabc063216:09
notmynamegun1x: all the swift processes log directly to syslog. each process is configured separately. eg https://github.com/openstack/swift/blob/master/etc/account-server.conf-sample#L19-L4216:31
gun1xnotmyname: so that means that in my case the error will be on the swift nodes, not on controller (Where swift-proxy is)16:33
gun1xnotmyname: and they should be present in syslog if i don't have any different config16:33
notmynamecorrect16:33
zaitcevHe is going to learn that journald intercepts syslog, isn't he16:34
notmynamehere's some docs on that from the dev environment https://docs.openstack.org/swift/latest/development_saio.html#optional-setting-up-rsyslog-for-individual-logging16:35
gun1xnotmyname: https://bpaste.net/show/72c3cc1ed5b516:35
gun1xzaitcev: can i get any additional information from journald?16:35
zaitcevgun1x: your ports are confused up. Make sure that your account ring contains ports where account server _actually_ listens. They must match up with what's in your account-server.conf. Same for container and object.16:36
zaitceve.g. 6200 for object, 6201 for container, 6202 for account16:37
zaitcevno, wait, never mind that16:37
gun1x6200 is object, 6201 is container, 6202 is account16:37
zaitcevit must be account updater...16:37
gun1xhttps://bpaste.net/show/95a45a723e3e\16:38
gun1xhttps://bpaste.net/show/95a45a723e3e16:38
gun1xbtw, even if osa is there in servere name, this is actually a manual install. i had a good setup with osa, but trove doesn't work on osa atm, so i tried to do everything from zero16:39
gun1xand now i am the part where i configure swift becasue trove needs it ...16:39
zaitcevwell, the thing is why vdd/650 is for account, but when the update comes it's vdd/180? I guess it's one of those confusions. Maybe rings mismatch between nodes.16:39
zaitcevgun1x: netstat looks fine, but what does  "swift-ring-builder container.builder"  return?16:41
gun1xwhat's the difference between 650 and 180?16:42
gun1xyou are right, this is messed up16:43
gun1xi fucked up the ports when i created the rings16:43
zaitcevAh, okay.16:43
gun1xhttps://bpaste.net/show/01bd293b737416:44
gun1xthank you, this was a lot of help16:44
gun1xso know i have to add proper ports on the rings, rebalance, move the .gz files to the controller node and it should work16:44
gun1xright?16:44
zaitcevYes, it should.16:48
zaitcevso, here's what update looks like16:49
zaitcevDec 27 11:44:33 rhev-a24c-02 account-server: 192.168.50.4 - - [27/Dec/2017:16:44:33 +0000] "PUT /b2/105937/AUTH_zaitcev/testcont" 201 - "PUT http://192.168.50.4:6001/d3/120288/AUTH_zaitcev/testcont" "tx91278952e6e04b3e91ff7-005a43cdf1" "container-server 31966" 0.0037 "-" 18324 016:49
zaitcevBut in your case proxy tried to talk to account server with a path of container, e.g.16:49
zaitcevDec 27 17:31:27 osa-swift account-server: 172.29.236.11 - - [27/Dec/2017:15:31:27 +0000] "PUT /vdd/180/AUTH_4ee83088930c48ada47f9eab835c1f72/container1" 404 - "PUT http://osa-controller:8080/v1/AUTH_4ee83088930c48ada47f9eab835c1f72/container1" "tx5428cf54b32d433ea4e0d-005a431924" "proxy-server 8259" 0.0001 "-" 18558 -16:50
zaitcevthat is not allright, so I thought ports were confused somewhere16:50
zaitcevUsually when people do that, a 400 comes out16:51
zaitcevHowever, as it happens, the account server can accept one more path. It thinks it's an update, but it goes for a partition where there's no account in your case, the 180, and produces 40416:52
zaitcevwell, that's a postfactum stretching of theory to explain the facts16:52
gun1xzaitcev: thank you, this information is usefull16:53
gun1xas you can tell, i am a noob at swift. it's easy to deploy it with OSA... :D16:53
gun1xzaitcev: i trained mostly for ceph but i need swift atm for this project16:53
gun1xand i got stuck on manual install16:53
gun1xand i am on deadline to deliver some POCs ...16:53
zaitcevRight. I know the feeling, because I had to deal with Ceph a little and it was like "whyyyyy is the health is not healthy, I added enough OSDs didn't"16:54
gun1xzaitcev: yea, exactly. and the biggest pain will be that kubernetes bare metal will probably take over, so if that happens we have to learn a new set of tools16:55
*** gkadam has quit IRC17:02
*** d0ugal has quit IRC17:15
*** d0ugal has joined #openstack-swift17:31
*** d0ugal has quit IRC17:37
*** d0ugal has joined #openstack-swift17:39
*** d0ugal has quit IRC17:48
*** silor has quit IRC18:01
*** d0ugal has joined #openstack-swift18:09
*** silor has joined #openstack-swift18:44
gun1xzaitcev: can't remove the containers and objects: There are no devices in this ring, or all devices have been deleted18:51
gun1x--force doesn't work :D18:51
gun1xhttps://bpaste.net/show/994006e6aa5e18:54
gun1xthank got this is just a test environment :D18:54
*** itlinux has joined #openstack-swift19:04
*** nottrobin has quit IRC19:12
*** DuncanT has quit IRC19:13
*** clayg has quit IRC19:13
*** jungleboyj has quit IRC19:13
*** hogepodge has quit IRC19:13
*** samueldmq has quit IRC19:13
*** AndyWojo has quit IRC19:13
*** amito has quit IRC19:13
*** ying_zuo has quit IRC19:13
*** portdirect has quit IRC19:13
*** robcresswell has quit IRC19:14
*** cargonza has quit IRC19:14
*** kong has quit IRC19:14
*** serverascode has quit IRC19:14
*** fyxim has quit IRC19:14
*** zhongjun has quit IRC19:15
gun1xzaitcev: nevermind, i am rebuilding this node from scratch\19:22
*** itlinux has quit IRC19:32
*** itlinux has joined #openstack-swift19:35
*** jungleboyj has joined #openstack-swift19:37
notmynamegun1x: any luck?19:38
*** kong has joined #openstack-swift19:40
*** fyxim has joined #openstack-swift19:40
*** samueldmq has joined #openstack-swift19:40
*** AndyWojo has joined #openstack-swift19:43
*** cargonza has joined #openstack-swift19:43
*** serverascode has joined #openstack-swift19:43
*** DuncanT has joined #openstack-swift19:44
*** nottrobin has joined #openstack-swift19:44
*** clayg has joined #openstack-swift19:48
*** ChanServ sets mode: +v clayg19:48
*** hogepodge has joined #openstack-swift19:52
*** linkmark has joined #openstack-swift20:10
openstackgerritClay Gerrard proposed openstack/swift master: Handle EmptyRingError in swift-ring-builder's default command  https://review.openstack.org/52979120:15
openstackgerritClay Gerrard proposed openstack/swift master: Display more info on empty rings  https://review.openstack.org/53025820:15
*** portdirect has joined #openstack-swift20:15
*** SkyRocknRoll has quit IRC20:15
*** silor has quit IRC20:49
openstackgerritTim Burke proposed openstack/swift master: Have check_drive raise ValueError on errors  https://review.openstack.org/50434121:07
claygfor patch 530175 I worry there might be situations where internal client's retry logic might consume a huge body without anyway for the caller to control the behavior21:30
patchbothttps://review.openstack.org/#/c/530175/ - swift - Fix InternalClient to drain response body if the r...21:30
*** robcresswell has joined #openstack-swift21:30
clayg... if that case came up I'd have been happier just logging the 499 (which is somewhat "harmless" if not particularly interesting/useful)21:30
*** amito has joined #openstack-swift21:31
*** ying_zuo has joined #openstack-swift21:32
*** zhongjun has joined #openstack-swift21:32
notmynamemattoliverau: in america, if one refers to "pie", everyone thinks of stuff like https://www.google.com/search?q=pie&client=safari&rls=en&tbm=isch&source=lnt&tbs=isz:l&sa=X&ved=0ahUKEwivsrfnkqvYAhVD_mMKHfRpCmAQpwUIIA&biw=1470&bih=1064&dpr=1#imgrc=A1DwFKj-jdPXaM:21:40
notmynamemattoliverau: is it the same in australia, or is there a different common understanding of "pie"?21:40
notmyname(eg american vs brittish "pudding")21:40
claygI'm probably going to have to block out some time to review patch 50780821:58
patchbothttps://review.openstack.org/#/c/507808/ - swift - Add ability to undelete an account.21:58
claygmaybe Friday21:58
openstackgerritTim Burke proposed openstack/swift master: Better mock out OSErrors in test_replicator before raising them  https://review.openstack.org/49643322:14
mattoliveraunotmyname: yeah, depends on context. If you were talking about desert then sure, an Aussie would think of a sweet pie like apple.. but if you just said pie, a savoury meat pie is what an Aussie would think of https://goo.gl/images/yA7jnF22:18
notmynamemattoliverau: ah. an important distinction. my MCA talk on swift uses the word "pie", so I'm just trying to make sure I have the right cultural context :-)22:18
mattoliverauYeah, by default Oz is meat pie ;)22:29
claygthat sounds delicious!22:30
openstackgerritTim Burke proposed openstack/swift master: container sync: reraise properly, don't log traceback for ClientExceptions  https://review.openstack.org/49651722:45
*** kei_yama has joined #openstack-swift23:24
*** itlinux has quit IRC23:49
claygtimburke: well I tried to +2 patch 49651723:54
patchbotConnectionError: HTTPSConnectionPool(host='review.openstack.org', port=443): Max retries exceeded with url: /changes/496517 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7f69983fc210>: Failed to establish a new connection: [Errno 101] Network is unreachable',)) (file "/usr/local/lib/python2.7/dist-packages/requests/adapters.py", line 467, in send)23:54
claygrofl23:54
*** openstackgerrit has quit IRC23:54
timburkehahahaha23:54
« Tuesday, 2017-12-26 Index Thursday, 2017-12-28 »

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!