Monday, 2019-11-11

*** mwheckmann has quit IRC01:17
*** nanzha has joined #openstack-swift01:17
*** spsurya has joined #openstack-swift01:18
*** nanzha has quit IRC03:21
*** nanzha has joined #openstack-swift03:21
*** mwheckmann has joined #openstack-swift03:24
*** psachin has joined #openstack-swift03:28
*** mwheckmann has quit IRC03:47
*** nanzha has quit IRC04:04
*** nanzha has joined #openstack-swift04:04
*** psachin has quit IRC05:10
*** nanzha has quit IRC05:23
*** nanzha has joined #openstack-swift05:27
*** rcernin has quit IRC07:08
*** nanzha has quit IRC07:10
*** nanzha has joined #openstack-swift07:17
*** ccamacho has joined #openstack-swift07:27
*** nanzha has quit IRC07:32
*** ccamacho has quit IRC07:39
*** tkajinam has quit IRC08:19
viks___hi, just wanted to know the default `max_clients = 1024` in proxy-server.conf is based on what? on what basis i should be setting this? any suggestions?08:25
*** ccamacho has joined #openstack-swift08:33
*** nanzha has joined #openstack-swift09:01
*** rcernin has joined #openstack-swift09:03
*** rcernin has quit IRC09:56
*** rcernin has joined #openstack-swift10:12
*** rcernin has quit IRC10:49
*** FlorianFa has quit IRC11:26
*** pcaruana has joined #openstack-swift11:47
*** pcaruana has quit IRC12:09
*** rcernin has joined #openstack-swift12:17
*** rcernin has quit IRC12:44
rledisezhi viks___, if you want to increase it, don't forget to increase the system limit of file descriptor (ulimit -n)13:13
viks___rledisez:  Ok... but what can be the max value for it ? is there any limit ? or based on system load i should be increasing it? Any suggestions?13:15
viks___like workers, we set based on the cores, similarly is there any dependent thing for max_clients?13:17
rledisezviks___: I can't tell if there is a limit, but there is certainly one. you should check for stats like load, ttfb and logs like timeout before increasing it blindly14:14
viks___rledisez: ok.. thanks14:35
*** mwheckmann has joined #openstack-swift15:04
*** renich has joined #openstack-swift15:24
renichGood day15:25
renichI am having these recurring messages: https://paste.centos.org/view/56ab8b41. The odd thing is that this is a newly installed cluster and the referenced containers are from an account that doesn't list when I: openstack user list.15:27
DHEaccounts in swift are actually from projects, not individual users15:28
renichDHE: Oh, OK.15:29
DHEthat way multiple users can share a resource while each having their own login credentials, or a single user can be granted multiple resources that don't entirely overlap with other users, etc.15:29
DHEthis is basically how openstack as a whole works, the project owns the resources rather than the user15:30
renichDHE: so, it is there. It's admin.15:30
renichDHE: in any case, how do I prevent those errors?15:30
DHEsounds like you need accounts to be auto-created. that's an option in the proxy server15:30
renichOK. Let me check.15:31
renichaccount_autocreate = true15:31
renichit is set15:31
renichAny other idea of how to fix that?15:40
tdasilvawhat about the option `allow_account_management` ?15:43
renichtdasilva: chekcing15:46
renichtdasilva: that wasn't there. Setting it to true.15:47
renichtdasilva: after setting that up and restarting swift-account-server, the error keeps appearing15:51
tdasilvarenich: do you see any log message with the strings: "autocreate account" ?15:57
renichtdasilva: chekcing16:00
renichjournalctl | grep autocreate turned out nothing tdasilva16:00
renichI keep misspelling checking, hehe.16:04
tdasilvarenich: mm...not sure actually, are you able to HEAD this account? or what about `swift-account-info` ?16:16
*** nanzha has quit IRC16:16
renichtdasilva: let me check16:17
renichtdasilva: what do you mean HEAD the account? curl -X HEAD? In any case, swift stat works.16:18
renichswift-account-info asks for a path to a DB. Let me read the man, tdasilva16:19
tdasilvaah, `swift stat` is the same as HEAD request16:19
tdasilvaswift-account-info needs the path to the account ring and then just the account name16:20
tdasilvarenich: sorry, got cmds confused...i meant to say swift-get-nodes16:20
renichtdasilva: OK16:20
renichtdasilva: https://paste.centos.org/view/a010bede16:22
tdasilvarenich: your account ring has only 1 replica? also the other log seemed to be trying to PUT a container in account `AUTH_c6b9b19aa06d4b41ad2a78f376a1fe88`, no?16:24
renichtdasilva: yep.16:32
renichtdasilva: what do you mean about trying to PUT in that account?16:35
tdasilvarenich: the error you posted earlier, show's a PUT error for 3 different containers, for example: ERROR __call__ error with PUT /swift-devices/807/AUTH_c6b9b19aa06d4b41ad2a78f376a1fe88/container116:36
renichtdasilva: right.16:37
tdasilvaand the account server responds with the error: "I can't put this container in this account, I don't have a db for it"16:37
renichtdasilva: exactly16:37
tdasilvano i'm not sure why this account wasn't auto created or why the db can't be found16:38
tdasilvas/no/now16:38
renich... OK.16:38
renichI am worse off. I don't know :D16:38
tdasilvarenich: which account are you using? AUTH_c6b9b19aa06d4b41ad2a78f376a1fe88 or admin?  what does `swift stat --debug` show for the curl commands? what command did you run to get those PUT failures? `swift post container1`?16:43
renichadmin16:44
renichtdasilva:  https://paste.centos.org/view/ab021dae16:44
renichbtw, I tested the demo account and, that one, works fine (I can create and delete containers) but not in admin... pretty odd.16:44
*** pcaruana has joined #openstack-swift16:45
tdasilvayeah16:45
renichtdasilva: openstack container create test16:45
tdasilvaand what did you get from `swift-get-nodes -a <account_ring_path> AUTH_c6b9b19aa06d4b41ad2a78f376a1fe88` the first node it returns with, can you check if the db is there?16:47
renichhttps://paste.centos.org/view/a148a0a616:48
renichit seems /srv/node/swift-devices/accounts is empty in 10.0.176.12216:50
tdasilvarenich: can you see if you find the db in the other handoff nodes? also is 10.0.176.122 the same node where you saw these errors: https://paste.centos.org/view/56ab8b41#L3 ?16:56
renichtdasilva: man, I am sorry but I gotta leave for now. I'll leave my IRC client open. Thanks a lot for the help, btw!16:57
tdasilvarenich: ok, sorry i couldn't help much16:57
tdasilvaor at all16:57
renichtdasilva: no, it's not the same one. And, yes, I will see if I can find the DB in other nodes.16:57
renichtdasilva: on the contrary, thanks a lot!16:57
tdasilvacheck you have the same rings everyhere16:58
tdasilvaswift-recon --md516:58
tdasilvasee ya16:58
renichtdasilva: now, I know there are nodes that work and nodes that don't. demo is on 123 and it works.16:58
renichtdasilva: I will. Thanks a ton!16:58
tdasilvayeah,you probably have different rings16:58
renichtdasilva: I think you nailed it!16:58
renichhttps://paste.centos.org/view/ef45c10116:59
renichtdasilva: thank you very much! You rock!16:59
tdasilvarenich: yw :)17:00
*** pcaruana has quit IRC18:57
*** pcaruana has joined #openstack-swift18:58
*** henriqueof has joined #openstack-swift19:35
*** spsurya has quit IRC21:07
*** renich has quit IRC21:36
*** ormandj has quit IRC21:38
*** pcaruana has quit IRC21:42
mattoliveraumorning, and yes tdasilva definitely rocks! :)22:15
*** mwheckmann has quit IRC22:28
*** rcernin has joined #openstack-swift22:58
*** tkajinam has joined #openstack-swift23:01

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!