Friday, 2018-04-06

notmynamemattoliverau: welcome back! hope everything is good00:06
mattoliveraunotmyname: yeah, the hospital visit was great, heard the baby's heart, midwifes we're awesome. Better then the local hospital.. but a little far away. If everything goes well wont need to do another drive up there until week 30 something.. so not for quite a while :)00:08
notmynameglad to hear it00:08
notmynamewhenever you get a chance, read over the meeting notes from yesterday00:09
mattoliveraunow need to go through a bunch of emails and missed meeting minutes etc ;)00:09
mattoliverauwill do.00:09
openstackgerritSamuel Merritt proposed openstack/swift master: Don't dump recon stats when replicating only certain policies  https://review.openstack.org/55919800:13
*** d0ugal has quit IRC00:13
*** d0ugal has joined #openstack-swift00:17
openstackgerritTim Burke proposed openstack/swift feature/deep: Merge branch 'master' into feature/deep  https://review.openstack.org/55917500:33
openstackgerritSamuel Merritt proposed openstack/swift master: Refactor replicator command-line-argument handling  https://review.openstack.org/55920200:42
*** tovin07_ has joined #openstack-swift00:45
openstackgerritClay Gerrard proposed openstack/swift feature/deep: Fix intermittent failing probetest  https://review.openstack.org/55920701:01
claygdid I break gerrit?01:03
*** mikecmpbll has quit IRC01:11
kota_good morning01:19
kota_clayg: which one is broken?01:20
mattoliveraukota_: morning01:25
mattoliverauclayg: I wouldn't put it past you :P01:25
*** cshastri has joined #openstack-swift01:25
kota_mattoliverau: o/01:25
claygno it's good - it started working01:25
claygit was probably my internet or computer or something - who knows01:25
kota_good to hear01:36
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/s3api: Change sysmeta name from swift3 to s3api  https://review.openstack.org/55762301:41
*** germs has quit IRC02:23
*** germs has joined #openstack-swift02:24
openstackgerritMerged openstack/swift feature/deep: Move misplaced objects when cleaving  https://review.openstack.org/55754702:44
*** psachin` has joined #openstack-swift02:49
openstackgerritMerged openstack/swift feature/deep: Merge branch 'master' into feature/deep  https://review.openstack.org/55917503:35
*** armaan has quit IRC03:45
*** armaan has joined #openstack-swift03:46
*** links has joined #openstack-swift03:48
*** kei_yama has quit IRC03:57
*** SkyRocknRoll has joined #openstack-swift04:00
*** kei_yama has joined #openstack-swift04:02
*** rcernin has quit IRC04:04
*** germs has quit IRC04:07
*** rcernin has joined #openstack-swift04:19
*** armaan has quit IRC04:43
*** armaan has joined #openstack-swift04:52
*** geaaru has quit IRC05:16
*** gkadam_ has joined #openstack-swift05:48
*** jistr has quit IRC06:30
*** cbartz has joined #openstack-swift06:30
*** jistr has joined #openstack-swift06:32
*** gkadam_ has quit IRC06:42
*** gkadam has joined #openstack-swift06:42
*** ccamacho has quit IRC06:43
*** hseipp has joined #openstack-swift06:46
*** pcaruana has joined #openstack-swift06:47
*** ccamacho has joined #openstack-swift06:53
*** silor has joined #openstack-swift07:11
*** SkyRocknRoll has quit IRC07:13
*** tesseract has joined #openstack-swift07:20
*** SkyRocknRoll has joined #openstack-swift07:26
openstackgerritNguyen Hai proposed openstack/python-swiftclient master: Remove py34 from envlist in tox.ini  https://review.openstack.org/55342907:27
*** armaan has quit IRC07:33
*** armaan has joined #openstack-swift07:33
*** threestrands has quit IRC07:36
*** rcernin has quit IRC07:37
*** geaaru has joined #openstack-swift07:49
openstackgerritMerged openstack/swift master: Respect X-Backend-Etag-Is-At headers from left of SLO  https://review.openstack.org/55668307:55
*** armaan has quit IRC08:08
*** armaan has joined #openstack-swift08:08
acolesgood morning08:10
* acoles hugs clayg for https://review.openstack.org/55920708:33
patchbotpatch 559207 - swift (feature/deep) - Fix intermittent failing probetest08:33
*** armaan has quit IRC08:49
*** armaan has joined #openstack-swift08:50
*** gkadam has quit IRC08:52
*** gkadam has joined #openstack-swift08:53
*** mikecmpbll has joined #openstack-swift09:06
openstackgerritMerged openstack/swift master: Support unicode characters in tempauth user names.  https://review.openstack.org/55897409:38
*** StevenK has quit IRC09:39
*** StevenK has joined #openstack-swift09:42
*** armaan has quit IRC09:42
*** armaan has joined #openstack-swift09:43
*** silor1 has joined #openstack-swift09:54
*** silor has quit IRC09:55
*** silor1 is now known as silor09:55
*** kei_yama has quit IRC10:04
*** armaan has quit IRC10:23
*** armaan has joined #openstack-swift10:24
*** cshastri has quit IRC10:27
*** jistr has quit IRC10:27
*** armaan has quit IRC10:28
*** armaan has joined #openstack-swift10:28
*** tovin07_ has quit IRC10:32
*** jistr has joined #openstack-swift10:36
*** tesseract has quit IRC10:37
*** tesseract has joined #openstack-swift10:38
*** gkadam has quit IRC10:47
*** tesseract-RH has joined #openstack-swift10:59
*** tesseract has quit IRC10:59
*** cshastri has joined #openstack-swift11:13
*** silor has quit IRC11:21
*** armaan has quit IRC11:54
*** jistr is now known as jistr|mtg12:02
*** armaan has joined #openstack-swift12:05
*** cshastri has quit IRC12:26
*** jistr|mtg is now known as jistr12:31
*** NM has joined #openstack-swift12:38
*** armaan has quit IRC12:39
*** armaan has joined #openstack-swift12:39
*** armaan_ has joined #openstack-swift12:42
*** armaan_ has quit IRC12:44
*** armaan_ has joined #openstack-swift12:45
*** armaan has quit IRC12:45
acolesclayg: thanks for updating trello! I have been moving completed cards to the *top* of the completed column by dragging, so its easier to see recent activity.12:50
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Shard range updates should not revive deleted container  https://review.openstack.org/55932413:00
acolestimburke: should stop deleted sharded containers coming back from the dead ^^13:00
*** frickler has joined #openstack-swift13:15
*** armaan_ has quit IRC13:20
*** psachin` has quit IRC13:28
*** links has quit IRC13:28
*** gkadam has joined #openstack-swift13:30
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Shard range updates should not revive deleted container  https://review.openstack.org/55932413:48
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Remove support for ShardRange PUT via headers  https://review.openstack.org/55933613:48
ccamachoHey guys!!13:59
ccamachoYesterday I was getting some information to push some big files to swift using service.py14:00
ccamachoI managed to do it, but now Ill need to be able to download those files..14:00
ccamachothis is the result of my last test14:00
ccamachohttps://paste.fedoraproject.org/paste/V0JsXVqkYuj~XQb0HaN3MA14:00
ccamachocan anyone if having some cycles tell me how to download the big file uploaded (6GB) instead of the manifest with all the segments?14:01
ccamachoin the paste there is a better description14:01
*** ukaynar has joined #openstack-swift14:02
DHEif you're downloading the manifest instead of the big file, it means you didn't upload the manifest correctly14:02
DHEoh, never mind you're not downloading the file "normally"...14:04
ccamachoDHE aa ok the usual way for me is using `openstack container save  undercloud-backupsasdf`14:05
ccamachoyou can't add the file name14:06
ccamachomaybe there is another CLI option to get it correctly?14:06
DHEI'm using the direct swift API, where I access http://proxyip:8080/v1/ACCOUNTNAME/CONTAINERNAME/OBJECTNAME and the manifest will be processing swift-side and produce the 6 GB file for me...14:10
*** germs has joined #openstack-swift14:10
*** germs has quit IRC14:11
*** germs has joined #openstack-swift14:11
ccamachoi.e. from docs (https://docs.openstack.org/swift/latest/overview_large_objects.html)14:11
ccamachoSo now, the following swift command would download the entire large object: swift download test_container large_file14:11
ccamachoBut,14:11
ccamacho(undercloud) [stack@undercloud kk]$ swift download undercloud-backupsasdf asdf.tar.gz14:11
ccamachoasdf.tar.gz [auth 3.399s, headers 3.787s, total 3.788s, 0.003 MB/s]14:11
ccamacho(undercloud) [stack@undercloud kk]$ ls -ltah14:11
ccamachototal 8.0K14:11
ccamachodrwx------.  2 stack stack   25 Apr  6 14:09 .14:11
ccamacho-rw-rw-r--.  1 stack stack 1019 Apr  6 13:47 asdf.tar.gz14:11
ccamachodrwx------. 14 stack stack 4.0K Apr  6 12:47 ..14:11
ccamachoDHE^ so there is no CLI option to get it?14:11
ccamachoI have upstream master deployed for testing14:12
DHEsorry I don't use those programs myself enough to tell you. it was my fault for not reading the paste completely before I replied14:12
ccamachohey DHE no worries :)14:15
*** germs has quit IRC14:15
*** armaan has joined #openstack-swift14:26
*** armaan has quit IRC14:30
*** armaan has joined #openstack-swift14:49
*** gkadam_ has joined #openstack-swift14:51
*** gkadam has quit IRC14:53
*** SkyRocknRoll has quit IRC14:55
*** SkyRocknRoll has joined #openstack-swift15:09
tdasilvaqq for ops, how do you usually health check background services? i.e., auditor, replication, updater, etc...15:09
*** gkadam_ has quit IRC15:10
tdasilvamlanner, rledisez_, onovy ^^^15:10
*** armaan has quit IRC15:11
*** armaan has joined #openstack-swift15:11
*** armaan has quit IRC15:18
*** armaan has joined #openstack-swift15:33
*** openstackgerrit has quit IRC15:33
*** cbartz has quit IRC15:36
notmynamegood morning15:38
rledisez_tdasilva: tough question ;) we mainly rely on stats (number of unlined async_pending, number of removed partitions, …) and logs (we push stacks to a log plateform and watch the "top stacks"). For now, this "log" thing is only a POC on few servers but want to deploy it massively for every swift processes15:42
*** pcaruana has quit IRC15:49
*** armaan has quit IRC15:53
*** mikecmpbll has quit IRC16:04
*** germs has joined #openstack-swift16:11
*** germs has quit IRC16:11
*** germs has joined #openstack-swift16:11
*** germs has quit IRC16:16
*** hseipp has quit IRC16:24
*** germs has joined #openstack-swift16:30
*** germs has quit IRC16:30
*** germs has joined #openstack-swift16:30
*** germs has quit IRC16:30
*** germs has joined #openstack-swift16:31
*** germs has quit IRC16:31
*** germs has joined #openstack-swift16:31
*** armaan has joined #openstack-swift16:44
timburkeccamacho: what headers do you get on download? might be able to tack on a `--debug` to see; i'm not as familiar with the openstack cli behavior16:57
*** links has joined #openstack-swift16:57
timburkeand as a sanity check, what's your proxy-server pipeline look like?16:57
ccamachohey timburke thanks for the reply, the issue is fixed now, it was because uploading big files in the undercloud is disabled by default (enabled now in the proxy-server pipeline)16:58
timburkeah, good. glad you figured it out :-)16:58
ccamachonow to be fixed here https://review.openstack.org/#/q/topic:bug/176141216:58
ccamachotimburke but thanks for asking!16:59
ccamacho:)16:59
timburkei keep meaning to have service.py go grab /info to check the server capabilities so it can do smarter things... but i also don't really want to incur an extra request every time you try to do something on the cli... really makes me wish we had somewhere to cache the results or something17:04
timburke("smarter things" in this case being "raise an exception explaining that SLO isn't available")17:05
*** openstackgerrit has joined #openstack-swift17:05
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Prevent pending file flushing to retiring db  https://review.openstack.org/55862517:05
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Only redirect updates originating from the updater  https://review.openstack.org/55862617:05
*** links has quit IRC17:06
*** links has joined #openstack-swift17:08
*** SkyRocknRoll has quit IRC17:19
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Remove support for ShardRange PUT via headers  https://review.openstack.org/55933617:20
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Shard range updates should not revive deleted container  https://review.openstack.org/55932417:20
*** armaan has quit IRC17:20
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Remove EXPANDING state  https://review.openstack.org/55823217:28
*** tesseract-RH has quit IRC17:35
*** SkyRocknRoll has joined #openstack-swift17:36
*** geaaru has quit IRC17:51
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Remove unnecessary conditional case in get_shard_usage()  https://review.openstack.org/55939117:58
*** armaan has joined #openstack-swift18:02
*** armaan has quit IRC18:11
*** silor has joined #openstack-swift18:17
*** SkyRocknRoll has quit IRC18:29
tdasilvarledisez_: thanks! btw: the reason for the question is that we are containerizing swift services and IIUC, docker containers has a healthcheck instruction that we are trying to make use of...18:33
openstackgerritSamuel Merritt proposed openstack/swift master: Make multiprocess replicator's logs more readable  https://review.openstack.org/55666518:44
*** ukaynar has quit IRC18:45
*** NM has quit IRC19:17
*** NM has joined #openstack-swift19:32
*** geaaru has joined #openstack-swift19:38
openstackgerritSamuel Merritt proposed openstack/swift master: Don't dump recon stats when replicating only certain policies  https://review.openstack.org/55919819:39
*** ukaynar has joined #openstack-swift19:41
openstackgerritSamuel Merritt proposed openstack/swift master: Refactor replicator command-line-argument handling  https://review.openstack.org/55920219:47
onovytdasilva: i'm crawling recon by own script and creating graph of all metrics19:49
onovytdasilva: and have limits on some of them, for example replicator time19:50
*** ukaynar has quit IRC19:54
*** ukaynar has joined #openstack-swift20:01
tdasilvaonovy: thanks20:12
onovynp20:12
notmynametdasilva: answering for mlanner, we check via combination of recon stats and collectd metrics20:14
tdasilvanotmyname: thanks...i'm wondering if for this purpose, swift-orphans might work better20:19
openstackgerritSamuel Merritt proposed openstack/swift master: Make multiprocess reconstructor's logs more readable.  https://review.openstack.org/55799520:19
tdasilvasince the point of docker healthcheck is to make sure the process is running as expected...idk...20:19
notmynameyeah, definitately20:19
notmynamewe've got our own agent that checks to see if a process exists. IIRC we use the presence of logs, metrics, etc for determining if it's healthy20:20
tdasilvait's really at the process level check, as swift-recon is really looking at all (replicator) processes across the cluster...20:20
torgomatictdasilva: my company also has a WSGI healthcheck that runs a GET request through the account/container/object server. You've got to be careful with your 404 handling because of race conditions, but it's a pretty decent healthcheck20:20
tdasilvatorgomatic: yeah, planning to use that for those services...20:21
tdasilvait's just that the background services don't have that20:21
torgomatictrue that20:21
*** paramite has joined #openstack-swift20:22
tdasilvathanks guys!!20:22
tdasilvahave a great weekend20:22
torgomaticyou too20:23
*** links has quit IRC20:28
*** silor has quit IRC20:44
*** paramite has quit IRC21:01
*** zaitcev has quit IRC21:01
*** itlinux has joined #openstack-swift21:03
*** itlinux has quit IRC21:18
*** ukaynar has quit IRC21:41
openstackgerritMerged openstack/swift feature/deep: Fix intermittent failing probetest  https://review.openstack.org/55920722:29
openstackgerritMerged openstack/swift feature/deep: Remove support for ShardRange PUT via headers  https://review.openstack.org/55933622:32
openstackgerritMerged openstack/swift feature/deep: Remove unnecessary conditional case in get_shard_usage()  https://review.openstack.org/55939122:32
*** mikecmpbll has joined #openstack-swift23:13
*** NM has quit IRC23:18
*** mikecmpbll has quit IRC23:22
*** itlinux has joined #openstack-swift23:39

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!