Tuesday, 2017-03-07

claygtimburke: in patch 442208 was the sphinx bump... required?  desired?00:01
patchbothttps://review.openstack.org/#/c/442208/ - swift - Make Sphinx treat warnings as errors00:01
claygI don't know why we had it pinned in the frist place00:01
timburkeclayg: required. new option was introduced in 1.5.000:01
timburkei'm assuming it was capped because it used to be capped in g-r00:02
*** sams-gleb has quit IRC00:04
timburkeblame seems to confirm that? https://github.com/openstack/swift/commit/9a2bd79 -> https://github.com/openstack/swift/commit/c0217a4 -> https://github.com/openstack/swift/commit/396baf400:05
*** _JZ_ has quit IRC00:06
*** vills has quit IRC00:07
*** vills has joined #openstack-swift00:07
*** vills has quit IRC00:08
*** delatte has quit IRC00:13
*** dmorita has joined #openstack-swift00:13
*** dmorita_ has joined #openstack-swift00:14
*** dmorita has quit IRC00:14
*** zaitcev has joined #openstack-swift00:14
*** ChanServ sets mode: +v zaitcev00:14
*** dmorita has joined #openstack-swift00:15
*** dmorita_ has quit IRC00:15
*** dmorita_ has joined #openstack-swift00:18
timburkeclayg: interesting... i *did* see errors building docs with a too-old sphinx (1.3.6) -- error: error in setup.cfg: command 'build_sphinx' has no such option 'warning_is_error'00:19
*** dmorita has quit IRC00:19
*** dmorita has joined #openstack-swift00:20
*** dja has joined #openstack-swift00:21
*** dmorita has quit IRC00:21
*** dmorita has joined #openstack-swift00:21
*** dmorita has quit IRC00:23
*** dmorita has joined #openstack-swift00:23
*** dmorita_ has quit IRC00:23
*** dmorita_ has joined #openstack-swift00:27
*** dmorita has quit IRC00:28
*** dmorita_ has quit IRC00:32
*** dmorita has joined #openstack-swift00:32
*** dmorita has quit IRC00:37
*** dmorita has joined #openstack-swift00:37
*** tonanhngo has joined #openstack-swift00:38
dims_timburke : see backstory in https://review.openstack.org/#/c/430618/00:39
patchbotpatch 430618 - releases - Release pbr 2.0.0 (MERGED)00:39
*** dmorita_ has joined #openstack-swift00:40
*** dmorita_ has quit IRC00:42
*** dmorita_ has joined #openstack-swift00:42
*** dmorita has quit IRC00:42
*** tonanhngo has quit IRC00:43
*** dmorita_ has quit IRC00:46
*** dmorita has joined #openstack-swift00:48
*** dmorita has quit IRC00:52
*** dmorita has joined #openstack-swift01:15
*** dmorita has quit IRC01:19
*** tonanhngo has joined #openstack-swift01:28
*** dmorita has joined #openstack-swift01:31
*** dmorita_ has joined #openstack-swift01:32
*** dmorita has quit IRC01:32
*** tonanhngo has quit IRC01:33
*** dmorita_ has quit IRC01:33
*** dmorita has joined #openstack-swift01:33
*** dmorita has quit IRC01:36
*** dmorita_ has joined #openstack-swift01:36
*** dmorita_ has quit IRC01:37
*** dmorita has joined #openstack-swift01:37
*** dmorita has quit IRC01:40
*** dmorita has joined #openstack-swift01:40
*** dmorita_ has joined #openstack-swift01:42
*** dmorita has quit IRC01:43
*** dmorita_ has quit IRC01:43
*** dmorita has joined #openstack-swift01:43
*** dmorita_ has joined #openstack-swift01:45
*** dmorita has quit IRC01:45
*** dmorita has joined #openstack-swift01:46
*** dmorita_ has quit IRC01:46
*** dmorita has quit IRC01:50
*** sams-gleb has joined #openstack-swift02:01
*** dmorita has joined #openstack-swift02:03
kota_good morning02:04
*** sams-gleb has quit IRC02:05
*** dmorita_ has joined #openstack-swift02:07
*** dmorita has quit IRC02:08
*** dmorita_ has quit IRC02:11
*** klrmn has quit IRC02:12
*** dmorita has joined #openstack-swift02:13
*** dmorita_ has joined #openstack-swift02:17
*** dmorita has quit IRC02:18
*** dmorita_ has quit IRC02:21
*** dmorita has joined #openstack-swift02:21
*** dmorita_ has joined #openstack-swift02:23
*** dmorita__ has joined #openstack-swift02:24
*** dmorita_ has quit IRC02:24
*** dmorita has quit IRC02:26
*** dmorita__ has quit IRC02:26
*** dmorita has joined #openstack-swift02:26
*** dmorita has quit IRC02:28
*** _JZ_ has joined #openstack-swift02:28
*** dmorita has joined #openstack-swift02:28
*** dmorita_ has joined #openstack-swift02:30
*** dmorita has quit IRC02:30
*** dmorita has joined #openstack-swift02:33
*** dmorita_ has quit IRC02:34
*** dmorita has quit IRC02:38
clayginteresting probe tests pointing an at issue with container sync and slo manifest -> https://8b86aea46fb38e6450f2-0e5f4c086da474abc1df58826577db2f.ssl.cf1.rackcdn.com/442208/6020/probetests/console.txt02:39
*** dmorita has joined #openstack-swift02:39
*** dmorita_ has joined #openstack-swift02:42
*** dmorita has quit IRC02:43
*** dmorita_ has quit IRC02:46
*** dja has quit IRC02:48
*** dja has joined #openstack-swift02:49
*** dmorita has joined #openstack-swift02:49
*** dmorita has quit IRC02:54
*** dmorita has joined #openstack-swift02:57
*** dmorita_ has joined #openstack-swift02:59
*** dmorita__ has joined #openstack-swift03:01
*** dmorita has quit IRC03:02
*** dmorita_ has quit IRC03:04
*** dmorita has joined #openstack-swift03:05
*** dmorita__ has quit IRC03:06
*** dmorita has quit IRC03:10
*** dja has quit IRC03:11
*** bkopilov has quit IRC03:11
*** dja has joined #openstack-swift03:14
*** daxtens has joined #openstack-swift03:16
*** dmorita has joined #openstack-swift03:18
*** daxtens has quit IRC03:19
*** dmorita has quit IRC03:21
*** dmorita has joined #openstack-swift03:21
*** dmorita has quit IRC03:22
*** dmorita has joined #openstack-swift03:22
*** dja has quit IRC03:24
*** dmorita_ has joined #openstack-swift03:26
*** dja has joined #openstack-swift03:26
*** dmorita has quit IRC03:27
*** dmorita_ has quit IRC03:30
*** links has joined #openstack-swift03:35
*** dja has quit IRC03:39
*** dja has joined #openstack-swift03:47
*** dmorita has joined #openstack-swift03:48
*** dmorita has quit IRC03:52
clayginteresting probe tests pointing an at issue with container sync and slo manifest -> https://8b86aea46fb38e6450f2-0e5f4c086da474abc1df58826577db2f.ssl.cf1.rackcdn.com/442208/6020/probetests/console.txt03:56
claygsry03:56
*** sams-gleb has joined #openstack-swift04:04
*** _JZ_ has quit IRC04:05
*** sams-gleb has quit IRC04:08
*** tonanhngo has joined #openstack-swift04:08
*** tonanhngo has quit IRC04:13
*** gkadam has joined #openstack-swift04:19
*** psachin has joined #openstack-swift04:25
*** _JZ_ has joined #openstack-swift04:31
*** bkopilov has joined #openstack-swift04:34
claygrledisez: do you already have a patch that adds some kind of multiprocessing to ssync_senders?  I have these 80 disk nodes I'm playing with and a single object-reconstrcutor process can not have a concurrency high enough to move these disks before hub starvation sets in04:36
claygwhen I spin up the same totaly concurrency but with a python process per disk it's like night and day04:38
clayghttps://cloud.swiftstack.com/v1/AUTH_clayg/junk/gaining_parts.png04:38
claygCan you tell when I changed from handoffs_only with a concurrency of ~80 to a concurrency of 1 and https://gist.github.com/clayg/01e063655c250d6808e2b341ab65594c04:39
claygI'm not sure what's the most stright forward way to make swift-object-reconstrcutor spin up multiple workers - but I gotta come up with something tomorrow while I've still got this hardware04:41
clayggah, stats handling is going to be annoying04:44
claygthere probably isn't a trivial way to introduce multiple workers04:44
clayggood!  it'll be a good excuse for a larger rewrite!04:46
claygg'night04:46
kota_clayg: have a good sleep04:50
*** tonanhngo has joined #openstack-swift04:59
*** dja has quit IRC05:00
*** tonanhngo_ has joined #openstack-swift05:02
*** tonanhngo has quit IRC05:03
*** tonanhngo_ has quit IRC05:07
*** kavitha has joined #openstack-swift05:07
kavithahi..05:08
kavithai did not find the release notes for ocata..05:08
kavithai did not find the release notes for trove in ocata release..05:15
kota_kavitha: maybe around https://github.com/openstack/swift/tree/master/releasenotes/notes ?05:16
kota_kavitha: i don't know why the release has not generated automatically though05:17
kavithaok i will check..05:17
kavithathank you05:17
kota_perhaps, something related to that https://github.com/openstack/swift/tree/master/releasenotes/source doesn't have ocata.rst?05:17
* kota_ supposes notmyname knows something05:18
kavithais there release notes in ocata or not?05:21
kota_kavitha: 2.11.0, 2.12.0, 2.13.0 are included into the ocata final, I don't think the concatated note exists but not sure.05:22
*** rcernin has joined #openstack-swift05:40
*** kavitha has quit IRC05:40
*** adriant has quit IRC05:50
*** Jeffrey4l has quit IRC05:52
claygi wonder where kavitha was *looking* for release notes05:55
*** Jeffrey4l has joined #openstack-swift05:56
*** dmorita has joined #openstack-swift06:03
*** sams-gleb has joined #openstack-swift06:05
*** sams-gleb has quit IRC06:10
*** dmorita has quit IRC06:10
*** rcernin has quit IRC06:13
*** McMurlock1 has joined #openstack-swift06:21
openstackgerritMerged openstack/swift master: Make Sphinx treat warnings as errors  https://review.openstack.org/44220806:25
*** dja has joined #openstack-swift06:25
*** ChubYann has quit IRC06:33
*** dmorita has joined #openstack-swift06:34
kota_clayg: i thought he was looking for https://releases.openstack.org/ocata/06:35
*** dmorita has quit IRC06:38
openstackgerritMerged openstack/swift master: Follow up on reconstructor handoffs_only  https://review.openstack.org/43401806:45
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873606:47
*** dja has quit IRC06:48
*** _JZ_ has quit IRC07:18
*** hseipp has joined #openstack-swift07:42
*** tesseract has joined #openstack-swift07:47
*** pcaruana has joined #openstack-swift07:50
*** rcernin has joined #openstack-swift07:55
*** tonanhngo has joined #openstack-swift07:57
*** dosaboy has quit IRC07:58
*** dosaboy has joined #openstack-swift07:59
*** dja has joined #openstack-swift08:02
*** sams-gleb has joined #openstack-swift08:07
*** dja has quit IRC08:09
*** dja has joined #openstack-swift08:09
*** kota_ has quit IRC08:11
*** kota_ has joined #openstack-swift08:11
*** ChanServ sets mode: +v kota_08:11
*** sams-gleb has quit IRC08:13
*** tonanhngo_ has joined #openstack-swift08:15
*** tonanhngo has quit IRC08:16
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Composite Ring Zipper Implementation  https://review.openstack.org/44192108:19
*** sams-gleb has joined #openstack-swift08:21
*** Jeffrey4l_ has joined #openstack-swift08:30
*** oshritf has joined #openstack-swift08:34
*** Jeffrey4l has quit IRC08:34
*** Jeffrey4l_ has quit IRC08:37
*** amoralej|off is now known as amoralej08:38
*** Jeffrey4l_ has joined #openstack-swift08:38
rledisezclayg: "multiprocessing to ssync_senders" -> what we do is to start multiple processes, one for N devices (N=3 for us). we manage it with the init script. it's not clean, but it works. a solution like the object-auditor's one seems cleaner (define concurrency, distribute devices to the workers).08:40
*** dmorita has joined #openstack-swift08:46
*** dmorita has quit IRC08:47
*** dmorita has joined #openstack-swift08:47
*** dmorita has quit IRC08:51
*** hseipp has quit IRC08:54
*** dmorita has joined #openstack-swift09:00
*** hseipp has joined #openstack-swift09:05
*** dmorita has quit IRC09:05
*** dmorita has joined #openstack-swift09:09
*** cbartz has joined #openstack-swift09:11
*** dmorita has quit IRC09:14
*** tanee is now known as tanee_away09:15
*** tanee_away is now known as tanee09:15
*** acoles_ has joined #openstack-swift09:19
*** ChanServ sets mode: +v acoles_09:19
*** acoles_ has left #openstack-swift09:19
*** mvk has quit IRC09:21
*** nadeem has quit IRC09:23
*** nadeem has joined #openstack-swift09:23
*** jcook has quit IRC09:23
mattoliveraukota_: \o/ ringzipper Ive starred it, I look forward to having a play with it tomorrow!09:24
*** bkopilov has quit IRC09:26
kota_mattoliverau: \o/ thanks a lot! i need your eyes to improves the patch!09:26
*** bkopilov has joined #openstack-swift09:29
*** jcook has joined #openstack-swift09:32
*** d0ugal has quit IRC09:32
*** dja has quit IRC09:32
*** joeljwright has joined #openstack-swift09:35
*** ChanServ sets mode: +v joeljwright09:35
*** d0ugal has joined #openstack-swift09:36
*** dmorita has joined #openstack-swift09:36
*** tonanhngo_ has quit IRC09:38
*** dmorita has quit IRC09:40
openstackgerritVitaly Gridnev proposed openstack/python-swiftclient master: Fix logging of the gzipped body  https://review.openstack.org/44234209:40
*** oshritf has quit IRC09:42
*** d0ugal has quit IRC09:48
*** d0ugal has joined #openstack-swift09:50
*** mvk has joined #openstack-swift09:52
*** oshritf has joined #openstack-swift09:52
*** tonanhngo has joined #openstack-swift09:52
*** bkopilov has quit IRC09:56
*** tonanhngo has quit IRC09:57
*** oshritf has quit IRC10:01
*** links has quit IRC10:05
*** dja has joined #openstack-swift10:07
*** bkopilov has joined #openstack-swift10:09
*** oshritf has joined #openstack-swift10:14
*** links has joined #openstack-swift10:19
*** tanee is now known as tanee_away10:27
*** mvk has quit IRC10:28
*** openstackgerrit has quit IRC10:33
*** links has quit IRC10:39
*** mvk has joined #openstack-swift10:41
*** Guest6667 is now known as Guest666610:43
*** dja has quit IRC10:48
*** links has joined #openstack-swift10:55
*** gkadam is now known as gkadam-afk11:00
*** vills has joined #openstack-swift11:06
*** vills has left #openstack-swift11:14
*** gkadam-afk is now known as gkadam11:19
*** sams-gleb has quit IRC11:19
*** murugesh has joined #openstack-swift11:55
murugeshHi There11:56
*** sams-gleb has joined #openstack-swift12:02
*** cshastri|gone has joined #openstack-swift12:05
*** cshastri|gone is now known as cshastri12:06
*** bkopilov has quit IRC12:13
murugeshI have problem in keystone authentication with swift12:17
murugeshi get 500 internal server error12:17
acolestimburke: thanks for patch 442208, that has bugged me for a while12:21
patchbothttps://review.openstack.org/#/c/442208/ - swift - Make Sphinx treat warnings as errors (MERGED)12:21
acolesmurugesh: if you could paste your proxy server logs to pastebin e.g. http://paste.openstack.org/ that may reveal a cause12:22
murugeshSure +acoles12:24
*** catintheroof has joined #openstack-swift12:24
murugeshwhere can i get the logs12:24
acolesdepends how you set up your logging. my SAIO logs to /var/log/swift/proxy.log and proxy.error, as described here https://docs.openstack.org/developer/swift/development_saio.html#optional-setting-up-rsyslog-for-individual-logging12:27
murugeshThanks for the reference +acoles12:33
murugeshthis is the error i get when i run the below command on controller node (keystone)12:33
murugesh[root@cfvsenctrl121 ~]# swift stat --debug DEBUG:keystoneclient.auth.identity.v3.base:Making authentication request to http://X.X.X.X:35357/v3/auth/tokens INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): X.X.X.X DEBUG:requests.packages.urllib3.connectionpool:"POST /v3/auth/tokens HTTP/1.1" 201 4840 INFO:requests.packages.urllib3.connectionpool:Starting new HTTP connection (1): X.X.X.X DEBUG:req12:35
murugeshINFO:swiftclient:RESP STATUS: 500 Internal Server Error12:35
*** geaaru has joined #openstack-swift12:40
murugeshshall i post my current proxy-server.conf file??12:41
*** openstackgerrit has joined #openstack-swift12:52
openstackgerritMahati Chamarthy proposed openstack/swift master: Limit number of revert tombstone SSYNC requests  https://review.openstack.org/43957212:52
acolesmurugesh: yes, pasting your proxy-server.conf may help, but logs will be most useful12:57
murugeshI dont find any logs acloes12:59
murugeshhere is my configuration file13:00
murugesh[DEFAULT] bind_port = 8080 workers = 8 user = swift  [pipeline:main] pipeline = healthcheck cache authtoken keystone proxy-logging catch_errors gatekeeper container_sync bulk tempurl ratelimit container-quotas account-quotas proxy-server  [app:proxy-server] use = egg:swift#proxy allow_account_management = true account_autocreate = true  [filter:cache] use = egg:swift#memcache #memcache_servers = 172.16.10.100:11211  [filter:13:00
patchbotError: Missing "]".  You may want to quote your arguments with double quotes in order to prevent extra brackets from being evaluated as nested commands.13:00
*** chlong has joined #openstack-swift13:00
*** hseipp has quit IRC13:01
*** hseipp has joined #openstack-swift13:01
murugeshSorry13:03
murugeshHere i have pasted the proxy-server.conf file13:04
murugeshhttp://paste.openstack.org/show/601751/13:04
murugeshAnd my /etc/swift/swift.conf file is blow13:06
*** kei_yama has quit IRC13:06
murugeshhttp://paste.openstack.org/show/601754/13:07
murugeshi get below error on keystone server13:09
murugeshhttp://paste.openstack.org/show/601758/13:10
murugeshpls help me to fix this issue13:13
acolesmurugesh: usually the authtoken and keystone middlewares would be towards the righthand end of the pipeline13:20
acoleshttps://docs.openstack.org/developer/swift/overview_auth.html#configuring-swift-to-use-keystone13:20
*** dmorita has joined #openstack-swift13:21
acolesmurugesh: also see https://github.com/openstack/swift/blob/4ee20dba482e8f8e4b9ea574428c72c5728a10a1/etc/proxy-server.conf-sample#L96-L9913:21
acolesmurugesh: your swift client output suggests that swift client is getting a successful response form keystone when it requests a token but the 500 comes when requesting to the swift endpoint13:23
*** bkopilov has joined #openstack-swift13:24
*** dmorita has quit IRC13:26
*** bkopilov has quit IRC13:29
*** klamath has joined #openstack-swift13:33
*** klamath has quit IRC13:37
murugeshThanks for the feedback +acoles13:38
*** klamath has joined #openstack-swift13:38
murugeshDo you want to do any changes in my configuration files?13:39
*** bkopilov has joined #openstack-swift13:41
openstackgerritAlistair Coles proposed openstack/swift master: Trivial: add assertion to test_reconstructor test_get_response  https://review.openstack.org/44248513:44
acolesmurugesh: I would suggest you change your proxy middleware pipeline in proxy-server.conf to match what you see in those docs I linked13:47
*** tonanhngo has joined #openstack-swift13:50
*** links has quit IRC13:51
murugeshSure +acoles,I will change it accordingly and try again13:51
*** amoralej is now known as amoralej|lunch13:54
*** tonanhngo has quit IRC13:55
*** hseipp has quit IRC13:55
*** joeljwright has quit IRC14:05
*** vint_bra has joined #openstack-swift14:07
*** cshastri has quit IRC14:09
*** tonanhngo has joined #openstack-swift14:24
*** NM has joined #openstack-swift14:27
*** tonanhngo has quit IRC14:29
*** gabor_antal_ is now known as gabor_antal14:34
*** murugesh has quit IRC14:52
*** amoralej|lunch is now known as amoralej14:55
*** hurricanerix has joined #openstack-swift15:03
*** hurricanerix has quit IRC15:04
*** hurricanerix has joined #openstack-swift15:06
*** pcaruana has quit IRC15:09
*** sams-gleb has quit IRC15:09
openstackgerritMerged openstack/swift master: Follow up the reconstructor test coverage  https://review.openstack.org/44095015:10
*** sams-gleb has joined #openstack-swift15:11
*** sams-gleb has quit IRC15:16
*** hurricanerix has quit IRC15:17
*** dfg_ has quit IRC15:17
*** aerwin3 has quit IRC15:18
*** hurricanerix has joined #openstack-swift15:18
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873615:19
openstackgerritAlistair Coles proposed openstack/swift master: Global EC Under Development Documentation  https://review.openstack.org/43251315:20
acolesclayg: I rebased ^^ and hacked it a bit15:21
*** pcaruana has joined #openstack-swift15:23
openstackgerritAlistair Coles proposed openstack/swift master: Global EC Under Development Documentation  https://review.openstack.org/43251315:26
*** sams-gleb has joined #openstack-swift15:27
*** dmorita has joined #openstack-swift15:30
*** dmorita has quit IRC15:34
*** dmorita has joined #openstack-swift15:34
*** dmorita has quit IRC15:39
*** _JZ_ has joined #openstack-swift15:43
*** psachin has quit IRC15:43
jrichliclayg: re: container sync and slo manifest probe test failure: I find it interesting that the test says that case is a 'sanity check'.  curious, what job run got this error?15:44
openstackgerritRomain LE DISEZ proposed openstack/swift master: Fix cname_lookup/eventlet 0.20+ DNS exceptions  https://review.openstack.org/43577015:56
openstackgerritRomain LE DISEZ proposed openstack/swift master: Cache all answers from nameservers in cname_lookup  https://review.openstack.org/43577315:56
*** hurricanerix has quit IRC15:59
*** oshritf has quit IRC16:00
*** hurricanerix has joined #openstack-swift16:00
jrichliclayg: nm, I see the patch on the first line16:03
*** McMurlock1 has quit IRC16:04
spiettehow come pip install swift installs 1.0.2?16:14
*** McMurlock1 has joined #openstack-swift16:17
*** tonanhngo has joined #openstack-swift16:20
*** adu has joined #openstack-swift16:24
*** tonanhngo has quit IRC16:25
*** pcaruana has quit IRC16:26
*** McMurlock1 has quit IRC16:26
*** chsc has joined #openstack-swift16:28
*** chsc has joined #openstack-swift16:28
*** rcernin has quit IRC16:30
*** ouchkernel has joined #openstack-swift16:33
notmynamegood morning16:33
*** tesseract has quit IRC16:38
claygnotmyname: is slack stupid this morning?16:41
notmynameas opposed to ...16:42
notmyname;-)16:42
claygi thought we stopped publishing swift to pypi?16:42
notmynamelooks like it's working for me16:42
notmynameclayg: I'm getting "trouble connecting to slack" message, but I can ping people16:42
notmynameclayg: re pypi, yeah, AFAIK we only publish clients to pypi.16:44
claygnotmyname: re slack, I can't get to status.slack.com and slack.com says server error16:45
notmyname"centralized chat client has downtime. silicon valley shuts down"16:45
notmynameclayg: I send you a pm in slack. marcron says he got one I sent him16:46
*** adu has left #openstack-swift16:47
notmynamegood info on the summit from ttx this morning http://lists.openstack.org/pipermail/openstack-dev/2017-March/113459.html16:48
notmynamealso, another interesting ML thread startign at http://lists.openstack.org/pipermail/openstack-dev/2017-March/113463.html (the response from graham is quite good)16:50
notmynamehonestly I have no idea what the linked etherpad is about16:50
acolesnotmyname: "Free hacking/meetup space" :D17:01
notmynameyeah. that email combined with the wiki page at https://wiki.openstack.org/wiki/Forum17:02
notmyname...makes me think that we might have a ops feedback session and those of us who are there can get around a table and talk17:02
jrichliyes, sounds good17:03
notmynamebut otherwise there probably won't be a lot of formal "swift" things. I'm imagining that the fishbowl sessions will be very similar to the cross-project sessions at previous summits17:04
notmyname...and the general user feedback will be similar to the general ops sessions I've been a part of: swift in the context of ops who are deploying every openstack project. in that case, swift doesn't come up much at all17:05
notmynamebut that's just a guess17:05
notmynamei'll be thinking and reading more about it17:05
notmynameanyone remember jbryce having some sort of "letter to convince your manager to go to boston" thing? I remember somethign about that, but I can't find it anywhere. anyone got a link?17:06
notmynamebut also, we need to get involved in http://lists.openstack.org/pipermail/openstack-dev/2017-March/113115.html (I'm just now digging in to it myself)17:07
*** tonanhngo has joined #openstack-swift17:15
*** tonanhngo has quit IRC17:20
openstackgerritClay Gerrard proposed openstack/swift master: Test EC chunk_transformer with larger input chunks  https://review.openstack.org/44210817:20
*** JimCheung has joined #openstack-swift17:35
*** dmorita has joined #openstack-swift17:39
*** dmorita has quit IRC17:43
*** dmorita has joined #openstack-swift17:43
timburkegood morning17:45
*** david-lyle_ has joined #openstack-swift17:52
spietteoh well, there was a swift 2.10 on pipy...17:54
*** david-lyle has quit IRC17:54
*** david-lyle_ is now known as david-lyle17:55
*** NM has quit IRC17:58
notmynamehmm17:58
notmynamespiette: got a link? when I did a quick search earlier, I didn't see it17:59
*** NM has joined #openstack-swift17:59
spiettenotmyname: not anymore, I did install pip 2.10 a couple of months ago, did a pip freeze, and my collegue could got it to install. I realized that only 1.0.2 was now available.18:00
spiette*could not*18:00
*** links has joined #openstack-swift18:01
*** david-lyle has quit IRC18:04
*** david-lyle has joined #openstack-swift18:05
*** klrmn has joined #openstack-swift18:11
claygnotmyname: there's this -> https://pypi.python.org/pypi/swift/1.0.218:13
claygI think all the old school projects are up there?  https://pypi.python.org/pypi/nova18:14
timburkeclayg: but https://pypi.python.org/pypi/swift 404s? weird...18:14
notmynameinteresting. but if you go to just /swift, it fails18:14
*** geaaru has quit IRC18:17
*** david-lyle has quit IRC18:23
*** tonanhngo has joined #openstack-swift18:23
*** david-lyle has joined #openstack-swift18:25
openstackgerritClay Gerrard proposed openstack/swift master: Limit number of revert tombstone SSYNC requests  https://review.openstack.org/43957218:25
*** tonanhngo has quit IRC18:28
*** david-lyle has quit IRC18:29
*** david-lyle has joined #openstack-swift18:36
*** mvk has quit IRC18:36
*** cbartz has quit IRC18:47
clayganyone ever get something like this for python-swiftclient tests -> NoMatchingPlugin: The plugin v1password could not be found18:53
claygi just `sudo pip install -r test-requirements.txt`18:54
timburkeclayg: i wanna see this error. got more context?19:02
timburkeseems related to https://github.com/openstack/python-swiftclient/blob/master/swiftclient/authv1.py19:02
*** david-lyle has quit IRC19:04
*** david-lyle has joined #openstack-swift19:06
*** mvk has joined #openstack-swift19:07
*** dmorita has quit IRC19:12
*** vint_bra has quit IRC19:13
*** SkyRocknRoll has quit IRC19:18
*** dmorita has joined #openstack-swift19:19
*** NM has quit IRC19:21
*** NM has joined #openstack-swift19:22
openstackgerritShashirekha Gundur proposed openstack/swift master: display swift services in apache2  https://review.openstack.org/44272419:23
*** vint_bra has joined #openstack-swift19:24
*** NM has quit IRC19:24
*** NM has joined #openstack-swift19:25
sgundurclayg, related to 'devstack+swift' on apache2 I see the swift services working for the apache2 now, pls check this-19:28
sgundurhttps://gist.github.com/sgundur/3feb3968a039bc8a8f9365f682f477cb19:28
sgundurclayg, also this - https://review.openstack.org/#/c/442710/19:29
patchbotpatch 442710 - openstack-dev/devstack - swift apis to run in apache19:29
openstackgerritAlistair Coles proposed openstack/swift master: Support EC policy for in process functional tests  https://review.openstack.org/44274919:34
acoles^^maybe a step towards functional testing of EC in the gate?19:35
notmynamesgundur: that's interesting19:37
notmynamelooking19:37
jrichliacoles: nice.  another use of conf loader :-)19:37
acolesjrichli: yep, it worked out pretty niceley :)19:38
sgundurnotmyname, yep!19:38
notmynamesgundur: did you try this with either crypto or with EC? I think you'll need to make *only* the proxy run under apache and still run the storage nodes with evenlet19:38
notmynamebecause of the multipart requests in those cases19:39
notmynameacoles: yay19:39
sgundurnotmyname, okay. I havn't tested with EC/crypto; I will do that19:40
notmynamesgundur: cool, thanks19:40
notmynamesgundur: also, have you talked with clayg or tdasilva about a devstack plugin for swift living in our repo? is that related to your work? the goal is that all of the devstack setup work can live in our repo instead of being out of our control19:41
sgundurnotmyname, I have not talked to them on that. not sure if they r related; I ll ping them and ask19:42
*** tonanhngo has joined #openstack-swift19:42
pdardeau_notmyname: might devstack plugin in repo run any of same risks as in-repo tempest plugin?19:43
*** amoralej is now known as amoralej|off19:43
*** ChubYann has joined #openstack-swift19:43
notmynamepdardeau_: yep, they're very similar. however, I'm detecting more support for in-repo stuff in the broader community19:44
notmynamepersonally, I'd still love to see the tempest plugins in swift too, if they'd actually be used for interop testing. (otherwise the churn is hard to justify)19:44
sgundurnotmyname, as of now- all I did was found that devstack/apache was looking for conf in a folder though we were storing them ; because of the default set to false;19:44
sgundurswift confs were not copied19:45
jrichlipdardeau_, notmyname : I wonder if they are wanting devstack to be 'branchless' or if it already is.  I think that will make a big difference for plugin repo locaiton19:45
notmynamejrichli: I don't know what that means19:46
*** tonanhngo has quit IRC19:46
jrichlithat is one of the big reasons they gave for not wanting in-tree tempest plugins, if i understood correctly19:47
jrichlilemme dig up the etherpad to see if there is some good explanation before i try19:47
notmynamefrom the PTG conversations and what I remember from when it happened, the TC was generally in favor of doing the tempest plugin thing, but there were some qa team members who didn't want that. however, those people aren't as active in qa any more either19:48
notmynameand there's a lot more scaling problems with the in-tempest pattern as there are more projects19:49
jrichlisome projects have tempest plugins now.  but they are supposed to live in a separate repo form their project so they can go with the whole 'branchless' thing and be version independent19:49
jrichligate stuff doesn't work out otherwise19:49
*** dmorita has quit IRC19:51
jrichlior they dont want users to have to deal with different version branches19:51
*** dmorita has joined #openstack-swift19:51
notmynameI've got a meeting in a bit, so I need to go pick somethign up for lunch. to be continued later....19:52
jrichlithis was the proposal for tempest.  just wondered if there would be a simlar thing for devstack https://review.openstack.org/#/c/369749/5/goals/pike/split-tempest-plugins.rst19:52
patchbotpatch 369749 - governance - Add Pike goal split out tempest plugins19:52
jrichliok19:52
openstackgerritAlistair Coles proposed openstack/swift master: Test EC chunk_transformer with larger input chunks  https://review.openstack.org/44210819:55
acolesclayg: ^^ TIL [[]]*10 is not what you think it is19:57
*** dmorita has quit IRC19:59
*** dmorita has joined #openstack-swift19:59
*** vint_bra has quit IRC20:05
*** NM has quit IRC20:05
timburkeacoles: no, it's not :-)20:06
*** NM has joined #openstack-swift20:08
timburkereminds me of the idiom in https://docs.python.org/2/library/itertools.html#itertools.izip that has *way* too much magic for my tastes20:08
*** links has quit IRC20:09
*** vint_bra has joined #openstack-swift20:16
*** tonanhngo has joined #openstack-swift20:18
*** tonanhngo_ has joined #openstack-swift20:25
*** tonanhngo has quit IRC20:25
*** tonanhngo_ has quit IRC20:38
*** dja has joined #openstack-swift20:45
openstackgerritVitaly Gridnev proposed openstack/python-swiftclient master: Fix logging of the gzipped body  https://review.openstack.org/44234220:50
*** dja has quit IRC20:56
*** tonanhngo has joined #openstack-swift20:57
*** tonanhngo has quit IRC21:01
claygacoles: oh crap - I knew that in another life :'(21:06
clayg[list() for i in range(n)] is more expressive anyway - why did I try to write it like that!?21:06
claygacoles: oh good you fixed it already!21:08
*** JimCheung has quit IRC21:09
*** JimCheung has joined #openstack-swift21:09
zaitcevPython makes it worse by virtue of its embeds being noticeably faster than open-coding the same thing, so people have an incentive to push work down into functions.21:09
claygtimburke: regarding "NoMatchingPlugin: The plugin v1password could not be found" - "nosetests python-swiftclient/tests/unit/test_authv1.py" reliably fails on my vsaio currently21:14
claygsgundur: probably because either maybe ... because it doesn't have an EC policy?  it shouldn't matter?  we shouldn't be able to start our object server behind a non eventlet webserver - the envrion['wsgi.input'].set_hundred_continue_headers should blow up?  And I think we always do that?21:16
claygtimburke: yup `pip install -e .` fixed it21:16
claygtimburke: I was way behind master and didn't have it installed21:16
claygtimburke: probably wouldn't have noticed the issue if I knew how to run tests with tox/ostester w/e21:16
timburkeplain old `tox` tends to work well for me21:17
clayghow do you run just one test?21:17
timburkeoh, no clue on that one21:18
notmynameit's possible. but of course I forgot how21:21
tdasilvanosetests test.unit.bla.bla.bla21:29
claygsgundur: did you try to upload an object?21:29
claygtdasilva: acachacpcha!  everyone knows how to do it with nosetests!  ;)21:29
tdasilvaheh21:29
claygsgundur: what bits did you have to fiddle to make it do the acpahce setup?  was it in local.conf or w/e?21:30
tdasilvaclayg: did you mean with tox or ostester?21:30
notmynamehttps://wiki.openstack.org/wiki/Testr#How_can_I_run_just_one_test.3F_Just_some_tests.3F  just write a regex!21:30
notmynamealso, http://b.z19r.com/post/did-you-just-tell-me-to-go-fuck-myself21:30
claygtdasilva: i have no idea - i'm kind of over it - swift tests probably also fail similarlly spectacularlly if you don't acctually have the current swift installed and something something entry points21:31
claygi'll probably just try not to let myself get so behind on python-swiftclient21:32
tdasilvaclayg: ok, well. FWIW, i typically run something like this: tox -e func -- --pdb test.functional.tests.TestFile.testCopy21:32
claygafter `git pull master` had I run `reinstallswift` on my vsaio it probably would have worked21:32
tdasilvanot sure that's helpful...21:32
claygzomg!  tdasilva is like a magician!21:32
clayg-- <import path> I'll try and remember21:33
tdasilvaclayg: it's in .functests :)21:34
claygwat?21:34
tdasilvaI put a comment there, because I also always forget21:34
*** tonanhngo has joined #openstack-swift21:34
*** Jeffrey4l_ has quit IRC21:34
claygoh, protip - nice21:35
claygthat's in swift/.functests21:35
tdasilvayep21:35
claygcool!21:35
claygeveryone say "thank you tdasilva" for patch 35187321:36
patchbothttps://review.openstack.org/#/c/351873/ - swift - add reminder how to run debug func tests (MERGED)21:36
*** dja has joined #openstack-swift21:36
*** Jeffrey4l_ has joined #openstack-swift21:37
*** tonanhngo has quit IRC21:39
openstackgerritMerged openstack/swift master: Fix cname_lookup/eventlet 0.20+ DNS exceptions  https://review.openstack.org/43577021:40
sgundurclayg, yep I had but with replica=1 as by default that works in devstack - https://gist.github.com/sgundur/c0ebab8e388f7d480788bab073dd98f821:40
sgundurclayg, I made changes in devstack/lib/swift and in our repo - swift/examples/apache2/*.server.template21:41
sgundurdevstack/lib/swift changes here -https://review.openstack.org/#/c/442710/1/lib/swift21:44
patchbotpatch 442710 - openstack-dev/devstack - swift apis to run in apache21:44
claygsgundur: mind blown21:45
mattoliverauMorning21:46
claygsgundur: well there you go: https://github.com/openstack/swift/blob/d621277feb235e8da2a1e155a21e80f5daf6d892/swift/obj/server.py#L74421:47
claygyou'd have to configure either EC or encryption to encounter the bug - apache mod_wsgi still works fine for unencrypted replicas - that's great!?21:47
zaitcevwhat what21:47
zaitcevExactly.21:48
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873621:48
zaitcevYou know... I saw a mail from dfg today, about troubling, and asked myself: who in the world does want PUT+POST anymore of RAX guys fork?21:49
claygzaitcev: parse error21:50
*** NM has quit IRC21:50
sgundurclayg, I ll test with EC/encryption on this devstack setup21:50
zaitcevclayg: "troubling" is their... troublesome name of the repo. And you even replied to that mail.21:50
*** NM has joined #openstack-swift21:50
claygzaitcev: I still want proxy->object server protocol to be http - I think we've talked at length about how MIME wrapping stuff is ugly but reasonable; continue headers is valid but not broadly supported (so bad); and the `\r\n\r\n` in the middle of a chunked transfer is just just voodoo made up bullshit21:51
claygfixing all of that would be *amazing*21:51
claygzaitcev: yeah troubling whatever - they're gunna play on a fork somewhere by themselves great for them - not troubling at all - power to the FOSS!21:52
claygzaitcev: I just don't know what you meant by "who in he world <parse error> RAX guys fork"21:52
zaitcevclayg: it's the actual name, https://github.com/troubling/hummingbird21:53
clayg???? I don't give a shit what they name it?21:53
claygwere you saying something about the proxy->object server communication or just a comment about the dfg's email?21:54
claygI care about one and not the other ;)21:54
zaitcevThe main justification for working on it was that Go implementation of the current 2-phase PUT protocol was impossible. But if nobody cares about EC in Hummingbird, it is not needed anymore.21:55
claygzaitcev: I care about EC!  I care about a better proxy->object communication!  I care about better, more robust and more stable communications because it enables us more flexibility in our implementation choices!  I care about golang in swift - and the implications of a supportable protocol!21:57
claygI think that sentiment is broadly shared21:57
zaitcevThanks21:57
claygWho here thinks zaitcev is awesome!  And why didn't anyone tell tdasilva thank you yet!?21:57
* clayg wonders if it's lunch break or something21:57
* clayg thinks zaitcev and tdasilva are awesome21:58
claygsgundur: cool, good luck!21:58
zaitcevokay. I'm just wondering if that could help with mod_wsgi too21:58
notmynamezaitcev: FWIW I was talking about it with tdasilva earlier today. i'm going to write somethign up to put on the internet (linkable and everything) about where we are vis a vis consistency engine problems, golang/hummingbird, etc21:58
claygsgundur: it's possible that by the time zaitcev is done we'll be able to support mod_wsgi in the object layer again even for EC and encryption - so if it works currently you might not get all gung ho about ripping it out21:59
zaitcevnotmyname: looking forward to it21:59
notmynamecause there's been a lot of stuff going on, good and bad, and a lack of "here's goals going forward and a decent plan to get there"21:59
claygsgundur: afaik it's going to be a whole nother thing to get devstack to support/test EC and encryption - and the failure mode might be a limited subset of the matrix which we might fix later!22:00
claygsgundur: I'm really happy it's working for you!22:00
*** NM has quit IRC22:02
claygzaitcev: hell yeah it well!  death to eventlet storage servers!  death to set_hundred_continue_response_headers!22:02
sgundurclayg, thank you :)22:06
sgundurclayg, I hadn't used devstack for Swift - EC/encryption earlier ; I ll get to try that now!22:07
sgundurclayg, notmyname earlier mentioned something abt devstack plugin within swift repo ; I need to learn more on that22:08
openstackgerritRomain LE DISEZ proposed openstack/swift master: Replace replication_one_per_device by custom count  https://review.openstack.org/39078122:11
*** tonanhngo has joined #openstack-swift22:21
*** adriant has joined #openstack-swift22:22
*** tonanhngo has quit IRC22:25
*** tdasilva has quit IRC22:32
*** ChanServ changes topic to "Topic: Let's talk, we're nice. | https://etherpad.openstack.org/p/BOS-Swift-brainstorming | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift"22:40
notmynameetherpad to collect ideas for the Boston summit https://etherpad.openstack.org/p/BOS-Swift-brainstorming22:40
*** catintheroof has quit IRC22:41
notmynamelinked on https://wiki.openstack.org/wiki/Forum/Boston201722:41
zaitcevalready? I just got back from PTG, it feels like22:42
notmynameyep22:42
*** catintheroof has joined #openstack-swift22:42
notmynamesee http://lists.openstack.org/pipermail/openstack-dev/2017-March/113459.html and the other linked email therein22:42
notmyname(also, i'm prepping for tomorrow's team meeting)22:43
*** tdasilva has joined #openstack-swift22:44
notmynamehttps://twitter.com/wolever/status/839233571101491201  <-- problems with swift on twitter22:45
*** catintheroof has quit IRC22:47
*** tdasilva has quit IRC22:54
jrichliwhoa ...22:58
*** sams-gleb has quit IRC22:58
*** sams-gleb has joined #openstack-swift22:59
*** sams-gleb has quit IRC23:03
*** tdasilva has joined #openstack-swift23:07
*** tonanhngo has joined #openstack-swift23:07
pdardeau_it's good that he provided something concrete (maybe we can incorporate into tests and/or docs)23:11
*** tonanhngo has quit IRC23:12
timburkeugh. at some point we really need to try to get rid of https://github.com/openstack/python-swiftclient/blob/3.3.0/swiftclient/client.py#L448-L474 ...23:13
openstackgerritJohn Dickinson proposed openstack/swift master: add name_check to /info  https://review.openstack.org/44285923:14
notmynamethere's one of his issues, patched23:15
*** tdasilva has quit IRC23:15
*** _JZ_ has quit IRC23:15
notmynameprobably should have some functional tests that combine name_check and quoting things23:17
notmynamehmm... If you url quote stuff and the provider name_checks %, that seems bad (as in, how could it possibly work)23:18
timburkei think we maybe should be checking req.environ['PATH_INFO'] rather than req.path23:19
*** dja has quit IRC23:20
timburkei remember hitting similar trouble while writing tests for https://review.openstack.org/#/c/441520/23:20
patchbotpatch 441520 - swift - Use swift3's check_signature function23:20
zaitcevjust give him import base6423:20
timburkereally, we need to just have a v2 api where all accounts, containers, and objects are referenced by GUID, and the actual "names" are stored as metadata :P23:22
*** dja has joined #openstack-swift23:22
*** vint_bra has quit IRC23:22
notmynameyou joke, but we almost had that. then took it out when we couldn't figure out how to stop things from reappearing after being deleted23:23
claygrledisez: thanks for the update on patch 390781 - I'm coming around on the multi-file lock pattern thing!23:24
patchbothttps://review.openstack.org/#/c/390781/ - swift - Replace replication_one_per_device by custom count23:24
*** catintheroof has joined #openstack-swift23:32
*** tdasilva has joined #openstack-swift23:34
*** kei_yama has joined #openstack-swift23:35
openstackgerritJohn Dickinson proposed openstack/swift master: add name_check to /info  https://review.openstack.org/44285923:47

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!