Tuesday, 2016-05-31

*** klrmn has quit IRC00:09
*** diogogmt has joined #openstack-swift00:09
*** jamielennox|away is now known as jamielennox00:20
kota_good morning, mattoliverau o/01:00
*** sams-gleb has joined #openstack-swift01:21
*** sams-gleb has quit IRC01:25
mattoliveraukota_: morning01:39
*** nadeem has joined #openstack-swift01:44
*** klamath_ has joined #openstack-swift01:50
*** klamath has quit IRC01:50
*** Jeffrey4l has joined #openstack-swift01:50
*** nadeem has quit IRC01:53
*** zul has joined #openstack-swift02:01
*** klrmn has joined #openstack-swift02:45
*** nakagawamsa has joined #openstack-swift02:47
*** sheel has joined #openstack-swift02:47
*** ppai has joined #openstack-swift02:59
*** ppai has quit IRC03:12
*** janonymous has joined #openstack-swift03:47
*** rcernin has joined #openstack-swift03:48
*** links has joined #openstack-swift03:50
*** arch-nemesis has joined #openstack-swift04:00
*** pgbridge has joined #openstack-swift04:12
*** arch-nemesis has quit IRC04:18
*** klrmn has quit IRC04:35
*** psachin has joined #openstack-swift04:40
*** ppai has joined #openstack-swift04:40
*** nadeem has joined #openstack-swift04:51
*** rcernin has quit IRC04:52
*** chlong has quit IRC04:54
*** ozeri has joined #openstack-swift04:58
*** pgbridge has quit IRC05:04
*** SkyRocknRoll has joined #openstack-swift05:05
*** ChubYann has quit IRC05:08
*** chlong has joined #openstack-swift05:12
*** jamielennox is now known as jamielennox|away05:24
*** jamielennox|away is now known as jamielennox05:28
*** diogogmt has quit IRC05:31
*** diogogmt has joined #openstack-swift05:32
*** SkyRocknRoll has quit IRC06:05
*** pietervanw has joined #openstack-swift06:05
*** geaaru has joined #openstack-swift06:10
*** jamielennox is now known as jamielennox|away06:15
*** SkyRocknRoll has joined #openstack-swift06:18
*** nadeem has quit IRC06:39
openstackgerritCheng Li proposed openstack/python-swiftclient: Add an option: disable etag check on downloads  https://review.openstack.org/32315006:40
*** SkyRocknRoll has quit IRC06:50
*** tesseract has joined #openstack-swift06:57
*** nadeem has joined #openstack-swift06:58
*** rcernin has joined #openstack-swift07:01
*** SkyRocknRoll has joined #openstack-swift07:02
*** sams-gleb has joined #openstack-swift07:03
*** geaaru_ has joined #openstack-swift07:15
*** geaaru has quit IRC07:17
*** jamielennox|away is now known as jamielennox07:18
*** geaaru__ has joined #openstack-swift07:21
*** geaaru_ has quit IRC07:23
*** geaaru__ has quit IRC07:27
*** geaaru__ has joined #openstack-swift07:27
*** rledisez has joined #openstack-swift07:32
*** Jeffrey4l has quit IRC07:34
*** natarej_ has joined #openstack-swift07:39
*** natarej has quit IRC07:43
*** geaaru__ has quit IRC07:45
*** geaaru__ has joined #openstack-swift07:46
*** geaaru_ has joined #openstack-swift07:51
*** geaaru__ has quit IRC07:52
*** nadeem has quit IRC07:57
*** pietervanw_ has joined #openstack-swift08:00
*** pietervanw has quit IRC08:03
*** jordanP has joined #openstack-swift08:08
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844108:10
*** natarej__ has joined #openstack-swift08:11
*** natarej_ has quit IRC08:14
*** joeljwright has joined #openstack-swift08:16
*** ChanServ sets mode: +v joeljwright08:16
*** mkrcmari__ has quit IRC08:22
*** SkyRocknRoll has quit IRC08:23
*** asettle has joined #openstack-swift08:24
*** dmk0202 has joined #openstack-swift08:26
openstackgerritDoron Chen proposed openstack/swift: Added a test for delayed reap. The test schedules a 5-second delayed account reaping. The test checks that no reaping occurs 4 seconds later, and that full reaping occurs 6 seconds later.  https://review.openstack.org/32104108:26
*** jmccarthy has quit IRC08:28
*** jmccarthy has joined #openstack-swift08:31
*** SkyRocknRoll has joined #openstack-swift08:38
*** pietervanw_ has quit IRC08:41
*** mkrcmari__ has joined #openstack-swift08:54
*** jordanP has quit IRC08:59
*** pietervanw_ has joined #openstack-swift09:03
*** ppai has quit IRC09:06
*** permalac has quit IRC09:16
*** ppai has joined #openstack-swift09:19
openstackgerritFelix Cantournet proposed openstack/swift: Fix swift-dispersion in multi-region setups  https://review.openstack.org/32282009:20
*** daemontool has joined #openstack-swift09:22
*** ppai has quit IRC09:26
*** fcantournet has joined #openstack-swift09:27
*** chlong has quit IRC09:29
*** ppai has joined #openstack-swift09:40
openstackgerritDoron Chen proposed openstack/swift: Added a test for delayed reap.  https://review.openstack.org/32104109:41
*** acoles_ is now known as acoles09:42
openstackgerritAlistair Coles proposed openstack/swift: crypto - remove default root secret  https://review.openstack.org/31820809:42
*** mkrcmari__ has quit IRC09:43
*** chlong has joined #openstack-swift09:46
*** mvk has joined #openstack-swift09:47
*** manous has joined #openstack-swift09:54
*** takashi has joined #openstack-swift10:01
*** admin6 has joined #openstack-swift10:01
*** SkyRocknRoll has quit IRC10:08
*** pcaruana has joined #openstack-swift10:11
*** chlong has quit IRC10:15
openstackgerritDoron Chen proposed openstack/swift: Added a test for delayed reap.  https://review.openstack.org/32104110:19
*** SkyRocknRoll has joined #openstack-swift10:21
*** chlong has joined #openstack-swift10:27
openstackgerritAlistair Coles proposed openstack/swift: crypto: Verify on-disk data  https://review.openstack.org/31968310:36
openstackgerritMerged openstack/swift: crypto: use derived iv for container listing etag  https://review.openstack.org/32197010:42
mahaticacoles: thanks for fixing nits (oops about env args) and approving10:43
acolesmahatic: np :)10:43
*** Shashikant86 has joined #openstack-swift10:46
*** Shashikant86 has quit IRC10:48
*** permalac has joined #openstack-swift10:48
openstackgerritAlistair Coles proposed openstack/swift: crypto - more tests for other middleware overrides  https://review.openstack.org/32163811:00
*** dmk0202 has quit IRC11:07
*** raildo-afk is now known as raildo11:13
*** sams-gleb has quit IRC11:14
*** psachin has quit IRC11:42
*** dmk0202 has joined #openstack-swift11:42
*** kei_yama has quit IRC11:50
*** sams-gleb has joined #openstack-swift11:57
*** takashi has quit IRC11:58
tdasilvagood morning12:05
*** psachin has joined #openstack-swift12:07
*** vinsh has joined #openstack-swift12:08
*** psachin has quit IRC12:12
*** psachin has joined #openstack-swift12:12
*** Jeffrey4l has joined #openstack-swift12:20
*** manous_ has joined #openstack-swift12:21
*** arch-nemesis has joined #openstack-swift12:22
*** arch-nemesis has joined #openstack-swift12:23
*** manous has quit IRC12:24
*** arch-nemesis has quit IRC12:29
CaioBrentanogood morning!12:40
*** arch-nemesis has joined #openstack-swift12:42
openstackgerritMerged openstack/swift: crypto: Verify on-disk data  https://review.openstack.org/31968312:46
*** SkyRocknRoll has quit IRC12:56
*** diogogmt has quit IRC12:56
pdardeaugood morning12:56
*** diogogmt has joined #openstack-swift12:57
openstackgerritAlistair Coles proposed openstack/swift: crypto - add test to verify ondisk container listing  https://review.openstack.org/32335513:07
*** pauloewerton has joined #openstack-swift13:11
*** bill_az_ has joined #openstack-swift13:20
*** diogogmt has quit IRC13:25
openstackgerritAlistair Coles proposed openstack/swift: crypto - purge crypto sysmeta from responses  https://review.openstack.org/32057913:26
openstackgerritAlistair Coles proposed openstack/swift: crypto - more tests for other middleware overrides  https://review.openstack.org/32163813:30
*** ppai has quit IRC13:33
openstackgerritAlistair Coles proposed openstack/swift: crypto - remove default root secret  https://review.openstack.org/31820813:33
*** bill_az_ has quit IRC13:36
*** diogogmt has joined #openstack-swift13:36
*** ozeri has quit IRC13:40
openstackgerritAlistair Coles proposed openstack/swift: crypto - stop using key id to derive GET path keys  https://review.openstack.org/31814813:42
*** klamath_ has quit IRC13:50
*** klamath has joined #openstack-swift13:51
*** ametts has joined #openstack-swift13:56
*** CarlFK has joined #openstack-swift13:56
*** admin6_ has joined #openstack-swift13:57
*** MikeG451 has joined #openstack-swift13:58
*** admin6 has quit IRC14:00
*** admin6_ is now known as admin614:00
*** diogogmt has quit IRC14:01
CarlFKI used pyrax to upload files on the cdn - https://github.com/rackspace/pyrax "recated in favor of the OpenStack SDK"14:02
CarlFKfiles = web page assets (png, mp4...)14:03
*** arch-nemesis has quit IRC14:03
CarlFKwhat's the replacment?14:03
*** StraubTW has joined #openstack-swift14:06
CarlFKhttp://docs.openstack.org/developer/python-swiftclient/swiftclient.html#swiftclient.service.SwiftService.upload14:08
*** d0ugal has quit IRC14:15
*** admin6_ has joined #openstack-swift14:16
*** d0ugal has joined #openstack-swift14:17
*** admin6 has quit IRC14:19
*** admin6_ is now known as admin614:19
openstackgerritOndřej Nový proposed openstack/swift: Fixed typo  https://review.openstack.org/32340814:26
*** StraubTW has quit IRC14:36
*** dmorita has joined #openstack-swift14:38
*** StraubTW has joined #openstack-swift14:40
*** annegentle has joined #openstack-swift14:41
*** diogogmt has joined #openstack-swift14:43
*** wasmum has quit IRC14:52
*** cdelatte has joined #openstack-swift14:56
*** rcernin has quit IRC15:07
*** daemontool_ has joined #openstack-swift15:08
*** StraubTW has quit IRC15:10
*** dmorita has quit IRC15:10
*** daemontool has quit IRC15:10
*** daemontool_ has quit IRC15:11
*** daemontool__ has joined #openstack-swift15:11
openstackgerritOndřej Nový proposed openstack/swift: swift-ring-builder --yes option  https://review.openstack.org/32343815:13
*** links has quit IRC15:15
CarlFKhttps://github.com/openstack/python-swiftclient15:16
CarlFKImportError: cannot import name 'walk'15:16
onovyhi, can someone look to https://review.openstack.org/#/c/293904/ please?15:16
patchbotonovy: patch 293904 - swift - Extend swift-init config handling documentation15:16
CarlFKwere do I report that?15:16
onovyCarlFK: hi, can you share whole backtrace please?15:19
CarlFKonovy: that's really about it.  - python3 moved walk to somewhere else15:20
CarlFK  File "upload.py", line 3, in <module>15:21
CarlFKonovy: what I would really like is an example of upload that just uploads one or two files.  all this code about walking a tree and munging strings is not something I need an example of15:23
*** arch-nemesis has joined #openstack-swift15:24
*** arch-nemesis has quit IRC15:24
*** arch-nemesis has joined #openstack-swift15:24
*** dmorita has joined #openstack-swift15:24
*** dmorita has quit IRC15:31
*** dmorita has joined #openstack-swift15:31
*** openstackgerrit has quit IRC15:33
*** openstackgerrit has joined #openstack-swift15:34
*** StraubTW has joined #openstack-swift15:34
*** psachin has quit IRC15:35
*** pietervanw_ has quit IRC15:36
*** dmorita has quit IRC15:36
*** marok has joined #openstack-swift15:37
onovyCarlFK: https://bugs.launchpad.net/python-swiftclient/+filebug15:38
*** wasmum has joined #openstack-swift15:38
CarlFKthanks15:38
onovyhttps://github.com/openstack/python-swiftclient/blob/master/doc/source/client-api.rst15:39
onovy"uploads one or two files" ^^15:39
onovyhigher-level API: https://github.com/openstack/python-swiftclient/blob/master/doc/source/service-api.rst15:39
joeljwrightCarlFK: thanks for the report15:41
CarlFKonovy: "Create a new object with the contents of a local text file:"  that's what I was  looking for.  thank you !!!15:41
*** dmk0202 has quit IRC15:42
onovyCarlFK: you are welcome15:43
*** sams-gleb has quit IRC15:47
*** _JZ_ has joined #openstack-swift15:51
*** tesseract has quit IRC15:54
*** lakshmiS has joined #openstack-swift15:54
*** pcaruana has quit IRC15:59
notmynamegood morning15:59
*** gyee has joined #openstack-swift16:00
notmynameit was a long holiday weekend in the US. time to dive back into openstack stuff16:01
tdasilvanotmyname: hope you had a good time16:02
notmynameyeah, I did. the family went camping16:02
tdasilvanice :-)16:02
CarlFKhttps://github.com/openstack/python-swiftclient/blob/master/doc/source/service-api.rst#example-6  "The code below demonstrates the us of..."16:08
CarlFKUm, there is no code below.16:09
joeljwrightCarlFK: those docs really aren't supposed to be read there - the examples aren't inlined16:09
notmynameCarlFK: you're looking at the raw source, not the generated docs. start with http://docs.openstack.org/developer/python-swiftclient/ (and the doc you're looking at is http://docs.openstack.org/developer/python-swiftclient/apis.html#the-swiftclient-swiftservice-api)16:10
CarlFKah.. that makes sense16:10
joeljwrightnotmyname: can we get the new docs online soon?16:11
notmynamejoeljwright: yeah, that would be really great, wouldn't it.16:11
joeljwrightCarlFK: the code examples for the service-api.rst page are in the examples folder16:11
notmynamejoeljwright: hmm...here's an idea. instead of us waiting on "them" (whoever that is) to get the versioning thing in the sidebar, let's push forward with the updated docs and get "them" to catch up16:12
joeljwrightCarlFK: https://github.com/openstack/python-swiftclient/tree/master/examples16:12
joeljwrightnotmyname: makes sense16:12
joeljwrightwhat do I need to do to push it faster?16:13
notmynamejoeljwright: there's a yaml file somewhere that controls when docs are built. swiftclient needs to be changed to match whatever swift has. IIRC we'll put swiftclient into a "service" category instead of a "library" category.16:13
joeljwrightok, no problem, I'll go hunting for it16:17
*** thumpba has joined #openstack-swift16:18
notmynamejoeljwright: great, thanks!16:20
notmynamejoeljwright: after I get through my email, I'll see what I can dig up too16:20
*** thumpba has quit IRC16:23
*** thumpba has joined #openstack-swift16:24
*** rledisez has quit IRC16:24
*** StraubTW has quit IRC16:31
*** StraubTW has joined #openstack-swift16:32
notmynamejoeljwright: find anything yet?16:34
joeljwrightnotmyname: no - I'm still digging through docs contributor guides16:35
joeljwrightnotmyname: there was nothing obvious in either the swift or swiftclient repos16:35
*** garthb has joined #openstack-swift16:35
joeljwrightthis is as close as I've got: 'You will also need to add the openstack-server-publish job to the appropriate repositories so that the index page is re-published with every commit.'16:36
notmynameI'm looking through the project-config repo now. I think it will either be here or the infra-config repo16:36
notmynameah!16:36
*** StraubTW has quit IRC16:36
notmynamethat might help finding something16:36
notmynameyeah. in layout.yaml16:37
*** vinsh has quit IRC16:38
notmynamejoeljwright: swift has openstack-server-publish-jobs. swiftclient has openstack-client-publish-jobs16:39
*** vinsh has joined #openstack-swift16:39
joeljwrightwhere is this?16:39
joeljwrightwhich repo?16:39
notmynameI think swiftclient needs the server publish jobs, but I need to find the definitions of those16:39
notmynamein openstack-infra/project-config repo in zuul/layout.yaml16:40
joeljwrightaha16:40
joeljwrightthanks16:40
*** permalac has quit IRC16:42
notmynameand the jobs are defined in the same file16:43
notmynamejoeljwright: do you want to do the honors?16:43
*** vinsh_ has joined #openstack-swift16:43
*** vinsh has quit IRC16:44
joeljwrightare we agreed that the only difference between the server publish and client publish jobs is that the client one only publishes on a release tag?16:44
joeljwrightif so I'll just submit a patch to change the client to server-publish16:45
*** asettle has quit IRC16:45
joeljwrightnotmyname: looking at the job definitions in project-config/jenkins/jobs/openstack-publish-jobs.yaml that looks like the only difference16:47
*** sams-gleb has joined #openstack-swift16:47
notmynameyep16:48
notmynameI agree16:48
joeljwrightkk, patch on its way shortly16:48
notmynamejoeljwright: thanks. I'll +1 it with words saying something like "yes, really. this is what we want. it's ok"16:49
*** mvk has quit IRC16:51
*** sams-gleb has quit IRC16:52
joeljwrightnotmyname: this might be more complex - the layout also specifies publish-to-pypi, so is this only run on releases?16:57
*** fcantournet has quit IRC16:58
joeljwrightnotmyname: probably not - that looks like it only runs on release anyway16:58
joeljwrightright, patch incoming16:58
*** links has joined #openstack-swift17:00
*** rcernin has joined #openstack-swift17:01
*** diogogmt has quit IRC17:02
*** stewie925_ has joined #openstack-swift17:02
*** diogogmt has joined #openstack-swift17:03
notmynamejoeljwright: I see it. thanks17:05
joeljwrightblimey, that was fast17:05
*** jaakkos has quit IRC17:05
*** jaakkos has joined #openstack-swift17:05
joeljwrightnotmyname: I didn't even have time to copy the link to post here :)17:05
*** dmorita has joined #openstack-swift17:06
*** nadeem has joined #openstack-swift17:07
notmynamejoeljwright: I gotta keep up that mystique of not letting any swift-related things go unnoticed. ;-)17:07
openstackgerritMerged openstack/swift: Fixed typo  https://review.openstack.org/32340817:07
*** nadeem has quit IRC17:08
joeljwright:)17:09
*** nadeem has joined #openstack-swift17:09
*** links has quit IRC17:11
*** joeljwright has quit IRC17:11
notmynametimburke: around?17:22
*** manous_ has quit IRC17:26
*** klrmn has joined #openstack-swift17:26
*** acoles is now known as acoles_17:32
*** asettle has joined #openstack-swift17:37
*** wasmum has quit IRC17:41
*** timur has joined #openstack-swift17:43
*** asettle has quit IRC17:46
*** suyash has joined #openstack-swift17:46
CarlFKhttps://github.com/openstack/python-swiftclient/blob/master/examples/upload.py17:46
CarlFKcan someone tell me how auth credentials are handled ?17:46
*** sams-gleb has joined #openstack-swift17:49
notmynamentata: FYI https://review.openstack.org/#/c/312718/ will be discussed at today's TC meeting. that should determine what happens with your patch https://review.openstack.org/#/c/313676/17:49
patchbotnotmyname: patch 312718 - governance - add resolution explaining which tests we think def...17:49
patchbotnotmyname: patch 313676 - swift - add Tempest Plugin for functional tests17:49
*** sams-gleb has quit IRC17:53
*** daemontool__ has quit IRC17:54
*** daemontool has joined #openstack-swift17:55
*** timur has quit IRC17:59
*** timur has joined #openstack-swift18:00
*** annegentle has quit IRC18:04
*** ChubYann has joined #openstack-swift18:08
*** ChubYann has quit IRC18:09
*** ChubYann has joined #openstack-swift18:09
ntatanotmyname, looking forward to know what happens with it..18:10
*** wasmum has joined #openstack-swift18:18
openstackgerritJohn Dickinson proposed openstack/swift: add explicit HA info to the deployment guide  https://review.openstack.org/32352418:28
claygheyoh!18:30
notmynamethat patch is because I want to be explicit about HA in swift so that it's easy to add something to http://docs.openstack.org/ha-guide/index.html so that we can also qualify for the HA tag when that gets approved18:30
notmynameclayg: did you see all the great stuff briancline added to the golang readme? cool stuff18:31
claygnotmyname: just saw the email from gerrit - haven't read it yet - nice work briancline18:32
notmynameyeah, I'm looking forward to walking through it too18:32
*** wasmum has quit IRC18:36
*** sams-gleb has joined #openstack-swift18:49
*** sams-gleb has quit IRC18:54
*** asettle has joined #openstack-swift18:54
*** rvasilets__ has joined #openstack-swift18:57
*** asettle has quit IRC18:59
*** klrmn has quit IRC19:01
claygweeee19:04
*** dmorita has quit IRC19:10
*** adu has joined #openstack-swift19:12
*** dmorita has joined #openstack-swift19:13
*** tqtran has joined #openstack-swift19:15
*** dmorita has quit IRC19:18
openstackgerritMerged openstack/swift: go: Add tons of SAIO+Hummingbird details to readme  https://review.openstack.org/32240119:19
*** klrmn has joined #openstack-swift19:23
claygoh snap!19:24
*** sheel has quit IRC19:25
*** Jeffrey4l_ has joined #openstack-swift19:32
*** Jeffrey4l has quit IRC19:34
*** gyee has quit IRC19:35
*** daemontool has quit IRC19:38
*** wasmum has joined #openstack-swift19:40
hurricanerixI was just looking at that ^^^ and it says the object-server is considered  "feature-complete".  Should that be updated to say "almost feature-complete", then list what is missing?  Or can we ignore it since it should be feature complete by the time it lands to master?19:40
notmynameI'd actually ignore it for a different reason. what's currently on the hummingbird branch is different than what needs to be brought to master. yeah, the object server will be more feature complete, but the proxy won't be brought over. but really, there isn't going to be a merge from current hummingbird branch to master exactly, so I'm ok with ignoring stuff like that19:42
*** mvk has joined #openstack-swift19:42
notmynameand now that the TC threads (may) have died down somewhat, I hope to start working with everyone to define what that set of stuff we're bringing into master actually is19:43
notmynamein fact, I had just switched over to the hummingbird branch to go through the new stuff in the readme :-)19:43
*** dmorita has joined #openstack-swift19:45
*** adu has quit IRC19:46
*** sams-gleb has joined #openstack-swift19:51
hurricanerixahh, ok, sounds good.19:56
*** sams-gleb has quit IRC19:56
*** asettle has joined #openstack-swift20:03
*** dmk0202 has joined #openstack-swift20:05
*** garthb_ has joined #openstack-swift20:09
*** garthb has quit IRC20:10
CarlFKdoes anyone know of some code that uses swift.upload  (which is really with SwiftService(options=_opts) as swift20:11
pdardeaummotiani: did any of your recent changes pertaining to region happen to touch the man page for swift-ring-builder?20:13
mmotianipdardeau, Yes20:13
mmotianipdardeau: Oh wait. no not yet20:14
mmotianiit still needs to be merge20:14
notmynamentata: patch 312718 was approved by the TC. so that means that in-tree tests for swift can *not* be used for defcore compliance. all tests which check for defcore's required capabilities must now live in the tempest repo20:14
patchbotnotmyname: https://review.openstack.org/#/c/312718/ - governance - add resolution explaining which tests we think def...20:14
ntatanotmyname, :(20:14
notmynamentata: which implies that your patch to make our functional tests work as a tempest plugin perhaps just lost their biggest reason for existing20:15
notmynamentata: yeah, I agree. :-(20:15
*** daemontool has joined #openstack-swift20:15
*** CarlFK has quit IRC20:15
pdardeaunotmyname: are the defcore required capabilities documented somewhere?20:16
ntatanotmyname, does that mean that tempest will have a separate set of tests to test our APIs? Wouldn't that be a duplicated copy from what already exists in swift repo?20:17
ntatatempest always had their own set of object storage tests.. but who maintains them?20:17
notmynamentata: yes, and they're maintained by the tempest team20:18
pdardeaummotiani: which patch is it?20:18
notmynamepdardeau: this is totally not snarky. the most readable thing I've seen is https://github.com/openstack/defcore/blob/master/2016.01/2016.01.required.txt (look for the object_storage stuff at the end)20:19
notmynamethere's also some json files in that repo that also have definitions. eg https://github.com/openstack/defcore/blob/master/next.json20:20
notmynameso https://github.com/openstack/defcore/blob/master/next.json#L102 starts the list of required capabilities, and you find what that means later in that same doc20:21
pdardeaunotmyname: thx. i don't think i would've ever stumbled upon that20:21
notmynameand a capability is defined by a set of tests that must pass20:21
notmynameeg https://github.com/openstack/defcore/blob/master/next.json#L167620:22
notmynameI don't know what achievements are20:22
*** joeljwright has joined #openstack-swift20:22
*** ChanServ sets mode: +v joeljwright20:22
claygnotmyname: it's for like when you complete boss battles in a video game - like you unlocked the defate OSML troll achievement20:24
notmynamehmmm...seems there's a difference between objectstore-object-put and objectstore-object-create and objectstore-object-upload20:26
*** dmk0202 has quit IRC20:28
pdardeauso many helpful comments lately20:28
*** daemontool_ has joined #openstack-swift20:31
*** daemontool has quit IRC20:33
*** dmk0202 has joined #openstack-swift20:44
*** raildo is now known as raildo-afk20:47
*** gyee has joined #openstack-swift20:48
*** sams-gleb has joined #openstack-swift20:52
openstackgerritMohit Motiani proposed openstack/swift: Add region in search-value of swift-ring-builder manpage  https://review.openstack.org/32358020:56
claygoh snap!20:56
*** sams-gleb has quit IRC20:57
notmynamegophers, do I have to have pwd in the current $GOPATH to be able to make stuff work?20:57
openstackgerritMohit Motiani proposed openstack/swift: Add region in search-value of swift-ring-builder manpage  https://review.openstack.org/32358020:58
zaitcevI don't even have GOPATH20:58
zaitcev(but Hummingbird may require it)20:58
notmynameeg on the new stuff in the README, it says symlink the swift code checkout to the $GOPATH, then cd to $GOPATH and do the `make ...` dance20:58
zaitcevI hate the dumb idea of the "workspace". Rob Pike imported that shit from Android and it SUKETH.20:58
notmynamewhat if I had cd'd to the code instead of the pwd20:58
zaitcevWhat? Make now? I guess I need to read that readme...20:59
notmynameyeah, it's got a Makefile and everything :-)20:59
zaitcevGood lord21:00
openstackgerritMohit Motiani proposed openstack/swift: Add region in search-value of swift-ring-builder manpage  https://review.openstack.org/32358021:00
redboActually now that I think about it, using /opt/hummingbird is weird for dev.  My GOPATH is /home/redbo/go21:00
notmynameI suppose redbo could have written a "Go Build Reasonableness" or something...21:00
notmynameredbo: yeah, the permissions setup with that is weird21:00
zaitcevYeah, at least ~go21:00
zaitcev~/go21:00
notmynamemaybe briancline just runs everything as root ;-)21:01
notmynameok, so if $GOTPATH is ~/go in my SAIO, that's ok? or can I have $GOPATH as the actual "go" subdir in the swift source tree?21:02
*** daemontool_ has quit IRC21:02
zaitcevYou can but then you have to change it for every project. Maybe that Makefile sets GOPATH though21:02
redboIt needs to be ~/go, and under that src/github.com/openstack/swift21:02
notmynameok, thanks21:03
*** thumpba has quit IRC21:03
redboWell there is gb that does go builds more conventionally rather than having a GOPATH.21:03
zaitcevInteresting.21:04
notmynameah ha. and I must be in $GOPATH for the make commands to work21:06
notmynamebeing in ~/swift/go doesn't cut it21:06
zaitcevWell duh. You didn't hack on Android before?21:07
zaitcevTrying to recall another system with "workspace" idea. SunPro did that for C++, IIRC.21:08
claygnotmyname: there's some great rants about "why the fuck does go care so much about my fucking project layout!?" and "fuck you go just follow symlinks and stop being so fucking annoying" - they're great.21:08
notmynamesounds fun!21:08
claygyeah you can google for it21:08
zaitcevSo far my hatred only released as these small things https://github.com/zaitcev/cld2/blob/master/make.sh21:09
notmynameI'll look for those exact quotes ;-)21:09
notmynameok, so where is DESTDIR in the Makefile set? ie why does `make install` want to install to /usr/bin?21:09
*** pauloewerton has quit IRC21:10
notmynameah I see. it's *not* set. so it's going to the root. and so I should set it to put it in ~ or something21:11
notmynameredbo: what are you doing on your dev box?21:11
notmynameredbo: where do you `make install` to?21:11
*** garthb_ has quit IRC21:12
redbosudo make develop21:12
notmynameoh! develop. that sounds more normal to my python brain21:13
redboso it symlinks /usr/local/bin/hummingbird to (all that stuff)/bin/hummingbird and I just have to recompile it and it's picked up.  But that may change.21:13
*** garthb_ has joined #openstack-swift21:14
claygthat (great|terrible) thing about Makefiles' is you can teach them to do *anything*21:14
redboI think we need to move go/cmd/hummingbird.go to go/cmd/hummingbird/main.go and then we don't really need the make file so much, "go build ./..." will build the binary and then put it into $GOPATH/bin like it's supposed to.21:14
notmynamebah. of course root doesn't have my env set up...21:15
redboclayg: that will also fix it making a "cmd" executable21:16
claygredbo: i don't remember complaining about that (or what that means) - but it sounds like a good idea21:17
claygoh, maybe i sorta remember that21:18
notmynameredbo: when would be a good time to merge from master? current hummingbird branch doesn't know about copy middleware?21:19
notmynameapparently I really like ?21:19
notmyname????21:20
redboWhenever, I just never think to do it.21:20
notmynameok. after I get through this I can do it (if you haven't by then)21:21
redboWe still haven't touched anything outside of go/ so it's usually pretty smooth.21:22
notmynamewoohoo! I have now (for the first time ever) written 4 bytes with hummingbird and successfully gotten them back out of the system21:22
zaitcevHummingbird does not support reverse listings I expect21:25
zaitcevWhich version middleware wants or something like that.21:25
zaitcevtst\n ?21:25
redboThat doesn't touch object server21:25
zaitcevoh, right. I'm dumb.21:26
zaitcevWaaait a moment. That sounds like a project! Is anyone working on accounts and containers in Go?21:26
zaitcevbrb21:27
*** CarlFK has joined #openstack-swift21:27
notmynamehttps://gist.github.com/notmyname/18fcf28d05c5f4ff059613a6ac9853e921:29
notmynamewheeee21:30
notmynameit's like I'm living in the future21:30
notmyname(which is a year ago in redbo's timeframe)21:30
claygnotmyname: now run the benchmark on the replicators!21:30
*** lakshmiS has quit IRC21:31
claygredbo: does the object server devcie limit stuff do some trick where it holds the connection for a few seconds before dropping it if a device is "too busy"?21:32
redboIt does that for replication, but not regular operations.21:33
claygoh, but the default is 25 now maybe?21:34
claygmaybe it was always 25 and i lost my mind...21:34
redboI don't remember if that changed recently.21:35
openstackgerritJohn Dickinson proposed openstack/swift: small tweaks to the golang readme  https://review.openstack.org/32359721:38
claygnotmyname: I think the hummingbird branch of vagrant-swift-all-in-one sorta works too21:38
*** dmk0202 has quit IRC21:38
openstackgerritJohn Dickinson proposed openstack/swift: Merge branch 'master' into feature/hummingbird  https://review.openstack.org/32359921:42
notmynameredbo: please +2/+A if that looks good to you21:43
redboIs this going to make a bunch of emails?21:43
claygheh21:44
notmynameyeah, probably21:44
claygredbo: do it!  email make people feel important!21:44
redboMy openstack email folder will go from 11,000 unread to 11,025 unread21:45
claygredbo: that's the ticket!21:46
notmynamelol21:46
notmynamewow. look at all those emails!22:02
*** asettle has quit IRC22:06
notmynameok, so I'm new to this whole go thing22:10
notmyname`go get` fetches all my dependencies into GOPATH?22:10
notmynameand `go vet` does ...?22:10
redboYes, and go vet does some basic static analysis checks for common mistakes.22:11
notmynameah ok.22:11
notmynamewhat's the "./..." mean? the triple dots?22:11
*** CaioBrentano has quit IRC22:11
redboit tells it to do whatever in all the sub-directories22:12
notmynameok, thanks. ... is about the most ungooglable thing I've seen22:12
notmyname`go test` is a built-in test framework? kinda like unittest in python?22:12
redboYeah22:13
notmynameor is it more like nose in that it discovers and runs tests?22:13
redboMore like nose22:13
notmynameah ok22:13
notmynamethe pattern is foo.go and foo_test.go?22:13
*** nadeem has quit IRC22:13
notmynameint he same dir?22:13
redboYes22:14
*** ametts has quit IRC22:14
notmynameredbo: half joking, but not really, question. how does gholt do golang with his 80-char-wide terminal?22:14
notmynameI mean, my editor's setup is kinda tuned for python. any hints for go formatting?22:15
notmynameI mean, tabs?!22:15
claygrofl22:15
claygnotmyname: install govim?22:15
notmynameclayg: seems like https://github.com/DisposaBoy/GoSublime might be what I need22:17
notmynameor it might be terrible. let's find out!22:17
zaitcevnotmyname: You can use Solaris tabs for anything in parenthesis, like https://github.com/zaitcev/cld2/blob/master/cld2.go#L7922:20
zaitcevnotmyname: also, :=22:20
claygwee we're havig fun!22:21
zaitcevSo, 80-character terminal is no problem with Go. It's only a problem with a shared Go project with other people, some of which may be jerks and sociopaths22:21
claygIF YOU TYPE 81 CHARS I WILL *KILL* YOU22:22
zaitcevI meant to say may be brilliant developers who do not need to abide by the obsolete conventions.22:22
*** joeljwright has quit IRC22:23
claygbetter22:23
clayg:P22:23
mattoliveraumorning22:24
redboSome people use govim, I don't, I just have a little code in my vimrc that runs goimports when I save the file.22:25
*** geaaru_ has quit IRC22:28
*** CarlFK has quit IRC22:34
*** MikeG451 has quit IRC22:35
notmynameredbo: so would it be reasonable to update ./.unittests with go vet and go test?22:36
redboYeah, that seems like it'd be reasonable.22:38
notmynameok22:38
notmynameredbo: what would it take to teach swift-init how to start/stop the golang code? or to back up a bit, why'd you choose to write a different launcher instead of using swift-init?22:44
zaitcevThis may be a bad time to mention that Red Hat recommends using normal SystemD units, which our packaging provides with "dnf install openstack-swift".22:46
*** wasmum has quit IRC22:46
redboI don't think it would be too bad, clayg was working on that.22:46
notmynamezaitcev: I wouldn't know a normal systemd unit from an abnormal one. so what would that look like in swiftlandia?22:47
notmynameredbo: yeah, he said (in the office) that he had a start of something, but it's not done and he's doing other stuff at the moment22:47
zaitcevsystemctl enable openstack-swift-proxy22:47
zaitcevBut personally I still use swift-init.22:48
notmynamezaitcev: what do we have in our repo to implement that?22:48
zaitcevI'm just mentioning it so that you know that our binaries are pefectly well behaved for any start system... Maybe we could just take what redbo has for hummingbird and run everything else under it, I dunno.22:49
notmynamezaitcev: oh ok22:49
notmynameI was hoping that we could keep one thing for all of swift and have swift-init Just Work(tm) for anyting swift related you want to do.22:50
zaitcevI'm obligated to write missing SystemD units... in exchange for money. But if you run on OSX or Windows that's of no use to you.22:50
notmynameshort-term, I don't want to rewrite my resetswift et al scripts to do hummingbird stuff. long term, I think ops should continue to use swift-init (or whatever calls swift-init) and it just keeps working regardless of the implementation22:51
notmynamezaitcev: yeah, but if you're trying to run swift on osx or windows, umm... I may have some bad news for you22:51
zaitcevoh, right... XFS22:51
notmynamemeh. doesn't really require xfs. just anythign that has xattrs22:51
notmynamewow. swift on HFS+. what a world (of pain)22:52
notmynamesomeone once said that's the worst filesystem ever http://www.cio.com/article/2868393/linus-torvalds-apples-hfs-is-probably-the-worst-file-system-ever.html22:53
*** sams-gleb has joined #openstack-swift22:53
redboI was just working on getting it compiling on osx.  More for dev than actually running it.  Also I suspect once it works on osx, it'll work on freebsd too.22:54
claygredbo: it would have been trivial except for the differences about which args go where and with what names - i'm not I really care for the direction i was going -> https://gist.github.com/clayg/9f837a37bb3943aa7c368b578e9d515122:55
claygnotmyname: ^^22:55
mattoliverauThere is a go language plugin for all Jet Brains IDE's so it works on Py Charm.. apparently, I haven't used it yet. But I might give it a go, and yeah I'll have to install govim too now.22:56
*** rvasilets__ has quit IRC22:56
*** sams-gleb has quit IRC22:58
claygalso til dnf is the new yum22:58
notmynameoh is that what that is? I had heard of dtf and diaf and bnf.23:00
*** darrenc is now known as darrenc_afk23:03
hurricanerixi use atom, which has some nice go packages23:06
openstackgerritMerged openstack/swift: small tweaks to the golang readme  https://review.openstack.org/32359723:08
hurricanerixspecifically autocomplete-go, go-plus and go-debug i think are the ones i have loaded23:08
*** nadeem has joined #openstack-swift23:12
stewie925_hello, would like some assistance with creating a test case for https://review.openstack.org/#/c/31998823:12
notmynamestewie925_: sure23:13
notmynamestewie925_: looks like it should be relatively simple23:14
stewie925_hi notmyname23:14
notmynamestewie925_: look in test/unit/common/ring/test_ring.py. that's where all of the unit test coverage for the file you modified is23:14
stewie925_its my first time to do unit test - am working with my colleague who submitted the code change23:14
notmynamestewie925_: since you're updating _get_part_nodes, then you need to add a test case that will specifically test the code path you added23:15
stewie925_yes, I do see the test_ring and I know the test_get_part_node needs to be updated to accomodate the test for the new 'if' condition23:15
notmynamestewie925_: you should add a new test_get_part_nodes_out_of_bounds() (or something similarly named)23:15
stewie925_ohh23:15
notmynamestewie925_: and pass in good/bad values for part and ensure that the ValueError is raised23:15
notmynamethat's it23:15
stewie925_ahh that is to test the negative condition for the get_part_nodes....23:16
notmynamestewie925_: if you look at the coverage report that's generated at the end of the unittest run, you should see that the lines you added to ring.py are now covered (whereas they aren't now)23:16
stewie925_oh I see23:17
notmynameredbo: is it good practice to always do `make get test` instead of just `make test`? ie is the `make get` thing something I should always do before anything else?23:19
*** diogogmt has quit IRC23:19
stewie925_thank you notmyname !23:19
notmynamestewie925_: thanks for working on it!23:20
notmynamestewie925_: is this something you saw yourself when using swift? or is it something where you found an open bug and jumped in to help?23:20
notmynamestewie925_: hmm...seems like it doesn't pass the pep8/flake8 test either. you'll need to fix that before it can land23:21
stewie925_yeah it was a bug that my co-worker saw, and he fixed it but needed help with test case creation, so I jumped in and helped23:21
stewie925_yes, we had issues running pep8 on local machine23:21
notmynamestewie925_: cool. now you've got me curious. how are you using swift today? what are you doing with it?23:21
stewie925_actually, let me go ahead and run the pep8 test locally with his fix23:21
stewie925_hello,  pretty much an Openstack newbie here, was looking for low-hanging fruits to fix23:22
*** nadeem has quit IRC23:23
*** darrenc_afk is now known as darrenc23:23
notmynamestewie925_: it would seem that there are also some other tests that are hitting that code path and throwing an error. http://logs.openstack.org/88/319988/2/check/gate-swift-python27/9aad670/console.html.gz#_2016-05-23_18_05_39_36223:24
notmynamestewie925_: you'll probably need to doctor up the other code too to get the tests all passing23:24
notmynamestewie925_: you can run the tests locally with `tox -epy27` or `./.unittests`23:25
redbonotmyname: I usually only run it when dependencies change or setting up a new system.  But I imagine dependency management will be something openstack decides there's a way to do.23:25
notmynameredbo: you said glide looked reasonable?23:25
openstackgerritJohn Dickinson proposed openstack/swift: added golang tests to .unittests  https://review.openstack.org/32361723:26
clayglol @ reconstructor tests blowing up with the get_part_nodes validation - what a whole can of worms get unravleded fixing that interface to blow up when you give it garbage23:26
redboYeah, I think so.  But I haven't used it enough to figure out how it sucks.23:26
notmynameheh23:27
stewie925_hi notmyname  sorry I am back23:27
notmynameredbo: so if I can figure out where ./.unittests are called from some test job, that patch should then give us golang unittests in the gate for free (ie not needing to rely on your non-voting ones)23:28
stewie925_I am running the pep8 test locally to fix the pep8 issue23:28
claygnotmyname: won't it need to like install go setup all that stuff and compile them before it can run tests?23:28
notmynameredbo: but alas, I don't think .unittests is actually called. it's just using nosetests23:28
claygnotmyname: or tox?23:29
notmynameclayg: yeah, but redbo already wrote all that down at https://gist.github.com/redbo/d7133a069341a2f1711923:29
*** kei_yama has joined #openstack-swift23:29
notmynameclayg: so my plan is to get that into a script in the source repo and then get the -infra CI jobs to call it. then, ta da! upstread golang tests23:29
claygnotmyname: ok, good luck - -infa is down the docker?23:30
notmynamenah, not going to worry with that23:30
notmynamegoing to try more for the stuff that's in the README23:30
notmynameand that's where I'll be working with the -infra team to get it set up23:30
redboIt's medium hard getting docker to run with a filesystem that supports xattrs.  It does that unified filesystem thing by default.23:30
claygnotmyname: but isn't that the part that sets up has path suffix and downloads golang?23:31
notmynameyeah, but it's not like docker is the only way to do that23:31
claygnotmyname: ok, sorry - i'm sure it's all doable - gl23:32
notmynameheh23:32
notmynamemostly I want to write an email that's along the lines of "while you were discussing if this is allowed, we went ahead and did it and it's great"23:32
notmyname;-)23:32
notmynamestewie925_: and? what did the local pep8 say?23:33
stewie925_yikes its giving me errors - its in http://paste.openstack.org/show/506666/23:34
*** arch-nemesis has quit IRC23:35
notmynamestewie925_: here's a shortcut that can avoid that stuff for the time being: git diff HEAD~1 --name-only | grep '\.py$' | xargs pep8 -r'23:36
stewie925_I checked out changes from https://review.openstack.org/#/c/319988/2   and ran 'tox -e pep8' and got those errors23:36
patchbotstewie925_: patch 319988 - swift - get_part_nodes should raise error on invalid part23:36
notmynamestewie925_: yeah, you'll need to get that fixed (ie install liberasurecode) long-term, but that bash command above will work for just getting something done for this patch23:37
openstackgerritMerged openstack/swift: Merge branch 'master' into feature/hummingbird  https://review.openstack.org/32359923:38
notmynamestewie925_: shortcut for getting liberasurecode (and anything else that's needed that's not a python dependency) is to look in other-requirements.txt23:38
notmynamestewie925_: `bindep -b` run from in the source tree on your dev box will show you what's not installed23:40
stewie925_the source tree should be /home/swift in this case I believe?23:41
notmynamestewie925_: is this on your SAIO?23:41
stewie925_on my virtualbox23:42
stewie925_vm23:42
notmynamehow did you set up your dev environment? ie how'd you make/configure that vm?23:42
stewie925_hi it was part of the instructions to set up devstack23:43
notmynameah23:44
notmynamewell then23:44
notmynameok23:44
notmynameso using devstack might work. probably works. you've got a good chance of being able to do something23:45
notmynamepersonally, I don't use it. nor do any of the other swift devs who are contributing. devstack doesn't really set up a swift environment that tests swift in any interesting ways (multiple drives, storage polices, etc)23:46
zaitcevWait, what. I always just run  tox -e pep8  and it works with no problems or additional tinkering, and assuredly without devstack.23:46
stewie925_hi notmyname  - (a) base memory 4500mb (b) vdi storage =64GB  (c) network 1= NAT, network 2 = virtualbox hostonly Ethernet Adapter23:46
notmynamestewie925_: however, don't be discouraged!23:46
notmynamestewie925_: ok, so let's try to work with what you have for the time being23:46
*** CarlFK has joined #openstack-swift23:46
notmynamestewie925_: wherever the source is checked out in your devstack vm, you can make sure the dependencies are installed (using bindep as above)23:47
notmynamestewie925_: then the tox commands should work for you23:47
stewie925_let me run the 'bindep -b'  from the swift directory23:48
notmynamestewie925_: but after you get through this patch, there's a better way to have a long-term swift dev environment23:48
stewie925_yeah it couldnt find bindep23:48
notmyname`pip install bindep`23:49
notmynameit's turtles all the way down23:49
stewie925_oh, thank you so much23:50
stewie925_let me do that23:50
*** dmorita has quit IRC23:50
stewie925_should I just run the pip install on the home directory?23:50
stewie925_or on the project (ie, swift) directory23:51
notmynamecschwede: for when you wake up, sdague and clarkb took a look at patch 304465. seems like there might be an issue still since the gate-tempest-dsvm-multinode-full job isn't passing. but they were talking about it in the -infra channel earlier today, so you should check those logs too23:51
patchbotnotmyname: https://review.openstack.org/#/c/304465/ - openstack-infra/devstack-gate - Use subnodes for Swift storage nodes in a multinod...23:51
notmynamestewie925_: in the project. ie in the directory with the code23:51
stewie925_oh thank you23:52
*** dmorita has joined #openstack-swift23:52
*** dmorita has quit IRC23:53
*** dmorita has joined #openstack-swift23:53
stewie925_OSError: [Errno 13] Permission denied: '/usr/local/bin/pbr'23:53
*** chlong has quit IRC23:53
stewie925_the download looks good -  but the install process failed -  http://paste.openstack.org/show/506667/23:55
notmynameyep. permissions issue. use sudo23:55
stewie925_can i pvt msg you?23:57
notmynamestewie925_: yes, but I'm probably going home soon. unless it's sensitive info or something, keeping the conversation in here means that there might be other people who can help if I'm not online :-)23:58
stewie925_ahh sure no problem :)23:58
notmynamestewie925_: what time zone are you in?23:59
stewie925_Pacific time zone - almost 'done' for the day too23:59
notmynameah. me too23:59
stewie925_but let me share this - we can continue tomorrow :)23:59
stewie925_http://paste.openstack.org/show/506668/23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!