Tuesday, 2014-07-01

tsg_notmyname:  just checked out the dashboard.  looks great .. thanks00:08
*** annegent_ has joined #openstack-swift00:15
*** zigo has quit IRC00:17
*** zigo has joined #openstack-swift00:21
*** annegent_ has quit IRC00:23
*** dmorita has joined #openstack-swift00:26
*** zigo has quit IRC00:35
*** tsg_ has quit IRC00:38
*** mwstorer has quit IRC00:39
*** tsg has joined #openstack-swift00:40
*** zz_wasmum is now known as wasmum00:42
*** wasmum is now known as zz_wasmum00:42
*** zigo has joined #openstack-swift00:47
*** ho has joined #openstack-swift01:12
*** nosnos has joined #openstack-swift01:24
*** byeager has joined #openstack-swift01:55
*** byeager_ has joined #openstack-swift01:59
*** byeager_ has quit IRC02:01
*** byeager has quit IRC02:02
*** byeagerz is now known as byeagerz_away02:04
*** nsquare has quit IRC02:11
*** annegent_ has joined #openstack-swift02:18
*** annegent_ has quit IRC02:23
*** tongli has quit IRC02:24
*** bkopilov_ has quit IRC02:27
*** zhiyan_ is now known as zhiyan02:38
*** zhiyan is now known as zhiyan_02:50
*** zhiyan_ is now known as zhiyan02:51
*** cm2 has quit IRC03:12
*** annegent_ has joined #openstack-swift03:18
*** annegent_ has quit IRC03:24
*** nosnos has quit IRC03:38
*** annegent_ has joined #openstack-swift03:38
*** annegent_ has quit IRC03:41
*** annegentle has joined #openstack-swift03:42
*** chandan_kumar has joined #openstack-swift03:59
*** sileht has quit IRC04:06
*** bkopilov_ has joined #openstack-swift04:08
*** sileht has joined #openstack-swift04:09
*** ho has quit IRC04:09
*** ho has joined #openstack-swift04:09
*** fifieldt has quit IRC04:11
*** gyee has quit IRC04:11
*** annegentle has quit IRC04:11
*** occupant has quit IRC04:11
*** lpabon has quit IRC04:11
*** charz has quit IRC04:11
*** ekarlso has quit IRC04:11
*** chmouel has quit IRC04:11
*** gyee_ has quit IRC04:11
*** anderstj has quit IRC04:11
*** alpha_ori has quit IRC04:11
*** byeagerz_away has quit IRC04:11
*** jeblair has quit IRC04:11
*** swat30 has quit IRC04:11
*** pconstantine has quit IRC04:11
*** j_king has quit IRC04:11
*** yuan has quit IRC04:11
*** wer has quit IRC04:11
*** torgomatic has quit IRC04:11
*** hurricanerix has quit IRC04:11
*** jd__ has quit IRC04:11
*** portante has quit IRC04:11
*** briancline has quit IRC04:11
*** annegentle has joined #openstack-swift04:23
*** fifieldt has joined #openstack-swift04:23
*** gyee has joined #openstack-swift04:23
*** pconstantine has joined #openstack-swift04:23
*** chmouel has joined #openstack-swift04:23
*** gyee_ has joined #openstack-swift04:23
*** anderstj has joined #openstack-swift04:23
*** alpha_ori has joined #openstack-swift04:23
*** occupant has joined #openstack-swift04:23
*** byeagerz_away has joined #openstack-swift04:23
*** lpabon has joined #openstack-swift04:23
*** ekarlso has joined #openstack-swift04:23
*** charz has joined #openstack-swift04:23
*** jeblair has joined #openstack-swift04:23
*** swat30 has joined #openstack-swift04:23
*** j_king has joined #openstack-swift04:23
*** yuan has joined #openstack-swift04:23
*** wer has joined #openstack-swift04:23
*** torgomatic has joined #openstack-swift04:23
*** hurricanerix has joined #openstack-swift04:23
*** jd__ has joined #openstack-swift04:23
*** portante has joined #openstack-swift04:23
*** briancline has joined #openstack-swift04:23
*** dickson.freenode.net sets mode: +vv torgomatic portante04:23
*** goodes has quit IRC04:26
*** goodes has joined #openstack-swift04:29
*** gyee has quit IRC04:31
*** gyee has joined #openstack-swift04:31
*** kopparam has joined #openstack-swift04:35
*** kopparam has quit IRC04:41
*** kopparam has joined #openstack-swift04:42
*** nosnos has joined #openstack-swift04:45
*** nosnos has quit IRC04:51
*** nosnos has joined #openstack-swift04:51
*** nsquare has joined #openstack-swift04:52
openstackgerritNirmal Thacker proposed a change to openstack/swift: Container Auditor should log a warning if the devices path contains a non-directory.  https://review.openstack.org/9714804:56
*** zaitcev has quit IRC04:58
*** ajc_ has joined #openstack-swift04:59
*** psharma has joined #openstack-swift04:59
*** ppai has joined #openstack-swift05:05
openstackgerritClay Gerrard proposed a change to openstack/swift: Fix pop_queue for move object twice  https://review.openstack.org/10373105:05
claygnotmyname: this one is sorta crappy -> https://review.openstack.org/#/c/103731/05:07
*** kopparam has quit IRC05:20
*** kopparam has joined #openstack-swift05:21
*** dmorita has quit IRC05:21
*** chandan_kumar has quit IRC05:37
*** openfly has quit IRC05:45
*** gyee has quit IRC05:47
*** ppai has quit IRC05:58
*** nosnos has quit IRC06:01
*** nosnos has joined #openstack-swift06:03
*** ppai has joined #openstack-swift06:11
*** nthacker has joined #openstack-swift06:11
*** zigo has quit IRC06:13
*** zigo has joined #openstack-swift06:14
*** chandan_kumar has joined #openstack-swift06:41
*** kopparam_ has joined #openstack-swift06:44
*** kopparam has quit IRC06:47
*** nsquare has quit IRC06:51
*** mmcardle has joined #openstack-swift06:53
*** nsquare has joined #openstack-swift06:59
*** nsquare has quit IRC07:00
*** nthacker has quit IRC07:08
*** kopparam_ has quit IRC07:11
*** kopparam has joined #openstack-swift07:12
*** kopparam has quit IRC07:16
*** mlipchuk has joined #openstack-swift07:27
*** mkerrin has quit IRC07:33
mattoliverauThat's it for me, time to go cook dinner, night all!07:36
*** nacim has joined #openstack-swift07:38
*** openfly has joined #openstack-swift07:40
*** ppai has quit IRC07:45
openstackgerritClay Gerrard proposed a change to openstack/swift: Fix KeyError on Storage Policy Container Sync  https://review.openstack.org/10274707:50
openstackgerritClay Gerrard proposed a change to openstack/swift: Add X-Backend-Timestamp on more object server responses  https://review.openstack.org/10377607:50
openstackgerritClay Gerrard proposed a change to openstack/swift: Capture 409 Conflict during expect on PUT  https://review.openstack.org/10377707:50
openstackgerritClay Gerrard proposed a change to openstack/swift: Remove the X-Newest pre-flight request on X-Timestamp  https://review.openstack.org/10377807:50
openstackgerritClay Gerrard proposed a change to openstack/swift: Add support for multiple container-reconciler  https://review.openstack.org/10377907:50
*** kopparam has joined #openstack-swift07:50
hugokuoHola07:52
*** ppai has joined #openstack-swift07:58
openstackgerritlawrancejing proposed a change to openstack/swift: Fix the section name in CONTRIBUTING.rst  https://review.openstack.org/10378307:58
*** tsg has quit IRC08:03
openstackgerritlawrancejing proposed a change to openstack/python-swiftclient: Add CONTRIBUTING.rst  https://review.openstack.org/10378608:04
*** joeljwright has joined #openstack-swift08:09
*** mmcardle has quit IRC08:16
*** mmcardle has joined #openstack-swift08:17
*** keisuke_ has joined #openstack-swift08:19
*** nacim has quit IRC08:20
*** keisuke_ has quit IRC08:21
*** kopparam has quit IRC08:28
*** kopparam has joined #openstack-swift08:29
*** kopparam has quit IRC08:33
*** ujjain has quit IRC08:39
*** ujjain has joined #openstack-swift08:39
*** ppai has quit IRC08:58
*** foexle has joined #openstack-swift09:06
*** kopparam has joined #openstack-swift09:07
*** kopparam has quit IRC09:13
*** ppai has joined #openstack-swift09:14
*** mkollaro has joined #openstack-swift09:19
*** kopparam has joined #openstack-swift09:24
*** kopparam_ has joined #openstack-swift09:25
*** kopparam has quit IRC09:25
*** kopparam_ has quit IRC09:44
*** kopparam has joined #openstack-swift09:44
*** joeljwright has quit IRC10:11
*** joeljwright has joined #openstack-swift10:12
*** joeljwright has quit IRC10:12
*** joeljwright has joined #openstack-swift10:12
*** joeljwright1 has joined #openstack-swift10:19
*** joeljwright has quit IRC10:22
*** ppai has quit IRC10:31
*** joeljwright has joined #openstack-swift10:34
*** joeljwright1 has quit IRC10:37
*** ppai has joined #openstack-swift10:44
*** ho has quit IRC10:45
*** km has joined #openstack-swift10:45
*** km is now known as Guest8674610:46
*** chandan_kumar has quit IRC10:47
*** openstack has joined #openstack-swift10:51
*** cm2 has joined #openstack-swift10:57
*** ppai has quit IRC11:07
*** chandan_kumar has joined #openstack-swift11:20
*** ppai has joined #openstack-swift11:22
*** nacim has joined #openstack-swift11:33
*** andyandy has joined #openstack-swift11:36
openstackgerritA change was merged to openstack/swift: Fix KeyError on Storage Policy Container Sync  https://review.openstack.org/10274711:45
*** ppai has quit IRC11:56
*** mlipchuk has left #openstack-swift12:06
*** psharma_ has joined #openstack-swift12:08
*** psharma_ has quit IRC12:09
*** psharma_ has joined #openstack-swift12:09
*** psharma__ has joined #openstack-swift12:10
*** psharma has quit IRC12:11
*** mlipchuk has joined #openstack-swift12:14
*** psharma_ has quit IRC12:14
*** kopparam has quit IRC12:16
*** ajc_ has quit IRC12:17
*** kopparam has joined #openstack-swift12:17
*** kopparam has quit IRC12:21
*** mmcardle has quit IRC12:24
*** kopparam has joined #openstack-swift12:24
*** mitz_ has quit IRC12:25
*** mmcardle has joined #openstack-swift12:51
*** redbo has joined #openstack-swift12:56
*** ChanServ sets mode: +v redbo12:56
*** mlipchuk has quit IRC12:58
*** kopparam has quit IRC12:59
*** chandan_kumar has quit IRC12:59
*** bkopilov_ has quit IRC13:00
*** chandan_kumar has joined #openstack-swift13:07
openstackgerritOpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements  https://review.openstack.org/8873613:12
*** kenhui has joined #openstack-swift13:17
peluse_notmyname:  just noticed one that's not on the dashboard that looks ready to go (thing you found): https://review.openstack.org/#/c/102052/113:19
*** psharma__ has quit IRC13:24
*** tdasilva has joined #openstack-swift13:25
*** mlipchuk has joined #openstack-swift13:28
*** chandan_kumar is now known as chandankumar13:30
*** kopparam has joined #openstack-swift13:41
*** pconstantine has quit IRC13:48
acolespeluse_: i see it on dashboard :) - i think that dashboard url has filters on reviews for which you are owner13:50
*** chandan_kumar has joined #openstack-swift13:58
*** chandankumar has quit IRC13:59
peluse_acoles:  ahhh, thanks13:59
*** chandan_kumar is now known as chandan|afk14:00
*** chandan|afk is now known as ciypro|afk14:00
*** kopparam has quit IRC14:04
*** chandan_kumar has joined #openstack-swift14:04
acolespeluse_: try http://bit.ly/1qfsVgR14:06
*** chandan_kumar is now known as chandankumar14:09
peluse_acoles:  coolio14:10
*** nosnos has quit IRC14:13
*** angelastreeter has joined #openstack-swift14:14
*** nosnos has joined #openstack-swift14:14
*** nosnos has quit IRC14:18
openstackgerritA change was merged to openstack/swift: Add SAIO fix for Ubuntu 12.04  https://review.openstack.org/10344614:22
*** annegent_ has joined #openstack-swift14:24
*** nacim has quit IRC14:24
*** Midnightmyth has joined #openstack-swift14:33
*** nacim has joined #openstack-swift14:35
*** salec has joined #openstack-swift14:57
*** mitz_ has joined #openstack-swift14:57
*** mitz_ has quit IRC14:57
salechey guys, if I only have a single swift node, is the data still resilient (does swift still make multiple copies of the data)?  or does it rely on multiple nodes to make copies?14:58
ctennisit will make multiple copies across disks in the same node14:58
*** kevinc_ has joined #openstack-swift15:01
salecawesome! thanks :)15:02
*** jasond has joined #openstack-swift15:03
jasondis the AUTH_ part of a tempurl always required or can it be something else?15:04
*** mitz has quit IRC15:08
*** mitz has joined #openstack-swift15:12
notmynamegood morning15:13
notmynamejasond: something should be there. it's what allows the swift accounts to be segmented into different auth systems. you can change AUTH to something else (the reseller prefix), but you should have something there (and you can't change it on existing accounts)15:14
jasondnotmyname: just what i was looking for.  thanks15:15
*** mlipchuk has quit IRC15:17
tdasilvasalec: your ring will still need to be configured correctly to make multiple copies across disks on the same node....15:26
clayggholt: hrmm... yeah sorry, i guess the part that makes it so it should be about the same was in the other refernced change -> "You'll want to look at https://review.openstack.org/#/c/103777/1 first"15:27
*** foexle has quit IRC15:38
salectdasilva: Do the docs for single node installs configure the ring correctly for that?  Or is there some other resource I use?15:41
notmynamesalec: how many drives to do you have in your rings?15:42
salec815:43
notmyname3 replicas?15:45
salecI don't have it just yet, as I won't pick it up until I'm sure it will suit my needs.  But I'm looking to build a simple storage system with 8 3TB drives in it setup as JBOD15:46
notmynamesalec: ok, so swift will put each piece of data on 3 different drives. if those are all in the same server, then that server will be your failure domain. if you have more than one server, you'll have higher availability since swift will spread the data across multiple servers15:47
*** nacim has quit IRC15:49
*** annegent_ has quit IRC15:58
*** chandankumar has quit IRC16:02
*** jasond has left #openstack-swift16:02
salecyep :) I'm ok with that.  Eventually I'll add a second server for redundancy16:09
*** angelastreeter has quit IRC16:16
*** zhiyan is now known as zhiyan_16:19
*** gyee_ has quit IRC16:20
*** mwstorer has joined #openstack-swift16:20
*** dANOKELOFF has joined #openstack-swift16:25
dANOKELOFFhi , it's possible with curl command to delete non-empty containers ?16:26
*** joeljwright has quit IRC16:27
*** gyee has joined #openstack-swift16:28
*** kevinc_ has quit IRC16:30
*** kevinc_ has joined #openstack-swift16:31
peluse_dANOKELOFF:  no, not with one curl cmd.  you can use swift client or write your own script to first del the objects though16:34
*** dANOKELOFF has quit IRC16:37
*** kenhui has quit IRC16:39
*** lpabon has quit IRC16:43
*** lpabon has joined #openstack-swift16:46
*** andyandy has quit IRC16:47
notmynameparis summit CFP opened today: http://lists.openstack.org/pipermail/openstack/2014-July/008218.html16:57
notmyname(yes it feels like we just got back from the last one)16:58
peluse_wow16:59
notmynameacoles: thanks for sending the keystone v3 email to the ML17:00
notmynamehope we get valuable feedback there17:00
acolesnotmyname: yeah, lets see what comes back17:01
*** mmcardle has quit IRC17:03
*** chandan_kumar has joined #openstack-swift17:04
*** kevinc_ has quit IRC17:19
notmynameacoles: how about this? http://bit.ly/1iVBigF17:21
notmynameI added a "My Patches" section17:21
*** nsquare has joined #openstack-swift17:23
*** kevinc_ has joined #openstack-swift17:24
*** ChanServ changes topic to "Currently in Swift 2.0 RC phase -- read all about it at http://lists.openstack.org/pipermail/openstack-dev/2014-June/038357.html | master is open for dev work | http://bit.ly/1iVBigF"17:25
*** ChanServ changes topic to "Currently in Swift 2.0 RC phase -- read all about it at http://lists.openstack.org/pipermail/openstack-dev/2014-June/038357.html | master is open for dev work | Swift Review Dashboard: http://bit.ly/1iVBigF"17:25
*** jamiehannaford has joined #openstack-swift17:28
*** salec has quit IRC17:30
openstackgerritSamuel Merritt proposed a change to openstack/swift: Small cleanup to ring serialization  https://review.openstack.org/9761517:39
*** zaitcev has joined #openstack-swift17:43
*** ChanServ sets mode: +v zaitcev17:43
openstackgerritSamuel Merritt proposed a change to openstack/swift: Fix the section name in CONTRIBUTING.rst  https://review.openstack.org/10378317:44
*** mkollaro has quit IRC17:46
acolesnotmyname: nice!17:49
*** tongli has joined #openstack-swift17:56
*** bkopilov_ has joined #openstack-swift17:57
*** kevinc_ has quit IRC18:00
openstackgerritClay Gerrard proposed a change to openstack/swift: SimpleClient http proxying  https://review.openstack.org/10259818:00
*** CaioBrentano has joined #openstack-swift18:13
notmynamewho's editing the priority reviews page?18:17
notmynameclayg: is it you?18:17
torgomaticI edited it, but I stopped once I was done adding a link18:20
*** kevinc_ has joined #openstack-swift18:20
torgomaticnotmyname: ^^18:20
notmynametorgomatic: you added the performance section?18:20
torgomaticnotmyname: yup18:20
notmynametorgomatic: ok. I rejiggered it a little and added some links there too18:21
notmynamehttps://wiki.openstack.org/wiki/Swift/PriorityReviews18:21
torgomaticnotmyname: ah, cool... maybe put the parallel auditor in there too?18:21
notmynameshould be relatively updated enough to give people a direction on what to do next, especially with the new gerrit dashboard hotness18:21
notmynametorgomatic: ya, that one too18:21
notmynametorgomatic: I'll add the link18:22
torgomaticthanks18:22
torgomaticI'm glad to see you put the zero-copy GET in there... I think that one's useful, but I didn't want to add a new section and then dump my own changes in it :)18:22
notmynameI think the "needs approval" and "needs feedback" sections of the dashboard link are going to be really useful for keeping on top of proposed patches18:23
*** cm2 has quit IRC18:31
torgomaticyeah, I definitely agree there. I have a couple of queries bookmarked for those, but it's nice to get a single page instead of multiple tabs18:32
*** shri has joined #openstack-swift18:33
notmynameacoles: portante: peluse_: creiht: clayg: torgomatic: I've been talking to some marketing people about doing some press releases around the 2.0 release, and one of their pieces of feedback is that it's better to do it on a monday rather than the thursday before a holiday18:34
notmynameso, in their ideal world, the release would be monday am instead of thursday. but either way, they want to do the press releases at the same time as the actual release. so we're in the driver's seat there18:35
notmynamewhat do you think?18:35
torgomaticnotmyname: you're the one with the ability to tag things, but a couple extra days for testing don't bother me any18:36
notmynametorgomatic: actually, I don't have that power. I just tell the right people that the right SHA is ready to go. so, in other words, I just send emails18:37
openstackgerritClay Gerrard proposed a change to openstack/swift: Document the unnecessary method invoking in FakeRing  https://review.openstack.org/10340718:38
openstackgerritClay Gerrard proposed a change to openstack/swift: Remove fake _get_part and use the real thing  https://review.openstack.org/10396218:38
portanteSounds good to release after the 4th18:39
portantenotmyname:18:39
claygportante: well there's a couple of bugs I found that I'd like to get into the release if it's reasonable - nothing major18:43
portantecool, so in general don't think it hurts us to wait a bit longer18:44
claygnotmyname: oh, are we not *allowed* to edit the priority review page?18:44
notmynameclayg: you can do whatever you want. just concurrent editing is tricky, and I wanted to make sure I didn't smoosh the other changes. or, if you rather, notmyanme RAGE! SMASH OTHER CONTRIBUTORS!18:45
claygoh my18:46
claygOH, yeah I'm not editing it *currently* - I didn't understand the tense of your question :P18:46
portantehulk smash18:47
notmynamesorry. and it was all torgomatic's fault anyway :-)18:47
portanteall these operations18:47
portanteI wonder what they are actually doing to notmyname ...18:47
notmynameclayg: ya, the outstanding 2 patches for 2.0 (one merged one not) are what we gotta figure out about. do we backport those or not? what impact does that have for testing18:47
*** mmcardle has joined #openstack-swift19:01
*** CaioBrentano has quit IRC19:04
*** CaioBrentano has joined #openstack-swift19:07
openstackgerritClay Gerrard proposed a change to openstack/swift: Add X-Backend-Timestamp on more object server responses  https://review.openstack.org/10377619:10
openstackgerritClay Gerrard proposed a change to openstack/swift: Capture 409 Conflict during expect on PUT  https://review.openstack.org/10377719:10
openstackgerritClay Gerrard proposed a change to openstack/swift: Remove the X-Newest pre-flight request on X-Timestamp  https://review.openstack.org/10377819:10
openstackgerritClay Gerrard proposed a change to openstack/swift: Add support for multiple container-reconciler  https://review.openstack.org/10377919:10
tdasilvanotmyname: are there any plans on creating a new tag such as rc2 before the official release?19:16
*** jamiehannaford has quit IRC19:21
*** kevinc_ has quit IRC19:25
*** kenhui has joined #openstack-swift19:27
openstackgerritA change was merged to openstack/swift: Container Auditor should log a warning if the devices path contains a non-directory.  https://review.openstack.org/9714819:27
*** CaioBrentano has quit IRC19:30
*** chandan_kumar has quit IRC19:31
*** mkollaro has joined #openstack-swift19:32
*** kenhui has quit IRC19:34
notmynametdasilva: that's what we gotta figure out this afternoon. in general, though, if nothing comes up that needs to be backported, then there will be another tag at the same sha as 2.0.0.rc1 for the 2.0.0 release19:40
*** kenhui has joined #openstack-swift19:47
*** annegent_ has joined #openstack-swift19:55
*** lsell has joined #openstack-swift19:58
notmynameFYI the defcore/tc meeting is starting now in #openstack-meeting20:02
*** annegent_ is now known as annegentle_20:06
*** annegentle_ is now known as Guest7979520:06
*** Guest79795 is now known as theannegentle20:13
*** kevinc_ has joined #openstack-swift20:21
openstackgerritgholt proposed a change to openstack/swift: SimpleClient http proxying  https://review.openstack.org/10259820:26
claygohai20:30
openstackgerritClay Gerrard proposed a change to openstack/swift: Add more tests for SimpleClient http proxy  https://review.openstack.org/10399420:38
*** CaioBrentano has joined #openstack-swift20:43
*** mmcardle has quit IRC20:44
claygnotmyname: i think either/both 102747 and 103731 are good candidates for backport20:46
*** CaioBrentano has quit IRC20:47
*** kenhui has quit IRC20:55
*** kenhui has joined #openstack-swift20:56
*** mkollaro has quit IRC20:58
*** kevinc_ has quit IRC21:03
*** kenhui has quit IRC21:10
*** kevinc_ has joined #openstack-swift21:10
openstackgerritA change was merged to openstack/swift: Fix SLO test with old simplejson  https://review.openstack.org/9980521:11
openstackgerritClay Gerrard proposed a change to openstack/swift: Add more tests for SimpleClient http proxy  https://review.openstack.org/10399421:20
*** kevinc_ has quit IRC21:31
*** kevinc_ has joined #openstack-swift21:35
*** piousbox has joined #openstack-swift21:37
piousboxmeow21:38
piousboxHi people. If I have an OpenStack and a Swift, how do I make OpenStack aware of my Swift?21:38
piousboxI installed OpenStack with Mirantis Fuel.21:38
*** Midnightmyth has quit IRC21:43
peluse_notmyname:  agree on post holiday thing, also feel free to have your people contact my people to arrange for other PR activies around 2.0 :)21:52
peluse_portante: what's the status on SP support for in process func tests?21:53
mattoliverauMorning21:58
*** theannegentle has quit IRC22:00
notmynamepeluse_: do you have a contact email you can pm me? I'm already talking with lsell from the foundation about it22:05
notmynamelsell: <-- laruen, does marketing for openstack foundation22:05
*** piousbox has quit IRC22:15
peluse_notmyname:  yup, will send it over email22:16
notmynamepeluse_: thanks22:16
notmynamepeluse_: clayg: creiht: portante: acoles: torgomatic: new plan!22:18
torgomaticscrew object storage, we're doing function storage?22:19
notmynameit's monads all the way down!22:19
notmynamebackport https://review.openstack.org/#/c/102747/ and https://review.openstack.org/#/c/103731/ to the RC, cut an RC2, continue testing and release 2.0 on monday22:19
peluse_torgomatic:  function storage eh?  Lets fire up a Trello board and get started then!22:20
zaitcev(car cdr)22:21
notmynameany concerns with that plan?22:21
notmynamealso, please review https://review.openstack.org/#/c/103731/ since it hasn't landed on master yet22:21
notmynamecan't backport something not on master22:21
peluse_notmyname:  no issues here, still doing my rolling upgrade and suffering from totally unrelated issues (slowing me down).  Will keep you posted22:22
notmynamecreiht: dfg: gholt: glange: redbo: if there's anything that you have found in your testing at RAX, especially anything where a patch would invalidate existing testing, please speak up22:23
notmynamethe current 2 proposed backport patches do not appear to invalidate most QA testing that would be done. one is container sync and the other is the reconciler (an edge case in the edge case)22:24
notmynamelsell: here?22:33
*** markd has joined #openstack-swift22:34
markdHey there, I am trying to install swift on ubuntu 14.04 (icehouse).  Using the guide here: http://docs.openstack.org/icehouse/install-guide/install/apt/content/ch_swift.html22:36
markdWhen I go to run the ring builder I keep getting:  sudo swift-ring-builder account.builder 18 1 1Ring Builder file does not exist: account.builder22:36
markddoes anyone know what is causing this?  I have duplicated it now 3 times... sorta starting to go crazy... touching the file causes a python stack trace.22:37
zaitcevdon't sudo it and run the whole thing in a directory in your ~22:41
zaitcevthen you can strace22:42
markdah geez, figured it out.  I was forgetting the create command!    ARGGGGG!  Somehow, just posting here helps! :-)22:42
zaitcevheh22:42
openstackgerritA change was merged to openstack/swift: Add test for swift-recon --auditor  https://review.openstack.org/10005822:44
peluse_notmyname:  check your email real quick if you haven't re:press release stuff22:44
notmynamepeluse_: got it. I'm adding him to the existing thread of marketing people22:44
peluse_cool22:44
claygshouldn't it be like swift-ring-builder account.builder create 18 1 122:50
claygmarkd: and how many devices do you have in this cluster with a part power of *18* (spoiler alert - anything less than 60 is probably wrong answer)22:51
notmynameclayg: to be fair to markd, don't all the examples have 18?22:52
notmynamemarkd: http://rackerlabs.github.io/swift-ppc/22:52
claygmeh, that ones has basically the same "go huge it's awesome!" mentality of every other crystal ball based recommendation i've seen22:53
markdclayg, I am just setting it up to test internal support for swift in our product.  Going to run the swift tests.  We set it up with 18 1 1, as internally to our product we write 3 times, so no need for 18 3 1.22:53
markdand yes all the examples have 18.  Have yet to research what should it be for a real deployment.22:54
notmynamemarkd: seems that clayg doesn't like it, but that part power calculator gives decent recommendations IMO. basically you want around 100 partition per drive when you have all the drives deployed (ie max possible size of your cluster22:55
claygnotmyname: the max *possible* size of my cluster!?  let me see, once I add another region on the moon I might be a billion devices!  why does this thing only go to 32!?22:56
markdnotmyname, thanks that's good info. I will pass it on to the developer.22:56
notmynameclayg: what else would you use? or is that in your patch to make the part power adjustable? ;-)22:57
claygdon't mind the terrible code/math - the answer is what matters -> https://gist.github.com/clayg/2fb0b467d71a8afd367022:57
notmynamelol @ number-of-devices-you-have-in-the-real-hardware-you-are-going-to-deploy22:58
claygnotmyname: just pick something sane for the hardware you are deploying that will scale a good two orders of magnitude and come crying to me in a couple of years if you acctually hit the balancing issues of pikcing "too low" a part power22:58
claygI've seen pleanty of clusters that went too high22:58
* clayg is waiting on vms to build and making noise :P22:59
notmynameah, now your comment above makes sense. not how many drives in the cluster; how many drives per server in the cluster. 60/server leads to a part power of 18. got it23:00
* notmyname now gets closer to understanding clayg23:00
claygoh and also, that thing doesn't only go to 32 - so that's funny for me23:00
claygpandemicsyn2: is the source for the ppc out there somewhere?  does the "min drives" number even get used?23:01
notmynameclayg: ya, min drives changes the output numbers. doesn't change the calculation AFAICT23:01
claygpandemicsyn2: oh i see it, where it shows me the rediculously high parts per drive number - shouldn't that be in red above ~20K or something?23:02
notmynameclayg: I only get more than a part power of 32 after I get up to 9000000 drives per server (going up by powers of ten each time)23:02
notmyname9 million drives!!!!23:02
notmynameper server!23:02
notmynameclayg: what kind of fancy kinetic thing are you working on!?!?23:03
*** tdasilva has quit IRC23:03
claygno no no - one *billion*23:03
notmyname"yes, I'd like 3 servers please. 1 billion drives each"23:03
* notmyname suspects swift might have a few problems in a mbillion drive cluster23:04
torgomaticjust type "ls /srv/node" and then give up; it won't finish before you do23:05
notmynamelol23:05
zaitcevI have to disagree with Clay23:06
zaitcevDespite all this experience - you never know how big your cluster is going to grow.23:07
zaitcevSo, adding one little pause parameter into replicator is much better than tearing your hair once your balancing gets lumpy later.23:07
claygzaitcev: meh, it's not just the replicator cycle types - your object servers are trying to cache that directory structure too - so you have to have a bunch of ram to support that many parts in each device23:09
zaitcevdude please23:12
zaitcev[root@rhev-a24c-01 ~]# free23:12
zaitcev             total       used       free     shared    buffers     cached23:12
zaitcevMem:      66028884    2644260   63384624          0     170532    161376423:12
zaitcevoh, wait23:12
zaitcevtaht was proxy, i don't paco23:13
*** mwstorer has quit IRC23:13
zaitcevMem:      66028880   14008108   52020772          0     204736     63090023:13
zaitcev[root@rhev-a24c-02 ~]# grep dent /proc/slabinfo23:14
zaitcevdentry            60603648 60603880    192   20    1 : tunables  120   60    8 : slabdata 3030194 3030194     7923:14
zaitcevGranted this cluster is essentially empty23:14
notmynamefill it up 90% with small objects, then walk the drive and just inodes will fill the page cache23:16
claygzaitcev: or don't it's fine, part power 18 ftw!23:23
claygso did markd get his trusty issue squared away?23:24
markdclayg, yes I did, thanks!23:25
claygmarkd: oh... well good!23:25
notmynameanyone else looking at https://review.openstack.org/#/c/103731/123:36
notmyname?23:36
openstackgerritOpenStack Proposal Bot proposed a change to openstack/swift: Updated from global requirements  https://review.openstack.org/8873623:37
*** kevinc_ has quit IRC23:37
claygnotmyname: i suppose someone should tell me to write a unittest for it, but none of the eixting tests were really setup to exercise that problem in any meaningful way besdies the probetest...23:37
notmynameclayg: thing I'm wrapping my head around right now is why get_to_final_state() matters for the reconciler23:38
notmynameclayg: is it just to make sure the listing is all up to date? (that makes sense to me)23:39
*** kevinc_ has joined #openstack-swift23:41
claygnotmyname: well objects are enqueued in the replicator - i could have just run those23:42
claygso like the reconciler runs and it throws out some writes, then you cycle replication to see if anything new shows up to be reconciled23:42
notmynameya, ok. makes sense. I think I grok it now23:42
claygmeh, it had me scratching my head for awhile23:43
claygi have a subsequent change I need to do to fix up the log formatting23:43
notmynamewell it's really easy to figure out when I read how you solved it. :-)23:43
claygthere's a few places that do '%f' % Timestamp() and you don't see all the important bits23:43
*** kevinc_ has quit IRC23:53

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!