Monday, 2015-01-05

*** kei_yama has joined #openstack-swift00:02
*** ho has joined #openstack-swift00:02
hogood morning guys and happy new year!00:06
*** wer has quit IRC00:10
*** wer_ has quit IRC00:11
mattoliverauho: morning and happy new year to you too :)00:24
*** Masahiro has joined #openstack-swift00:28
*** Masahiro has quit IRC00:32
*** bkopilov has quit IRC00:37
*** bkopilov has joined #openstack-swift00:48
*** addnull has joined #openstack-swift00:50
*** Masahiro has joined #openstack-swift00:57
*** addnull has quit IRC01:00
*** aswadr has joined #openstack-swift01:18
*** vu has quit IRC01:24
*** wer has joined #openstack-swift01:31
*** addnull has joined #openstack-swift01:42
*** nosnos has joined #openstack-swift01:43
*** ho has quit IRC01:48
*** ho has joined #openstack-swift01:50
*** haomaiwang has joined #openstack-swift02:08
*** addnull has quit IRC02:58
*** ho__ has joined #openstack-swift03:06
*** ho has quit IRC03:07
*** nosnos has quit IRC03:13
*** echevemaster has quit IRC03:15
*** wer_ has joined #openstack-swift03:22
*** fandi has joined #openstack-swift03:43
*** addnull has joined #openstack-swift04:06
*** ppai has joined #openstack-swift04:09
*** ho__ has quit IRC04:17
*** ho has joined #openstack-swift04:17
notmynamehello world04:18
* notmyname tries to catch up on various backlogs04:18
*** nosnos has joined #openstack-swift04:20
homattoliverau: I got an abandon aleart for the change https://review.openstack.org/#/c/138342/. The current status is I wrote a response for your comment. So could you please check it again?04:20
notmynamefortunately it looks like it's been a pretty light week04:20
notmynameho: don't worry. all the suspected abandoned patches are tracked at http://abandoner.oliver.net.au/abandoned_changes.html04:22
notmynameho: and since you added a comment, it looks like it isn't tracked there04:22
honotmyname: thanks for the info!04:23
notmynameho: but, that being said, it's still a manual process to abandon stuff (ie I go click a lot of buttons to do it). I try to catch stuff like this before abandoning anything.04:23
notmynameho: but the emails are automatic. IIRC, it's an email after no comments if it has a negative review, then goes to the abandoner page 4 weeks after that04:24
notmynameho: so maybe the email you got was just the warning one04:24
notmynameho: point is, mattoliverau needs to go back and look at his -1 on your patch!04:25
honotmyname: thanks again. One question. Only you (PTL) can abandon patches?04:26
notmynameho: no. any core can04:26
lcurtisanyone here deploy swift with puppet?04:26
notmynamebut by convention I'm the only one who has done that so far04:26
notmynamelcurtis: I know people do (not me).04:27
honotmyname: thanks. I understand.04:27
notmynamelcurtis: I can't help with puppet-specific things, but I might be able to help with general questions. what's up?04:28
lcurtiswell...how about when using swift-ringbuilder....add r1z1-STORAGE_NODE_MANAGEMENT_INTERFACE_IP_ADDRESS:6001/DEVICE_NAME DEVICE_WEIGHT04:29
lcurtisdoes r1z1 need to be in there?04:30
lcurtisis it being parsed?04:30
notmynameya, that's the region and zone identifier04:30
notmynameregion 1, zone 104:30
mattoliverauho: I'll go take a look. I think the christmas period wasn't the best for the abandoned changes as many people where away, sorry.04:30
mattoliveraunotmyname: welcome and happy new year :)04:31
notmynamemattoliverau: thanks! you too04:31
lcurtisso has to follow that format - i.e., rXzY04:31
homattoliverau: thanks in advance!04:32
mattoliverauho: you will only get the warning email, and the email says you have 14 days to comment on the change to remove it from the abandoner04:32
notmynamelcurtis: well...sortof04:32
notmynamelcurtis: instead of the (admittedly confusing) DSL we've invented for identifying stuff in a ring, there's fortunately also long option names you can give to swift-ring-builder04:33
mattoliveraulcurtis: if you leave them out, I think they get a 0.04:33
lcurtisokay...great to know04:34
lcurtisthanks much04:34
notmynamelcurtis: https://gist.github.com/notmyname/b542433a4029f5c8a7f704:34
notmynamelcurtis: that's from the help message04:34
lcurtisah....makes sense now04:36
homattoliverau: yeah. I got a lecture for the abandoned procedure from you last month. I think :)04:36
notmynamelcurtis: IIRC you must use integers for the region and zone if you are using the swift-ring-builder CLI. if you are calling the library functions directly, there's no such restriction. best practice is probably to keep it as integers, though04:36
mattoliveraulol, oh yeah, but that was last year :P04:36
lcurtisokay04:36
lcurtisi think i am still confused on how many partitions to actually create...any overall advice?04:37
*** chlong has joined #openstack-swift04:37
notmynamelcurtis: how much hardware are you installing?04:38
lcurtisso far 30 dual cpu servers04:38
lcurtis114T each04:39
notmynamenumber of drives is the most important metric04:39
lcurtisokay...i think each server has 36 drives04:39
lcurtissupermicro 4u's04:39
notmynamelcurtis: 17. that should give you support for nearly 4K drives (36 drives per server) and close to 20PB04:42
lcurtisfantastic04:43
lcurtiswill need to keep rtfm04:43
lcurtisthanks so much04:43
notmynamelcurtis: there04:43
notmynamelcurtis: there's risk with having too small and too large of part powers. but you've already got a decent cluster04:44
lcurtiscant thank you enough for your input and time04:45
lcurtislearning by doing04:45
*** addnull has quit IRC04:46
notmynamelcurtis: please let me know if you have other questions. and if I'm not around, there are many other people in here who can help and are friendly04:47
notmynamelcurtis: what are you using swift for? (/me is always curious about use cases)04:48
notmynamealso, I hope I haven't already asked you that and forgotten ;-)04:48
lcurtisto shift an existing infrastruture off of S304:49
notmynamecool04:50
lcurtisaws = $$04:50
notmynameyup04:50
lcurtislol04:50
lcurtiswas torn between ceph and swift...04:51
notmynameI hear that a lot (but I have selection bias since my employer looks for those S3->Swift stories...)04:51
notmynameah?04:51
notmynamehow'd you make you decision?04:51
notmynameand what made you choose swift?04:51
lcurtismore mature, purpose-built, integration04:52
lcurtisgreat community ;)04:52
mattoliverauho: I have made a comment :)04:52
notmynameawww, shucks ;-)04:52
notmynamelcurtis: what integration are you looking for?04:52
notmynameinternally with existing ops stuff or externally with apps?04:53
lcurtisjust seems nicely integrated with openstack04:53
lcurtisexternally with apps04:53
notmynameya, that's the point :-)04:53
notmynamecool. I've been working some with some app vendors to get better/official swift support. it's hugely important04:54
lcurtisagreed!04:54
mattoliveraunotmyname: with ho's change https://review.openstack.org/#/c/138342/ he is keeping duplicated data for backwards compatabliity, which is good (breaking monitoring tools for prod clusters is bad), so have suggested we need a way forward. Duplicate and mark depricated in the next release (his change is apart of) and then remove dulication in the following release. does my suggestion in the change look like a way forward,04:56
mattoliverau or is there a better way to depricate things?04:56
notmynamemattoliverau: ... ummmm04:56
mattoliveraunotmyname: too late for such long and probably in comprehensable sentences? :P04:58
notmynameno, but I've got no context for it right now :-)04:58
mattoliveraulol04:59
notmynamemattoliverau: ho: it's _really_ hard to deprecate things, especially stuff like this that is almost certainly used in custom scripts05:02
*** km has joined #openstack-swift05:03
mattoliverauyeah I agree, its why I wonder how... if ever (which I hope we do sometime), or do we mark as depricated in documentation and then wait for the next major major release swift 3.0.0 to remove it completely.05:05
notmynameok, I'm out for tonight. tomorrow starts early05:15
mattoliveraunotmyname: night night05:16
*** nshaikh has joined #openstack-swift05:30
honotmyname: mattoliverau: sorry to respond you late. The idea of a transition period sounds good for me. I will upload the patch with some doc change.05:39
*** greghayn1 is now known as greghaynes06:22
mattoliverauI'm calling it a day too. Night all06:26
homattoliverau: good night!06:35
*** remix_tj has quit IRC06:43
*** km has quit IRC06:57
*** silor has joined #openstack-swift07:31
*** lcurtis has quit IRC07:40
*** silor has quit IRC07:47
*** chlong has quit IRC07:47
*** addnull has joined #openstack-swift08:04
*** jordanP has joined #openstack-swift08:47
*** jistr has joined #openstack-swift09:10
*** fandi has quit IRC09:11
*** addnull has quit IRC09:25
*** ppai has quit IRC09:38
*** fandi has joined #openstack-swift09:48
*** ppai has joined #openstack-swift09:52
*** ashestakov has quit IRC09:52
*** mkerrin has joined #openstack-swift10:14
*** ppai has quit IRC10:15
*** mkerrin has quit IRC10:18
*** mkerrin has joined #openstack-swift10:18
*** ekarlso- has quit IRC10:24
*** ekarlso- has joined #openstack-swift10:24
*** ppai has joined #openstack-swift10:27
*** haomaiwang has quit IRC10:34
*** addnull has joined #openstack-swift10:36
*** addnull has quit IRC10:40
*** nshaikh has quit IRC10:41
*** Masahiro has quit IRC10:41
*** chlong has joined #openstack-swift10:46
*** ho has quit IRC10:47
*** nellysmitt has joined #openstack-swift10:50
openstackgerritDaniel Wakefield proposed openstack/python-swiftclient: Verify MD5 of uploaded objects.  https://review.openstack.org/12925410:51
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046310:58
*** erlon_ has joined #openstack-swift10:59
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046311:06
*** nosnos has quit IRC11:20
*** chlong has quit IRC11:36
*** hurricanerix has quit IRC11:36
*** xianghui has quit IRC11:36
*** xianghui has joined #openstack-swift11:36
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Change tests to use CaptureOutput class  https://review.openstack.org/14496811:36
*** nellysmitt has quit IRC11:36
*** mahatic has joined #openstack-swift11:37
*** jest has joined #openstack-swift11:38
*** nshaikh has joined #openstack-swift11:38
*** hurricanerix has joined #openstack-swift11:39
*** Masahiro has joined #openstack-swift11:42
*** kei_yama has quit IRC11:44
*** Masahiro has quit IRC11:46
*** chlong has joined #openstack-swift11:52
*** fandi has quit IRC11:53
*** aswadr has quit IRC11:56
*** ppai has quit IRC12:03
*** dmsimard_away is now known as dmsimard12:11
*** waywardsonic has joined #openstack-swift12:13
waywardsonichello12:14
*** ajax1100 has joined #openstack-swift12:15
ajax1100hello12:15
waywardsonicsorry guys12:16
*** waywardsonic has left #openstack-swift12:16
*** ajax1100 has quit IRC12:16
*** ppai has joined #openstack-swift12:16
*** ppai has quit IRC12:21
*** ppai has joined #openstack-swift12:33
*** david-lyle_afk has quit IRC12:38
*** david-ly_ has joined #openstack-swift12:38
openstackgerritMerged openstack/swift: Consistently apply node error limiting rules in proxy  https://review.openstack.org/13516712:51
openstackgerritMerged openstack/python-swiftclient: Print info message about incorrect --totals usage when neither -l nor --lh is provided. Added test coverage for --totals.  https://review.openstack.org/13046312:55
*** Masahiro has joined #openstack-swift12:58
*** Masahiro has quit IRC13:02
*** ajay_ has joined #openstack-swift13:03
*** guest123 has joined #openstack-swift13:11
ajay_Can swift be used with exofs?13:11
*** sandywalsh has joined #openstack-swift13:13
*** nellysmitt has joined #openstack-swift13:28
jestany best practice swift multiregion ring building examples available somewhere on the web?13:42
openstackgerritJoel Wright proposed openstack/python-swiftclient: This patch fixes downloading files to stdout, allows _SwiftReader to operate as an iterator as well as a context manager.  https://review.openstack.org/14489913:44
*** nellysmitt has quit IRC13:45
*** ppai has quit IRC13:47
*** pberis has joined #openstack-swift13:47
*** pcaruana has joined #openstack-swift13:49
*** ndk has quit IRC13:57
*** Masahiro has joined #openstack-swift13:59
*** ndk has joined #openstack-swift14:00
openstackgerritJoel Wright proposed openstack/python-swiftclient: This patch fixes downloading files to stdout, allows _SwiftReader to operate as an iterator as well as a context manager.  https://review.openstack.org/14489914:00
*** ppai has joined #openstack-swift14:01
openstackgerritJoel Wright proposed openstack/python-swiftclient: This patch fixes downloading files to stdout, allows _SwiftReader to operate as an iterator as well as a context manager.  https://review.openstack.org/14489914:01
*** Masahiro has quit IRC14:03
*** portante has quit IRC14:03
*** portante has joined #openstack-swift14:04
*** ChanServ sets mode: +v portante14:04
*** zackmdavis has quit IRC14:10
*** pberis has quit IRC14:10
*** ppai has quit IRC14:11
*** zackmdavis has joined #openstack-swift14:11
*** pberis has joined #openstack-swift14:11
*** SkyRocknRoll has joined #openstack-swift14:16
*** SkyRocknRoll has joined #openstack-swift14:16
*** SkyRocknRoll has quit IRC14:16
*** SkyRocknRoll has joined #openstack-swift14:16
*** SkyRocknRoll has joined #openstack-swift14:16
*** mahatic has quit IRC14:27
*** SkyRocknRoll has quit IRC14:28
*** silor has joined #openstack-swift14:42
*** nellysmitt has joined #openstack-swift14:43
*** addnull has joined #openstack-swift14:45
*** pberis has quit IRC14:47
*** mahatic has joined #openstack-swift14:47
*** nellysmitt has quit IRC14:47
*** tdasilva has joined #openstack-swift14:55
*** pberis has joined #openstack-swift14:58
*** remix_tj has joined #openstack-swift15:00
*** fandi has joined #openstack-swift15:00
*** openstack has joined #openstack-swift15:06
*** addnull has quit IRC15:12
*** addnull has joined #openstack-swift15:13
*** tristanC_ has joined #openstack-swift15:13
*** tristanC has quit IRC15:14
*** silor has quit IRC15:18
*** nellysmitt has joined #openstack-swift15:30
*** portante has quit IRC15:31
*** portante has joined #openstack-swift15:34
*** ChanServ sets mode: +v portante15:34
*** lpabon has joined #openstack-swift15:34
*** nshaikh has quit IRC15:35
*** tristanC_ is now known as tristanC15:42
*** Masahiro has joined #openstack-swift15:47
*** Masahiro has quit IRC15:52
*** tdasilva has quit IRC15:52
*** addnull has quit IRC16:03
*** miqui has joined #openstack-swift16:06
*** openstackgerrit has quit IRC16:06
*** openstackgerrit has joined #openstack-swift16:07
*** tdasilva has joined #openstack-swift16:07
*** david-ly_ is now known as david-lyle16:13
*** david-lyle has quit IRC16:22
openstackgerritMerged openstack/swift: Fix the GET's response code when there is a missing segment in LO  https://review.openstack.org/13625816:23
*** nellysmitt has quit IRC16:30
*** lpabon has quit IRC16:30
*** nellysmitt has joined #openstack-swift16:31
*** nellysmitt has quit IRC16:35
*** gyee has joined #openstack-swift16:36
*** lcurtis has joined #openstack-swift16:38
*** tdasilva has quit IRC16:44
*** imkarrer has joined #openstack-swift16:45
*** nellysmitt has joined #openstack-swift16:47
notmynamegood morning16:50
*** openstackgerrit has quit IRC16:51
*** openstackgerrit has joined #openstack-swift16:51
portantenotmyname: good morning, happy new year16:52
notmynamethanks, you too!16:53
notmynamelooks to be a busy day today16:53
notmynamecatch up on what's going on16:53
notmynamepeluse is in (my) town for EC work16:54
*** tdasilva has joined #openstack-swift16:56
acolesnotmyname: portante: happy new year17:03
clayghappy new year!17:04
*** openstackgerrit has quit IRC17:04
*** openstackgerrit has joined #openstack-swift17:04
claygsaw a bunch of merged failed this morning - what landed?17:05
*** EmilienM is now known as EmilienM|afk17:07
acolesclayg: this landed earlier https://review.openstack.org/#/c/135167/17:12
lcurtishello all...changing around my infrastructure plans for swift...had originally intended to put on top of zfs...i think best practice is xfs...any thoughts or point to benchmarks, reasoning?17:12
claygacoles: oh crap... hope that was a good idea then :)17:14
acolesclayg: lol. i'm sure it was17:14
clayglcurtis: I think it's just one of those things where more folks have run on and have experience with xfs17:14
acolesclayg: happy new year btw17:14
lcurtisthanks clayg17:14
clayglcurtis: briancline tried running on extX one time and it was not fun for him for some reason17:15
notmynamelcurtis: fill up an xfs volume 90% full with 1MB files. flush caches. then os.walk the drive. xfs does better than others tested with a _lot_ of inodes/dentries17:15
lcurtishello again notmyname...thanks for that..interesting17:16
clayglcurtis: I'd imagine someone managed to get some sort of freebsd looking thing running most of swift in some sort of dev/lab setup - i've not kept up with the state of zfs on linux - isn't it like better now than evar!17:16
lcurtisyes very, though im still not a filesystem scientist17:16
* clayg has a new idea for his businesscard17:17
lcurtislol17:17
*** pberis has quit IRC17:20
notmynamefound it17:24
notmynamelcurtis: http://d.not.mn/FS_comparisons.png  <-- courtesy of redbo a long time ago17:24
*** jistr has quit IRC17:25
tdasilvaHappy New Year everyone!17:27
lcurtisnotmyname--awesome reference17:30
lcurtisthanks17:30
*** Nadeem has joined #openstack-swift17:32
*** Masahiro has joined #openstack-swift17:36
*** Masahiro has quit IRC17:41
claygpeluse: notmyname: i'm reviewing 134065 - looks like https://review.openstack.org/#/c/129361/ needs a rebase17:58
*** jordanP has quit IRC18:00
peluseHappy New Year!18:09
*** nottrobin has quit IRC18:12
*** serverascode____ has quit IRC18:12
*** cppforlife has quit IRC18:12
openstackgerritAlistair Coles proposed openstack/python-swiftclient: Fix cross account upload using --os-storage-url  https://review.openstack.org/12575918:12
*** acoles has quit IRC18:14
*** CrackerJackMack has quit IRC18:14
*** tacticus has quit IRC18:14
*** jroll has quit IRC18:14
*** acoles_away has joined #openstack-swift18:16
*** acoles_away is now known as acoles18:16
*** ChanServ sets mode: +v acoles18:16
*** jroll has joined #openstack-swift18:16
*** cppforlife has joined #openstack-swift18:17
*** tacticus has joined #openstack-swift18:17
*** nottrobin has joined #openstack-swift18:17
*** serverascode____ has joined #openstack-swift18:18
*** CrackerJackMack has joined #openstack-swift18:18
*** sigmavirus24 has joined #openstack-swift18:26
sigmavirus24Hey all, is there a changelog for swiftclient that's readily available? I'm trying to determine what version the cacert parameter was added in but there doesn't seem to be documentation around that18:27
*** EmilienM|afk is now known as EmilienM18:28
notmynamesigmavirus24: git blame says it was added when the library was ported to use requests. so that would be v2.018:29
sigmavirus24notmyname: thanks18:29
*** jroll has quit IRC18:31
*** jroll has joined #openstack-swift18:31
*** echevemaster has joined #openstack-swift18:35
*** nellysmitt has quit IRC18:43
portanteacoles: happy new year to you and yours as well!18:50
portantenotmyname, redbo: any guess on how long ago that was and as a stretch, what versions of things were involved?18:56
portantethat was, being the FS traversal graph posted earlier ...18:56
notmynameportante: years ago. and "older that now"18:56
notmynamewhere "years" is probably 3ish18:57
notmynameportante: do you know anyone who looks at performance stuff? maybe for a big company that focuses on linux things? maybe that person could rerun some tests ;-)18:57
portantehmmm, lemme see ... ;)18:58
openstackgerritClay Gerrard proposed openstack/swift: Build up reconstructor with correct node selection  https://review.openstack.org/12936118:58
portantetdasilva!18:58
portante;)18:58
tdasilvaportante: are you asking me if I know someone in performance? yeah, i know a couple of really smart good guys19:00
ahale_I'd have thought it was closer to a year ago we were revisiting bulkstat .. but time flies :)19:01
redbohmm... that data was from 8/13.  I apparently didn't record the system configuration.  Ubuntu precise with whatever latest version of the kernel had been backported to it at that point.19:06
portanteredbo: thanks!19:07
*** tristanC has quit IRC19:20
*** tristanC has joined #openstack-swift19:20
*** nellysmitt has joined #openstack-swift19:23
openstackgerritClay Gerrard proposed openstack/swift: Build up reconstructor with correct node selection  https://review.openstack.org/12936119:24
*** pberis has joined #openstack-swift19:24
*** nellysmitt has quit IRC19:24
*** Masahiro has joined #openstack-swift19:25
*** rebelshr_ has joined #openstack-swift19:27
*** Masahiro has quit IRC19:29
*** nellysmitt has joined #openstack-swift19:30
*** nellysmitt has quit IRC19:34
openstackgerritThiago da Silva proposed openstack/swift: versioned writes middleware  https://review.openstack.org/13434719:46
*** zaitcev has joined #openstack-swift19:47
*** ChanServ sets mode: +v zaitcev19:47
claygredbo: hi!19:48
*** IRTermite has joined #openstack-swift19:53
torgomaticcschwede: ping19:55
*** silor has joined #openstack-swift19:55
*** abhirc has joined #openstack-swift20:01
openstackgerritpaul luse proposed openstack/swift: New hashes.pkl format and other reconstructor changes  https://review.openstack.org/13187220:06
openstackgerritpaul luse proposed openstack/swift: Build up reconstructor with correct node selection  https://review.openstack.org/12936120:06
openstackgerritpaul luse proposed openstack/swift: Add node/pair index patch back into feature/EC  https://review.openstack.org/13406520:06
redboclayg: hi20:26
*** nellysmitt has joined #openstack-swift20:31
*** sfineberg has joined #openstack-swift20:32
*** rebelshr_ has quit IRC20:33
*** nellysmitt has quit IRC20:35
*** tdasilva has quit IRC21:03
mattoliverauMorning21:06
*** Masahiro has joined #openstack-swift21:14
*** Masahiro has quit IRC21:18
*** nellysmitt has joined #openstack-swift21:23
*** fifieldt_ has quit IRC21:27
*** fifieldt_ has joined #openstack-swift21:28
*** nellysmitt has quit IRC21:35
*** gyee has quit IRC21:37
*** Nadeem_ has joined #openstack-swift21:51
*** Nadeem has quit IRC21:51
*** dmsimard is now known as dmsimard_away21:57
*** chlong has quit IRC21:59
*** silor has quit IRC22:01
openstackgerritSamuel Merritt proposed openstack/swift: Only move too-close-together replicas when they can spread out.  https://review.openstack.org/14087922:07
openstackgerritSamuel Merritt proposed openstack/swift: Add notion of overload to swift-ring-builder  https://review.openstack.org/14145222:17
*** gyee has joined #openstack-swift22:29
*** mahatic has quit IRC22:30
*** chlong has joined #openstack-swift22:57
*** Masahiro has joined #openstack-swift23:02
*** Masahiro has quit IRC23:07
*** chlong_ has joined #openstack-swift23:14
*** km has joined #openstack-swift23:27
*** nellysmitt has joined #openstack-swift23:36
*** Nadeem_ has quit IRC23:36
*** chlong has quit IRC23:39
*** chlong_ has quit IRC23:39
*** nellysmitt has quit IRC23:41
*** chlong_ has joined #openstack-swift23:46
*** chlong has joined #openstack-swift23:46
*** chlong_ has quit IRC23:46
*** lcurtis has quit IRC23:56
*** ho has joined #openstack-swift23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!