Thursday, 2014-07-03

notmynameoh, and also to check with swifterdarrell that our utilization or monitoring isn't dependent on the value of the user-agent string in the logs.00:01
TygerIf it is, that should probably be in a test somewhere, either a unit test or one of the gate tests.00:02
portantenotmyname: here00:02
notmynameportante: Tyger has proposed changing/updating some user agent strings in the logs. while that's not entirely forbidden, IMO, it's something to consider with care if it's done. mostly to check what impact it would have, if any00:04
portantenotmyname: thanks for the summary, is there a specific gerrit review id to consider?00:07
notmynameI'm headed home. I'll check in this evening, and hopefully the last 2 of the 3 needed backports will have landed. if so, I'll cherry-pick them to a 2.0 branch and we'll get and rc2 tag when ttx wakes up00:08
notmynameportante: meet Tyger, Tyger meet portante00:08
Tygerportante: https://review.openstack.org/#/c/102401/00:08
portanteTyger: hi00:08
notmynameTyger: oh, if you're interested in logs....00:09
*** kevinc_ has quit IRC00:09
TygerOh dear, that sounds ominous00:09
notmynameTyger: something on my todo list that I haven't gotten to yet is to add the storage policy to the proxy access log lines. I probably won't get to it myself until next week, but if you happened to submit a patch to do it, I'd happily review it :-)00:10
*** shri has quit IRC00:11
Tygernotmyname: I'll keep it in mind... I have been meaning to investigate storage policies.00:11
*** annegent_ has joined #openstack-swift00:15
*** annegent_ has quit IRC00:21
Tygerportante: Any thoughts?00:23
openstackgerritA change was merged to openstack/swift: Fix order dependent test in proxy.test_server  https://review.openstack.org/10430600:26
*** dmorita has joined #openstack-swift00:26
peluse_notmyname:  some strange jenkins failres on the info key patch, seemingly unlreated.  Will run it again and then spend some time looking into it I guess.00:27
* peluse_ will be in and out for a bit00:27
*** sungju has joined #openstack-swift00:29
*** mwstorer has quit IRC00:31
*** sungju has quit IRC00:33
portanteTyger: just finished putting the kiddies to bed ...00:57
*** nosnos has joined #openstack-swift01:13
*** kota_ has joined #openstack-swift01:18
openstackgerritPeter Portante proposed a change to openstack/swift: Object services user-agent string uses full name  https://review.openstack.org/10240101:20
*** ktsuyuzaki has joined #openstack-swift01:20
*** nosnos has quit IRC01:20
*** kota_ has quit IRC01:22
Tygerportante: That seems like a sensible alternative to the commit message.01:23
*** kota_ has joined #openstack-swift01:23
portantecool01:25
*** ktsuyuzaki has quit IRC01:25
*** ktsuyuzaki has joined #openstack-swift01:25
portanteTyger: I don't have a good sense of how this might impact existing tools that process swift log files01:26
portanteI am guessing this change might break a few things01:26
portantebut I could be wrong, that nobody cares about the user-agent01:26
portantestring01:26
Tygerportante: That's the million dollar question isn't it. I half expected it to fail a gate check, but I have no feel for if people care about the user agent string or not.01:26
portanteit is very helpful when debugging all the whys-and-wherefores of a problem, at least to me01:26
*** kota_ has quit IRC01:27
TygerYeah it was using the user agent string in the logs I noticed it to begin with. I assumed it would be object-* and couldnt find anything in the logs when I looked for that user-agent string.01:27
*** kota_ has joined #openstack-swift01:32
*** ktsuyuzaki has quit IRC01:34
*** ktsuyuzaki has joined #openstack-swift01:34
openstackgerritSteven Lang proposed a change to openstack/swift: Object services user-agent string uses full name  https://review.openstack.org/10240101:36
*** kota_ has quit IRC01:36
*** kota_ has joined #openstack-swift01:39
*** ktsuyuzaki has quit IRC01:41
*** ktsuyuzaki has joined #openstack-swift01:41
*** kota_ has quit IRC01:43
*** kota_ has joined #openstack-swift01:44
*** ktsuyuzaki has quit IRC01:46
*** ktsuyuzaki has joined #openstack-swift01:46
peluse_notmyname: saw the approval on the info patch and claygs other fix, thanks.01:47
*** kota_ has quit IRC01:48
peluse_notmyname:  if not clear from the commit message I found the bug by running a 4 node cluster with 1.13.1, doing a pile of traffic to it then upgrading nodes to v2 one by one and inspecting logs.  Did that with rsync, then with ssync, then back again, then back again and then enabled a 2nd policy as default (last part between traffic generator runs though)01:49
peluse_all the upgrades while the cluster was pretty active...01:50
*** kota_ has joined #openstack-swift01:53
*** ktsuyuzaki has quit IRC01:55
*** ktsuyuzaki has joined #openstack-swift01:55
*** kota_ has quit IRC01:57
*** kota_ has joined #openstack-swift02:00
*** ktsuyuzaki has quit IRC02:02
*** ktsuyuzaki has joined #openstack-swift02:02
*** kota_ has quit IRC02:04
*** kota_ has joined #openstack-swift02:05
*** ktsuyuzaki has quit IRC02:07
*** ktsuyuzaki has joined #openstack-swift02:07
*** nthacker has joined #openstack-swift02:09
nthackerhey guys, rather silly question here cause im new to git...what do i do with my branch once its merged02:09
nthackermerged to master that is02:09
*** kota_ has quit IRC02:09
openstackgerritA change was merged to openstack/swift: Fix pop_queue for move object twice  https://review.openstack.org/10373102:11
mattoliveraunthacker: in your local clone?02:11
nthackeryes in my local clone02:12
mattoliveraunthacker: if its merged to master upstream then you can delete it :)02:12
nthackermattoliverau: i created a branch to fix a bug. the bug was reviewed committed merged, so what do i do with my branch02:12
nthackermattoliverau: im guessing deleting it, but that wont break anything right?02:12
nthackermattoliverau: ok thanks!02:12
mattoliveraunthacker: no it wont, so long as you checkout master again and pull the latest from master before you branch out and fix another bug ;)02:13
nthackermattoliverau: thanks! i should take a tutorial for git...sometime....:P02:14
mattoliveraunthacker: lol, your taking the git tutorial called "git by fire" :P02:15
nthackermattoliverau: it does seem like that...but thankfully i broke nothing and went through the workflow02:16
nthackermattoliverau: i have been wanting to poke around on the EC bits. i posted on the trello board but got no response...any ideas how to proceed there? sorry for just throwing you another question there02:16
mattoliveraunthacker: if you do get stuck, let me know and I'm happy to walk you through anything git related :)02:16
mattoliveraulol02:17
nthackermattoliverau: thanks - i ll definitely take you up on that sometime( because im sure i ll break something if i keep doing this while googling it on a different tab lol)02:17
mattoliveraunthacker: according to the code review dashboard, this is the only EC patch out, you can take a look at it, review it, fetch the code and play, but I haven't reviewed it yet so don't know what state its in (https://review.openstack.org/#/c/103644/)02:20
*** kota_ has joined #openstack-swift02:20
nthackermattoliverau: thanks again ! i ll take a look at this02:21
*** ktsuyuzaki has quit IRC02:22
*** ktsuyuzaki has joined #openstack-swift02:25
*** kota_ has quit IRC02:27
*** kota_ has joined #openstack-swift02:27
hugokuogood morning ...02:29
*** ktsuyuzaki has quit IRC02:29
kota_hugokuo: morning02:30
hugokuokota_: how's going kota_ San02:30
kota_hugokuo: nice. How about you?02:31
hugokuogood good ~!02:31
mattoliverauMorning hugokuo02:32
peluse_nthacker:  not sure if it was super clear on Trello but the unit tests you asked about were for the external lib called PyECLib, they're not part of the swift repo (so different process and repor for review/merge)02:34
nthackerpeluse_: ahh - ok no i didnt get that02:35
peluse_the one EC related patch out there now adds a policy for EC and requires that ext library I just mentioned but it doesn't do EC yet02:35
peluse_"it" meaning the Swift patch by Tushar :)02:35
*** bkopilov has quit IRC02:35
peluse_proposals for things like the PUT/GET path, the reconstructor, Swift unit tests, etc., etc., will all depend on having a basic EC policy defined first so that one that's up there is important to get eyes on, appreciate you taking a look for sure02:36
kota_mattoliverau: Hi, Matt!02:37
zaitcevDoes anyone happen to remember what we used posix_ipc for? I remember there was some kind of shmem in it and I even found the implementation...02:37
zaitcevoh. It all is coming back to me02:38
kota_mattoliverau: Did you comment my patch? (https://review.openstack.org/#/c/99824/)02:38
kota_mattoliverau: I've fix it according to your comment and I wonder if you could review again.02:39
mattoliveraukota_: yes i did, and yes I will :)02:40
mattoliverauzaitcev: lol, sometimes it's good to just talk it out :)02:41
kota_mattoriverau: Thanks!02:41
kota_And if anyone here could review it, I will be happy :)02:43
*** ktsuyuzaki has joined #openstack-swift02:44
*** zaitcev has quit IRC02:46
*** kota_ has quit IRC02:47
*** ktsuyuzaki has quit IRC02:48
*** kota_ has joined #openstack-swift02:48
*** ktsuyuzaki has joined #openstack-swift02:51
*** kota_ has quit IRC02:53
*** kota_ has joined #openstack-swift02:56
*** kota_ has quit IRC02:56
*** ktsuyuzaki has quit IRC02:57
notmynamegood evening03:07
notmynamelooks like another 30 minutes in the gate for https://review.openstack.org/#/c/104350/ (but it's at the top, which is good)03:08
*** nthacker has quit IRC03:08
peluse_better than a sharp stick in the eye :)03:10
peluse_kota:  I'll see if I can make some time tomorrow to review - is this what you brought up with clayg at the hackathon?03:12
notmynamepeluse_: when that patch lands, I'll add it to my backport banch and push those into the proposed/2.0.0 branch so we can do the rc203:16
notmynamethe 3 commits being backported are: 0f0c0e5553adeccdf6d95ee61b64ea84ffa79758 and 8a3b65107d788a8590349fc4aa02e5c8c2ad9202 and https://review.openstack.org/#/c/104350/ (in that order)03:16
peluse_notmyname:  sounds like a winner, now I gotta go make some dinner...03:19
peluse_I'm a poet and didn't even know it03:19
hugokuoAnyone knows the usage of --quoted in swift-temp-url ?03:20
notmynamehugokuo: looking03:20
notmynamepeluse_: winner winner chicken dinner03:20
* hugokuo no description in swift-temp-url command help output03:22
notmynamejohn@europa:~/Documents/swift(20bp)$ python bin/swift-temp-url GET 60 /v1/AUTH_hugo/ünicodecontainer/ob secr3t03:23
notmyname/v1/AUTH_hugo/ünicodecontainer/ob?temp_url_sig=1fdffcd47006e21e66e5a006e0a31ffb685abe51&temp_url_expires=140435786303:23
notmynamejohn@europa:~/Documents/swift(20bp)$ python bin/swift-temp-url GET 60 /v1/AUTH_hugo/ünicodecontainer/ob secr3t --quoted03:23
notmyname/v1/AUTH_hugo/ünicodecontainer/ob?temp_url_sig=e350bef2f5b5414f13767698993209e4fb3d93af&temp_url_expires=140435786503:23
notmynamehugokuo: so, if you end the command with --quoted, the urllib.quote() value of the path is used to compute the signature03:24
notmynamehugokuo: oh, wait03:24
notmynamehugokuo: that was wrong03:24
notmynamehugokuo: the opposite is true03:24
notmynamehugokuo: --quoted means than the URL you passed in is already quoted, and so it will first unquote it before doing the hmac03:25
notmynameso if you passed in "%2c" or "%20" in the url (because that's what might be given to the end user), then it will unquote that first instead of using those exact characters for the hamc03:26
notmyname*hmac03:26
notmynamehugokuo: make sense?03:26
*** stevemac has joined #openstack-swift03:28
*** annegent_ has joined #openstack-swift03:28
hugokuonotmyname: so if there's Chinese character in the URL. The --quoted is a must have option for swift-temp-url03:38
notmynamehugokuo: correct03:38
openstackgerritA change was merged to openstack/swift: Fix potential missing key error in container_info  https://review.openstack.org/10435003:40
openstackgerritA change was merged to openstack/swift: Small cleanup to ring serialization  https://review.openstack.org/9761503:40
*** zhiyan_ is now known as zhiyan03:47
peluse_^^ nice.  Calling it a night...03:51
*** nosnos has joined #openstack-swift03:52
*** ho has quit IRC03:58
*** kota_ has joined #openstack-swift03:59
*** bkopilov has joined #openstack-swift04:01
*** ktsuyuzaki has joined #openstack-swift04:01
*** kota_ has quit IRC04:04
*** annegent_ has quit IRC04:06
*** Kbee has joined #openstack-swift04:07
*** ktsuyuzaki has quit IRC04:08
*** annegent_ has joined #openstack-swift04:09
*** elambert has quit IRC04:09
*** ajc_ has joined #openstack-swift04:17
*** Tyger has quit IRC04:21
*** ppai has joined #openstack-swift04:42
*** annegent_ has quit IRC04:43
*** bvandenh has joined #openstack-swift04:44
*** annegent_ has joined #openstack-swift04:52
*** psharma has joined #openstack-swift04:54
*** stevemac has quit IRC04:58
notmynametooling is conspiring to slow down getting stuff backported. -infra has to land a patch before jenkins will pass the tests for the backported patches05:02
*** annegent_ has quit IRC05:07
goodesmorning all05:09
*** gyee has quit IRC05:09
goodesquestion - should updating metadata (i.e. POST) on an object affect the last modified value?05:10
mattoliveraumorning goodes05:28
mattoliveraunotmyname: bugger :(05:28
*** robsparker has quit IRC05:31
goodesmattoliverau: heya05:31
goodesfundamental question - should last modified refer to the contents of the object and/or the meta data05:32
mattoliveraunotmyname: OK, gone through all the daemons and compared what are in the sample config files and the code, there are 3 config options mssing that I have found that are missing, but nothing major. There is however a bunch of defaults in the sample configs, commented but with a value representing the default, which are different then the defaults in the code. I will assume that the code is the correct defaults in this05:33
mattoliveraucase... now to see if the documentation differs from the truth at all.05:33
goodesit seems in my testing that updating the metadata also updates the last modified which could screw up any logic if someone is assuming that it refers to when the contents were last changed05:33
goodesor is this just a limitation of xattr that leaves us no choice?05:34
mattoliveraugoodes: good question, it comes down to what is the "contents", is metadata as important as the object? I think is it.05:34
goodesmattoliverau: this could mean that middleware that updates metadata could have nasty side effects05:35
mattoliveraugoodes: the file gets a new name (timestamp) so it isn't xattr, and I think this is required for sync05:35
mattoliveraugoodes: true, but hopfully the middle ware only updates on a request.05:36
mattoliveraunot all the time touching things.05:36
goodesor an async app that sets something like metadata to show reviewed, compliance etc could also have -ve effects05:36
goodessay you had a process to transcode video to different formats and you wanted to set MD to say that it has been done05:37
goodesunless there is an xattr limitation it would seem that it would be helpful in the POST to specify whether last-modified should be updated or not05:38
*** robsparker has joined #openstack-swift05:46
goodesmattoliverau: apparently the other half of the world is now asleep06:01
mattoliveraugoodes: yeah, slackers :P06:04
*** acoles has quit IRC06:08
*** chandan_kumar has joined #openstack-swift06:25
*** jamiehannaford has joined #openstack-swift06:33
openstackgerritlawrancejing proposed a change to openstack/python-swiftclient: Add CONTRIBUTING.md  https://review.openstack.org/10378606:55
*** Anju has joined #openstack-swift06:59
*** Anju has quit IRC07:05
*** ppai has quit IRC07:35
mattoliverauok, I'm calling it a night, well from in front of the computer anyway :) Night all07:38
mattoliveraugoodes: or should I just say night to you cause you seem to be the only one here :P07:38
*** Midnightmyth has joined #openstack-swift07:41
*** nthacker_ has quit IRC07:44
*** mmcardle has joined #openstack-swift07:55
*** nacim has joined #openstack-swift07:58
*** nosnos has quit IRC08:05
*** nosnos has joined #openstack-swift08:05
*** mlipchuk has joined #openstack-swift08:07
*** foexle has joined #openstack-swift08:24
goodesmattoliverau: g'nite08:26
*** ppai has joined #openstack-swift08:39
*** andyandy has joined #openstack-swift08:58
*** dmorita has quit IRC09:04
*** mitz has quit IRC09:22
*** mitz has joined #openstack-swift09:26
*** Kbee has quit IRC10:51
openstackgerritA change was merged to openstack/swift: Fix exception raising in FakeConn  https://review.openstack.org/10431911:42
*** mmcardle has quit IRC11:43
*** aswadr has joined #openstack-swift11:47
*** mkerrin has quit IRC11:51
*** nosnos has quit IRC11:55
*** nosnos_ has joined #openstack-swift11:58
*** mkerrin has joined #openstack-swift11:59
*** ppai has quit IRC12:02
*** bvandenh has quit IRC12:09
*** mmcardle has joined #openstack-swift12:11
*** mmcardle1 has joined #openstack-swift12:22
*** mmcardle has quit IRC12:25
*** mkollaro has joined #openstack-swift12:28
*** ajc_ has quit IRC12:30
*** fifieldt has quit IRC12:35
*** zigo has quit IRC12:37
*** zigo has joined #openstack-swift12:37
*** bkopilov has quit IRC12:41
*** zigo has quit IRC12:41
*** zigo has joined #openstack-swift12:42
*** nshaikh has joined #openstack-swift12:44
*** zigo has quit IRC12:45
*** mtreinish has quit IRC12:45
*** angelastreeter has joined #openstack-swift12:52
*** miqui has joined #openstack-swift12:56
zulhi guys im looking for some guidance with respect to the storage policy stuff, should things like swift-reconciler-enqueue and swift-container-reconciler be in a seperate package and have init scripts12:57
*** Midnightmyth has quit IRC13:05
*** chandan_kumar is now known as chandankumar13:18
*** psharma has quit IRC13:26
*** Kbee has joined #openstack-swift13:31
*** keshava_ has joined #openstack-swift13:33
*** keshava_ has quit IRC13:33
*** keshava_ has joined #openstack-swift13:33
*** keshava_ has quit IRC13:34
*** keshava_ has joined #openstack-swift13:34
*** keshava_ has quit IRC13:34
*** Kbee has quit IRC13:35
*** panbalag has joined #openstack-swift13:37
*** nosnos_ has quit IRC13:37
*** angelastreeter has quit IRC13:39
*** nosnos has joined #openstack-swift13:49
*** zigo has joined #openstack-swift13:58
*** nosnos has quit IRC13:59
ahaleconfused by defcore emails - is swift no longer gonna be a core openstack project ?14:09
*** bkopilov has joined #openstack-swift14:18
*** angelastreeter has joined #openstack-swift14:27
*** chandankumar has quit IRC14:38
*** honeybadger has joined #openstack-swift14:40
notmynameahale: I don't know what the board is going to do. the TC has expressed very strong and unified support for "openstack is the code in the integrated release". the board may or may not choose to respect that for the purposes of trademark protection14:49
*** foexle has quit IRC14:51
portanteahale, notmyname: can you point me at the specific email you are talking about?14:51
notmynameahale: IMO the important things to do for swift are to make sure that as many deployers (with or without the rest of openstack)) are known and our "core capabilities" are well tested, first where it is and later in tempest (probably)14:51
notmynameportante: http://www.openstack.org/blog/2014/07/openstack-technical-committee-update-july-1/ and http://eavesdrop.openstack.org/meetings/tc/2014/tc.2014-07-01-20.02.log.html are good places to start14:53
portantenotmyname: thanks14:54
ahalei was reading the Foundation list "Understanding DefCore" thread with the links to https://etherpad.openstack.org/p/DefCoreLighthouse.F2F14:55
notmynameportante: it's basically becoming obvious (IMO) that the primary reason for defcore is to figure out if someone can sell "openstack" but exclude swift from that. it has larger implications for some other projects, current and future, but that seems to be the stickiest question today (with those leading defcore seemingly trying to keep swift excluded)14:55
notmynamewhich is why it's very important, again IMO, that we as a community make swift deployments very well known14:56
portantenotmyname: so markmc and russellb are the two leading that sentiment?14:57
notmynameportante: rob hirtchfeld and john mckenty are leading defcore. I had too much direct interaction with others there, so I can't comment on it. that being said, from their role on the TC, there is strong support from the TC of "openstack == code in integrated release"14:59
portanteokay14:59
creihtnotmyname: while I understand your point, such a strong position has other implications as well15:00
creihtlike for example that means you have to run horizon to be called openstack15:00
creihtor any of the other myriad of projects15:00
notmynamecreiht: yes, that is true. that was mentioned int he TC meeting andyou should read the transcript15:00
creihtheh15:01
creihtI'm trying to stay away from high blood pressure :)15:01
notmynamecreiht: actually, I think you'd be pleased with what was said in the TC meeting. there was very strong unified support for swift (since that's the current lightning rod)15:02
creihtheh15:02
portantemordred seems to be leading that15:02
notmynameportante: he was the first to say it, but there were others too15:03
creihtyeah I was watching the meeting on and off yesterday15:03
notmynameone current issue inside of defcore is that the "core capabilities" currently listed for swift are really really wrong. and to a smaller extent there is the misperception that swift isn't pluggable/extensible so therefore can only be treated as a single unit15:03
*** nacim has quit IRC15:03
notmynameas chosen by troy toman, swift's core capabilities are: account services, container ACL, container quota, staticweb, and quotas. I proposed http://lists.openstack.org/pipermail/defcore-committee/2014-May/000173.html but I haven't seen anything come of that yet15:06
notmynameI think there is a json blob somewhere that maps openstack core capabilities to test names (ie the name of a function that tests it), but I think troy's 5 swift capabilities are still what's there15:08
notmynameso....now you know almost everything about defcore that I do. any help in navigating these waters is appreciated :-)15:09
portantebut are the other core capabilities getting into the API features?15:09
portantefor other projects?15:09
*** nshaikh has quit IRC15:10
portanteso we need to specify that reading an object is a core capability? If that is the case, this defcore stuff sounds quite broken15:10
ahaleits weird that the staticweb capability is considered more deployed than object-server capability on the spreadsheet, whole thing seems nuts15:12
creihtwhat is the link to the spreadsheet?15:12
goodesthere is also a negative to this - if you wanted to do a swift only solution - you could never call that openstack15:13
ahalehttps://etherpad.openstack.org/p/DefCoreLighthouse.F2F +L76 creiht15:13
creihtahale: ahh thanks15:13
ahaleah not L76 ChanServ15:13
notmynameahale: https://wiki.openstack.org/w/images/e/e3/DefCore_Capabilities_Scoring.pdf15:13
creihtgoodes: yeah15:13
goodesit seems that the whole discussion is at the wrong granularity15:13
ahalebah creiht not ChanServ.. L93 even15:14
creihthaha15:14
notmynamegoodes: right. but is that bad? it's not "openstack" because openstack is a large umbrella of things. you may be deploying "openstack swift", but that's not "openstack". I'm ok with that15:14
goodeswell it seems that openstack already falls into major categories i.e. computer, object, management (incl orchestration)15:15
notmynameI guess if I get "openstack - swift = not openstack" then I'm also ok with "swift alone = not openstack"15:15
goodess/computer/compute/15:15
goodesaiming for one size fits all - will infact suit no one15:16
creihtahale: that spreadsheet is very confusing15:16
portanteyeah, you can say that again15:16
notmynamelol15:16
ahalecreiht: I think it defines defcore pretty well in that case15:16
creihthahahaha15:16
portanteplays well with others?15:16
portantetakes a system view?15:17
notmynamethere is a more current one I can't find right now where the TC has updated the scoring15:17
* portante ... column headings15:17
*** honeybadger has quit IRC15:18
notmynamecreiht: goodes: point is, from the TC meeting, the TC isn't picking "favorites" among the integrated release. that is, the integrated release is openstack15:18
creihtnotmyname: yeah I got that15:18
goodesthe issue is 'integrated' - does not match the real work or make sense?15:18
creihtnotmyname: but at the same time, you are just pushing the decision to the board15:18
goodes work == world15:19
notmynamecreiht: well I'm not on the TC, so not me, per se ;-)15:19
creihtlol15:19
goodesit seems that this is more about vendors taking and selling OS solutions and not contributing back15:20
notmynamebut I think it's slightly different that just asking the board to make the call. the TC is providing guidance. it's just that those on defcore (ie rob in the TC meeting) really didn't like the given recommendation15:20
notmynamegoodes: yes, that is a huge part of it, I think15:21
goodeswhich if so, then this is not the right way to go about it15:21
creihtthe funny thing is, that is already happening, and is going to happen reguardless15:21
notmynameand for the record, I think openstack is too young and has too little adoption today to start trying to make a shibboleth around "true openstack". now's not the time to limit deployments, IMO15:22
creihtheh15:22
creihtmy argument to rob from the beginning was to get rid of the idea of core and let the markets decide15:22
creihtotherwise you will forever hamper innovation15:23
goodesmost other vendors/standards committess have a 'certification' board with guidlines on how to certify and then they can apply the rule to allow someone to say 'Openstack XXXXX' - but there needs to be lewat15:23
goodesleway15:23
goodesthis seems to be the case of repeating lessons that everyone else learned years ago15:23
creihtand prevent companies from being able to differentiate15:23
notmynamebut the issue actually has legal concerns, since the only thing the foundation controls is the trademark. so if "openstack" is going to mean something, legally the foundation has to defend the TM, and therefore you get the questions of "well, what is openstack anyway?"15:24
goodescreiht: +115:24
goodesbut you set guidelines with the option to review and you make companies pay to be able to use the OpenStack XXXX term15:25
notmynamecreiht: I don't really buy the "we can't innovate if we have to use swift" argument (substitute any openstack project for "swift")15:25
creihtbecause there are artificially blessed projects15:25
creihta simple example is the dashboard15:26
goodesor keystone15:26
creihtthere are tons of ways to innovate/differenentiate with the dashboard15:26
notmynameyou'll remember that when I was on the TC, I only rarely voted to add new projects :-)15:26
creihtsure15:26
notmyname(mostly in a 11-1 minority)15:26
notmyname;-)15:26
creihtanyways... I've argued this to death before15:27
creihtand at this point, it is hard for me to care enough to argue any more about it15:27
goodesproblem is that people are asking 'what does openstack mean' rather then 'what does openstack mean to the customer' - the process is too technical15:27
notmynameand then they win15:27
creihtwin what?15:28
notmynamecreiht: so ya, I think you're right that there are perhaps some openstack projects that are less suited for "innovation", but that seems different than "the code hosted at github.com/openstack/ is what openstack is"15:28
goodesbecuase the only thing that would matter to a customer is one provider was openstack would be that they could transfer their data to another openstack provider, otherwise what does the customer care what powers the cloud solution?15:29
notmynamecreiht: ie when one side gets tired of the argument, the other side wins. for the specific thing now, it's "does swift get tm protection from the foundation as part of openstack?"15:29
goodesnow that apple has swift, what will happen to the name? Surely Apple checked before using the name.15:30
ahalewhat does swift get from being part of the openstack ?15:30
notmynamecreiht: and we've seen that before with everything from bzr, launchpad, "openstack is an atomic thing rather than loosely coupled cooperating systems" etc15:30
creihtI guess I don't care as much about that as you do15:30
creihtwhen people say openstack, they only mean nova anyways15:30
creihtit has always been like that15:30
creihtwill always be15:30
notmynameahale: that's a very good question, if swift doesn't get to enjoy the foundation's tm protection. but I don't really want to explor the implications of that too much until the "if" actually happens, if it ever does15:32
goodes"openstack object (TM)"15:32
creihtgoodes: yeah that was mentioned, but the board is too lazy to want to manage many trademarks15:32
creihthah there you go15:33
creihtif it isn't worth trademarking, it isn't core :)15:33
goodes3? compute (or just Openstack), object and management15:33
creihtgoodes: oh there are like 15 now or something like that15:33
goodesthree main pillars15:33
creihttrue15:33
*** acoles has joined #openstack-swift15:34
*** ChanServ sets mode: +v acoles15:34
creihtkinda15:34
* portante ... so much for technology15:35
notmynameportante: selling it all and starting a llama farm?15:36
* mordred will join portante in llama farming15:37
creihtlol15:37
portantegot two of us, any other takers?15:38
notmynameyes yes, but what does it really /mean/ to "farm"? do I have to plant my llamas int he ground or can I let them simply wander around? can we have any sort of test process around this?15:38
* portante runs!15:38
creihtnotmyname: is there any other presidence for this type of thing?15:39
notmynamefor what type of thing?15:39
goodescan I change the subject for a few mins?15:39
creihtthe trademark stuff15:39
creihtthe hadoop ecosystem is pretty huge15:39
portantegoodes: sure15:39
creihtthere isn't anything that says you have to have x installed to call it hadoop15:40
notmynamecreiht: I don't know15:40
creihtI'm not aware of any other ecosystem that does the same15:40
creihtlong term, people are going to care about cloud15:40
goodesdoing a POST on a file and changing the headers updates the last modified?15:40
creihtopenstack is just an implementation detail15:40
goodesis this becuase that will trigger a replicate to spread the updated metadata or is that independent?15:41
notmynamegoodes: POST is by default implemented as a COPY15:41
notmynamebut I don't recall without looking at the code if the "fast post" (ie not COPY) updates the last-modified15:42
goodesnotmyname: default meaning that it can be changed or that it was a design decision15:42
notmynamegoodes: it can be changed. but you'll lose the ability to change the content type15:43
notmynamethere are some people working on getting the best of both worlds, but it hasn't been written yet15:43
goodesnotmyname: I assume that would be global and not a per container setting15:43
notmynamegoodes: correct15:44
notmynamegoodes: int he proxy config. "post_as_copy" I think15:44
goodesnotmyname: so there is a reference to that in the container sync documentation15:44
notmynameyes15:45
goodesContainer sync will sync object POSTs only if the proxy server is set to use “object_post_as_copy = true” which is the default. So-called fast object posts, “object_post_as_copy = false” do not update the container listings and therefore can’t be detected for synchronization.15:45
goodesbut for replication (not container sync) is this still true?15:46
notmynamecreiht: portante: ok for other stuff, the -infra tooling is trying to get updated so that we can land those backports. then tag rc2 with those changes. unless other things have come up, we shoudl still be able to have a monday final release15:46
*** jamiehannaford has quit IRC15:46
notmynamegoodes: replication is orthogonal to container sync15:46
goodesassuming that older implementations use container sync to copy between regions15:47
goodesif they no longer will rsync, ssync still replicate if object_post_as_copy = false15:47
notmynameI think you're confusing container sync and replication15:48
goodespossibly15:48
portantenotmyname: k15:48
peluse_ notmyname:  what's the status/plans on 2.0 at the moment?15:48
*** jamiehannaford has joined #openstack-swift15:49
notmynamepeluse_: (see above) working with -infra right now. the 3 backport patches are good to go once jenkins can be convinced it's ok.15:49
notmynamepeluse_: I think monday is still ok for final release, with (as you may have seen from dana) with some press stuff on tuesday15:50
* peluse_ is scrolling :)15:50
notmynamepeluse_: about 3 lines up. pay no attention to the defcore stuff ;-)15:51
notmynameor you might join portante and mordred and sell it all to start a llama farm15:51
*** gyee has joined #openstack-swift15:52
* peluse_ is all in when it comes to any kind of sheep thingy - aren't they close to llamas?15:54
creihtheh15:58
*** mtreinish has joined #openstack-swift16:00
zigoFYI, gf-complete and jerasure have just been validated by FTP masters and just entered Debian! :)16:01
*** mtreinish has quit IRC16:04
*** mtreinish has joined #openstack-swift16:04
notmynamezigo: nice!16:05
zigonotmyname: Are you working on the erasure stuff?16:05
*** angelastreeter has quit IRC16:05
zigoI'd like to know about the status of PyECLib and separation of libec ...16:06
zigoI'm waiting for it to be able to package it in Debian.16:06
*** panbalag has quit IRC16:07
notmynamezigo: that's for tushar and kevin. but for people in irc, you should talk to peluse_16:08
zigoOk.16:08
zigoWill ping tushar (I got his email address).16:09
*** mwstorer has joined #openstack-swift16:09
*** lpabon_test has joined #openstack-swift16:15
*** mlipchuk has quit IRC16:23
*** zhiyan is now known as zhiyan_16:29
*** mmcardle1 has quit IRC16:53
notmynamelooks like about 2 hours ish for the -infra patch to land before I can recheck the backport patches16:55
* notmyname goes offline for a bit for getting ready/commute/etc16:56
*** lpabon_test has quit IRC16:57
peluse_zigo: I'll get tsg in here17:02
*** tsg has joined #openstack-swift17:03
tsgzigo: ping17:03
zigotsg: pong !17:04
tsgzigo: this is Tushar17:05
zigoOh ok, cool!17:06
zigotsg: How's going the eclib and pyeclib thing?17:06
zigoAny progress?17:06
tsgzigo: progressing pretty well17:06
zigo:)17:06
zigoCool.17:06
tsgthe split is pyeclib:liberasurecode now17:06
tsghttps://bitbucket.org/tsg-/liberasurecode/commits/all17:06
tsgwe are 50% there moving stuff out of pyeclib17:07
tsgzigo: no more network downloads!  ;)17:07
zigotsg: Do you think I can already start packaging liberasurecode?17:07
tsgzigo: give us until Monday17:07
zigoOk.17:07
zigoNo pb.17:07
tsga lot of stuff in pipeline17:07
tsgzigo: pyeclib remains a python api layer now17:08
zigoI don't want to sound like putting pressure, I just don't want to miss the November deadline to get this into Jessie! :)17:08
zigoIt'd be just so nice to have all this in Swift for Jessie.17:08
tsgzigo: no worries, we have a deadline to get the first few EC Swift patches in by end of this month which depends on pyeclib :)17:08
zigoAwesome! :)17:09
tsgzigo: it might be a good idea for you to watch liberasurecode and pyeclib17:09
tsgso we can take in any suggestions you may have, early enough17:09
zigoOk, will try.17:10
tsgzigo: thanks!  :)17:10
zigotsg: FYI, gf-complete and jerasure just entered Debian today.17:10
tsgzigo: awesome!  thanks for getting that done - those will be "runtime" deps for liberasurecode17:11
zigoThe only issue is that I couldn't activate SSE code, because it's compile time only.17:12
tsgzigo: ah, you mean any of SSE/AVX code?17:12
zigoYeah, cause the Debian packages are built once, for all x86 CPUs.17:13
tsgzigo: is it possible to split the package into multiple subpackages - sse, sse3, avx etc variants17:13
zigoOne way could be to have a specific .deb with the SSE activated, so that our users could choose, but it'd be best if it could be a runtime thing.17:13
zigoYeah, though not sure how I'd deal with the buildd thing in Debian.17:14
tsgzigo: isa_l should be better that way .. it does a cpuid at runtime17:14
zigoWhat's isa_l ?17:14
tsgzigo: https://01.org/intel%C2%AE-storage-acceleration-library-open-source-version17:15
tsgprovides SIMD based building blocks for erasure code (reed soloman and cauchy)17:16
tsgzigo: this is one of the libraries we'll add support for, in liberasurecode17:16
tsgzigo: let me check internally to make sure we have a go ahead to create .deb for isa_l .. will get back to you17:17
zigoWell, I can try to work out SSE for gf-complete & jerasure, I think.17:19
*** Tyger has joined #openstack-swift17:19
zigoAnyway, for those who deploy, it's just a mater of doing rm -rf debian/patches and rebuild, so it's pretty easy.17:19
tsgzigo: sounds good17:21
zigotsg: Could you please add a tag to liberasurecode?17:21
zigoAnything, even 0.0.0.1 ... :)17:21
*** elambert has joined #openstack-swift17:21
tsgzigo: will do :)17:23
*** aswadr has quit IRC17:52
*** mwstorer has quit IRC18:01
*** foexle has joined #openstack-swift18:17
notmynamegood morning again. (traffic is bad downtown today)18:23
*** andyandy has quit IRC18:30
*** mwstorer has joined #openstack-swift18:34
TygerGood morning18:47
*** foexle has quit IRC18:57
*** sombrafam has joined #openstack-swift19:00
*** sombrafam is now known as erlon19:00
Tygernotmyname: While the question if changing the user agent will break any log monitoring remains unanswered, I did add an update to the logs document to patch 102401.19:01
notmynamethanks19:01
*** wer has quit IRC19:04
*** CaioBrentano has joined #openstack-swift19:08
*** CaioBrentano has left #openstack-swift19:09
*** Tyger has quit IRC19:13
claygwow, crazy scrollback today - not sure I caught all the conversations going on19:20
*** jamiehannaford has quit IRC19:20
*** zaitcev has joined #openstack-swift19:21
*** ChanServ sets mode: +v zaitcev19:21
*** robsparker has quit IRC19:26
*** jamiehannaford has joined #openstack-swift19:35
*** robsparker has joined #openstack-swift19:37
goodesnotmyname: so the question is, besides container sync, will setting 'object_post_as_copy = false' have any other side effects19:58
*** Tyger has joined #openstack-swift20:01
*** foexle has joined #openstack-swift20:03
*** foexle has quit IRC20:10
*** foexle has joined #openstack-swift20:10
clayggoodes: you don't get a new last_modified in the container listings when you do a POST, but if you HEAD the object server you get a new modified time (time of the last POST)20:17
*** jamiehannaford has quit IRC20:17
goodesclayg: the goal here is not change the last-modified when setting metadata20:18
goodesclayg: are you saying that is the general case?20:18
*** jamiehannaford has joined #openstack-swift20:20
claygwut?20:21
claygyeah when you post the object is "modified"20:21
claygcan you try setting that option on a dev setup and see if it does what you want?20:22
goodesclayg: testing now20:22
*** mmcardle has joined #openstack-swift20:25
*** sandywalsh has quit IRC20:29
*** sandywalsh has joined #openstack-swift20:30
*** jamiehannaford has quit IRC20:36
*** wer has joined #openstack-swift20:42
*** mwstorer has quit IRC21:02
goodesclayg: so weird, I set it to false, restarted everything (in vsaio) and it is still updating x-timestamp and last-modified for both head and get_object21:05
*** foexle has quit IRC21:06
goodesclayg: ah ha - get what you mean - get/head returns time stamp of .meta file and container list returns timestamp of .data file21:09
goodesobviously too late at night for me - time to turn in - enjoy your 4th July holidays21:16
*** lpabon has quit IRC21:17
*** mwstorer has joined #openstack-swift21:22
notmynamebackports finally making their way through jenkins21:57
notmynamedefcore follow up from rob: http://lists.openstack.org/pipermail/defcore-committee/2014-July/000240.html22:07
mattoliverauMorning22:10
notmynamemattoliverau: good morning to you and happy 'murica day22:10
mattoliveraunotmyname: lol, thanks, now all I need to get my hands on are some fireworks :)22:13
notmyname:-)22:15
peluse_morning22:15
peluse_notmyname:  good news on the backports!22:16
notmynameyup22:17
notmynamepeluse_: oh hey! glad you are online. what's your schedule look like next week?22:17
notmynamemon-wed?22:17
peluse_notmyname.  and intersting link you posted there on defcon or defcore, whatever it is :)22:17
peluse_I'm here all week like a bad lounge singer22:17
peluse_well... looks like I have an all day meeting on Wed though.  wheee22:18
notmynamepeluse_: I want to have a hourish phone call with you where we talk about a spec document for the EC work. getting all the parts in swift that need to change down in one place. and maybe I'll convince torgomatic to join in too :-)22:18
* torgomatic types faster22:19
peluse_excellent...22:19
*** mmcardle has quit IRC22:19
peluse_pick a day and I'll let you know what times work (just not Wed)22:20
notmynamepeluse_: tuesday22:20
openstackgerritSamuel Merritt proposed a change to openstack/swift: Zero-copy object-server GET responses with splice()  https://review.openstack.org/10260922:21
openstackgerritSamuel Merritt proposed a change to openstack/swift: Zero-copy object-server PUT requests with splice()  https://review.openstack.org/10470522:21
peluse_what time is it in CA right now?22:21
notmynamepeluse_: 3:22pm right now22:22
peluse_1:00 Tue work for you guys?22:22
notmynameCA time?22:22
peluse_yes, we're the same right now22:22
notmynameok. that should work for me 1pm tuesday. I'll send an invite22:23
peluse_coolio22:23
peluse_so on EC docs, you guys good with doing multiple commits to feature/ec this time instead of one giant one?  I'll have a good start ready to post soon22:24
notmynamepeluse_: I think we can plan this one better. I expect similar starts and missteps in the feature/ec branch as we had with SP work. so doing all of the stuff on feature/ec and then making a feature/ec-review branch may be what happens22:26
notmynamepeluse_: either way, I see zero reason to delay or put requirements around docs for EC in the feature/ec branch :-)22:26
peluse_OK, with docs specifically though I'd rather merge as we go so the feature/ec branch actually has accurate (albeit not complete) docs at any given point in time22:27
peluse_cool, we were typing at the same time22:27
notmynamegreat :-)22:27
*** elambert has quit IRC22:28
*** wer has quit IRC22:50
*** wer has joined #openstack-swift22:50
openstackgerritpaul luse proposed a change to openstack/swift: Initial Erasure Code Docs  https://review.openstack.org/10471323:03
*** tsg has quit IRC23:18
*** mwstorer has quit IRC23:23
*** mtreinish has quit IRC23:31
*** mtreinish has joined #openstack-swift23:39

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!