Thursday, 2015-11-12

*** nexusz99 has quit IRC00:00
*** nadeem has quit IRC00:01
*** lcurtis has quit IRC00:08
*** jamielennox is now known as jamielennox|away00:08
*** siva_krishnan has quit IRC00:10
*** nexusz99 has joined #openstack-swift00:11
*** siva_krishnan has joined #openstack-swift00:11
*** nexusz99 has quit IRC00:12
*** nbalaji has quit IRC00:18
*** joeljwright has quit IRC00:19
*** siva_krishnan has quit IRC00:19
*** jamielennox|away is now known as jamielennox00:21
*** m_kazuhiro has joined #openstack-swift00:28
*** dmorita has joined #openstack-swift00:43
*** diogogmt has quit IRC00:48
notmynameI get the same error as the gate when I run the unittests under tox. for https://review.openstack.org/#/c/244287/00:49
claygnotmyname: yay!  reproducibility is key!00:52
*** itlinux has joined #openstack-swift00:59
*** bill_az has quit IRC01:08
*** garthb__ has quit IRC01:10
*** m_kazuhiro has quit IRC01:12
*** m_kazuhiro has joined #openstack-swift01:12
*** chsc has quit IRC01:15
pelusenotmyname: beats me, I'm working from home01:21
pelusenotmyname: but he's not on internal IM either so probably not01:21
clayghttp://stackoverflow.com/questions/20124472/python-float-to-ratio lol @ Possible duplicates: every question ever asked about floating point math.01:35
*** lyrrad has quit IRC01:36
*** mahatic has joined #openstack-swift01:36
*** haomaiwa_ has joined #openstack-swift01:37
notmynamepeluse: ah, ok. thanks01:38
notmynamepeluse: we're not in the same TZ anymore are we?01:38
mahaticgood morning!01:39
notmynamehello mahatic01:39
pelusenotmyname: nope, you guys are an hour behind us now01:39
mahatichello notmyname01:39
pelusemahatic:  morning!01:40
notmynamepeluse: I think the correct phrase is that you're in The FUTURE!01:40
pelusenotmyname: most of the time i feel more like I'm in the past though :)01:40
mahaticpeluse: morning!01:40
mahaticnotmyname: nope, I am in the future, ha!01:40
peluseOK, gotta go cook up some dinner.... l8r01:40
notmynamepeluse: that's only until DST ends ;-)01:40
notmynamemahatic: It hink Zyric has us all beat. already nearly 3pm there ;-)01:41
mahaticnotmyname: oh yeah heh01:41
*** asettle is now known as asettle-afk01:44
*** itlinux has quit IRC01:46
*** pdardeau has joined #openstack-swift01:51
*** Guest21151 has quit IRC01:54
*** pdardeau has quit IRC01:56
*** pdardeau has joined #openstack-swift01:57
*** haomaiwa_ has quit IRC02:01
*** haomaiwa_ has joined #openstack-swift02:01
openstackgerritTim Burke proposed openstack/swift: Stop logging "client disconnected" for 304 / 412 responses  https://review.openstack.org/24439402:06
*** bill_az has joined #openstack-swift02:12
*** diogogmt has joined #openstack-swift02:13
*** klrmn1 has quit IRC02:13
*** gyee has quit IRC02:14
*** pdardeau has quit IRC02:18
*** zhill has quit IRC02:18
clayghow about the clients stop disconnecting!?02:21
claygoh wait... maybe I didn't read that correctly02:21
*** bill_az has quit IRC02:21
*** Lickitysplitted has quit IRC02:32
*** lnxnut has joined #openstack-swift02:37
*** Lickitysplitted has joined #openstack-swift02:45
openstackgerritMerged openstack/python-swiftclient: Centralize header parsing  https://review.openstack.org/18433602:53
*** haomaiwa_ has quit IRC03:01
*** haomaiwa_ has joined #openstack-swift03:01
*** mahatic has quit IRC03:04
openstackgerritClay Gerrard proposed openstack/swift: Ring Overview updates  https://review.openstack.org/24441203:05
clayggah - doing doc is the worst03:08
claygbut it's good I picked at the overview because it was full of references to multiple replicas of the same part on the same device - lawl!03:10
*** wbhuber_ has joined #openstack-swift03:24
*** wbhuber has quit IRC03:27
*** jrichli has joined #openstack-swift03:28
*** diazjf has joined #openstack-swift03:31
*** diazjf has quit IRC03:34
*** diazjf has joined #openstack-swift03:36
*** rjaiswal has quit IRC03:45
openstackgerritMerged openstack/swift: Added unit tests for ringbuilder command-line utility  https://review.openstack.org/24007603:47
*** jrichli_ has joined #openstack-swift03:49
*** jrichli has quit IRC03:52
*** sw3 has joined #openstack-swift03:52
*** haomaiwa_ has quit IRC04:01
*** haomaiwang has joined #openstack-swift04:01
*** SkyRocknRoll has joined #openstack-swift04:08
*** badari has quit IRC04:17
*** badari has joined #openstack-swift04:22
*** wbhuber_ has quit IRC04:26
*** mahatic has joined #openstack-swift04:30
*** haomaiwang has quit IRC04:37
*** SkyRocknRoll has quit IRC04:38
*** ppai has joined #openstack-swift04:40
*** haomaiwang has joined #openstack-swift04:42
*** ppai has quit IRC04:52
*** haomaiwang has quit IRC04:56
openstackgerritClay Gerrard proposed openstack/swift: Bump PyECLib requirement to >=1.0.7  https://review.openstack.org/24428705:06
*** links has joined #openstack-swift05:07
*** asettle-afk is now known as asettle05:08
*** jrichli_ has quit IRC05:09
*** haomaiwang has joined #openstack-swift05:13
*** diazjf has quit IRC05:26
*** haomaiwang has quit IRC05:27
*** haomaiwang has joined #openstack-swift05:38
*** haomaiwang has quit IRC05:50
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925005:58
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873605:58
*** trifon has joined #openstack-swift06:00
*** km has joined #openstack-swift06:08
*** km is now known as Guest4538006:08
*** haomaiwa_ has joined #openstack-swift06:09
*** jerrygb has quit IRC06:14
*** tsg has joined #openstack-swift06:21
*** haomaiwa_ has quit IRC06:21
tsgnotmyname, clayg: sorry was away with some ongoing 'Diwali' festivities today - will take a closer look at what's going on with patch 24428706:23
patchbottsg: https://review.openstack.org/#/c/244287/ - Bump PyECLib requirement to >=1.0.706:23
tsglooks like clayg's tox.ini change for LD_LIBRARY_PATH didn't help either06:23
*** haomaiwang has joined #openstack-swift06:25
*** trifon_ has joined #openstack-swift06:38
*** mac_ified has quit IRC06:41
*** sc68cal has quit IRC06:45
*** links has quit IRC06:45
*** tsg has quit IRC07:00
*** haomaiwang has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:01
*** pchng_ has joined #openstack-swift07:03
*** haomaiwang has quit IRC07:04
*** links has joined #openstack-swift07:05
*** pchng has quit IRC07:05
*** mzhou has quit IRC07:08
*** okdas has quit IRC07:14
*** okdas has joined #openstack-swift07:15
*** okdas has joined #openstack-swift07:15
*** janonymous has joined #openstack-swift07:22
*** haomaiwang has joined #openstack-swift07:24
janonymousnotmyname, lifeless : I saw the comments above about testr , really now the picture is more clear :)07:28
*** haomaiwang has quit IRC07:38
*** haomaiwang has joined #openstack-swift07:40
*** haomaiwang has quit IRC07:51
*** dmorita has quit IRC07:53
*** aix has joined #openstack-swift07:55
*** haomaiwa_ has joined #openstack-swift07:56
*** janonymous has quit IRC08:00
*** haomaiwa_ has quit IRC08:01
*** haomaiwang has joined #openstack-swift08:01
*** arnox has joined #openstack-swift08:04
*** haomaiwang has quit IRC08:14
*** rledisez has joined #openstack-swift08:15
*** haomaiwang has joined #openstack-swift08:16
*** sc68cal has joined #openstack-swift08:31
*** haomaiwang has quit IRC08:32
*** haomaiwang has joined #openstack-swift08:33
*** ho has quit IRC08:39
*** Pablo|off| has joined #openstack-swift08:40
*** janonymous has joined #openstack-swift08:44
*** geaaru has joined #openstack-swift08:46
*** Pablo|off| is now known as pcaruana08:48
*** rcernin has joined #openstack-swift08:50
*** haomaiwang has quit IRC09:00
*** janonymous has quit IRC09:01
*** jistr has joined #openstack-swift09:03
*** jordanP has joined #openstack-swift09:07
*** haomaiwang has joined #openstack-swift09:08
*** aix has quit IRC09:19
*** aix has joined #openstack-swift09:21
*** haomaiwang has quit IRC09:34
*** haomaiwa_ has joined #openstack-swift09:38
*** Zyric has quit IRC09:43
*** openstackgerrit has quit IRC09:46
*** openstackgerrit has joined #openstack-swift09:46
*** haomaiwa_ has quit IRC09:58
*** haomaiwa_ has joined #openstack-swift09:59
*** haomaiwa_ has quit IRC10:01
*** haomaiwa_ has joined #openstack-swift10:01
*** haomaiwa_ has quit IRC10:11
*** haomaiwang has joined #openstack-swift10:13
*** openstackgerrit has quit IRC10:16
*** openstackgerrit has joined #openstack-swift10:16
*** joeljwright has joined #openstack-swift10:26
*** ChanServ sets mode: +v joeljwright10:26
*** haomaiwang has quit IRC10:31
*** haomaiwang has joined #openstack-swift10:36
*** jmccarthy has joined #openstack-swift10:38
*** esker has joined #openstack-swift10:39
*** jistr_ has joined #openstack-swift10:48
*** rcernin_ has joined #openstack-swift10:48
*** haomaiwang has quit IRC10:48
*** aix_ has joined #openstack-swift10:48
*** jistr has quit IRC10:49
*** rcernin has quit IRC10:49
*** rcernin has joined #openstack-swift10:50
*** 7F1AAZM53 has joined #openstack-swift10:51
*** aix has quit IRC10:51
*** aix_ has quit IRC10:53
*** rcernin_ has quit IRC10:53
*** jistr_ has quit IRC10:54
*** 7F1AAZM53 has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
*** haomaiwang has quit IRC11:02
*** aix_ has joined #openstack-swift11:05
*** jistr_ has joined #openstack-swift11:05
*** jamielennox is now known as jamielennox|away11:12
*** haomaiwang has joined #openstack-swift11:12
*** esker has quit IRC11:13
*** jerrygb has joined #openstack-swift11:15
*** esker has joined #openstack-swift11:17
*** jerrygb has quit IRC11:19
*** esker has quit IRC11:22
*** haomaiwang has quit IRC11:24
*** haomaiwang has joined #openstack-swift11:30
*** Chavers has joined #openstack-swift11:32
*** lnxnut has quit IRC11:39
*** lpabon has joined #openstack-swift11:39
*** haomaiwang has quit IRC11:41
*** badari has quit IRC11:45
*** haomaiwang has joined #openstack-swift11:47
*** joeljwright has quit IRC11:58
openstackgerritMerged openstack/swift: Fix testing issues  https://review.openstack.org/23593311:58
*** haomaiwang has quit IRC12:01
*** haomaiwang has joined #openstack-swift12:01
*** marzif has joined #openstack-swift12:08
*** haomaiwang has quit IRC12:11
*** haomaiwang has joined #openstack-swift12:11
*** m_kazuhiro has quit IRC12:14
*** jistr_ is now known as jistr12:20
*** haomaiwang has quit IRC12:22
*** haomaiwang has joined #openstack-swift12:23
*** Chavers has quit IRC12:25
*** CaioBren_ has joined #openstack-swift12:33
*** CaioBrentano has quit IRC12:36
*** haomaiwang has quit IRC12:42
*** Chavers has joined #openstack-swift12:45
*** mahatic has quit IRC12:46
*** siva_krishnan has joined #openstack-swift12:47
*** Guest45380 has quit IRC12:55
*** lpabon has quit IRC13:00
*** mahatic has joined #openstack-swift13:03
*** haomaiwang has joined #openstack-swift13:08
*** jerrygb has joined #openstack-swift13:15
*** jerrygb_ has joined #openstack-swift13:18
*** jerrygb has quit IRC13:22
*** MVenesio has joined #openstack-swift13:29
*** diogogmt has quit IRC13:37
*** jerrygb_ has quit IRC13:39
*** diogogmt has joined #openstack-swift13:40
*** CaioBren_ has quit IRC13:40
*** joeljwright has joined #openstack-swift13:50
*** ChanServ sets mode: +v joeljwright13:50
*** haomaiwang has quit IRC14:01
*** haomaiwang has joined #openstack-swift14:01
*** CaioBrentano has joined #openstack-swift14:01
*** diogogmt has quit IRC14:01
*** bill_az has joined #openstack-swift14:08
*** joeljwright has quit IRC14:09
*** minwoob has joined #openstack-swift14:11
*** wbhuber_ has joined #openstack-swift14:16
*** bill_az has quit IRC14:17
*** marzif has quit IRC14:20
*** jerrygb has joined #openstack-swift14:22
*** MVenesio has quit IRC14:26
*** proteusguy__ has joined #openstack-swift14:27
*** proteusguy_ has quit IRC14:29
openstackgerritSivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py  https://review.openstack.org/24467814:30
*** siva_krishnan has quit IRC14:31
*** MVenesio has joined #openstack-swift14:31
*** siva_krishnan has joined #openstack-swift14:32
*** petertr7_away is now known as petertr714:33
*** siva_krishnan has quit IRC14:38
*** badari has joined #openstack-swift14:43
*** petertr7 is now known as petertr7_away14:47
*** petertr7_away is now known as petertr714:49
*** blmartin has joined #openstack-swift14:54
*** pchng_ is now known as pchng14:55
*** haomaiwang has quit IRC14:58
*** haypo has joined #openstack-swift15:04
*** BAKfr has quit IRC15:06
*** esker has joined #openstack-swift15:06
*** diogogmt has joined #openstack-swift15:07
*** diogogmt has quit IRC15:07
*** BAKfr has joined #openstack-swift15:09
*** tsg has joined #openstack-swift15:10
*** diogogmt has joined #openstack-swift15:10
*** lnxnut has joined #openstack-swift15:16
*** breitz has quit IRC15:18
*** breitz has joined #openstack-swift15:18
*** marzif has joined #openstack-swift15:21
*** siva_krishnan has joined #openstack-swift15:22
*** jrichli has joined #openstack-swift15:25
*** garthb has joined #openstack-swift15:28
*** CaioBren_ has joined #openstack-swift15:29
*** CaioBrentano has quit IRC15:32
*** petertr7 is now known as petertr7_away15:46
*** petertr7_away is now known as petertr715:49
*** jlhinson has joined #openstack-swift15:52
*** aix_ has quit IRC15:52
*** aix has joined #openstack-swift15:56
notmynametsg: clayg: in my saio, if I (starting from no pyeclib at all) install via `sudo pip install pyeclib==1.0.7` then I get *only* the python part and not the liberasurecode or any other .so. however, if I use `sudo -H pip install pyeclib==1.0.7` I get all the .so libs installed correctly15:57
notmynameI think this is a hint as to what's going wrong with tox15:57
notmyname(just not sure what it means yet)15:57
*** trifon has quit IRC15:59
hayponotmyname: since pip 6, pip has an internal wheel cache. so PyEClib setup.py is not run again if you already have a local cached wheel file. see: find /home/haypo/.cache/pip/ -iname "pyeclib*.whl"16:04
*** pdardeau has joined #openstack-swift16:04
notmynameah ok16:04
hayponotmyname: so you may remove the cached wheel files to replay the upgrade16:04
haypowheel packages are not compatible with the "let's install a custom C library in setup.py" :-)16:05
*** pdardeau has quit IRC16:06
*** jlhinson has quit IRC16:08
*** jlhinson has joined #openstack-swift16:08
notmynameI'm trying to get back into the state I had last night where it was failing16:09
*** tongli has joined #openstack-swift16:09
notmynamehaypo: so it's probably as simple as you jsut said. wheels don't work with installing .sos16:12
notmynameand that's why tsg was saying that he wants to get another liberasurecode package built and deployed to the CI slaves16:12
*** esker has quit IRC16:12
*** esker has joined #openstack-swift16:13
hayponotmyname: it may work, since pip are usually only built locally. so setup.py is run locally at least once16:13
haypobut downgrade dance may not work16:13
*** mattymo has left #openstack-swift16:14
notmynamethe situation we're in now is that the swift code works with >=1.0.7, we want to move to >=1.1.1, we can get stuff working locally and reasonably expect it to work in prod for upgrades, but we can't get the gate to pass on this intermediate step16:15
hayponotmyname: for gates, the best would be to have distro packages16:16
hayponotmyname: last time i checked, Ubuntu & Fedora had packages for liberasurecode (Ubuntu: 1.1.0, Fedora: 1.0.9)16:17
*** links has quit IRC16:18
haypohttps://launchpad.net/ubuntu/+source/liberasurecode & https://admin.fedoraproject.org/pkgdb/package/liberasurecode/16:18
notmyname1.1.0 had a bad install path and that's why there's a 1.1.116:19
hayponotmyname: it doesn't matter for a linux package which probably override the default prefix, no?16:19
*** CaioBren_ has quit IRC16:21
*** mahatic has quit IRC16:24
*** mahatic has joined #openstack-swift16:25
*** jbonjean has left #openstack-swift16:25
*** CaioBrentano has joined #openstack-swift16:26
*** MVenesio_ has joined #openstack-swift16:29
*** MVenesio has quit IRC16:30
*** jlhinson has quit IRC16:31
*** chsc has joined #openstack-swift16:33
tdasilvanotmyname, haypo: so how can i fix the whole 'local cached wheel' on my dev machine? If I just delete pyeclib*.whl and run pip install again, then it should work??16:34
notmynametdasilva: make sure you clear out the stuff in /usr/local/lib too16:35
haypotdasilva: try: find ~/.cache/pip -iname "pyeclib*.whl" -delete16:35
haypotdasilva: (maybe begin without -delete ;-))16:35
tdasilvahaypo: found this PyECLib-1.1.1-cp27-none-linux_x86_64.whl16:37
tdasilvahaypo: is that what you would expect, or should it be the 1.0.7 version?16:37
haypotdasilva: what do you want to do?16:38
haypoif you remove the wheel cache, the setup.py will be executed again when you install PyEClib16:38
tdasilvahaypo: got it16:38
tdasilvaI was trying to review tushar's patch and ran into the same problem you guys already described16:39
haypoah, it looks like pip has an option: --no-binary :all:16:39
tdasilvaFailure: ImportError (liberasurecode.so.1: cannot open shared object file: No such file16:39
haypo(and a deprecated option --no-use-wheel)16:39
tdasilvahmm16:39
tdasilvai don't see either option listed under 'pip --help'16:41
haypotdasilva: what is your pip version?16:41
haypothe latest version is 7.1.2. transparent wheel cache is available and enabled by default since pip 616:41
tdasilvapip 7.1.216:42
haypotdasilva: ah yes, try: pip install --help ;-)16:42
tdasilvagot it16:44
*** itlinux has joined #openstack-swift16:44
*** nadeem has joined #openstack-swift16:47
*** jlhinson has joined #openstack-swift16:48
*** aix has quit IRC16:49
*** rcernin has quit IRC16:50
*** petertr7 is now known as petertr7_away16:52
*** blmartin has quit IRC16:56
*** gyee has joined #openstack-swift16:56
tsghaypo: has CI always used the "python setup.py bdist_wheel" target?  (I assume not).16:58
tsghaypo: if not, has this been a recent switch?  or just a pip 7.1.x thing?16:58
*** petertr7_away is now known as petertr716:59
*** marzif has quit IRC16:59
tsghaypo: (sorry, I missed parts of earlier conversation)16:59
haypotsg: i hope that the CI spawn fresh VM at each run16:59
gmmahai enabled swift to talk to keystone (install from source) and i am getting functional test errors https://gist.github.com/ganeshmaharaj/a49fab65665ba69d9e7f16:59
tsghaypo: yes, they do :) and that's how I have been testing as well (with docker though)16:59
*** marzif has joined #openstack-swift17:00
gmmahabeen tring to figure out why via pdb but no luck.17:00
haypotsg: so i don't think that the wheel cache matters on the CI17:00
gmmahahas anyone seen this before?17:00
*** pdardeau has joined #openstack-swift17:01
*** lcurtis has joined #openstack-swift17:04
*** garthb has quit IRC17:05
*** marzif has quit IRC17:05
*** marzif has joined #openstack-swift17:06
*** pcaruana has quit IRC17:06
*** nadeem has quit IRC17:07
*** diazjf has joined #openstack-swift17:14
*** marzif has quit IRC17:20
*** rcernin has joined #openstack-swift17:24
*** mzhou has joined #openstack-swift17:25
*** rledisez has quit IRC17:27
*** geaaru has quit IRC17:28
*** arnox has quit IRC17:30
*** jlhinson has quit IRC17:31
*** pdardeau has quit IRC17:31
*** MVenesio has joined #openstack-swift17:40
*** petertr7 is now known as petertr7_away17:40
*** MVenesio_ has quit IRC17:41
*** aix has joined #openstack-swift17:43
*** david-lyle has quit IRC17:46
* notmyname commutes17:46
*** blmartin has joined #openstack-swift17:50
*** klrmn1 has joined #openstack-swift17:55
*** garthb has joined #openstack-swift18:06
openstackgerritSivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for common/bufferedhttp.py  https://review.openstack.org/24467818:07
*** jistr has quit IRC18:22
notmynamegood morning, again18:30
*** jordanP has quit IRC18:32
*** petertr7_away is now known as petertr718:32
*** CaioBrentano has quit IRC18:37
*** diazjf has quit IRC18:38
*** zul has quit IRC18:41
*** zul has joined #openstack-swift18:42
*** EmilienM has quit IRC18:42
*** CaioBrentano has joined #openstack-swift18:43
*** EmilienM has joined #openstack-swift18:46
*** petertr7 is now known as petertr7_away18:47
*** CaioBrentano has quit IRC18:50
*** petertr7_away is now known as petertr718:56
*** gyee has quit IRC18:56
*** klrmn1 has quit IRC18:56
*** klrmn1 has joined #openstack-swift18:57
*** wbhuber_ has quit IRC19:00
*** wbhuber has joined #openstack-swift19:01
*** itlinux has quit IRC19:02
claygheyoh!19:12
claygtsg: so we need to get the liberasure that goes with pyeclib 1.1.1 packaged and installed on the gate vm's yeah?19:12
claygtsg: notmyname: the only reason that pyeclib 1.1.1 was working on our saio's was because we already jerasure installed?19:13
notmynameliberasurecode, but yeah (I think)19:13
notmyname1.1.1 doesn't have any jerasure with it19:13
*** diazjf has joined #openstack-swift19:14
claygyeah but it's still a valid ec type - i'm pretty sure19:14
notmynameonly if the jerasure so is found19:14
claygnotmyname: which it was on our saio's19:14
notmynameyes, in an upgrade setting (ie jerasure isn't deleted by installing newer pyeclib)19:15
*** aix has quit IRC19:15
claygnotmyname: fair, but my point was that the newer liberasure isn't installed either - i had to compile from source (personally) to get the new liberasure_rs_vand ec type to work19:16
claygdoes anyone know anything about glance - re: lp bug #151102519:17
openstackLaunchpad bug 1511025 in OpenStack Object Storage (swift) "Image download with multi tenant true fails" [Undecided,Confirmed] https://launchpad.net/bugs/151102519:17
notmynameoh, ok19:17
*** nadeem has joined #openstack-swift19:18
tdasilvaclayg: hi, i'm reading your doc patch now (patch 244412), is it ok to push changes on top of that (minor fixes)?19:19
patchbottdasilva: https://review.openstack.org/#/c/244412/ - Ring Overview updates19:19
*** rohit_ has joined #openstack-swift19:19
*** siva_krishnan has quit IRC19:19
claygtdasilva: oh god please yes do!19:20
claygtdasilva: I'm absolutely the worst person to write docs - it's not that I shouldn't *write* docs (we should all write more stuff down) - but I have such terrible spelling and grammer and proof-reading I desperatly need a good editor - just wastes time to go back and forth - i agree with any improvements you have in mind a priori19:21
*** jlhinson has joined #openstack-swift19:25
*** nadeem has quit IRC19:29
tdasilvaclayg: ok, but it's a great job btw. thanks for taking the time to write it down19:30
*** nadeem has joined #openstack-swift19:30
claygtdasilva: yeah for sure needed to happen - thank torgomatic_ and notmyname for telling me to do it!19:33
gmmahahas anyone seen this before?19:34
gmmahasorry upkey in the wrong window19:34
wbhuberclayg: regarding rebuilding the frag on a hand off node after discovering that one device goes off (unmounted or server down) that would fail the ec scheme (i.e. 4+2), is the reconstructor currently designed to handle fragments of an existing object whenever it is missing, misplaced or corrupted?19:39
wbhuberclayg: i understand that when reconstructor finds missing or misplace fragments, it'd either rebuild or revert them to the correct place.19:39
tdasilvalol: "The 'n' was probably thrown in because of Blade Runner."19:40
claygtdasilva: well who knows - it's just a theory19:40
tdasilvaheh19:40
wbhuberclayg: from the top of your head, does it have the capability to count the # of valid fragments and find out that one is missing (due to one device out of touch), then we rebuild one on a hand off node.19:40
*** CaioBrentano has joined #openstack-swift19:41
claygwbhuber: yeah - i mean they're somewhat orthogonal - if you have a rebuild job in hand and you decide to sync with some node you install that _build_fragment callback thing for ssync and start to sync - if a frag pops up as needed - in the callback we'll go talk to whatever nodes we need to inorder to rebuild the fragment that we want to ship to that node19:42
claygso I think if you just focus on that part of the loop of the rebuild job that's checking it's left and right parter and continuing around the ring if it can't connect - to do something more like "fire up a sync to a handoff" - the "getting the right fragments to rebuild" should suss itself out (maybe?)19:46
claygwbhuber: I haven't looked at this code in awhile19:46
claygwbhuber: it's going to be a really tricky change tho :\19:46
notmynametorgomatic_: with q.q() is there a way to have it not truncate the output?19:46
claygwbhuber: hope you're up for a challange - it's not terribly likely someone will nail it on the first go19:46
torgomatic_notmyname: not that I know of19:46
claygtorgomatic_: notmyname: that seems exactly like what q.q should *not* do?19:47
wbhuberclayg: i'm giving this one a shot.  need to go over the path countless times to get it in the head.19:47
torgomatic_notmyname: if you feed it a long enough string, it dumps it to its own file19:48
notmynameah! so it does19:48
wbhuberclayg: i think the loop of the rebuild job that checks its left and right partners from the ring to see everyone is connected.  once it discovers one doesn't, we fire up a sync to a handoff.  i think that's the segment i'm looking for.19:48
*** djc_ has joined #openstack-swift19:49
claygwbhuber: yeah I don't think the flow is like that currently tho - if it finds one of it's primary partners is offline it just checks another primary partner - which is also useful - but some folks are thinking maybe not sufficient - hence the bug.19:49
claygwbhuber: anyway the main point is that it shouldn't do anything different unless it get's a 507 from a primary partner19:50
claygso we'll end up doing one thing for 507 and what's there currently for any other kind of error19:50
clayg*maybe* this is good plan - but that's what the bug says to do anyway - so you'll have that going for you19:51
wbhuberclayg: i think i would leave some room for any error conditions other than 507.  i understand that 507 indicates insufficient storage error but that sounds like that there is not enough storage to store an object.  does that error also "cover" the number of primary nodes (besides handoff) not meeting the size of the object?19:54
wbhuberclayg: i'm thinking like those 4 nodes have only 100 mb avialble, but this incoming object has 110 mb.  insufficient storage error pops up.19:54
wbhuberclayg: or is it just that # of nodes (offline, etc.) is not satisfying the ec scheme (4+2) and the same error pops up?19:55
djc_is there an easy way to find out the size of a swift cluster?19:57
*** mahatic has quit IRC19:59
*** joeljwright has joined #openstack-swift20:00
*** ChanServ sets mode: +v joeljwright20:00
*** pdardeau has joined #openstack-swift20:01
claygdjc_: keep uploading stuff to it until someone in devops tells you to stop - you can imagine that's roughly 80-90% of the capacity available20:06
jrichliI thought I liked working with regular expressions, but then I wanted to understand _rfc_extension_pattern in common/utils.py20:07
djc_clayg: lol20:08
djc_clayg: I see swift-recon -d20:08
*** zhill has joined #openstack-swift20:09
claygdjc_: oh yeah that's a good way to go20:09
claygdjc_: by size do you mean capacity or consumed - raw or usable?20:09
djc_clayg: both I guess. http://pastebin.com/srrrJHuN20:10
claygdjc_: most of the time we talk about how much raw capacity is in the cluster (in 100's or 1000's of TB's) or how much user data in stored (which is collected from the account databases by tools like slogging)20:10
djc_clayg: so if we are talking about raw..the link I sent you showed 215937010335744 as capacity....Is that number raw?20:11
claygdjc_: yeah and then monitoring for device usage/fullness and deviation is like sort of a seperate opperational task - we use collectd20:12
claygdjc_: yeah!20:13
djc_clayg: so that is 215 terabytes I guess...We have 4 replicas. I don't have to multiply that number by 4 to find raw?20:13
claygdjc_: no20:13
djc_clayg: thanks a bunch!20:14
djc_clayg: you've been very helpful20:14
*** zhill has quit IRC20:14
claygdjc_: but be careful trying to *devide* that number by 4 and estimate usable capacity - between filesystem metadata, object metadata, and account/container metadata you really just have what you have - raw/<replica> is *very* rough20:14
*** itlinux has joined #openstack-swift20:15
claygwell... I mean it won't be off by an order of magnitude or anything unless you have multiple storage policies EC, reduced-redundancy, then you really have to put on your thinking cap20:15
djc_clayg: I understand. thanks for the heads up20:15
claygdjc_: nah man that was all you - i forgot about recon pooling devices20:16
clayg*poll20:16
djc_clayg: thanks20:16
* clayg throws a shotout to pandemicsyn!20:16
claygso but we're going with no f'ing clue on lp bug #1511025 - or did i miss something in scrollback?20:17
openstackLaunchpad bug 1511025 in OpenStack Object Storage (swift) "Image download with multi tenant true fails" [Undecided,Confirmed] https://launchpad.net/bugs/151102520:17
*** itlinux has quit IRC20:18
*** itlinux has joined #openstack-swift20:20
*** nikhil has joined #openstack-swift20:20
*** diazjf has quit IRC20:22
*** diazjf has joined #openstack-swift20:23
*** jlhinson has quit IRC20:26
*** diazjf has quit IRC20:27
*** nadeem has quit IRC20:28
*** diazjf has joined #openstack-swift20:28
*** diazjf has quit IRC20:28
*** itlinux has quit IRC20:29
*** itlinux has joined #openstack-swift20:33
*** Chavers has quit IRC20:34
*** jlhinson has joined #openstack-swift20:42
*** Zyric has joined #openstack-swift20:42
*** siva_krishnan has joined #openstack-swift20:44
*** tsg has quit IRC20:50
gmmahasorry for being a pain, but has anyone seen this error with their swift+keystone setup? https://bugs.launchpad.net/swift/+bug/1176030 && https://gist.github.com/ganeshmaharaj/a49fab65665ba69d9e7f20:54
openstackLaunchpad bug 1176030 in OpenStack Object Storage (swift) "Swift functional tests fails when Keystone is used" [Undecided,Won't fix]20:54
gmmahamy google searches havent been very helpful20:54
*** gyee has joined #openstack-swift20:58
*** CaioBrentano has quit IRC21:01
*** itlinux has quit IRC21:07
*** wbhuber_ has joined #openstack-swift21:09
*** nadeem has joined #openstack-swift21:10
*** nadeem has quit IRC21:10
*** nadeem has joined #openstack-swift21:11
*** wbhuber has quit IRC21:13
*** nadeem has quit IRC21:15
*** Guest60041 is now known as scotticus21:18
*** diogogmt has quit IRC21:27
*** petertr7 is now known as petertr7_away21:28
openstackgerritMerged openstack/swift: Small cleanup for unit/proxy/controllers/test_obj  https://review.openstack.org/24417921:30
*** petertr7_away is now known as petertr721:32
wbhuber_clayg: one thing came up in mind - when a device goes off line, why do we need to rebuild a frag on a handoff node if we continue to meet policy.ec_ndata, using frags from parity nodes?21:35
wbhuber_clayg: i assume that the guy who opened the bug had three primary nodes going offline (using 4+2 scheme).21:38
*** joeljwright has quit IRC21:45
*** jlhinson has quit IRC21:54
*** petertr7 is now known as petertr7_away22:04
*** jamielennox|away is now known as jamielennox22:05
*** MVenesio has quit IRC22:08
*** zhill has joined #openstack-swift22:11
*** blmartin has quit IRC22:12
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873622:13
*** david-lyle has joined #openstack-swift22:16
*** zhill has quit IRC22:16
*** pdardeau has quit IRC22:19
*** Guest90281 has joined #openstack-swift22:21
Guest90281I get "ImportError: No module named swift.cli.ringbuilder" -- when I run remakerings for the first time on a SAIO set up. what's going wrong here/22:22
Guest90281?22:22
claygGuest90281: something with python package install22:23
claygGuest90281: go back into ~/swift (or wherever you cloned) and `pip install -e .`22:24
Guest90281oh yeah22:24
Guest90281there was an offending line in requirements.txt22:24
Guest90281http://pastebin.com/f5g5Rj2v22:27
clayg^ and so it beings lifeless haypo22:27
claygGuest90281: do a pip install -U pip pbr setuptools virtualenv22:27
clayg*sudo*22:27
Guest90281clayg: Could not find any downloads that satisfy the requirement pbf22:30
claygpb*R*22:30
* Guest90281 slaps himself awake22:31
Guest90281sorry22:31
claygnp - werx?22:31
Guest90281works fine thanks !22:31
Guest90281oh the original command still fails though22:32
Guest90281the one that you suggested runs fine .. and installs the relevant stuff22:32
*** lnxnut has quit IRC22:32
Guest90281but .. I still get the same error .. like some kind of parser error22:33
claygwell after the -U you still need to `pip install -e .`22:33
Guest90281as in the pastebin22:33
Guest90281oh okay makes sense22:33
claygGuest90281: you probably have the system seutptools installed and it's too old22:33
claygGuest90281: ubuntu?  `apt-get purge python-setuptools -y`22:33
Guest90281clayg: i have an ubuntu trusty22:34
claygGuest90281: it's sort of a sad joke, but read the topic :'(22:35
*** djc_ has quit IRC22:35
claygpurge the system setuptools and run the pip -U command again then install the swift source - what a chore :'(22:35
claygso sorry :'(22:35
Guest90281clayg: thanks and np .. learning is learning !22:36
openstackgerritJonathan Hinson proposed openstack/swift: Transition to 'keymaster'  https://review.openstack.org/24489422:36
*** BAKfr has quit IRC22:38
Guest90281cd22:39
Guest90281oops sorry22:40
*** BAKfr has joined #openstack-swift22:40
clayghome is where the heart is22:40
Guest90281yep !22:41
*** tongli has quit IRC22:41
*** wbhuber_ has quit IRC22:44
*** wbhuber has joined #openstack-swift22:44
*** wbhuber has quit IRC22:49
openstackgerritJonathan Hinson proposed openstack/swift: Transition to 'keymaster'  https://review.openstack.org/24490422:57
*** jlhinson has joined #openstack-swift22:59
*** zhill has joined #openstack-swift23:05
*** km has joined #openstack-swift23:06
*** km is now known as Guest2187823:06
claygredbo: has the "thrash" bench tool always been in hummingbird?23:07
*** mac_ified has joined #openstack-swift23:12
redboclayg: yeah, for quite a while.  I use it to make a mixed workload for profiling and looking at memory usage and stuff.23:12
*** jamielennox is now known as jamielennox|away23:13
clayg$ hummingbird object -c /etc/swift/object-server.conf23:14
claygUnable to load object23:14
claygexits 1 - nothing in syslog :'(23:15
*** aix has joined #openstack-swift23:18
*** darrenc is now known as darrenc_afk23:18
*** minwoob has quit IRC23:19
*** gyee has quit IRC23:19
*** gyee has joined #openstack-swift23:21
*** jamielennox|away is now known as jamielennox23:22
redbohmm.. maybe that got broken :(  I'll look at it in a bit.23:22
redbowe only use object config directories23:22
claygoh dirs work now!?23:23
claygit's so hard to keep up23:23
claygredbo: well what's the default path?  I can get `object -c /etc/swift/object-server.conf.d` to start but not `start object`23:26
claygnm i found it - you guys are trying to incompatible on purpose23:28
*** kei_yama has joined #openstack-swift23:30
*** lcurtis has quit IRC23:31
*** jlhinson has quit IRC23:33
claygredbo: got my object server running - next command - next error -> https://gist.github.com/clayg/78f7fbafb05faec9bd6523:36
claygwow, I think was just a 503 from recon?23:37
claygwtf logging?23:38
*** darrenc_afk is now known as darrenc23:39
*** chsc has quit IRC23:44
*** ho has joined #openstack-swift23:45
*** Chavers has joined #openstack-swift23:46
*** ChanServ changes topic to "Review Dashboard: https://goo.gl/iLt6Ld | Get an IRC bouncer at http://znc.in | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/"23:51
*** notmyname sets mode: -o notmyname23:51
claygsrly I'm getting nothing kicked out to syslog :\23:52
*** fbo has quit IRC23:52
*** fbo has joined #openstack-swift23:55
notmynamehaypo: what breaks if pbr isn't in requirements.txt?23:56
clayghaypo: what breaks if those marker lines that are screwing up the world aren't in requirements.txt?23:56
hogood morning!23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!