| *** haomaiwang has quit IRC | 00:01 | |
| *** haomaiwang has joined #openstack-swift | 00:01 | |
| *** cdelatte has quit IRC | 00:04 | |
| openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for server.py https://review.openstack.org/242300 | 00:05 |
|---|---|---|
| *** tsg has quit IRC | 00:06 | |
| *** sanchitmalhotra has joined #openstack-swift | 00:16 | |
| *** sanchitmalhotra1 has quit IRC | 00:18 | |
| *** jlhinson_ has quit IRC | 00:23 | |
| *** siva_krishnan has quit IRC | 00:31 | |
| *** siva_krishnan has joined #openstack-swift | 00:32 | |
| *** breitz has quit IRC | 00:32 | |
| *** rohit_ has joined #openstack-swift | 00:33 | |
| *** dmorita has joined #openstack-swift | 00:33 | |
| *** jamielennox is now known as jamielennox|away | 00:33 | |
| *** nadeem has joined #openstack-swift | 00:37 | |
| *** siva_krishnan has quit IRC | 00:40 | |
| *** m_kazuhiro has joined #openstack-swift | 00:41 | |
| *** wbhuber has quit IRC | 00:55 | |
| *** wbhuber has joined #openstack-swift | 00:55 | |
| *** wbhuber has quit IRC | 00:59 | |
| *** haomaiwang has quit IRC | 01:01 | |
| *** 20WACGE4T has joined #openstack-swift | 01:01 | |
| *** nadeem has quit IRC | 01:13 | |
| *** rjaiswal has quit IRC | 01:15 | |
| *** thumpba has joined #openstack-swift | 01:16 | |
| *** thumpba has quit IRC | 01:18 | |
| *** garthb_ has quit IRC | 01:19 | |
| *** nadeem has joined #openstack-swift | 01:23 | |
| *** nadeem has quit IRC | 01:25 | |
| *** pdardeau has joined #openstack-swift | 01:25 | |
| *** mzhou has quit IRC | 01:27 | |
| clayg | anyone know of something that's like update but does set default instead? | 01:31 |
| *** badari has quit IRC | 01:32 | |
| clayg | like updated_example = default.update(example) but doesn't modify default? | 01:33 |
| *** jrichli has joined #openstack-swift | 01:35 | |
| *** diogogmt has quit IRC | 01:37 | |
| *** diazjf has joined #openstack-swift | 01:40 | |
| torgomatic_ | clayg: not in python; you'd have to be like updated_example = default.copy(); updated_example.update(more_stuff) | 01:42 |
| clayg | torgomatic_: well that's BS | 01:42 |
| clayg | I bet go has it | 01:43 |
| torgomatic_ | Ruby has that as Hash#merge (versus Hash#merge! that modifies its invocant) and I miss it sometimes | 01:43 |
| *** badari has joined #openstack-swift | 01:45 | |
| *** zhill has quit IRC | 01:56 | |
| *** Guest33023 has quit IRC | 01:59 | |
| *** pdardeau has quit IRC | 01:59 | |
| *** km has joined #openstack-swift | 01:59 | |
| *** km is now known as Guest65318 | 02:00 | |
| *** 20WACGE4T has quit IRC | 02:01 | |
| *** pdardeau has joined #openstack-swift | 02:01 | |
| *** haomaiwang has joined #openstack-swift | 02:01 | |
| *** diazjf has quit IRC | 02:02 | |
| *** haomaiwang has quit IRC | 02:09 | |
| *** badari has quit IRC | 02:12 | |
| *** zhill has joined #openstack-swift | 02:14 | |
| *** klrmn1 has quit IRC | 02:14 | |
| *** diazjf has joined #openstack-swift | 02:17 | |
| *** asettle is now known as asettle-afk | 02:18 | |
| *** Guest65318 has quit IRC | 02:18 | |
| *** zhill has quit IRC | 02:18 | |
| *** badari has joined #openstack-swift | 02:19 | |
| *** pdardeau has quit IRC | 02:24 | |
| lifeless | clayg: torgomatic_: you can do it with pyrsistent | 02:24 |
| *** badari has quit IRC | 02:25 | |
| *** diogogmt has joined #openstack-swift | 02:31 | |
| *** jamielennox|away is now known as jamielennox | 02:34 | |
| openstackgerrit | janonymous proposed openstack/swift: Eventlet green threads not released back to pool https://review.openstack.org/227855 | 02:43 |
| *** rohit_ has quit IRC | 02:46 | |
| *** badari has joined #openstack-swift | 02:48 | |
| *** haomaiwang has joined #openstack-swift | 02:51 | |
| *** bapalm has quit IRC | 02:54 | |
| *** thumpba has joined #openstack-swift | 02:56 | |
| *** haomaiwang has quit IRC | 03:01 | |
| *** badari_ has joined #openstack-swift | 03:01 | |
| *** haomaiwang has joined #openstack-swift | 03:01 | |
| openstackgerrit | Catherine Northcott proposed openstack/swift: Add support for storage policies to have more than one name https://review.openstack.org/241978 | 03:01 |
| *** thumpba has quit IRC | 03:02 | |
| *** rjaiswal has joined #openstack-swift | 03:02 | |
| *** bapalm has joined #openstack-swift | 03:02 | |
| *** badari has quit IRC | 03:04 | |
| *** klrmn1 has joined #openstack-swift | 03:14 | |
| *** badari_ has quit IRC | 03:15 | |
| *** zaitcev has quit IRC | 03:19 | |
| *** venkat_p has joined #openstack-swift | 03:21 | |
| openstackgerrit | venkatesh proposed openstack/swift: remove unused parameters in the method https://review.openstack.org/243401 | 03:24 |
| *** asettle-afk is now known as asettle | 03:27 | |
| *** badari has joined #openstack-swift | 03:28 | |
| *** haomaiwang has quit IRC | 03:38 | |
| *** haomaiwang has joined #openstack-swift | 03:38 | |
| jrichli | clayg: around? found a new issue with encryption we might need to solve | 03:40 |
| jrichli | (if my deduction is correct) | 03:41 |
| *** badari has quit IRC | 03:41 | |
| jrichli | acoles_: you are correct. 'swift_bytes' is a problem for the content_type. We cannot have this part encrypted, because the container server needs to parse it. | 03:47 |
| jrichli | there are no functional tests that include 'swift_bytes' in the content-type, AFAIK. This is probably how it was missed. | 03:48 |
| *** sanchitmalhotra1 has joined #openstack-swift | 03:53 | |
| *** sanchitmalhotra has quit IRC | 03:55 | |
| *** diazjf has quit IRC | 03:59 | |
| *** links has joined #openstack-swift | 03:59 | |
| *** haomaiwang has quit IRC | 04:01 | |
| *** haomaiwang has joined #openstack-swift | 04:01 | |
| *** david-lyle has joined #openstack-swift | 04:07 | |
| jrichli | clayg: sorry, no worries. I sent mail to acoles_ and we can chat later about the issue if needed. | 04:08 |
| *** jrichli has quit IRC | 04:09 | |
| *** sanchitmalhotra has joined #openstack-swift | 04:12 | |
| *** diazjf has joined #openstack-swift | 04:13 | |
| *** sanchitmalhotra1 has quit IRC | 04:14 | |
| notmyname | good evening | 04:16 |
| *** diogogmt has quit IRC | 04:17 | |
| ho | notmyname: good evening! | 04:20 |
| *** thumpba has joined #openstack-swift | 04:22 | |
| *** thumpba has quit IRC | 04:26 | |
| *** jerrygb has quit IRC | 04:28 | |
| clayg | notmyname: we need to get the intel & ibm-ers some bouncer action | 04:31 |
| *** ChanServ changes topic to "Review Dashboard: https://goo.gl/iLt6Ld | Get an IRC bouncer at http://znc.in | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/" | 04:32 | |
| notmyname | clayg: topic updated ;-) | 04:32 |
| clayg | notmyname: nice | 04:33 |
| clayg | acoles_: jrichli: i get slo's sticking bytes in the content-type is an problem for fast-POST too! | 04:34 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 04:34 |
| clayg | ^ watch it be pyeclib>=1.0.7 :P | 04:34 |
| clayg | lol - totally is | 04:35 |
| clayg | notmyname: we never did chat about the pyeclib chain | 04:36 |
| *** jerrygb has joined #openstack-swift | 04:36 | |
| notmyname | yeah. I was out longer than I expected and I needed to get home | 04:36 |
| notmyname | clayg: I want to look at the patches out there again (tonight or more likely in the am) before we dive into it | 04:38 |
| clayg | notmyname: I still don't understand how patch 238926 is ever supposed to land if the gate's upper-constraints is pinning pyeclib==1.0.7 | 04:38 |
| patchbot | clayg: https://review.openstack.org/#/c/238926/ - EC: Use ec_type=liberasurecode_rs_vand in unit tests | 04:38 |
| clayg | notmyname: ok, np | 04:38 |
| notmyname | clayg: yeah, there's a way or a reason :-) | 04:38 |
| notmyname | that's what I want to wrap my head around first | 04:38 |
| *** zhill has joined #openstack-swift | 04:38 | |
| notmyname | in the meantime, I've got https://www.masterofmalt.com/tequila/la-altena/tapatio-excelencia-gran-reserva-extra-anejo-tequila/ in a glass. let's not ruin it with dependency resolutions ;-) | 04:39 |
| *** itlinux has joined #openstack-swift | 04:40 | |
| openstackgerrit | Merged openstack/swift: DiskFileNoSpace check during object delete https://review.openstack.org/237648 | 04:40 |
| *** notmyname sets mode: -b Zyric*!*@* | 04:44 | |
| *** notmyname sets mode: -b *!~catherine@203-97-119-226.cable.telstraclear.net | 04:45 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 04:48 | |
| *** nadeem has joined #openstack-swift | 04:48 | |
| *** sanchitmalhotra has quit IRC | 04:50 | |
| *** klrmn1 has quit IRC | 04:52 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 04:53 |
| *** haomaiwang has quit IRC | 04:55 | |
| *** klrmn1 has joined #openstack-swift | 04:55 | |
| *** haomaiwang has joined #openstack-swift | 04:55 | |
| *** chsc has quit IRC | 04:56 | |
| *** haomaiwang has quit IRC | 05:01 | |
| *** jamielennox is now known as jamielennox|away | 05:01 | |
| *** 18WAA337V has joined #openstack-swift | 05:01 | |
| *** klrmn1 has quit IRC | 05:03 | |
| *** nadeem has quit IRC | 05:07 | |
| *** jerrygb has quit IRC | 05:20 | |
| *** jerrygb has joined #openstack-swift | 05:23 | |
| *** jerrygb has quit IRC | 05:23 | |
| *** garthb has joined #openstack-swift | 05:24 | |
| *** venkat_p has quit IRC | 05:28 | |
| *** badari has joined #openstack-swift | 05:29 | |
| *** asettle is now known as asettle-afk | 05:29 | |
| *** badari has quit IRC | 05:33 | |
| *** ppai has joined #openstack-swift | 05:35 | |
| *** itlinux has quit IRC | 05:37 | |
| *** sanchitmalhotra has joined #openstack-swift | 05:40 | |
| *** sanchitmalhotra1 has quit IRC | 05:42 | |
| *** trifon has joined #openstack-swift | 05:44 | |
| *** garthb has quit IRC | 05:45 | |
| *** gyee has quit IRC | 05:52 | |
| *** trifon has quit IRC | 05:53 | |
| *** SkyRocknRoll has joined #openstack-swift | 05:58 | |
| *** 18WAA337V has quit IRC | 06:01 | |
| *** 20WACGGAC has joined #openstack-swift | 06:01 | |
| *** ig0r__ has quit IRC | 06:05 | |
| openstackgerrit | John Dickinson proposed openstack/swift: suppress warning output in a unit test https://review.openstack.org/243419 | 06:09 |
| *** ig0r__ has joined #openstack-swift | 06:09 | |
| notmyname | clayg: that tiny patch suppresses the write_buider warning in unit tests | 06:09 |
| *** venkat_p has joined #openstack-swift | 06:21 | |
| *** itlinux has joined #openstack-swift | 06:22 | |
| *** jerrygb has joined #openstack-swift | 06:24 | |
| *** thumpba has joined #openstack-swift | 06:24 | |
| *** jerrygb has quit IRC | 06:28 | |
| *** thumpba has quit IRC | 06:29 | |
| *** mahatic_ has joined #openstack-swift | 06:29 | |
| *** mahatic has joined #openstack-swift | 06:29 | |
| *** mahatic_ has quit IRC | 06:29 | |
| * mahatic realizes her IRC client ditched her with proxy issues | 06:31 | |
| mahatic | clayg: IRC bouncer seems impossible with an intel proxy standing in between :\ | 06:33 |
| notmyname | you could use The Cloud. I hear it's pretty popular | 06:33 |
| mahatic | irccloud you mean? | 06:34 |
| *** rjaiswal has quit IRC | 06:35 | |
| mahatic | notmyname: ^ | 06:35 |
| notmyname | no. like rackspace or softlayer or ec2 or etc ;-) | 06:37 |
| mahatic | ah yeah, i just figured you meant that ;) | 06:37 |
| *** diazjf has quit IRC | 06:38 | |
| notmyname | peluse seems to have it figured out | 06:38 |
| notmyname | ie the intel + stay on IRC thing | 06:38 |
| mahatic | yeah, he has another desktop at work apart from his laptop, whereas me just got a desktop *screen* :P | 06:39 |
| mahatic | (IIRC) | 06:40 |
| *** km has joined #openstack-swift | 06:41 | |
| *** km is now known as Guest38323 | 06:42 | |
| *** August1914 has quit IRC | 06:43 | |
| *** itlinux has quit IRC | 06:45 | |
| *** SkyRocknRoll has quit IRC | 06:54 | |
| *** trifon has joined #openstack-swift | 06:57 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 06:57 | |
| *** sanchitmalhotra has quit IRC | 06:58 | |
| *** 20WACGGAC has quit IRC | 07:01 | |
| *** pchng_ghost has joined #openstack-swift | 07:01 | |
| *** 7GHABMC07 has joined #openstack-swift | 07:01 | |
| *** pchng_ has quit IRC | 07:04 | |
| *** jerrygb has joined #openstack-swift | 07:25 | |
| *** thumpba has joined #openstack-swift | 07:25 | |
| *** jerrygb has quit IRC | 07:29 | |
| *** thumpba has quit IRC | 07:29 | |
| *** itlinux has joined #openstack-swift | 07:34 | |
| *** openstackgerrit has quit IRC | 07:46 | |
| *** openstackgerrit has joined #openstack-swift | 07:46 | |
| *** zhill has quit IRC | 07:50 | |
| *** itlinux_ has joined #openstack-swift | 07:52 | |
| *** itlinux has quit IRC | 07:53 | |
| *** itlinux_ has quit IRC | 07:55 | |
| *** itlinux has joined #openstack-swift | 07:56 | |
| *** 7GHABMC07 has quit IRC | 08:01 | |
| *** haomaiwang has joined #openstack-swift | 08:01 | |
| *** zigo has quit IRC | 08:01 | |
| *** arnox has joined #openstack-swift | 08:01 | |
| *** zigo has joined #openstack-swift | 08:03 | |
| *** itlinux has quit IRC | 08:04 | |
| *** itlinux has joined #openstack-swift | 08:06 | |
| *** rledisez has joined #openstack-swift | 08:08 | |
| *** peterlisak has joined #openstack-swift | 08:08 | |
| *** haomaiwang has quit IRC | 08:11 | |
| *** haomaiwang has joined #openstack-swift | 08:11 | |
| *** itlinux has quit IRC | 08:13 | |
| *** haomaiwang has quit IRC | 08:16 | |
| *** 18WAA3459 has joined #openstack-swift | 08:18 | |
| *** ChanServ sets mode: +v cschwede | 08:18 | |
| peterlisak | acoles_, hi, I have a question about patch 241342. What would change your mind to give +2 to patch set 2? I made also patch set 3, but it looks like it's not as convenient as previous patch set 2. | 08:23 |
| patchbot | peterlisak: https://review.openstack.org/#/c/241342/ - Add content-type in list of container content | 08:23 |
| *** itlinux has joined #openstack-swift | 08:25 | |
| *** jerrygb has joined #openstack-swift | 08:26 | |
| *** jerrygb has quit IRC | 08:31 | |
| *** openstackgerrit has quit IRC | 08:31 | |
| *** papercup has quit IRC | 08:31 | |
| *** openstackgerrit has joined #openstack-swift | 08:31 | |
| *** SkyRocknRoll has joined #openstack-swift | 08:36 | |
| *** SkyRocknRoll has quit IRC | 08:40 | |
| *** jordanP has joined #openstack-swift | 08:41 | |
| *** geaaru has joined #openstack-swift | 08:51 | |
| *** 18WAA3459 has quit IRC | 09:01 | |
| *** sanchitmalhotra has joined #openstack-swift | 09:01 | |
| *** haomaiwa_ has joined #openstack-swift | 09:02 | |
| *** sanchitmalhotra1 has quit IRC | 09:03 | |
| *** o_o has joined #openstack-swift | 09:04 | |
| *** o_o is now known as Guest94628 | 09:05 | |
| *** donagh has quit IRC | 09:06 | |
| *** jmccarthy has joined #openstack-swift | 09:11 | |
| *** SkyRocknRoll has joined #openstack-swift | 09:15 | |
| *** itlinux has quit IRC | 09:15 | |
| *** donagh has joined #openstack-swift | 09:16 | |
| openstackgerrit | Peter Lisák proposed openstack/swift: swift-init return codes https://review.openstack.org/230352 | 09:19 |
| *** itlinux has joined #openstack-swift | 09:19 | |
| *** SkyRocknRoll has quit IRC | 09:20 | |
| charz | I fixed "pbr>=1.6" issue in vm-saio-probe jobs, if you see this error in your patch, please add comment "recheck" in your patch. Community jenkins will rerun it. | 09:21 |
| openstackgerrit | Catherine Northcott proposed openstack/swift: Add support for storage policies to have more than one name https://review.openstack.org/241978 | 09:23 |
| *** jerrygb has joined #openstack-swift | 09:27 | |
| *** jerrygb has quit IRC | 09:32 | |
| *** ho has quit IRC | 09:41 | |
| *** jistr has joined #openstack-swift | 09:45 | |
| *** kei_yama has quit IRC | 09:45 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 09:56 | |
| *** sanchitmalhotra has quit IRC | 09:58 | |
| *** haomaiwa_ has quit IRC | 10:01 | |
| *** haomaiwa_ has joined #openstack-swift | 10:01 | |
| *** can8dnSix has joined #openstack-swift | 10:04 | |
| *** aix has joined #openstack-swift | 10:04 | |
| *** sanchitmalhotra1 has quit IRC | 10:07 | |
| *** jamielennox|away is now known as jamielennox | 10:24 | |
| openstackgerrit | Peter Lisák proposed openstack/swift: swift-init return codes https://review.openstack.org/230352 | 10:26 |
| *** jerrygb has joined #openstack-swift | 10:28 | |
| *** pchng_ has joined #openstack-swift | 10:32 | |
| *** jerrygb has quit IRC | 10:34 | |
| *** pchng_ghost has quit IRC | 10:35 | |
| *** ig0r__ has quit IRC | 10:40 | |
| *** sanchitmalhotra has joined #openstack-swift | 10:42 | |
| *** sanchitmalhotra has quit IRC | 10:45 | |
| *** ppai has quit IRC | 10:51 | |
| *** itlinux has quit IRC | 10:52 | |
| *** itlinux has joined #openstack-swift | 10:58 | |
| *** haomaiwa_ has quit IRC | 11:01 | |
| *** haomaiwang has joined #openstack-swift | 11:01 | |
| *** peterlisak13 has joined #openstack-swift | 11:02 | |
| *** marcusvrn_ has joined #openstack-swift | 11:04 | |
| *** peterlisak has quit IRC | 11:04 | |
| *** ppai has joined #openstack-swift | 11:05 | |
| *** jmccarthy1 has joined #openstack-swift | 11:09 | |
| *** jmccarthy has quit IRC | 11:09 | |
| *** npf has joined #openstack-swift | 11:10 | |
| npf | hello | 11:11 |
| npf | i have an install of openstack swift (2.5.0) and i have lots of tombstones with more than 7 days. How can i debug the issue in object-replicator? | 11:11 |
| npf | # find /srv/node/ -iname \*ts -mtime +7 | wc -l => shows 22779 files | 11:13 |
| npf | reading the metadata from on of the files i get: | 11:14 |
| npf | datetime.datetime.fromtimestamp(float(pickle.loads(xattr.getxattr('/srv/node/s1-sata1/objects/1551/c3a/3079500de295d4e63b3b83a887893c3a/1446413903.75113.ts','user.swift.metadata'))['X-Timestamp'])) | 11:14 |
| npf | datetime.datetime(2015, 11, 1, 21, 38, 23, 751130) | 11:14 |
| *** dmorita has quit IRC | 11:20 | |
| npf | any ideas? | 11:27 |
| *** itlinux has quit IRC | 11:30 | |
| *** jmccarthy1 has quit IRC | 11:32 | |
| *** aix has quit IRC | 11:33 | |
| *** aix has joined #openstack-swift | 11:33 | |
| *** jmccarthy has joined #openstack-swift | 11:36 | |
| *** jmccarthy has quit IRC | 11:39 | |
| cschwede | npf: did you set your reclaim age to a lower value? the default is 604800 seconds, ie 4 weeks (https://github.com/openstack/swift/blob/master/etc/object-server.conf-sample#L209-L210) | 11:49 |
| *** venkat_p has quit IRC | 11:49 | |
| *** can8dnSix has quit IRC | 11:53 | |
| *** itlinux has joined #openstack-swift | 11:55 | |
| *** jmccarthy has joined #openstack-swift | 11:57 | |
| *** haomaiwang has quit IRC | 12:01 | |
| *** haomaiwang has joined #openstack-swift | 12:01 | |
| npf | cschwede: hum.. 604800/3600/24 = 7 days | 12:02 |
| npf | not 4 weeks.. | 12:03 |
| npf | that's why it did the find with mtime +7 | 12:03 |
| cschwede | npf: er, you’re absolutely right. *me needs more coffee* | 12:04 |
| *** m_kazuhiro has quit IRC | 12:04 | |
| npf | ;) | 12:04 |
| * npf is hoping for an easy fix... | 12:05 | |
| *** cdelatte has joined #openstack-swift | 12:05 | |
| *** Guest38323 has quit IRC | 12:21 | |
| *** CaioBrentano has joined #openstack-swift | 12:24 | |
| cschwede | npf: permissions are correct? ie the same as the user that is running the object-replicator? | 12:29 |
| *** jerrygb has joined #openstack-swift | 12:32 | |
| *** jerrygb has quit IRC | 12:37 | |
| *** arnox has quit IRC | 12:38 | |
| npf | yes.. i think i found where the problem lies... | 12:40 |
| npf | all permissions are ok.. | 12:40 |
| npf | this is a seldom used cluster (we are in the process of installing it) | 12:40 |
| npf | but because there wasn't any "real" updates(inserts, updates, deletes) in those containers, all the hashes.pkl remained the same | 12:41 |
| npf | after i deleted all the hashes.pkl file.. the replicator started sweeping the filesystem and reconstructing hashes.pkl and in the process cleaning up tombstones | 12:42 |
| *** mahatic_ has joined #openstack-swift | 12:42 | |
| npf | but this was a last resort | 12:42 |
| *** fbo has quit IRC | 12:44 | |
| *** mahatic has quit IRC | 12:46 | |
| *** fbo has joined #openstack-swift | 12:47 | |
| *** arnox has joined #openstack-swift | 12:49 | |
| *** arnox has quit IRC | 12:49 | |
| npf | https://answers.launchpad.net/swift/+question/218285 | 12:50 |
| npf | i think is related to this | 12:50 |
| *** haomaiwang has quit IRC | 12:51 | |
| *** jmccarthy has quit IRC | 12:51 | |
| *** haomaiwang has joined #openstack-swift | 12:52 | |
| *** haomaiwang has quit IRC | 12:57 | |
| *** trifon has quit IRC | 12:58 | |
| *** arnox has joined #openstack-swift | 12:59 | |
| *** jmccarthy1 has joined #openstack-swift | 13:09 | |
| *** jmccarthy1 has quit IRC | 13:09 | |
| *** jmccarthy1 has joined #openstack-swift | 13:09 | |
| *** wbhuber has joined #openstack-swift | 13:11 | |
| *** peterlisak has joined #openstack-swift | 13:11 | |
| *** peterlisak13 has quit IRC | 13:14 | |
| *** wbhuber has quit IRC | 13:15 | |
| *** ppai has quit IRC | 13:16 | |
| *** tsg has joined #openstack-swift | 13:21 | |
| *** jerrygb has joined #openstack-swift | 13:24 | |
| *** daemontool has quit IRC | 13:25 | |
| *** jerrygb has quit IRC | 13:29 | |
| *** trifon has joined #openstack-swift | 13:38 | |
| *** haomaiwang has joined #openstack-swift | 13:50 | |
| *** ahale_ is now known as _ahale | 13:55 | |
| *** haomaiwang has quit IRC | 14:01 | |
| *** haomaiwang has joined #openstack-swift | 14:01 | |
| *** dustins has joined #openstack-swift | 14:03 | |
| openstackgerrit | venkatamahesh proposed openstack/swift: OpenStack typo https://review.openstack.org/243608 | 14:04 |
| *** links has quit IRC | 14:08 | |
| *** thumpba has joined #openstack-swift | 14:09 | |
| *** diogogmt has joined #openstack-swift | 14:13 | |
| *** petertr7_away is now known as petertr7 | 14:14 | |
| openstackgerrit | venkatamahesh proposed openstack/swift: Change stackforge repo to openstack repo https://review.openstack.org/243617 | 14:17 |
| *** daemontool has joined #openstack-swift | 14:18 | |
| *** CaioBren_ has joined #openstack-swift | 14:26 | |
| *** pdardeau has joined #openstack-swift | 14:27 | |
| *** CaioBrentano has quit IRC | 14:27 | |
| *** siva_krishnan has joined #openstack-swift | 14:31 | |
| *** tsg has quit IRC | 14:33 | |
| *** dustins has quit IRC | 14:41 | |
| *** barker_ has joined #openstack-swift | 14:44 | |
| *** barker_ has quit IRC | 14:44 | |
| *** jmccarthy1 has quit IRC | 14:45 | |
| *** jmccarthy1 has joined #openstack-swift | 14:45 | |
| *** ujjain has quit IRC | 14:46 | |
| *** ujjain has joined #openstack-swift | 14:48 | |
| *** ujjain has joined #openstack-swift | 14:48 | |
| *** badari has joined #openstack-swift | 14:52 | |
| *** barker_ has joined #openstack-swift | 14:53 | |
| *** barker_ has quit IRC | 14:56 | |
| *** barker_ has joined #openstack-swift | 14:57 | |
| *** daemontool has quit IRC | 14:58 | |
| openstackgerrit | Niall Bunting proposed openstack/python-swiftclient: Retry download of object body https://review.openstack.org/159208 | 14:59 |
| *** haomaiwang has quit IRC | 15:01 | |
| *** links has joined #openstack-swift | 15:01 | |
| *** haomaiwang has joined #openstack-swift | 15:01 | |
| *** chsc has joined #openstack-swift | 15:04 | |
| *** barker_ has quit IRC | 15:04 | |
| *** breitz has joined #openstack-swift | 15:04 | |
| *** links has quit IRC | 15:05 | |
| *** diogogmt has quit IRC | 15:06 | |
| *** barker has joined #openstack-swift | 15:06 | |
| *** wbhuber has joined #openstack-swift | 15:12 | |
| *** siva_krishnan has quit IRC | 15:14 | |
| *** ajiang has quit IRC | 15:15 | |
| *** bhakta has quit IRC | 15:16 | |
| *** hseipp has joined #openstack-swift | 15:17 | |
| *** siva_krishnan has joined #openstack-swift | 15:18 | |
| openstackgerrit | venkatamahesh proposed openstack/swift: Changed .md files to .rst files https://review.openstack.org/243655 | 15:22 |
| *** tsg has joined #openstack-swift | 15:27 | |
| *** rjaiswal has joined #openstack-swift | 15:31 | |
| *** jerrygb has joined #openstack-swift | 15:33 | |
| *** dustins has joined #openstack-swift | 15:33 | |
| *** siva_krishnan has quit IRC | 15:34 | |
| *** jerrygb has quit IRC | 15:37 | |
| *** pdardeau has quit IRC | 15:39 | |
| *** garthb has joined #openstack-swift | 15:41 | |
| notmyname | good morning | 15:43 |
| tdasilva | good morning | 15:43 |
| *** pdardeau has joined #openstack-swift | 15:47 | |
| *** npf has quit IRC | 15:49 | |
| *** barker has quit IRC | 15:49 | |
| mahatic_ | good morning | 15:49 |
| peluse | good morning to all 3 of you | 15:50 |
| *** blmartin has joined #openstack-swift | 15:50 | |
| tdasilva | honestly, I don't get this: patch 243608 | 15:53 |
| patchbot | tdasilva: https://review.openstack.org/#/c/243608/ - OpenStack typo | 15:53 |
| *** peterlisak has quit IRC | 15:53 | |
| *** jrichli has joined #openstack-swift | 15:54 | |
| *** diogogmt has joined #openstack-swift | 15:55 | |
| *** proteusguy__ has quit IRC | 15:55 | |
| peluse | hmmm, yeah | 15:55 |
| peluse | oh wait. Hmm, yeah. | 15:56 |
| notmyname | lol | 15:56 |
| peluse | looks like the other projects are being 'scrubbed' for the same thing and accepting them as 'sure, why no' kinda thing... | 15:58 |
| peluse | not | 15:58 |
| *** diogogmt has quit IRC | 15:59 | |
| *** jmccarthy1 has quit IRC | 16:00 | |
| *** wbhuber_ has joined #openstack-swift | 16:00 | |
| *** haomaiwang has quit IRC | 16:01 | |
| *** jmccarthy has joined #openstack-swift | 16:01 | |
| *** haomaiwang has joined #openstack-swift | 16:01 | |
| *** dustins has quit IRC | 16:01 | |
| *** diogogmt has joined #openstack-swift | 16:02 | |
| *** daemontool has joined #openstack-swift | 16:03 | |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Unit tests for account/backend.py https://review.openstack.org/240613 | 16:04 |
| *** wbhuber has quit IRC | 16:04 | |
| *** aix has quit IRC | 16:04 | |
| *** dustins has joined #openstack-swift | 16:06 | |
| *** jerrygb has joined #openstack-swift | 16:07 | |
| *** jmccarthy has quit IRC | 16:07 | |
| *** proteusguy__ has joined #openstack-swift | 16:08 | |
| *** jmccarthy has joined #openstack-swift | 16:08 | |
| *** itlinux has quit IRC | 16:09 | |
| *** mzhou has joined #openstack-swift | 16:10 | |
| tdasilva | wow, patch 238771 still hasn't merged! | 16:10 |
| patchbot | tdasilva: https://review.openstack.org/#/c/238771/ - Bump PyECLib version to >=1.0.7 | 16:10 |
| *** jerrygb has quit IRC | 16:12 | |
| notmyname | tdasilva: I'm working on it ;-) | 16:12 |
| *** jerrygb has joined #openstack-swift | 16:13 | |
| notmyname | tdasilva: for that typo patch, please don't spend a lot of time on it. if you think it's good, approve it. | 16:13 |
| tdasilva | notmyname: yeah, i see it on the gate, but tsg already had to add 4 'rechecks' to it :/ | 16:13 |
| tsg | notmyname, tdasilva, something's up with the neutron gate jobs | 16:14 |
| notmyname | tdasilva: I was going to get my head around it again this morning. summary is that it's more complicated in part because of requirements | 16:14 |
| notmyname | tsg: ah ok | 16:14 |
| tsg | checks succeed but they fail at gate | 16:14 |
| tdasilva | tsg: yeah | 16:14 |
| tsg | I mentioned to lifeless earlier on -infra | 16:14 |
| *** jerrygb_ has joined #openstack-swift | 16:15 | |
| *** jerrygb has quit IRC | 16:17 | |
| *** esker has joined #openstack-swift | 16:18 | |
| openstackgerrit | Ganesh Maharaj Mahalingam proposed openstack/swift: Add unit tests for direct_client https://review.openstack.org/241291 | 16:19 |
| jrichli | clayg notmyname: bouncer is on my todo list. hrou and pchng_ have been doing work towards making this easier for ibm'ers :-) constant connection coming soon | 16:22 |
| tsg | haypo: ping | 16:22 |
| notmyname | jrichli: :-) | 16:22 |
| * notmyname gets off the computer to commute to the office | 16:22 | |
| tdasilva | jrichli: just fyi, acoles_ pointed me to panicbnc and that's been working well for me | 16:23 |
| tdasilva | mahatic_: ^^^ | 16:23 |
| *** pchng_ is now known as pchng | 16:24 | |
| mahatic_ | tdasilva: thanks, will check it out | 16:24 |
| *** diazjf has joined #openstack-swift | 16:25 | |
| *** pdardeau has quit IRC | 16:25 | |
| *** minwoob has joined #openstack-swift | 16:26 | |
| onovy | i'm using ZNC on my home server, working fine too :) | 16:26 |
| *** minwoob has quit IRC | 16:26 | |
| *** donagh has quit IRC | 16:26 | |
| *** pchng_ has joined #openstack-swift | 16:28 | |
| *** jamielennox has quit IRC | 16:28 | |
| *** minwoob has joined #openstack-swift | 16:28 | |
| onovy | notmyname, hi, can we talk about: https://www.mail-archive.com/openstack-infra@lists.openstack.org/msg03339.html pls? | 16:31 |
| *** pchng has quit IRC | 16:31 | |
| *** trifon has quit IRC | 16:32 | |
| *** mzhou has quit IRC | 16:33 | |
| *** August1914 has joined #openstack-swift | 16:37 | |
| clayg | jrichli: oh wow, do you use irc logs on http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ to catch up or something? | 16:37 |
| jrichli | yup | 16:39 |
| jrichli | been doing that since last Feb :-) | 16:39 |
| clayg | onovy: I think timburke & kota_ & chmouel recently went thorugh this moving swift3 from fugita's repo to under openstack | 16:40 |
| onovy | don't need help with "how to" | 16:41 |
| clayg | onovy: now swift3 is a like a real thing, people talk about it at design summits, we're working on better cross project gating jobs | 16:41 |
| onovy | but where :] | 16:41 |
| clayg | "where" ? | 16:41 |
| clayg | *here* | 16:41 |
| clayg | :P | 16:41 |
| onovy | so as subproject? | 16:41 |
| *** jamielennox has joined #openstack-swift | 16:41 | |
| onovy | (just created openstack-swauth irc channel :) | 16:41 |
| onovy | it's possible to set different gerrit ACL for subprojects? | 16:42 |
| clayg | heh | 16:42 |
| clayg | oh yeah for sure - swift3 has different social review expectations | 16:42 |
| clayg | and of course a different set of people who *can* acctually click +A | 16:43 |
| onovy | perfect, so subproject is better | 16:43 |
| clayg | I dont' think they have their own irc channel tho :P | 16:43 |
| onovy | np, will remove it | 16:44 |
| tdasilva | they do | 16:44 |
| tdasilva | #swift3 | 16:44 |
| clayg | I don't know if swift3 calls itself a swift subproject - it's just an openstack associated project - I think they used to call them stackforge projects | 16:44 |
| clayg | tdasilva: nice! | 16:44 |
| clayg | I should hang out in there | 16:44 |
| *** jlhinson has joined #openstack-swift | 16:44 | |
| clayg | i bet thats where all the cool kids are | 16:44 |
| tdasilva | clayg, onovy: right, it's not a subproject, but just an openstack project associated with swift | 16:44 |
| tdasilva | for example, #swiftonfile is another one | 16:44 |
| *** siva_krishnan has joined #openstack-swift | 16:45 | |
| onovy | python-swiftclient too? | 16:45 |
| tdasilva | it has its own list of cores, maintainers, etc...so you can set up your own project | 16:45 |
| clayg | onovy: well there you go - talk to tdasilva | 16:45 |
| clayg | I need to get the kids ready for school | 16:45 |
| onovy | clayg, :] | 16:45 |
| tdasilva | clayg: sorry, for jumping in the middle | 16:45 |
| onovy | peter is following this: http://docs.openstack.org/infra/manual/creators.html#give-openstack-permission-to-publish-releases | 16:46 |
| clayg | tdasilva: no it's cool - i'm clueless on openstack "regulations" - i just pretend they're all normal opensource projects and try to do what makes sense | 16:46 |
| *** donagh has joined #openstack-swift | 16:46 | |
| tdasilva | clayg: yep! and you are right | 16:46 |
| jrichli | acoles_ is still away ... I am wondering if that means he was selected | 16:47 |
| *** haomaiwang has quit IRC | 16:48 | |
| *** itlinux has joined #openstack-swift | 16:49 | |
| *** peterlisak has joined #openstack-swift | 16:49 | |
| jlhinson | jrichli: may the odds be ever in his favor | 16:50 |
| jrichli | jlhinson: :-p | 16:50 |
| tdasilva | onovy: hrou just went through the process of setting up the storlets project too, so he might be able to provide some tips too | 16:51 |
| tdasilva | onovy: https://github.com/openstack/storlets | 16:52 |
| onovy | yep, there was presenation on summit | 16:52 |
| *** gyee has joined #openstack-swift | 16:52 | |
| *** August1914 has quit IRC | 16:53 | |
| *** onovy has quit IRC | 17:00 | |
| *** onovy has joined #openstack-swift | 17:00 | |
| mahatic_ | torgomatic_: hello, I was wondering if you could address a comment on this patch https://review.openstack.org/#/c/173497/ - I know itś been long since this was merged, but could you take a look please? | 17:00 |
| *** daemontool has quit IRC | 17:04 | |
| *** mzhou has joined #openstack-swift | 17:08 | |
| *** hseipp has quit IRC | 17:09 | |
| *** pdardeau has joined #openstack-swift | 17:09 | |
| *** itlinux has quit IRC | 17:10 | |
| *** jmccarthy has quit IRC | 17:12 | |
| *** garthb_ has joined #openstack-swift | 17:14 | |
| *** garthb has quit IRC | 17:15 | |
| *** mzhou has quit IRC | 17:17 | |
| *** mzhou has joined #openstack-swift | 17:18 | |
| *** gyee has quit IRC | 17:25 | |
| *** pdardeau has quit IRC | 17:25 | |
| notmyname | onder: peterlisak: I was wondering about the swauth thing you created. what is that? | 17:26 |
| *** gyee has joined #openstack-swift | 17:28 | |
| *** badari has quit IRC | 17:29 | |
| notmyname | wow. I just got this email. Subject: "How Hyperconvergence Affects App Deployment" Title in the body: "The IT Social Dynamics of Hyperconverged Infrastructure" | 17:29 |
| tsg | notmyname: http://tinyurl.com/ne3ex4v (gate failure rate) | 17:29 |
| notmyname | is there a phrase for buzzwords so dense it turns into a black hole? | 17:30 |
| tdasilva | lol | 17:30 |
| notmyname | onder: oh, interesting. it seems I missed one of your earlier comments in the channel about the swauth thing | 17:32 |
| *** rledisez has quit IRC | 17:33 | |
| tdasilva | notmyname: do you mean onovy ? | 17:33 |
| notmyname | oh yeah | 17:33 |
| notmyname | onovy: | 17:33 |
| notmyname | thanks | 17:33 |
| *** petertr7 is now known as petertr7_away | 17:34 | |
| onder | :) | 17:34 |
| *** esker has quit IRC | 17:35 | |
| notmyname | onovy: it seems from your email that you've talked to gholt about it. I'm a little curious about what your plans are for swauth (and why that's possible inside the openstack project namespace and not possible now) | 17:37 |
| notmyname | onovy: but in general, if you are moving it over, then I'd suggest doing it similar to swift3: as a separate team/project that is in the ecosystem but not one of the official swift deliverables | 17:38 |
| *** arnox has quit IRC | 17:45 | |
| tdasilva | has anybody run into this problem? | 17:46 |
| tdasilva | [vagrant@server0 swift]$ sudo python setup.py develop | 17:46 |
| tdasilva | error in setup command: Invalid environment marker: (python_version>='3.0') | 17:46 |
| notmyname | tdasilva: yeah, you gotta upgrade pbr | 17:46 |
| tdasilva | when setting up a new saio dev VM | 17:46 |
| tdasilva | oh | 17:46 |
| tdasilva | i have Version: 1.8.1 | 17:47 |
| *** jistr has quit IRC | 17:48 | |
| *** jmccarthy has joined #openstack-swift | 17:49 | |
| notmyname | hmm. IIRC it was pbr v1 that added support for the python version specifiers | 17:50 |
| tdasilva | mmmm :/ | 17:51 |
| *** jmccarthy has quit IRC | 17:54 | |
| notmyname | tsg: looks like sdague just sent an email to the ML about the neutron failures | 17:55 |
| *** pdardeau has joined #openstack-swift | 17:58 | |
| tdasilva | notmyname: ok, had to also upgrade setuptools | 18:00 |
| tdasilva | notmyname: rpm available on centos is pretty old | 18:01 |
| notmyname | ah ok | 18:01 |
| *** garthb_ has quit IRC | 18:02 | |
| *** garthb_ has joined #openstack-swift | 18:02 | |
| *** zhill has joined #openstack-swift | 18:04 | |
| *** jordanP has quit IRC | 18:05 | |
| tdasilva | notmyname: thanks for the tip | 18:05 |
| *** willsama has joined #openstack-swift | 18:06 | |
| *** jerrygb has joined #openstack-swift | 18:06 | |
| *** jerrygb_ has quit IRC | 18:09 | |
| *** klrmn1 has joined #openstack-swift | 18:13 | |
| *** blmartin has quit IRC | 18:13 | |
| *** diazjf has quit IRC | 18:14 | |
| *** tsg has quit IRC | 18:14 | |
| *** tsg has joined #openstack-swift | 18:17 | |
| *** tsg has quit IRC | 18:18 | |
| *** tsg has joined #openstack-swift | 18:19 | |
| *** pdardeau has quit IRC | 18:19 | |
| *** diazjf has joined #openstack-swift | 18:20 | |
| openstackgerrit | Merged openstack/swift: Change stackforge repo to openstack repo https://review.openstack.org/243617 | 18:21 |
| *** jlhinson has quit IRC | 18:21 | |
| *** lcurtis has joined #openstack-swift | 18:23 | |
| *** tsg has quit IRC | 18:23 | |
| *** tsg has joined #openstack-swift | 18:23 | |
| *** siva_krishnan has quit IRC | 18:26 | |
| *** siva_krishnan1 has joined #openstack-swift | 18:26 | |
| *** garthb__ has joined #openstack-swift | 18:31 | |
| *** garthb_ has quit IRC | 18:31 | |
| onovy | notmyname, plan is simple: gholt don't have time for maintaining of swauth. we are using it, and openstack ecosystem is fine for project maintaining. | 18:36 |
| onovy | so we (seznam.cz) will maintain it using openstack ecosystem (gerrit, ...) | 18:37 |
| onovy | notmyname, so, you are suggesting follow: http://docs.openstack.org/infra/system-config/stackforge.html + http://docs.openstack.org/infra/manual/creators.html right? | 18:38 |
| onovy | and not as "official openstack project", but as stackforge | 18:39 |
| *** CaioBren_ has quit IRC | 18:39 | |
| notmyname | yeah, I think the second like is right | 18:39 |
| notmyname | stackforge (as a name) doesn't exist any more | 18:40 |
| onovy | related project? | 18:40 |
| *** CaioBrentano has joined #openstack-swift | 18:41 | |
| notmyname | yeah | 18:41 |
| notmyname | it won't be an "official openstack project". but it will live int eh openstack namespace and use the CI | 18:41 |
| onovy | perfect, thats your goal | 18:41 |
| onovy | *our | 18:41 |
| clayg | torgomatic_: I don't have a good plan on where to put words about replicanths | 18:42 |
| clayg | torgomatic_: my hope was that after the design summit in Toyko everyone would have an intuative sense of how I was describing part-replica placement - but I've thought about it more and I think I could put together a paragraph that wouldn't to egregiously bastardize math words that have real meanings | 18:43 |
| clayg | ... I just don't know where to put them? | 18:43 |
| clayg | torgomatic_: would commit message be ok for now? Or do you think there's a high level doc string that could speak to the concept? | 18:43 |
| onovy | notmyname, and it will *not* be "swift official" (http://stackalytics.com/?module=swift-group), right? | 18:43 |
| notmyname | clayg: http://docs.openstack.org/developer/swift/overview_ring.html ? | 18:43 |
| clayg | notmyname: good call! | 18:43 |
| notmyname | onovy: correct | 18:44 |
| dfg | onovy: are you planning on updating swauth? cool :) what are you planning on doing? | 18:44 |
| onovy | dfg, first of all: code cleanup and unit tests | 18:45 |
| onovy | and first of first of all: move it to gerrit :) | 18:45 |
| dfg | onovy: neat. one of our guys has been thinking about maybe some updates to it recently but i'll let him know so he can coordinate with you. thx! | 18:47 |
| onovy | dfg, perfect! #openstack-swauth channel is up and working for dicussion | 18:48 |
| notmyname | onovy: also briancline might be interested since they currently use swauth in their clusters (although have plans to move off of it) | 18:48 |
| *** jlhinson has joined #openstack-swift | 18:48 | |
| clayg | lifeless: tsg: i doesn't look like patch 238771 is going in?! | 18:49 |
| patchbot | clayg: https://review.openstack.org/#/c/238771/ - Bump PyECLib version to >=1.0.7 | 18:49 |
| tsg | clayg: neutron broke gate | 18:49 |
| lifeless | clayg: there's a 35% failure in neutron in the combined gate at the moment | 18:49 |
| lifeless | clayg: see sdague's email in the 'learning to debug the gate' thread | 18:49 |
| lifeless | [perhaps not the most obvious thread to put it in] | 18:50 |
| clayg | oh... well looking at the failures on that openstack/requirements change it didn't seem to be nuetron specific but rather something quite specific with the requirements-resolver | 18:50 |
| clayg | notmyname: what gives with patch 243655 - are our tld docs markdown or restructured text? | 18:51 |
| patchbot | clayg: https://review.openstack.org/#/c/243655/ - Changed .md files to .rst files | 18:51 |
| lifeless | clayg: the resolver job is non-voting | 18:52 |
| *** petertr7_away is now known as petertr7 | 18:53 | |
| clayg | lifeless: oh how strange... so it's the tempest-nuetron-full failure that's eating it's lunch afterall - mybad | 18:54 |
| torgomatic_ | clayg: commit message is fine; I feel like I used to know what it meant but now I don't, so I just need a little refresher | 18:57 |
| torgomatic_ | preferably in Gerrit so the other reviewer can read it too | 18:57 |
| *** tsg has quit IRC | 19:00 | |
| notmyname | clayg I have no idea why the md->rst patch was done. all the rest of our docs are rst, so maybe that's why? | 19:00 |
| clayg | torgomatic_: notmyname suggested the ring overview in tree doc - which I thought sounded pretty good? Would an implementation detail as trivial as that be inappropriate to document in a highlevel over view meant for consumption by a board audience - or do you agree developer docs is a good spot? | 19:01 |
| clayg | if I put it in the diff it'll be in gerrit for reviewers ;) | 19:01 |
| clayg | torgomatic_: thanks for reading the diff BTW, I normally go over my changes after I push for exactly that kind of crap - but I was so exhausted I couldn't bare to look at it for a couple of days - so... much appreciated! | 19:01 |
| *** jerrygb_ has joined #openstack-swift | 19:01 | |
| notmyname | is venkatamahesh here in IRC? | 19:02 |
| clayg | notmyname: what is the name of the editor you use? | 19:02 |
| clayg | notmyname: hipster-text or something like ... ah sublime! | 19:02 |
| notmyname | yeah, that one :-) | 19:02 |
| notmyname | I was using it before it was cool (of course) | 19:02 |
| tdasilva | lol | 19:03 |
| *** jerrygb has quit IRC | 19:04 | |
| *** jerrygb has joined #openstack-swift | 19:05 | |
| *** tsg has joined #openstack-swift | 19:05 | |
| *** geaaru has quit IRC | 19:06 | |
| *** jerrygb_ has quit IRC | 19:08 | |
| torgomatic_ | Sublime Text always sounds like a good editor for writing vaporware. | 19:10 |
| notmyname | torgomatic_: the adjective definition is much better than the verb ;-) | 19:11 |
| notmyname | (if perhaps a little pretentious) | 19:11 |
| *** blmartin has joined #openstack-swift | 19:13 | |
| clayg | anyone know Peter Lisak's handle? | 19:19 |
| tdasilva | peterlisak: | 19:20 |
| clayg | peterlisak: hey I need your builder! | 19:20 |
| onovy | it's 8:23 pm here (where peter lives) and he is not in work now :) | 19:24 |
| onovy | but if you want builder for from our production cluster, i can send it to you | 19:24 |
| onovy | *builder file | 19:24 |
| tdasilva | onovy: are you guys in Brno? | 19:25 |
| onovy | can someone with better english help me with this? "An alternate authentication system for Swift": Alternate or Alternative? | 19:25 |
| onovy | tdasilva, yep | 19:26 |
| diazjf | notmyname, jrichli, I have added an etherpad for what is need from Castellan in order to include it in the keymaster. https://etherpad.openstack.org/p/swifjt-keymaster-with-castellan Can we plan a discussion on this sometime :) | 19:26 |
| tdasilva | onovy: have you heard of devconf: http://devconf.cz/ ? | 19:27 |
| jrichli | thanks, diazjf | 19:27 |
| onovy | tdasilva, no | 19:27 |
| *** siva_krishnan1 has quit IRC | 19:27 | |
| onovy | tdasilva, oh, sry, yes | 19:28 |
| openstackgerrit | Merged openstack/swift: Skip functional tests when test account4 is unauthorized https://review.openstack.org/238441 | 19:28 |
| *** siva_krishnan has joined #openstack-swift | 19:28 | |
| diazjf | jrichli no worries :) | 19:28 |
| onovy | tdasilva, i will be there :) | 19:29 |
| tdasilva | onovy: cool! you should propose a talk | 19:29 |
| tdasilva | talk about your swift experiences :) | 19:29 |
| onovy | tdasilva, with my horrible english? no thanks :) | 19:30 |
| tdasilva | onovy: i'm planning to be there too..we'll see | 19:30 |
| onovy | BUT can i send some of my colleage | 19:30 |
| tdasilva | onovy: i'm sure you would do just fine | 19:31 |
| peterlisak | clayg, hi, builder can be created by http://paste.openstack.org/show/478422/ ... or onovy will send it | 19:31 |
| openstackgerrit | Bill Huber proposed openstack/swift: ObjectControllers return application errors as 499 on bad read https://review.openstack.org/236007 | 19:31 |
| onovy | peterlisak, you are working? NOW? 20:31? REALY? :) | 19:32 |
| *** lpabon has joined #openstack-swift | 19:32 | |
| *** tsg has quit IRC | 19:34 | |
| openstackgerrit | Merged openstack/swift: Compare Swift config checksum in swift-recon --all https://review.openstack.org/240722 | 19:34 |
| peterlisak | onovy, no, just trying your bouncer ;) | 19:34 |
| peterlisak | onovy, and I have seen my name ... | 19:35 |
| *** subscope has joined #openstack-swift | 19:39 | |
| peterlisak | tdasilva, notmyname, timburke, mattoliverau hi, sorry to bother you. I made a patch 241342, there are two solutions: patch set 2 (extend current list output) and patch set 3 (keep current list output and add new option to extend it). What patch set do you suggest more convenient? thx | 19:42 |
| patchbot | peterlisak: https://review.openstack.org/#/c/241342/ - Add content-type in list of container content | 19:42 |
| onovy | peterlisak, https://review.openstack.org/#/c/243795/ | 19:43 |
| peterlisak | onovy, is it for related project? | 19:49 |
| onovy | peterlisak, yep | 19:49 |
| briancline | I would just like to take a moment to proclaim how much I love pbr | 19:50 |
| clayg | wee! | 19:50 |
| clayg | peterlisak: well I don't think it's the topology that's the problem ( in the comments you even said when I start from scratch it works) | 19:51 |
| clayg | peterlisak: I need the replica2part2dev table | 19:51 |
| clayg | peterlisak: so yeah, if onovy could send it that would be amazing | 19:51 |
| *** daemontool has joined #openstack-swift | 19:51 | |
| onovy | clayg, peterlisak: .builder file from production, right? | 19:52 |
| *** tsg has joined #openstack-swift | 19:52 | |
| peterlisak | onovy, yes | 19:52 |
| clayg | which ever one fails the change! | 19:52 |
| notmyname | ok, clayg and I just "discussed" the pyeclib stuff. there was shouting, wall-hitting, and we were asked to move to a separate room. but we have a plan now! :-) | 19:52 |
| clayg | lol ^ all true! | 19:52 |
| notmyname | tsg: ^ | 19:52 |
| onovy | peterlisak, ^^ but we don't have problem with production rings | 19:52 |
| onovy | i'm missing something? :) | 19:53 |
| clayg | notmyname: althoguth I think until neutron is fixed we're all just spinning our wheels | 19:53 |
| onovy | peterlisak, i think we only have scenario which fails | 19:53 |
| notmyname | clayg: well yeah, but at least when that's fixed we won't be waiting | 19:53 |
| onovy | https://etherpad.openstack.org/p/tokyo-swift-rings // scenario here | 19:53 |
| tdasilva | notmyname, clayg: that must have been entertaining ;) | 19:53 |
| clayg | tdasilva: meh, typical clayg rant | 19:54 |
| peterlisak | onovy, object.builder ... I tried to rebalance our prod. builder with patch 241571 today and it failed | 19:54 |
| patchbot | peterlisak: https://review.openstack.org/#/c/241571/ - Put part-replicas where they go | 19:54 |
| onovy | peterlisak, ah! | 19:54 |
| notmyname | here's the new plan: clayg will rebase patch 243316 against master. that will make patch 238926 unnecessary. then we'll have code that will work with pyeclib 1.0.7 or greater | 19:55 |
| patchbot | notmyname: https://review.openstack.org/#/c/243316/ - Update code to work with requirements | 19:55 |
| patchbot | notmyname: https://review.openstack.org/#/c/238926/ - EC: Use ec_type=liberasurecode_rs_vand in unit tests | 19:55 |
| notmyname | then we'll update g-r with >=1.0.7, then swift with >=1.0.7, then g-r with >=1.1.1, then swift with >=1.1.1 and remove jerasure | 19:55 |
| onovy | http://ondrej.org/object.builder | 19:56 |
| onovy | here it is | 19:56 |
| notmyname | tsg: so very very similar. but now without swift's requirements lying to the world about what works (just in case there are any gaps) | 19:56 |
| notmyname | IMO this is how we'd have normally done it anyway (with any dependency) but we got to the other weird g-r dance first because of asking how to update 2 repos in lockstep | 19:57 |
| *** diazjf has quit IRC | 19:58 | |
| *** jlhinson_ has joined #openstack-swift | 20:01 | |
| *** jlhinson has quit IRC | 20:01 | |
| *** diazjf has joined #openstack-swift | 20:02 | |
| tsg | notmyname: agreed | 20:03 |
| notmyname | always fun to read (even if historically not a good fit for swift) https://www.backblaze.com/blog/cloud-storage-hardware/ | 20:04 |
| onovy | notmyname, hmm nice hardware | 20:06 |
| minwoob | clayg: So the issue with the tests I added in 196848 (and the other tests in test/probe/test_reconstructor_revert.py) seems to be that we aren't actually verifying whether the fragment was reverted back to its location, or if actually the reconstructor rebuilt it. | 20:07 |
| *** zhill is now known as zhill_afk | 20:08 | |
| minwoob | clayg: So in 196848 the change made to the reconstructor itself is to abort the rebuild if the fragment is found via one of the responses. | 20:08 |
| tsg | clayg: in your patch 243316, let's leave "liberasurecode_rs_vand" out until we up the requirement to 1.1.1 | 20:08 |
| patchbot | tsg: https://review.openstack.org/#/c/243316/ - Update code to work with requirements | 20:08 |
| onovy | notmyname, why it's not good for swift? | 20:08 |
| minwoob | clayg: Therefore, it looks to me that it does not matter whether the added probe tests pass before and after the change, since it makes sense that they would pass before the change as well (fragment is rebuilt and placed in the proper location, as opposed to being reverted there). | 20:09 |
| notmyname | onovy: not sure about the 5.0 version, but earlier versions were very oversubscribed on IO bandwidth. that worked ok with the backblaze archive/backup model, but not for swift clusters where there's a lot of disk activity (even with background processes) | 20:09 |
| onovy | notmyname, ah | 20:10 |
| notmyname | however, with their new B2 service, the newer pods are probably getting better for that | 20:10 |
| minwoob | (cschwede as well). | 20:10 |
| *** pdardeau has joined #openstack-swift | 20:11 | |
| notmyname | this one has much better CPU and more memory. still looks like it's using sata port multipliers | 20:12 |
| tsg | clayg: never mind | 20:12 |
| notmyname | onovy: would be interesting to compare this one to an avoton or xeon-d SoC box. you can get those with 12 drives for 1U, so you'll end up with 3 more drives in 4U. would be interesting to compare price and performance | 20:13 |
| minwoob | clayg: cschwede: The fix that came before this one made sure that the reconstructor does not rebuild using an existing fragment (if it is found), but it will still proceed with the rebuild using the other fragments. | 20:13 |
| *** klrmn1 has quit IRC | 20:13 | |
| *** CaioBrentano has quit IRC | 20:14 | |
| clayg | sorry I was afk | 20:15 |
| clayg | onovy: peterlisak: so I saw a comment that said "no home for device" -> I want the ring that raised that error | 20:15 |
| clayg | icanhaz!? | 20:15 |
| onovy | notmyname, yes really interesting. we are using dell/ibm 2u servers with 24 drives and really: it's not cheap :) | 20:16 |
| tdasilva | notmyname: what software does blackblaze use ? | 20:16 |
| *** lpabon has quit IRC | 20:16 | |
| minwoob | clayg: cschwede: Which makes me think that these probe tests should have been with the previous fix, and the current one should test whether revert vs. rebuild occurred. | 20:17 |
| *** itlinux has joined #openstack-swift | 20:17 | |
| peterlisak | clayg, here http://ondrej.org/object.builder ... onovy posted it few minutes ago | 20:18 |
| tsg | clayg: I abandoned patch 238926, patch 243316 is next now :) | 20:18 |
| patchbot | tsg: https://review.openstack.org/#/c/238926/ - EC: Use ec_type=liberasurecode_rs_vand in unit tests | 20:18 |
| patchbot | tsg: https://review.openstack.org/#/c/243316/ - Update code to work with requirements | 20:18 |
| *** gyee has quit IRC | 20:18 | |
| tsg | clayg: next in* is what I meant :) all yours | 20:19 |
| openstackgerrit | Clay Gerrard proposed openstack/swift: EC: Use best available ec_type in unittests https://review.openstack.org/243316 | 20:19 |
| clayg | tsg: notmyname: ^ I think that's right? hopefully it'll work | 20:20 |
| mahatic_ | torgomatic_: ping | 20:21 |
| mahatic_ | or clayg | 20:21 |
| clayg | mahatic_: pong | 20:21 |
| mahatic_ | or anyone else: https://review.openstack.org/#/c/173497/5/swift/proxy/controllers/base.py I wonder if the condition in 1069 is ever true since content-type i always set in Response | 20:22 |
| mahatic_ | is* | 20:22 |
| mahatic_ | is ever false** (damn!) | 20:23 |
| clayg | minwoob: oic, so is it not *possible* to write a probe test to demonstrate the behavior of "skipping the rebuild when frag is on other node" - or just that these tests don't do it? | 20:23 |
| clayg | minwoob: I mean there *is* a behavior change introduced in the change - so it seems like it would be *possible* to construct a scearnio that would demonstrate the behavior - or else - why change the behavior if it's un-observable? | 20:23 |
| clayg | mahatic_: it looks defensive to me | 20:25 |
| clayg | mahatic_: I think in *our* httplib.Response we should never find an object server that forgot to put in *something* for the Content-Type header | 20:25 |
| *** lifeless has quit IRC | 20:26 | |
| clayg | mahatic_: but in practice you *may* have a valid HTTP response that does not include a content-type (e.g. most 3XX responses do not have a Content-Type) | 20:26 |
| *** badari has joined #openstack-swift | 20:26 | |
| *** rjaiswal has quit IRC | 20:26 | |
| *** rjaiswal has joined #openstack-swift | 20:27 | |
| clayg | mahatic_: there's also unittests mocking httplib to return some faked up thing that maybe didn't include a content-type header (i.e. not a good fake for the real object server) | 20:27 |
| clayg | *generally* it's totally reasonable to track down those tests and fix them to be a better fake by acting more like the system they're faking - but otoh coding for the web has taught us to embrance liberal in what you accept - so putting in the defensive code in your response handler also feels natural | 20:28 |
| clayg | mahatic_: is it causing you some greif? | 20:28 |
| *** moravec has left #openstack-swift | 20:28 | |
| glange | *clayg* | 20:29 |
| clayg | tsg: I think having the liberasure in the ec-type-preferences list makes sense as soon as we say >=1.0.7 - so we can add it in that change or now - i'm game either way? | 20:29 |
| mahatic_ | clayg: sorry, was afk. Yeah, I mean it is called in every GET and PUT which means every content-type is set to ´multipart/byteranges´ ? | 20:29 |
| clayg | mahatic_: wat? | 20:30 |
| mahatic_ | (not afk - was in a vm and IRC client is outside of it) | 20:30 |
| clayg | is_multipart = content_type == 'multipart/byteranges' | 20:30 |
| *** CaioBrentano has joined #openstack-swift | 20:30 | |
| mahatic_ | if ct:is_multipart = content_type == 'multipart/byteranges' | 20:30 |
| mahatic_ | clayg: yeah | 20:30 |
| clayg | so is_multipart depends on if the content_type of the response is equal to 'multipart/byteranges' ??? | 20:30 |
| mahatic_ | yeah, thatś precisely my question | 20:31 |
| *** mzhou has quit IRC | 20:32 | |
| clayg | sorry that was a rehtorical (???) as in "a monad is just a monoid in the category of endofunctors, what's the problem"? | 20:32 |
| *** mzhou has joined #openstack-swift | 20:32 | |
| clayg | so if not ct is probbably mostly true, and is_multipart is either true or false dendending on the content-type of the response being equal to 'multipart/byteranges' | 20:33 |
| peluse | mahatic_: so I just noticed that LOC that clay posted up there. earlier you were asserting that anything with a content_type would be considered multipart, that's not what that LOC does | 20:33 |
| clayg | I don't see where is_multipart is effecting the response that get's sent to the client... | 20:33 |
| clayg | mahatic_: type in x = 1 == 2 and then print x | 20:34 |
| peluse | mahatic_: so you get it that is_multipart is only set if content_type is 'multipart/byteranges' right (and not set just if any old content type is present)? | 20:34 |
| mahatic_ | clayg: that makes sense :D | 20:34 |
| clayg | werd | 20:34 |
| minwoob | clayg: Basically, that these tests don't do it. I'm not sure of a way to discern whether it was rebuilt vs. reverted, based solely on outcome alone. | 20:34 |
| clayg | minwoob: oic - crap | 20:35 |
| mahatic_ | clayg: thanks for the example (stupid me duh) | 20:35 |
| minwoob | clayg: It would require verifying which code path was taken in the code itself -- if that's appropriate for a probe test, then yes it's possible. | 20:35 |
| mahatic_ | peluse: yeah, it now does | 20:35 |
| peluse | mahatic_: cool, I didn't see that line earlier, sorry :) | 20:35 |
| *** pdardeau has quit IRC | 20:36 | |
| mahatic_ | peluse: ah, no problem! and I am losing my eye sight (no diff between = and ==) | 20:36 |
| *** pdardeau has joined #openstack-swift | 20:36 | |
| peluse | mahatic_: lost mine year ago! well, never really had it to being with but WTF... | 20:36 |
| mahatic_ | :D | 20:36 |
| clayg | minwoob: i had convinced myself that we could verify it simply by controlling which node (conf) was holding which frag and running them indipendenly in a controlled fashion | 20:36 |
| clayg | mahatic_: don't call yourself stupid - you learned something - that's smart as all get out - most people are terrible at absorbing new information | 20:37 |
| clayg | minwoob: ok, well leave that change for now - i'll start it - i want to take a stab at the probe test - if I find something I like I'll push it up and we can brig cschwede around ;) | 20:38 |
| mahatic_ | heh, sure | 20:38 |
| clayg | mahatic_: you could also refactor it be more clear, there's lots of places where we 'return x == y' instead of 'return True if x == y else False' - i'm not sure the former is as readable | 20:40 |
| clayg | it's less characters | 20:40 |
| minwoob | clayg: Sounds good. Let me know if you need more info about it. | 20:40 |
| mahatic_ | clayg: actually the former is kinda readable i think; but = and == together blinded me! | 20:41 |
| clayg | minwoob: thanks for getting it this far | 20:41 |
| clayg | doh! | 20:41 |
| minwoob | clayg: Np. | 20:41 |
| clayg | :P | 20:41 |
| minwoob | clayg: And also, thanks for the help on it. | 20:41 |
| clayg | phththt - it's nothing | 20:41 |
| mahatic_ | x == y is ok if one has programmed a little; seems = and == is not :P or itś just me. Iĺl get some sleep | 20:43 |
| mahatic_ | good night. Thanks clayg ! | 20:44 |
| mahatic_ | and peluse ! | 20:44 |
| clayg | g'night | 20:44 |
| *** mahatic_ has quit IRC | 20:44 | |
| *** tsg has quit IRC | 20:46 | |
| *** klrmn1 has joined #openstack-swift | 20:47 | |
| *** blmartin has quit IRC | 20:48 | |
| *** jlhinson_ has quit IRC | 20:50 | |
| *** jerrygb has quit IRC | 20:51 | |
| clayg | so for weeks I was using {t[-1]: r for (t, r) in wr.items() if len(t) == 2} but reducing all the failure domains in a tier to just their last digit doesn't work out so well when you have duplicates | 20:54 |
| clayg | did you know you can have z1 in r1 and r2 - because I apparently have selective memory | 20:54 |
| *** CaioBrentano has quit IRC | 20:54 | |
| *** jlhinson has joined #openstack-swift | 20:57 | |
| clayg | onovy: anyway - that's not the problem with your ring | 20:57 |
| *** CaioBren_ has joined #openstack-swift | 20:57 | |
| onovy | clayg, which is good or bad news? :) | 20:57 |
| clayg | onovy: peterlisak: *acctually* there's nothing wrong with your ring - thanks for catching this bug! | 20:57 |
| onovy | ah, good news | 20:58 |
| onovy | perfect | 20:58 |
| clayg | onovy: this is great node! we'll merge code that's better than it would have been other wise! You're like a hero! | 20:58 |
| clayg | onovy: thanks! | 20:58 |
| onovy | :))) | 20:58 |
| onovy | peterlisak, ^^ this is for you, not me | 20:58 |
| onovy | i just sent one file | 20:58 |
| *** jerrygb has joined #openstack-swift | 20:59 | |
| *** jerrygb has quit IRC | 20:59 | |
| clayg | yeah - but like - you sent it *really* good | 20:59 |
| clayg | ;) | 20:59 |
| onovy | :)))) | 20:59 |
| clayg | bah - i acctually don't know how i'm going to fix this yet - but still better that we know about it than not - i'm sure I'll come up with something | 20:59 |
| *** jerrygb has joined #openstack-swift | 20:59 | |
| *** diazjf has quit IRC | 20:59 | |
| clayg | anyway - here's the skinny - https://gist.github.com/clayg/d9d908c1aaa37ac66321 - four zones and four replicas + floating point rounding | 21:03 |
| notmyname | lal @ the buffer playback | 21:03 |
| notmyname | hmm... "a" isn't anywhere near "o" on my keyboard | 21:04 |
| *** jlhinson has quit IRC | 21:04 | |
| clayg | you were going for lawl | 21:04 |
| clayg | urban dictionary is so much fun - I've never heard of "pronouncing" ROFL as "waffles" but I'm totally going to do that now | 21:06 |
| clayg | also - my new title is Cheif Executive Captain Bringdown | 21:06 |
| *** lifeless has joined #openstack-swift | 21:10 | |
| *** CaioBren_ has quit IRC | 21:12 | |
| *** jerrygb_ has joined #openstack-swift | 21:12 | |
| *** jlhinson has joined #openstack-swift | 21:12 | |
| openstackgerrit | Paul Dardeau proposed openstack/swift: Added unit tests for ringbuilder command-line utility https://review.openstack.org/240076 | 21:12 |
| *** klrmn1 has quit IRC | 21:15 | |
| *** klrmn1 has joined #openstack-swift | 21:15 | |
| *** jerrygb has quit IRC | 21:16 | |
| *** klrmn1 has quit IRC | 21:16 | |
| *** jerrygb_ is now known as jerrygb | 21:17 | |
| *** klrmn1 has joined #openstack-swift | 21:17 | |
| peluse | clayg: hey I got a new title this weekend too (not a joke though), CSCS.... http://www.nsca.com/CSCS_Certification_2/ | 21:18 |
| notmyname | clayg: yeah, looks good. running tests | 21:19 |
| jrichli | peluse: congrats! | 21:19 |
| peluse | jrichli: thanks, it was a lot harder than you might think!! | 21:20 |
| *** klrmn1 has quit IRC | 21:22 | |
| *** klrmn1 has joined #openstack-swift | 21:23 | |
| *** jamielennox is now known as jamielennox|away | 21:25 | |
| notmyname | peluse: it doesn't look easy ; | 21:26 |
| peluse | so if there are any pro athletes in the channel who need a trainer.... :) | 21:27 |
| notmyname | heh | 21:27 |
| peluse | took 5 months of studying and a 4.5 hr test at the end | 21:27 |
| peluse | if acoles EC patches were only that easy! | 21:28 |
| peluse | acoles_: JK of course, finally reviewing them... sorry it took me so long to get to them | 21:29 |
| wbhuber_ | peluse: congrats! must be tuff to find time to study and take the course! | 21:31 |
| peluse | wbhuber_: yeah, well, that's what weekends and vacation time if for right? heh | 21:31 |
| *** jbonjean has joined #openstack-swift | 21:32 | |
| wbhuber_ | right. since the field is broad, you'd need to tackle every possible sport - running, tri-athetes, cycling, etc. quite impressive! | 21:33 |
| peluse | wbhuber_: yeah, the test included everything from rowing technique to cycling to football. Main emphasis was on science of strength and conditioning but developing a program for different sports requires a decent knowledge of the sport as well... | 21:38 |
| *** diazjf has joined #openstack-swift | 21:39 | |
| openstackgerrit | Sivasathurappan Radhakrishnan proposed openstack/swift: Added unit test cases for server.py https://review.openstack.org/242300 | 21:39 |
| *** esker has joined #openstack-swift | 21:42 | |
| *** petertr7 is now known as petertr7_away | 21:42 | |
| *** itlinux has quit IRC | 21:44 | |
| *** itlinux has joined #openstack-swift | 21:44 | |
| *** dustins has quit IRC | 21:46 | |
| *** zhill_afk is now known as zhill | 21:47 | |
| *** itlinux has quit IRC | 21:47 | |
| notmyname | tdasilva: I just ran into the exact same problem | 21:49 |
| notmyname | I had to install virtualenv | 21:50 |
| clayg | peluse: right on bro that's awesome! (Re: CSCS) | 21:50 |
| *** ChanServ changes topic to ""you didn't blow away your entire deployment and install everything fresh from the very latest version?! wow."" | 21:51 | |
| *** esker has quit IRC | 21:51 | |
| notmyname | clayg: ok, *now* I'll actually run tests on that patch | 21:52 |
| peluse | clayg: so at the next hackathon I'll setup like an obstacle course or something for everyone or something like that for our team event :) | 21:52 |
| *** esker has joined #openstack-swift | 21:52 | |
| clayg | notmyname: it passed the gate! patch 243316 | 21:53 |
| patchbot | clayg: https://review.openstack.org/#/c/243316/ - EC: Use best available ec_type in unittests | 21:53 |
| notmyname | merge it! | 21:53 |
| *** thumpba has quit IRC | 21:54 | |
| jrichli | peluse: like the ninja warrior course? that'd be cool :-) | 21:54 |
| peluse | jrichli: heack yeah, but with my course there will be a differet shot flavor before each obstacle that one must consume... oh yeah baby! | 21:55 |
| clayg | tdasilva: you're on a review tear - thanks! | 21:56 |
| * clayg goes back into his hoe to play with rings | 21:56 | |
| notmyname | peluse: the first thing clayg said on friday at the summit was "Paul tried to kill me" | 21:56 |
| *** esker has quit IRC | 21:56 | |
| *** mzhou_ has joined #openstack-swift | 21:56 | |
| *** mzhou has quit IRC | 21:57 | |
| tdasilva | notmyname: here's how i fixed it: https://github.com/thiagodasilva/ansible-saio/commit/3231d4683e72f04bc259adef92a6bcc599fe26aa | 21:57 |
| clayg | peluse: I had a coffee in both hands and I'm sure I looked like death - I'm not 100% sure my death was your ultimate goal - but I do know if I'd have tried to keep up with you much longer I wouldn't have made it home | 21:57 |
| *** mzhou_ is now known as mzhou | 21:57 | |
| tdasilva | clayg: trying to keep up with you guys ;) | 21:57 |
| *** jerrygb has quit IRC | 21:57 | |
| peluse | clayg: ha! yeah, that was pretty rough fr sure but I'm proud of you son, you did well :) | 21:58 |
| notmyname | lol | 21:58 |
| tdasilva | peluse: clayg did look pretty funny on Friday morning, his first words were: peluse tried to kill me last night and the room burst out laughing | 21:59 |
| clayg | :D | 21:59 |
| clayg | peluse: I probably just need more training | 21:59 |
| peluse | clayg: it's all about practice for sure. i actually didn't feel too bad, was going to head over but fell asleep since I didn't get back to the room til, well, lets leave it at that.... | 22:01 |
| *** jlhinson_ has joined #openstack-swift | 22:05 | |
| *** jlhinson has quit IRC | 22:08 | |
| *** jamielennox|away is now known as jamielennox | 22:24 | |
| clayg | so you know what's great about floats? sum(x for i in range(46)) * 2 == sum(x for i in range(92)) is only true for most values of x! | 22:28 |
| *** Zyric1 has joined #openstack-swift | 22:30 | |
| jrichli | fun! | 22:32 |
| peluse | clayg: are you using an old pentium? | 22:32 |
| peluse | I think I have a keychin with one of those procs in it :) | 22:33 |
| *** diazjf has quit IRC | 22:33 | |
| *** pdardeau has quit IRC | 22:35 | |
| jrichli | acoles_ and others interested in crypto: I have been digging into the content-type issue recently brought up in channel. | 22:35 |
| jrichli | The content-type crypto-meta only gets chopped-off when update_data_record is called, which is only container listings. That is because this is the only place that swift will split on ';' in content-type to look for swift_bytes, which is only inserted for SLO manifests. | 22:36 |
| jrichli | So, that is one issue, we need to maybe use a different delimiter than what is used for swift_bytes. | 22:36 |
| jrichli | But, to answer the question: why didn't we see this issue earlier? | 22:36 |
| jrichli | test/functional/tests.py:TestSlo.test_slo_overwrite_segment_with_manifest is a case where content-type in encrypter is application/octet-stream;swift_bytes=2097152, but there is no container listing performed, so it passes. | 22:36 |
| jrichli | So, we need a functest that combines using SLO manifest and container listings | 22:36 |
| *** km has joined #openstack-swift | 22:37 | |
| *** km is now known as Guest93971 | 22:38 | |
| clayg | jrichli: how did we not get a functional test for that silly bytes feature of slo's into tree when we merged it!? | 22:39 |
| clayg | dfg: ^ | 22:39 |
| *** tongli has quit IRC | 22:39 | |
| jrichli | clayg: there were unit tests created :-). I did dig up the review that added that feature. | 22:40 |
| torgomatic_ | what would the functest look like? a HEAD request that gets the bytes right? | 22:40 |
| clayg | torgomatic_: nah this is the thing that makes "bytes" returned in the container listing be different from the size of the file for slo manifests | 22:40 |
| torgomatic_ | clayg: oh right; it's jammed in the content type or something | 22:41 |
| clayg | torgomatic_: yup | 22:41 |
| notmyname | and it works on master, right? it's just that the parsing wasn't accounted for in crypto because there wasn't a test for it | 22:41 |
| jrichli | notmyname: I assume so. I didn't test by hand. | 22:42 |
| clayg | notmyname: yeah works on master | 22:43 |
| notmyname | jrichli: and so the part that breaks is that bytes is in the content type. and you're encrypting content-type so you can't get the "real" bytes | 22:44 |
| clayg | content_type = application/octet-stream;swift_bytes=5311331 | 22:44 |
| notmyname | clayg: wait. that's in the DB or that's in the response? | 22:44 |
| clayg | it's in the db so that it can "fix" the response | 22:45 |
| notmyname | right | 22:45 |
| jrichli | notmyname: well, the first step for us to do is use a different delimiter for the crypto-meta. it doesn't even get that far now | 22:45 |
| clayg | i was wondering where content-type was acctually getting the thing added - but didn't know what to grep for | 22:45 |
| clayg | turns out swift_bytes is in the container GET (object listing) and middleware.slo | 22:46 |
| jrichli | notmyname: after that, I would suggest having encrypter split on ';' as well to get the real content-type before encrypting - similar unwinding behavior for decrypt | 22:46 |
| clayg | I wish acoles_ was around to chat with him about fast-POST with content-type update to SLO probably messes with that thing | 22:47 |
| clayg | jrichli: *maybe* - I think the slo middleware maybe shouldn't be munging this quite so early | 22:47 |
| *** asettle-afk is now known as asettle | 22:48 | |
| clayg | if we just passed X-SLO-Bytes round trip to the container update we could have the only person that knows about the akward munging of content-type and slo-manifest-bytes be the container server (and it's just an implementation detail that he decides to cram it into content-type like a mad man) | 22:48 |
| jrichli | lol | 22:49 |
| jrichli | sounds like a good idea. I just laugh b/c of the mad man ref | 22:49 |
| clayg | jrichli: well lots of good ideas fall apart in practice | 22:50 |
| clayg | i don't know if the async updates will already sync arbitrary X-Backend headers | 22:50 |
| clayg | i don't know if changing proxies to write to alt header instead of pure content-type will work in an upgrade (I mean I know it won't just "work" I've just not thought enough of who needs to be backwards compatible to make it work or if that's possible) | 22:51 |
| clayg | like I'd guess the container server could be updated to to eat the header if it's there and do the content-type munge on a PUT - but if a proxy with updated middleware ended up making slo-manifest PUTs to container servers that don't know how to do that - those container server might just not write swift_bytes into the content-type - so we could do both? | 22:53 |
| clayg | notmyname: don't you have a change that fixes the warning in unittests? | 22:54 |
| clayg | notmyname: can we +A that? | 22:54 |
| notmyname | clayg: yup https://review.openstack.org/#/c/243419/ | 22:55 |
| clayg | notmyname: pfththt kinda weak - you could have just mocked stderr and then written another test to validate no warning is printed when new min_part_hours is passed | 22:57 |
| clayg | notmyname: but it WOMM | 22:57 |
| notmyname | pfththt mine's a 6 character patch ;-) | 22:57 |
| notmyname | and yes, I did think about another patch that would explicitly test both branches to see if the warning was printed at the right time | 22:58 |
| *** klrmn1 has quit IRC | 22:59 | |
| notmyname | and then i didn't do that because I just wanted the warning to go away and the test printing it is unaffected by the warning | 22:59 |
| notmyname | (actually, the test is only testing "this thing ran and didn't crash") | 22:59 |
| *** klrmn1 has joined #openstack-swift | 22:59 | |
| notmyname | but yeah, having another test that does the check for the warning is the right way to go, i think | 23:00 |
| *** rjaiswal has quit IRC | 23:05 | |
| notmyname | clayg: how were you testing patch 243316? | 23:05 |
| patchbot | notmyname: https://review.openstack.org/#/c/243316/ - EC: Use best available ec_type in unittests | 23:05 |
| clayg | i started to code it up and got so sleepy - we have that RunSwiftRingBuilderMixin but it uses self.tempfile instead of self.tmpfile - what a kludge | 23:06 |
| *** tsg has joined #openstack-swift | 23:06 | |
| notmyname | oh, nice. tsg is back | 23:06 |
| clayg | who was I giving grief about making launchpad bugs for test cleanup because I totally want ot make on now :'( | 23:07 |
| notmyname | clayg: lol | 23:07 |
| clayg | notmyname: i don't think i tested the latest rev - is it broken? | 23:07 |
| notmyname | clayg: https://bugs.launchpad.net/swift/+bug/1514831 | 23:07 |
| openstack | Launchpad bug 1514831 in OpenStack Object Storage (swift) "OpenStack Typo" [Undecided,In progress] - Assigned to venkatamahesh (venkatamaheshkotha) | 23:07 |
| clayg | yeah that guy - but that's not even test clean up - and he had the patch all ready to go - just weird | 23:07 |
| *** jerrygb has joined #openstack-swift | 23:08 | |
| clayg | no I think other paul was trying to add some coverage to recon - and I was like "gah this test module is whack!?" and he was like "well should we open a bug" and I was like "a bug for a test module seems silly" and then peluse was like "use trello!" | 23:08 |
| clayg | at least *I* think that's how it happened | 23:09 |
| clayg | but if I don't write down all the things I wanted fixed in test modules how am I ever going to trick someone else into doing it for me!? | 23:11 |
| notmyname | clayg: tsg: I started with master (test pass), applied patch 243316 (tests pass), upgraded pyeclib to 1.1.1 (tests pass), uninstalled pyeclib and liberasurecode and reinstalled only 1.1.1 (test fail with a jerasure reference) | 23:12 |
| patchbot | notmyname: https://review.openstack.org/#/c/243316/ - EC: Use best available ec_type in unittests | 23:12 |
| notmyname | while upgrading to pyeclib1.1.1 the first time, I manually changed swift's requirements.txt to be >=1.0.7 | 23:13 |
| clayg | torgomatic_: my brain isn't working to day - this is simple data structure manipulation - but I can't click to the obvious way to spell it so it's not itereating over all the devices and all their tiers all the time -> https://gist.github.com/clayg/edf91dbdec109a01c811 | 23:13 |
| clayg | torgomatic_: this is the fix for onovy's rings | 23:13 |
| tsg | notmyname: I thought we were testing only for the ==1.0.7 case :) | 23:13 |
| *** siva_krishnan has quit IRC | 23:13 | |
| notmyname | tsg: I'm testing clay's patch that should make it work for both. ie what should be an upgrade path according to the requirements file | 23:14 |
| clayg | notmyname: upgrade worked but uninstall/reinstall didn't work? | 23:14 |
| clayg | notmyname: sounds like a PEBCAK | 23:14 |
| notmyname | clayg: right | 23:14 |
| notmyname | and likely | 23:14 |
| *** siva_krishnan has joined #openstack-swift | 23:14 | |
| clayg | notmyname: ok ok wait | 23:14 |
| notmyname | except that when you upgrade, you get 2 versions of liberasure code | 23:15 |
| *** wbhuber_ has quit IRC | 23:15 | |
| clayg | so when you uninstalled did you remove your requirements.txt change? | 23:15 |
| notmyname | no | 23:15 |
| clayg | so you have swift requires >= 1.0.7 and pyeclib 1.1.1 | 23:15 |
| clayg | should work | 23:15 |
| notmyname | right | 23:15 |
| notmyname | uninstall was with pip uninstall and manually rm'ing the .so files | 23:15 |
| notmyname | Nov 10 23:11:39 saio liberasurecode[17757]: liberasurecode_backend_open: dynamic linking error libJerasure.so: cannot open shared object file: No such file or directory | 23:15 |
| *** esker has joined #openstack-swift | 23:16 | |
| peluse | oh man | 23:17 |
| clayg | wAT? O.o | 23:17 |
| notmyname | wait a minute | 23:17 |
| clayg | np | 23:17 |
| notmyname | I may have found the problem | 23:17 |
| notmyname | somewhere between keyboard and chair ;-) | 23:17 |
| tsg | :) | 23:18 |
| notmyname | yeah. all good | 23:20 |
| notmyname | tsg: and you're actually listed as the Author. clayg is only co-author in the commit message | 23:20 |
| tsg | oh sorry | 23:20 |
| *** esker has quit IRC | 23:20 | |
| tsg | notmyname: thanks for pointing out | 23:20 |
| tsg | and clayg: thanks | 23:21 |
| notmyname | tsg: only know it because I had the exact same thought ;-) | 23:21 |
| notmyname | cool. and peluse already +2'd it, so therefore +A | 23:21 |
| notmyname | yay, progress! | 23:21 |
| peluse | i'm hot today | 23:21 |
| tsg | notmyname, clayg: did you guys see an issue "error in setup command: Invalid environment marker: (python_version>='3.0')" after haypo's latest commit | 23:22 |
| *** garthb__ has quit IRC | 23:22 | |
| notmyname | tsg: yeah, you have to upgrade everything | 23:22 |
| notmyname | tsg: see the topic message ;-) | 23:22 |
| notmyname | tsg: tdasilva and I both saw it too | 23:22 |
| tsg | LOL | 23:23 |
| notmyname | upgrade pbr, setupptools, and pip. probably other stuff. in fact, you aren't running Arch and installing everything from nightlies?! wow. | 23:23 |
| *** siva_krishnan has quit IRC | 23:23 | |
| tsg | notmyname: this is a brand new trusty container | 23:23 |
| tsg | ah | 23:23 |
| tsg | I may need to upgrade pip | 23:23 |
| *** garthb__ has joined #openstack-swift | 23:23 | |
| notmyname | container?! like docker/lxc/rkt? you're already way ahead! | 23:24 |
| * notmyname needs to dial back the snark a little | 23:24 | |
| tsg | docker :) | 23:25 |
| *** chsc has quit IRC | 23:26 | |
| tsg | notmyname: cheaper than vagrant* | 23:26 |
| clayg | torgomatic_: oh goodness thank you for talking me out of doing something stupid | 23:29 |
| clayg | torgomatic_: this new better plan works great | 23:30 |
| clayg | oh crap - now I need a test | 23:30 |
| clayg | sigh | 23:30 |
| clayg | can I just add onovy's builder to our test suite? it's only 5M | 23:30 |
| tsg | notmyname: turns out it was in fact setuptools that needed to be upgraded | 23:30 |
| notmyname | tsg: ah ok. same issue tdasilva saw | 23:31 |
| clayg | test_this_ring_works test_that_ring_works test_another_ring_works test_??? <- totally scalable! | 23:31 |
| clayg | tsg: it's either pip, pbr, setuptools, virtualenv, or something else - everytime | 23:31 |
| *** minwoob has quit IRC | 23:33 | |
| tsg | clayg: I see :) I tested in a brand new trusty instance - and looks like this time it was setuptools. Good to put a note in SAIO | 23:33 |
| tsg | clayg: based on https://github.com/testing-cabal/mock/issues/261, and https://github.com/nikolas/pylti/commit/2c556f7cd90c6cb9075a5e975ba2310102059057, we can probably tell that the minimum setuptools version needed is 17.1 | 23:34 |
| *** jrichli has quit IRC | 23:38 | |
| *** lcurtis has quit IRC | 23:42 | |
| *** ho has joined #openstack-swift | 23:44 | |
| *** jlhinson_ has quit IRC | 23:49 | |
| clayg | how gross is .format(**locals()) like it *feels* gross - but is it really worse than .format(some_var=some_var, other_thing=other_thing) | 23:50 |
| clayg | ruby has native string interpolation with the fancy "#{some_var} is #{other_thing}" and it's pretty terse | 23:51 |
| clayg | tsg: it doesn't matter how often you update the docs - it'll be broken in again in a few weeks - see topic | 23:53 |
| ho | good morning! | 23:53 |
| torgomatic_ | clayg: it's pretty gross; it basically makes the variable grep-proof | 23:57 |
| * torgomatic_ isn't a big fan of ruby's string interpolation either, tbh | 23:58 | |
| * briancline gags | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!