Wednesday, 2016-07-06

mattoliverauclayg: os was it the de-json-ifying and if you make the ring use utf8 will json then behave and give you utf-8.. though maybe I'm yet to understand the problem00:00
*** Jeffrey4l_ has joined #openstack-swift00:00
claygmattoliverau: no, json always returns unicode00:01
brianclineoh, catching up. sorry, tmux on mobile is difficult :P00:02
claygi'm just trying to decide which standardization is going to give us the least amount of grief00:04
*** adu has joined #openstack-swift00:04
claygi guess unicode everywhere - but then we may as well fix swob that seemed to think keeping the path utf-8 was a good idea?00:05
*** CaioBrentano has joined #openstack-swift00:09
brianclineyeah, my problem was that it converted it way up in the stack, wasn't clear at all why that was preferable00:10
brianclinewell, one of several problems00:10
brianclinethere seemed to be tons of needless converting00:11
brianclineso you cant get gettext_ to give you back a unicode type?00:12
*** CaioBrentano has quit IRC00:14
*** nadeem has quit IRC00:19
claygbriancline: no, i'm sure now that it never does - not in py2 anyway00:25
claygbriancline: it acctually makes the traceback make more sense00:26
brianclinehmm. i had it printing the repr of my gettext_ call... so now im curious wth is happening00:27
claygthe rhs isn't ever unicode - but it's have unicode patterens (from the ring devices) interpolated into it - which coerces the type of the utf-8 str to unicode, then we we try to interpolate the additional_info argument (which is utf-8 after translation and after interpolating the utf-8 path into it) - THEN it blows up00:27
kota_hello00:28
* kota_ is attending OpenStack Days Tokyo 201600:29
*** _JZ_ has joined #openstack-swift00:31
*** klamath has quit IRC00:32
brianclinewait, now i'm really confused... so you're reproducing this with just unicode ring dev names and not from the unquoted req path?00:32
claygbriancline: yeah you just need a downed node, non-ascii chars in your put object name, and a real ring00:36
claygexisting unittests started blowing up as soon as I fixed our Fake to return data that looked more like the real.00:37
brianclineintriguing00:39
claygbriancline: i guess, timburke and I shared some choice words about unicode - I don't think "interesting" was the mostly commonly used adjective00:41
openstackgerritKota Tsuyuzaki proposed openstack/swift: Enable object server to return non-durable data  https://review.openstack.org/21527600:41
timburkeclayg: it's not so much that json always returns unicode; json *is* unicode! the spec defines it as a series of unicode codepoints00:42
openstackgerritTim Burke proposed openstack/swift: Fix gettext_ calls  https://review.openstack.org/33674300:42
brianclineclayg: yeah. i have definitely been censoring myself00:43
*** diogogmt has quit IRC00:45
claygtimburke: it always confused me... it's supposed to be a data interchange format - but it seems like you have to encode an object to json, and then encode the json for the wire?00:49
timburkei didn't say it made sense...00:49
claygmaybe the assumption is that the json format SHOULD not have non-ascii characters in it (it has the \u format) - but most parsers have learned to expect utf-8 in those little blobs -> json.loads('"w\xc8\x81t"')00:50
*** m_kazuhiro has joined #openstack-swift00:50
timburkealthough you can definitely specify something different, like json.loads('"w\xc8\x81t"', encoding='latin1')00:56
*** Suyash has quit IRC00:58
*** mint has joined #openstack-swift01:08
*** mint has quit IRC01:08
*** Suyash has joined #openstack-swift01:21
*** tqtran has quit IRC01:22
*** smile-luobin has joined #openstack-swift01:29
*** NM has joined #openstack-swift01:32
*** siva_krish has joined #openstack-swift01:34
*** diogogmt has joined #openstack-swift01:37
*** siva_krish has quit IRC01:39
*** chlong has quit IRC01:40
*** AndyWojo has joined #openstack-swift01:41
*** siva_krish has joined #openstack-swift01:41
AndyWojoHi anyone have a second?01:41
AndyWojoI'm building my rings, (swift-ring-builder object.builder add --region 1 --zone 1 --ip 192.168.241.117 --port 6000 --device dm-6 --weight 100), is dm-6 correct here? or /dev/dm-601:42
kota_AndyWojo: not correct01:44
AndyWojoOr both?01:45
AndyWojoMy FS is mounted: /srv/node/36005076300820ac270000000000000de, it's backed via /dev/mapper/36005076300820ac270000000000000de01:45
kota_AndyWojo: you need to mount the /dev/dm-6 to somewhere like /srv/node/sdb101:45
AndyWojowhich is a symlink to /dev/dm-601:45
AndyWojoIt is01:46
AndyWojoohh01:46
kota_and then you can set the mout point to swift ring.01:46
AndyWojoSo I put the filesystem?01:46
AndyWojoSo it would be...01:46
AndyWojoswift-ring-builder object.builder add --region 1 --zone 1 --ip 192.168.241.117 --port 6000 --device /srv/node/36005076300820ac270000000000000de --weight 10001:46
kota_maybe01:48
timburkecertainly looks more correct. you'll probably need to remove the /dev/dm-6 entry, as well01:49
AndyWojoright01:51
AndyWojoill delete the gz files and rebuild the rings01:51
*** chlong has joined #openstack-swift01:53
AndyWojoNow I get: Account GET failed: http://gvicopnstk01:8080/v1/AUTH_00d93a1f7a0c484a9dad0e7fa39dd597?format=json 400 Bad Request  [first 60 chars of response] Invalid path: //srv/node/36005076300820ac270000000000000df/501:56
AndyWojoLet me go back through the implementation guide see if I missed anything01:57
*** _JZ__ has joined #openstack-swift02:01
*** _JZ_ has quit IRC02:02
zaitcevNo /srv/node in --device02:03
openstackgerritCheng Li proposed openstack/python-swiftclient: Add python version constraint python>=2.7  https://review.openstack.org/33433302:04
timburkethanks zaitcev, i was just coming around to that...02:04
timburke(i should really go through the full SAIO docs...)02:05
AndyWojosweet fixed it02:05
AndyWojoMy device isn't represented by the mount point, so I symlinked 36005076300820ac270000000000000de to /dev/dm-6 and took the /srv/node out02:06
AndyWojothanks!02:06
zaitcevAndyWojo: Device names are just identificators with a flat namespace of Swift devices on a node. They have nothing with the underlying block device. Over years people tried various schemes, like "same as block device" for /dev/sda1 -> /srv/node/sda1 -> "sda1" device. This fell apart when block devices started to travel with every plug of a SAS cabel.02:06
AndyWojoAh.02:07
zaitcevAndyWojo: So, one popular trick these days is 1) mount by label with LABEL=X or -L X, and then 2) use the same X in Swift namespace.02:07
AndyWojoAh I see02:07
AndyWojoMakes sense02:07
AndyWojoThis works, this is just for a lab02:08
zaitcevfor example, I have a1 a2 s3 on node 'a', b1, b2, b3 on node 'b'.02:08
*** thurloat has quit IRC02:08
mattoliverauclayg: sorry was in meeting, then sidetracked with travel prep for midcycle. I think unicode is a great interchange format.. a bunch of code points can then be encoded into any utf-8,16, etc byte encoding.. but yeah if you want to send it as a byte stream down a wire then it' isn't necessarily the best for that type of interchange :) We could make our own utf8 json wrapper ;)02:08
zaitcevthen I know at once where the blasted device is when problems happen02:08
AndyWojozaitcev: gotcha!02:08
*** swat30 has quit IRC02:08
AndyWojoThat makes sense02:08
AndyWojoI only have one storage node in this case02:08
AndyWojoWhat kind of cool stuff can I do with swift other than storing my ephemeral vm storage?02:09
zaitcevDunno... It is mostly the VM storage in my case.02:09
AndyWojoGotcha02:09
zaitcevBackups for Glance.02:09
AndyWojoCan you do tiered storage? For example I have a DS3700, an XIV and Flash storage. Is there a way to create different tiers of swift and have that presented in horizon?02:10
zaitcevI dunno if you're into Japanimation, but maybe you heard about Crunchyroll. They serve all their video streams out of a Swift cluster.02:10
AndyWojooh cool02:10
AndyWojoI have02:10
zaitcevSorry, we don't have a tiered storage solution baked in. IBM folks keep tinkering with it for their tape libraries, but it seems like a project with a forever receding horizon.02:11
AndyWojoAh02:11
AndyWojoMaybe I'll ask the #openstack-powervm folks, they're all IBMers02:12
kota_AndyWojo: https://review.openstack.org/#/c/287057/ may be what you are looking for, it is still WIP though.02:13
patchbotkota_: patch 287057 - swift - WIP: Swift Automated Tiering02:13
*** _JZ_ has joined #openstack-swift02:14
*** _JZ__ has quit IRC02:15
openstackgerritCheng Li proposed openstack/python-swiftclient: Add python version constraint python>=2.7  https://review.openstack.org/33433302:15
openstackgerritTim Burke proposed openstack/python-swiftclient: Add python version constraint python>=2.7  https://review.openstack.org/33433302:17
*** tanee_away is now known as tanee02:19
*** _JZ_ has quit IRC02:20
*** tqtran has joined #openstack-swift02:21
openstackgerritTim Burke proposed openstack/swift: Send correct SLO ETag for container updates  https://review.openstack.org/33796002:23
*** thurloat has joined #openstack-swift02:24
*** _JZ_ has joined #openstack-swift02:24
timburkemattoliverau: yes! maybe we'll call it...simplejson! 'cause, y'know, it's so simple! :P02:24
*** swat30 has joined #openstack-swift02:25
mattoliverautimburke: genius!02:25
*** tqtran has quit IRC02:26
timburkeAndyWojo: fwiw, you still *can* have tiered storage. we just don't (currently) automatically move the data between tiers for you. you can still define separate "storage policies", which can each have their own separate disks. so you could define separate SSD and HDD policies02:28
*** ManojK has quit IRC02:28
timburkei'm not sure what support horizon may have for storage policies, though02:28
AndyWojoGotcha, yeah that's the mystery02:28
AndyWojoI want my users to be able to choose between different storage options02:29
AndyWojoI'll experiment.02:29
timburke(note to self, go look at horizon some...see what patches i can write...)02:29
*** NM has quit IRC02:30
*** ManojK has joined #openstack-swift02:44
*** siva_krish has quit IRC02:51
*** gyee has quit IRC02:52
*** siva_krish has joined #openstack-swift03:00
*** ManojK has quit IRC03:04
mattoliverauAndyWojo: I know horizon are working on a new swift frontend.. not sure its storage policy support. But I can poke the guy who did a binch of the work (he's in my team).. tho he's on holidays this week.03:13
AndyWojoNo biggy. Basically I have all this storage in our lab, and I want to be able to present all the different kinds of storage as options when creating a VM within openstack03:14
AndyWojoI thought swift might be the option03:14
AndyWojoWe have 5-6 types of storage I want to make available03:14
*** Suyash has quit IRC03:35
openstackgerritTim Burke proposed openstack/python-swiftclient: Add other-requirements.txt  https://review.openstack.org/33798203:44
*** _JZ_ has quit IRC03:45
*** m_kazuhiro has quit IRC04:03
*** m_kazuhiro has joined #openstack-swift04:08
*** sgundur1 has joined #openstack-swift04:09
*** sgundur1 has left #openstack-swift04:10
*** klrmn has quit IRC04:11
*** ManojK has joined #openstack-swift04:18
*** tqtran has joined #openstack-swift04:23
*** tqtran has quit IRC04:28
*** ManojK has quit IRC04:29
*** okdas has quit IRC04:33
*** okdas has joined #openstack-swift04:35
*** okdas has joined #openstack-swift04:35
openstackgerritTim Burke proposed openstack/python-swiftclient: Add other-requirements.txt  https://review.openstack.org/33798204:38
*** psachin has joined #openstack-swift04:42
*** links has joined #openstack-swift04:48
openstackgerritTim Burke proposed openstack/python-swiftclient: Add other-requirements.txt  https://review.openstack.org/33798204:51
openstackgerritTim Burke proposed openstack/python-swiftclient: Add other-requirements.txt  https://review.openstack.org/33798204:59
*** Victor has joined #openstack-swift05:00
*** Victor is now known as Guest7385005:01
*** Guest73850 has quit IRC05:01
*** Guest73850 has joined #openstack-swift05:01
*** Guest73850 is now known as CR3ZNEZCH05:02
*** sheel has joined #openstack-swift05:02
*** SkyRocknRoll has joined #openstack-swift05:15
*** asettle has joined #openstack-swift05:29
*** asettle has quit IRC05:34
*** zaitcev has quit IRC05:40
*** hseipp has joined #openstack-swift05:50
*** hseipp has quit IRC05:52
*** siva_krish has quit IRC06:00
*** pcaruana has joined #openstack-swift06:05
*** rcernin has joined #openstack-swift06:09
*** adu has quit IRC06:14
-openstackstatus- NOTICE: All python 3.5 jobs are failing today, we need to build new xenial images first.06:28
*** mmcardle has joined #openstack-swift06:30
*** cshastri has joined #openstack-swift06:32
*** CR3ZNEZCH has quit IRC06:34
*** Victor has joined #openstack-swift06:34
*** Victor is now known as Guest7181506:34
*** Guest71815 has quit IRC06:35
*** Guest71815 has joined #openstack-swift06:35
*** Guest71815 is now known as CR3ZNEZCH06:35
*** SkyRocknRoll has quit IRC06:37
*** CR3ZNEZCH has quit IRC06:38
*** hosanai has quit IRC06:44
*** SkyRocknRoll has joined #openstack-swift06:49
*** hseipp has joined #openstack-swift06:55
*** tesseract- has joined #openstack-swift07:21
*** rledisez has joined #openstack-swift07:23
*** joeljwright has joined #openstack-swift08:03
*** ChanServ sets mode: +v joeljwright08:03
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844108:10
*** oshritf has joined #openstack-swift08:13
*** smile-luobin_ has joined #openstack-swift08:20
*** smile-luobin has quit IRC08:23
*** asettle has joined #openstack-swift08:35
*** asettle has quit IRC08:36
*** asettle has joined #openstack-swift08:36
*** asettle has quit IRC08:44
*** asettle has joined #openstack-swift08:47
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925008:50
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873608:51
*** kei_yama has quit IRC09:01
*** ouchkernel has quit IRC09:02
*** acoles_ is now known as acoles09:09
*** ouchkernel has joined #openstack-swift09:09
*** oshritf has quit IRC09:10
*** dfflanders has joined #openstack-swift09:19
*** tqtran has joined #openstack-swift09:25
*** tqtran has quit IRC09:29
*** SkyRocknRoll has quit IRC09:47
*** daemontool has joined #openstack-swift09:49
*** daemontool has quit IRC09:58
*** daemontool has joined #openstack-swift09:58
*** m_kazuhiro has quit IRC09:59
*** links has quit IRC10:00
*** jrichli has quit IRC10:04
*** SkyRocknRoll has joined #openstack-swift10:04
*** jrichli has joined #openstack-swift10:06
*** oshritf has joined #openstack-swift10:06
*** SkyRocknRoll has quit IRC10:38
*** nadeem has joined #openstack-swift10:40
*** jrichli has quit IRC10:42
*** siva_krish has joined #openstack-swift10:44
*** jrichli has joined #openstack-swift10:46
openstackgerritMaria Malyarova proposed openstack/swift: Added missing parenthesis in print calls  https://review.openstack.org/33769010:49
*** SkyRocknRoll has joined #openstack-swift10:53
*** asettle has quit IRC10:57
*** asettle has joined #openstack-swift10:57
*** asettle has quit IRC11:02
*** Victor has joined #openstack-swift11:06
*** Victor has joined #openstack-swift11:06
*** Victor is now known as Guest3271911:07
*** Guest32719 is now known as CR3ZNEZCH11:07
*** siva_krish has quit IRC11:19
*** links has joined #openstack-swift11:24
*** cdelatte has quit IRC11:24
*** SkyRocknRoll has quit IRC11:24
*** asettle has joined #openstack-swift11:25
*** thurloat has quit IRC11:26
*** swat30 has quit IRC11:26
*** thurloat has joined #openstack-swift11:27
*** swat30 has joined #openstack-swift11:28
*** silor has joined #openstack-swift11:39
*** SkyRocknRoll has joined #openstack-swift11:40
*** CaioBrentano has joined #openstack-swift11:41
*** silor1 has joined #openstack-swift11:42
*** silor has quit IRC11:44
*** silor1 is now known as silor11:44
*** NM has joined #openstack-swift11:47
*** oshritf has quit IRC11:50
*** oshritf has joined #openstack-swift11:50
*** permalac has joined #openstack-swift12:02
*** oshritf has quit IRC12:02
*** oshritf has joined #openstack-swift12:03
*** oshritf_ has joined #openstack-swift12:03
*** siva_krish has joined #openstack-swift12:04
openstackgerritAlistair Coles proposed openstack/swift: Copy headers correctly when copying object  https://review.openstack.org/27272412:24
*** klamath has joined #openstack-swift12:41
*** klamath has quit IRC12:41
*** klamath has joined #openstack-swift12:42
*** cshastri has quit IRC12:49
*** takashi has joined #openstack-swift12:59
*** cshastri has joined #openstack-swift13:04
*** dfflanders has quit IRC13:11
*** nadeem has quit IRC13:12
*** vint_bra has joined #openstack-swift13:15
*** CaioBrentano has quit IRC13:19
*** ManojK has joined #openstack-swift13:23
*** diogogmt has quit IRC13:23
*** diogogmt has joined #openstack-swift13:25
*** tqtran has joined #openstack-swift13:26
*** SkyRocknRoll has quit IRC13:30
*** tqtran has quit IRC13:30
*** ametts has joined #openstack-swift13:33
*** asettle has quit IRC13:37
*** asettle has joined #openstack-swift13:37
*** diogogmt has quit IRC13:41
*** vinsh has joined #openstack-swift13:41
openstackgerritAlistair Coles proposed openstack/swift: Add basic functests for user object metadata  https://review.openstack.org/33674113:48
acolesclayg: hope you don't mind my change ^^13:57
*** links has quit IRC13:57
*** ManojK has quit IRC13:57
*** ManojK has joined #openstack-swift14:00
*** siva_krish has quit IRC14:04
*** ManojK has quit IRC14:11
*** oshritf has quit IRC14:18
*** oshritf_ has quit IRC14:18
*** CR3ZNEZCH has quit IRC14:24
*** sgundur1 has joined #openstack-swift14:27
*** psachin has quit IRC14:30
*** vint_bra has quit IRC14:30
*** vint_bra has joined #openstack-swift14:33
*** vint_bra has quit IRC14:34
*** siva_krish has joined #openstack-swift14:34
*** ManojK has joined #openstack-swift14:35
*** psachin has joined #openstack-swift14:35
*** vint_bra has joined #openstack-swift14:39
*** arch-nemesis has joined #openstack-swift14:40
*** chsc has joined #openstack-swift14:47
*** chsc has joined #openstack-swift14:47
*** diogogmt has joined #openstack-swift14:54
*** _JZ_ has joined #openstack-swift14:59
*** thumpba has joined #openstack-swift15:00
*** pcaruana has quit IRC15:06
*** siva_krish has left #openstack-swift15:08
*** psachin has quit IRC15:10
*** vint_bra has quit IRC15:10
*** rcernin has quit IRC15:10
*** cshastri has quit IRC15:10
*** psachin has joined #openstack-swift15:10
*** klrmn has joined #openstack-swift15:19
*** silor has quit IRC15:19
*** NM has quit IRC15:29
*** NM has joined #openstack-swift15:31
*** rcernin has joined #openstack-swift15:49
*** jmccarthy has quit IRC15:50
*** jmccarthy has joined #openstack-swift15:50
*** asettle has quit IRC15:51
timburkegood morning16:00
*** vinsh has quit IRC16:03
*** vinsh has joined #openstack-swift16:03
*** vinsh_ has joined #openstack-swift16:08
*** takashi has quit IRC16:09
*** klrmn has quit IRC16:12
*** vinsh has quit IRC16:12
*** vint_bra has joined #openstack-swift16:13
*** nadeem has joined #openstack-swift16:20
*** gyee has joined #openstack-swift16:21
*** psachin has quit IRC16:22
brianclinemorning timburke16:23
*** Suyash has joined #openstack-swift16:24
*** ukaynar has joined #openstack-swift16:27
*** zaitcev has joined #openstack-swift16:28
*** ChanServ sets mode: +v zaitcev16:28
notmynamehello, world16:36
*** NM has quit IRC16:38
*** admin6 has left #openstack-swift16:40
*** hseipp has quit IRC16:41
*** NM has joined #openstack-swift16:41
*** Suyash has quit IRC16:42
*** rledisez has quit IRC16:44
*** gyee has quit IRC16:45
*** tesseract- has quit IRC16:49
*** gyee has joined #openstack-swift17:00
*** redbo_ has quit IRC17:01
*** redbo has joined #openstack-swift17:01
*** ChanServ sets mode: +v redbo17:01
*** ManojK has quit IRC17:07
notmynameand with very liberal use of "mark all as read", I've now sorted through the last 4 days' worth of email17:08
tdasilvanotmyname: howdy! how was camp?17:09
notmynametdasilva: it was nice http://d.not.mn/Kirby_cove_view.jpg http://d.not.mn/Kirby_cove_view2.jpg17:11
notmynameI wasn't able to see fireworks from there, but otherwise, it was a great spot17:12
tdasilvaneat, looks like you were on the other side of the bridge right? that's SFO behind the bridge17:12
tdasilva?17:12
notmynameyep. just over the bridge in marin and just below the overlook/observation area17:13
*** ChanServ changes topic to "Let's talk. We're nice. | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Hackathon: https://etherpad.openstack.org/p/swift_SA_hackathon_2016"17:13
tdasilvanotmyname: sounds cool :-)17:14
*** acoles is now known as acoles_17:14
notmynameliterally and figuratively ;-)17:14
*** klrmn has joined #openstack-swift17:16
*** daemontool has quit IRC17:18
openstackgerritTim Burke proposed openstack/swift: Send correct SLO ETag for container updates  https://review.openstack.org/33796017:18
tdasilvanotmyname: heh17:20
*** Suyash has joined #openstack-swift17:25
*** tqtran has joined #openstack-swift17:27
*** cdelatte has joined #openstack-swift17:28
*** ukaynar has quit IRC17:30
tdasilvanotmyname: just a heads up, now I can't get scrollbars on the community dashboard at all, even when making the window smaller17:30
*** ouchkernel has quit IRC17:32
notmynametdasilva: ok, thanks. I think that's left over from the confetti stuff17:35
notmynameI'll fix it shortly17:35
*** Jeffrey4l_ has quit IRC17:39
*** Jeffrey4l_ has joined #openstack-swift17:44
notmynametdasilva: should be fixed17:45
tdasilvanotmyname: yep! thanks17:46
*** nadeem has quit IRC17:51
notmynameAuthor:Cloud User <cloud-user@bounce.cisco.com>17:51
claygheyoh!17:53
claygacoles_: never!  you always make everything better17:53
*** ManojK has joined #openstack-swift17:53
klamathany reason why "error_suppression_limit" is not working?18:06
klamathdo timeouts count as an "error" if the node is hard down?18:07
*** joeljwright has quit IRC18:07
*** nadeem has joined #openstack-swift18:08
klamathhttp://comments.gmane.org/gmane.comp.cloud.openstack.devel/86918:08
*** permalac has quit IRC18:09
*** Jeffrey4l_ has quit IRC18:19
openstackgerritMerged openstack/swift: Added missing parenthesis in print calls  https://review.openstack.org/33769018:25
*** ouchkernel has joined #openstack-swift18:48
*** cdelatte has quit IRC18:50
*** ChubYann has joined #openstack-swift18:50
*** esumerfd has joined #openstack-swift18:54
*** cdelatte has joined #openstack-swift18:55
*** sheel has quit IRC18:55
*** asettle has joined #openstack-swift19:00
*** ManojK has quit IRC19:07
*** ManojK has joined #openstack-swift19:12
*** nadeem has quit IRC19:15
*** asettle has quit IRC19:20
openstackgerritMichael Barton proposed openstack/swift: go: storage policies  https://review.openstack.org/33850619:25
klamathyay19:26
tdasilvawow19:26
*** asettle has joined #openstack-swift19:29
*** adu has joined #openstack-swift19:34
*** asettle has quit IRC19:36
*** adu has quit IRC19:37
*** zul has quit IRC19:51
claygwow @ storage policies in hummingbird!?19:52
*** cdelatte has quit IRC19:53
*** asettle has joined #openstack-swift19:59
*** mathiasb has quit IRC20:01
*** sbelous_ has joined #openstack-swift20:01
*** rcernin_ has joined #openstack-swift20:06
tdasilvaclayg: yeah20:08
tdasilvaredbo: sounds great, would like to try it out soon20:09
*** nadeem has joined #openstack-swift20:09
*** rcernin_ has quit IRC20:10
notmynamegreat to see :-)20:11
*** rcernin_ has joined #openstack-swift20:15
*** cdelatte has joined #openstack-swift20:16
*** rcernin_ has quit IRC20:19
*** rcernin_ has joined #openstack-swift20:19
*** rcernin_ has quit IRC20:20
*** rcernin has quit IRC20:24
*** rcernin has joined #openstack-swift20:25
*** diazjf has joined #openstack-swift20:27
*** vint_bra has quit IRC20:32
*** mathiasb has joined #openstack-swift20:33
*** rcernin has quit IRC20:38
*** rcernin has joined #openstack-swift20:39
*** kei_yama has joined #openstack-swift20:43
*** thumpba has quit IRC20:46
*** nadeem has quit IRC20:50
*** nadeem has joined #openstack-swift20:54
*** dfflanders has joined #openstack-swift20:54
*** nadeem has quit IRC20:54
*** nadeem has joined #openstack-swift20:55
notmynameswift team meeting in #openstack-meeting is 5 minutes20:55
*** sbelous_ has quit IRC20:57
*** acoles_ is now known as acoles20:58
*** dfflanders has quit IRC20:58
mattoliveraumorning20:58
*** dfflanders has joined #openstack-swift20:59
jrichlimattoliverau: good morning!  ready for the Texas heat?21:00
notmynameswift team meeting time21:00
notmynamejrichli: ugh. it's literally going to be double in TX from my home21:00
mattoliveraunotmyname: I had the same complaint about the doc's patches (new docfolders in the root directory and under doc). So I went to see if it could be moved, but the gerrit publish jobs (for ref-api and install-guide) look in the root, and it can't be changed without moving them in all of openstack.. but surely others have the same issue.21:01
notmyname100+ in san antonio. in the 50s in SF21:01
jrichliwow!21:01
*** m_kazuhiro has joined #openstack-swift21:01
notmynamemattoliverau: yeah, I want one docs dir with one conf.py and one docs theme21:01
*** m_kazuhi_ has joined #openstack-swift21:01
*** m_kazuhi_ has quit IRC21:02
mattoliveraujrichli: surface of the sun again huh.. I guess I'm as ready as I'll ever be :P21:02
*** rcernin has quit IRC21:03
*** rcernin has joined #openstack-swift21:04
*** diazjf has quit IRC21:07
*** rcernin has quit IRC21:07
*** rcernin has joined #openstack-swift21:07
acolesthat sounds...'warm'21:08
*** vint_bra has joined #openstack-swift21:11
*** asettle has quit IRC21:13
*** esumerfd has quit IRC21:29
*** NM has quit IRC21:31
openstackgerritMerged openstack/swift: Change elifs to ifs  https://review.openstack.org/33630321:31
torgomaticI've started thinking about temperatures in Kelvin. Makes the difference between SF and San Antonio seem smaller.21:32
hurricanerixlol21:33
tdasilvakota_ is not around today...does anybody know if dmorita will be in san antonio? would be cool to keep the auto tier conversation going21:33
hurricanerixtorgomatic: come on, it's only going to be around 100, thats a nice round number.  =)21:33
torgomatichurricanerix: yes, and I am a nice round programmer who doesn't get along with high heat ;)21:33
acolestorgomatic: lol. think in Celsius and they're almost on a par21:34
hurricanerixtorgomatic heh, don't worry we have air conditioning all over the place.  also ice tea21:34
acolestorgomatic: um, actually its probably not that cold in SF21:34
* jrichli if off to yoga21:36
tdasilvatimur: Hi, timburke mentioned you have done some work with the swift+searchlight integration...do you have any updates? is the searchlight team doing most of the work?21:37
*** acoles is now known as acoles_21:37
*** rcernin has quit IRC21:37
claygtdasilva: I don't think timur really monitors this channel, nor do I think he's in much contact with the searchlight team?  You want me to ping him?21:38
tdasilvaclayg: if it's not too much trouble and it is not urgent, just trying to figure out where things are since Austin21:39
tdasilvaclayg: do you know if timur will be in San Antonio?21:39
timurtdasilva: I've made some progress on the container-sync-like approach. Hopefully, I'll be able to push a version of that in the next couple of weeks. I haven't kept in touch with the searchlight folks though21:42
timurtdasilva: I don't think I'll be in San Antonio though21:43
notmynametdasilva: yes, dmorita is signed up for the hackathon21:44
*** m_kazuhiro has quit IRC21:46
tdasilvatimur: ok, thanks for the heads up. I think the searchlight team was going to try the "other" approach, correct?21:48
tdasilvanotmyname: cool! thanks21:49
tdasilvatimur: and by "other" approach I mean wsgi middleware...at least that's what I could understand from comments here: https://review.openstack.org/#/c/305404/21:54
patchbottdasilva: patch 305404 - searchlight-specs - Searchlight Client Library21:54
*** gyee has quit IRC21:54
timurtdasilva: They were going to push on writing the middleware to get notifications from Swift into searchlight. I don't know what's happening with it though, as I haven't seen any updates on any of the patches21:55
timurtdasilva: yea, that's the best reference above -- I was just looking around for it21:56
*** diazjf has joined #openstack-swift21:56
mattoliverautdasilva: I believe dmorita is currently living in the states, so he'll probably be there. (If my memory serves)21:59
*** diazjf has quit IRC22:00
notmynameyeah, IIRC he's here in the Bay Area22:01
*** ametts has quit IRC22:02
kota_ugh, my alarm didn't ring22:03
notmynamekota_: no worries22:03
notmynamekota_: the meeting summary is "we're looking forward to seeing you next week" :-)22:03
kota_notmyname: is there something new?22:03
openstackgerritMerged openstack/swift: Prevent down nodes failing PUTs with non-ascii obj names  https://review.openstack.org/33537322:03
kota_notmyname: \o/ definately!22:04
* kota_ is reading log...22:04
mattoliveraunotmyname: kota_'s right to ask, cause looking forward to seeing him is nothing new ;)22:06
notmyname:-)22:06
kota_lol22:06
mattoliverauwell looks like the meeting I'm suppose to be in now isn't happening, so I'm going to go find some breakfast \o/22:07
kota_done for reading, it looks it was short meeting :-)22:12
kota_tdasilva: dmorita will be SanAantonio but m_kazuhiro won't because of his work :/22:14
*** david-lyle_ has joined #openstack-swift22:21
*** mmcardle has quit IRC22:29
pdardeaui took a stab at some code to hopefully illustrate the eventlet hub starvation problem. do you think it's a fair representation? https://github.com/pauldardeau/python-concurrent-disk-io22:32
*** vint_bra has quit IRC22:32
*** david-lyle_ is now known as david-lyle22:35
notmynamepdardeau: oh wow. that's much more thorough than I expected when I first clicked on it22:37
openstackgerritTim Burke proposed openstack/swift: Send correct SLO ETag for container updates  https://review.openstack.org/33796022:44
openstackgerritTim Burke proposed openstack/swift: Fix X-*-Container-Update-Override-* header/footer precedence  https://review.openstack.org/33858822:44
*** vint_bra has joined #openstack-swift22:45
*** ManojK has quit IRC22:47
*** nadeem has quit IRC22:57
*** chsc has quit IRC23:07
claygpdardeau: so it looks like you have an implementation using native threads in a dozen languages (include jython) - then eventlet; then the golang runtime23:10
*** vint_bra has quit IRC23:16
claygpdardeau: did you notice that the "jython" solution using threads runs just fine under cpython and doesn't exibit "the problem scenario"23:17
pdardeauclayg: yep, you got it. i did not try the jython approach under cpython (i didn't think about it), but i'll give it a shot23:19
*** zul has joined #openstack-swift23:24
*** vinsh_ has quit IRC23:28
pdardeauclayg: thanks for your suggestion. i just tried the python threaded version with cpython 2.7 and the problem did not appear. i also updated source file names and README with results.23:50
notmynamepdardeau: clayg: that's expected, I'd think. but the next part would be to have the test running put an "interesting" load against it. instead of doing 4-5 concurrent clients, how does the server handle 400-500 clients?23:51
notmynamepdardeau: clayg: I suspect that would show where threads fall down23:52
notmyname(and why we use greenlets)23:52
pdardeaunotmyname: good points. maybe we can talk about it more at hackathon (even if not part of schedule)23:53
pdardeaunotmyname: is there a specific client-side testing tool for 400-500 clients?23:54
*** _JZ_ has quit IRC23:55
notmynamepdardeau: no. back in early swift days I wrote a simple putter script that uses eventlet on the client side to throw requests at a server. something like that would likely be sufficient23:56
*** Suyash has quit IRC23:56
notmynamepdardeau: IOW, I'd suggest actually using python+eventlet to get the workload concurrency up to interesting levels. (this would also have the advantage of only having to run one client instead of a bunch)23:56
notmynameon my laptop, I can get eventlet to push several hundred swift PUTs/sec on a single core. of course you could write something in golang and get a lot more since it would use more than one core ;-)23:57
kota_Does someone know why swift set "sock" to args, here?, https://github.com/openstack/swift/blob/master/swift/common/memcached.py#L22523:58
kota_it looks always None even if a Timeout raised and nothing to do in the method.23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!