Wednesday, 2016-08-31

openstackgerritTimur Alperovich proposed openstack/swift: Silence "Client disconnected" warnings on reads.  https://review.openstack.org/36331600:06
openstackgerritTimur Alperovich proposed openstack/swift: Silence "Client disconnected" warnings on reads.  https://review.openstack.org/36331600:07
*** takashi has joined #openstack-swift00:07
*** manous_ has quit IRC00:12
openstackgerritMerged openstack/swift: Close the iterators in string_along.  https://review.openstack.org/36319900:15
*** chlong has quit IRC00:16
*** mingyu has quit IRC00:25
*** abhitechie has joined #openstack-swift00:26
*** takashi has quit IRC00:26
*** dfflanders has joined #openstack-swift00:26
*** mingyu has joined #openstack-swift00:33
*** Vinsh has quit IRC00:38
claygtimburke: ok, at the urging of a couple of core in #python-dev I poked the bees nest on that bug -> http://bugs.python.org/issue2223300:38
claygtimburke: now i'm wondering if you have your py3proxy branch somewhere we could build python 3.6 with the patch and see if it acctually fixes the issue?00:38
*** Vinsh has joined #openstack-swift00:39
*** mingyu has quit IRC00:41
*** Suyi_1 has quit IRC00:43
*** mingyu has joined #openstack-swift00:47
*** m_kazuhiro has joined #openstack-swift00:53
*** asettle has joined #openstack-swift00:54
*** delattec has quit IRC00:56
*** trananhkma has joined #openstack-swift00:57
openstackgerritMerged openstack/python-swiftclient: Convert numeric and boolean header values to strings  https://review.openstack.org/36072500:58
*** asettle has quit IRC00:59
*** _JZ_ has quit IRC01:02
kota_good morning01:05
mattoliveraukota_: morning01:06
kota_mattolivearu: o//01:07
*** dmorita has quit IRC01:21
zhengyinkoata_, mattoliverau: good morning01:27
mattoliverauzhengyin: morning :)01:28
*** abhitechie has quit IRC01:33
*** chlong has joined #openstack-swift01:40
*** _JZ_ has joined #openstack-swift01:49
*** arnoldchen has joined #openstack-swift02:04
*** bkopilov has quit IRC02:05
*** Vinsh has quit IRC02:07
*** Vinsh has joined #openstack-swift02:10
*** ChanServ sets mode: +v jrichli02:19
*** diogogmt has quit IRC02:19
*** tqtran has quit IRC02:22
*** nadeem has joined #openstack-swift02:31
*** gyee has quit IRC02:31
*** Jeffrey4l_ has joined #openstack-swift02:38
*** ChubYann has quit IRC02:42
*** ChubYann has joined #openstack-swift02:56
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient: Updated from global requirements  https://review.openstack.org/8925003:10
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873603:10
*** tqtran has joined #openstack-swift03:21
*** dmorita has joined #openstack-swift03:21
*** bkopilov has joined #openstack-swift03:22
*** dmorita has quit IRC03:26
*** mingyu has quit IRC03:33
*** arnoldchen has quit IRC03:33
*** Vinsh has quit IRC03:37
*** Vinsh has joined #openstack-swift03:40
*** dmorita has joined #openstack-swift03:42
*** diogogmt has joined #openstack-swift03:44
*** dmorita has quit IRC03:46
*** arnoldchen has joined #openstack-swift03:53
*** mingyu has joined #openstack-swift03:53
*** mingyu has quit IRC03:53
*** arnoldchen has quit IRC03:58
*** abhitechie has joined #openstack-swift04:00
*** bkopilov_ has joined #openstack-swift04:03
*** bkopilov_ has quit IRC04:03
*** bkopilov_ has joined #openstack-swift04:04
*** arnoldchen has joined #openstack-swift04:04
*** arnoldchen has quit IRC04:09
*** cschwede has quit IRC04:17
*** cschwede has joined #openstack-swift04:17
*** _JZ_ has quit IRC04:27
*** arnoldchen has joined #openstack-swift04:31
*** SkyRocknRoll has joined #openstack-swift04:35
*** arnoldchen has quit IRC04:36
*** arnoldchen has joined #openstack-swift04:36
*** links has joined #openstack-swift04:36
*** chlong has quit IRC04:38
*** chlong has joined #openstack-swift04:39
*** arnoldchen has quit IRC04:40
*** arnoldchen has joined #openstack-swift04:41
*** Vinsh has quit IRC04:42
*** ppai has joined #openstack-swift04:43
*** chlong has quit IRC04:45
*** chsc has joined #openstack-swift04:46
*** chsc has joined #openstack-swift04:46
*** Vinsh has joined #openstack-swift04:47
*** Jeffrey4l_ has quit IRC04:56
*** chlong has joined #openstack-swift04:57
*** asettle has joined #openstack-swift04:57
*** chsc has quit IRC04:58
*** asettle has quit IRC05:02
*** psachin has joined #openstack-swift05:05
*** zaitcev has quit IRC05:07
*** arnoldchen has quit IRC05:11
*** suresh_ has joined #openstack-swift05:16
*** arnoldchen has joined #openstack-swift05:17
*** diogogmt has quit IRC05:17
suresh_hii all i want to know about "read and write permissions on containers"05:18
suresh_please suggest me some links05:18
*** arnoldchen has quit IRC05:21
*** ppai has quit IRC05:24
mattoliverausuresh_: you can take a look at http://docs.openstack.org/developer/swift/misc.html#module-swift.common.middleware.acl to get an idea of how acls look/work and briefly described http://docs.openstack.org/developer/swift/overview_auth.html I.e. the headers to use. X-Container-Read and X-Container-Write.05:31
*** ChubYann has quit IRC05:32
suresh_mattoliverau: thanks05:33
mattoliverausuresh_: swiftstack have this https://www.swiftstack.com/docs/cookbooks/swift_usage/container_acl.html but they talk about using there specific usernames. In essence you can define an ACL by .referrer (or just .r) or by user, the latter depends on your auth system.05:34
suresh_mattoliverau: yeah i will read and try these05:34
suresh_mattoliverau: thanks for your response05:35
mattoliverausuresh_: no probs05:35
*** arnoldchen has joined #openstack-swift05:35
*** arnoldchen has quit IRC05:40
openstackgerritKota Tsuyuzaki proposed openstack/swift: CompositeRing Support  https://review.openstack.org/27192005:45
kota_just rebased, still working.05:45
*** arnoldchen has joined #openstack-swift05:46
*** arnoldchen has quit IRC05:51
*** arnoldchen has joined #openstack-swift05:53
*** arnoldchen has quit IRC05:57
*** Vinsh has quit IRC05:58
*** ppai has joined #openstack-swift05:58
*** arnoldchen has joined #openstack-swift05:59
*** kei_yama has quit IRC06:02
*** Vinsh has joined #openstack-swift06:02
*** arnoldchen has quit IRC06:03
*** ttrumm has joined #openstack-swift06:05
*** arnoldchen has joined #openstack-swift06:11
*** pcaruana has joined #openstack-swift06:15
*** arnoldchen has quit IRC06:15
*** rcernin has joined #openstack-swift06:21
*** arnoldchen has joined #openstack-swift06:22
*** sheel has joined #openstack-swift06:24
*** ttrumm has quit IRC06:25
*** ttrumm has joined #openstack-swift06:25
*** arnoldchen has quit IRC06:26
*** SkyRocknRoll has quit IRC06:36
*** arnoldchen has joined #openstack-swift06:40
*** arnoldchen has quit IRC06:44
*** silor has joined #openstack-swift06:46
*** joeljwright1 has joined #openstack-swift06:48
*** joeljwright1 has quit IRC06:48
*** mingyu has joined #openstack-swift06:54
*** ChanServ sets mode: +v cschwede06:55
*** mingyu has quit IRC06:59
*** hseipp has joined #openstack-swift06:59
*** arnoldchen has joined #openstack-swift07:03
*** arnoldchen has quit IRC07:05
*** arnoldchen has joined #openstack-swift07:05
*** tesseract- has joined #openstack-swift07:08
*** Vinsh has quit IRC07:17
*** Vinsh has joined #openstack-swift07:22
*** trananhkma has quit IRC07:26
*** arnoldchen has quit IRC07:34
*** abhinavtechie has joined #openstack-swift07:34
*** arnoldchen has joined #openstack-swift07:34
*** abhitechie has quit IRC07:37
openstackgerritNguyen Phuong An proposed openstack/swift: Config logABug feature for Swift api-ref  https://review.openstack.org/36345207:41
*** SkyRocknRoll has joined #openstack-swift07:45
*** geaaru has joined #openstack-swift07:50
*** silor1 has joined #openstack-swift07:54
*** silor has quit IRC07:55
*** silor1 is now known as silor07:55
*** bkopilov_ has quit IRC07:57
*** bkopilov has quit IRC07:57
*** bkopilov has joined #openstack-swift08:01
*** chlong has quit IRC08:06
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844108:10
*** kong has quit IRC08:22
*** kong has joined #openstack-swift08:23
*** silor has quit IRC08:31
*** mingyu has joined #openstack-swift08:35
*** Vinsh has quit IRC08:37
*** Vinsh has joined #openstack-swift08:42
*** dmorita has joined #openstack-swift08:46
*** nadeem has quit IRC08:47
*** ttrumm has quit IRC08:49
*** ttrumm has joined #openstack-swift08:50
*** dmorita has quit IRC08:51
*** ttrumm has quit IRC08:55
*** asettle has joined #openstack-swift08:58
*** hseipp has quit IRC09:01
*** brnelson has quit IRC09:23
*** brnelson has joined #openstack-swift09:24
*** marok has quit IRC09:29
*** marok has joined #openstack-swift09:29
*** trananhkma has joined #openstack-swift09:36
*** arnoldchen has quit IRC09:40
*** abhinavtechie has quit IRC09:51
*** Vinsh has quit IRC09:53
*** Vinsh has joined #openstack-swift09:55
*** manous_ has joined #openstack-swift09:59
*** SkyRocknRoll has quit IRC10:01
openstackgerritJoel Wright proposed openstack/python-swiftclient: Fix tests/unit/test_shell.py copy tests result order  https://review.openstack.org/36355210:12
*** hosanai has quit IRC10:15
*** manous_ has quit IRC10:24
suresh_hii all, while uploading more than 5 GB file through chunks it is creating "object_name"+segments container10:32
suresh_why it is creating that container10:33
suresh_please someone help10:33
openstackgerritKota Tsuyuzaki proposed openstack/swift: Enable object server to return non-durable data  https://review.openstack.org/21527610:33
*** chrichip has joined #openstack-swift10:34
joeljwrightsuresh_: are you using the python-swiftclient?10:35
kota_suresh_: that is becuase swift doesn't allow > 5GB file as an object in default ( you can change the conf in swift.conf)10:35
kota_joel!10:35
joeljwrightkota_: hey!10:35
joeljwrightsuresh_: the python swiftclient creates a new container called 'container_segments' for uploading large objects10:35
kota_joeljwright: probably that's default behavioer of swiftclient command line to make SLO?10:36
joeljwrightsuresh_: the manifest file that represents the large object is placed in the original container, all the data goes into container_segments10:36
joeljwrightsuresh_: loads of info about what's happening when uploading >5gb here: http://docs.openstack.org/developer/swift/overview_large_objects.html10:37
kota_yeah, to split the file to small "segments" and make a manifest which you can download the original > 5GB object via the path you want to upload.10:37
joeljwrightkota_: how's things? Will you be at the summit in October?10:37
kota_joerlwright: I'll be there!10:38
joeljwright:)10:38
*** manous_ has joined #openstack-swift10:38
kota_joeljwright: i'm looking forward to meeting you there ;-)10:38
suresh_joeljwright: If i delete the manifest file then the data in container_segments will be delete?10:39
joeljwrightkota_: should be fun. I've been really busy since Austin, just trying to get back into swift stuff again10:39
kota_joeljwright: np, welcome to get back anyway :)10:40
joeljwrightsuresh_: I need to check that10:43
suresh_will you please check once and let me know what is happening when deleteing manifest.10:45
joeljwrightsuresh_: I believe that segments are only deleted if you're using DLO at the moment10:49
joeljwrightsuresh_: deleting an SLO will currently leave the segments in storage I believe10:50
*** chrichip has quit IRC10:50
suresh_joeljwrightL: sorry what is DLO and SLO ?10:50
joeljwrightsuresh_: see the link I sent you earlier10:51
joeljwrightsuresh_: DLO == 'dynamic large object', SLO == 'static large object'10:51
*** chrichip has joined #openstack-swift10:51
suresh_joeljwright: yeah got it10:51
*** chrichip has quit IRC10:56
suresh_joeljwrightL: i uploaded a 10 GB file through python-swift client10:56
suresh_why it is showing less size in swift stat container10:56
suresh_it is showing 12MB in stat of that container10:57
*** chrichip has joined #openstack-swift10:57
joeljwrightsuresh_: swift stat container only shows the size of the data in that container; all the object contents are in container_segments10:57
joeljwrightsuresh_: swift stat container_segments will show the size of the data you expect10:58
suresh_joeljwright: yeah thanks for your responses.10:58
joeljwrightsuresh_: np :)10:58
openstackgerritKota Tsuyuzaki proposed openstack/swift: EC Fragment Duplication - Foundational Global EC Cluster Support  https://review.openstack.org/21916511:00
kota_rebased11:00
kota_because my landed patch conflicted with my patch :/11:00
joeljwrightkota_: glad I'm not the only one who does that :)11:01
*** abhinavtechie has joined #openstack-swift11:01
*** Vinsh has quit IRC11:02
kota_joeljwright: ;)11:03
kota_it's time to back home, bye guys11:04
joeljwrightkota_: bye11:04
openstackgerritzheng yin proposed openstack/python-swiftclient: Add commands examples for copy and delete  https://review.openstack.org/36358111:07
*** Vinsh has joined #openstack-swift11:07
*** chrichip has quit IRC11:10
*** chrichip has joined #openstack-swift11:11
*** bkopilov has quit IRC11:11
suresh_hii all, how to write in to one object which is in online  Is there anyway"11:17
suresh_please someone help11:17
*** chrichip has quit IRC11:18
*** chrichip has joined #openstack-swift11:19
*** dmorita has joined #openstack-swift11:23
*** SkyRocknRoll has joined #openstack-swift11:25
*** chrichip has quit IRC11:26
*** chrichip has joined #openstack-swift11:27
*** dmorita has quit IRC11:27
*** ttrumm has joined #openstack-swift11:41
*** dfflanders has quit IRC11:41
*** ttrumm has quit IRC11:41
*** ttrumm has joined #openstack-swift11:42
*** chrichip has quit IRC11:44
*** chrichip has joined #openstack-swift11:45
*** asettle has quit IRC11:53
*** asettle has joined #openstack-swift11:58
*** asettle has quit IRC11:58
*** asettle has joined #openstack-swift11:59
*** chrichip has quit IRC12:00
*** chrichip has joined #openstack-swift12:00
*** tongli has quit IRC12:03
*** Jeffrey4l_ has joined #openstack-swift12:10
*** sheel has quit IRC12:16
*** Vinsh has quit IRC12:17
*** dmorita has joined #openstack-swift12:19
*** Vinsh has joined #openstack-swift12:20
*** dmorita has quit IRC12:24
*** suresh_ has quit IRC12:31
*** openstackgerrit has quit IRC12:34
*** openstackgerrit has joined #openstack-swift12:34
*** trananhkma has quit IRC12:39
*** abhinavtechie has quit IRC12:44
*** abhinavtechie has joined #openstack-swift12:44
*** bkopilov has joined #openstack-swift12:46
*** tongli has joined #openstack-swift12:47
*** tongli has quit IRC12:48
*** tongli has joined #openstack-swift12:49
*** m_kazuhiro has quit IRC12:54
openstackgerritChristian Schwede proposed openstack/swift: More TestAccountController test updates  https://review.openstack.org/36362812:59
openstackgerritChristian Schwede proposed openstack/swift: More Test[Account|Container]Controller test updates  https://review.openstack.org/36362813:05
*** ttrumm has quit IRC13:07
*** ttrumm has joined #openstack-swift13:08
*** psachin has quit IRC13:09
*** abhinavtechie has quit IRC13:11
*** abhinavtechie has joined #openstack-swift13:12
*** StraubTW has joined #openstack-swift13:17
*** SkyRocknRoll has quit IRC13:22
*** klamath has joined #openstack-swift13:22
*** klamath has quit IRC13:22
*** klamath has joined #openstack-swift13:23
*** takashi has joined #openstack-swift13:23
*** Vinsh has quit IRC13:27
*** zul has quit IRC13:30
*** Vinsh has joined #openstack-swift13:30
*** zul has joined #openstack-swift13:33
*** chrichip has quit IRC13:40
*** chrichip has joined #openstack-swift13:41
*** ttrumm has quit IRC13:43
*** ttrumm has joined #openstack-swift13:44
*** chrichip has quit IRC13:46
*** chrichip has joined #openstack-swift13:47
*** ttrumm has quit IRC13:48
*** jamielennox|away is now known as jamielennox13:55
*** chsc has joined #openstack-swift13:56
openstackgerritChristian Schwede proposed openstack/swift: Fix swiftdir option and usage of storage policy aliases  https://review.openstack.org/34469313:56
*** psachin has joined #openstack-swift13:57
openstackgerritMerged openstack/swift: Add unit case  https://review.openstack.org/35047113:57
*** tongli_ has joined #openstack-swift13:58
*** abhinavtechie has quit IRC13:59
*** links has quit IRC14:00
*** tongli has quit IRC14:01
*** jamielennox is now known as jamielennox|away14:01
*** chrichip has quit IRC14:02
*** jamielennox|away is now known as jamielennox14:02
*** chrichip has joined #openstack-swift14:03
*** baojg has joined #openstack-swift14:05
*** silor has joined #openstack-swift14:07
openstackgerritMohit Motiani proposed openstack/swift: Add regions and zones in ring-builder.py  https://review.openstack.org/35062514:10
*** manous_ has quit IRC14:21
*** manous_ has joined #openstack-swift14:21
*** psachin has quit IRC14:22
*** ppai has quit IRC14:27
openstackgerritMerged openstack/swift: Add test to validate the error strings in test_expirer  https://review.openstack.org/36091414:28
*** Vinsh has quit IRC14:42
*** Vinsh has joined #openstack-swift14:49
*** ChubYann has joined #openstack-swift14:51
*** m_kazuhiro has joined #openstack-swift14:52
*** abhitechie has joined #openstack-swift14:53
*** m_kazuhiro has quit IRC14:59
*** m_kazuhiro has joined #openstack-swift15:01
*** tongli_ has quit IRC15:01
*** ttrumm has joined #openstack-swift15:02
*** tongli has joined #openstack-swift15:02
*** dmellado is now known as dmellado|mtg15:04
*** m_kazuhiro has quit IRC15:04
*** manous_ has quit IRC15:04
*** jamielennox is now known as jamielennox|away15:05
*** tongli has quit IRC15:07
*** diogogmt has joined #openstack-swift15:14
*** tongli has joined #openstack-swift15:14
*** tongli has quit IRC15:18
*** pcaruana has quit IRC15:22
*** rcernin has quit IRC15:22
*** ttrumm has quit IRC15:28
*** dmellado|mtg is now known as dmellado15:33
*** Vinsh_ has joined #openstack-swift15:34
notmynamegood morning15:36
*** tesseract- has quit IRC15:36
*** Vinsh has quit IRC15:37
*** _JZ_ has joined #openstack-swift15:38
*** rcernin has joined #openstack-swift15:54
*** sheel has joined #openstack-swift15:57
*** links has joined #openstack-swift16:10
*** ouchkernel has joined #openstack-swift16:11
*** asettle has quit IRC16:12
*** tongli has joined #openstack-swift16:13
*** asettle has joined #openstack-swift16:13
*** nikivi has joined #openstack-swift16:14
*** chrichip has quit IRC16:16
*** asettle has quit IRC16:17
*** chrichip has joined #openstack-swift16:17
*** dmorita has joined #openstack-swift16:23
*** tongli_ has joined #openstack-swift16:26
*** chsc has quit IRC16:27
*** jith_ has joined #openstack-swift16:27
*** dmorita has quit IRC16:28
*** tongli has quit IRC16:29
*** tongli_ has quit IRC16:30
*** tongli has joined #openstack-swift16:32
*** mingyu has quit IRC16:32
*** mingyu has joined #openstack-swift16:32
*** mingyu has quit IRC16:32
*** ukaynar has joined #openstack-swift16:32
*** tongli has quit IRC16:36
timburkeclayg: you could, but it'd probably be better to test with python-swiftclient. following https://review.openstack.org/#/c/360135/ the functests should generally all pass, but definitely don't if you've got, say, u'\u5605' in your account tempurl key16:38
patchbotpatch 360135 - python-swiftclient - Make functests py3-compatible16:38
*** tongli has joined #openstack-swift16:38
*** aswadr_ has joined #openstack-swift16:39
*** abhitechie has quit IRC16:40
*** tongli has quit IRC16:43
*** dmorita has joined #openstack-swift16:43
*** tongli has joined #openstack-swift16:44
*** tongli has quit IRC16:48
*** daemontool has joined #openstack-swift16:50
*** chsc has joined #openstack-swift16:56
*** tongli has joined #openstack-swift16:57
*** tongli has quit IRC17:02
*** chsc has quit IRC17:03
*** nadeem has joined #openstack-swift17:04
notmynameFYI swift is mentioned here several times. https://news.ycombinator.com/item?id=1239208117:08
notmynamea common issue raised is "really hard to initially set up" (however, good once that happens)17:09
*** baojg has quit IRC17:10
*** tongli has joined #openstack-swift17:12
*** tongli has quit IRC17:17
timburkenotmyname: i'm a little sad to not see swift mentioned more in https://news.ycombinator.com/item?id=1239830317:21
ahale_large scale object storage seems much harder to run than to set up, the day to day things that go along with having a lot of machines with a lot of disks17:22
*** tongli has joined #openstack-swift17:24
notmynametimburke: I see one mention of swift in the comments (and positive)17:25
notmynameahale_: it's not hard when you have A(hale)aaS17:27
ahale_hah17:28
*** tongli has quit IRC17:28
* notmyname is choosing tshirt colors right now17:29
*** tongli has joined #openstack-swift17:30
*** ttrumm has joined #openstack-swift17:31
*** tongli_ has joined #openstack-swift17:31
*** mingyu has joined #openstack-swift17:33
*** StraubTW has quit IRC17:33
*** tongli_ has quit IRC17:34
*** tongli has quit IRC17:35
*** tongli_ has joined #openstack-swift17:35
*** mingyu has quit IRC17:38
*** tongli_ has quit IRC17:39
*** pcaruana has joined #openstack-swift17:39
*** tongli has joined #openstack-swift17:40
*** ttrumm has quit IRC17:43
*** tongli has quit IRC17:43
*** tongli has joined #openstack-swift17:44
*** ttrumm has joined #openstack-swift17:44
*** tongli has quit IRC17:46
*** tongli has joined #openstack-swift17:46
*** ttrumm has quit IRC17:48
*** tongli has quit IRC17:50
*** zaitcev has joined #openstack-swift17:50
*** ChanServ sets mode: +v zaitcev17:50
*** tongli has joined #openstack-swift17:50
*** ukaynar has quit IRC17:51
openstackgerritTimur Alperovich proposed openstack/swift: Silence "Client disconnected" warnings on reads.  https://review.openstack.org/36331617:54
*** tongli has quit IRC17:58
*** tongli has joined #openstack-swift17:58
*** tongli_ has joined #openstack-swift18:00
*** geaaru has quit IRC18:02
jrichliim really excited about the shirts!  great design18:02
*** diogogmt has quit IRC18:02
*** tongli has quit IRC18:03
*** chsc has joined #openstack-swift18:03
*** chsc has joined #openstack-swift18:03
*** thumpba has joined #openstack-swift18:05
claygtimburke: awesome, full ack18:08
*** tongli has joined #openstack-swift18:11
*** tongli_ has quit IRC18:14
*** Suyi_ has joined #openstack-swift18:18
*** ukaynar has joined #openstack-swift18:19
*** ukaynar has quit IRC18:22
*** tongli has quit IRC18:43
*** tongli has joined #openstack-swift18:44
openstackgerritThiago da Silva proposed openstack/swift: Add option to set default version mode  https://review.openstack.org/36143918:45
*** tongli_ has joined #openstack-swift18:46
*** diogogmt has joined #openstack-swift18:48
*** tongli has quit IRC18:48
*** thumpba has quit IRC18:49
*** thumpba has joined #openstack-swift18:49
tdasilvajrichli: now you can actually add a +2 on patch 357559 ;)18:54
patchbothttps://review.openstack.org/#/c/357559/ - swift - Include metadata in PUT/POST responses18:54
*** sheel has quit IRC18:56
*** diogogmt has quit IRC18:57
jrichlitdasilva: you are right!18:59
* jrichli goes to retest and re-review18:59
jrichliits gonna take awhile to be comfortable with that, me thinks!19:00
*** links has quit IRC19:13
*** silor has quit IRC19:17
tdasilvajrichli: congrats again! :)19:23
*** daemontool has quit IRC19:23
jrichlitdasilva: thanks!19:23
zaitcevhip hip Jamie!19:24
zaitcevBut now you have to become comfortable to review all the dusty crannies, like ACLs19:25
jrichlizaitcev: true.  I look forward to learning about the 'dusty crannies'!19:25
*** aswadr_ has quit IRC19:31
*** McMurlock1 has joined #openstack-swift19:33
redboಠ_ಠ19:40
notmynametimburke: (/cc joeljwright) looks like the main outstanding things for swiftclient have been merged19:53
joeljwrightnotmyname: I think so, will check through my review list20:01
notmynamejoeljwright: thanks. I'm cleaning up the changelog now. will push in a few minutes20:01
joeljwrightnotmyname: patch 184956 could do with landing20:09
patchbothttps://review.openstack.org/#/c/184956/ - python-swiftclient - Accept gzip-encoded API responses20:09
openstackgerritJohn Dickinson proposed openstack/python-swiftclient: authors/changelog updates for 3.1.0 release  https://review.openstack.org/36177520:10
joeljwrightbut I guess we can live without it20:11
notmynamejoeljwright: hmm...looks like it had already been approved20:11
joeljwrightneed to go and collect my wife from the station - be back for the meeting20:11
notmynameI'll ping mattoliverau about it in the meeting, but I want to have a commit SHA for release today20:13
*** diogogmt has joined #openstack-swift20:14
*** nikivi has quit IRC20:16
*** tongli_ has quit IRC20:16
*** mingyu has joined #openstack-swift20:23
openstackgerritTim Burke proposed openstack/python-swiftclient: Fix intermittent test failure  https://review.openstack.org/36153720:27
*** mingyu has quit IRC20:28
timurI noticed there's been a couple of times where I can't get the test artifact after a failure. Most recently here: https://review.openstack.org/#/c/363316/ (the cluster-swift-tox-func-ec). Is that likely a temporary CI issue?20:28
patchbotpatch 363316 - swift - Silence "Client disconnected" warnings on reads.20:28
*** nikivi has joined #openstack-swift20:29
*** Jeffrey4l__ has joined #openstack-swift20:34
*** Jeffrey4l_ has quit IRC20:35
notmynamedont' land https://review.openstack.org/#/c/361775/ quite yet. there's something on it I want to bring up in the meeting (reno)20:40
patchbotpatch 361775 - python-swiftclient - authors/changelog updates for 3.1.0 release20:40
kota_good morning20:54
mattoliverauMorning20:56
*** m_kazuhiro has joined #openstack-swift20:56
notmynamemattoliverau: summary from scrollback... can you look at https://review.openstack.org/#/c/184956/ ? you previously gave a +2, but it got rebased and a test added. it would be nice to have in a release, but if that happens, we need to land it in the next few hours20:57
patchbotpatch 184956 - python-swiftclient - Accept gzip-encoded API responses20:57
notmynamemeeting in 2 minutes in #openstack-meeting20:58
mattoliveraunotmyname: I can do that thing :) I'll will look post meeting21:00
notmynamethanks21:00
notmynameclayg: ping (meeting)21:01
openstackgerritTim Burke proposed openstack/swift: Include correct version in install-guide  https://review.openstack.org/36393821:10
*** thumpba has quit IRC21:41
timburkeon reno, i wonder if we could define custom section headers? i could see some value in being able to group features by target audience: here are new things available to you as a client, or a middleware writer, or an operator (or on the client side, as a CLI user vs as a developer)21:45
claygRE the term "cross-project" and esp. as it relates to "liasons" - i've just come to realize I misunderstood the meaning of "cross-project" for a long time21:46
claygI used to think it had something to with like Swift working with barbican to deliver some sweet OpenStack encrypted security cloud infrasture capabilities awesomesauce - but it turns out "cross-project" is not that at all21:47
notmynameclayg: +100021:48
clayg"cross-project" means "shit in OpenStack that's not about building cloud infrastrucutre software" like if you work on Hacking that's cross-project, or like the gate, or like reno, or a process for21:48
*** diogogmt has quit IRC21:48
clayg... I mean really my point is that I heard cross project I thought it ment OpenStack projects working together to deliver awsome cloud infrastrucutre - but it's really like EVERYTHING that makes up OpenStack that I don't pay attention to21:49
claygi'm like... literally the WORST possible at corss project :'(21:49
mattoliveraulol21:49
kota_ah, make sense. cross-project... that is becoming it seems working across projects to me21:50
kota_i meant "common things for all projects"21:51
mattoliverauI work with the stable PTL (he's on my team) so it might make sense if I step up and be the stable liason.. that way he can always poke me in person :)21:51
notmynamemattoliverau: if the past is any indicator, that will happen about zero times ;-)21:53
mattoliveraunotmyname: lol, great even better, but it'll look like we are participating :P21:53
*** chrichip has quit IRC21:54
clarkbclayg: I think its meant to be both... and I am sorry you don't feel that the work others do is important for building clouds. Who needs documentation right?21:54
*** chrichip has joined #openstack-swift21:55
claygnadeem: I'm not sure it's a given that having to manage two directories with a .git subdir will ruin the community?22:01
*** m_kazuhiro has quit IRC22:02
claygnadeem: I think most of us already commit and work in different places - including swift and python-swiftclient - if the split is the way that works best for the TC we should be open to that - it's still the right direction22:02
claygclarkb: I love documentation.  It feels good to write documentation on a new feature.  It's like cleaning your room - you put it off because it seems like a boring/annoying chore - but you know you should - and once you do - aww man - it feels so GOOOD!22:04
claygor fixing bugs in old docs - yum22:04
claygi just don't know how to do it anywhere besides the repos and code I pay attention to - and I suck at paying attention to documentation that other people wrote :'(22:05
clarkbyes I think that specific reason is why cross project includes "shit in openstack thats not about building cloud infrastructure"22:06
*** joeljwright has quit IRC22:06
claygyeah it's not a knock on anyone excep me - my understanding - my short coming22:06
claygadmiting you ahve a problem is like a first tep right!22:06
pdardeauclayg: it's a tough crowd :-)22:07
claygit's just i'm not sure i'm an island in this regard either - i think the term itself (granted partially aided by my own willful ignorance) has allowed me to misconstrue the nature of the criteques that have been built up over the years22:11
*** dmorita has quit IRC22:11
claygso... just like a public admission I'm working on my mental models here people - it's been eye opening22:12
*** mingyu has joined #openstack-swift22:12
clarkbwell I think its both things. It is helpling swift and barbican and whoever else work on neat features but also to help people do things like documentation and test their software and so on using a common set of tools and expectatiosn so we don't all have to relearn it every time we clone a new project22:12
notmynameI think my perspective is that there's other projects that provide functionality (eg barbican with crypto stuff), and in my mind they're all equal. eg barbican provides something, so does the -infra team22:14
*** asettle has joined #openstack-swift22:14
notmynameso working with barbican or keystone is just the same as working with docs or release or infra22:14
claygnotmyname: clarkb: gah - i feel like I disagree with both of those statements :P22:14
claygit's almost contrary to waht I'm trying to say22:14
clayglike for swift <=> barbican - we have API's mostly for that22:15
notmynamewe make sure that where we integrate to consume the functionality provided we do it well and in a way that doesn't break other people22:15
notmynameyeah, APIs are where it's at22:15
notmynameand as a member of openstack, we provide an api for storage and we want to work with other projects to make sure it works well22:15
claygand when we work on stuff to integrate and consume - that's... i mean it requires people across projects working - but that's - you don't get cross project credit for that :D22:15
claygyou get cross project creds if *everyone* benifits - never do something that helps you if you can do something that helps everyone22:16
*** mingyu has quit IRC22:16
claygi'm still working on this here - spitballin' - i may not have it nailed down yet22:16
clarkbone example that comes to mind is sorting out cinder volume multi attach. Thats api that has had to involve nova nd cinder because REST api is involved as well as libvirt among other things (as I understand it)22:17
claygi still think that's <10% of "cross-project"22:17
claygpeople *want* it to >50% of "cross-project" but mostly that only effects cinder & nova and it doesn't "count" - not anymore than swift working with zaqar or searchlight22:18
clarkbOh I don't care about percentages I just want openstack to be able to talk to each other so that we can fix problems22:18
clarkband historically we have sucked at that22:18
*** asettle has quit IRC22:19
*** dmorita has joined #openstack-swift22:21
claygclarkb: i ... don't really have a context to place that statement in :\22:21
clarkbone example is for a very long long time we said nova net is deprecated stop using it. But at the same time neutron was not implementing the features that nova net had that users wanted because nova and neutron never actually seemed to communicate about what was necessary to make nova net go away22:22
claygif nova and cinder want to "fix" multi-attach - they just do it - i really think it's worthwhile to seperate *that* as "cross-project" to whatever the *other* "cross-project" is22:22
clarkbits only been in the last cycle or two where we actually started having those discussions and now we might actually be able to delete nova net. Its amazing how quickly that happened once we started doing this22:22
clarkbbut without it we got nowhere just had ltos of angry devs and users22:22
clarkbclayg: history has shown that it just doesn't hapepn though. ANyways people like liasons hopeflly open up those doors and allow us to have those conversations allowing the just do it to happen22:23
claygwe're definately conflating some different things with the same term - and I think swift as a project and more imporantly as a community is FUCKING GREAT an fixing shit and getting shit done - you gotta real use-case problem - i don't care where you from - let's fix it22:23
clarkbeh22:24
clarkbI was told no :{22:24
clarkber :P22:24
clarkbwould you please please fix your logging? If I ask now does it count more?22:24
clarkbswift logs are almost unindexable because they don't care enough information along with them and they are not configurable to do so22:24
patchbotYou've given me 5 invalid commands within the last 60 seconds; I'm now ignoring you for 10 minutes.22:24
claygpatchbot: you are out of control bro!22:25
clarkbdefinitely keep the existing formats for backward compat (I had no problem with this before and continue to not have a problem with that) but it would be really ncie to be able to at least opt into a log format that is useful22:25
clarkbI don't even care if you use oslo logging22:25
claygclarkb: you know - i probably didn't put 2 + 2 together here - notmyname was saying something to me about logging - first he or I had ever heard of it - coming up recently?  I don't know all the details?22:25
clarkbI asked for this years ago22:25
clarkbbut I know other people have been banging the drum more. I mostly gave up years ago when I was told no22:26
claygclarkb: you know - honestly - I probably don't understand the problem or requirements really all that well22:28
clarkbThe big problems are missing timestamps in many places and where we do have timestamps they don't have subsecond resolution22:29
claygclarkb: but I will say that if it would really make a big difference to you - I'd love to take up the torch22:29
clayg... sorry - my first gut reaction to that is to fix the rsyslog formatting22:30
clarkbyes thats the other problem22:30
clarkbyou only support rsyslog22:30
clarkbplease support at least python logging, its in stdlib doesn't add anymore deps to swift and continues to support syslog22:30
clarkbthere are also at least two major formats in use. the apache common log format then the else format22:33
claygaren't proxy logs mostly in the apache format?  (with extra fields)22:34
*** klamath has quit IRC22:34
clarkbits a mix22:34
clarkbthings like authorizing user show up not in apache format, but then the top level GET is apache format22:35
clarkbI also think we have a lack of log levels as a result? I would have to go digging more22:36
claygclarkb: most folks already use the proxy_logging configuration to send just proxy access logs to a seperate logger - it's not clear to me how things that aren't really access log statements would be converted to the apache format22:36
clarkbbut log levels tend to be very useful for "oh something just broken let me grep/search/whatever for ERROR"22:36
clarkbat least the logs we end up with in the gate for swift seem to be levelless22:37
jrichlii suspect its the way we integrate our logging with devstack.22:38
clarkbclayg: apache has a non HTTP request type of format which swift doesn't seem to follow22:38
jrichliwhen i split out my logs in my saio, i can grep for ERROR in the error logfile22:38
clarkbfor error logs and such22:38
clarkbwhich means you can't use standard recipes for parsing eg apache logs to deal with swift logs22:39
clarkbI guess its specifically the proxy as the other services use the else format too22:40
claygjrichli: i was just looking at the code for "log_custom_handlers" - apparently you can configure swift logging to do basically anything you want22:42
claygclarkb: i agree with jrichli there's probably a gap with how devstack want's to configure logging - but irc is probably not the greatest forum to caputre requirements :'(22:43
clarkbsorry was mistaken the other services do appear to be pretty consistent bout doig apache's format its the proxy where we have the mix and things get annoying to deal with22:45
clayg*really*?  that's backwards as I would understand swift logging.  and outside of request logging to my knowledge there is no "format" that I know of other than how the logger format and syslog have been configured22:47
clarkbjust looking at the semi random sample of eg http://logs.openstack.org/38/363838/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a796242/logs/screen-s-account.txt.gz compared to the proxy log from the same thing22:48
clarkbthat file is all apache format22:48
clarkbhttp://logs.openstack.org/38/363838/2/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/a796242/logs/screen-s-proxy.txt.gz is not22:49
claygmost of the messages i'm seeing emitted from the proxy log there are coming from the keystone components :(22:50
claygwhat *are* those curl lines!?22:50
clayggod help us if someone that acctually deploys swift has logs like that :D22:51
clarkbthose are your defaults aiui22:51
clarkbas devstack isn't configuring logging its just saying go22:51
timburkeclayg: makes sense to me; non-proxy does very little logging other than requests (short of bugs like the one fixed in https://review.openstack.org/#/c/285754/)22:52
patchbotpatch 285754 - swift - Require account/container metadata be UTF-8 (MERGED)22:52
timburkeclayg: the curl lines are largely (entirely?) to do with keystone auth22:52
claygtimburke: yeah I see that - but the version we package doesn't make that much noise - and if it did - we'd figure out some way to shut it up ;)22:52
claygclarkb: this is where I think the conversation gets to turn back to what I was trying to say about 'cross-project' vs "cross-project" the problem is that keystone and swift need to get together and come up with a better interface to handle logs - someone just needs to make the devstack logging configuration better for swift + keystone22:54
* notmyname had stepped out and is back now22:54
claygI'm not sure how much *additional* work would be needed in devstack's swift configuration logging to meet all of your requirements - or maybe your complaint is that it "shouldn't" take anything "just say go"22:54
clarkbsure I think that is fine. But the last time I broached the subject it was met with our logs are perfect and we can't break our users (I never asked for that anyways) so no22:55
clarkbso its not just having keystone + swift + devsatck work together22:55
clarkbits being willing to have the conversation in the first place22:55
clarkbclayg: and yes ideally there would be zero config for that. swift logs should work sanely out of the box22:55
claygi'm not sure if i was in that earlier converstation - but it's quite possible - because I really think i've had a long term misunderstanding about the terms22:56
*** _JZ_ has quit IRC22:57
claygobviously we're somehow missing each other a little bit here - but i think i'm trying to suggest that if keystone + swift + devstack logging just met your requirements - you'd acctually be pretty damn happy22:57
clarkbbut this is probably why your users are asking you to use oslo logging because by default oslo logging has a sane setup out of the box (at least the projects that use it do). I don't want to get into the argument of whether ot not you should use oslo.logging this is solveable with and without doing so. But possible this si whwere some of that comes from22:57
claygclarkb: somehow when you tell me what my users want i feel like we're placing ourselves at odds :\22:59
clarkbclayg: you were the one that brought up people wanting oslo logging earlier... just saying that I think some of the motivation there is to have logs taht work out of the box22:59
claygas far as sane setup out of the box - i guess it depends who's box it's coming out of maybe?  idk.22:59
clarkbnot necessarily that I or $user really care if you use oslo logging23:00
clarkband thats being used as a proxy for make logs better and if we focused on making logs better maybe the other fight goes away I dunno23:00
notmynameclarkb: I'm not sure if what you're saying is that there's something about swift's logs that are broken or that the swift team is unwilling to change anything about logging23:01
clarkbnotmyname: both23:01
claygrofl23:02
clarkbthe logs are very hard to use to track down problems (I think the links above are decent examples of that)23:02
claygclarkb: I hope we've put in a bunch of effort over the years to make you this jaded!  otherwise I'd feel that's fairly counter productive.  :D23:02
clarkband I have asked multiple times in the past grantedits been yaers since the last occasion for swift to please fix it23:02
claygclarkb: i mean... again... i'm not sure that's super producive - but you're welcome to vent a little bit - I'm even *sorry* you feel that way23:03
notmynameclarkb: but I can't fix "it's hard to find problems". http://docs.openstack.org/developer/swift/logs.html23:03
clarkbnotmyname: please see scrollback I gave many examples of where things are bad23:03
claygclarkb: but bro... like do you have a bug we can reference with the use-case and requirements?23:03
*** Trixboxer has quit IRC23:04
clarkbclayg: I am sure there is likely a bug from a few years ago that can be drug up. I don't know what it is off the top of my head23:04
clarkbI had to get neutronand glance and a few others to work on these things too and there was a big bug iirc but swift was not interested.23:04
claygclarkb: I do hope we can find it (i'm looking) because I think it cuts to heart of my point about 'cross-project' vs. "cross-project"23:05
clarkbnotmyname: specifically only syslog is supported (please support other writers python logging is good at this), please do subsecond timestamp resolution (you would get this for free with python logging), use apache logging format consistently so that existing tools can be used to parse those logs23:05
claygInstead of "logging sucks for me" we hear "you need to change your log format" and instead of "let me help you configure your system to meet your requirements" we say "i'm not going to break my users to fix it so the default logging configuration meets your alone needs"23:06
clarkbor I guess apache logging format isn't a hard requirement just be consistent23:06
clarkbclayg: as I said I have no interest in breaking your existing users23:06
clarkbI think we cuold get by with making it opt in23:07
notmynamepython logging and syslog are orthogonal. we actually use python's logging module to send stuff to syslog23:07
claygclarkb: i know - we're still talking past each other - it's *amazing* people are able to communicate on IRC at all with out some prior human experience with each other :D23:07
clarkbnotmyname: right let me clarify. Allow me to configure python logging using its configuration format. Last I checked you hardcoded syslog so I can't use other handlers and loggers23:07
claygclarkb: there's a way you can configure custom handlers23:07
claygclarkb: you could configure syslog to ignore (or not write) logs from swift or confugre swift to dump to /dev/null or w/e - or you can configure syslog to do whatever you want23:08
clarkbclayg: but I can't edit the format either right? which is what the loggers do iirc23:08
*** nikivi has quit IRC23:09
claygeither way - MY point - YOU shouldn't have to do anything - that's not "cross-project" - that's 'cross-project' - if swift was good at "cross-project" we'd fix devstack to meet your requirements :D23:09
*** Trixboxer has joined #openstack-swift23:09
claygclarkb: see I thought handlers had formatters :D23:09
*** McMurlock1 has quit IRC23:09
clayghandler.setFormatter seems like a thing23:10
clarkbI think the flow is logger -> formatter -> handler23:11
clarkbso you'd need to be able to create formatters and set them on handlers23:11
clarkbah its actually logger -> handler via the handle method which runs the formaters23:12
*** mingyu has joined #openstack-swift23:12
claygclarkb: ok, so we don't have to write any code in IRC here ;) - I think you had like three things somewhere that would make a great requirements for fixing swift's logging in your environment23:13
claygthere it is -> [23:04]       clarkb | notmyname: specifically only syslog is supported (please support other writers python logging is good at this), please do subsecond timestamp  resolution (you would get this for free with python logging), use apache logging format consistently so that existing tools can be used to parse those logs23:14
*** jamielennox|away is now known as jamielennox23:14
*** mingyu has quit IRC23:17
*** manous has joined #openstack-swift23:17
*** manous has quit IRC23:22
*** jamielennox is now known as jamielennox|away23:22
claygclarkb: hey man, look - even if nothing else - THANK YOU - for stepping up and raising your voice - those logs are *truly* terrible -> https://bugs.launchpad.net/swift/+bug/161907323:23
openstackLaunchpad bug 1619073 in OpenStack Object Storage (swift) "Swift logs in devstack are terrible" [Undecided,New]23:23
*** manous has joined #openstack-swift23:23
clarkbclayg: and tahnk you for being willing to listen23:23
*** jamielennox|away is now known as jamielennox23:28
*** manous has quit IRC23:28
*** kei_yama has joined #openstack-swift23:31
*** chrichip has quit IRC23:36
*** jamielennox is now known as jamielennox|away23:36
*** manous_ has joined #openstack-swift23:37
*** chrichip has joined #openstack-swift23:37
*** hosanai has joined #openstack-swift23:38
*** ChanServ sets mode: +v hosanai23:38
*** chsc has quit IRC23:39
*** chrichip has quit IRC23:42
*** chrichip has joined #openstack-swift23:43
*** manous_ has quit IRC23:44
*** manous_ has joined #openstack-swift23:44
*** manous_ has quit IRC23:45
*** diogogmt has joined #openstack-swift23:46
*** nadeem has quit IRC23:51
*** Suyi_ has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!