Tuesday, 2016-08-02

*** Suyi_ has quit IRC00:01
*** hosanai has joined #openstack-swift00:01
*** ChanServ sets mode: +v hosanai00:01
*** StraubTW has joined #openstack-swift00:13
*** onovy has quit IRC00:23
*** cdelatte has quit IRC00:23
*** onovy has joined #openstack-swift00:23
*** admin6 has quit IRC00:34
*** StraubTW has quit IRC00:37
*** rcoleman has joined #openstack-swift00:38
*** NM has quit IRC00:40
*** admin6 has joined #openstack-swift00:44
openstackgerritShashirekha Gundur proposed openstack/swift: update manpage for -P / --policy-name option  https://review.openstack.org/34972500:47
*** kaleta has quit IRC00:48
*** jamielennox is now known as jamielennox|away00:49
*** kaleta has joined #openstack-swift00:49
kota_goor morning00:51
*** m_kazuhiro has joined #openstack-swift00:52
kota_solomon: try via  http://fqdn.hostname:8080/container/obj with Authorization: AWS header.00:53
kota_solomon: swift3 doesn't require swift prefixes of /version/account (e.g. /v1/AUTH_test)00:54
kota_not sure what does /swift mean in your path.00:54
kota_though00:54
openstackgerritShashirekha Gundur proposed openstack/swift: update manpage for -P / --policy-name option  https://review.openstack.org/34972500:55
timburkekota_: i agree, it seemed odd. the swift stat result seemed to indicate that the *account* really was 'v1' though -- weird00:55
kota_hi timburke :-)00:56
timburkegood morning kota_!00:56
kota_timburke: btw, I think I can take a time to look at versioned_write history mode today, is it ready for review?00:57
timburkeyay! pretty sure. actually, it's been a bit since i thought very hard about the code :-/ patch 21492200:58
patchbottimburke: https://review.openstack.org/#/c/214922/ - swift - Add "history" mode to versioned_writes middleware00:58
kota_ok, I'll try it00:58
timburkethanks00:59
mattoliveraukota_: morning00:59
kota_mattolivearu: good morning!00:59
zaitcevtimburke, kota_: the crazy symptom that confuse you are consistent with using Ceph RGW to emulate Swift. Indeed the account is "v1". For all of them.01:01
zaitcev(which means that this guy is beyond any help)01:02
zaitcev((because he did not realize that if he wants S3, RGW has a native one))01:02
*** jamielennox|away is now known as jamielennox01:03
kota_hello zaitcev, sounds so curious.01:03
*** nadeem has joined #openstack-swift01:03
*** NM has joined #openstack-swift01:06
*** klrmn has quit IRC01:11
*** NM has quit IRC01:23
*** nadeem has quit IRC01:36
*** rcoleman has quit IRC02:03
*** klrmn has joined #openstack-swift02:07
jrichlitimur clayg: thanks!02:26
*** jamielennox is now known as jamielennox|away02:28
*** amitkqed has quit IRC02:30
*** amitkqed has joined #openstack-swift02:30
*** jamielennox|away is now known as jamielennox02:42
*** dmorita has quit IRC02:51
*** dmorita has joined #openstack-swift02:53
*** asettle has joined #openstack-swift03:07
*** dmorita has quit IRC03:08
*** dmorita has joined #openstack-swift03:12
*** asettle has quit IRC03:13
*** dmorita has quit IRC03:16
*** janonymous has joined #openstack-swift03:21
*** _JZ_ has quit IRC03:27
*** brnelson has quit IRC03:30
*** brnelson has joined #openstack-swift03:30
*** calebb has joined #openstack-swift03:34
*** bill_az has quit IRC03:46
*** chsc has quit IRC03:54
*** janonymous has quit IRC04:04
calebbis it possible to upload an object to swift using a URL instead of a filename?04:10
*** links has joined #openstack-swift04:36
*** klrmn has quit IRC04:39
*** psachin has joined #openstack-swift04:40
*** janonymous has joined #openstack-swift04:45
*** siva_krish has joined #openstack-swift04:50
*** nadeem has joined #openstack-swift04:56
*** flwang1 has quit IRC05:06
*** SkyRocknRoll has joined #openstack-swift05:12
*** ppai has joined #openstack-swift05:20
*** nadeem has quit IRC05:27
*** ppai has quit IRC05:34
*** ChubYann has quit IRC05:35
*** siva_krish has quit IRC05:37
*** derekjhyang has quit IRC05:42
*** ppai has joined #openstack-swift05:48
*** flwang1 has joined #openstack-swift05:52
*** maestropandy has joined #openstack-swift05:53
*** flwang1 has quit IRC06:03
*** lok has joined #openstack-swift06:38
*** ppai has quit IRC06:42
*** tesseract- has joined #openstack-swift06:43
*** rledisez has joined #openstack-swift06:51
*** KriskK has joined #openstack-swift07:01
*** ppai has joined #openstack-swift07:09
*** zul has quit IRC07:09
*** trananhkma has joined #openstack-swift07:17
*** joelinux73 has quit IRC07:17
*** geaaru has joined #openstack-swift07:18
*** oshritf has joined #openstack-swift07:19
*** cschwede has joined #openstack-swift07:19
*** ChanServ sets mode: +v cschwede07:19
*** ppai has quit IRC07:22
*** zul has joined #openstack-swift07:24
openstackgerritMatthew Oliver proposed openstack/swift: update swift-dispersion manpages to add policy-name  https://review.openstack.org/34972507:31
mattoliverau^^ just tidied up a commit message07:32
*** ppai has joined #openstack-swift07:35
*** janonymous has quit IRC07:44
*** silor has joined #openstack-swift07:50
*** admin6_ has joined #openstack-swift07:53
*** silor has quit IRC07:55
*** silor has joined #openstack-swift07:56
*** admin6__ has joined #openstack-swift07:56
*** admin6_ has quit IRC07:57
*** janonymous has joined #openstack-swift07:59
*** KriskK has quit IRC08:03
*** silor has quit IRC08:05
*** silor has joined #openstack-swift08:05
*** fbo has joined #openstack-swift08:08
openstackgerritDavanum Srinivas (dims) proposed openstack/swift: [WIP] Testing latest u-c  https://review.openstack.org/31844108:10
*** jamielennox is now known as jamielennox|away08:10
*** vinsh has quit IRC08:14
*** vinsh has joined #openstack-swift08:15
*** cppforlife_ has quit IRC08:19
*** sileht has quit IRC08:19
*** kong has quit IRC08:19
*** DuncanT has quit IRC08:19
*** DuncanT has joined #openstack-swift08:20
*** psachin has quit IRC08:20
*** sileht has joined #openstack-swift08:21
*** cppforlife__ has joined #openstack-swift08:21
*** kong_ has joined #openstack-swift08:21
*** cppforlife__ has quit IRC08:21
*** cppforlife__ has joined #openstack-swift08:21
*** kong_ has quit IRC08:21
*** kong_ has joined #openstack-swift08:21
*** kong_ is now known as kong08:21
*** psachin has joined #openstack-swift08:22
*** cppforlife__ is now known as cppforlife_08:22
*** silor1 has joined #openstack-swift08:24
*** silor has quit IRC08:25
*** silor1 is now known as silor08:25
*** links has quit IRC08:26
*** greghaynes has quit IRC08:29
*** admin6__ has quit IRC08:39
*** asettle has joined #openstack-swift08:40
*** links has joined #openstack-swift08:41
*** greghaynes has joined #openstack-swift08:41
*** Shashikant86 has joined #openstack-swift08:47
*** daemontool_ has joined #openstack-swift08:51
*** daemontool__ has quit IRC08:54
*** acoles_ is now known as acoles09:07
*** mvk has quit IRC09:21
*** Shashikant86 has quit IRC09:25
*** ellen has quit IRC09:26
*** links has quit IRC09:28
*** ppai has quit IRC09:31
acolesnotmyname: fwiw I questioned 'is not None' in same way as you, then came to same conclusion as jrichli - better to error an empty string than ignore.09:32
*** KriskK has joined #openstack-swift09:34
*** Shashikant86 has joined #openstack-swift09:38
*** links has joined #openstack-swift09:40
*** ppai has joined #openstack-swift09:45
*** mvk has joined #openstack-swift09:48
openstackgerritAlistair Coles proposed openstack/swift: Fix repeated OPTIONS in swift-dispersion-report manpage  https://review.openstack.org/34991009:56
openstackgerritAlistair Coles proposed openstack/swift: Fix link to docs from swift-dispersion manpages  https://review.openstack.org/34991510:02
*** dmorita has joined #openstack-swift10:09
*** dmorita has quit IRC10:13
kota_hi, acoles thank you for great comments on patch 304382!10:15
patchbotkota_: https://review.openstack.org/#/c/304382/ - swift - Add Pros/Cons table for global cluster consideration10:15
kota_acoles: i noticed but I didn't have a time to look at your suggestion today, I will take a time to do that tommorow10:15
acoleskota_: hi. NP, I hope they are useful.10:16
*** asettle has quit IRC10:28
*** KriskK has quit IRC10:40
*** asettle has joined #openstack-swift10:40
*** asettle has quit IRC10:43
*** Shashikant86 has quit IRC10:44
*** asettle has joined #openstack-swift10:44
openstackgerritMerged openstack/swift: update swift-dispersion manpages to add policy-name  https://review.openstack.org/34972510:46
*** hosanai has quit IRC10:47
*** m_kazuhiro has quit IRC10:51
*** NM has joined #openstack-swift10:56
*** NM has quit IRC10:57
*** NM has joined #openstack-swift10:57
*** ppai has quit IRC10:58
*** lok has quit IRC11:03
*** ppai has joined #openstack-swift11:11
*** Shashikant86 has joined #openstack-swift11:12
acolestimburke: LOL I just got round to reading this "was getting annoyed at needing to send the same value twice, so I found a way to send it three times instead"11:22
*** cbartz has joined #openstack-swift11:24
openstackgerritAlistair Coles proposed openstack/swift: Add test that authorize callback cannot violate constraints  https://review.openstack.org/34950111:27
*** NM has quit IRC11:29
openstackgerritzheng yin proposed openstack/swift: Add log error  https://review.openstack.org/34994211:30
*** mahatic has quit IRC11:31
*** ppai has quit IRC11:34
*** ppai has joined #openstack-swift11:48
*** admin6_ has joined #openstack-swift12:05
*** trananhkma has quit IRC12:10
*** kei_yama has quit IRC12:24
*** zul has quit IRC12:32
*** zul has joined #openstack-swift12:32
*** Shashikant86 has quit IRC12:33
*** klamath has joined #openstack-swift12:43
*** links has quit IRC12:48
*** maestropandy has left #openstack-swift12:53
*** Shashikant86 has joined #openstack-swift12:55
*** bsdkurt has quit IRC13:00
*** admin6_ has left #openstack-swift13:03
openstackgerritzheng yin proposed openstack/swift: Add log error  https://review.openstack.org/34994213:05
*** ppai has quit IRC13:06
*** ppai has joined #openstack-swift13:19
*** links has joined #openstack-swift13:21
*** StraubTW has joined #openstack-swift13:26
*** StraubTW has quit IRC13:26
*** StraubTW has joined #openstack-swift13:27
*** vinsh has quit IRC13:34
*** psachin has quit IRC13:35
*** cdelatte has joined #openstack-swift13:43
*** Shashikant86 has quit IRC13:47
*** thumpba has quit IRC13:52
*** thumpba has joined #openstack-swift13:53
*** Shashikant86 has joined #openstack-swift13:55
*** Shashikant86 has quit IRC13:57
*** thumpba has quit IRC13:57
*** diogogmt has quit IRC14:02
*** bill_az has joined #openstack-swift14:02
*** ametts has joined #openstack-swift14:04
*** vint_bra has joined #openstack-swift14:10
*** links has quit IRC14:12
*** vinsh has joined #openstack-swift14:19
oshritfacoles: https://review.openstack.org/#/c/348495/ looks good! Makes sense to me. More coding hands needed? will be happy to join14:21
patchbotoshritf: patch 348495 - swift - Make container sync copy SLO manifests14:21
*** _JZ_ has joined #openstack-swift14:22
*** SkyRocknRoll has quit IRC14:22
acolesoshritf: it needs unit tests, for the change to SLO, to verify that container_sync middleware sets the environ flag etc.14:22
acolesoshritf: BTW, I am looking at patch 210099 again :)14:23
patchbotacoles: https://review.openstack.org/#/c/210099/ - swift - Add process level concurrency to container sync14:23
acolesoshritf: appreciate any help with 34849514:23
oshritf  acoles: will look on adding more container sync + SLO unit tests14:26
acolesoshritf: thanks!14:26
*** asettle has quit IRC14:28
oshritf acoles: Your comment about moving internal methods check to logs helped me spot a huge bug with not reseting forked variables14:28
acolesoshritf: is that where you added self.stats.clear() at line 276?14:30
oshritfacoles: exactly14:31
acolesoshritf: making assertion inside mocked methods always makes me nervous, much better to stash values and then make assertions after the code under test has completed. or in this case use the FakeLogger to "stash" values.14:31
*** asettle has joined #openstack-swift14:32
oshritfacoles: I agree. In this case values that were checked were ok, but values not checked were not.. log contained all values, so was easy to spot :)14:34
oshritfacoles: Could you clarify in test/unit/container/test_sync.py, Line 118: tests needed for the new config option?14:40
*** siva_krish has joined #openstack-swift14:44
oshritfacoles:oh, tests for the 'processes' config option... ok14:49
*** psachin has joined #openstack-swift14:52
*** oshritf has quit IRC14:53
*** asettle has quit IRC14:53
*** asettle has joined #openstack-swift14:54
*** diogogmt has joined #openstack-swift14:58
*** psachin has quit IRC15:00
*** siva_krish has quit IRC15:02
notmynamegood morning15:07
zaitcevSitting through a presentation that says, in part, "taks an epics like to masquerade as stories (they are by nature deceptive creatures)".15:12
*** klrmn has joined #openstack-swift15:18
*** ppai has quit IRC15:21
notmynameemails read, new revision TC governance resolution proposed, time to take the kids to summer camp and go to the office. be back online in a while15:25
*** thumpba has joined #openstack-swift15:32
*** thumpba has quit IRC15:32
*** thumpba has joined #openstack-swift15:33
*** nadeem has joined #openstack-swift15:55
*** StraubTW has quit IRC15:56
*** StraubTW has joined #openstack-swift15:58
*** chsc has joined #openstack-swift16:07
*** chsc has quit IRC16:13
*** asettle has quit IRC16:16
*** cbartz has quit IRC16:17
*** SkyRocknRoll has joined #openstack-swift16:25
*** StraubTW has quit IRC16:28
*** StraubTW has joined #openstack-swift16:29
*** rledisez has quit IRC16:29
timburkegood morning16:33
notmynamehello again16:37
*** thumpba has quit IRC16:44
*** thumpba has joined #openstack-swift16:45
notmyname(1) spend hours crafting a TC governance resolution proposal with the help of several other people too (2) propose resolution (3) two weeks later it's put on the TC meeting agenda, so the morning of that meeting you start getting a bunch of comments from people16:49
*** dmorita has joined #openstack-swift16:49
*** thumpba has quit IRC16:49
*** corvus is now known as jeblair16:51
*** tesseract- has quit IRC16:51
*** dmorita has quit IRC16:54
*** nadeem has quit IRC16:55
*** dmorita has joined #openstack-swift16:55
*** chsc has joined #openstack-swift16:57
*** chlong has quit IRC16:58
*** nadeem has joined #openstack-swift17:01
*** mvk has quit IRC17:06
*** chlong has joined #openstack-swift17:11
*** ametts has quit IRC17:12
*** thumpba has joined #openstack-swift17:13
*** ametts has joined #openstack-swift17:13
*** SkyRocknRoll has quit IRC17:18
*** thumpba_ has joined #openstack-swift17:22
*** sanchitmalhotra has quit IRC17:23
*** sanchitmalhotra has joined #openstack-swift17:24
*** ukaynar has joined #openstack-swift17:25
*** thumpba has quit IRC17:25
*** tqtran has joined #openstack-swift17:31
*** maestropandy has joined #openstack-swift17:36
notmynamepdardeau: acoles: thank you for your comments on the governance resolution17:42
*** maestropandy has left #openstack-swift17:43
notmynamelol, in my twitter feed right now, someone is talking about not spending time on things that don't matter and using this test to figure out which things those are: "is this thing clearly more important than learning how to play mario bros with my feet?"17:44
*** geaaru has quit IRC17:55
*** mvk has joined #openstack-swift17:58
*** jamielennox|away is now known as jamielennox18:01
*** dmorita has quit IRC18:03
*** dmorita has joined #openstack-swift18:03
*** daemontool_ has quit IRC18:12
*** siva_krish has joined #openstack-swift18:14
*** siva_krish has quit IRC18:17
*** acoles is now known as acoles_18:18
*** ChubYann has joined #openstack-swift18:18
*** siva_krish has joined #openstack-swift18:21
*** flwang1 has joined #openstack-swift18:28
*** siva_krish has quit IRC18:28
*** siva_krish has joined #openstack-swift18:30
*** siva_krish has quit IRC18:33
*** ukaynar has quit IRC18:33
*** ukaynar has joined #openstack-swift18:38
*** Suyi_ has joined #openstack-swift18:39
*** silor has quit IRC18:52
*** maestropandy1 has joined #openstack-swift18:58
*** maestropandy1 has left #openstack-swift18:59
*** ukaynar has quit IRC19:00
*** asettle has joined #openstack-swift19:03
*** fifieldt has quit IRC19:07
*** lcurtis has joined #openstack-swift19:08
*** dmorita has quit IRC19:12
*** fifieldt has joined #openstack-swift19:18
*** maestropandy has joined #openstack-swift19:19
*** maestropandy has left #openstack-swift19:19
CaioBrentanohey all, what is the best strategy to delete a container with millions of small objects? I created a script to bulk delete while the container is not empty. What do you suggest?19:24
tqtrannoob question incoming: using the swift cli, is there a way to access a different /account/container ? or would i have to use curl for that?19:26
tqtranlets say accounta was given access to acountb/sharedcontainer19:27
CaioBrentanotqtran: yes, you can use --os-storage-url parameter19:27
tqtranah thanks!19:27
CaioBrentanotqtran with --os-auth-token ;)19:27
tqtranok, perfect, thats exactly what i was looking for.19:27
CaioBrentanotqtran :)19:28
*** dmorita has joined #openstack-swift19:29
notmynameCaioBrentano: yep, that's about it. there's not a shortcut19:30
*** dmorita has quit IRC19:33
*** maestropandy1 has joined #openstack-swift19:33
*** maestropandy1 has left #openstack-swift19:33
CaioBrentanonotmyname sad!! :( "bulk post" to set expire date is a stupid idea ?19:33
notmynameCaioBrentano: hmm..that's interesting. really it's a question of balancing the load you put on the cluster vs the time you need it to take (with a little consideration given to how consistent you need your utilization to be)19:34
notmynameCaioBrentano: eg if the container is not being used at all any more, you could download it, write a script to go to the right object server drives and delete each object. you've got to be careful about hashes.pkl and asyncs though19:35
notmynameCaioBrentano: or you could set the expiry time for each object (be sure you have fast post instead of post as copy, or you'll be doing a lot more work). the expirer will eventually delete all the objects, but it will likely take a while19:36
notmynameCaioBrentano: or you could just blast out a bunch of delete requests yourself and deal with that load on the cluster19:36
*** cebruns has joined #openstack-swift19:36
CaioBrentanonotmyname the container is not being used. But I dont have guts to do that... go to the right object server! =P19:37
CaioBrentanonotmyname my first idea was set the expiry for each object... but I thought that dozens of bulk deletes would be better than millions of POSTs19:39
notmynameit will be the same amount of work in the end, right?19:40
*** maestropandy has joined #openstack-swift19:42
tdasilvaif you have a very large container (millions of objects) and you set them all to expire later, aren' t you creating yet another huge 'hidden' container to track object expiration? sure both will be deleted at some point, but seems like you are putting uncessary load on the system19:42
notmynamehint: the answer is yet19:43
notmyname;-)19:43
notmyname*yes19:43
CaioBrentanonotmyname you mean "amount of work" for swift cluster or for my script?19:44
notmynamefor the cluster19:44
*** ouchkernel has joined #openstack-swift19:47
*** maestropandy has left #openstack-swift19:47
CaioBrentanonotmyname My guess would be that is better set expire date and let the cluster handle itself! But tdasilva got a point!19:49
CaioBrentanonow I think bulk delete is better!19:49
notmynameyeah, that's likely. be sure to use the new concurrency with bulk operations and perhaps spread the work out on your client across different workers19:50
CaioBrentanonew concurrency?19:54
*** dmorita has joined #openstack-swift19:55
notmynameCaioBrentano: https://github.com/openstack/swift/blob/master/CHANGELOG#L34-L4119:55
timburkepatch 311817 -- yeah, what notmyname said19:55
patchbottimburke: https://review.openstack.org/#/c/311817/ - swift - Allow concurrent bulk deletes (MERGED)19:55
notmynameoh, boy. here we go (tc meeting). for those of you not wanting to re-open ulcers, I'll give a recap after19:59
CaioBrentanocurl http://my.swift.cluster/info | python -m json.tool | grep version19:59
CaioBrentano"version": "2.7.0"19:59
CaioBrentano:(19:59
notmynamewell seems that your next step is to upgrade then ;-)20:00
CaioBrentanonotmyname it's not easy to keep updated with swift! lol! thanks for all! ;)20:05
*** flwang1 has quit IRC20:18
*** manous has joined #openstack-swift20:33
*** daemontool has joined #openstack-swift20:35
*** Jeffrey4l has quit IRC20:35
*** openstackgerrit_ has joined #openstack-swift20:35
*** Jeffrey4l has joined #openstack-swift20:35
*** openstackgerrit_ has quit IRC20:36
*** KriskK has joined #openstack-swift20:42
*** daemontool has quit IRC20:42
*** StraubTW has quit IRC20:43
*** StraubTW has joined #openstack-swift20:43
*** ametts has quit IRC20:44
ahaleso reading the TC meeting, they are advocating the openstack object store ships without an actual object server? thats hilarious20:49
jrichlidoesn't seem to be going well ...20:49
* notmyname has a bit of adrenaline pumping right now *breath*breath*20:51
tdasilvanotmyname: don't rage quit20:51
jrichlihugs all around!20:52
notmynameI need to be offline for a while20:55
notmynametdasilva: I promise I'll come back20:55
tdasilva:)20:55
tdasilvai'm out of here too20:55
ahaleman its hard to resist being rude in there20:55
jrichliyou all did good20:55
*** notmyname has quit IRC20:55
ahalehas annegentle even considered the use of projects.py instead of having it in yaml ?! whats with the new shiny :(20:56
*** thumpba_ has quit IRC21:01
*** siva_krish has joined #openstack-swift21:03
*** siva_krish has quit IRC21:07
*** KriskK has quit IRC21:07
*** flwang1 has joined #openstack-swift21:34
mattoliverauMorning22:03
pdardeaumattoliverau: morning22:03
*** asettle has quit IRC22:10
*** StraubTW has quit IRC22:13
*** lcurtis has quit IRC22:29
*** nadeem has quit IRC22:36
*** chsc has quit IRC22:37
*** delattec has joined #openstack-swift22:48
*** david-lyle has quit IRC22:50
*** cdelatte has quit IRC22:51
*** david-lyle has joined #openstack-swift22:51
*** klamath has quit IRC22:55
*** vinsh has quit IRC23:05
openstackgerritTim Burke proposed openstack/python-swiftclient: Add --json option to `swift capabilities` / `swift info`  https://review.openstack.org/27638223:18
*** kei_yama has joined #openstack-swift23:20
*** bill_az has quit IRC23:44
zaitcevAt least nobody asked for --xml version yet23:55

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!