Friday, 2017-08-04

timburkeit's quiet again00:05
timburkei guess that happens when both notmyname *and* clayg are on vacation00:05
*** ukaynar has quit IRC00:08
*** alenavolk has joined #openstack-swift00:09
*** ukaynar has joined #openstack-swift00:11
*** alenavolk has quit IRC00:11
*** ukaynar has quit IRC00:11
*** ukaynar has joined #openstack-swift00:12
*** alenavolk has joined #openstack-swift00:13
*** catintheroof has quit IRC00:14
*** itlinux has joined #openstack-swift00:16
*** Sukhdev_ has quit IRC00:20
*** alenavolk has quit IRC00:22
*** alenavolk has joined #openstack-swift00:25
*** ukaynar has quit IRC00:26
mattoliveraulol, now we know who causes all the noise ;)00:29
*** kiennt has joined #openstack-swift00:39
*** shuyingya has joined #openstack-swift00:39
*** shuyingya has quit IRC00:44
*** itlinux has quit IRC00:57
*** itlinux has joined #openstack-swift01:02
*** frank_young has joined #openstack-swift01:13
*** frank_young has quit IRC01:17
*** alenavolk has quit IRC01:20
jrichlimattoliverau, timburke: fine I'll make a little noise!  I still have not yet congratulated mattoliverau on his new job - so let me do that now.  Congratulations!  Best of luck.01:31
*** shuyingya has joined #openstack-swift01:31
*** qwebirc31697 has joined #openstack-swift01:31
*** shuyingya has quit IRC01:32
*** shuyingya has joined #openstack-swift01:32
mattoliveraujrichli: thanks :) doing the exciting online security training now, which is so much fun.. and welcome the break ;)01:32
jrichliwell, I am in Chicago at my hotel bar listening to some live music, and doing some work :-)01:34
*** mat128 has joined #openstack-swift01:35
mattoliveraujrichli: sounds nice :)01:35
*** JimCheung has quit IRC01:38
*** JimCheung has joined #openstack-swift01:38
*** JimCheung has quit IRC01:43
kota_good morning01:52
*** qwebirc31697 has quit IRC01:56
*** JimCheung has joined #openstack-swift01:59
*** frank_young has joined #openstack-swift02:02
*** JimCheung has quit IRC02:04
*** vint_bra has joined #openstack-swift02:06
*** frank_young has quit IRC02:07
*** mat128 has quit IRC02:10
*** mat128 has joined #openstack-swift02:11
*** http_GK1wmSU has joined #openstack-swift02:14
mattoliveraukota_: morning02:16
kota_mattoliverau: o/02:17
*** http_GK1wmSU has left #openstack-swift02:17
kota_mattoliverau: it looks like you're still on training time?02:17
mattoliveraukota_: lol, yup :)02:18
*** mat128 has quit IRC02:21
*** vint_bra has quit IRC02:27
*** alenavolk has joined #openstack-swift02:42
*** mingyu has joined #openstack-swift02:51
*** mingyu has quit IRC03:01
*** mingyu has joined #openstack-swift03:01
*** alenavolk has quit IRC03:02
*** mingyu has quit IRC03:04
*** mat128 has joined #openstack-swift03:10
*** frank_young has joined #openstack-swift03:11
*** frank_young has quit IRC03:15
*** openstackgerrit has joined #openstack-swift03:25
openstackgerrityanghuichan proposed openstack/swift master: Replacing six.iter usages substituting .items(), .keys() and .values() in place of six.iteritems/dict.iteritems, six.iterkeys/dict.iterkeys and six.itervalues/itervalues respectively.  https://review.openstack.org/49073003:25
*** frank_young has joined #openstack-swift03:25
*** mat128 has quit IRC03:25
*** frank_young has quit IRC03:30
*** mattoliverau_ has joined #openstack-swift03:32
*** mattoliverau has quit IRC03:33
*** mattoliverau_ is now known as mattoliverau03:33
*** ChanServ sets mode: +v mattoliverau03:33
*** mat128 has joined #openstack-swift03:37
*** winggundamth has joined #openstack-swift03:39
openstackgerritDebo Zhang proposed openstack/swift master: Update links in README  https://review.openstack.org/49073603:42
*** mat128 has quit IRC03:43
*** gkadam has joined #openstack-swift03:43
*** Sukhdev has joined #openstack-swift04:01
*** links has joined #openstack-swift04:03
*** klrmn has quit IRC04:07
*** alenavolk has joined #openstack-swift04:23
*** frank_young has joined #openstack-swift04:29
*** Sukhdev has quit IRC04:30
*** frank_young has quit IRC04:33
*** two_tired has joined #openstack-swift04:40
*** frank_young has joined #openstack-swift04:40
*** tovin07_ has joined #openstack-swift04:41
*** kiennt has quit IRC04:42
*** kiennt has joined #openstack-swift04:42
*** t2y has joined #openstack-swift05:07
t2yhi, i'm investigating swift golang implementation, written in https://www.swiftstack.com/blog/2016/10/17/whats-going-swift/05:10
t2yi found golang implementation branch in https://github.com/openstack/swift/commits/feature/hummingbird05:11
t2ybut, it seems no history since Nov 23, 201605:12
*** JimCheung has joined #openstack-swift05:12
t2ydoes anyone know what status of swift golang implementation is?05:13
*** JimCheung has quit IRC05:17
*** tovin07_ has quit IRC05:18
*** tovin07_ has joined #openstack-swift05:19
*** psachin has joined #openstack-swift05:29
*** kiennt has quit IRC05:41
*** JimCheung has joined #openstack-swift05:47
*** JimCheung has quit IRC05:52
*** frank_young has quit IRC05:54
*** cshastri has joined #openstack-swift06:03
*** frank_young has joined #openstack-swift06:04
*** frank_young has quit IRC06:09
*** kiennt has joined #openstack-swift06:17
*** alenavolk has quit IRC06:21
*** two_tired has quit IRC06:23
openstackgerrityanghuichan proposed openstack/swift master: Replacing six.iter usages substituting .items(), .keys() and .values() in place of six.iteritems/dict.iteritems, six.iterkeys/dict.iterkeys and six.itervalues/itervalues respectively.  https://review.openstack.org/49073006:24
*** rcernin has joined #openstack-swift06:30
*** itlinux has quit IRC06:30
*** frank_young has joined #openstack-swift06:36
*** hseipp has joined #openstack-swift06:37
openstackgerrityanghuichan proposed openstack/swift master: Replacing six.iter/dict.iter usages  https://review.openstack.org/49073006:57
*** hseipp has quit IRC07:02
*** hseipp has joined #openstack-swift07:04
*** geaaru has joined #openstack-swift07:04
*** mingyu has joined #openstack-swift07:05
*** tesseract has joined #openstack-swift07:16
openstackgerritShangXiao proposed openstack/swift master: [Trivialfix]Fix typos in swift  https://review.openstack.org/49077507:26
*** winggundamth has quit IRC07:27
*** pcaruana has joined #openstack-swift07:38
*** http_GK1wmSU has joined #openstack-swift07:44
*** http_GK1wmSU has left #openstack-swift07:46
openstackgerritShangXiao proposed openstack/swift master: [Trivialfix]Fix typos in swift  https://review.openstack.org/49077507:50
*** winggundamth has joined #openstack-swift07:50
*** RayLei has joined #openstack-swift08:03
rcerninping swift guys, how can we create temp_url for uploading the overcloud-swift-rings from overcloud to undercloud manually?08:11
*** ChubYann has quit IRC08:17
*** early has quit IRC08:24
*** early has joined #openstack-swift08:31
*** SkyRocknRoll has joined #openstack-swift08:35
*** JimCheung has joined #openstack-swift08:48
*** JimCheung has quit IRC08:52
*** SkyRocknRoll has quit IRC08:59
psachinrcernin: temp_url for upload ring? Don't think temp_url is desiged for that. We use temp_url for downloading object09:11
rcerninpsachin: yes for PUT method09:26
*** t2y has left #openstack-swift09:26
rcerninpsachin: raised BZ for that https://bugzilla.redhat.com/show_bug.cgi?id=147806009:27
openstackbugzilla.redhat.com bug 1478060 in openstack-swift "Can't upload swift-rings to swift container." [Medium,New] - Assigned to thiago09:27
rcerninpsachin: we are doing: curl --insecure --silent -X PUT "${swift_ring_put_tempurl}" --write-out "%{http_code}" --data-binary @swift-rings.tar.gz09:27
* psachin checking09:27
psachinrcernin: Any idea what's value of %{http_code}?09:40
*** RayLei has quit IRC09:40
rcerninpsachin: thats what curl returns09:40
rcerninpsachin: we dont have any output from deployment, but doing it manually with extracted temp_url from logs, we have 401, temporary url is invalid09:40
psachinrcernin: I also get 401 on dedicated swift setup. Trying to find out a way to upload09:42
psachinrcernin: It should be 201 according to BZ description09:48
rcerninyes09:49
rcerninanything else is exit 109:49
*** oshritf has joined #openstack-swift09:50
*** RayLei has joined #openstack-swift09:58
*** tovin07_ has quit IRC10:05
psachinrcernin: for PUT to work tmpurl should be creatd to allow PUT request. -- http://paste.openstack.org/show/617524/10:07
rcerninpsachin: you replace %{http_code}10:08
rcerninpsachin: that is curl variable, that should output the response code.10:08
rcernincan you do the same with --write-out '%{http_code}'10:09
psachinrcernin: I replaces with http code to be expected. I can do that as well. Guess you need to look at how the tmepurl was created10:09
rcerninpsachin: also note your temp_url_expires= Mon Aug 14 22:05:20 CEST 2017 which is great, thats something we never get, we get expiration in the past.10:09
psachinreplaced*10:10
rcerninthat is not replaced by bash variable.10:10
rcerninpsachin: its curl variable, and curl captures output with --silent there is no output at all, exepct the --write-out %{http_code}10:10
*** gabor_antal has quit IRC10:10
rcerninthat http_code is grabbed from the curl output, if you replace it before calling it you will always get 201.10:11
rcerninyou can try --write-out "hello world"10:11
psachinrcernin: Yes10:11
psachinrcernin: I don;t think so10:11
psachinrcernin: by curl's manual it should be http_code10:12
psachinrcernin: http://paste.openstack.org/show/617525/10:12
rcerninpsachin: why are you exporting the http_code?10:12
rcerninpsachin: that %{http_code} is not bash thing, I though this is the curl variable. so if the response from server is 401 then curl writes out the 40110:13
*** oshritf has quit IRC10:13
rcerninthats achieved by the --write-out.10:13
psachinrcernin: The point being you need to look at 1. how tempurl was created 2. it should have enough time until it expires10:13
rcerninyeah10:13
rcerninthought I can use swift-temp-url or somthing to craft this temp_url manually.10:15
psachinrcernin: You can. `swift post -m "Temp-URL-Key: mykey" && swift tempurl PUT 1800 https://undercloud_publicURL:port/v1/AUTH_0ae8e2f716e6437cbdbdead30cded831/overcloud-swift-rings/swift-rings.tar.gz mykey`10:17
*** openstackgerrit has quit IRC10:18
rcerninpsachin: well I need to find then in t-h-t how the temp_url is generated.10:19
rcerninpsachin: It works it just generates the temp_url with expiration date in past, and curl fails with invalid temp url.10:19
rcerninI can upload the swift-rings to swift manually.10:19
rcerninand I believe that PUT command will work.10:20
rcerninpsachin: also to be able to do this on overcloud you would need stackrc there, since we upload them to undercloud swift.10:23
rcerninI am not sure about the reason why we are using curl instead of swift.10:24
psachinrcernin: Because during update we don't was to give full access to swift. tempurl are best for restricted access. Just a guess10:25
*** mingyu has quit IRC10:30
rcerninpsachin: ok so10:32
rcerninpsachin: swift tempurl GET 60 /v1/AUTH_539c6444fb85461da7dc3f25f87d12c0/overcloud-swift-rings <key>10:32
rcerninpsachin: do you know from which service or what exactly would be the <key> here?10:32
rcerninwell it doesnt matter, anything I put there it will generate a temp_url:10:33
rcernin/v1/AUTH_539c6444fb85461da7dc3f25f87d12c0/overcloud-swift-rings?temp_url_sig=a4a48c5629f1e67f902ea8adc771755ba4aacb98&temp_url_expires=150184286210:33
rcerninwell it doesnt matter, anything I put there it will generate a temp_url:10:34
rcerninand 60 is the #s it is valid for.10:34
linkspsachin, its called in ./puppet/post.j2.yaml10:35
psachinrcernin: Yep. I see that swift swift-ring-update.yaml has that code. but I'm not aware of the flow10:36
psachinrcernin: http://git.openstack.org/cgit/openstack/tripleo-heat-templates/tree/extraconfig/tasks?id=9477c875414efd57e0d5b9161f6629f6cb2ec9ac10:36
rcerninyeah the input_values.10:37
rcerninbut lamost there:)10:37
rcerninalmost*10:37
linkspsachin, i think the above j2 file is converted to yaml & used . in overcloud.j2.yaml  you will find 'type: OS::TripleO::PostDeploySteps'10:37
rcernindoes seems to check for Meta Temp-Url-Key: with swift stat10:38
rcerninand if its set it takes the key from there.10:39
rcerninpsachin: will go and try this: http://paste.openstack.org/show/617527/10:42
*** RayLei has quit IRC10:43
psachinrcernin: Replace GET with PUT when creating temurl10:43
rcerninah ok10:43
rcerninthanks10:43
linkspsachin, rcernin i think it comes from 'mistral environment-get overcloud| grep SwiftRingGetTempurl'10:48
linksnot sure were does that come from :) . i think probably something in workbook .10:49
psachinlinks: https://github.com/openstack/tripleo-common/blob/master/workbooks/swift_rings_backup.yaml10:54
*** winggundamth has quit IRC10:56
*** kiennt has quit IRC11:06
*** mingyu has joined #openstack-swift11:31
*** mingyu has quit IRC11:35
*** http_GK1wmSU has joined #openstack-swift11:39
*** http_GK1wmSU has left #openstack-swift11:41
rcerninpsachin: links: http://paste.openstack.org/show/617531/11:51
*** JimCheung has joined #openstack-swift12:24
*** mingyu has joined #openstack-swift12:27
*** JimCheung has quit IRC12:28
*** baojg has joined #openstack-swift12:31
*** gkadam has quit IRC12:31
*** baojg has quit IRC12:32
*** shuyingya has quit IRC12:33
*** shuyingya has joined #openstack-swift12:56
*** shuyingya has quit IRC13:00
*** mingyu has quit IRC13:11
*** frank_young has quit IRC13:13
*** mingyu has joined #openstack-swift13:14
*** catintheroof has joined #openstack-swift13:17
*** frank_young has joined #openstack-swift13:23
*** frank_young has quit IRC13:27
*** baojg has joined #openstack-swift13:32
*** lucasxu has joined #openstack-swift13:34
*** vint_bra has joined #openstack-swift13:35
*** baojg has quit IRC13:37
*** mat128 has joined #openstack-swift13:41
*** pax_rhos has joined #openstack-swift13:46
*** vint_bra has quit IRC13:46
pax_rhoshello13:46
pax_rhosare there any gui clients for linux?13:46
*** jistr is now known as jistr|mtg13:46
pax_rhosunfortunately, cyberduck doesn't work even via wine13:46
*** Dinesh_Bhor has quit IRC13:47
*** mat128 has quit IRC13:55
*** vint_bra has joined #openstack-swift13:57
*** alenavolk has joined #openstack-swift14:00
*** vint_bra has quit IRC14:06
*** vint_bra has joined #openstack-swift14:09
*** links has quit IRC14:12
*** smatzek has joined #openstack-swift14:13
*** frank_young has joined #openstack-swift14:22
*** alenavolk has quit IRC14:23
*** alenavolk has joined #openstack-swift14:27
*** frank_young has quit IRC14:29
*** frank_young has joined #openstack-swift14:35
*** jistr|mtg is now known as jistr15:01
*** mahatic has quit IRC15:04
*** vint_bra has quit IRC15:06
*** mahatic has joined #openstack-swift15:06
*** alenavolk has quit IRC15:10
*** vint_bra has joined #openstack-swift15:10
*** shuyingya has joined #openstack-swift15:12
*** baojg has joined #openstack-swift15:14
*** rcernin has quit IRC15:14
*** lucasxu has quit IRC15:15
*** shuyingya has quit IRC15:16
*** klrmn has joined #openstack-swift15:21
*** alenavolk has joined #openstack-swift15:22
*** jaosorior has quit IRC15:23
*** chsc has joined #openstack-swift15:25
*** baojg has quit IRC15:42
*** baojg has joined #openstack-swift15:45
timburkegood morning15:51
*** lucasxu has joined #openstack-swift16:00
timburkepax_rhos: fwiw, the company i work for has a free GUI client at https://www.swiftstack.com/downloads that's available as rpm or deb16:00
*** cshastri has quit IRC16:00
*** tonanhngo has joined #openstack-swift16:03
*** chsc has quit IRC16:03
*** psachin has quit IRC16:07
*** pcaruana has quit IRC16:10
*** chsc has joined #openstack-swift16:11
*** chsc has joined #openstack-swift16:11
*** klrmn has quit IRC16:12
*** _glb has joined #openstack-swift16:13
notmynameFYI, the Pike deadline for a Swift release is August 21. That's basically two weeks away. Bug fixes and quality-of-life patches should likely take priority over big new features16:16
notmynameI added the date to https://wiki.openstack.org/wiki/Swift/PriorityReviews16:16
*** itlinux has joined #openstack-swift16:17
*** hseipp has quit IRC16:26
*** JimCheung has joined #openstack-swift16:30
*** joeljwright has joined #openstack-swift16:31
*** ChanServ sets mode: +v joeljwright16:31
joeljwrighttimburke: you about?16:32
*** frank_yo_ has joined #openstack-swift16:32
timburkejoeljwright: yup16:32
joeljwrightjust spotted your comments on my slo patch16:32
joeljwrightwanted to talk http status codes (oh the excitement!)16:32
timburkesure16:33
joeljwrightI see your point about 40916:33
*** frank_young has quit IRC16:33
joeljwrightbut the only way this data could fail to validate on download is die to corruption on disk after upload16:34
joeljwrightdoes kinda feel like a 'swift screwed up' situation, not something the client should be trying to fix16:34
timburketrue. but i guess the question in my mind is, should the client retry? 5xx, most clients (should) retry; 4xx, clients should stop and think a bit16:36
joeljwrightthat's a fair point16:37
timburkeiiuc, that was the reasoning for the 409 when the segments have changed out from under us16:37
joeljwrightyeah, that makes sense16:38
joeljwright409 -> make a new manifest16:38
joeljwrightbut this isn't data changing, it's on disk corruption16:38
timburkei think the object-server would quarantine during the read... i wonder what the proxy would see...16:39
joeljwrightis it even possible for validated upload to get back to the proxy corrupt?16:40
joeljwrightI assume it must be16:40
joeljwrightor at least, there must be a window of opportunity16:40
timburkebut i think there may be another possibility: we inadvertently break our parsing. manifest was validated on upload, still reflects that uploaded state, but the proxy got more picky about formats16:41
joeljwrightgood point16:42
timburkeclearly a bug that we should try to avoid, and clearly something swift needs to fix, but... how would we want swift to respond...16:42
timburkemaybe a 500 *is* reasonable. client may retry, but so what?16:43
joeljwrightI'm really torn16:44
joeljwrightI like your point about 409 giving the client a reason to think before retrying16:45
joeljwrightthanks for the time, let me think about it some more16:45
*** mingyu has quit IRC16:46
*** baojg has quit IRC16:49
*** gkadam has joined #openstack-swift16:58
*** joeljwright has quit IRC17:02
*** hseipp has joined #openstack-swift17:09
*** klrmn has joined #openstack-swift17:12
*** frank_yo_ has quit IRC17:14
*** frank_young has joined #openstack-swift17:24
*** openstackstatus has quit IRC17:27
*** openstack has joined #openstack-swift17:29
*** openstackstatus has joined #openstack-swift17:29
*** ChanServ sets mode: +v openstackstatus17:29
*** hseipp has quit IRC17:30
*** alenavolk has quit IRC17:43
*** geaaru has quit IRC17:44
*** mingyu has joined #openstack-swift17:47
*** mingyu has quit IRC17:51
*** itlinux has quit IRC18:03
*** itlinux has joined #openstack-swift18:05
*** JimCheung has quit IRC18:09
*** thurloat has quit IRC18:18
*** thurloat has joined #openstack-swift18:23
*** openstackstatus has quit IRC18:26
*** openstack has joined #openstack-swift18:28
*** openstackstatus has joined #openstack-swift18:29
*** ChanServ sets mode: +v openstackstatus18:29
*** mingyu has joined #openstack-swift19:05
*** mingyu has quit IRC19:10
*** gkadam has quit IRC19:16
*** frank_young has joined #openstack-swift19:22
*** frank_young has quit IRC19:27
*** itlinux has quit IRC19:49
*** ChubYann has joined #openstack-swift19:58
tdasilvatimburke: just tested out the gui client, pretty neat!20:15
*** frank_young has joined #openstack-swift20:24
*** frank_young has quit IRC20:29
-openstackstatus- NOTICE: Gerrit is being restarted to pick up CSS changes and should be back momentarily20:37
*** smatzek has quit IRC20:50
*** lucasxu has quit IRC20:51
*** mingyu has joined #openstack-swift20:54
*** openstackgerrit has joined #openstack-swift20:57
openstackgerritRomain LE DISEZ proposed openstack/swift master: Replace replication_one_per_device by custom count  https://review.openstack.org/39078120:57
*** mingyu has quit IRC20:59
*** frank_young has joined #openstack-swift21:14
*** itlinux has joined #openstack-swift21:15
*** frank_young has quit IRC21:19
*** frank_young has joined #openstack-swift22:13
*** frank_young has quit IRC22:18
*** vint_bra has quit IRC22:25
*** mingyu has joined #openstack-swift22:43
*** mingyu has quit IRC22:47
*** catintheroof has quit IRC22:56
*** chsc has quit IRC23:19

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!