Wednesday, 2018-02-21

*** openstackstatus has quit IRC00:12
*** openstackstatus has joined #openstack-swift00:15
*** ChanServ sets mode: +v openstackstatus00:15
*** yashmurty has joined #openstack-swift00:37
*** tosky has quit IRC00:38
*** d0ugal_ has joined #openstack-swift00:48
*** tovin07_ has joined #openstack-swift00:51
notmynameI have a conflict for the swift meeting tomorrow. can we push it back 30 minutes? start at 2130UTC00:55
notmynamewe don't have anything added to the agenda other than PTG prep (same as last week), so we could even leave it as a "come by and ask questions if you have them"00:55
portanteprobably old news, but https://betanews.com/2018/02/19/samsung-pm1643-ssd/ 30 TB SSD from Samsung00:56
portante"the new PM1643 drive features random read and write speeds of up to 400,000 IOPS and 50,000 IOPS, and sequential read and write speeds of up to 2,100MB/s and 1,700 MB/s, respectively"00:57
* portante slicks back to logging work ...00:58
notmynameportante: internal comments this morning on that were "..and see the backplane catch fire trying to [put 80 in a chassis]" and "like driving a Ferrari Semi-Trailer on the freeway during rush hours…"01:01
portanteha!01:01
portanteclassic01:01
DHEthat drive is so cool... especially since I won't be able to afford to heat my house after buying one01:14
portantesoon we'll have furnaces constructed to cool storage by heating our house01:15
*** rcernin has quit IRC01:36
*** rcernin has joined #openstack-swift01:36
*** rcernin has quit IRC01:42
*** rcernin has joined #openstack-swift01:43
kota_tdasilva: yeah, coverage and running logs. indeed.01:45
kota_tdasilva: it seems like the new zuul job in our repo lost the script to bring the test logs in the snnipet.01:46
kota_fyi, older legacy devstack gate job shows me the logs and confs...01:46
*** m_kazuhiro has joined #openstack-swift01:47
m_kazuhirogood morning01:48
mattoliveraukota_, m_kazuhiro: morning01:50
kota_mattoliverau, m_kazuhiro: o/01:50
mattoliverauwhen are you guys leaving for the PTG?01:50
mattoliverauI leave late Saturday night.01:50
*** rcernin has quit IRC01:53
m_kazuhiromattoliverau: kota_: morning! We will leave japan at sunday noon.01:53
*** rcernin has joined #openstack-swift01:53
mattoliveraudo you guys still get there Sunday?01:54
kota_mattoliverau: yup02:14
kota_but the Sunday night IIRC.02:14
kota_around 8 p.m. ~ 9 p.m.02:15
mattoliveraunice, I guess your not travelling as far north as me :)02:16
*** tovin07_ has quit IRC02:23
*** tovin07_ has joined #openstack-swift02:27
*** links has joined #openstack-swift02:49
tdasilvamattoliverau: when do you arrive there?02:54
*** SkyRocknRoll has joined #openstack-swift03:09
*** SkyRocknRoll has joined #openstack-swift03:09
*** gkadam has quit IRC03:14
*** gkadam has joined #openstack-swift03:15
mattoliverautdasilva: Sunday afternoon sometime.03:27
mattoliverauFound fairly direct flights so on ly 26 hours in transit03:27
tdasilvaheh, only...nice!03:29
*** kei_yama has quit IRC03:43
*** yashmurty has quit IRC03:55
*** yashmurty has joined #openstack-swift03:55
*** kei_yama has joined #openstack-swift04:02
*** cshastri has joined #openstack-swift04:07
*** d0ugal__ has joined #openstack-swift04:13
*** d0ugal_ has quit IRC04:15
*** yashmurt_ has joined #openstack-swift04:17
*** yashmurty has quit IRC04:21
*** tovin07_ has quit IRC04:23
thurloatseeing a lot of ":No authentication middleware authorized request yet. Skipping staticweb" in proxy logs after upgrading an older proxy server. staticweb is placed near the end after all the auth plugins. could this be caused by other objects being read publicly with .r* ACLs outside of staticweb?04:23
*** tovin07_ has joined #openstack-swift04:23
thurloatit's log level warning, which threw me for a loop when i looked into it. seems like it's quite loudly announcing that it's choosing not to paricipate in the request.04:24
*** yashmurt_ has quit IRC04:28
*** psachin`` has joined #openstack-swift04:34
kota_thurloat: https://github.com/openstack/swift/commit/a7af80249704:36
kota_thurloot: it looks like expected behavior, staticweb can be brittle if the request is not authed so the staticweb middleware prevents to show any meaningful web info (e.g. contents listing).04:39
kota_perhaps, the log message can be changed as a debug if it would be too annoying on the public readable containers tho.04:39
thurloatyeah there's a lot of public ACL reads for this swift deployment04:40
thurloatI understand the reasoning behind the behaviour, and bailing out. Does definitely sound like a debug message though, how often to the other middlewares warn that they're not going to do anything to a request?04:42
thurloatheh, "slo: WARN: not a large object request"04:42
timburke_i'm debating about that though... i'm guessing that the reason behind using warning was that the env *not* having a swift.authorize key is a sign of a mis-configured pipeline... even (especially?) for a publicly accessible container, shouldn't the appropriate auth middleware be setting an authorize callback?04:43
timburke_what's the pipeline look like?04:43
kota_the warning seems indeed to prevent the mis-configuration in the pipeline, to me.04:44
thurloatbasically stock, and staticweb is sitting between versioned_writes and proxy-logging04:44
timburke_(that said, i'm all for making sure we log at appropriate levels)04:44
timburke_i wonder if it should be left of versioned_writes... that guy *definitely* makes some pre-authed requests, including container listings04:45
thurloathave some custom authentication middleware for CDN stuff, but can confirm that's working and setting authorized for internal CDN edge node pushes04:45
timburke_what kinds of requests tend to trip the logging?04:45
timburke_DELETEs to containers with versioing enabled, by any chance?04:46
thurloatI'm seeing it near HEADs04:46
timburke_(or PUTs, for that matter...)04:46
timburke_any swift source set?04:46
thurloatI don't think any users are using versioning04:46
thurloatlet me tail some more logs, i'll let you know04:47
thurloatah, my compatriot already squelched the logs in the config. I have some historical that I can look back on04:47
timburke_might be worth grepping for txn ids that are affected, keep an eye out for subrequests...04:48
thurloatseeing it on deletes04:48
thurloatand PUTs04:49
thurloatinteresting!04:49
thurloatand it seems to be mostly from UA CloudBerry, so I bet they're using versioning04:50
kota_hmmm.... i'm wondering why swift.authorize is not in env even it's allowed to access via acl04:50
*** m_kazuhiro has quit IRC04:50
thurloatI'll try moving staticweb 1 to the left and see if it's any cleaner04:50
* kota_ is looking at around tempauth/keystoneauth and swift.authorize vs swift.clean_acl04:51
timburke_that's a good question... even pre-authed requests should have it set: https://github.com/openstack/swift/blob/master/swift/common/wsgi.py#L1210-L121104:53
timburke_(so there goes my theory...)04:53
thurloatyea, and shifting it didn't change anything for the logs.04:53
thurloatcloudberry requests still triggering those logs04:53
*** m_kazuhiro has joined #openstack-swift04:54
thurloatthanks timburke_ , found the culprit04:58
thurloatwas actually CDN seed requests not setting authorized value04:59
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Fix a typo in swift/common/swob.py  https://review.openstack.org/54648805:00
timburke_oh, interesting...05:03
*** psachin`` has quit IRC05:05
timburke_could probably have that mware set it to `lambda req: None` like make_pre_authed_env does05:05
timburke_(for appropriate requests, of course)05:05
thurloatyeah that's what I'm about to do. historically, we just let it pass by for approved requests and delayed auth decision enabled the request to get served i suppose05:09
*** gyee has quit IRC05:27
*** pmannidi has quit IRC06:04
*** psachin`` has joined #openstack-swift06:22
*** d0ugal__ has quit IRC06:27
kota_it looks like the next meeting will start at 2130 UTC?06:31
*** d0ugal__ has joined #openstack-swift06:33
*** silor has joined #openstack-swift06:41
*** silor has quit IRC06:48
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Imported Translations from Zanata  https://review.openstack.org/54552306:50
*** d0ugal__ has quit IRC06:52
*** rcernin has quit IRC07:21
*** hoonetorg has quit IRC07:46
*** hseipp has joined #openstack-swift07:47
*** pcaruana has joined #openstack-swift07:47
openstackgerritMerged openstack/swift master: Fix a typo in swift/common/swob.py  https://review.openstack.org/54648807:49
*** geaaru has joined #openstack-swift07:52
*** psachin`` has quit IRC07:54
*** d0ugal has joined #openstack-swift07:55
*** d0ugal has quit IRC07:55
*** d0ugal has joined #openstack-swift07:55
*** m_kazuhiro has quit IRC07:56
*** psachin has joined #openstack-swift07:57
*** hoonetorg has joined #openstack-swift08:00
*** d0ugal has quit IRC08:00
*** d0ugal has joined #openstack-swift08:01
*** d0ugal has quit IRC08:06
*** d0ugal has joined #openstack-swift08:15
*** d0ugal has quit IRC08:29
*** cebruns has joined #openstack-swift08:30
*** cebruns_ has quit IRC08:31
*** tesseract has joined #openstack-swift08:34
*** kei_yama has quit IRC08:35
*** kei_yama has joined #openstack-swift08:35
*** psachin has quit IRC08:40
*** d0ugal has joined #openstack-swift08:48
*** psachin has joined #openstack-swift08:51
*** kei_yama has quit IRC08:52
*** cbartz has joined #openstack-swift08:55
*** d0ugal has quit IRC08:58
*** d0ugal has joined #openstack-swift09:08
*** hseipp has quit IRC09:09
*** hseipp has joined #openstack-swift09:12
*** armaan has joined #openstack-swift09:47
*** notmyname has quit IRC09:48
*** PagliaccisCloud has quit IRC09:50
*** PagliaccisCloud has joined #openstack-swift09:50
*** notmyname has joined #openstack-swift09:51
*** ChanServ sets mode: +v notmyname09:51
*** pcaruana has quit IRC10:05
*** d0ugal has quit IRC10:06
*** d0ugal_ has joined #openstack-swift10:06
*** tovin07_ has quit IRC10:10
*** d0ugal_ has quit IRC10:11
*** d0ugal__ has joined #openstack-swift10:17
*** pcaruana has joined #openstack-swift10:20
acolesnotmyname: ack 2130 meeting start10:35
*** d0ugal__ has quit IRC10:54
*** d0ugal has joined #openstack-swift10:54
*** d0ugal has quit IRC10:54
*** d0ugal has joined #openstack-swift10:54
*** ^andrea^ has quit IRC11:04
*** tosky has joined #openstack-swift11:06
*** pcaruana has quit IRC11:19
*** d0ugal has quit IRC11:23
*** d0ugal has joined #openstack-swift11:31
*** pcaruana has joined #openstack-swift11:33
*** tosky has quit IRC11:34
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Move shrinking shard ranges to a 'shrinking' state  https://review.openstack.org/54226111:35
openstackgerritAlistair Coles proposed openstack/swift feature/deep: refactor get_shard_usage to re-use get_shard_ranges  https://review.openstack.org/54226211:35
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Retry creating shard containers until successful  https://review.openstack.org/54236611:35
*** armaan has quit IRC12:00
*** d0ugal has quit IRC12:06
*** d0ugal has joined #openstack-swift12:10
*** armaan has joined #openstack-swift12:17
*** mgagne has quit IRC12:19
*** d0ugal has quit IRC12:20
*** d34dh0r53 has quit IRC12:20
*** dhellmann has quit IRC12:22
*** kazsh has quit IRC12:23
*** d0ugal has joined #openstack-swift12:23
*** kazsh has joined #openstack-swift12:25
*** d34dh0r53 has joined #openstack-swift12:26
*** dhellmann has joined #openstack-swift12:30
*** d0ugal has quit IRC12:34
*** mgagne has joined #openstack-swift12:36
*** mgagne is now known as Guest2094612:36
*** persia has joined #openstack-swift12:47
*** persia has left #openstack-swift12:49
*** tosky has joined #openstack-swift12:52
*** cshastri has quit IRC12:59
*** Supun has joined #openstack-swift13:06
*** d0ugal has joined #openstack-swift13:14
*** d0ugal_ has joined #openstack-swift13:19
*** d0ugal has quit IRC13:20
*** d0ugal_ has quit IRC13:25
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Move shrinking shard ranges to a 'shrinking' state  https://review.openstack.org/54226113:26
openstackgerritAlistair Coles proposed openstack/swift feature/deep: refactor get_shard_usage to re-use get_shard_ranges  https://review.openstack.org/54226213:26
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Retry creating shard containers until successful  https://review.openstack.org/54236613:26
*** d0ugal_ has joined #openstack-swift13:39
*** d0ugal_ has quit IRC13:48
*** d0ugal has joined #openstack-swift13:48
*** psachin has quit IRC13:54
*** d0ugal has quit IRC13:58
*** d0ugal has joined #openstack-swift13:59
*** d0ugal has quit IRC14:04
*** d0ugal has joined #openstack-swift14:22
*** cshastri has joined #openstack-swift14:22
*** links has quit IRC14:29
*** psachin has joined #openstack-swift14:37
*** d0ugal has quit IRC14:49
*** d0ugal has joined #openstack-swift14:58
*** cshastri has quit IRC15:02
*** psachin has quit IRC15:08
*** psachin has joined #openstack-swift15:10
*** psachin has quit IRC15:26
*** itlinux has joined #openstack-swift15:26
*** itlinux has quit IRC15:26
*** itlinux has joined #openstack-swift15:26
*** psachin has joined #openstack-swift15:28
*** psachin has quit IRC15:29
*** saint_ has quit IRC15:51
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Make sharding state more abstract  https://review.openstack.org/54642415:52
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Make update_sharding_info() a broker method  https://review.openstack.org/54642515:52
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Shrink final shard range to root container  https://review.openstack.org/53652015:52
thurloattimburke_: i'm confused on the proxy middleware ordering again, shouldn't keystoneauth (which appears well before staticweb) be injecting a 'swift.authorize' in all cases (minus override?)16:08
*** silor has joined #openstack-swift16:12
thurloatdouble nevermind, apparently i'm short on caffiene today.16:13
*** pcaruana has quit IRC16:16
*** openstackgerrit has quit IRC16:19
*** silor has quit IRC16:20
*** silor has joined #openstack-swift16:21
*** kukacz_ has joined #openstack-swift16:26
*** kukacz_ is now known as kukacz16:29
acolesmattoliverau: I've updated the sharding-replication etherpad https://etherpad.openstack.org/p/deep-containers-replication16:49
*** gyee has joined #openstack-swift17:04
*** cbartz has quit IRC17:07
timburke_good morning17:33
notmynamegood morning17:36
*** Supun has quit IRC17:38
*** itlinux has quit IRC17:46
*** hseipp has quit IRC17:54
*** geaaru has quit IRC18:11
*** tesseract has quit IRC18:25
*** SkyRocknRoll has quit IRC18:29
acolesnotmyname: I added a brief topic for today's meeting18:32
tdasilvameetings starts at 21:30 today, right?18:34
acolestdasilva: yes that's what agenda says18:34
acolesand that's when I'm showing up ;)18:35
* tdasilva should have checked agenda18:35
*** tosky has quit IRC18:49
*** openstackgerrit has joined #openstack-swift18:57
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Make update_sharding_info() a broker method  https://review.openstack.org/54642518:57
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Shrink final shard range to root container  https://review.openstack.org/53652018:57
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Make sharded shards report zero object stats  https://review.openstack.org/54674118:57
notmynameacoles: ok, thanks19:05
*** itlinux has joined #openstack-swift19:19
tdasilvatimburke_, kota_ any plans for a new swift3 release anytime soon?19:31
timburke_the plan of record was to have 1.12 be the final release of swift3, so we wouldn't have a moving target as we try to bring s3api back into swift19:37
tdasilvatimburke_: ack, that's what i was trying to remember.19:38
timburke_given that i've still got 6 or so open patches against swift3 (several of which *i'm* packaging for my own releases), i'm not sure that was/is the *best* plan, but that was our thinking in Denver as i recall19:38
tdasilvatimburke_: yeah, s3api dev has been slow...we should probably revisit that in dublin19:39
timburke_but fwiw, there have only been like 3 patches merged to swift3 since 1.12, all to do with testing stuff, no material changes to compatibility19:39
*** armaan has quit IRC19:43
*** tosky has joined #openstack-swift20:02
*** silor has quit IRC20:11
*** psachin has joined #openstack-swift20:11
*** armaan has joined #openstack-swift20:18
*** psachin has quit IRC20:33
*** psachin has joined #openstack-swift20:39
*** psachin has quit IRC20:52
*** psachin has joined #openstack-swift20:56
*** openstackgerrit has quit IRC21:03
*** armaan has quit IRC21:04
*** armaan has joined #openstack-swift21:08
*** m_kazuhiro has joined #openstack-swift21:13
notmynamethanks for being flexible. we'll start an abbreviated swift meeting in about 15 minutes21:14
m_kazuhirogood morning21:14
mattoliveraumorning21:19
timburke_o/21:20
kota_good morning21:28
acoleskota_: o/21:28
*** ukaynar_ has joined #openstack-swift21:29
kota_acoles: o.21:29
kota_o/21:29
acoleshehe21:29
acolesanimation21:29
notmynameall right. let's get started in #openstack-meeting21:30
kota_tdasilva, timburke_:  i don't think we should release a new swift3 at this time. The reason is what timburke_ said, we merged just a few patches on the testing staff.21:30
*** ukaynar_ has quit IRC21:31
claygpong21:31
*** ukaynar has joined #openstack-swift21:46
tdasilvakota_: ack, thanks!21:48
*** psachin has quit IRC21:50
*** m_kazuhiro has quit IRC21:58
acolesmattoliverau: I won't merge anything til tomorrow my time so please leave any comments if you get chance22:05
acolesmattoliverau: also I brain-dumped some reasoning here https://etherpad.openstack.org/p/deep-containers-replication22:08
acolesg'night22:08
*** armaan has quit IRC22:14
*** armaan has joined #openstack-swift22:14
mattoliverauacoles: cheers, a d good night22:20
*** itlinux has quit IRC22:29
*** rcernin has joined #openstack-swift22:32
*** openstackgerrit has joined #openstack-swift22:59
openstackgerritGerard Gine proposed openstack/swift master: Fix usage of multiple accounts in functional tests  https://review.openstack.org/54643322:59
*** gerardgine has joined #openstack-swift23:24
clayggerardgine: nah, it's pretty quiet23:30
openstackgerritTim Burke proposed openstack/swift master: Stop logging overlapping tracebacks  https://review.openstack.org/54680823:34
openstackgerritGerard Gine proposed openstack/swift master: Fix usage of multiple accounts in functional tests  https://review.openstack.org/54643323:36
*** kei_yama has joined #openstack-swift23:37

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!