Tuesday, 2018-02-13

*** tovin07 has joined #openstack-swift00:47
*** tovin07_ has joined #openstack-swift00:51
*** openstackgerrit has quit IRC01:03
*** gyee has quit IRC01:07
*** itlinux has joined #openstack-swift01:15
*** kei_yama has quit IRC01:29
*** m_kazuhiro has joined #openstack-swift01:37
m_kazuhirogood morning01:38
*** itlinux has quit IRC01:43
*** itlinux has joined #openstack-swift01:56
*** Sukhdev has quit IRC02:10
kota_good morning02:15
*** itlinux has quit IRC02:22
*** itlinux has joined #openstack-swift02:27
*** bkopilov has quit IRC02:34
*** tovin07 has quit IRC02:35
*** links has joined #openstack-swift02:35
*** kei_yama has joined #openstack-swift02:36
mattoliveraukota_, m_kazuhiro: morning02:38
kota_mattoliverau: o/02:40
*** itlinux has quit IRC02:40
*** ukaynar has quit IRC02:47
m_kazuhiromattoliverau: kota_: morning! I updated patch 538171 , if you have time, please review it.02:47
patchbothttps://review.openstack.org/#/c/538171/ - swift - Refactor expirer's task round robin implementation02:47
*** ukaynar has joined #openstack-swift02:47
*** ukaynar has quit IRC02:52
*** tovin07_ has quit IRC02:56
*** SkyRocknRoll has joined #openstack-swift03:00
*** Supun has joined #openstack-swift03:21
*** kei_yama has quit IRC03:39
*** bkopilov has joined #openstack-swift03:49
*** Supun has quit IRC03:50
*** Supun has joined #openstack-swift03:50
*** kei_yama has joined #openstack-swift04:02
*** gkadam has joined #openstack-swift04:04
*** links has quit IRC04:05
*** openstackgerrit has joined #openstack-swift04:08
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Refactor expirer's task round robin implementation  https://review.openstack.org/53817104:08
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Remove confusing assertion from expirer's unit test  https://review.openstack.org/54378404:08
m_kazuhiroSorry, I update round robin refactor patch by mistake...04:11
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Refactor expirer's task round robin implementation  https://review.openstack.org/53817104:15
m_kazuhirook... I fixed the mis-update...04:16
*** cshastri has joined #openstack-swift04:16
*** SkyRocknRoll has quit IRC04:17
m_kazuhiroOops, there are some mis-update in the patch... I need to fix them...04:19
*** links has joined #openstack-swift04:23
*** Supun has quit IRC04:26
*** Supun has joined #openstack-swift04:29
mattoliverauopps :)04:30
m_kazuhiroAh... OK... The patch set 7 has no problem. It is ready for review now :)04:31
*** Supun has quit IRC04:36
*** psachin has joined #openstack-swift04:37
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Refactor expirer's task round robin implementation  https://review.openstack.org/53817104:37
m_kazuhiroThis is just rebasing :)04:38
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Remove confusing assertion from expirer's unit test  https://review.openstack.org/54378404:48
*** threestrands has quit IRC04:50
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Fix expirer's invalid task object names in unit tests  https://review.openstack.org/54379605:34
*** itlinux has joined #openstack-swift05:59
*** itlinux has quit IRC06:08
*** yashmurty has joined #openstack-swift06:15
*** _alastor__ has quit IRC07:16
*** rcernin has quit IRC07:25
*** yashmurty has quit IRC07:31
*** hoonetorg has quit IRC07:34
*** m_kazuhiro_ has joined #openstack-swift07:35
*** m_kazuhiro has quit IRC07:37
*** pcaruana has joined #openstack-swift07:41
*** hseipp has joined #openstack-swift07:46
*** hseipp has quit IRC07:49
*** hoonetorg has joined #openstack-swift07:50
*** hseipp has joined #openstack-swift07:50
* kei-ichi Nice to meet you everyone. My name is Keiichi Hikita at NTT Communication Japan.07:51
* kei-ichi I have added 1 topic in Swift PTG etherpad (https://etherpad.openstack.org/p/Dublin_PTG_Swift) about slogging.07:51
* kei-ichi Main objective of this topic is, as I sent e-mail to notmyname and kota_ , I would like to help making slogging as official project of OpenStack.07:51
* kei-ichi Our company is now providing OpenStack based Cloud service named "Enterprise Cloud 2.0" .07:51
kei-ichiIn this service, Nova/Cinder/Glance/Heat is provided as API and Horizon is used as GUI.07:51
kei-ichiI'm one of developer of this service.07:51
* kei-ichi Lately, our team is going to launch object storage service by using Swift with "slogging" as billng logic for this.07:51
* kei-ichi Through this development we found that slogging is now managed in John's GitHub repository and issues are also managed there.07:51
*** d0ugal has quit IRC07:52
* kei-ichi We feels slogging is really good and useful software.07:52
* kei-ichi In case we find someimprovement point or bugs in slogging after service launching, we would like to contribute to fix those case.07:52
* kei-ichi But I know also now Swift team is really busy. 07:52
* kei-ichi So if Swift team give us a permission, we hope we can help this "official projectnize" activity.07:52
* kei-ichi And we have developed slogging result virualize GUI also. (My collegue yashmurty has developed this)07:52
* kei-ichi If we can use time, we would like to introduce this GUI and want to get feedback from Swift team.07:52
* kei-ichi (We are now preparing demonstration movie of this GUI. After move is created, I would like to introduce link of movie here.)07:52
* kei-ichi Let me explain above point in coming PTG if there is time for discussion !07:52
*** neonpastor has quit IRC08:00
*** neonpastor has joined #openstack-swift08:02
*** yashmurty has joined #openstack-swift08:02
*** d0ugal has joined #openstack-swift08:02
*** tesseract has joined #openstack-swift08:26
*** yashmurty has quit IRC08:31
acoleskei-ichi: hello, many of the swift community will be sleeping at this time :) thanks for adding the topic to the PTG etherpad. Look forward to meeting you at the PTG and hearing more about your project.08:35
acolesgood morning08:35
*** peterlisak has joined #openstack-swift08:37
* kei-ichi hello acoles! thank you for returning! Japan is now around 5:30 PM...08:38
* kei-ichi I'm looking forward seeing you and many other Swift members at Dublin!08:39
*** onovy has joined #openstack-swift08:40
mattoliverauacoles: morning08:44
mattoliveraukei-ichi: welcome and I look forward to meeting and talking at the PTG08:45
acolesmattoliverau: o/08:46
*** cbartz has joined #openstack-swift08:48
* kei-ichi Thanks mattoliverau , nice to meet you! I hope I can contribute to Swift project. Let's have discussion in coming PTG!08:48
*** geaaru has joined #openstack-swift09:04
kota_kei-ichi: thanks for adding that09:06
*** kong has quit IRC09:07
*** cshastri has quit IRC09:07
* kei-ichi Hello kota_ san. Thank you for giving us( Me and yashmurty ) a positive advice in e-mail!09:07
*** yashmurty has joined #openstack-swift09:11
kota_kei-ichi: np. hope the discussion goes progressed.09:11
*** yashmurty has quit IRC09:11
* kei-ichi kota_ : Yes, thanks! o/09:12
*** armaan has quit IRC09:14
kota_kei-ichi: perhaps, do you set "/me" for all lines in IRC?09:16
* kota_ is wondering09:16
kota_i got indent lines from your massages09:17
kota_in my irc client09:17
* kei-ichi Let me check, thanks!09:17
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add an update_state method to ShardRange  https://review.openstack.org/54289209:19
*** cshastri has joined #openstack-swift09:23
*** kei-ichi has quit IRC09:33
mattoliveraukei-ichi: glad to have more swift people on the APAC timezone! Sorry we'll build out numbers :)09:34
*** kei-ichi has joined #openstack-swift09:34
*** kei-ichi has left #openstack-swift09:34
*** kei-ichi has joined #openstack-swift09:34
*** gkadam_ has joined #openstack-swift09:34
* kei-ichi test(sorry ..09:34
kei-ichitest09:34
kei-ichikota_ : I found the cause, I've typed enter with cmd key. ( it becomes a habit to enter with cmd in Japanese version slack... )09:35
kota_kei-ichi: looks fine to me.09:36
*** gkadam has quit IRC09:36
kei-ichiSorry for everyone here.09:37
kota_no worries09:39
*** armaan has joined #openstack-swift09:47
*** armaan has quit IRC09:50
*** armaan has joined #openstack-swift09:50
openstackgerritNguyen Hung Phuong proposed openstack/swift master: Fix html_last_updated_fmt for Python3  https://review.openstack.org/54387309:55
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Split expirer methods into smaller ones  https://review.openstack.org/54387409:55
*** silor has joined #openstack-swift10:03
*** links has quit IRC10:36
*** m_kazuhiro_ has quit IRC10:39
*** links has joined #openstack-swift10:49
*** kei_yama has quit IRC11:09
acolessome of us are having a voice call later today (2230 UTC) to discuss details of replication with sharding containers. will be specific detail, not high level. let me know if you would like to join in.11:15
openstackgerritAlistair Coles proposed openstack/swift feature/deep: move annotate_failure to test.__init__  https://review.openstack.org/54281811:16
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Move shrinking shard ranges to a 'shrinking' state  https://review.openstack.org/54226111:16
openstackgerritAlistair Coles proposed openstack/swift feature/deep: refactor get_shard_usage to re-use get_shard_ranges  https://review.openstack.org/54226211:16
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Retry creating shard containers until successful  https://review.openstack.org/54236611:16
openstackgerritAlistair Coles proposed openstack/swift feature/deep: kill orphans during probe test setup  https://review.openstack.org/54226011:16
acolesnotmyname: ^ reordering to merge simpler patches!11:17
*** bkopilov has quit IRC11:19
*** zhongjun has quit IRC11:30
*** zhongjun has joined #openstack-swift11:30
*** robcresswell has quit IRC11:58
*** robcresswell has joined #openstack-swift11:58
*** portdirect has quit IRC12:03
*** portdirect has joined #openstack-swift12:03
*** m_kazuhiro has joined #openstack-swift12:08
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Split expirer methods into smaller ones  https://review.openstack.org/54387412:09
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: WIP: Add object-expirer new mode to execute tasks from general task queue  https://review.openstack.org/51738912:09
*** gkadam_ has quit IRC12:19
*** yashmurty has joined #openstack-swift12:21
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Split expirer methods into smaller ones  https://review.openstack.org/54387412:22
openstackgerritMerged openstack/swift feature/deep: Add an update_state method to ShardRange  https://review.openstack.org/54289212:23
*** yashmurty has quit IRC12:25
*** armaan has quit IRC12:38
*** ianychoi_ has joined #openstack-swift12:42
*** bkopilov has joined #openstack-swift12:46
*** ianychoi has quit IRC12:46
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Parameterize expirer unit tests  https://review.openstack.org/54392312:47
*** tovin07 has joined #openstack-swift12:57
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: WIP: Add object-expirer new mode to execute tasks from general task queue  https://review.openstack.org/51738912:57
*** m_kazuhiro has quit IRC12:57
*** armaan has joined #openstack-swift13:02
*** pcaruana has quit IRC13:16
*** silor has quit IRC13:23
*** tovin07 has quit IRC13:25
*** silor has joined #openstack-swift13:32
*** ianychoi_ has quit IRC13:48
*** ianychoi_ has joined #openstack-swift13:49
*** Supun has joined #openstack-swift14:02
*** amito has quit IRC14:16
*** amito has joined #openstack-swift14:16
openstackgerritMerged openstack/swift feature/deep: move annotate_failure to test.__init__  https://review.openstack.org/54281814:17
*** cshastri has quit IRC14:27
*** openstackgerrit has quit IRC14:33
*** armaan has quit IRC14:35
*** armaan has joined #openstack-swift14:41
*** links has quit IRC14:47
*** ying_zuo has quit IRC14:58
*** ying_zuo has joined #openstack-swift14:59
*** armaan has quit IRC15:06
*** Supun has quit IRC15:16
*** Supun has joined #openstack-swift15:25
*** tovin07 has joined #openstack-swift15:30
*** itlinux has joined #openstack-swift16:01
*** SkyRocknRoll has joined #openstack-swift16:06
*** SkyRocknRoll has quit IRC16:07
*** vinsh has joined #openstack-swift16:11
*** tovin07 has quit IRC16:24
*** Sukhdev has joined #openstack-swift16:30
*** vinsh has quit IRC16:32
*** vinsh has joined #openstack-swift16:32
*** vinsh_ has joined #openstack-swift16:33
*** vinsh has quit IRC16:33
*** psachin has quit IRC16:36
*** saint_ has joined #openstack-swift16:39
*** Supun has quit IRC16:44
*** Supun has joined #openstack-swift16:45
*** itlinux has quit IRC16:46
*** pcaruana has joined #openstack-swift16:47
*** itlinux has joined #openstack-swift16:50
*** Sukhdev has quit IRC17:02
*** cbartz has quit IRC17:03
timburkegood morning17:20
*** armaan has joined #openstack-swift17:20
*** Supun has quit IRC17:22
*** hseipp has quit IRC17:25
*** itlinux has quit IRC17:26
*** itlinux has joined #openstack-swift17:31
*** vinsh_ has quit IRC17:32
*** pcaruana has quit IRC17:55
*** Sukhdev has joined #openstack-swift18:00
*** vinsh has joined #openstack-swift18:00
*** vinsh has quit IRC18:05
*** pcaruana has joined #openstack-swift18:06
*** vinsh has joined #openstack-swift18:07
*** hseipp has joined #openstack-swift18:09
*** saint__ has joined #openstack-swift18:11
*** saint_ has quit IRC18:12
*** hseipp has quit IRC18:12
*** saint_ has joined #openstack-swift18:14
*** saint__ has quit IRC18:16
*** silor has quit IRC18:19
*** Sukhdev has quit IRC18:22
tdasilvanotmyname: thought you might be interested: http://community.redhat.com/blog/2018/02/notes-from-the-fosdem-community-devroom/ Full-disclaimer: the talks listed there were actually talks I had planned to watch, but ended up not working out in my schedule, I have not watched them online yet, but plan to do so...18:26
tdasilvathere were some others here: https://fosdem.org/2018/schedule/track/community_devroom/18:26
notmynametdasilva: you trying to tell me something? ;-)18:27
tdasilvalol...i've thought before that we do need an FAQ18:28
notmynameyeah, those summaries look really interesting. thanks18:28
tdasilvabut no, just noticed you typically mention watching community type of talks...18:28
*** itlinux has quit IRC18:30
*** spiette_ has quit IRC18:33
*** yashmurty has joined #openstack-swift18:37
*** Supun has joined #openstack-swift18:38
*** tesseract has quit IRC18:40
*** Sukhdev has joined #openstack-swift18:41
*** yashmurty has quit IRC18:42
*** itlinux has joined #openstack-swift18:44
*** pcaruana has quit IRC18:45
*** itlinux has quit IRC18:57
*** itlinux has joined #openstack-swift18:59
*** vinsh has quit IRC19:01
*** vinsh has joined #openstack-swift19:02
*** vinsh has quit IRC19:06
*** Sukhdev has quit IRC19:07
*** vinsh has joined #openstack-swift19:08
*** vinsh has quit IRC19:12
*** itlinux has quit IRC19:39
*** armaan has quit IRC19:41
*** armaan has joined #openstack-swift19:42
*** itlinux has joined #openstack-swift19:43
*** itlinux has quit IRC19:46
*** vinsh has joined #openstack-swift19:50
*** itlinux has joined #openstack-swift20:36
*** armaan has quit IRC20:37
*** ukaynar_ has joined #openstack-swift20:51
*** armaan has joined #openstack-swift21:06
*** yashmurty has joined #openstack-swift21:12
*** Supun has quit IRC21:17
*** yashmurty has quit IRC21:17
*** Sukhdev has joined #openstack-swift21:18
tdasilvatimburke: hey! i've been looking at that py3 patch and it's really weird what's going on with that syslog failure21:19
timburkeyeah, i got nothing on that one21:19
tdasilvahere's what i have been able to find...i'm able to reproduce in py35, but only in Fedora! not ubuntu21:20
timburkemakes no sense to me. i thought https://review.openstack.org/#/c/506410/ did... something... to help, though21:20
patchbotpatch 506410 - swift - Stop reloading swift.common.utils in test_daemon (MERGED)21:20
tdasilvaturns out that fedora and ubuntu have different versions of this file: https://github.com/python/cpython/blob/3.5/Lib/logging/handlers.py#L81321:21
tdasilvain fedora it looks like above ^21:21
tdasilvain ubuntu it looks more like what's in 3.4: https://github.com/python/cpython/blob/3.4/Lib/logging/handlers.py#L80421:22
tdasilvaand the problem is that line...in 3.5+ (in Fedora) it's no longer raising an exception, while up to 3.4 it was...21:23
timburke...something something IPv6? maybe?21:23
timburkeno, that's the else block21:24
timburkeok, so https://github.com/python/cpython/commit/e59af5521:24
tdasilvayeah, it's really just the lack of raising the exception, while we are kind of counting it to raise...because we pass a bad address in the test21:24
tdasilvaright21:25
timburkeand the original bug is https://bugs.python.org/issue2980821:26
tdasilvahttps://github.com/openstack/swift/blob/master/test/unit/common/test_utils.py#L156821:26
timburkei wonder whether it passes or fails with the fake_syslog setting...it'd be nice to close https://bugs.launchpad.net/swift/+bug/1704192 ...21:28
openstackLaunchpad bug 1704192 in OpenStack Object Storage (swift) "Unit tests shouldn't take config" [Low,Confirmed]21:28
tdasilvaheh, so ubuntu probably has 3.5.3 and that change made it into 3.5.421:28
timburkei'm still partial toward letting it slide for now, until we have a gate job capable of enforcing whatever fix is required21:29
tdasilvayeah..i think i'm ok with that...not enjoying going down this rabbit hole, but at some point i'd expect gate jobs to just star failing...21:34
*** openstackstatus has quit IRC21:43
*** openstackstatus has joined #openstack-swift21:45
*** ChanServ sets mode: +v openstackstatus21:45
*** ukaynar_ has quit IRC21:47
timburkeyeah, we should probably write up a bug about it... if only so we don't forget what's already been found out21:50
*** afazekas has quit IRC21:50
*** afazekas has joined #openstack-swift21:52
*** ukaynar has joined #openstack-swift21:54
mattoliveraumorning21:57
*** gyee has joined #openstack-swift22:00
*** rcernin has joined #openstack-swift22:05
*** m3m0 has joined #openstack-swift22:10
m3m0Hello, am I missing something? the requirements for swift in stable/queens https://github.com/openstack/swift/blob/stable/queens/requirements.txt seems to be very minimal and when I install swift from source I get some import erros, is there any other step that I should run to install from source?22:12
notmynamem3m0: can you pastebin the errors you are getting?22:12
m3m0Also, does swift provides a "db_sync" like script to create the db?22:12
*** ukaynar has quit IRC22:12
notmynamem3m0: there is no db in swift, so there's nothing to create. also, the requirements file should be complete (we intentionally try to limit dependencies)22:13
m3m0notmyname: sure: http://paste.openstack.org/show/671070/22:13
*** ukaynar has joined #openstack-swift22:13
m3m0"there is no db in swift" perfect :) thanks22:14
notmynamem3m0: yeah, keystone is optional in swift, so it's not listed in the requiremenst file (there's not really a good way to "spell" that)22:14
notmynameinstall python-keystoneclient, and you should be good22:14
timburkekeystonemiddleware, yeah?22:15
m3m0I had to install keystonemiddleware instead22:15
m3m0timburke: thanks :)22:16
timburkeand we could put it in "extras" like we did for castellan -- that might not be a bad idea https://github.com/openstack/swift/blob/2.17.0/setup.cfg#L65-L6822:16
notmynametimburke: yeah, that's exactly what we should o22:17
notmyname*do22:17
timburkewe *already* do something like that for swiftclient https://github.com/openstack/python-swiftclient/blob/3.5.0/setup.cfg#L35-L3722:17
*** ukaynar has quit IRC22:17
m3m0so, if python-keystoneclient and keystonemiddleware are not required, how do you talk to keystone to get authentication?22:22
*** itlinux has quit IRC22:23
timburkeyou don't :-) you have another auth system, like swauth, or something else that integrates well with your specific organization22:25
*** ukaynar has joined #openstack-swift22:25
timburkeif that's keystone, great; if it's something else, that's great too22:25
m3m0so, you can deploy swift standalone?22:26
m3m0nice :)22:26
*** itlinux has joined #openstack-swift22:27
*** sorrison has quit IRC22:28
timburkeyup! you could even have no auth at all (handy for on-prem, well-firewalled installs)22:30
notmynametimburke: did you see in -infra someone just asking the exact same question with clarkb suggesting the exact same solution?22:36
m3m0timburke: thanks a lot it was very informative.22:37
*** openstackgerrit has joined #openstack-swift22:38
openstackgerritJohn Dickinson proposed openstack/swift master: add keystonemiddleware to extras area  https://review.openstack.org/54412122:38
m3m0notmyname: and thanks for the help.22:38
notmynametimburke: is it anything more than that ^ ?22:38
notmynamedo we have to reference it somewhere?22:38
openstackgerritJohn Dickinson proposed openstack/swift master: add keystonemiddleware to extras area  https://review.openstack.org/54412122:41
openstackgerritJohn Dickinson proposed openstack/swift master: add keystonemiddleware to extras area  https://review.openstack.org/54412122:43
*** armaan has quit IRC22:43
*** itlinux has quit IRC22:46
mrjk_Hi22:47
notmynamehello22:48
mrjk_I just discovered swift-container-updater was not logging anymore after few hours of operations, even with debug logs. It is not a network service which can be easily tested, and strace -p doesn't give me so much info, except the process is epoll_wait.22:53
mrjk_I also noticed on the rest of the prod, there where only one process, on those specific nodes, I may have 2 or three processes. Can this service run in concurrency ? Because as I see no activity, it may be the source of my problem22:54
notmynameyeah, it sounds like it's hung for some reason. let me check the configs for the updater22:55
mrjk_Version info: openstack-swift-container-2.13.0-1.el7.noarch22:55
*** kong has joined #openstack-swift22:55
notmynamemrjk_: yeah, there's a "concurrency" setting you can use. it defaults to "4"22:56
notmynamehttps://github.com/openstack/swift/blob/master/etc/container-server.conf-sample#L176-L21022:56
mrjk_Ha nice, the up to date config example :) Ho, well, I'll disable concurency and see if things are going better.23:00
mrjk_notmyname, thx23:01
notmynamemrjk_: np. all the files in that directory in the source tree are really well commented. and all the commented-out values are the defaults. definitely use them as a reference23:01
notmyname(anything not commented out is required to be specified in the config file. most of the time the operator needs to choose a value)23:02
*** kei_yama has joined #openstack-swift23:08
*** vinsh has quit IRC23:41
*** vinsh has joined #openstack-swift23:41
*** Sukhdev has quit IRC23:42
*** vinsh has quit IRC23:49

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!