Friday, 2018-04-13

*** itlinux has quit IRC00:03
*** itlinux has joined #openstack-swift00:06
*** gyee has quit IRC00:10
*** Sukhdev has quit IRC00:10
*** itlinux has quit IRC00:41
*** m_kazuhiro has joined #openstack-swift00:46
*** itlinux has joined #openstack-swift00:46
m_kazuhirogood morning00:47
openstackgerritMerged openstack/swift feature/deep: Remove shard_cleanups  https://review.openstack.org/56002900:57
*** itlinux has quit IRC00:58
mattoliveraum_kazuhiro: morning00:58
m_kazuhiromattoliverau: morning!00:59
*** ianychoi_ is now known as ianychoi01:01
openstackgerritClay Gerrard proposed openstack/swift feature/deep: WIP: narrow race in _replicate_object  https://review.openstack.org/56109101:03
*** cshastri has joined #openstack-swift01:06
*** itlinux has joined #openstack-swift01:09
*** itlinux has quit IRC01:10
*** itlinux has joined #openstack-swift01:19
openstackgerritMerged openstack/swift master: Clean up SegmentError messages  https://review.openstack.org/56104801:21
*** manous_ has joined #openstack-swift01:22
kota_good morning01:27
*** itlinux has quit IRC01:35
*** manous_ has quit IRC01:37
*** armaan has quit IRC02:25
*** armaan has joined #openstack-swift02:26
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: add get_sys_meta_header function  https://review.openstack.org/56110702:30
*** germs has quit IRC02:34
*** germs has joined #openstack-swift02:35
*** germs has quit IRC02:35
*** germs has joined #openstack-swift02:35
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110902:37
*** d0ugal has quit IRC02:43
*** d0ugal has joined #openstack-swift02:50
openstackgerritMerged openstack/swift feature/deep: Merge remote-tracking branch 'gerrit/master' into feature/deep  https://review.openstack.org/56106402:57
*** psachin has joined #openstack-swift03:04
*** gtOrochimarufan has joined #openstack-swift03:21
*** gtOrochimarufan has quit IRC03:23
*** babilenFL1ZRC has joined #openstack-swift03:34
*** babilenFL1ZRC has quit IRC03:36
openstackgerritTovin Seven proposed openstack/swift master: OSprofiler in OpenStack Swift  https://review.openstack.org/46831603:38
*** kei_yama has quit IRC03:41
*** m_kazuhiro has quit IRC03:47
*** grkolla has joined #openstack-swift03:49
*** itlinux has joined #openstack-swift03:49
*** grkolla has quit IRC03:51
*** kei_yama has joined #openstack-swift04:02
*** epsilonph has joined #openstack-swift04:08
*** epsilonph has quit IRC04:10
openstackgerritMerged openstack/swift master: swift-recon-cron: do not get confused by files in /srv/node  https://review.openstack.org/38802904:14
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110904:16
*** itlinux has quit IRC04:23
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110904:50
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110905:00
*** links has joined #openstack-swift05:11
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110905:14
*** m_kazuhiro has joined #openstack-swift05:24
*** armaan has quit IRC06:14
*** armaan has joined #openstack-swift06:14
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110906:16
openstackgerritKeiichi Hikita proposed openstack/slogging master: Fix tox settings and relevant bugs  https://review.openstack.org/56110906:23
openstackgerritMatthew Oliver proposed openstack/swift master: py3: port cli recon tests  https://review.openstack.org/55104006:40
*** cshastri has quit IRC06:44
*** hseipp has joined #openstack-swift06:45
*** cshastri has joined #openstack-swift06:47
*** m_kazuhiro_ has joined #openstack-swift06:47
*** m_kazuhiro has quit IRC06:50
*** Supun has joined #openstack-swift06:51
*** armaan has quit IRC07:01
*** armaan has joined #openstack-swift07:02
*** geaaru has joined #openstack-swift07:07
*** tesseract has joined #openstack-swift07:17
*** Supun has quit IRC07:23
*** cbartz has joined #openstack-swift07:27
openstackgerritCharles Hsu proposed openstack/swift master: Truncate error logs to prevent log handler runs out of the buffer.  https://review.openstack.org/56114207:30
*** rcernin has quit IRC07:33
*** Supun has joined #openstack-swift07:41
*** cshastri has quit IRC07:53
*** mikecmpbll has joined #openstack-swift08:00
*** gkadam has joined #openstack-swift08:07
*** armaan has quit IRC08:07
*** armaan has joined #openstack-swift08:07
acolesgood morning08:08
acolestdasilva: LOL @ 22:15 - you mean you're allowed to *ever* have the lights on?08:09
mattoliverauacoles: morning08:12
acolesmattoliverau: o/ nearly the weekend...08:12
mattoliveraunearly.. just a team meeting and a stand up to go and it's weekend time!08:13
acolesmattoliverau: I'm heading to the beach this weekend...which for me means wrapping up in warm waterproof clothing and plenty of hot drinks :)08:13
mattoliverauacoles: or.. you could come visit me.. we're having a crazy hot April. It was 37 yesterday and above 30 today.08:14
acolesphew that's warm08:16
*** Supun has quit IRC08:18
mattoliverauyeah, it's suppose to be nice and mid 20s.08:19
acoleshehe 'mid-20s' aka 'a British heatwave'08:20
mattoliveraulol08:20
alecuyer_acoles:  good morning08:30
acolesalecuyer_: hi08:31
*** cshastri has joined #openstack-swift08:31
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Start from last max row when repeating cleaving  https://review.openstack.org/55949108:44
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Take lock before unlinking db files  https://review.openstack.org/55979608:44
*** cshastri_ has joined #openstack-swift08:59
*** cshastri has quit IRC09:01
*** m_kazuhiro_ has quit IRC09:03
*** pcaruana has joined #openstack-swift09:12
mattoliverauk, I'm calling it a week. Have a great weekend all09:13
mattoliverauacoles: night man, have a great day09:13
mattoliverau..and weekend of course09:13
acolesmattoliverau: cheers, you too09:13
*** armaan has quit IRC09:55
*** cshastri_ has quit IRC10:06
*** cshastri_ has joined #openstack-swift10:29
*** PavelK has quit IRC10:37
*** PavelK has joined #openstack-swift10:51
*** ccamacho is now known as ccamacho|hungy11:10
*** armaan has joined #openstack-swift11:17
*** NM has joined #openstack-swift11:55
*** armaan has quit IRC11:57
*** armaan has joined #openstack-swift11:59
*** NM has quit IRC12:01
*** knylander has quit IRC12:13
*** cshastri_ has quit IRC12:15
*** ccamacho|hungy is now known as ccamacho12:17
*** NM has joined #openstack-swift12:23
*** armaan has quit IRC12:26
*** silor has joined #openstack-swift12:33
*** cshastri_ has joined #openstack-swift12:34
*** kei_yama has quit IRC12:39
*** knylander has joined #openstack-swift12:40
tdasilvagood morning12:58
tdasilvaacoles: that was timburke, but 22:15 is waayy past my bedtime ;)12:58
acolestdasilva: oops I misread12:58
*** PavelK has quit IRC12:59
*** psachin has quit IRC13:02
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Enable shard ranges to be fetched from a deleted container  https://review.openstack.org/56097813:10
*** vstinner has joined #openstack-swift13:17
*** cshastri_ has quit IRC13:48
*** hoonetorg has quit IRC13:48
*** vstinner has left #openstack-swift13:52
openstackgerritVictor Stinner proposed openstack/swift master: py3: Fix test_utils on Python 3.5  https://review.openstack.org/56123014:06
tdasilvaah...vstinner left...14:09
*** armaan has joined #openstack-swift14:10
*** cshastri_ has joined #openstack-swift14:18
*** cshastri_ has quit IRC14:34
*** germs has quit IRC14:35
*** germs has joined #openstack-swift14:35
*** germs has quit IRC14:35
*** germs has joined #openstack-swift14:35
*** psachin has joined #openstack-swift14:36
openstackgerritCharles Hsu proposed openstack/swift master: Truncate error logs to prevent log handler runs out of the buffer.  https://review.openstack.org/56114214:40
*** openstackgerrit has quit IRC14:50
*** germs has quit IRC14:53
*** germs has joined #openstack-swift14:54
*** links has quit IRC14:58
*** germs has quit IRC14:58
*** germs has joined #openstack-swift14:59
*** germs has quit IRC14:59
*** germs has joined #openstack-swift14:59
*** germs has quit IRC15:04
*** pcaruana has quit IRC15:12
notmynamegood morning]15:22
notmynametdasilva: would you have time today to give a very short update to http://lists.openstack.org/pipermail/openstack-dev/2018-April/129347.html ?15:23
notmynameeven "I'm working on it, and support is better than it was". or something15:24
*** silor has quit IRC15:31
*** armaan has quit IRC15:46
tdasilvatdasilva: yep, will reply...15:46
*** Supun has joined #openstack-swift15:47
*** itlinux has joined #openstack-swift15:48
notmynametdasilva: thanks15:49
*** mikecmpbll has quit IRC16:06
*** Supun has quit IRC16:10
*** cbartz has quit IRC16:11
*** pcaruana has joined #openstack-swift16:15
*** gkadam has quit IRC16:21
*** hseipp has quit IRC16:22
timburkegood morning16:38
*** gyee has joined #openstack-swift16:51
*** links has joined #openstack-swift16:53
*** germs has joined #openstack-swift17:00
*** germs has quit IRC17:00
*** germs has joined #openstack-swift17:00
*** germs has quit IRC17:05
*** mikecmpbll has joined #openstack-swift17:13
*** zaitcev_ has joined #openstack-swift17:36
*** ChanServ sets mode: +v zaitcev_17:36
*** zaitcev has quit IRC17:40
*** openstackgerrit has joined #openstack-swift17:44
openstackgerritTim Burke proposed openstack/swift feature/deep: Add shard range state to container-info output  https://review.openstack.org/56128317:44
*** psachin has quit IRC17:49
*** tesseract has quit IRC17:53
*** Sukhdev has joined #openstack-swift17:57
*** links has quit IRC18:02
openstackgerritTim Burke proposed openstack/swift feature/deep: Make the broker timeout when sharding configurable  https://review.openstack.org/56128618:06
*** geaaru has quit IRC18:11
*** links has joined #openstack-swift18:15
*** bkopilov has quit IRC18:30
*** links has quit IRC18:31
openstackgerritTim Burke proposed openstack/swift feature/deep: Catch Timeouts in _one_shard_cycle  https://review.openstack.org/56129018:32
*** germs has joined #openstack-swift19:01
*** germs has quit IRC19:01
*** germs has joined #openstack-swift19:01
*** NM has quit IRC19:04
*** germs has quit IRC19:06
*** Sukhdev has quit IRC19:28
*** NM has joined #openstack-swift19:54
*** NM has quit IRC20:09
*** NM has joined #openstack-swift20:13
*** jhawk has joined #openstack-swift20:43
*** ccamacho has quit IRC20:49
*** d0ugal has quit IRC20:59
*** germs has joined #openstack-swift21:01
*** germs has quit IRC21:01
*** germs has joined #openstack-swift21:01
*** ccamacho has joined #openstack-swift21:06
*** germs has quit IRC21:06
notmynamejhawk: oh hi21:13
jhawknotmyname: I started here,  but I was it was labeled as a swift team channel rather than a support one,  I didn't want to be presumptuous and start posting here21:13
notmynameno worries21:14
jhawklet me start porting my comments over to this channel...21:14
jhawkquick recap from the #openstack channel....21:15
*** geaaru has joined #openstack-swift21:15
jhawkI'm trying to install swift,  the installation seems to have gone smoothly,  I can create containers,  but I cannot create / upload objects21:15
jhawkOn the proxy node I see the following unhandled exception21:16
jhawkproxy-server: ERROR Unhandled exception in request:  ** some of the string omitted ** /swift/proxy/controllers/obj.py", line 399, in _handle_response#012    etags.add(response.getheader('etag').strip('"'))#012AttributeError: 'NoneType' object has no attribute 'strip'21:16
jhawkIt appears as though the header does not contain etags21:17
jhawk(which causes this exception... which is in a condition labeled success... which is odd as well, but I'll come back to that)21:17
jhawkon the storage node,  I see some 404 errors talking back to the controller (or proxy node)21:17
jhawk container-server: 10.0.22.1 - - [13/Apr/2018:21:18:13 +0000] "HEAD /sdf/874/AUTH_91a13260197146038d8ec1f031e93673/test1/desktop.ini" 404 - "HEAD http://control1:8080/v1/AUTH_91a13260197146038d8ec1f031e93673/test1/desktop.ini" "txe9b1ec6da48a406186e73-005ad11e94" "proxy-server 6658" 0.0008 "-" 18053 021:18
notmynamejhawk: what version of swift? where'd you get it? what is the client request that triggered this?21:19
jhawkHorrizon is the client,  running whatever ubuntu/apt has as the latest for everything21:19
jhawknotmyname: let me get the actual version numbers21:20
jhawknotmyname: swift-object/artful,artful,now 2.15.1-0ubuntu321:21
notmynamejhawk: swift-recon could be your friend here21:21
jhawknotmyname: I've been pouring though the config files trying to enable some for of debug21:22
jhawk*form of...21:22
notmynameall info available goes to the logs. syslog21:24
* jhawk reading over the object storage monitoring page21:24
notmynameset "log_level = DEBUG" to get the highest level of logging21:24
notmynamein the config files21:24
notmynamethe sample config files are very well commented to show what's possible21:24
jhawknotmyname: I tried to set that on the container-server.conf,  but it didn't seem to do anything21:24
notmynamehttps://github.com/openstack/swift/tree/master/etc21:25
jhawknotmyname: assuming that it was just using the pythong logging module constants21:25
notmynamejust for fun, check `swift-recon --validate-servers object`. also with container and account21:25
*** d0ugal has joined #openstack-swift21:26
jhawknotmyname: ah-ha!21:26
jhawkInvalid: http://10.0.22.9:6201/ is container-server21:26
notmynamenote that every log message from swift should have a transaction id in it. eg txe9b1ec6da48a406186e73-005ad11e94 from one you pasted above. and all log messages with a particular request will have the same txnid21:26
notmynameoh cool!21:26
notmyname(thanks for that feature mahatic!)21:27
jhawknotmyname: okay so account and container are all good21:28
notmynamegood21:28
jhawknotmyname: just object is bad21:28
notmynamethat means you have something wrong in your object ring21:29
jhawknotmyname: all 4 nodes :/21:29
notmynameprobably fat-fingered a port number21:29
*** gkadam has joined #openstack-swift21:30
jhawknotmyname: wouldn't surprise me hahaha,  I've been configuring various openstack components for weeks.... -_-21:30
*** NM has quit IRC21:31
jhawkderp, that is exactly it -_-"21:31
jhawkfat fingered a port...21:31
notmynameeasy fix then :-)21:33
notmynameglad that was something simple21:33
notmynameI've got to step away for a while. going to pick my wife up from the airport. but feel free to stay in here and ask any other questions21:34
notmynameit's the end of the workweek for most of us, so it may be somewhat quiet until monday21:34
jhawknotmyname: thanks a lot for your help!21:34
*** nfslnlkw has joined #openstack-swift21:35
*** nfslnlkw has quit IRC21:37
*** gkadam has quit IRC21:58
*** linkmark has quit IRC22:12
*** itlinux has quit IRC22:27
openstackgerritSamuel Merritt proposed openstack/swift master: Make reconstructor go faster with --override-devices  https://review.openstack.org/55595122:50
openstackgerritSamuel Merritt proposed openstack/swift master: Make multiprocess reconstructor's logs more readable.  https://review.openstack.org/55799522:50
*** Sukhdev has joined #openstack-swift22:52
*** mikecmpbll has quit IRC22:52
*** germs has joined #openstack-swift23:02
*** germs has quit IRC23:02
*** germs has joined #openstack-swift23:02
*** germs has quit IRC23:06
*** NM has joined #openstack-swift23:26
*** hoonetorg has joined #openstack-swift23:45
notmynamehttps://upcommons.upc.edu/handle/2117/116223 <-- wonder if they'll contribute upstream23:46
*** Sukhdev has quit IRC23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!