| zaitcev | creiht: ok writing todo: "gurumed: read eventlet code, find what danpb missed re. finding greenthreads" | 00:00 |
|---|---|---|
| creiht | hehe | 00:00 |
| creiht | I'm poking a bit | 00:00 |
| creiht | I'm also a little worried that crawling through all of gc.get_objects() could pause things for quite a bit | 00:01 |
| creiht | on a prod system | 00:01 |
| creiht | though if the thing is hung anyways, may not be a big deal | 00:19 |
| creiht | and it looks like there isn't a straightforward way to crawl all the current greenlets | 00:19 |
| *** miurahr has quit IRC | 00:19 | |
| *** changbl has quit IRC | 00:24 | |
| *** miurahr has joined #openstack-swift | 00:31 | |
| *** miurahr has quit IRC | 00:31 | |
| *** shri has quit IRC | 00:33 | |
| creiht | zaitcev: ok so some experimentation seems to indicate that if the greenlet has been created, but hasn't run yet then it will show that behavior | 00:34 |
| zaitcev | creiht: but the tracebacks are not empty, they all end in some kind of idling like listening | 00:35 |
| creiht | zaitcev: an interesting change might be to ignore if greenlet.dead == True | 00:36 |
| zaitcev | actually hmmm.... I'll look at id(gt.gt_traceback), maybe they are all the same :-) | 00:36 |
| creiht | zaitcev: well it it showing the stack of the thing that is checking to see if there is a stack because there is not stack yet | 00:36 |
| creiht | of course the dead thing wouldn't solve the above problem, but would make sure that it wouldn't show any dead threads | 00:37 |
| creiht | or maybe at least print that value out in the report | 00:37 |
| creiht | oh | 00:38 |
| creiht | zaitcev: if gr_frame == None then it hasn't done anything yet so has no stack to print | 00:38 |
| creiht | so it is printing the stack of the parent I guess | 00:38 |
| creiht | so if gr_frame == None print out that there is a thread but hasn't ben run yet or some other message like that | 00:39 |
| creiht | did all of that make sense? | 00:40 |
| creiht | time for me to step away now, but I think that will clean it up a bit | 00:41 |
| zaitcev | yes, I saved that line about None | 00:43 |
| creiht | cool | 00:44 |
| *** miurahr has joined #openstack-swift | 00:51 | |
| *** miurahr has quit IRC | 00:53 | |
| *** Dharmit has joined #openstack-swift | 00:54 | |
| *** tdasilva has left #openstack-swift | 00:57 | |
| *** csd_ has joined #openstack-swift | 00:57 | |
| *** csd has quit IRC | 01:00 | |
| *** vu has quit IRC | 01:08 | |
| openstackgerrit | A change was merged to openstack/swift: Don't lard up InternalClient with extra middleware https://review.openstack.org/77042 | 01:09 |
| *** csd_ has quit IRC | 01:16 | |
| zaitcev | https://review.openstack.org/51613 -- gives an interesting 404 (transparency with a button), supposed to be the review to add EC support to policies | 01:38 |
| *** nosnos has joined #openstack-swift | 01:56 | |
| *** catintheroof has joined #openstack-swift | 02:00 | |
| catintheroof | Hi guys, one quick question, having the object-replication service just one object-server.conf on most of the deploys, the intention is for the service to go one device at a time an look for the partitions to replicate? i mean, we have multiple .conf for every device, and replication is running at the same time for every device, but y dont want that behaviour, so just confirming how the replication should work | 02:05 |
| *** haomaiwang has joined #openstack-swift | 02:15 | |
| *** haomaiwang has quit IRC | 02:20 | |
| *** haomaiwa_ has joined #openstack-swift | 02:21 | |
| *** catintheroof has quit IRC | 02:27 | |
| openstackgerrit | Samuel Merritt proposed a change to openstack/swift: Speed up failing InternalClient requests https://review.openstack.org/78070 | 02:43 |
| *** changbl has joined #openstack-swift | 02:50 | |
| *** haomaiw__ has joined #openstack-swift | 03:01 | |
| *** haomaiwa_ has quit IRC | 03:04 | |
| openstackgerrit | Zhang Hua proposed a change to openstack/swift: Add profiling middleware in Swift https://review.openstack.org/53270 | 03:18 |
| openstackgerrit | Zhang Hua proposed a change to openstack/swift: Add profiling middleware in Swift https://review.openstack.org/53270 | 03:27 |
| *** Edward-Zhang has joined #openstack-swift | 03:34 | |
| *** chandan_kumar has joined #openstack-swift | 03:42 | |
| *** miurahr has joined #openstack-swift | 03:46 | |
| *** chandan_kumar has quit IRC | 03:46 | |
| *** Edward-Zhang has quit IRC | 03:50 | |
| *** miurahr has quit IRC | 03:58 | |
| *** gyee has quit IRC | 04:03 | |
| *** Edward-Zhang has joined #openstack-swift | 04:39 | |
| *** ppai has joined #openstack-swift | 04:45 | |
| openstackgerrit | Zhang Hua proposed a change to openstack/swift: Add profiling middleware in Swift https://review.openstack.org/53270 | 04:47 |
| *** Midnightmyth has joined #openstack-swift | 05:03 | |
| *** chandankumar_ has quit IRC | 05:28 | |
| *** miurahr has joined #openstack-swift | 05:31 | |
| *** miurahr has quit IRC | 05:35 | |
| *** nshaikh has joined #openstack-swift | 05:37 | |
| *** chandan_kumar has joined #openstack-swift | 05:38 | |
| *** miurahr has joined #openstack-swift | 05:45 | |
| *** miurahr has left #openstack-swift | 05:46 | |
| *** Midnightmyth has quit IRC | 05:53 | |
| *** miurahr has joined #openstack-swift | 05:59 | |
| *** miurahr has left #openstack-swift | 06:00 | |
| *** haomaiw__ has quit IRC | 06:11 | |
| *** bvandenh has joined #openstack-swift | 06:15 | |
| *** sungju has quit IRC | 06:16 | |
| *** madhuri has quit IRC | 06:19 | |
| *** madhuri has joined #openstack-swift | 06:19 | |
| *** miurahr has joined #openstack-swift | 06:34 | |
| *** basha has joined #openstack-swift | 06:35 | |
| *** zaitcev has quit IRC | 06:38 | |
| *** ppai has quit IRC | 06:45 | |
| *** miurahr has quit IRC | 06:45 | |
| *** ppai has joined #openstack-swift | 07:02 | |
| *** Edward-Zhang has quit IRC | 07:02 | |
| *** saju_m has joined #openstack-swift | 07:02 | |
| *** haomaiwang has joined #openstack-swift | 07:18 | |
| *** basha has quit IRC | 07:56 | |
| *** yuanz has joined #openstack-swift | 08:08 | |
| *** nosnos has quit IRC | 08:11 | |
| *** yuan has quit IRC | 08:11 | |
| *** openstackgerrit has quit IRC | 08:11 | |
| *** creiht has quit IRC | 08:11 | |
| *** gholt has quit IRC | 08:11 | |
| *** saju_m has quit IRC | 08:11 | |
| *** ppai has quit IRC | 08:11 | |
| *** clarkb has quit IRC | 08:11 | |
| *** chandan_kumar has quit IRC | 08:11 | |
| *** mrsnivvel has quit IRC | 08:11 | |
| *** Slidey has quit IRC | 08:11 | |
| *** joearnold has quit IRC | 08:11 | |
| *** cschwede- has quit IRC | 08:11 | |
| *** Kim-Chi-San has quit IRC | 08:11 | |
| *** tanee-away has quit IRC | 08:11 | |
| *** haomaiwang has quit IRC | 08:11 | |
| *** Dharmit has quit IRC | 08:11 | |
| *** bada has quit IRC | 08:11 | |
| *** krtaylor has quit IRC | 08:11 | |
| *** erlon has quit IRC | 08:11 | |
| *** peluse has quit IRC | 08:11 | |
| *** swifterdarrell has quit IRC | 08:11 | |
| *** sileht has quit IRC | 08:11 | |
| *** sudorandom has quit IRC | 08:11 | |
| *** ondergetekende has quit IRC | 08:11 | |
| *** akscram has quit IRC | 08:11 | |
| *** grapsus_ has quit IRC | 08:11 | |
| *** Anju has quit IRC | 08:11 | |
| *** mkerrin has quit IRC | 08:11 | |
| *** otherjon has quit IRC | 08:11 | |
| *** Alex_Gaynor has quit IRC | 08:11 | |
| *** mtreinish has quit IRC | 08:11 | |
| *** occupant has quit IRC | 08:11 | |
| *** wer has quit IRC | 08:11 | |
| *** CrackerJackMack has quit IRC | 08:11 | |
| *** briancline has quit IRC | 08:11 | |
| *** bvandenh has quit IRC | 08:11 | |
| *** wkelly has quit IRC | 08:11 | |
| *** ccorrigan has quit IRC | 08:11 | |
| *** saschpe has quit IRC | 08:11 | |
| *** annegentle has quit IRC | 08:11 | |
| *** acoles has quit IRC | 08:11 | |
| *** sfineberg has quit IRC | 08:11 | |
| *** tristanC has quit IRC | 08:11 | |
| *** pberis has quit IRC | 08:11 | |
| *** cropalato has quit IRC | 08:11 | |
| *** wayneeseguin has quit IRC | 08:11 | |
| *** acorwin has quit IRC | 08:11 | |
| *** jokke_ has quit IRC | 08:11 | |
| *** zackmdavis has quit IRC | 08:11 | |
| *** jeblair has quit IRC | 08:11 | |
| *** greghaynes has quit IRC | 08:11 | |
| *** nshaikh has quit IRC | 08:11 | |
| *** redbo has quit IRC | 08:11 | |
| *** judd7 has quit IRC | 08:11 | |
| *** notmyname has quit IRC | 08:11 | |
| *** MooingLemur has quit IRC | 08:11 | |
| *** rahmu has quit IRC | 08:11 | |
| *** dosaboy has quit IRC | 08:11 | |
| *** bsdkurt has quit IRC | 08:11 | |
| *** torgomatic has quit IRC | 08:11 | |
| *** minnear has quit IRC | 08:11 | |
| *** glange has quit IRC | 08:11 | |
| *** hugokuo has quit IRC | 08:11 | |
| *** ctennis has quit IRC | 08:11 | |
| *** anderstj has quit IRC | 08:11 | |
| *** alpha_ori has quit IRC | 08:11 | |
| *** mandarine has quit IRC | 08:11 | |
| *** early has quit IRC | 08:11 | |
| *** ryao has quit IRC | 08:11 | |
| *** anticw has quit IRC | 08:11 | |
| *** pconstantine has quit IRC | 08:11 | |
| *** j_king has quit IRC | 08:11 | |
| *** dfg has quit IRC | 08:11 | |
| *** mordred has quit IRC | 08:11 | |
| *** kragniz has quit IRC | 08:11 | |
| *** otoolee has quit IRC | 08:11 | |
| *** StevenK has quit IRC | 08:11 | |
| *** EmilienM has quit IRC | 08:11 | |
| *** pandemicsyn has quit IRC | 08:11 | |
| *** chmouel has quit IRC | 08:11 | |
| *** Diddi has quit IRC | 08:11 | |
| *** omame has quit IRC | 08:11 | |
| *** zigo has quit IRC | 08:11 | |
| *** mhu has quit IRC | 08:11 | |
| *** russellb has quit IRC | 08:11 | |
| *** Anticimex has quit IRC | 08:11 | |
| *** zanc has quit IRC | 08:11 | |
| *** fbo_away has quit IRC | 08:11 | |
| *** ChanServ has quit IRC | 08:11 | |
| *** madhuri has quit IRC | 08:11 | |
| *** mjseger has quit IRC | 08:11 | |
| *** ekarlso has quit IRC | 08:11 | |
| *** Dieterbe has quit IRC | 08:11 | |
| *** physcx has quit IRC | 08:11 | |
| *** JelleB has quit IRC | 08:11 | |
| *** mlanner has quit IRC | 08:11 | |
| *** amandap has quit IRC | 08:11 | |
| *** therve has quit IRC | 08:11 | |
| *** portante has quit IRC | 08:11 | |
| *** luisbg has quit IRC | 08:11 | |
| *** ahale has quit IRC | 08:11 | |
| *** rpedde has quit IRC | 08:11 | |
| *** clayg has quit IRC | 08:11 | |
| *** miurahr has joined #openstack-swift | 08:26 | |
| *** nosnos has joined #openstack-swift | 08:28 | |
| *** yuan has joined #openstack-swift | 08:28 | |
| *** nosnos has quit IRC | 08:29 | |
| *** yuan has quit IRC | 08:29 | |
| *** miurahr has quit IRC | 08:33 | |
| *** yuanz has quit IRC | 08:41 | |
| *** nacim_ has joined #openstack-swift | 08:53 | |
| *** basha has joined #openstack-swift | 09:02 | |
| *** openstackgerrit has joined #openstack-swift | 09:02 | |
| *** nosnos_ has joined #openstack-swift | 09:02 | |
| *** creiht_ has joined #openstack-swift | 09:02 | |
| *** 1JTAAJOSR has joined #openstack-swift | 09:02 | |
| *** saju_m has joined #openstack-swift | 09:02 | |
| *** ppai has joined #openstack-swift | 09:02 | |
| *** madhuri has joined #openstack-swift | 09:02 | |
| *** bvandenh has joined #openstack-swift | 09:02 | |
| *** chandan_kumar has joined #openstack-swift | 09:02 | |
| *** Dharmit has joined #openstack-swift | 09:02 | |
| *** otoolee has joined #openstack-swift | 09:02 | |
| *** gholt has joined #openstack-swift | 09:02 | |
| *** bada has joined #openstack-swift | 09:02 | |
| *** redbo has joined #openstack-swift | 09:02 | |
| *** wkelly has joined #openstack-swift | 09:02 | |
| *** judd7 has joined #openstack-swift | 09:02 | |
| *** mrsnivvel has joined #openstack-swift | 09:02 | |
| *** ccorrigan has joined #openstack-swift | 09:02 | |
| *** annegentle has joined #openstack-swift | 09:02 | |
| *** krtaylor has joined #openstack-swift | 09:02 | |
| *** ekarlso has joined #openstack-swift | 09:02 | |
| *** erlon has joined #openstack-swift | 09:02 | |
| *** saschpe has joined #openstack-swift | 09:02 | |
| *** acoles has joined #openstack-swift | 09:02 | |
| *** sfineberg has joined #openstack-swift | 09:02 | |
| *** mjseger has joined #openstack-swift | 09:02 | |
| *** clarkb has joined #openstack-swift | 09:02 | |
| *** peluse has joined #openstack-swift | 09:02 | |
| *** swifterdarrell has joined #openstack-swift | 09:02 | |
| *** tristanC has joined #openstack-swift | 09:02 | |
| *** sileht has joined #openstack-swift | 09:02 | |
| *** sudorandom has joined #openstack-swift | 09:02 | |
| *** ondergetekende has joined #openstack-swift | 09:02 | |
| *** Dieterbe has joined #openstack-swift | 09:02 | |
| *** physcx has joined #openstack-swift | 09:02 | |
| *** JelleB has joined #openstack-swift | 09:02 | |
| *** greghaynes has joined #openstack-swift | 09:02 | |
| *** notmyname has joined #openstack-swift | 09:02 | |
| *** dickson.freenode.net sets mode: +vvvv gholt redbo swifterdarrell notmyname | 09:02 | |
| *** MooingLemur has joined #openstack-swift | 09:02 | |
| *** pberis has joined #openstack-swift | 09:02 | |
| *** cropalato has joined #openstack-swift | 09:02 | |
| *** mlanner has joined #openstack-swift | 09:02 | |
| *** amandap has joined #openstack-swift | 09:02 | |
| *** wayneeseguin has joined #openstack-swift | 09:02 | |
| *** therve has joined #openstack-swift | 09:02 | |
| *** Slidey has joined #openstack-swift | 09:02 | |
| *** jokke_ has joined #openstack-swift | 09:02 | |
| *** zackmdavis has joined #openstack-swift | 09:02 | |
| *** jeblair has joined #openstack-swift | 09:02 | |
| *** akscram has joined #openstack-swift | 09:02 | |
| *** grapsus_ has joined #openstack-swift | 09:02 | |
| *** Anju has joined #openstack-swift | 09:02 | |
| *** joearnold has joined #openstack-swift | 09:02 | |
| *** cschwede- has joined #openstack-swift | 09:02 | |
| *** Kim-Chi-San has joined #openstack-swift | 09:02 | |
| *** tanee-away has joined #openstack-swift | 09:02 | |
| *** mandarine has joined #openstack-swift | 09:02 | |
| *** acorwin has joined #openstack-swift | 09:02 | |
| *** briancline has joined #openstack-swift | 09:02 | |
| *** CrackerJackMack has joined #openstack-swift | 09:02 | |
| *** wer has joined #openstack-swift | 09:02 | |
| *** occupant has joined #openstack-swift | 09:02 | |
| *** mtreinish has joined #openstack-swift | 09:02 | |
| *** Alex_Gaynor has joined #openstack-swift | 09:02 | |
| *** otherjon has joined #openstack-swift | 09:02 | |
| *** mkerrin has joined #openstack-swift | 09:02 | |
| *** rahmu has joined #openstack-swift | 09:02 | |
| *** StevenK has joined #openstack-swift | 09:02 | |
| *** dosaboy has joined #openstack-swift | 09:02 | |
| *** bsdkurt has joined #openstack-swift | 09:02 | |
| *** EmilienM has joined #openstack-swift | 09:02 | |
| *** pandemicsyn has joined #openstack-swift | 09:02 | |
| *** torgomatic has joined #openstack-swift | 09:02 | |
| *** minnear has joined #openstack-swift | 09:02 | |
| *** glange has joined #openstack-swift | 09:02 | |
| *** hugokuo has joined #openstack-swift | 09:02 | |
| *** ctennis has joined #openstack-swift | 09:02 | |
| *** anderstj has joined #openstack-swift | 09:02 | |
| *** alpha_ori has joined #openstack-swift | 09:02 | |
| *** portante has joined #openstack-swift | 09:02 | |
| *** early has joined #openstack-swift | 09:02 | |
| *** ryao has joined #openstack-swift | 09:02 | |
| *** anticw has joined #openstack-swift | 09:02 | |
| *** pconstantine has joined #openstack-swift | 09:02 | |
| *** j_king has joined #openstack-swift | 09:02 | |
| *** dfg has joined #openstack-swift | 09:02 | |
| *** dickson.freenode.net sets mode: +vvvv torgomatic glange portante dfg | 09:02 | |
| *** mordred has joined #openstack-swift | 09:02 | |
| *** kragniz has joined #openstack-swift | 09:02 | |
| *** chmouel has joined #openstack-swift | 09:02 | |
| *** Diddi has joined #openstack-swift | 09:02 | |
| *** omame has joined #openstack-swift | 09:02 | |
| *** zigo has joined #openstack-swift | 09:02 | |
| *** mhu has joined #openstack-swift | 09:02 | |
| *** russellb has joined #openstack-swift | 09:02 | |
| *** Anticimex has joined #openstack-swift | 09:02 | |
| *** luisbg has joined #openstack-swift | 09:02 | |
| *** ahale has joined #openstack-swift | 09:02 | |
| *** zanc has joined #openstack-swift | 09:02 | |
| *** rpedde has joined #openstack-swift | 09:02 | |
| *** fbo_away has joined #openstack-swift | 09:02 | |
| *** ChanServ has joined #openstack-swift | 09:02 | |
| *** clayg has joined #openstack-swift | 09:02 | |
| *** dickson.freenode.net sets mode: +ov ChanServ clayg | 09:02 | |
| *** bvandenh has quit IRC | 09:02 | |
| *** fbo_away is now known as fbo | 09:05 | |
| *** nshaikh has joined #openstack-swift | 09:05 | |
| *** tanee-away is now known as tanee | 09:05 | |
| *** tanee is now known as tanee-away | 09:05 | |
| openstackgerrit | Fabien Boucher proposed a change to openstack/python-swiftclient: Allow get_account and get_container to return an iterator https://review.openstack.org/74845 | 09:14 |
| *** mlipchuk has joined #openstack-swift | 09:16 | |
| *** saju_m has quit IRC | 09:19 | |
| *** psharma has joined #openstack-swift | 09:25 | |
| *** tanee-away is now known as tanee | 09:30 | |
| *** saju_m has joined #openstack-swift | 09:34 | |
| *** jamieh has joined #openstack-swift | 09:42 | |
| *** psharma has quit IRC | 09:47 | |
| *** Trixboxer has joined #openstack-swift | 10:03 | |
| *** bada has quit IRC | 10:22 | |
| *** miurahr has joined #openstack-swift | 10:25 | |
| *** miurahr has quit IRC | 10:30 | |
| *** jamieh has quit IRC | 10:37 | |
| *** jamieh has joined #openstack-swift | 10:38 | |
| *** miurahr has joined #openstack-swift | 10:45 | |
| *** mkollaro has joined #openstack-swift | 10:49 | |
| *** 1JTAAJOSR has quit IRC | 10:49 | |
| *** bvandenh has joined #openstack-swift | 10:51 | |
| *** bvandenh has quit IRC | 10:59 | |
| *** foexle has joined #openstack-swift | 11:02 | |
| *** miurahr has quit IRC | 11:17 | |
| *** chandan_kumar has quit IRC | 11:25 | |
| *** nshaikh has quit IRC | 11:32 | |
| openstackgerrit | Christian Schwede proposed a change to openstack/swift: Add option to log container metadata https://review.openstack.org/67282 | 11:42 |
| *** psharma has joined #openstack-swift | 11:43 | |
| *** fbo is now known as fbo_away | 11:44 | |
| *** mtreinish_ has joined #openstack-swift | 11:48 | |
| *** mrsnivvel has quit IRC | 11:50 | |
| *** bada has joined #openstack-swift | 11:52 | |
| *** jamieh_ has joined #openstack-swift | 11:55 | |
| *** grapsus__ has joined #openstack-swift | 11:55 | |
| *** Alex_Gaynor_ has joined #openstack-swift | 11:55 | |
| *** mtreinish has quit IRC | 11:55 | |
| *** akscram has quit IRC | 11:56 | |
| *** mtreinish_ is now known as mtreinish | 11:56 | |
| *** Alex_Gaynor has quit IRC | 11:56 | |
| *** jamieh has quit IRC | 11:56 | |
| *** wer has quit IRC | 11:56 | |
| *** briancline has quit IRC | 11:56 | |
| *** grapsus_ has quit IRC | 11:57 | |
| *** briancline has joined #openstack-swift | 11:57 | |
| *** Dharmit has quit IRC | 11:57 | |
| *** ondergetekende has quit IRC | 11:57 | |
| *** ondergetekende has joined #openstack-swift | 11:57 | |
| *** Alex_Gaynor_ is now known as Alex_Gaynor | 11:57 | |
| *** wer has joined #openstack-swift | 11:58 | |
| *** tdasilva has joined #openstack-swift | 12:00 | |
| *** basha has quit IRC | 12:10 | |
| *** chandan_kumar has joined #openstack-swift | 12:11 | |
| *** dmsimard has joined #openstack-swift | 12:27 | |
| *** psharma has quit IRC | 12:44 | |
| *** bvandenh has joined #openstack-swift | 12:53 | |
| *** miurahr has joined #openstack-swift | 12:56 | |
| *** ppai has quit IRC | 13:03 | |
| *** cschwede- has quit IRC | 13:06 | |
| *** tsnider has joined #openstack-swift | 13:11 | |
| *** fbo_away is now known as fbo | 13:13 | |
| *** tsnider has left #openstack-swift | 13:13 | |
| *** tdasilva has left #openstack-swift | 13:23 | |
| *** tongli has joined #openstack-swift | 13:37 | |
| *** nosnos_ has quit IRC | 13:45 | |
| *** vuvu has joined #openstack-swift | 13:45 | |
| *** vu_ has joined #openstack-swift | 13:45 | |
| *** krtaylor has quit IRC | 13:46 | |
| *** akscram has joined #openstack-swift | 13:48 | |
| *** nosnos has joined #openstack-swift | 13:48 | |
| *** nosnos has quit IRC | 13:49 | |
| *** nosnos has joined #openstack-swift | 13:50 | |
| *** nosnos has quit IRC | 13:54 | |
| *** vu_ has quit IRC | 13:55 | |
| *** vuvu has quit IRC | 13:55 | |
| *** vuvu has joined #openstack-swift | 13:56 | |
| *** vu_ has joined #openstack-swift | 13:56 | |
| *** vu_ has quit IRC | 14:03 | |
| *** vuvu has quit IRC | 14:04 | |
| *** vu_ has joined #openstack-swift | 14:04 | |
| *** vuvu has joined #openstack-swift | 14:07 | |
| *** vu_ has quit IRC | 14:08 | |
| *** vu_ has joined #openstack-swift | 14:09 | |
| *** Dharmit has joined #openstack-swift | 14:09 | |
| *** vuvu has quit IRC | 14:12 | |
| *** vu_ has quit IRC | 14:14 | |
| *** saju_m has quit IRC | 14:15 | |
| *** vu_ has joined #openstack-swift | 14:19 | |
| *** vuvu has joined #openstack-swift | 14:19 | |
| *** vuvu has quit IRC | 14:19 | |
| *** vu_ has quit IRC | 14:19 | |
| *** vuvu has joined #openstack-swift | 14:20 | |
| *** vu_ has joined #openstack-swift | 14:20 | |
| *** vuvu has quit IRC | 14:25 | |
| *** vu_ has quit IRC | 14:25 | |
| *** vuvu has joined #openstack-swift | 14:34 | |
| *** vu_ has joined #openstack-swift | 14:34 | |
| *** krtaylor has joined #openstack-swift | 14:40 | |
| *** zaitcev has joined #openstack-swift | 14:47 | |
| *** ChanServ sets mode: +v zaitcev | 14:47 | |
| *** bvandenh has quit IRC | 14:48 | |
| *** dmsimard1 has joined #openstack-swift | 14:49 | |
| *** creiht_ is now known as creiht | 14:51 | |
| *** ChanServ sets mode: +v creiht | 14:51 | |
| *** dmsimard has quit IRC | 14:51 | |
| *** hurricanerix has joined #openstack-swift | 15:13 | |
| *** basha has joined #openstack-swift | 15:14 | |
| *** tdasilva has joined #openstack-swift | 15:14 | |
| *** Dharmit has quit IRC | 15:33 | |
| mjseger | does anyone know why swift has to be started as root? | 15:37 |
| luisbg | mjseger, I run it from my user in my box | 15:40 |
| mjseger | hmm... | 15:40 |
| luisbg | mjseger, if all the related files in /etc/swift/ are read/writeable by the user I don't see why you would need root | 15:41 |
| mjseger | are you saying you can start it w/o sudo? | 15:41 |
| mjseger | might there be some things that might not work as expected? | 15:41 |
| ahale | i'd guess it starts as root so proxies can bind to low ports and then drop privs later | 15:41 |
| luisbg | http://docs.openstack.org/developer/swift/development_saio.html | 15:42 |
| luisbg | startmain started as a user | 15:42 |
| mjseger | the big problem with doing this the /proc/pid/io structures aren't readable by non-root processes, a real negative for monitoring tools that can't run as root | 15:42 |
| luisbg | mjseger, what distribution is this? | 15:44 |
| mjseger | ubuntu | 15:45 |
| *** basha has quit IRC | 15:45 | |
| mjseger | the newer kernels introduced a security patch that only allows the owners or root to access process I/O stats | 15:46 |
| luisbg | mjseger, so you answered your own question ;) if you use ubuntu's process i/o stats for swift, you need to be root | 15:46 |
| luisbg | AFAIK fedora uses something different | 15:46 |
| *** Dharmit has joined #openstack-swift | 15:47 | |
| mjseger | but my point is swift actually does run as the swift user, but since it starts out as root you lose access to those stats, hence the question of why it has to start as root. | 15:48 |
| mjseger | the reason I care is I want ot be able to get data like this for our production servers but can only do so as root, something that's disallowed - http://paste.openstack.org/show/72632/ | 15:50 |
| mjseger | a real nifty way to get a summary of how much cpu/io each swift process is doing | 15:50 |
| *** chandan_kumar has quit IRC | 15:51 | |
| *** vuvu has quit IRC | 15:51 | |
| *** vu_ has quit IRC | 15:51 | |
| *** chandan_kumar has joined #openstack-swift | 15:57 | |
| *** kun_huang has joined #openstack-swift | 15:58 | |
| *** vu_ has joined #openstack-swift | 16:02 | |
| *** vuvu has joined #openstack-swift | 16:02 | |
| *** mkollaro has quit IRC | 16:02 | |
| *** jergerber has joined #openstack-swift | 16:04 | |
| *** vu_ has quit IRC | 16:06 | |
| *** vuvu has quit IRC | 16:06 | |
| *** Midnightmyth has joined #openstack-swift | 16:06 | |
| *** asselin_wfh has joined #openstack-swift | 16:07 | |
| *** asselin_wfh has left #openstack-swift | 16:07 | |
| *** vu_ has joined #openstack-swift | 16:08 | |
| *** vuvu has joined #openstack-swift | 16:08 | |
| *** vu_ has quit IRC | 16:08 | |
| *** vuvu has quit IRC | 16:08 | |
| *** vuvu has joined #openstack-swift | 16:08 | |
| *** vu_ has joined #openstack-swift | 16:08 | |
| *** vuvu has quit IRC | 16:13 | |
| *** vu_ has quit IRC | 16:13 | |
| *** vu_ has joined #openstack-swift | 16:14 | |
| *** vuvu has joined #openstack-swift | 16:14 | |
| *** dmsimard has joined #openstack-swift | 16:15 | |
| *** dmsimard1 has quit IRC | 16:17 | |
| *** vuvu has quit IRC | 16:18 | |
| *** vu_ has quit IRC | 16:19 | |
| *** vuvu has joined #openstack-swift | 16:21 | |
| *** vu_ has joined #openstack-swift | 16:21 | |
| notmyname | good morning | 16:24 |
| creiht | is it lunch time yet? | 16:24 |
| creiht | :) | 16:24 |
| luisbg | creiht, hahahaha | 16:34 |
| luisbg | notmyname, around? | 16:34 |
| notmyname | luisbg: what's up? | 16:35 |
| creiht | so I'm good now with the profiling middleware | 16:35 |
| creiht | https://review.openstack.org/#/c/53270/ | 16:35 |
| creiht | if someone else wouldn't mind taking a look at it | 16:35 |
| creiht | it would be highly appreciated | 16:35 |
| creiht | ;) | 16:35 |
| luisbg | notmyname, could we get the two commits that I have pending in gerrit through? there are conflicting changes bound to happen | 16:36 |
| luisbg | and I want to stop seeing those while I move to other things :) | 16:36 |
| notmyname | https://review.openstack.org/#/c/74578/ and https://review.openstack.org/#/c/76630/ | 16:37 |
| luisbg | notmyname, yes, those :) | 16:38 |
| luisbg | creiht, looking | 16:39 |
| luisbg | creiht, I wish I could see the entire diff in one page in gerrit, is there such a way? | 16:39 |
| luisbg | s/such a thing/a way | 16:39 |
| notmyname | there's a tiny gitweb link | 16:39 |
| luisbg | notmyname, oooh! it was well hidden | 16:40 |
| luisbg | much nicer | 16:40 |
| luisbg | creiht, extensive unit testing, nice :) | 16:41 |
| *** foexle has quit IRC | 16:42 | |
| creiht | luisbg: I didn't write it :) | 16:43 |
| creiht | but should be handy | 16:43 |
| luisbg | creiht, Zhang Hua | 16:43 |
| openstackgerrit | Christian Schwede proposed a change to openstack/swift: Add option to log container metadata https://review.openstack.org/67282 | 16:45 |
| *** gdrudy has joined #openstack-swift | 16:45 | |
| *** Dharmit has quit IRC | 16:46 | |
| *** gyee has joined #openstack-swift | 16:47 | |
| notmyname | creiht: thanks for the review. I'm looking at the other one | 16:50 |
| creiht | cool | 16:50 |
| creiht | I'll skip that one then :) | 16:50 |
| *** piyush has joined #openstack-swift | 16:51 | |
| openstackgerrit | Constantine Peresypkin proposed a change to openstack/swift: account to account copy implementation https://review.openstack.org/72157 | 16:55 |
| luisbg | creiht, thanks! Ñ= | 16:56 |
| luisbg | oops, wrong keyboard layout | 16:56 |
| luisbg | meant, :) | 16:56 |
| creiht | hah | 16:56 |
| luisbg | notmyname, thanks John! | 17:00 |
| luisbg | any low hanging fruit bugs I could assign to myself and play with? | 17:01 |
| notmyname | luisbg: torgomatic mentioned something to me yesterday about a few simple things he had come across. otherwise, you may want to work with mjseger about the small file request latencies he's been poking at | 17:06 |
| luisbg | notmyname, I've been following msjeger's benchmarking work | 17:06 |
| luisbg | will talk to him to see if his intention is to raise and fix, or just to raise to make the community aware | 17:07 |
| luisbg | torgomatic, could you tell me more about these few simple things you have come across? ^ (when you are around) | 17:07 |
| luisbg | notmyname, thanks for the suggestions :) | 17:08 |
| *** chandan_kumar has quit IRC | 17:16 | |
| *** krtaylor has quit IRC | 17:23 | |
| *** Trixboxer has quit IRC | 17:28 | |
| *** krtaylor has joined #openstack-swift | 17:30 | |
| *** openstackgerrit has quit IRC | 17:32 | |
| torgomatic | luisbg: I'm as curious as you are | 17:47 |
| notmyname | :-) | 17:47 |
| luisbg | torgomatic, hahahaha, wondering what notmyname is talking about? | 17:47 |
| * torgomatic has been working on other things recently, so has no context | 17:47 | |
| notmyname | luisbg: I probably mis-heard or mis-remembered. let's not bother torgomatic so that he can keep working on the last bit of storage policies :-) | 17:48 |
| torgomatic | hehe, "last" :D | 17:49 |
| luisbg | heh, 60% of the time, it is the last time | 17:51 |
| *** nacim_ has quit IRC | 17:58 | |
| *** kun_huang has quit IRC | 17:58 | |
| clayg | notmyname: he's not working on *just* storage policies - did you see that critical fix to remove all definitions of old-style clases!? | 17:59 |
| notmyname | why is it 10am and I already want a strong drink? | 18:00 |
| clayg | did someone say wsgi!? | 18:00 |
| notmyname | or CORS? | 18:00 |
| notmyname | oh, reminder that we aren't having a swift team meeting today. skip until next week | 18:01 |
| *** fbo is now known as fbo_away | 18:07 | |
| peluse | notmyname:" is that so we can drink instead? | 18:08 |
| *** tanee is now known as tanee-away | 18:10 | |
| *** openstackgerrit has joined #openstack-swift | 18:26 | |
| *** tong_ has joined #openstack-swift | 18:31 | |
| *** shri1 has joined #openstack-swift | 18:32 | |
| *** keving1 has joined #openstack-swift | 18:33 | |
| *** tongli has quit IRC | 18:33 | |
| *** csd has joined #openstack-swift | 18:36 | |
| *** kun_huang has joined #openstack-swift | 18:49 | |
| portante | notmyname: thanks for the reminder for no team meeting today | 18:50 |
| openstackgerrit | paul luse proposed a change to openstack/swift: Add Storage Policy Support to ssync https://review.openstack.org/65347 | 18:53 |
| *** early has quit IRC | 18:58 | |
| *** kun_huang has quit IRC | 18:59 | |
| *** openstackgerrit has quit IRC | 19:02 | |
| *** early has joined #openstack-swift | 19:04 | |
| *** jamieh_ has quit IRC | 19:22 | |
| portante | torgomatic: looking at https://review.openstack.org/71704, "Store policy index in container_stat table" | 19:29 |
| portante | Do you have a minute for some questions? | 19:29 |
| *** vuvu has quit IRC | 19:39 | |
| *** vu_ has quit IRC | 19:39 | |
| zaitcev | I rememeber that one, what's up? | 19:45 |
| portante | I am trying to understand the details behind the commit message, and why we need to store the policy index per object in that table | 19:48 |
| creiht | clayg: I dropped in a suggestion for the proxy refactor | 19:51 |
| clayg | portante: I think we're not going to have the policy index per object in the container in the first pass - but it would have been great, but maybe simpler without it | 19:52 |
| clayg | creiht: i hope you mean in the form of a push ;) j/k - thanks | 19:52 |
| clayg | creiht: you saw there was a depdendent patch too right? | 19:53 |
| portante | clayg: I am confused by the commit message and will go back and re-read to see how I arrived at that | 19:53 |
| clayg | portante: i'm calling in the boss to set us stright - stay on the line for torgomatic | 19:55 |
| torgomatic | hm... yeah, that one's commit message is probably somewhat wrong now... I used to have a plan | 19:55 |
| portante | ;0 | 19:55 |
| portante | :) | 19:55 |
| portante | and now? | 19:55 |
| torgomatic | but anyway, the thing is that the semantics of X-Storage-Policy-Index on replication are different from the metadata | 19:56 |
| torgomatic | namely, metadata keeps neweest, but X-SPI keeps oldest | 19:56 |
| torgomatic | so I didn't want to keep this thing in with the metadata, as that was just asking for trouble | 19:56 |
| creiht | clayg: no didn't see that part | 19:56 |
| dmsimard | Ceilometer with swift question.. I have ceilometer in my proxy-server pipeline and I get meters for bytes in, bytes out and API calls. There seems to be more meters than that - something to do with a pollster ? Am I missing something ? Ref: http://docs.openstack.org/developer/ceilometer/measurements.html#object-storage-swift | 19:56 |
| creiht | clayg: cool, I'll look at that real quick | 19:57 |
| creiht | clayg: re the diff, I can submit a push if you are cool with it | 19:57 |
| torgomatic | portante: in any case, this makes it much faster to get at the SPI for things, and it makes it possible to use in SQL triggers and such | 19:57 |
| creiht | just didn't want to stomp over your changes | 19:58 |
| clayg | creiht: could you ping redbo to chime in on your gist as well - I think it's about the same so if you guys both like that one better... | 19:58 |
| creiht | oh redbo made one as well? | 19:58 |
| clayg | creiht: no he was just just like "i don't like that part" | 19:58 |
| creiht | ahh | 19:58 |
| creiht | k | 19:58 |
| clayg | creiht: yeah no worries - thanks | 19:59 |
| portante | torgomatic: I read what you wrote, and it makes some sense to me, but I must be missing or not truly understanding because I still ask myself, but why do we need a column for the index? | 19:59 |
| clayg | portante: i.e. per object instead of only in the stats table? | 20:00 |
| creiht | clayg: I'll go ahead and push and see what redbo thinks | 20:00 |
| creiht | still easy to change to something else | 20:00 |
| creiht | or revert | 20:00 |
| clayg | creiht: right on! | 20:00 |
| torgomatic | portante: the comment talks (incorrectly) about stuff in the object table, which I don't think I want anymore, or at least not now | 20:01 |
| torgomatic | the code only puts it in the container_stat table | 20:01 |
| portante | yes | 20:01 |
| torgomatic | so, I definitely need to go make the commit message less wrong | 20:02 |
| torgomatic | portante: but does it make sense to put the new thing in container_stat? | 20:03 |
| portante | clayg, torgomatic this line of questioning seems to mean I don't really understand the container stat table, so lemme go look a bit deeper | 20:03 |
| torgomatic | k | 20:03 |
| zaitcev | wait, IIRC there was a moment in that patch when policy index cannot be gotten from configuration... Som kind of replication or whatnot. | 20:04 |
| zaitcev | stat table is just a bunch of meta, as I understand. It only has 1 row. | 20:04 |
| torgomatic | yes, one row only | 20:04 |
| zaitcev | so column header is key, content is value | 20:04 |
| portante | ah, I see the fetchone() on line 286, so that matches what I had hoped this was doing now | 20:05 |
| portante | great | 20:05 |
| *** dmsimard has quit IRC | 20:26 | |
| *** fbo_away is now known as fbo | 20:46 | |
| portante | notmyname, torgomatic, clayg, creiht: one of the concerns I have with the feature/ec branch is that our unit test coverage is uncomfortably low from my perspective | 20:48 |
| portante | that is to say, on master, I believe our unit test coverage is too low, and taking in the feature/ec work is likely to introduce a problem that might otherwise have been caught be better unit test coverage | 20:49 |
| portante | I realize that I have not been involved for about a good month here, so I am not intending this to be a critique of the work, but rather pointing out a liability that I think we can collectively solve by raising the bar on the coverage | 20:50 |
| clayg | reset | 20:56 |
| clayg | heh | 20:56 |
| *** shri1 has quit IRC | 21:02 | |
| *** vu has joined #openstack-swift | 21:05 | |
| *** vu has quit IRC | 21:06 | |
| *** vu has joined #openstack-swift | 21:07 | |
| *** shri has joined #openstack-swift | 21:10 | |
| *** vu has quit IRC | 21:11 | |
| portante | torgomatic, peluse, clayg, notmyname: regarding SP reviews, looks like there is a chain of patches that include a WIP and an OUTDATED in the change set, so I'll wait until that is resolved before continuing | 21:52 |
| portante | working on acc/cnt backends now | 21:52 |
| portante | zaitcev: ^^^ | 21:52 |
| torgomatic | portante: yeah... the start of that patch chain is probably reviewable, but the end... not so much | 21:52 |
| notmyname | portante: the first 3 are good | 21:53 |
| notmyname | oh wait, I think torgomatic merged it | 21:53 |
| portante | I reviewed those, so that we have a 2 company +2 on them | 21:54 |
| zaitcev | umm guys. SP is on its own branch. It can't possibly be not buildable | 21:54 |
| zaitcev | it's isolated from merges into master, with someone (Paul?) rebasing it once in a while | 21:54 |
| zaitcev | Branchfeature/ec | 21:54 |
| portante | zaitcev: what problem are you seeing with tit? | 21:56 |
| portante | it/ | 21:56 |
| portante | it? | 21:56 |
| zaitcev | I'm not | 21:56 |
| portante | oh, okay | 21:56 |
| zaitcev | but you said that rest of SP patches are outdated. How is that possible? | 21:56 |
| portante | from gerrit saying that the given patch set to review is based on a patch set that is no longer the latest in a dependent review | 21:56 |
| peluse | zaitcev: yes, we keep it up to date with master once per week (either me or torgomatic) | 21:57 |
| peluse | portante: sw your question about ssync and the upgrade story and I can take that check out and assume index 0 if not included - you are right I wasn't thikning of the case where a rolling upgrade what happening | 21:58 |
| torgomatic | zaitcev: someone pushes chain A -> B -> C -> D; someone else fixes bug in A creating A' and pushes A' -> B' -> C' but doesn't update D; now D is outdated | 21:59 |
| portante | peluse: I think there are two cases to consider | 22:00 |
| portante | old ssync to new ssync, new ssync to old ssync | 22:00 |
| portante | in the case of old to new, accepting the default should be okay, | 22:01 |
| portante | but I am not sure about new to old | 22:01 |
| *** fbo is now known as fbo_away | 22:01 | |
| portante | the new ssync sender should never be sending a not-default storage policy to an old receiver | 22:01 |
| portante | but not sure how to detect that off the top of my head | 22:02 |
| portante | perhaps gholt could weigh in here ... | 22:03 |
| torgomatic | what I'm doing for db replicator is, if ∃ only SP 0, send old-format sync command (a 7-tuple) | 22:03 |
| torgomatic | otherwise, send new-format sync command (an 8-tuple, with storage policy index the last one) | 22:03 |
| portante | what is that backwards "E" thing mean? | 22:04 |
| torgomatic | so it'll break if you define new storage policies before you're fully upgraded, but so will everything else | 22:04 |
| torgomatic | oh, sorry, "there exists" | 22:04 |
| portante | ah, thanks | 22:04 |
| torgomatic | it tends to creep into things I say when I've been taking paper notes | 22:04 |
| portante | cool that you can type it | 22:04 |
| portante | torgomatic: so that means we leave it up to the admin to ensure the entire environment is post-SP before they create new ones, and we don't have much in the way of code to help detect a bad situation | 22:06 |
| portante | just document it | 22:06 |
| peluse | so for ssync I think I just need the receivee to not puke if there's no index. | 22:06 |
| torgomatic | portante: yup | 22:06 |
| portante | seems okay, so peluse, just not puking would be good | 22:07 |
| torgomatic | there's precedent; if you haven't upgraded all your proxies but you push out configs referencing a new middleware, stuff blows up | 22:07 |
| portante | agreed | 22:07 |
| portante | in the case of ssync, I think we can detect the mismatch, though | 22:08 |
| peluse | portante: say a little more about that... | 22:09 |
| portante | new ssync send message to old ssync, which old ssync will die with a 500, it looks like | 22:10 |
| peluse | yes, you mean because of the raise I have there now right? | 22:11 |
| portante | so the sender could detect the 500 from the receiver and emit a log message warning the user that it does appear that all nodes have been upgraded | 22:11 |
| portante | peluse: actually, in the case of new to old, it is the old code that will 500 there, because the split() ends up with more items that the assignment is to | 22:12 |
| portante | if I understand the code correctly | 22:12 |
| peluse | ahhh... yes | 22:12 |
| peluse | that is correct sir | 22:12 |
| peluse | portante: I think I can catch that at the split before it 500's and log a warn there can't I? | 22:13 |
| portante | well | 22:14 |
| portante | can we change the "old" code? | 22:14 |
| peluse | I was thikning old to new again, not new to old... but that would be a neat trick :) | 22:15 |
| dfg | wow! neat! one of the gate tests is actually turning up a real problem! | 22:15 |
| portante | kewl | 22:15 |
| portante | dfg: what is the problem? | 22:15 |
| dfg | with my cors stuff. who runs: check-swift-dsvm-functional | 22:16 |
| portante | hmm, those are supposed to be the regular functional tests, no? | 22:16 |
| dfg | or where can I see the test code for that | 22:16 |
| portante | got a log to look at? | 22:17 |
| notmyname | ya, those are normal .functests, but running in devstack | 22:17 |
| dfg | oh- swif tfunc tests don't work? thats not nearly as fun... | 22:17 |
| dfg | haha- they are our tests. I just didn't run func tests with some setting not turned on or something. dern it. oh well. | 22:18 |
| peluse | portante: so for "old to new" I can keep the check I have but just log a warn instead of raising an error as it should be possible to complete the operation (only pol 0 can be valid from old->new) - whatcha think? | 22:18 |
| portante | I wonder what that setting is, or if it is keystone | 22:18 |
| portante | peluse: I would just default to 0, as it could never be the case that the new code would fail to send an spi | 22:19 |
| portante | and you can detect old to new by a split that is short | 22:19 |
| dfg | hmph- i thought it was some interoperability stuff for another system with requirements on swift- but its just me not running func tests with the default proxy-server.conf oh well. | 22:22 |
| portante | bummer, dfg, got all up and out of my chair over that one! :) | 22:24 |
| dfg | you'll learn. nobody around here listens to anything i ever say | 22:25 |
| peluse | portante: cool, on the rcv side I can jsut delete the checks I have now as the obj server PUT and DELETE methods will default to 0 already if the pol idx header is missing | 22:25 |
| portante | yes, I think so | 22:26 |
| *** Midnightmyth has quit IRC | 22:28 | |
| *** tong_ has quit IRC | 22:30 | |
| *** tdasilva has left #openstack-swift | 22:35 | |
| *** bada_ has joined #openstack-swift | 22:51 | |
| *** bada has quit IRC | 22:53 | |
| *** vu_ has joined #openstack-swift | 22:56 | |
| *** vu has joined #openstack-swift | 22:56 | |
| *** Midnightmyth has joined #openstack-swift | 23:00 | |
| *** openstack has joined #openstack-swift | 23:03 | |
| portante | torgomatic: in-process func tests are fun, huh? | 23:06 |
| portante | I did not want to make a ton of changes to how we run the func tests, so I keyed off the presence of the test.conf and swift.conf files to make it work | 23:07 |
| portante | might be a bad assumption in general, but on my SAIO I don't use tox, and on my development box I use tox, and don't have any system-wide swift configuration | 23:08 |
| torgomatic | portante: ah; I do all my testing (automated and manual) on my SAIO, so I have a swift.conf there | 23:09 |
| portante | rats | 23:09 |
| torgomatic | maybe an environment variable or something? | 23:09 |
| portante | from within in tox, or also for ./.functests type runs? | 23:10 |
| portante | the other downside to this is the static way the pipeline is constructed | 23:10 |
| portante | I did not try to solve that | 23:10 |
| portante | but the upside of seeing coverage for functional tests seems to be big for me | 23:11 |
| portante | certainly convenient for developers | 23:11 |
| torgomatic | oh, I'd certainly like to see coverage in functional tests, if only so I can combine that with unit-test coverage to see what's completely missing | 23:17 |
| portante | great, so to enable it, we can also check for an environment variable | 23:19 |
| portante | does that seem like it would avoid the problem you ran into? | 23:19 |
| portante | torgomatic: | 23:19 |
| torgomatic | portante: it sure does | 23:19 |
| portante | gotta name that ya like, I am not fond of naming things | 23:20 |
| * torgomatic has nothing | 23:22 | |
| *** jergerber has quit IRC | 23:24 | |
| *** bada_ has quit IRC | 23:25 | |
| *** bada has joined #openstack-swift | 23:25 | |
| *** hurricanerix has quit IRC | 23:34 | |
| *** piyush has quit IRC | 23:34 | |
| *** sungju has joined #openstack-swift | 23:45 | |
| *** sungju has quit IRC | 23:50 | |
| *** sungju has joined #openstack-swift | 23:52 | |
| *** sungju has quit IRC | 23:52 | |
| *** sungju has joined #openstack-swift | 23:52 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!