| *** awkwardpenguin has joined #openstack-swift | 00:00 | |
| *** awkwardpenguin has quit IRC | 00:04 | |
| *** kei_yama has quit IRC | 00:11 | |
| *** hoonetorg has quit IRC | 00:15 | |
| *** hoonetorg has joined #openstack-swift | 00:16 | |
| openstackgerrit | Samuel Merritt proposed openstack/swift master: Don't make async_pendings during object expiration https://review.openstack.org/532383 | 00:26 |
|---|---|---|
| *** tovin07_ has joined #openstack-swift | 00:44 | |
| *** saint_ has quit IRC | 00:59 | |
| *** mvk has quit IRC | 01:01 | |
| *** threestrands has quit IRC | 01:03 | |
| *** tovin07_ has quit IRC | 01:14 | |
| *** JimCheung has quit IRC | 01:24 | |
| *** JimCheung has joined #openstack-swift | 01:24 | |
| *** JimCheung has quit IRC | 01:25 | |
| *** JimCheung has joined #openstack-swift | 01:25 | |
| *** JimCheung has joined #openstack-swift | 01:26 | |
| *** m_kazuhiro has joined #openstack-swift | 01:36 | |
| m_kazuhiro | good morning | 01:36 |
| mattoliverau | m_kazuhiro: morning | 01:40 |
| *** rcernin has quit IRC | 01:42 | |
| m_kazuhiro | mattoliverau: morning | 01:42 |
| *** two_tired has joined #openstack-swift | 01:44 | |
| m_kazuhiro | mattoliverau: I want small discussion about general task queue. It is not about legacy problem and can be discussed without checking latest patch status. Do you have time now? | 01:46 |
| mattoliverau | sure | 01:47 |
| m_kazuhiro | mattoliverau: Thank you! | 01:47 |
| m_kazuhiro | mattoliverau: At sydney, we discussed making base class for task-executor daemon classes (e.g. expirer). | 01:48 |
| m_kazuhiro | mattoliverau: ^ to generalize implementation. | 01:48 |
| m_kazuhiro | mattoliverau: But I think base class should be implemented AFTER the expirer's general task queue patch. | 01:50 |
| *** rcernin has joined #openstack-swift | 01:50 | |
| m_kazuhiro | mattoliverau: In my current thought, the base class should be implemented AFTER expirer and tiering patch are merged. | 01:51 |
| mattoliverau | As i recall, the base class (thanks to kota_'s thinking) was to remove the need to pass around functions and keep things simpler. | 01:51 |
| m_kazuhiro | mattoliverau: yes. | 01:52 |
| mattoliverau | I like how the expirers patch is moving to the new task queue approach, and makes it simpler to review. So yeah the base class improvements can be added after. I guess you don't have to wait until it's merged, but maybe follow on (make the expirer) a dependency | 01:54 |
| m_kazuhiro | mattoliverau: OK. Thank you for your opinion. | 01:56 |
| mattoliverau | expirer patch currently gets us use to the new approach, to help people review and understand how it works. The task-executioner base classes, are good refacters tho. But I worry that they may make things a bit more confusing to reviewers if we add them to the current patch (and make the current patch harder to land). | 01:57 |
| mattoliverau | So yeah, I agree. Currently we only have the expirer that will use it.. so lets start using the new approach. Then have a smaller refactor patch (base classes) that can start leading the next set of task executioner daemons (policy migration, tiering, etc.). | 01:59 |
| mattoliverau | at least that's my opinion. Makes smaller and easier to grok reviews. And moves us forward. | 02:00 |
| m_kazuhiro | mattoliverau: Thank you for your agreement. OK. I continue implementing expirer patch without base class. | 02:06 |
| *** tovin07_ has joined #openstack-swift | 02:09 | |
| m_kazuhiro | mattoliverau: And If you check the current expirer patch status, please ping me (or add comments to the gerrit page). | 02:10 |
| *** m_kazuhiro has quit IRC | 02:34 | |
| *** m_kazuhiro has joined #openstack-swift | 02:34 | |
| *** JimCheung has quit IRC | 02:39 | |
| *** JimCheung has joined #openstack-swift | 02:40 | |
| *** JimCheung has quit IRC | 02:44 | |
| *** threestrands has joined #openstack-swift | 02:47 | |
| *** threestrands has quit IRC | 02:47 | |
| *** threestrands has joined #openstack-swift | 02:47 | |
| * kota_ is at his office | 02:48 | |
| *** gyee has quit IRC | 03:16 | |
| *** gkadam has joined #openstack-swift | 04:03 | |
| *** links has joined #openstack-swift | 04:25 | |
| mattoliverau | m_kazuhiro: I've done a review. Still want and need to look at the tests. | 04:31 |
| *** m_kazuhiro_ has joined #openstack-swift | 04:35 | |
| *** m_kazuhiro has quit IRC | 04:38 | |
| *** m_kazuhiro_ has quit IRC | 04:39 | |
| *** m_kazuhiro has joined #openstack-swift | 04:39 | |
| m_kazuhiro | mattoliverau: Thank you! I will reflect your comments. Do you agree with my answer comments about legacy problem which I wrote on patch set 4? | 04:50 |
| mattoliverau | m_kazuhiro: yeah, I'm ok with it. even if the single legacy node is slow, it's not playing catch up, it'll eventually clean it out. And we'd have already stopped serving expired objects. Worst case they may drain slower. But that's better then DDOSing the cluster :) So yeah, it's a good solution that works, and if concurrency is something the legacy scanner will need we can look at it then. But really it'll only be | 04:56 |
| mattoliverau | run until all the legacy containers are gone. | 04:56 |
| *** links has quit IRC | 04:56 | |
| *** links has joined #openstack-swift | 04:57 | |
| *** two_tired has quit IRC | 05:01 | |
| m_kazuhiro | mattoliverau: I'm happy to get your agreement :) | 05:03 |
| mattoliverau | we could probably just leave the process and processes stuff in and mark it only used for legacy support, then people can still tune up the legacy scanners. and get concurrecy if they want. | 05:09 |
| *** itlinux has quit IRC | 05:14 | |
| *** gkadam has quit IRC | 05:16 | |
| *** psachin has joined #openstack-swift | 05:21 | |
| *** psachin has quit IRC | 05:27 | |
| *** rcernin has quit IRC | 05:29 | |
| *** psachin has joined #openstack-swift | 05:35 | |
| m_kazuhiro | mattoliverau: That makes sense. I will restore process and processes. | 06:01 |
| *** hoonetorg has quit IRC | 06:08 | |
| *** armaan has quit IRC | 06:17 | |
| *** hoonetorg has joined #openstack-swift | 06:20 | |
| *** tovin07 has joined #openstack-swift | 06:32 | |
| *** threestrands has quit IRC | 07:00 | |
| *** threestrands has joined #openstack-swift | 07:01 | |
| *** threestrands has quit IRC | 07:01 | |
| *** threestrands has joined #openstack-swift | 07:01 | |
| *** threestrands has quit IRC | 07:02 | |
| *** threestrands has joined #openstack-swift | 07:03 | |
| *** threestrands has quit IRC | 07:03 | |
| *** threestrands has joined #openstack-swift | 07:03 | |
| *** threestrands has quit IRC | 07:04 | |
| *** threestrands has joined #openstack-swift | 07:04 | |
| *** armaan has joined #openstack-swift | 07:13 | |
| *** pcaruana has joined #openstack-swift | 07:21 | |
| *** kei_yama has joined #openstack-swift | 07:24 | |
| *** m_kazuhiro has quit IRC | 07:39 | |
| *** armaan has quit IRC | 07:41 | |
| *** armaan has joined #openstack-swift | 07:41 | |
| *** hseipp has joined #openstack-swift | 07:42 | |
| *** armaan has quit IRC | 07:46 | |
| *** m_kazuhiro has joined #openstack-swift | 07:46 | |
| *** armaan has joined #openstack-swift | 07:47 | |
| *** threestrands has quit IRC | 08:08 | |
| *** tesseract has joined #openstack-swift | 08:17 | |
| *** gkadam has joined #openstack-swift | 08:18 | |
| *** cshastri has joined #openstack-swift | 08:31 | |
| *** geaaru has joined #openstack-swift | 08:36 | |
| *** pcaruana has quit IRC | 08:44 | |
| *** links has quit IRC | 08:46 | |
| *** armaan has quit IRC | 08:47 | |
| *** armaan has joined #openstack-swift | 08:48 | |
| *** links has joined #openstack-swift | 08:59 | |
| *** cbartz has joined #openstack-swift | 09:00 | |
| *** m_kazuhiro has quit IRC | 09:09 | |
| *** armaan has quit IRC | 09:27 | |
| *** armaan has joined #openstack-swift | 09:27 | |
| *** armaan has quit IRC | 09:36 | |
| acoles | good morning | 09:39 |
| *** links has quit IRC | 09:51 | |
| *** hseipp has quit IRC | 09:52 | |
| *** hseipp has joined #openstack-swift | 09:56 | |
| *** armaan has joined #openstack-swift | 10:03 | |
| *** pcaruana has joined #openstack-swift | 10:04 | |
| *** links has joined #openstack-swift | 10:05 | |
| *** tovin07_ has quit IRC | 10:11 | |
| *** kei_yama has quit IRC | 10:12 | |
| *** mvk has joined #openstack-swift | 10:14 | |
| *** cshastri has quit IRC | 10:35 | |
| *** dr_gogeta86 has joined #openstack-swift | 10:39 | |
| *** dr_gogeta86 has quit IRC | 10:39 | |
| *** dr_gogeta86 has joined #openstack-swift | 10:39 | |
| *** cshastri has joined #openstack-swift | 10:48 | |
| *** pcaruana has quit IRC | 12:02 | |
| *** pcaruana|afk| has joined #openstack-swift | 12:02 | |
| openstackgerrit | Merged openstack/swift master: Show devices marked as deleted on empty rings https://review.openstack.org/530839 | 12:16 |
| openstackgerrit | Merged openstack/swift master: Change exit code when displaying empty rings https://review.openstack.org/532484 | 12:16 |
| openstackgerrit | Merged openstack/swift feature/deep: Add includes method to ShardRange https://review.openstack.org/530901 | 12:17 |
| *** portante has quit IRC | 12:24 | |
| *** mvk has quit IRC | 12:25 | |
| *** portante has joined #openstack-swift | 12:27 | |
| *** csmart has left #openstack-swift | 12:42 | |
| *** pcaruana|afk| has quit IRC | 12:49 | |
| *** pcaruana|afk| has joined #openstack-swift | 13:02 | |
| *** hseipp has quit IRC | 13:03 | |
| *** mvk has joined #openstack-swift | 13:26 | |
| *** brimestone has joined #openstack-swift | 13:53 | |
| *** brimestone has quit IRC | 14:22 | |
| *** psachin has quit IRC | 14:24 | |
| *** bkopilov has quit IRC | 14:58 | |
| *** cbartz has quit IRC | 15:13 | |
| *** cbartz has joined #openstack-swift | 15:18 | |
| *** saint_ has joined #openstack-swift | 15:18 | |
| *** cbartz has quit IRC | 15:24 | |
| *** cbartz has joined #openstack-swift | 15:26 | |
| *** hseipp has joined #openstack-swift | 15:30 | |
| openstackgerrit | Thiago da Silva proposed openstack/swift master: fix barbican integration https://review.openstack.org/532865 | 15:34 |
| tdasilva | mathiasb: if you have a chance, it would be great to get your review on ^^^ | 15:37 |
| *** itlinux has joined #openstack-swift | 15:37 | |
| *** links has quit IRC | 15:38 | |
| tdasilva | We should add a gate job that tests barbican+swift integration to try to catch these issues early on, hopefully before APIs are broken | 15:39 |
| *** itlinux has quit IRC | 15:47 | |
| *** bkopilov has joined #openstack-swift | 15:51 | |
| *** armaan has quit IRC | 16:04 | |
| *** itlinux has joined #openstack-swift | 16:08 | |
| *** saint_ has quit IRC | 16:14 | |
| *** armaan has joined #openstack-swift | 16:17 | |
| *** armaan has quit IRC | 16:21 | |
| *** chsc has joined #openstack-swift | 16:34 | |
| *** verto_ has left #openstack-swift | 16:43 | |
| *** armaan has joined #openstack-swift | 16:55 | |
| *** pcaruana|afk| has quit IRC | 16:57 | |
| *** cbartz has quit IRC | 17:11 | |
| *** geaaru has quit IRC | 17:16 | |
| *** links has joined #openstack-swift | 17:17 | |
| *** links has quit IRC | 17:17 | |
| *** JimCheung has joined #openstack-swift | 17:19 | |
| *** JimCheung has quit IRC | 17:19 | |
| *** JimCheung has joined #openstack-swift | 17:20 | |
| *** hseipp has quit IRC | 17:25 | |
| *** gkadam has quit IRC | 17:37 | |
| *** brimestone has joined #openstack-swift | 17:40 | |
| *** cshastri has quit IRC | 17:41 | |
| *** awkwardpenguin has joined #openstack-swift | 17:47 | |
| -openstackstatus- NOTICE: Due to an unexpected issue with zuulv3.o.o, we were not able to preserve running jobs for a restart. As a result, you'll need to recheck your previous patchsets | 17:48 | |
| *** jistr is now known as jistr|afk | 17:55 | |
| *** awkwardpenguin has quit IRC | 17:58 | |
| *** awkwardpenguin has joined #openstack-swift | 18:00 | |
| *** brimestone has quit IRC | 18:17 | |
| *** brimestone has joined #openstack-swift | 18:19 | |
| *** brimestone has quit IRC | 18:25 | |
| *** mvk has quit IRC | 18:32 | |
| *** tesseract has quit IRC | 18:45 | |
| *** brimestone has joined #openstack-swift | 18:57 | |
| *** awkwardpenguin has quit IRC | 19:02 | |
| *** hseipp has joined #openstack-swift | 19:10 | |
| *** awkwardpenguin has joined #openstack-swift | 19:15 | |
| *** gkadam has joined #openstack-swift | 19:17 | |
| *** awkwardpenguin has quit IRC | 19:20 | |
| *** hseipp has quit IRC | 19:21 | |
| *** itlinux has quit IRC | 19:26 | |
| mathiasb | tdasilva: I'll have a look! | 19:46 |
| mathiasb | tdasilva: did you resolve the issue you were seeing yesterday? | 19:46 |
| tdasilva | mathiasb: not yet, currently trying to re-create your environment | 19:46 |
| tdasilva | devstack env. | 19:46 |
| mathiasb | I just realized I still had 'sudo add-apt-repository -y cloud-archive:newton' instead of pike, I'm rerunning now to see if that makes a difference | 19:47 |
| tdasilva | mathiasb: ah cool, just made that change... | 19:49 |
| tdasilva | mathiasb: did you also change: DEVSTACK_BRANCH=stable/pike ? | 19:49 |
| mathiasb | yes, that I changed | 19:49 |
| tdasilva | mathiasb: cool, running now...ran against master but was getting some weird keystone errors and remembered that you mentioned running pike devstack | 19:51 |
| *** itlinux has joined #openstack-swift | 19:54 | |
| *** brimestone has quit IRC | 19:54 | |
| *** itlinux has quit IRC | 19:55 | |
| *** jistr|afk is now known as jistr | 19:57 | |
| *** armaan has quit IRC | 20:02 | |
| *** armaan has joined #openstack-swift | 20:03 | |
| *** mvk has joined #openstack-swift | 20:08 | |
| *** gkadam has quit IRC | 20:12 | |
| torgomatic | has anyone seen this unit test failure? FAIL: test_multiple_tier_dispersion (test.unit.common.ring.test_builder.TestRingBuilderDispersion) | 20:31 |
| torgomatic | full error: https://gist.github.com/smerritt/7dad7cacf8a4b12432557e326b3fa61d | 20:31 |
| torgomatic | it's blowing up in the gate sometimes, like http://logs.openstack.org/74/532174/1/gate/cross-swift-py27/cc370d3/job-output.txt.gz#_2018-01-11_20_07_17_851149 | 20:31 |
| openstackgerrit | Samuel Merritt proposed openstack/swift master: Limit object-expirer queue updates on object DELETE, PUT, POST https://review.openstack.org/532342 | 20:32 |
| openstackgerrit | Samuel Merritt proposed openstack/swift master: Don't make async_pendings during object expiration https://review.openstack.org/532383 | 20:32 |
| openstackgerrit | Clay Gerrard proposed openstack/swift master: Let recon-cron work with conf.d https://review.openstack.org/532696 | 20:36 |
| openstackgerrit | Samuel Merritt proposed openstack/swift master: Use X-Timestamp when checking object expiration https://review.openstack.org/532595 | 20:55 |
| *** bigdogstl has joined #openstack-swift | 20:56 | |
| *** bigdogstl has quit IRC | 21:15 | |
| clayg | torgomatic: IIRC that test did give me some greif... we should probably do a PYTHONHASHSEED loop and figure out the range... | 21:17 |
| clayg | for i in {1..100}; do PYTHONHASHSEED=$i nosetests swift/test/unit/common/ring/test_builder.py:TestRingBuilderDispersion.test_multiple_tier_dispersion -vsx; if [ $? -ne 0 ] ; then echo "failed with $i"; break; fi; done | 21:19 |
| clayg | running... | 21:19 |
| clayg | oh.. hrm... does that only effect dict order? i maybe be thinking of the wrong var... | 21:19 |
| clayg | well it failed anyway -> parts in 127.1.1.5 was 407 expected 401 | 21:21 |
| *** awkwardpenguin has joined #openstack-swift | 21:25 | |
| *** awkwardpenguin has quit IRC | 21:30 | |
| *** brimestone has joined #openstack-swift | 21:33 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift master: Recenter builder test expectation around random variance https://review.openstack.org/532978 | 21:37 |
| *** brimestone has quit IRC | 21:37 | |
| clayg | torgomatic: I added like a random.seed(os.environ['SEED']) kinda thing and ran it in a loop - increasing the delta by 1 probably would have also worked... but I think this is better | 21:37 |
| *** awkwardpenguin has joined #openstack-swift | 21:42 | |
| *** bigdogstl has joined #openstack-swift | 21:45 | |
| *** rcernin has joined #openstack-swift | 21:46 | |
| *** bigdogstl has quit IRC | 21:53 | |
| *** threestrands has joined #openstack-swift | 21:58 | |
| *** threestrands has quit IRC | 21:58 | |
| *** threestrands has joined #openstack-swift | 21:58 | |
| *** threestrands has quit IRC | 21:59 | |
| *** threestrands has joined #openstack-swift | 21:59 | |
| *** threestrands has quit IRC | 21:59 | |
| *** threestrands has joined #openstack-swift | 21:59 | |
| *** vint_bra has joined #openstack-swift | 22:00 | |
| *** threestrands has quit IRC | 22:00 | |
| *** threestrands has joined #openstack-swift | 22:01 | |
| *** threestrands has quit IRC | 22:02 | |
| *** gyee has joined #openstack-swift | 22:02 | |
| *** threestrands has joined #openstack-swift | 22:02 | |
| mattoliverau | morning | 22:12 |
| *** bigdogstl has joined #openstack-swift | 22:12 | |
| *** awkwardpenguin has quit IRC | 22:12 | |
| *** bigdogstl has quit IRC | 22:26 | |
| *** bigdogstl has joined #openstack-swift | 22:26 | |
| *** itlinux has joined #openstack-swift | 22:30 | |
| openstackgerrit | Clay Gerrard proposed openstack/swift master: Remove un-needed hack in probetest https://review.openstack.org/533000 | 22:34 |
| *** neonpastor has quit IRC | 22:51 | |
| *** early has quit IRC | 22:51 | |
| *** early has joined #openstack-swift | 22:51 | |
| *** neonpastor has joined #openstack-swift | 22:52 | |
| *** vint_bra has quit IRC | 22:53 | |
| *** Jeffrey4l has quit IRC | 22:53 | |
| *** itlinux has quit IRC | 22:55 | |
| *** Jeffrey4l has joined #openstack-swift | 22:56 | |
| *** itlinux has joined #openstack-swift | 22:57 | |
| *** itlinux has quit IRC | 23:12 | |
| *** bigdogstl has quit IRC | 23:19 | |
| *** bigdogstl has joined #openstack-swift | 23:31 | |
| *** kei_yama has joined #openstack-swift | 23:36 | |
| *** bigdogstl has quit IRC | 23:36 | |
| *** chsc has quit IRC | 23:39 | |
| *** bigdogstl has joined #openstack-swift | 23:46 | |
| *** armaan has quit IRC | 23:53 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!