Tuesday, 2016-04-05

*** haomaiwang has quit IRC00:01
*** haomaiwang has joined #openstack-swift00:01
*** shakamunyi has joined #openstack-swift00:03
*** shakamunyi has quit IRC00:09
*** asettle has quit IRC00:10
*** dmorita has quit IRC00:13
*** garthb has quit IRC00:14
*** dmorita has joined #openstack-swift00:15
*** asettle has joined #openstack-swift00:18
*** Jeffrey4l__ has joined #openstack-swift00:18
*** _JZ_ has quit IRC00:23
notmynametimburke: cschwede: do the To Do steps in https://etherpad.openstack.org/p/swift-rolling-upgrade-multinode-testing look correct?00:31
*** shakamunyi has joined #openstack-swift00:31
*** jethrosun has quit IRC00:37
*** jamielennox|away is now known as jamielennox00:41
kota_good morning00:41
*** asettle has quit IRC00:42
*** shakamunyi has quit IRC00:47
*** diogogmt has quit IRC00:49
*** haomaiwang has quit IRC01:01
*** haomaiwang has joined #openstack-swift01:01
*** arch-nemesis has quit IRC01:02
*** shakamunyi has joined #openstack-swift01:04
kota_tdasilva, acoles: sure for patch 260179, and it looked to get merge conflict with versioned_writes upgrade bug fix :/01:07
patchbotkota_: https://review.openstack.org/#/c/260179/ - swift - decouple versioned writes from COPY01:07
*** asettle has joined #openstack-swift01:08
*** klrmn has quit IRC01:13
tdasilvakota_: sending update now01:18
kota_tdasilva: great, quick work :)01:22
tdasilvakota_: yeah, i'm also applying changes based on your review01:23
kota_tdasilva: will look at again today.01:23
kota_tdasilva: thx!01:23
tdasilvaok, thanks!01:23
*** lyrrad has quit IRC01:34
*** mwheckmann has joined #openstack-swift01:36
*** jamielennox is now known as jamielennox|away01:41
*** jamielennox|away is now known as jamielennox01:44
*** esker has joined #openstack-swift01:47
*** jethrosun has joined #openstack-swift01:48
*** NM has joined #openstack-swift01:56
*** diogogmt has joined #openstack-swift01:58
*** haomaiwang has quit IRC02:01
*** haomaiwang has joined #openstack-swift02:01
openstackgerritThiago da Silva proposed openstack/swift: decouple versioned writes from COPY  https://review.openstack.org/26017902:06
*** haomaiwang has quit IRC02:08
*** klrmn has joined #openstack-swift02:15
*** mingdang1 has joined #openstack-swift02:24
*** esker has quit IRC02:27
*** mingdang1 has quit IRC02:28
*** haomaiwang has joined #openstack-swift02:38
*** baojg has joined #openstack-swift02:45
*** esker has joined #openstack-swift02:47
*** asettle has quit IRC02:48
*** esker has quit IRC02:50
*** esker has joined #openstack-swift02:50
*** haomaiwang has quit IRC02:58
*** haomaiwang has joined #openstack-swift02:58
*** ankur has joined #openstack-swift03:00
*** haomaiwang has quit IRC03:01
*** tqtran has quit IRC03:01
*** haomaiwa_ has joined #openstack-swift03:01
*** dmorita has quit IRC03:10
*** mwheckmann has quit IRC03:14
*** sekrit has joined #openstack-swift03:17
*** dmorita has joined #openstack-swift03:30
*** NM has quit IRC03:32
*** dmorita has quit IRC03:35
*** links has joined #openstack-swift03:39
*** klrmn has quit IRC03:50
*** klrmn has joined #openstack-swift03:53
*** tqtran has joined #openstack-swift03:59
*** haomaiwa_ has quit IRC04:01
*** haomaiwa_ has joined #openstack-swift04:01
*** silor has joined #openstack-swift04:03
*** tqtran has quit IRC04:03
*** kei_yama has quit IRC04:06
*** kei_yama has joined #openstack-swift04:09
*** garthb has joined #openstack-swift04:09
*** klrmn has quit IRC04:11
*** esker has quit IRC04:20
*** furlongm has quit IRC04:20
*** klrmn has joined #openstack-swift04:21
*** esker has joined #openstack-swift04:25
*** asettle has joined #openstack-swift04:30
*** haomaiwa_ has quit IRC04:42
*** ChubYann has quit IRC04:43
*** ppai has joined #openstack-swift04:44
*** garthb has quit IRC04:46
*** asettle has quit IRC04:46
*** jethrosun has quit IRC04:50
*** furlongm has joined #openstack-swift04:52
*** asettle has joined #openstack-swift04:53
*** SkyRocknRoll has joined #openstack-swift04:55
*** tqtran has joined #openstack-swift05:00
*** haomaiwang has joined #openstack-swift05:01
*** tqtran has quit IRC05:04
*** zaitcev has quit IRC05:21
*** esker has quit IRC05:26
*** jamielennox is now known as jamielennox|away05:27
*** mingdang1 has joined #openstack-swift05:37
*** esker has joined #openstack-swift05:47
*** jethrosun has joined #openstack-swift05:51
*** rcernin has joined #openstack-swift05:51
*** esker has quit IRC05:52
*** kei_yama has quit IRC05:54
*** kei_yama has joined #openstack-swift05:54
*** jethrosun has quit IRC05:56
*** haomaiwang has quit IRC06:01
*** haomaiwang has joined #openstack-swift06:01
*** esker has joined #openstack-swift06:08
*** mingdang1 has quit IRC06:10
*** esker has quit IRC06:12
*** haomaiwang has quit IRC07:01
*** haomaiwang has joined #openstack-swift07:01
*** rledisez has joined #openstack-swift07:06
*** mmcardle has joined #openstack-swift07:08
*** klrmn has quit IRC07:21
*** asettle has quit IRC07:29
*** pcaruana has joined #openstack-swift07:38
*** sheel has joined #openstack-swift07:38
*** jethrosun has joined #openstack-swift07:39
*** jmccarthy has quit IRC07:39
*** jmccarthy has joined #openstack-swift07:40
*** asettle has joined #openstack-swift07:41
*** jistr has joined #openstack-swift07:44
*** jethrosun has quit IRC07:45
*** asettle has quit IRC07:47
*** jordanP has joined #openstack-swift07:59
*** haomaiwang has quit IRC08:01
*** tqtran has joined #openstack-swift08:01
*** jistr has quit IRC08:01
*** haomaiwang has joined #openstack-swift08:01
*** jistr has joined #openstack-swift08:01
*** tqtran has quit IRC08:05
*** mvk_ has quit IRC08:19
*** acoles_ is now known as acoles08:21
*** daemontool has joined #openstack-swift08:31
*** chlong has quit IRC08:35
*** mvk_ has joined #openstack-swift08:45
*** hosanai has quit IRC08:55
*** acoles is now known as acoles_08:57
kota_tdasilva: I'm still working on reviewing patch 260179. It looks almostly good but I didn't have a time to test in actual environ so I'm willing to work for that in this week. thanks.08:58
patchbotkota_: https://review.openstack.org/#/c/260179/ - swift - decouple versioned writes from COPY08:58
*** haomaiwang has quit IRC09:01
*** haomaiwang has joined #openstack-swift09:01
*** stantonnet has quit IRC09:04
*** stantonnet has joined #openstack-swift09:05
*** mingdang1 has joined #openstack-swift09:06
*** dmorita has joined #openstack-swift09:11
*** dmorita has quit IRC09:16
*** NM has joined #openstack-swift09:27
*** jethrosun has joined #openstack-swift09:27
*** NM has quit IRC09:32
*** jethrosun has quit IRC09:32
*** silor has quit IRC09:41
*** kei_yama has quit IRC09:41
*** baojg has quit IRC09:42
*** baojg has joined #openstack-swift09:43
*** asettle has joined #openstack-swift09:50
*** baojg has quit IRC09:51
*** baojg has joined #openstack-swift09:52
*** klrmn has joined #openstack-swift09:55
*** SkyRocknRoll has quit IRC09:56
*** haomaiwang has quit IRC10:01
*** haomaiwang has joined #openstack-swift10:01
*** SkyRocknRoll has joined #openstack-swift10:10
*** asettle has quit IRC10:16
*** Jeffrey4l__ is now known as Jeffrey4l10:32
*** acoles_ is now known as acoles10:36
*** SkyRocknRoll has quit IRC10:51
*** asettle has joined #openstack-swift10:59
*** haomaiwang has quit IRC11:01
*** haomaiwang has joined #openstack-swift11:01
*** asettle has quit IRC11:03
*** jethrosun has joined #openstack-swift11:16
*** jethrosun has quit IRC11:21
*** SkyRocknRoll has joined #openstack-swift11:22
*** km has quit IRC11:30
*** baojg has quit IRC11:34
*** mvk_ has quit IRC11:35
*** asettle has joined #openstack-swift11:41
*** asettle has quit IRC11:46
*** mvk_ has joined #openstack-swift11:48
*** mmcardle has quit IRC11:58
*** haomaiwang has quit IRC12:01
*** haomaiwang has joined #openstack-swift12:01
*** cdelatte has joined #openstack-swift12:04
tdasilvakota_: thanks!12:09
*** dmorita has joined #openstack-swift12:12
*** dmorita has quit IRC12:17
*** SkyRocknRoll has quit IRC12:19
acolestdasilva: morning. i saw some more opportunities to simplify (I hope!) the putters. new version coming later today.12:22
tdasilvaacoles: sounds great! I'll keep an eye out for it.12:31
tdasilvaacoles, jrichli: where do I find a list of crypto patches to review? is this still a good list? https://etherpad.openstack.org/p/swift-hackathon-feb-2016-encryption12:31
acolestdasilva: i believe it is, i just struck out last one we merged12:33
acolestdasilva: they are listed here too12:33
acoleshttps://wiki.openstack.org/wiki/Swift/PriorityReviews12:33
tdasilvaacoles: ok, great, i'll start looking at that...12:34
*** mmcardle has joined #openstack-swift12:35
*** mwheckmann has joined #openstack-swift12:37
*** ankur has quit IRC12:41
*** asettle has joined #openstack-swift12:45
*** asettle has quit IRC12:46
*** jethrosun has joined #openstack-swift12:48
*** ppai has quit IRC12:54
*** klrmn has quit IRC12:55
*** haomaiwang has quit IRC13:01
*** haomaiwang has joined #openstack-swift13:01
*** pauloewerton has joined #openstack-swift13:07
*** NM has joined #openstack-swift13:08
*** nottrobin_ has joined #openstack-swift13:15
*** dfg_ has joined #openstack-swift13:17
*** mwheckmann has quit IRC13:21
*** nottrobin has quit IRC13:21
*** dfg has quit IRC13:21
*** darrenc has quit IRC13:21
*** CrackerJackMack has quit IRC13:21
*** fbo has quit IRC13:21
*** dmellado has quit IRC13:21
*** kota_ has quit IRC13:21
*** janonymous has quit IRC13:21
*** pauloewerton has quit IRC13:21
*** daemontool has quit IRC13:21
*** sanchitmalhotra has quit IRC13:21
*** amit213 has quit IRC13:21
*** mtreinish has quit IRC13:21
*** dcourtois has quit IRC13:21
*** wbhuber has quit IRC13:21
*** dabukalam has quit IRC13:21
*** NM has quit IRC13:21
*** rcernin has quit IRC13:21
*** wer has quit IRC13:21
*** Lickitysplitted has quit IRC13:21
*** raginbajin has quit IRC13:21
*** Guest88568 has quit IRC13:21
*** hurricanerix has quit IRC13:21
*** csmart has quit IRC13:21
*** treyd has quit IRC13:21
*** timburke has quit IRC13:21
*** hrou has quit IRC13:21
*** tonyb has quit IRC13:21
*** john_bar has quit IRC13:21
*** jmccarthy has quit IRC13:21
*** shakamunyi has quit IRC13:21
*** zul has quit IRC13:21
*** marcusvrn_ has quit IRC13:21
*** sileht has quit IRC13:21
*** mmotiani has quit IRC13:21
*** sgundur has quit IRC13:21
*** tmoreira_ has quit IRC13:21
*** yarkot has quit IRC13:21
*** swiftfan has quit IRC13:21
*** jroll has quit IRC13:21
*** dosaboy has quit IRC13:21
*** EmilienM has quit IRC13:21
*** cppforlife_ has quit IRC13:21
*** mlanner has quit IRC13:21
*** bwall has quit IRC13:21
*** briancurtin has quit IRC13:21
*** siva_krishnan has quit IRC13:21
*** StevenK has quit IRC13:21
*** acoles has quit IRC13:21
*** haomaiwang has quit IRC13:21
*** jethrosun has quit IRC13:21
*** mingdang1 has quit IRC13:21
*** bapalm has quit IRC13:21
*** logan- has quit IRC13:21
*** philipw has quit IRC13:21
*** onovy has quit IRC13:21
*** kozhukalov has quit IRC13:21
*** flaper87 has quit IRC13:21
*** zacksh has quit IRC13:21
*** tristanC has quit IRC13:21
*** _fortis has quit IRC13:21
*** kaleta has quit IRC13:21
*** jlhinson_ has quit IRC13:21
*** pcaruana has quit IRC13:21
*** MooingLemur has quit IRC13:21
*** openstackgerrit has quit IRC13:21
*** charz has quit IRC13:21
*** hogepodge has quit IRC13:21
*** sw3 has quit IRC13:21
*** sbezverk has quit IRC13:21
*** sc has quit IRC13:21
*** tanee has quit IRC13:21
*** BAKfr has quit IRC13:21
*** cebruns has quit IRC13:21
*** mvk_ has quit IRC13:21
*** swat30 has quit IRC13:21
*** early has quit IRC13:21
*** hugokuo has quit IRC13:21
*** mathiasb has quit IRC13:21
*** dmsimard has quit IRC13:21
*** remix_tj has quit IRC13:21
*** aerwin3 has quit IRC13:21
*** redbo has quit IRC13:21
*** ahale has quit IRC13:21
*** wolsen has quit IRC13:21
*** HenryG has quit IRC13:21
*** zackmdavis has quit IRC13:21
*** mmcardle has quit IRC13:21
*** rledisez has quit IRC13:21
*** bhakta has quit IRC13:21
*** patchbot has quit IRC13:21
*** ntt has quit IRC13:21
*** JelleB has quit IRC13:21
*** cschwede has quit IRC13:21
*** clarkb has quit IRC13:21
*** notmyname has quit IRC13:21
*** amandap has quit IRC13:21
*** zigo has quit IRC13:21
*** Skaag has quit IRC13:21
*** sekrit has quit IRC13:21
*** ndk has quit IRC13:21
*** ChanServ has quit IRC13:21
*** david-lyle has quit IRC13:21
*** jeblair has quit IRC13:22
*** lifeless has quit IRC13:22
*** acorwin_ has quit IRC13:22
*** christian has quit IRC13:22
*** tamizh_geek has quit IRC13:22
*** rsFF has quit IRC13:22
*** cdelatte has quit IRC13:22
*** furlongm has quit IRC13:22
*** diogogmt has quit IRC13:22
*** natarej has quit IRC13:22
*** thurloat has quit IRC13:22
*** stevemar has quit IRC13:22
*** rushiagr has quit IRC13:22
*** briancline has quit IRC13:22
*** ajiang has quit IRC13:22
*** serverascode has quit IRC13:22
*** joearnold has quit IRC13:22
*** wanghua has quit IRC13:22
*** zhiyan has quit IRC13:22
*** pchng has quit IRC13:22
*** peterlisak has quit IRC13:22
*** jaakkos has quit IRC13:22
*** tdasilva has quit IRC13:22
*** mahatic has quit IRC13:22
*** mariusv has quit IRC13:22
*** blair has quit IRC13:22
*** jistr has quit IRC13:22
*** Jeffrey4l has quit IRC13:22
*** Anticimex has quit IRC13:22
*** urth has quit IRC13:22
*** gmmaha has quit IRC13:22
*** iurygregory has quit IRC13:22
*** portante has quit IRC13:22
*** anderstj has quit IRC13:22
*** coreycb has quit IRC13:22
*** torgomatic has quit IRC13:22
*** glange has quit IRC13:22
*** okdas has quit IRC13:22
*** ctennis has quit IRC13:22
*** balajir has quit IRC13:22
*** AbyssOne has quit IRC13:22
*** clayg has quit IRC13:22
*** stantonnet has quit IRC13:22
*** sheel has quit IRC13:22
*** andymccr has quit IRC13:22
*** saltsa_ has quit IRC13:22
*** jordanP has quit IRC13:22
*** number80 has quit IRC13:22
*** alpha_ori has quit IRC13:22
*** ejat has quit IRC13:22
*** chrisnelson has quit IRC13:22
*** swifterdarrell has quit IRC13:22
*** jlvillal has quit IRC13:22
*** j_king_ has quit IRC13:22
*** ekarlso- has quit IRC13:22
*** kragniz has quit IRC13:22
*** pdardeau has quit IRC13:22
*** btorch has quit IRC13:22
*** bobby2 has quit IRC13:22
*** jidar has quit IRC13:22
*** nottrobin_ is now known as nottrobin13:22
*** CrackerJ- has joined #openstack-swift13:24
*** darrenc_ has joined #openstack-swift13:24
*** mwheckma1n has joined #openstack-swift13:24
*** NM has joined #openstack-swift13:24
*** pauloewerton has joined #openstack-swift13:24
*** haomaiwang has joined #openstack-swift13:24
*** jethrosun has joined #openstack-swift13:24
*** mmcardle has joined #openstack-swift13:24
*** cdelatte has joined #openstack-swift13:24
*** mvk_ has joined #openstack-swift13:24
*** stantonnet has joined #openstack-swift13:24
*** daemontool has joined #openstack-swift13:24
*** jistr has joined #openstack-swift13:24
*** jordanP has joined #openstack-swift13:24
*** jmccarthy has joined #openstack-swift13:24
*** sheel has joined #openstack-swift13:24
*** pcaruana has joined #openstack-swift13:24
*** rledisez has joined #openstack-swift13:24
*** rcernin has joined #openstack-swift13:24
*** furlongm has joined #openstack-swift13:24
*** sekrit has joined #openstack-swift13:24
*** diogogmt has joined #openstack-swift13:24
*** shakamunyi has joined #openstack-swift13:24
*** Jeffrey4l has joined #openstack-swift13:24
*** natarej has joined #openstack-swift13:24
*** david-lyle has joined #openstack-swift13:24
*** MooingLemur has joined #openstack-swift13:24
*** number80 has joined #openstack-swift13:24
*** thurloat has joined #openstack-swift13:24
*** swat30 has joined #openstack-swift13:24
*** sbezverk has joined #openstack-swift13:24
*** sgundur has joined #openstack-swift13:24
*** zul has joined #openstack-swift13:24
*** sanchitmalhotra has joined #openstack-swift13:24
*** marcusvrn_ has joined #openstack-swift13:24
*** openstackgerrit has joined #openstack-swift13:24
*** wer has joined #openstack-swift13:24
*** alpha_ori has joined #openstack-swift13:24
*** charz has joined #openstack-swift13:24
*** ejat has joined #openstack-swift13:24
*** bapalm has joined #openstack-swift13:24
*** Anticimex has joined #openstack-swift13:24
*** amit213 has joined #openstack-swift13:24
*** stevemar has joined #openstack-swift13:24
*** urth has joined #openstack-swift13:24
*** fbo has joined #openstack-swift13:24
*** logan- has joined #openstack-swift13:24
*** Skaag has joined #openstack-swift13:24
*** philipw has joined #openstack-swift13:24
*** chrisnelson has joined #openstack-swift13:24
*** iurygregory has joined #openstack-swift13:24
*** mtreinish has joined #openstack-swift13:24
*** gmmaha has joined #openstack-swift13:24
*** early has joined #openstack-swift13:24
*** rushiagr has joined #openstack-swift13:24
*** briancline has joined #openstack-swift13:24
*** sileht has joined #openstack-swift13:24
*** ajiang has joined #openstack-swift13:24
*** bhakta has joined #openstack-swift13:24
*** hogepodge has joined #openstack-swift13:24
*** swifterdarrell has joined #openstack-swift13:24
*** patchbot has joined #openstack-swift13:24
*** sw3 has joined #openstack-swift13:24
*** andymccr has joined #openstack-swift13:24
*** jlvillal has joined #openstack-swift13:24
*** ntt has joined #openstack-swift13:24
*** serverascode has joined #openstack-swift13:24
*** onovy has joined #openstack-swift13:24
*** dmellado has joined #openstack-swift13:24
*** jeblair has joined #openstack-swift13:24
*** hugokuo has joined #openstack-swift13:24
*** joearnold has joined #openstack-swift13:24
*** mathiasb has joined #openstack-swift13:24
*** Lickitysplitted has joined #openstack-swift13:24
*** wanghua has joined #openstack-swift13:24
*** raginbajin has joined #openstack-swift13:24
*** zhiyan has joined #openstack-swift13:24
*** pchng has joined #openstack-swift13:24
*** mmotiani has joined #openstack-swift13:24
*** JelleB has joined #openstack-swift13:24
*** saltsa_ has joined #openstack-swift13:24
*** sc has joined #openstack-swift13:24
*** dmsimard has joined #openstack-swift13:24
*** siva_krishnan has joined #openstack-swift13:24
*** kozhukalov has joined #openstack-swift13:24
*** lifeless has joined #openstack-swift13:24
*** Guest88568 has joined #openstack-swift13:24
*** hurricanerix has joined #openstack-swift13:24
*** flaper87 has joined #openstack-swift13:24
*** csmart has joined #openstack-swift13:24
*** kota_ has joined #openstack-swift13:24
*** zacksh has joined #openstack-swift13:24
*** wolfe.freenode.net sets mode: +vv swifterdarrell kota_13:24
*** clarkb has joined #openstack-swift13:24
*** acorwin_ has joined #openstack-swift13:24
*** tanee has joined #openstack-swift13:24
*** peterlisak has joined #openstack-swift13:24
*** tristanC has joined #openstack-swift13:24
*** tmoreira_ has joined #openstack-swift13:24
*** j_king_ has joined #openstack-swift13:24
*** john_bar has joined #openstack-swift13:24
*** jaakkos has joined #openstack-swift13:24
*** ekarlso- has joined #openstack-swift13:24
*** yarkot has joined #openstack-swift13:24
*** tdasilva has joined #openstack-swift13:24
*** BAKfr has joined #openstack-swift13:24
*** _fortis has joined #openstack-swift13:24
*** treyd has joined #openstack-swift13:24
*** christian has joined #openstack-swift13:24
*** kaleta has joined #openstack-swift13:24
*** mahatic has joined #openstack-swift13:24
*** cebruns has joined #openstack-swift13:24
*** ahale has joined #openstack-swift13:24
*** tamizh_geek has joined #openstack-swift13:24
*** remix_tj has joined #openstack-swift13:24
*** swiftfan has joined #openstack-swift13:24
*** jroll has joined #openstack-swift13:24
*** aerwin3 has joined #openstack-swift13:24
*** mariusv has joined #openstack-swift13:24
*** dosaboy has joined #openstack-swift13:24
*** dabukalam has joined #openstack-swift13:24
*** wbhuber has joined #openstack-swift13:24
*** dcourtois has joined #openstack-swift13:24
*** cschwede has joined #openstack-swift13:24
*** redbo has joined #openstack-swift13:24
*** timburke has joined #openstack-swift13:24
*** wolfe.freenode.net sets mode: +vvvv tdasilva cschwede redbo timburke13:24
*** jlhinson_ has joined #openstack-swift13:24
*** jidar has joined #openstack-swift13:24
*** EmilienM has joined #openstack-swift13:24
*** rsFF has joined #openstack-swift13:24
*** notmyname has joined #openstack-swift13:24
*** cppforlife_ has joined #openstack-swift13:24
*** kragniz has joined #openstack-swift13:24
*** wolsen has joined #openstack-swift13:24
*** blair has joined #openstack-swift13:24
*** hrou has joined #openstack-swift13:24
*** HenryG has joined #openstack-swift13:24
*** portante has joined #openstack-swift13:24
*** wolfe.freenode.net sets mode: +v notmyname13:24
*** tonyb has joined #openstack-swift13:24
*** zackmdavis has joined #openstack-swift13:24
*** mlanner has joined #openstack-swift13:24
*** bwall has joined #openstack-swift13:24
*** briancurtin has joined #openstack-swift13:24
*** acoles has joined #openstack-swift13:24
*** StevenK has joined #openstack-swift13:24
*** amandap has joined #openstack-swift13:24
*** pdardeau has joined #openstack-swift13:24
*** btorch has joined #openstack-swift13:24
*** anderstj has joined #openstack-swift13:24
*** coreycb has joined #openstack-swift13:24
*** torgomatic has joined #openstack-swift13:24
*** glange has joined #openstack-swift13:24
*** zigo has joined #openstack-swift13:24
*** okdas has joined #openstack-swift13:24
*** ctennis has joined #openstack-swift13:24
*** bobby2 has joined #openstack-swift13:24
*** balajir has joined #openstack-swift13:24
*** AbyssOne has joined #openstack-swift13:24
*** ndk has joined #openstack-swift13:24
*** clayg has joined #openstack-swift13:24
*** wolfe.freenode.net sets mode: +vvvv acoles torgomatic glange clayg13:24
*** ChanServ has joined #openstack-swift13:24
*** wolfe.freenode.net sets mode: +o ChanServ13:24
*** nottrobin has quit IRC13:24
*** nottrobin has joined #openstack-swift13:24
*** openstackstatus has quit IRC13:24
*** JelleB has quit IRC13:26
*** AbyssOne has quit IRC13:26
*** openstackstatus has joined #openstack-swift13:27
*** ChanServ sets mode: +v openstackstatus13:27
jrichlitdasilva: thanks!13:30
*** jethrosun has quit IRC13:30
*** tqtran has joined #openstack-swift13:33
*** links has quit IRC13:35
*** AbyssOne has joined #openstack-swift13:36
*** tqtran has quit IRC13:38
*** rledisez has quit IRC13:39
*** oshritf has joined #openstack-swift13:39
*** sheel has quit IRC13:41
*** JelleB has joined #openstack-swift13:42
*** ametts has joined #openstack-swift13:42
tdasilvajrichli: :)13:42
*** haomaiwang has quit IRC13:47
*** haomaiwang has joined #openstack-swift13:51
*** _JZ_ has joined #openstack-swift13:53
*** jethrosun has joined #openstack-swift14:00
*** haomaiwang has quit IRC14:01
*** haomaiwang has joined #openstack-swift14:01
*** jethrosun has quit IRC14:03
*** jethrosun has joined #openstack-swift14:04
*** jethrosun has quit IRC14:08
*** bkeller` has joined #openstack-swift14:14
*** klamath has joined #openstack-swift14:17
sgundurgood morning14:24
*** gsaps has joined #openstack-swift14:25
*** haomaiwang has quit IRC14:30
*** diogogmt has quit IRC14:39
*** sheel has joined #openstack-swift14:49
pdardeaugood morning14:51
siva_krishnangood morning!14:56
oshritfAnyone available to discuss Swift object versioning?14:57
tdasilvaoshritf: hi14:57
tdasilvaoshritf: what's your question? I can try to help...14:58
oshritfDoes object versioing is expected to keep all object versions? I'm asking since in a scenario where there is a PUT with older timestamp, it will not be listed as a version (PUT is ignored + no entry to versions)14:59
*** ametts has quit IRC15:00
*** bkeller` has quit IRC15:02
tdasilvaPUT with older timestamp?15:02
oshritfI can try and describe a scenario:15:03
oshritf     Turn on versioning on proxy-server15:03
oshritf     swift post version_restore15:03
oshritf swift post -H "x-versions-location:version_restore" version_restore_with_header15:03
oshritf   swift upload -H "x-timestamp: 1" version_restore_with_header anonymizer.py15:04
oshritf   swift upload -H "x-timestamp: 10" version_restore_with_header anonymizer.py15:04
oshritf  swift upload -H "x-timestamp: 5" version_restore_with_header anonymizer.py15:04
*** bkeller` has joined #openstack-swift15:04
oshritf   swift list version_restore returns: 00danonymizer.py/0000000001.00000 00danony15:04
oshritfTimestamps 1 and 10 are listed in versioning, timestamp 5 does not.15:04
tdasilvammm..it didn't even make it to version_restore_with_header?15:05
*** pcaruana has quit IRC15:06
oshritfTimestamp 5 < 10, so it is ignored as there is a newer version of the object15:07
*** esker has joined #openstack-swift15:07
*** garthb has joined #openstack-swift15:08
oshritfIt should be listed in the container obviously, I guess the question is whether it should be listed as a version15:08
oshritfI also put it as a question here: https://ask.openstack.org/en/question/90582/swift-object-versioning-archiving-puts-with-older-timestamp/15:09
tdasilvaoshritf: right...had not thought of this scenario before. Honestly, at first my reasoning is that it should not be versioned. If it was never stored on the system, then it should not be versioned.15:11
oshritfright, exactly my thought too, just wonder if it ever was raised and discussed. Perhaps document it to make it clear that it versions only data stored in the system?15:13
siva_krishnanI am working on one of the code refactoring wishlist https://bugs.launchpad.net/swift/+bug/1550565 where  clayg has suggested to replace REPLICATE verbs by hand to direct_client.direct_get_suffix_hashes. But I see that direct_get_suffix_hashes doesn't use replication_ip or replciation_port for doing REPLICATE but in Swift docs I found the following information "These parameters will be used if they are present, but15:13
openstackLaunchpad bug 1550565 in OpenStack Object Storage (swift) "replicator/reconstructor should use direct_get_suffix_hashes" [Wishlist,New] - Assigned to Sivasathurappan Radhakrishnan (siva-radhakrishnan)15:13
*** bkeller` has quit IRC15:13
oshritftdasilve:right, exactly my thought too, just wonder if it ever was raised and discussed. Perhaps document it to make it clear that it versions only data stored in the system?15:13
*** ametts has joined #openstack-swift15:13
*** bkeller` has joined #openstack-swift15:14
*** links has joined #openstack-swift15:14
*** ChubYann has joined #openstack-swift15:15
oshritftdasilva: do you think it should be raised to discussion? if yes, what would be the right place to document it? not sure openstack ask is the right place15:17
claygsiva_krishnan: good morning15:18
tdasilvaoshritf: I think we could open a bug to track it, at least we can document it like you suggested it15:18
siva_krishnangood Morning clayg!15:18
claygsiva_krishnan: your question got cut off at "These parameters will be used if they are present, but ...15:19
*** arch-nemesis has joined #openstack-swift15:19
*** arch-nemesis has quit IRC15:19
claygsiva_krishnan: does the direct_get_suffix_hashes take like a node param?  that might be like a device dict from a ring - which would definately have the replication ip/port?15:20
*** haomaiwang has joined #openstack-swift15:20
siva_krishnanclayg not sure how it happened I could see the full message anyways my question was ""These parameters will be used if they are present, but they are not required. If this information does not exist or is empty for a particular node, the node’s standard IP and port will be used for replication."  Should direct_get_suffix_hashes changed ? correct me if Iam wrong"15:20
*** rledisez has joined #openstack-swift15:20
claygsiva_krishnan: well... I *think* when you look at the devices in a ring the 'replication_ip' *field* is always filled in - it's just that if you don't supply one it will get filled in with the regular node's ip?15:21
siva_krishnanclayg yes it does take node param. but request is being crafted in such a way that it uses  node['ip'] instead of node['replication_ip']15:22
claygsiva_krishnan: does that make sense?  you don't *have* to set a replication_ip when doing ring building - but by the time it gets serialized if you didn't set a replication_ip - the node dict will fill one in with the node['ip']15:22
claygoh really!?15:23
claygdahhhh - that's a bug :)15:23
claygsiva_krishnan: good eye!15:23
*** bkeller` has quit IRC15:23
claygcan you file it on launchpad15:23
siva_krishnanSure clayg. will do that :)15:24
siva_krishnanI just wanted to confirm it before changing it.15:24
*** links has quit IRC15:25
*** bkeller` has joined #openstack-swift15:28
*** diogogmt has joined #openstack-swift15:28
*** mvk_ has quit IRC15:37
*** oshritf has quit IRC15:37
*** daemontool has quit IRC15:45
*** nadeem has joined #openstack-swift15:51
*** asettle has joined #openstack-swift15:51
*** arch-nemesis has joined #openstack-swift15:53
*** nadeem has quit IRC15:55
*** asettle has quit IRC15:56
*** nadeem has joined #openstack-swift15:56
openstackgerritAlistair Coles proposed openstack/swift: Support for http footers - Replication and EC  https://review.openstack.org/23739315:59
*** jethrosun has joined #openstack-swift15:59
*** bkeller` has quit IRC16:00
*** haomaiwang has quit IRC16:01
acolestdasilva: jrichli ^^ I think I have pummelled this enough :) Reduced to a base Putter and a MIMEPutter. Didn't seem worth having an abstract base class and two subclasses but I'm never sure which way to go so push back if you disagree. Also worked a bit more on the test.16:01
*** haomaiwang has joined #openstack-swift16:01
tdasilvaacoles: cool! I'm looking at patch 257603 and then will circle back to this one16:03
patchbottdasilva: https://review.openstack.org/#/c/257603/ - swift (feature/crypto) - WIP Conditional GETs Fix16:03
*** zaitcev has joined #openstack-swift16:04
*** ChanServ sets mode: +v zaitcev16:04
acolestdasilva: thanks. I guess I'll look at that next too.16:05
*** diogogmt_ has joined #openstack-swift16:06
*** bkeller` has joined #openstack-swift16:06
*** diogogmt has quit IRC16:07
*** diogogmt_ is now known as diogogmt16:07
acolessiva_krishnan: clayg: agree, that looks like a bug in direct_get_suffix_hashes, if it were to be used with an obj server configured replication_server=False. sorry, my bad!16:08
*** rledisez has quit IRC16:13
*** lyrrad has joined #openstack-swift16:13
*** mvk_ has joined #openstack-swift16:14
notmynamegood morning16:23
claygacoles: no worries, lp bug #1566395 is filed - it's as good as fixed16:24
openstackLaunchpad bug 1566395 in OpenStack Object Storage (swift) "direct_get_suffix_hashes doesn't use replication_ip" [Low,Confirmed] https://launchpad.net/bugs/1566395 - Assigned to Sivasathurappan Radhakrishnan (siva-radhakrishnan)16:24
notmynameI read this on my commute in this morning. http://www.aosabook.org/en/gdb.html Definitely check out the "4.11 Lessons Learned" section at the bottom. Great stuff about dealing with large, complicated softward projects that have a varied contributor base and a long development history16:25
claygnotmyname: in bristol we talked about a bug triage party - do you think we still have time to do that before Austin?  Or should like SwiftStack sponer an "after-hours" bug triage working party in Texas?  I always feel like my best testing is slightly drunk testing.16:25
notmynameI read that caffeine is good when you need to focus on a known task and iterate on steps. alcohol is good when you need to let your mind wander to come up with creative solutions16:26
notmynamebug testing seems to fall in the latter ;-)16:27
notmynameI've been having trouble getting my schedule together for the week of the summit, so I don't know what the evenings look like yet. but I like the idea of an after-hours thing at the summit16:28
timburkegood morning16:30
*** dmorita has joined #openstack-swift16:38
*** esker has quit IRC16:49
*** mmcardle has quit IRC16:53
*** jordanP has quit IRC16:54
*** haomaiwang has quit IRC17:01
*** haomaiwa_ has joined #openstack-swift17:01
notmynameso openstack has this API working group, and they come up with common guidelines for the openstack apis. they wrote one that just completely doesn't work for swift at all (or other data-plane APIs, I think). I commented at the time that it was bad. but now they're updating/expanding it. so do I comment again that the whole thing is bad? or just leave it?17:03
*** acoles is now known as acoles_17:04
*** bkeller` has quit IRC17:12
zaitcevnotmyname: If I had an hour or two to waste on it, I'd still registered technical disagreements and saved links or other materials for the record. Could come handy one day.17:18
zaitcevnotmyname: but if you're completely nose down dealing with all the bugs and reviews and stuff then whatever17:18
notmynamezaitcev: yeah, that was exactly my thought. "for the record" might be useful, but otherwise, I'd just ignore it17:19
*** gsaps has quit IRC17:21
*** jistr has quit IRC17:24
*** Jeffrey4l has quit IRC17:25
*** klrmn has joined #openstack-swift17:27
*** jethrosun has quit IRC17:35
*** tqtran has joined #openstack-swift17:37
*** asettle has joined #openstack-swift17:40
*** twm2016_ has joined #openstack-swift17:45
*** asettle has quit IRC17:45
*** garthb has quit IRC17:47
notmynamebah! after re-reading the original review comments, I'm not going to get into it again. serious concerns were raised, and that should be fine for any future conversations that come up17:48
twm2016_+clayg: When you're free, could you review this?: https://bugs.launchpad.net/swift/+bug/1537811 Thanks!17:50
openstackLaunchpad bug 1537811 in OpenStack Object Storage (swift) "204 No Content responses have Content-Length specified" [Low,In progress] - Assigned to Trevor McCasland (twm2016)17:50
notmynamezaitcev: (FWIW, it was about the metadata guideline)17:54
notmynamezaitcev: and thanks :-)17:54
*** haomaiwa_ has quit IRC18:01
*** dmorita has quit IRC18:01
*** haomaiwang has joined #openstack-swift18:01
*** dmorita has joined #openstack-swift18:01
*** jethrosun has joined #openstack-swift18:03
*** diogogmt_ has joined #openstack-swift18:04
tdasilvanotmyname: thanks for sharing the link http://www.aosabook.org/en/gdb.html - nice read!18:04
*** diogogmt has quit IRC18:06
*** diogogmt_ is now known as diogogmt18:06
*** haomaiwang has quit IRC18:11
*** bkeller` has joined #openstack-swift18:14
*** diogogmt has quit IRC18:17
*** zul has quit IRC18:19
*** diogogmt has joined #openstack-swift18:29
*** twm2016_ has quit IRC18:32
notmynametdasilva: np. I've been going through that book (slowly) on my commute. it's great to read about how other people have solved hard problems. and the whole premise of the book is great!18:33
openstackgerritMerged openstack/swift: Fix strings with positional arguments  https://review.openstack.org/30088318:39
*** rcernin has quit IRC18:41
tdasilvahas anybody figured out how the new gerrit displays patch dependencies yet? i'm trying to figure out if patch 257603 depends on http footers patch18:43
patchbottdasilva: https://review.openstack.org/#/c/257603/ - swift (feature/crypto) - WIP Conditional GETs Fix18:43
tdasilvajrichli: ^^^18:43
notmynametdasilva: "poorly" probably isn't a helpful answer, is it?18:43
tdasilvalol18:44
jrichlitdasilva: I believe that one is just based on the footers patch, but let me revisit for a sec18:44
tdasilvajrichli: yeah, looks like it is...git log helps :/18:44
tdasilvawho needs gerrit anyway18:45
notmynametdasilva: `git log --graph --pretty --abbrev-commit --date=relative`18:45
*** bkeller` has quit IRC18:46
jrichlitdasilva: cool.  :-)  btw - jlhinson_ had planned to make a few changes to make that patch more final - and was going to remove the "WIP" at that point.18:46
tdasilvajrichli: ok, i was going to rebase, but probably not worth it ?18:47
tdasilvanotmyname: cool trick, thanks18:47
zaitcevWho neeeeeds the Quik-e-Maaaart18:47
jrichlitdasilva: well, it might still be helpful if somebody wants to run the version that is based on-top of that - which has all the functests passing.  but only if it is not much effort.18:48
jrichlitdasilva: i dont have an eta on when jlhinson_ can work on that18:49
tdasilvajrichli: ok, i'll rebase just to get it up to date18:50
jrichlitdasilva: thx!18:50
*** gsaps has joined #openstack-swift18:53
openstackgerritOpenStack Proposal Bot proposed openstack/swift: Updated from global requirements  https://review.openstack.org/8873618:53
*** bkeller` has joined #openstack-swift18:55
*** gsaps has quit IRC18:55
openstackgerritJohn Dickinson proposed openstack/swift: Added new contributor walkthrough doc  https://review.openstack.org/30187118:57
*** jethrosun has quit IRC18:57
notmynamepdardeau: ^ I'd appreciate it if you could look at that patch18:57
*** jethrosun has joined #openstack-swift18:57
pdardeaunotmyname: i'll look at it this afternoon18:58
notmynamepdardeau: thanks. it's based on something I wrote a while back and just now dusted off, but since you've been and seen "new contributors" recently, I'd love your take on it18:59
*** jethrosun has quit IRC18:59
*** haomaiwang has joined #openstack-swift19:01
*** esker has joined #openstack-swift19:07
*** ametts has quit IRC19:17
*** bkeller` has quit IRC19:20
*** bkeller` has joined #openstack-swift19:20
bkeller`notmyname, VS Code and Atom are both pretty good editors and open-source fwiw19:26
notmynamebkeller`: yeah. I wasn't trying to get into editor wars. there's a ton of great ones.19:29
*** ametts has joined #openstack-swift19:31
*** zul has joined #openstack-swift19:32
*** mmcardle has joined #openstack-swift19:34
*** esker has quit IRC19:36
tdasilvabkeller`: i've just started using atom recently...enjoying it so far19:38
notmynamejrichli: do you have to upload a key to gerrit? I don't remember that (but it's been a long time...)19:52
jrichligo to https://review.openstack.org/#/settings/ssh-keys to see yours19:52
jrichliif you have none there, then i guess you dont19:53
jrichlii thought i did19:53
*** dmorita has quit IRC19:53
notmynameyeah, I do. and it says "launchpad public key"19:53
jrichliyou may have gotten the key loaded automatically from launchpad?  mine doesn't say that.  i know i loaded one manually, but i guess there are prob different ways to get something there for auth19:54
*** dmorita has joined #openstack-swift19:54
*** dmorita has quit IRC19:55
*** dmorita_ has joined #openstack-swift19:55
*** haomaiwang has quit IRC20:01
*** haomaiwang has joined #openstack-swift20:01
*** tqtran has quit IRC20:06
*** mwheckma1n has quit IRC20:10
notmynamejrichli: all this setup is quite daunting, I'm sure, for new contributors20:13
notmynamedownload this, install that, register on this site, create/upload an ssh key, sign this legal document20:14
notmynamethen after that you can make your 2 character fix to the docs20:14
claygnotmyname: or you can attach a diff to a bug report?20:14
notmynameclayg: yeah, sure. I jsut get frustrated that we build the amazing and fantastic systems to do things never before dreamed of, but making it easy for someone to join us in working on it? nah, not important20:16
jrichlinotmyname: true!  of course, there are corporate hoops to get to where it shows you're contributing in that company's group.  i guess you might put a little something on that?20:16
notmyname(as an industry, not swift particularly--although it applies to us too)20:16
jrichlifollowing your steps would lead to the individual showing as independent, right?20:16
notmynamejrichli: I don't parse that sentence20:17
jrichlione sec20:17
*** asettle has joined #openstack-swift20:17
jrichlinotmyname: my stackalytics show I am in IBM.  My launchpad account says I am an "IBM Stacker".  not sure if Gerrit associates my account with ibm.  all i know is that i had to peform steps internally to have all that happen.20:20
claygnotmyname: well I'm not sure it should be taken for granted that folks who might want to make a small change, but don't want to go through the O$ rig-a-ma-roll, would *know* that a good bug report or a good diff is just as welcome a contribution as a change set in gerrit.20:21
notmynameanyone know a sphinx option that treats warnings as errors? like the gcc -Werror flag20:21
notmynameclayg: I think people would only know that if we write it down somewhere they can find it20:22
notmynameclayg: but yeah, I don't really expect people to go through all this for trivial changes20:22
notmynamejrichli: my idea behind this document was the bare minimum to get from zero to submitting a patch. I think corporate affiliation, stackalytics, and enythign else like thing should be kept out20:23
jrichlinotmyname: fair enough20:24
notmynameclayg: oh. rereading what you said. I agree with you (and i think I just repeated what you said)20:24
*** mmcardle has quit IRC20:24
claygnotmyname: minimum bar to contribute - file a bug, step up - file a *good* bug with steps to reproduce - step up from that attach a patch that WOYM - step up from that sign away your soul and try to get a change in gerrit - step up from that - sign away your life and try to a change reviewed - step up from that - embrace your newfound inner darkness and do reviews20:26
notmynamelol20:26
claygi feel like the slide into darkness starts fast and gets steeper quickly :\20:27
notmynameI almost want to have that in the docs verbatum20:27
notmynameit's not so much a stairway towards enlightenment. think of it more as a downward spiral to the abyss20:27
*** david-lyle_ has joined #openstack-swift20:28
claygnotmyname: yeah I think if it's not self deprecating it comes off as pretentious20:28
*** david-lyle has quit IRC20:29
*** david-lyle_ is now known as david-lyle20:29
notmynameI'm going to see if I can find a spare computer around the office so I can test this process as a noob20:30
*** tqtran has joined #openstack-swift20:34
*** nadeem has quit IRC20:47
*** sheel has quit IRC20:47
*** jamielennox|away is now known as jamielennox20:49
*** joeljwright has joined #openstack-swift20:52
*** ChanServ sets mode: +v joeljwright20:52
*** haomaiwang has quit IRC21:01
*** haomaiwang has joined #openstack-swift21:01
*** pauloewerton has quit IRC21:03
*** darrenc_ is now known as darrenc21:05
openstackgerritJohn Dickinson proposed openstack/swift: Added new contributor walkthrough doc  https://review.openstack.org/30187121:07
*** esker has joined #openstack-swift21:14
*** esker has quit IRC21:16
*** esker has joined #openstack-swift21:16
*** cppforlife_ has quit IRC21:19
*** sgundur has quit IRC21:20
*** cppforlife_ has joined #openstack-swift21:21
openstackgerritJohn Dickinson proposed openstack/swift: The dark cycle of contributing  https://review.openstack.org/30192621:27
notmynameclayg: ^ ;-)21:27
tdasilvalol21:28
tdasilvaSign away your life and try to *get* a change reviewed21:29
claygtdasilva: right - good catch :P21:29
notmynamethanks21:29
openstackgerritJohn Dickinson proposed openstack/swift: The dark cycle of contributing  https://review.openstack.org/30192621:30
notmynameif I were torgomatic, I'd set the topic to hello_darkness_my_old_friend" or something21:30
notmynamedfg_: lol21:37
dfg_:)21:38
notmynamedfg_: I'm goingt o go visit you next week. you going to be around?21:39
dfg_notmyname: ya21:39
notmynamecool. I'll be at the castle tuesday and (part of) wednesday21:39
*** esker has quit IRC21:46
*** esker has joined #openstack-swift21:46
*** haomaiwang has quit IRC22:01
*** haomaiwa_ has joined #openstack-swift22:01
*** klrmn has quit IRC22:03
*** klrmn has joined #openstack-swift22:08
redbonotmyname: what version of pypy were you testing before?  It keeps benchmarking slower than vanilla swift to me.22:08
redboI guess that might be memory pressure on my vm.  I'll give it more memory and try again later.22:08
notmynamelogging into that server to look22:09
redbothanks22:09
notmyname$ ./pypy-c22:10
notmynamePython 2.7.10 (5f8302b8bf9f53056e40426f10c72151564e5b19, Jan 05 2016, 19:17:36)22:10
notmyname[PyPy 4.0.1 with GCC 4.9.2] on linux222:10
notmynameType "help", "copyright", "credits" or "license" for more information.22:10
notmyname>>>>22:10
*** sebl_ has joined #openstack-swift22:10
*** sebl_ has left #openstack-swift22:10
notmynamethe most dramatic benefits I've seen for pypy are in a CPU constrained environment22:10
*** NotMyNameEither has joined #openstack-swift22:11
notmynameso Intel's testing was one proxy and a bunch of object servers (15 I think). in my testing with 1 proxy and 1 storage node, I turned off all but one of the cores on the proxy (to force cpu constraints)22:11
notmynameand there were 2 libraries that had to be recompiled for pypy22:12
notmynamewhat were they...22:12
notmynamexattrs and ...22:12
notmynamenetifaces22:12
notmynameI'll also need to recompile scrypt for swiftstack's use, but that wasn't part of this test22:13
*** bkeller` has quit IRC22:14
notmynameso with zero-byte PUTs with 200 concurrency (ie a greenpool of size 200), I went from 130 puts/sec with cpython to 303 with pypy22:15
notmynameand for 1KB objects, time to first byte on GETs went from 816ms (@ 285/sec) with cpython to 502ms (@ 571/sec) with pypy22:17
notmynamesince I was testing on a very underpowered system, I wasn't as concerned about the absolute numbers. more with the relative comparison between the two22:18
claygnotmyname: was your load generator also running on pypy22:19
notmynameno22:19
redboHmm... I'll keep playing with it.  It's come in about 10% slower than cpython for me so far.  But it might be something like pypy is using most of my memory and forcing things out of cache.22:21
claygmemory nom nom nom22:21
redboI tried running everything with pypy first and it used so much memory I couldn't do anything.  I had to just reboot the box.22:22
clarkbpypy's eventlet support is also pretty rudimentary I think, it turns of JITing or did in the past not sure if it still does22:23
NotMyNameEitherHi! I was on this channel last week (as nyar I believe), reporting some issues we ran into using Swift as a backend for Ceilometer/Gnocchi. I moved our container and account rings to SSD devices today and we are seeing a huge performance improvement. We are still seeing some object-server: ERROR container update failed with x.x.x.x:6001/sdk (saving for async update later): Timeout (3.0s) though22:23
NotMyNameEitherThe reason for that seems pretty silly to me: Gnocchi is writing to a single container (measure) before reading from it to aggregate the data and write them again in metrics' specific containers22:25
NotMyNameEitherThe bottleneck is obviously the never ending writes to this "measure" container, choking Swift which tries to update the container db each time a change is made22:26
*** jamielennox is now known as jamielennox|away22:26
notmynameredbo: super rough instructions for building pypy and the c libs: https://gist.github.com/notmyname/dfe1746f710a3674bb453bb812eb89a922:27
NotMyNameEitherI was wondering if anyone had any experience with Gnocchi/Swift at scale, I must admit I am now running out of idea on what we could tuned now22:27
notmynameredbo: there is one bug I've been working with intel on about the pypy GC and how it was doing something different than CPython. I expect at least a pypy patch; not sure if it will result in a swift patch too. basic operations should work, as-is, IIRC, but super high-load or long running stuff won't22:30
notmynameredbo: your memory issue may have had to do with pypy hanging onto a socket or something like that22:30
redboHmm.. I'll look through that.  I just downloaded the latest pypy nightly and built a venv for it, installed pip to the venv, then ran pip -r requirements.txt.  That all seemed to work well.  Except for where I had to fiddle with erasurecode.h.22:30
notmynameoh yeah. I didn't even mess with that yet :-)22:31
claygNotMyNameEither: so how big is the measure container?22:31
*** joeljwright has quit IRC22:32
claygNotMyNameEither: object count wise22:32
claygNotMyNameEither: or on disk22:32
*** joeljwright has joined #openstack-swift22:33
*** ChanServ sets mode: +v joeljwright22:33
*** joeljwright has quit IRC22:33
*** klrmn has quit IRC22:35
NotMyNameEitherIt's constantly changing but around 20 objects at average with our current workload. We are testing with 30VMs monitored by Ceilometer at the moment.22:36
claygNotMyNameEither: so the objects in the measure container are constantly being added and deleted?  how big is the container on-disk?  also small?22:37
NotMyNameEitherI am trying to come up with a number of requests/second we are pushing to Swift at the moment. Is there an existing tool capable of doing this? If not I'll come up with my own dirty way to do it22:38
NotMyNameEitherclayg: that is correct, constantly being added and deleted. Checking size on disk22:39
*** lcurtis has joined #openstack-swift22:40
NotMyNameEitherThe db is 20KB big22:41
claygtiny22:41
NotMyNameEitherHmm I am actually not so sure, I might have been looking at the wrong one. Can you remind me how to get the container db path on disk based on the container or object name?22:45
claygswift-get-nodes /etc/swift/container.ring.gz <account> <container>22:45
NotMyNameEitherI just did some quick logs crawling/aggregation: we are currently pushing an average of 50 PUTs/s and 20 DELETE/s22:46
claygthere's some "ssh X.X.X.X 'ls /some/path/to/hash'" kinda commands - that should give you the basic idea22:46
NotMyNameEitherat peak, we reach around 100 PUT/s22:46
NotMyNameEitherclayg: thanks! Soooo the db file is actually 800MB22:47
claygok, not tiny22:47
NotMyNameEitherIndeed. My bad, I looked at one of the "metrics specific" gnocchi container before22:48
claygenough rows maybe that it might take a few seconds to eat a big pending maybe - maybe22:48
clayggotcha22:48
*** diogogmt has quit IRC22:48
*** klamath has quit IRC22:49
claygmaybe gnocchi developers were thinking since the container was written and deleted from frequently that would never get "too big" - but deleted rows have to hand around for awhile22:49
*** diogogmt has joined #openstack-swift22:51
NotMyNameEitherI must admit I am not sure how they expect the object store to scale by doing this. Ceph, according to them, seems to be a better fit than Swift22:51
*** _JZ_ has quit IRC22:52
NotMyNameEitherI am not sure how, knowing that Ceph has the same principle of updating the journal before sending back an ACK on object write22:52
NotMyNameEitherBut right now, they are pretty much using the "Swift" argument on me :)22:53
notmynamepushing a bunch of data to swift is good. using swift like a queue isn't generally very good22:54
NotMyNameEitherI can understand why. I am not sure there is not much to be done here, it feels like to us Gnocchi is trying to use an object store for something it's not designed for :(22:55
notmynameso let's back up some. what's the actual problem? is the end-user seeing any errors? seeing anything that thye shouldn't or not seeign something they should?22:56
notmynameor is this trying to eliminate the logged messages?22:56
openstackgerritSivasathurappan Radhakrishnan proposed openstack/swift: Modified REPLICATE request to use replication_ip  https://review.openstack.org/30196322:57
*** ametts has quit IRC22:58
NotMyNameEitherNo end-user errors, only object-server throwing errors22:59
NotMyNameEitherI am just afraid that if we were to go production with this, the async container update would never catch up23:00
NotMyNameEitherBut at this point, we are indeed only trying to eliminate the error logged messages23:00
*** haomaiwa_ has quit IRC23:01
*** km has joined #openstack-swift23:01
pdardeaunotmyname: 301871 looks great to me. made a few minor editorial comments. very nice!23:01
*** 16WAALNTP has joined #openstack-swift23:01
pdardeaupatch 30187123:01
patchbotpdardeau: https://review.openstack.org/#/c/301871/ - swift - Added new contributor walkthrough doc23:01
notmynamepdardeau: thanks. I'm going through it now on a new box. there's a couple of improvements I'll make too23:01
notmynameI'll incorporate your comments23:02
*** Lickitysplitted has quit IRC23:08
pdardeauclayg: good call on submitting diff for newcomer who doesn't want to do the hoops23:09
*** lcurtis has quit IRC23:09
pdardeauclayg: you're right about steps for contributing, but in notmyname scenario it's doc changes23:11
notmynameugh. why can I not install git-review on this new box?23:14
notmynameor rather, when running `sudo pip install git-review`, why do I get a operation not permitted error? I'M ROOT!23:15
notmynamenew doc: "Step 22: Install git-review. good luck"23:16
*** garthb has joined #openstack-swift23:18
notmynameoh right. thanks apple. http://apple.stackexchange.com/questions/209572/how-to-use-pip-after-the-el-capitan-max-os-x-upgrade23:19
*** asettle has quit IRC23:19
zaitcevmeanwhile I just run "dnf install git-review" and presto :-)23:21
zaitcevEven checks GPG signatures to prevent spoofing of mirrors.23:21
*** Lickitysplitted has joined #openstack-swift23:22
*** jamielennox|away is now known as jamielennox23:23
*** klrmn has joined #openstack-swift23:28
*** esker has quit IRC23:33
notmynamehmm...http://docs.openstack.org/infra/manual/developers.html isn't bad at all for documenting the process23:36
*** esker has joined #openstack-swift23:36
notmyname(however, the process itself is very hostile)23:37
notmynamebizarre error message from git-review (AttributeError: 'GitReviewException' object has no attribute 'EXIT_CODE') because my CLA wasn't signed. can't sign the CLA because "Code Review - Error, Server Error, Cannot store contact information"23:39
*** NM has quit IRC23:39
notmynamewhich seems like it might be because I haven't signed up as an openstack foundation member yet23:39
notmyname(of course)23:40
notmyname(that's totally obvious, right?)23:40
*** kei_yama has joined #openstack-swift23:41
*** hosanai has joined #openstack-swift23:44
*** ChanServ sets mode: +v hosanai23:44
hosanaigood morning! I'm back from a lot of paper works :-)23:46
*** jamielennox is now known as jamielennox|away23:51
*** jamielennox|away is now known as jamielennox23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!