| *** zaitcev has joined #openstack-swift | 00:03 | |
| *** ChanServ sets mode: +v zaitcev | 00:03 | |
| zaitcev | Anyone else gets 500 when trying to review something? | 00:04 |
|---|---|---|
| *** NM has joined #openstack-swift | 00:21 | |
| *** rickyrem has quit IRC | 00:23 | |
| *** rickyrem has joined #openstack-swift | 00:25 | |
| *** urth has quit IRC | 00:25 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Don't include conditional headers in SLO HEAD requests https://review.openstack.org/305440 | 00:26 |
| *** urth has joined #openstack-swift | 00:29 | |
| *** Jeffrey4l__ has quit IRC | 00:30 | |
| clarkb | zaitcev: was it only happening around 0000UTC? | 00:30 |
| clarkb | db backups happen then and may be the culprit | 00:30 |
| clarkb | mordred has plans for making that less bad | 00:30 |
| zaitcev | Dunno... It was strange. I'm used to patch queue moving slowly, but the reviews themselves were quite reliable over the years. | 00:31 |
| clarkb | basically at 0000UTC (31 minutes ago) we dump the db for backup purposes | 00:32 |
| clarkb | this does locks aiui amd if you attempt to make changes and cant get a lock it may 500 | 00:32 |
| zaitcev | I see. Lucky! | 00:32 |
| clarkb | the fix is to run a slave db and backup off that | 00:33 |
| clarkb | we just havent implemented this yet | 00:33 |
| zaitcev | It's okay, just unexpected. | 00:35 |
| *** NM has quit IRC | 00:37 | |
| *** lakshmiS has quit IRC | 00:39 | |
| *** mingdang1 has joined #openstack-swift | 00:42 | |
| *** tonyb has quit IRC | 00:44 | |
| *** tonyb has joined #openstack-swift | 00:44 | |
| *** lyrrad has quit IRC | 00:54 | |
| *** m_kazuhiro has joined #openstack-swift | 00:57 | |
| *** haomaiwang has joined #openstack-swift | 00:58 | |
| *** gyee has quit IRC | 00:59 | |
| *** ajiang has left #openstack-swift | 00:59 | |
| *** haomaiwang has quit IRC | 01:01 | |
| *** nakagawamsa has joined #openstack-swift | 01:02 | |
| *** nakagawamsa has quit IRC | 01:02 | |
| *** mingdang1 has quit IRC | 01:07 | |
| *** bill_az_ has quit IRC | 01:16 | |
| *** asettle has quit IRC | 01:18 | |
| *** klrmn1 has quit IRC | 01:23 | |
| *** asettle has joined #openstack-swift | 01:30 | |
| *** hezhiqiang has joined #openstack-swift | 01:31 | |
| *** hezhiqia_ has joined #openstack-swift | 01:42 | |
| *** hezhiqiang has quit IRC | 01:46 | |
| *** tqtran has quit IRC | 01:53 | |
| openstackgerrit | Merged openstack/python-swiftclient: Fix downloading from "marker" item https://review.openstack.org/300853 | 02:02 |
| *** dmorita_ has quit IRC | 02:08 | |
| *** dmorita has joined #openstack-swift | 02:09 | |
| *** hezhiqia_ has quit IRC | 02:12 | |
| *** hezhiqiang has joined #openstack-swift | 02:15 | |
| *** haomaiwa_ has joined #openstack-swift | 02:18 | |
| *** dmorita has quit IRC | 02:24 | |
| *** hezhiqiang has quit IRC | 02:25 | |
| *** hezhiqiang has joined #openstack-swift | 02:25 | |
| *** dmorita has joined #openstack-swift | 02:26 | |
| *** klrmn has joined #openstack-swift | 02:28 | |
| *** itlinux has quit IRC | 02:37 | |
| *** sgundur1 has left #openstack-swift | 02:41 | |
| *** hezhiqiang has quit IRC | 02:55 | |
| *** hezhiqiang has joined #openstack-swift | 02:56 | |
| *** haomaiwa_ has quit IRC | 03:01 | |
| *** nadeem has joined #openstack-swift | 03:02 | |
| *** haomaiwa_ has joined #openstack-swift | 03:02 | |
| *** pdardeau_ has joined #openstack-swift | 03:18 | |
| *** natarej has quit IRC | 03:22 | |
| *** arch-nemesis has joined #openstack-swift | 03:26 | |
| *** arch-nemesis has joined #openstack-swift | 03:26 | |
| *** arch-nemesis has quit IRC | 03:27 | |
| *** arch-nemesis has joined #openstack-swift | 03:27 | |
| *** pdardeau_ has quit IRC | 03:32 | |
| *** arch-nemesis has quit IRC | 03:33 | |
| *** arch-nemesis has joined #openstack-swift | 03:34 | |
| *** arch-nemesis has quit IRC | 03:34 | |
| *** arch-nemesis has joined #openstack-swift | 03:35 | |
| *** arch-nemesis has quit IRC | 03:35 | |
| *** arch-nemesis has joined #openstack-swift | 03:36 | |
| *** arch-nemesis has quit IRC | 03:36 | |
| *** csmart_ is now known as csmart | 03:36 | |
| *** arch-nemesis has joined #openstack-swift | 03:37 | |
| *** ankur has joined #openstack-swift | 03:37 | |
| *** arch-nemesis has quit IRC | 03:37 | |
| *** hezhiqiang has quit IRC | 03:39 | |
| *** hezhiqiang has joined #openstack-swift | 03:40 | |
| *** hosanai has joined #openstack-swift | 03:47 | |
| *** ChanServ sets mode: +v hosanai | 03:47 | |
| *** dmorita has quit IRC | 03:53 | |
| *** haomaiwa_ has quit IRC | 04:01 | |
| *** haomaiwang has joined #openstack-swift | 04:01 | |
| *** janonymous has joined #openstack-swift | 04:02 | |
| *** mingdang1 has joined #openstack-swift | 04:08 | |
| *** mingdang1 has quit IRC | 04:13 | |
| *** dmorita has joined #openstack-swift | 04:13 | |
| *** dmorita has quit IRC | 04:19 | |
| *** asettle has quit IRC | 04:19 | |
| *** timburke has quit IRC | 04:30 | |
| *** alpha_ori has quit IRC | 04:30 | |
| *** hugokuo has quit IRC | 04:30 | |
| *** chrisnelson has quit IRC | 04:30 | |
| *** swifterdarrell has quit IRC | 04:30 | |
| *** pdardeau has quit IRC | 04:30 | |
| *** alpha_ori has joined #openstack-swift | 04:31 | |
| *** pdardeau has joined #openstack-swift | 04:31 | |
| *** nadeem has quit IRC | 04:31 | |
| *** swiftfan has quit IRC | 04:31 | |
| *** saltsa has quit IRC | 04:31 | |
| *** j_king has quit IRC | 04:31 | |
| *** swiftfan has joined #openstack-swift | 04:31 | |
| *** saltsa has joined #openstack-swift | 04:31 | |
| *** jlvillal has quit IRC | 04:32 | |
| *** j_king has joined #openstack-swift | 04:32 | |
| *** jlvillal has joined #openstack-swift | 04:32 | |
| *** chrisnelson has joined #openstack-swift | 04:32 | |
| *** swifterdarrell has joined #openstack-swift | 04:33 | |
| *** ChanServ sets mode: +v swifterdarrell | 04:33 | |
| *** nadeem has joined #openstack-swift | 04:34 | |
| *** timburke has joined #openstack-swift | 04:34 | |
| *** ChanServ sets mode: +v timburke | 04:34 | |
| *** hugokuo has joined #openstack-swift | 04:34 | |
| *** SkyRocknRoll has quit IRC | 04:35 | |
| *** hezhiqiang has quit IRC | 04:46 | |
| *** hezhiqiang has joined #openstack-swift | 04:47 | |
| *** bill_az has joined #openstack-swift | 04:48 | |
| *** _JZ__ has quit IRC | 04:48 | |
| *** rcernin has joined #openstack-swift | 04:49 | |
| *** SkyRocknRoll has joined #openstack-swift | 04:53 | |
| *** ndk has quit IRC | 04:54 | |
| *** portante has quit IRC | 04:54 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Don't include conditional headers in SLO HEAD requests https://review.openstack.org/305440 | 04:56 |
| *** ndk has joined #openstack-swift | 04:57 | |
| *** hezhiqiang has quit IRC | 04:57 | |
| *** portante has joined #openstack-swift | 04:57 | |
| *** mingdang1 has joined #openstack-swift | 04:58 | |
| *** haomaiwang has quit IRC | 05:01 | |
| *** haomaiwang has joined #openstack-swift | 05:01 | |
| *** ppai has joined #openstack-swift | 05:15 | |
| *** jidar has quit IRC | 05:24 | |
| *** jidar has joined #openstack-swift | 05:28 | |
| *** asettle has joined #openstack-swift | 05:29 | |
| *** asettle has quit IRC | 05:29 | |
| *** ChubYann has quit IRC | 05:29 | |
| *** asettle has joined #openstack-swift | 05:29 | |
| *** nadeem has quit IRC | 05:33 | |
| *** nadeem has joined #openstack-swift | 05:34 | |
| *** nadeem has quit IRC | 05:35 | |
| *** bill_az has quit IRC | 05:37 | |
| *** nadeem has joined #openstack-swift | 05:46 | |
| *** hezhiqiang has joined #openstack-swift | 05:53 | |
| *** kaleta_ has joined #openstack-swift | 06:00 | |
| *** haomaiwang has quit IRC | 06:01 | |
| *** haomaiwang has joined #openstack-swift | 06:01 | |
| *** furlongm has joined #openstack-swift | 06:02 | |
| *** darrenc_ has joined #openstack-swift | 06:03 | |
| *** zacksh_ has joined #openstack-swift | 06:03 | |
| *** alholano1a has joined #openstack-swift | 06:04 | |
| *** zaitcev has quit IRC | 06:04 | |
| *** tristanC_ has joined #openstack-swift | 06:04 | |
| *** SkyRocknRoll has quit IRC | 06:05 | |
| *** onovy_ has joined #openstack-swift | 06:05 | |
| *** jlhinson has joined #openstack-swift | 06:05 | |
| *** mmcardle has quit IRC | 06:05 | |
| *** McMurlock1 has joined #openstack-swift | 06:06 | |
| *** sileht_ has joined #openstack-swift | 06:06 | |
| *** stantonnet_ has joined #openstack-swift | 06:07 | |
| *** charz_ has joined #openstack-swift | 06:07 | |
| *** jlvillal_ has joined #openstack-swift | 06:08 | |
| *** jlvillal has quit IRC | 06:08 | |
| *** j_king has quit IRC | 06:08 | |
| *** ankur has quit IRC | 06:08 | |
| *** tonyb has quit IRC | 06:08 | |
| *** sileht has quit IRC | 06:08 | |
| *** stantonnet has quit IRC | 06:08 | |
| *** zul has quit IRC | 06:08 | |
| *** ahale_ has quit IRC | 06:08 | |
| *** furlongm_ has quit IRC | 06:08 | |
| *** charz has quit IRC | 06:08 | |
| *** tristanC has quit IRC | 06:08 | |
| *** alholanova has quit IRC | 06:08 | |
| *** mdnadeem_ has quit IRC | 06:08 | |
| *** CrackerJ- has quit IRC | 06:08 | |
| *** darrenc has quit IRC | 06:08 | |
| *** philipw has quit IRC | 06:08 | |
| *** onovy has quit IRC | 06:08 | |
| *** zacksh has quit IRC | 06:08 | |
| *** kaleta has quit IRC | 06:08 | |
| *** jlhinson_ has quit IRC | 06:08 | |
| *** onovy_ is now known as onovy | 06:08 | |
| *** kaleta_ is now known as kaleta | 06:08 | |
| *** CrackerJackMack has joined #openstack-swift | 06:09 | |
| *** asettle has quit IRC | 06:09 | |
| *** asettle has joined #openstack-swift | 06:09 | |
| *** zul has joined #openstack-swift | 06:09 | |
| *** j_king has joined #openstack-swift | 06:10 | |
| *** darrenc_ is now known as darrenc | 06:10 | |
| *** jlvillal_ is now known as jlvillal | 06:10 | |
| *** tqtran has joined #openstack-swift | 06:10 | |
| *** jlvillal is now known as Guest83485 | 06:10 | |
| *** ahale has joined #openstack-swift | 06:13 | |
| *** tonyb has joined #openstack-swift | 06:14 | |
| *** asettle has quit IRC | 06:14 | |
| *** asettle has joined #openstack-swift | 06:15 | |
| *** sileht_ is now known as sileht | 06:15 | |
| *** SkyRocknRoll has joined #openstack-swift | 06:19 | |
| *** asettle has quit IRC | 06:20 | |
| *** asettle has joined #openstack-swift | 06:20 | |
| *** darrenc has quit IRC | 06:25 | |
| *** asettle has quit IRC | 06:27 | |
| *** asettle has joined #openstack-swift | 06:27 | |
| *** jmccarthy has quit IRC | 06:34 | |
| *** asettle has quit IRC | 06:34 | |
| *** dikonoor has joined #openstack-swift | 06:35 | |
| *** dikonoo has joined #openstack-swift | 06:35 | |
| openstackgerrit | Andy McCrae proposed openstack/swift: Allow fallocate_reserve to be a percentage https://review.openstack.org/288011 | 06:35 |
| *** asettle has joined #openstack-swift | 06:35 | |
| *** jmccarthy has joined #openstack-swift | 06:38 | |
| *** trifon has joined #openstack-swift | 06:41 | |
| *** klrmn has quit IRC | 06:42 | |
| *** portante has quit IRC | 06:45 | |
| *** tesseract- has joined #openstack-swift | 06:45 | |
| *** portante has joined #openstack-swift | 06:46 | |
| *** tqtran has quit IRC | 06:47 | |
| *** dhellmann has quit IRC | 06:49 | |
| *** philipw has joined #openstack-swift | 06:52 | |
| *** dhellmann has joined #openstack-swift | 06:56 | |
| *** haomaiwang has quit IRC | 07:01 | |
| *** haomaiwang has joined #openstack-swift | 07:01 | |
| *** csmart has quit IRC | 07:06 | |
| *** rledisez has joined #openstack-swift | 07:08 | |
| *** csmart has joined #openstack-swift | 07:08 | |
| *** darrenc has joined #openstack-swift | 07:10 | |
| *** mingdang1 has quit IRC | 07:10 | |
| *** daemontool has joined #openstack-swift | 07:15 | |
| *** asettle has quit IRC | 07:17 | |
| *** daemontool_ has quit IRC | 07:17 | |
| *** asettle has joined #openstack-swift | 07:17 | |
| *** asettle has quit IRC | 07:23 | |
| *** asettle has joined #openstack-swift | 07:23 | |
| *** asettle has quit IRC | 07:29 | |
| *** asettle has joined #openstack-swift | 07:29 | |
| *** geaaru has joined #openstack-swift | 07:42 | |
| *** asettle has quit IRC | 07:44 | |
| *** acoles_ is now known as acoles | 07:45 | |
| *** daemontool has quit IRC | 07:49 | |
| *** daemontool has joined #openstack-swift | 07:51 | |
| *** mattoliverau has quit IRC | 07:54 | |
| *** jordanP has joined #openstack-swift | 07:55 | |
| *** matt6434 has joined #openstack-swift | 08:00 | |
| *** haomaiwang has quit IRC | 08:01 | |
| *** haomaiwang has joined #openstack-swift | 08:01 | |
| *** NotMyNameEither has quit IRC | 08:02 | |
| *** jmccarthy has quit IRC | 08:12 | |
| *** jmccarthy has joined #openstack-swift | 08:16 | |
| *** jistr has joined #openstack-swift | 08:18 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: crypto - cleanup unit tests https://review.openstack.org/304163 | 08:22 |
| *** asettle has joined #openstack-swift | 08:24 | |
| *** openstackstatus has joined #openstack-swift | 08:26 | |
| *** ChanServ sets mode: +v openstackstatus | 08:26 | |
| *** asettle has quit IRC | 08:29 | |
| *** SkyRocknRoll has quit IRC | 08:37 | |
| *** mmcardle has joined #openstack-swift | 08:50 | |
| *** SkyRocknRoll has joined #openstack-swift | 08:51 | |
| *** permalac has joined #openstack-swift | 08:53 | |
| openstackgerrit | Dmitriy Ukhlov proposed openstack/swift: Adds eventlet monkey patching of select module if thread is pathed https://review.openstack.org/303401 | 08:55 |
| *** daemontool_ has joined #openstack-swift | 08:57 | |
| *** ankur has joined #openstack-swift | 08:59 | |
| *** haomaiwang has quit IRC | 09:01 | |
| *** daemontool has quit IRC | 09:01 | |
| *** haomaiwang has joined #openstack-swift | 09:01 | |
| *** nadeem has quit IRC | 09:02 | |
| *** stantonnet_ has quit IRC | 09:03 | |
| *** stantonnet has joined #openstack-swift | 09:06 | |
| *** chlong has quit IRC | 09:11 | |
| *** m_kazuhiro has quit IRC | 09:15 | |
| *** mmcardle has quit IRC | 09:21 | |
| *** mmcardle has joined #openstack-swift | 09:22 | |
| *** mmcardle1 has joined #openstack-swift | 09:30 | |
| *** david-lyle_ has joined #openstack-swift | 09:30 | |
| *** chrisnelson has quit IRC | 09:31 | |
| *** hosanai has quit IRC | 09:32 | |
| *** hosanai has joined #openstack-swift | 09:32 | |
| *** ChanServ sets mode: +v hosanai | 09:32 | |
| *** furlongm_ has joined #openstack-swift | 09:32 | |
| *** j_king has quit IRC | 09:33 | |
| *** david-lyle has quit IRC | 09:33 | |
| *** chrisnelson has joined #openstack-swift | 09:33 | |
| *** mmcardle has quit IRC | 09:33 | |
| *** SkyRocknRoll has quit IRC | 09:33 | |
| *** dhellmann has quit IRC | 09:33 | |
| *** ahale has quit IRC | 09:33 | |
| *** furlongm has quit IRC | 09:33 | |
| *** j_king has joined #openstack-swift | 09:34 | |
| *** jistr has quit IRC | 09:38 | |
| *** tesseract- has quit IRC | 09:38 | |
| *** hosanai has quit IRC | 09:38 | |
| *** ahale has joined #openstack-swift | 09:41 | |
| *** dhellmann has joined #openstack-swift | 09:41 | |
| *** SkyRocknRoll has joined #openstack-swift | 09:46 | |
| *** tesseract- has joined #openstack-swift | 09:50 | |
| *** mvk has joined #openstack-swift | 09:50 | |
| *** mmcardle1 has quit IRC | 09:55 | |
| *** mmcardle has joined #openstack-swift | 09:58 | |
| *** haomaiwang has quit IRC | 10:01 | |
| *** haomaiwang has joined #openstack-swift | 10:01 | |
| *** daemontool__ has joined #openstack-swift | 10:10 | |
| *** daemontool_ has quit IRC | 10:14 | |
| *** hezhiqiang has quit IRC | 10:21 | |
| *** jistr has joined #openstack-swift | 10:22 | |
| *** hezhiqiang has joined #openstack-swift | 10:22 | |
| *** McMurlock1 has quit IRC | 10:24 | |
| *** sheel has joined #openstack-swift | 10:24 | |
| *** hezhiqiang has quit IRC | 10:29 | |
| *** dosaboy_ is now known as dosaboy | 10:48 | |
| *** km has quit IRC | 10:51 | |
| *** daemontool__ has quit IRC | 10:57 | |
| *** mingdang1 has joined #openstack-swift | 10:58 | |
| *** mvk has quit IRC | 10:59 | |
| *** asettle has joined #openstack-swift | 10:59 | |
| *** asettle has quit IRC | 10:59 | |
| *** haomaiwang has quit IRC | 11:01 | |
| *** haomaiwang has joined #openstack-swift | 11:01 | |
| openstackgerrit | Merged openstack/swift: crypto - cleanup unit tests https://review.openstack.org/304163 | 11:05 |
| *** ankur has quit IRC | 11:07 | |
| openstackgerrit | dharmendra kushwaha proposed openstack/swift: Removing unused clause https://review.openstack.org/254278 | 11:12 |
| *** McMurlock1 has joined #openstack-swift | 11:16 | |
| *** timur has quit IRC | 11:21 | |
| *** timur has joined #openstack-swift | 11:22 | |
| *** bkeller` has quit IRC | 11:27 | |
| *** wbhuber has quit IRC | 11:29 | |
| *** bkeller` has joined #openstack-swift | 11:29 | |
| *** wbhuber has joined #openstack-swift | 11:30 | |
| *** torgomatic has quit IRC | 11:31 | |
| *** NM has joined #openstack-swift | 11:31 | |
| *** torgomatic has joined #openstack-swift | 11:32 | |
| *** ChanServ sets mode: +v torgomatic | 11:32 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: follow up from multipart mime review https://review.openstack.org/305768 | 11:32 |
| *** flaper87 has quit IRC | 11:33 | |
| *** flaper87 has joined #openstack-swift | 11:33 | |
| *** mmcardle has quit IRC | 11:34 | |
| *** wanghua has quit IRC | 11:44 | |
| *** ppai has quit IRC | 11:48 | |
| *** asettle has joined #openstack-swift | 11:53 | |
| *** haomaiwang has quit IRC | 12:01 | |
| *** haomaiwang has joined #openstack-swift | 12:01 | |
| *** delattec has joined #openstack-swift | 12:01 | |
| *** asettle has quit IRC | 12:01 | |
| *** kei_yama has quit IRC | 12:03 | |
| *** flaper87 has quit IRC | 12:04 | |
| *** delatte has quit IRC | 12:04 | |
| *** portante has quit IRC | 12:05 | |
| *** Guest83485 has quit IRC | 12:05 | |
| *** jmccarthy has quit IRC | 12:06 | |
| *** portante has joined #openstack-swift | 12:07 | |
| *** McMurlock2 has joined #openstack-swift | 12:08 | |
| *** Vinsh_ has joined #openstack-swift | 12:10 | |
| *** Vinsh has quit IRC | 12:10 | |
| *** McMurlock1 has quit IRC | 12:10 | |
| *** flaper87 has joined #openstack-swift | 12:11 | |
| *** flaper87 has quit IRC | 12:11 | |
| *** flaper87 has joined #openstack-swift | 12:11 | |
| *** jmccarthy has joined #openstack-swift | 12:11 | |
| *** jlvillal has joined #openstack-swift | 12:13 | |
| *** tristanC_ is now known as tristanC | 12:13 | |
| *** tesseract- has quit IRC | 12:15 | |
| *** tesseract- has joined #openstack-swift | 12:16 | |
| *** mmcardle has joined #openstack-swift | 12:18 | |
| *** asettle has joined #openstack-swift | 12:20 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: crypto - only set body crypto meta if body is read and encrypted https://review.openstack.org/305794 | 12:21 |
| *** haomaiwang has quit IRC | 12:23 | |
| *** asettle has quit IRC | 12:25 | |
| *** mwheckmann has joined #openstack-swift | 12:27 | |
| *** cbartz has joined #openstack-swift | 12:31 | |
| *** hezhiqiang has joined #openstack-swift | 12:32 | |
| tdasilva | good morning | 12:40 |
| *** dmorita has joined #openstack-swift | 12:54 | |
| *** sgundur has joined #openstack-swift | 12:58 | |
| *** dmorita has quit IRC | 12:59 | |
| *** klamath has joined #openstack-swift | 13:00 | |
| *** hezhiqiang has quit IRC | 13:01 | |
| *** resker has quit IRC | 13:02 | |
| *** bill_az has joined #openstack-swift | 13:07 | |
| *** bill_az has quit IRC | 13:08 | |
| *** joeljwright has joined #openstack-swift | 13:12 | |
| *** ChanServ sets mode: +v joeljwright | 13:12 | |
| mahatic | acoles: hi, i don't see any func test failures on 305768.. I have the latest code of feature crypto - last commit being "cleanup unit tests" | 13:13 |
| *** permalac_ has joined #openstack-swift | 13:14 | |
| mahatic | acoles: nosetests ./test/functional/test_object.py:TestObject.test_manifest - this runs ok | 13:14 |
| mahatic | and other func tests as well | 13:15 |
| *** david-lyle has joined #openstack-swift | 13:15 | |
| acoles | mahatic: *all* tests pass?? | 13:15 |
| mahatic | acoles: yeah! | 13:16 |
| *** bkeller^ has joined #openstack-swift | 13:16 | |
| *** torgomatic_ has joined #openstack-swift | 13:16 | |
| acoles | mahatic: do you have crypto installed? | 13:16 |
| *** swat30_ has joined #openstack-swift | 13:16 | |
| *** swifterdarrell_ has joined #openstack-swift | 13:16 | |
| *** torgomatic has quit IRC | 13:17 | |
| *** bkeller` has quit IRC | 13:17 | |
| *** swifterdarrell has quit IRC | 13:17 | |
| *** swat30 has quit IRC | 13:17 | |
| *** bobby2 has quit IRC | 13:17 | |
| *** alpha_ori has quit IRC | 13:17 | |
| *** swat30_ is now known as swat30 | 13:17 | |
| *** bkeller^ is now known as bkeller` | 13:17 | |
| *** swifterdarrell_ is now known as swifterdarrell | 13:17 | |
| acoles | we don't pass all tests yet on the feature branch | 13:17 |
| *** jmccarthy has quit IRC | 13:17 | |
| *** bobby2 has joined #openstack-swift | 13:17 | |
| * mahatic checks the nail biting question | 13:17 | |
| acoles | :) | 13:17 |
| *** matt6434 has quit IRC | 13:17 | |
| *** jlvillal has quit IRC | 13:17 | |
| *** sgundur has quit IRC | 13:17 | |
| *** david-lyle_ has quit IRC | 13:17 | |
| *** permalac has quit IRC | 13:17 | |
| *** jordanP has quit IRC | 13:17 | |
| *** csmart has quit IRC | 13:17 | |
| *** matt6434 has joined #openstack-swift | 13:18 | |
| *** jordanP has joined #openstack-swift | 13:18 | |
| *** jlvillal has joined #openstack-swift | 13:18 | |
| mahatic | acoles: you're right. I had another branch with copy patches i think. but where i ran tests now doesn't have crypto. will run them and post back, sory | 13:19 |
| mahatic | sorry* | 13:19 |
| *** csmart has joined #openstack-swift | 13:19 | |
| acoles | mahatic: re your patch, bear in mind that a server can return 206 for a single part range response as well as multipart | 13:21 |
| acoles | mahatic: http://tools.ietf.org/html/rfc7233#section-4.1 | 13:21 |
| *** alpha_ori has joined #openstack-swift | 13:21 | |
| mahatic | acoles: yes thank you for pointing out | 13:22 |
| *** jmccarthy has joined #openstack-swift | 13:22 | |
| *** 14WAAQ1VG has joined #openstack-swift | 13:23 | |
| *** pauloewerton has joined #openstack-swift | 13:24 | |
| *** sgundur has joined #openstack-swift | 13:33 | |
| *** SkyRocknRoll has quit IRC | 13:35 | |
| *** daemontool has joined #openstack-swift | 13:36 | |
| *** sgundur has left #openstack-swift | 13:36 | |
| *** asettle has joined #openstack-swift | 13:44 | |
| *** joeljwright1 has joined #openstack-swift | 13:45 | |
| *** mwheckma1n has joined #openstack-swift | 13:45 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: follow up from multipart mime review https://review.openstack.org/305768 | 13:45 |
| *** Vinsh has joined #openstack-swift | 13:45 | |
| *** bill_az has joined #openstack-swift | 13:46 | |
| *** mmcardle1 has joined #openstack-swift | 13:47 | |
| *** joeljwright has quit IRC | 13:48 | |
| *** mwheckmann has quit IRC | 13:48 | |
| *** mmcardle has quit IRC | 13:48 | |
| *** Vinsh_ has quit IRC | 13:48 | |
| *** dhellmann has quit IRC | 13:48 | |
| *** tonyb has quit IRC | 13:48 | |
| *** jlhinson has quit IRC | 13:48 | |
| mahatic | acoles: ^ checking both 206 and multipart as you pointed, thanks | 13:48 |
| mahatic | acoles: i only have copy failures and test_POST with that | 13:48 |
| *** daemontool has quit IRC | 13:49 | |
| *** zul has quit IRC | 13:49 | |
| *** asettle has quit IRC | 13:49 | |
| *** daemontool has joined #openstack-swift | 13:49 | |
| acoles | mahatic: ok. thanks. I'm out tomorrow so may be next week before I get back round to that. | 13:49 |
| *** tonyb has joined #openstack-swift | 13:49 | |
| mahatic | acoles: ok, have a nice weekend! | 13:50 |
| acoles | maybe timburke could check it's what he meant in original comment? its a tiny patch 305768 | 13:50 |
| patchbot | acoles: https://review.openstack.org/#/c/305768/ - swift (feature/crypto) - follow up from multipart mime review | 13:50 |
| *** diazjf1 has joined #openstack-swift | 13:51 | |
| acoles | mahatic: you gotta make that commit title say something meaningful ;-) | 13:51 |
| mahatic | acoles: :) i wrote a commit message ;) will update, i wil do it from gerrit | 13:52 |
| acoles | yay for gerrit editing :) | 13:53 |
| *** fbo_ is now known as fbo | 13:54 | |
| mahatic | acoles: except i don't see commit message editing in new gerrit (my first attempt in the new UI) :\ | 13:54 |
| acoles | mahatic: you have to select the commit message for review now, then there is an edit button somewhere | 13:55 |
| acoles | mahatic: i find it quicker to do it OMM | 13:55 |
| *** jlhinson has joined #openstack-swift | 13:56 | |
| *** ametts has joined #openstack-swift | 13:57 | |
| openstackgerrit | Mahati Chamarthy proposed openstack/swift: 206 status check for multipart mime doc https://review.openstack.org/305768 | 13:57 |
| *** dhellmann has joined #openstack-swift | 13:58 | |
| mahatic | acoles: done in gerrit, yay! | 13:58 |
| acoles | mahatic: thanks. i love it! | 13:59 |
| pdardeau | good morning | 13:59 |
| mahatic | acoles: hahal ok, im glad | 13:59 |
| *** 14WAAQ1VG has quit IRC | 14:01 | |
| *** dhellmann has quit IRC | 14:01 | |
| *** haomaiwang has joined #openstack-swift | 14:01 | |
| acoles | mahatic: are you joining the phone conf now? | 14:02 |
| mahatic | acoles: I am on phone conf. It says "You're in our virtual lobby, organizer will let you in soon" | 14:02 |
| *** esker has joined #openstack-swift | 14:03 | |
| acoles | mahatic: ok i let you in | 14:03 |
| acoles | thats new to me! | 14:03 |
| mahatic | acoles: thanks, i'm in | 14:03 |
| *** ajiang has joined #openstack-swift | 14:03 | |
| *** dhellmann has joined #openstack-swift | 14:03 | |
| *** dmellado_ is now known as dmellado | 14:04 | |
| *** ajiang has left #openstack-swift | 14:04 | |
| acoles | tdasilva: you about for the phone call? | 14:04 |
| tdasilva | yeah, trying to call in now | 14:04 |
| *** zul has joined #openstack-swift | 14:04 | |
| *** mingdang1 has quit IRC | 14:04 | |
| acoles | tdasilva: great | 14:05 |
| *** _JZ_ has joined #openstack-swift | 14:05 | |
| diazjf1 | acoles, jrichli, mahatic, tdasilva, https://review.openstack.org/#/c/271517/ https://etherpad.openstack.org/p/newton-barbican-design-sessions | 14:08 |
| patchbot | diazjf1: patch 271517 - security-specs - Bring Your Own Key Implementation | 14:08 |
| diazjf1 | acoles. https://etherpad.openstack.org/p/cEA79A5fG1 | 14:13 |
| *** mmcardle1 has quit IRC | 14:18 | |
| *** mmcardle has joined #openstack-swift | 14:21 | |
| diazjf1 | acoles, http://developer.openstack.org/api-guide/key-manager/acls.html | 14:34 |
| *** permalac_ has quit IRC | 14:36 | |
| *** mvk has joined #openstack-swift | 14:40 | |
| tdasilva | acoles: have a great weekend! | 14:49 |
| *** tesseract- has quit IRC | 14:58 | |
| *** lakshmiS has joined #openstack-swift | 15:00 | |
| *** haomaiwang has quit IRC | 15:01 | |
| *** haomaiwang has joined #openstack-swift | 15:01 | |
| *** diazjf1 has quit IRC | 15:01 | |
| *** sgundur has joined #openstack-swift | 15:05 | |
| *** _JZ_ has quit IRC | 15:11 | |
| *** klrmn has joined #openstack-swift | 15:13 | |
| *** hezhiqiang has joined #openstack-swift | 15:20 | |
| *** jordanP has quit IRC | 15:30 | |
| *** diazjf has joined #openstack-swift | 15:31 | |
| Vinsh | notmyname: Some before and after splice() charts on the way later today. A bigger improvement worth noting here - since it's not mentioned anywhere in swift docs our source code.. and only barely brought up in a mail thread from 2013... is token chaching with keystone. Using swift.cache with keystone middlware is horrible. | 15:32 |
| *** asettle has joined #openstack-swift | 15:32 | |
| Vinsh | I moved the memcached_servers list up to the authtoken section. removed the swift.cache config.. and see 20% more requests/second in this cluster. | 15:33 |
| Vinsh | swift.cache doesn't actually do any useful token chaching. it still hits keystone for every request. | 15:34 |
| Vinsh | point keystone middleware directly at memcached.. and things are cached as expected. | 15:34 |
| Vinsh | I bet response time is way better too. | 15:35 |
| *** geaaru has quit IRC | 15:36 | |
| *** diazjf has quit IRC | 15:36 | |
| *** asettle has quit IRC | 15:37 | |
| *** diazjf has joined #openstack-swift | 15:38 | |
| *** arch-nemesis has joined #openstack-swift | 15:38 | |
| *** arch-nemesis has joined #openstack-swift | 15:38 | |
| *** haomaiwang has quit IRC | 15:50 | |
| *** McMurlock2 has quit IRC | 15:56 | |
| *** lakshmiS has quit IRC | 15:59 | |
| *** sheel has quit IRC | 16:15 | |
| *** sheel has joined #openstack-swift | 16:15 | |
| hurricanerix | notmyname where is your website at where you list top 20 or so reviews weighted by them being starred? | 16:15 |
| notmyname | good morning, world | 16:18 |
| notmyname | hurricanerix: it's in the chanel topic | 16:18 |
| *** lyrrad has joined #openstack-swift | 16:18 | |
| notmyname | Vinsh: interesting. is that because your users are reauthing for every request and not getting the same token back from keystone? | 16:19 |
| notmyname | Vinsh: what keystone token type are you using? | 16:20 |
| *** ppai has joined #openstack-swift | 16:21 | |
| *** cbartz has quit IRC | 16:21 | |
| notmyname | Vinsh: thanks for the info. I'm really interested in those results and seeing the config changes you did | 16:22 |
| Vinsh | notmyname: The user caches their token.. but swift checks that token against keystone everytime | 16:23 |
| Vinsh | *when configured using swift.cache | 16:23 |
| notmyname | when keystone is configured that way? | 16:24 |
| Vinsh | Yeah | 16:24 |
| Vinsh | which is default in all the swift docs | 16:24 |
| notmyname | hmm...what I remember is that functionality was added so that we specifically wouldn't check keystone every time | 16:24 |
| Vinsh | You can however take "memcache_servers" from the "filter:cache" section. rename it to "memcached_servers" and move it up to "authtoken" | 16:24 |
| notmyname | Vinsh: can you pastebin a config snippet of before and after? | 16:25 |
| Vinsh | Sure thing. | 16:25 |
| Vinsh | I melted out lab keystone nodes with my benchmarking. :) so I was motivated to finally look closer at our token caching or lack thereof. | 16:25 |
| hurricanerix | notmyname doh! ok, thanks! | 16:26 |
| *** jistr has quit IRC | 16:28 | |
| notmyname | hurricanerix: I'm refreshing it now. hadn't been doing that while I was traveling | 16:28 |
| pdardeau | notmyname: thx again for your time with OSIC team. happy to hear you made it home safely. | 16:30 |
| Vinsh | notmyname: http://paste.openstack.org/show/494101/ | 16:31 |
| notmyname | pdardeau: my pleasure. great to meet everyone, and, I hope, help out | 16:31 |
| notmyname | ntata: great review on patch 305405 :-) | 16:31 |
| patchbot | notmyname: https://review.openstack.org/#/c/305405/ - swift - fix fallocate_reserve traceback | 16:31 |
| pdardeau | notmyname: extremely helpful! | 16:31 |
| notmyname | Vinsh: thanks. will look in just a bit | 16:32 |
| Vinsh | notmyname: might get that perf I'm going for if I can keep digging up 20% increases :D | 16:33 |
| notmyname | :-) | 16:33 |
| *** rcernin has quit IRC | 16:36 | |
| openstackgerrit | Tim Burke proposed openstack/swift: Add multipart content-type test https://review.openstack.org/305976 | 16:39 |
| notmyname | hurricanerix: dashboard is updated | 16:39 |
| *** nadeem has joined #openstack-swift | 16:41 | |
| *** nadeem has quit IRC | 16:42 | |
| *** nadeem has joined #openstack-swift | 16:44 | |
| acoles | timburke: thanks for that test | 16:45 |
| *** dmorita has joined #openstack-swift | 16:45 | |
| timburke | no problem. i was the one to point out that we should check response code, so when i saw that patch go by, i figured i ought to take a look and help out | 16:46 |
| *** donagh has joined #openstack-swift | 16:48 | |
| *** rledisez has quit IRC | 16:50 | |
| *** lakshmiS has joined #openstack-swift | 16:54 | |
| acoles | timburke: can I delete line 485 here https://review.openstack.org/#/c/305976/1/test/unit/common/middleware/test_decrypter.py before merging? | 16:58 |
| patchbot | acoles: patch 305976 - swift (feature/crypto) - Add multipart content-type test | 16:58 |
| acoles | It would fail pep8 I think? | 16:58 |
| timburke | oh yeah, good call. i'd commented it out because i wasn't sure whether it would be necessary. by the time i'd confirmed that it wasn't, i'd forgotten about it :P | 16:59 |
| timburke | i'll throw up a new patchset | 17:00 |
| acoles | timburke: i was just enjoying the gerrit editor :) shall I change or you? | 17:00 |
| openstackgerrit | Tim Burke proposed openstack/swift: Add multipart content-type test https://review.openstack.org/305976 | 17:01 |
| timburke | too late! | 17:01 |
| notmyname | redbo: FYI, new pypy instructions http://d.not.mn/PyPyDeployment_rev1.pdf | 17:01 |
| *** dmorita has quit IRC | 17:02 | |
| *** dmorita has joined #openstack-swift | 17:03 | |
| bkeller` | timburke, is there a reason that patch 285754 is only for accounts/containers (not objects)? | 17:05 |
| patchbot | bkeller`: https://review.openstack.org/#/c/285754/ - swift - Require account/container metadata be UTF-8 | 17:05 |
| acoles | timburke: thanks. done. | 17:05 |
| *** mingdang1 has joined #openstack-swift | 17:05 | |
| timburke | bkeller`: objects can have non-utf-8 metadata. not sure why you'd want it, and it would certainly break from HTTP spec, but i wanted to limit the patch to just fixing the 500s that would be hit on account/container servers | 17:07 |
| bkeller` | ah, alright, thanks | 17:07 |
| *** esker has quit IRC | 17:08 | |
| *** joeljwright1 has quit IRC | 17:10 | |
| *** mingdang1 has quit IRC | 17:10 | |
| *** SkyRocknRoll has joined #openstack-swift | 17:10 | |
| *** ppai has quit IRC | 17:12 | |
| *** lakshmiS_ has joined #openstack-swift | 17:18 | |
| *** diazjf has quit IRC | 17:18 | |
| *** lyrrad_ has joined #openstack-swift | 17:19 | |
| *** hezhiqia_ has joined #openstack-swift | 17:20 | |
| *** lakshmiS has quit IRC | 17:20 | |
| *** lyrrad has quit IRC | 17:20 | |
| *** hezhiqiang has quit IRC | 17:20 | |
| *** mwheckma1n has quit IRC | 17:20 | |
| *** lyrrad_ is now known as lyrrad | 17:20 | |
| *** jmccarthy has quit IRC | 17:21 | |
| *** asettle has joined #openstack-swift | 17:21 | |
| *** mwheckmann has joined #openstack-swift | 17:22 | |
| *** iurygregory has quit IRC | 17:23 | |
| *** asettle has quit IRC | 17:26 | |
| *** ChubYann has joined #openstack-swift | 17:27 | |
| *** diazjf has joined #openstack-swift | 17:28 | |
| *** pauloewerton has quit IRC | 17:28 | |
| *** NM1 has joined #openstack-swift | 17:33 | |
| *** NM has quit IRC | 17:33 | |
| *** dikonoo has quit IRC | 17:36 | |
| *** dikonoor has quit IRC | 17:36 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: Encrypt/decrypt etag in container listing https://review.openstack.org/275492 | 17:36 |
| openstackgerrit | Alistair Coles proposed openstack/swift: Update container with correct etag on POST https://review.openstack.org/305995 | 17:36 |
| *** jmccarthy has joined #openstack-swift | 17:38 | |
| openstackgerrit | Alistair Coles proposed openstack/swift: crypto - Update container with correct etag on POST https://review.openstack.org/305995 | 17:38 |
| *** hezhiqia_ has quit IRC | 17:42 | |
| *** tqtran has joined #openstack-swift | 17:44 | |
| *** portante_ has joined #openstack-swift | 17:50 | |
| *** portante has quit IRC | 17:50 | |
| *** portante_ is now known as portante | 17:50 | |
| *** 7JTAANF1Q has joined #openstack-swift | 17:51 | |
| *** NM1 has quit IRC | 17:51 | |
| *** NM has joined #openstack-swift | 17:51 | |
| redbo | notmyname: That's basically what I did. But I gave up, pypy was pretty consistently like 10% slower than cpython on my benchmarks. | 17:52 |
| *** gyee has joined #openstack-swift | 17:55 | |
| *** 7JTAANF1Q has quit IRC | 17:56 | |
| acoles | clayg: ping | 17:57 |
| *** ametts has quit IRC | 17:59 | |
| *** itlinux has joined #openstack-swift | 18:00 | |
| acoles | clayg: nm. just realised I only had +1 on patch 292661 and there's no reason not to merge imho. | 18:01 |
| patchbot | acoles: https://review.openstack.org/#/c/292661/ - swift - Make rsync ignore it's own temporary files | 18:01 |
| *** ametts has joined #openstack-swift | 18:01 | |
| acoles | But I am curious if anyone knows what the character set is for mkstemp suffixes? | 18:01 |
| * acoles is ooo til Monday | 18:02 | |
| *** mmcardle has quit IRC | 18:04 | |
| *** acoles is now known as acoles_ | 18:09 | |
| *** bendre101 has joined #openstack-swift | 18:10 | |
| *** itlinux has quit IRC | 18:11 | |
| bendre101 | Hello everyone. I can't find anywhere in the documentation of Openstack Swift if there is any way to protect against application (or human) error causing thousands of unwanted delete requests. Swift seems to be pretty much indestructible hardware wise, but how can you backup your swift cluster to recover unwanted delete? | 18:11 |
| *** itlinux has joined #openstack-swift | 18:11 | |
| openstackgerrit | Merged openstack/swift: 206 status check for multipart mime doc https://review.openstack.org/305768 | 18:12 |
| tdasilva | bendre101: there's currently no official way to prevent that. Swiftstack has a swift_undelete middleware that you could test here: https://github.com/swiftstack/swift_undelete. More recently, there's been some discussion around building something in swift core. https://review.openstack.org/#/c/155421/4/specs/in_progress/object_undelete.rst. timburke also has a really nice plan to provide some data protection mechanis | 18:22 |
| tdasilva | m using object versioning and a new "default" middleware | 18:22 |
| patchbot | tdasilva: patch 155421 - swift-specs - Add object undelete spec (ABANDONED) | 18:22 |
| *** tqtran has quit IRC | 18:25 | |
| timburke | bendre101: fwiw, i don't really like the swift_undelete middleware. it splits up the responsibilities of protecting against deletes and protecting against overwrites, which means you need to version your undelete container and undelete protect your versions container, and you now have a whole bunch of locations to check when trying to restore an old version. https://review.openstack.org/#/c/214922/ seems much more promising | 18:27 |
| patchbot | timburke: patch 214922 - swift - Add "history" mode to versioned_writes middleware | 18:27 |
| *** daemontool has quit IRC | 18:31 | |
| *** SkyRocknRoll has quit IRC | 18:32 | |
| bendre101 | I saw the undelete middleware but it's been a year since the last commit, I'd worry a bit too much on a multi petabytes deployment | 18:33 |
| bendre101 | So there are no solution to either undelete files or to simply backup Swift to another cluster ? You need to manage that with a middleware ? | 18:34 |
| bendre101 | I saw the container sync functionality but it doesn't seem to allow a one-way only sync | 18:36 |
| openstackgerrit | oshritf proposed openstack/swift: Per container stat. report https://review.openstack.org/281814 | 18:38 |
| Vinsh | bendre101: I sort of feel like if someone is worried about that kind of thing.. they are doing it wrong. | 18:41 |
| Vinsh | A user should only have scope as far as their own account. An admin account should be tightly controlled. | 18:42 |
| *** diazjf has quit IRC | 18:42 | |
| Vinsh | If a user deletes things.. it only impacts their account etc. Keep it all segmented. | 18:42 |
| *** hezhiqiang has joined #openstack-swift | 18:44 | |
| bendre101 | Vinsh: is it possible to block the delete action for a specific user ? | 18:44 |
| *** zaitcev has joined #openstack-swift | 18:46 | |
| *** ChanServ sets mode: +v zaitcev | 18:46 | |
| Vinsh | Depends. there are account/container acls you could mess with. http://docs.openstack.org/developer/swift/overview_auth.html#tempauth | 18:46 |
| Vinsh | ^^ if using tempauth. | 18:46 |
| NM | bendre101: Our team use an undelete plugin. Do you think that might work for you? | 18:46 |
| Vinsh | if using keystone. I suppose you could extend some middleware to filter which users can delete. | 18:47 |
| Vinsh | I still think it's the wrong approach. A user should only have access/scope to limited area. | 18:48 |
| Vinsh | Limit the damage they can do. what scenario do you foresee with everything being deleted? | 18:48 |
| *** citytiming has joined #openstack-swift | 18:50 | |
| bendre101 | NM: is it the swift_undelete middleware ? It might work but it needs to be production ready | 18:53 |
| Vinsh | Do you have single users with access to all data in the entire cluster? | 18:53 |
| bendre101 | Vinsh: a single application using Swift as a massive storage backend to store millions of generated files | 18:53 |
| *** esker has joined #openstack-swift | 18:54 | |
| bendre101 | (small pdfs that have legal value) | 18:54 |
| Vinsh | Probably best to spread them across more then one tenant. Explicit access required to a segment of each of them. | 18:55 |
| Vinsh | I dunno.. I feel like that app has to have the smarts... solving the problem in swift seems odd to me (IMO). | 18:56 |
| Vinsh | I'm sure this can be argued many ways. | 18:56 |
| *** citytiming has quit IRC | 18:57 | |
| Vinsh | bendre101: do you use keystone with swift? | 18:57 |
| Vinsh | Give this a good read: http://docs.openstack.org/developer/swift/misc.html | 18:58 |
| bendre101 | Vinsh: we are in the analysis phase, so it's a possibility | 18:58 |
| *** tqtran has joined #openstack-swift | 18:59 | |
| Vinsh | You could use the container ACL method listed in that last link. | 18:59 |
| Vinsh | Say "user bendre is read only" | 18:59 |
| openstackgerrit | Janie Richling proposed openstack/swift: Encrypt/decrypt etag in container listing https://review.openstack.org/275492 | 18:59 |
| Vinsh | more examples here: https://swiftstack.com/docs/cookbooks/swift_usage/container_acl.html | 19:00 |
| ahale | whats the difference if the app accidently deletes all the pdfs or if it reuploads 0 byte writes over them all | 19:00 |
| Vinsh | exactly | 19:00 |
| bendre101 | Thank you for the links Vinsh | 19:00 |
| bendre101 | that's a very good point ahale, idealy for our need the storage backend would prevent any file overide (with an acl ?) | 19:01 |
| Vinsh | perfect.. you set the container write ACL to "not for anyone" or something. | 19:02 |
| Vinsh | again though.. segment files across containers and accounts. control access properly.. etc. | 19:02 |
| bendre101 | yes but we still need to write to put the generated pdfs in swift | 19:02 |
| lakshmiS_ | timur: I was going through your comments on the searchlight spec and want to how does this patch https://review.openstack.org/#/c/304332/ help in making a call from swift to searchlight. | 19:03 |
| patchbot | lakshmiS_: patch 304332 - swift - Expand the container server API to allow "since". | 19:03 |
| *** hezhiqiang has quit IRC | 19:04 | |
| lakshmiS_ | will there be an async process on swift which keeps listening to changes on swift and calls searchlight? | 19:04 |
| lakshmiS_ | rather than being in the active pipeline of middleware? | 19:04 |
| *** esker has quit IRC | 19:10 | |
| *** esker has joined #openstack-swift | 19:10 | |
| *** nadeem has quit IRC | 19:11 | |
| *** nadeem has joined #openstack-swift | 19:13 | |
| *** bill_az has quit IRC | 19:13 | |
| timur | lakshmiS_: there needs to be something written to use that patch, but the idea is to continue listing all container changes and propagate them to search light. This would be a cheaper way to pickup any changes that have not been propagated to searchlight already (during an outage or a partition or any other reason). It's possible that it would also be sufficient to use this mechanism and not use | 19:19 |
| timur | any in-path middleware, but I'm not clear on the latency we would observe as the number of swift operations increases | 19:19 |
| *** diazjf has joined #openstack-swift | 19:20 | |
| timur | another benefit is that changes to searchlight could be made using the bulk API, rather than individual index requests, which should give better performance on the ES side | 19:20 |
| lakshmiS_ | and that "something" would be listener process running separately on swift server? | 19:21 |
| timur | lakshmiS_: right, except it would need to poll the database for changes | 19:21 |
| timur | it could be ok if latencies on the order of seconds are acceptable from the searchlight side. I'd imagine that should be acceptable, but I don't know all of the requirements | 19:22 |
| lakshmiS_ | I am willing to right that. i like that "bulk" part of it | 19:22 |
| *** esker has quit IRC | 19:23 | |
| timur | great! | 19:23 |
| timur | I don't know how much time you spent looking at the ElasticSearch APIs, but here is the bulk API reference: https://www.elastic.co/guide/en/elasticsearch/reference/current/docs-bulk.html | 19:23 |
| lakshmiS_ | its a two sided sword. good from performance for both searchlight and swift. and at the same time have to tune the latency on polling the db without impacting the performance of swift db | 19:23 |
| lakshmiS_ | yes we do use bulk api in searchlight for indexing today | 19:24 |
| clayg | heyoh! | 19:24 |
| timur | excellent. Agreed that tuning the polling will be a balancing act | 19:25 |
| NM | bendre101: Well, we are running it in production :) | 19:28 |
| lakshmiS_ | thanks for clarification. will try to read up on the swift db code. also i wanted to check with you about elasticsearch client code that were working on - john mentioned yesterday. | 19:28 |
| lakshmiS_ | there will be some things specific to searchlight mappings but want to check it out before starting fresh on es library | 19:29 |
| timur | sure thing. Let me know how I can help | 19:30 |
| lakshmiS_ | i meant, do you already have it coded somewhere thats online to view? | 19:31 |
| timur | oh, I see. SwiftStack hasn't made it public thus far. I can answer questions about the approach, but I'll have to check if it's something we plan to make public | 19:33 |
| lakshmiS_ | ok no issues. it is going to be a thin layer on top of elasticsearch python library. I will add you as reviewer on the patch | 19:34 |
| timur | sounds good | 19:35 |
| bendre101 | NM: can I ask how much data you have in total ? Do you use swift versioning functionality to protect against overwiting existing data? | 19:37 |
| *** esker has joined #openstack-swift | 19:41 | |
| NM | bendre101: I think we have arround 400 GB in use and 350M requests/day. | 19:42 |
| NM | And yes, we use versioning. | 19:42 |
| *** bill_az has joined #openstack-swift | 19:47 | |
| *** dukhlov has joined #openstack-swift | 19:47 | |
| dukhlov | Hi! | 19:48 |
| dukhlov | Could anybody review https://review.openstack.org/#/c/303401/ | 19:48 |
| patchbot | dukhlov: patch 303401 - swift - Adds eventlet monkey patching of select module if ... | 19:48 |
| dukhlov | ? | 19:48 |
| bendre101 | NM: I think we'll take a closer look to this middleware, thanks | 19:49 |
| bendre101 | thank you for your help and explanations ! | 19:49 |
| *** mminesh has joined #openstack-swift | 19:52 | |
| timur | lakshmiS_: I had one question about the middleware you were using previously. Which headers did you find missing from the response? | 19:54 |
| lakshmiS_ | let me check | 19:55 |
| lakshmiS_ | one of my colleague did that patch. I will check with him or else i will update the spec after running the diff between them | 19:58 |
| lakshmiS_ | top of my head, fields like object count on a container which comes through API call | 19:59 |
| *** diazjf has quit IRC | 20:01 | |
| openstackgerrit | Merged openstack/swift: Make rsync ignore it's own temporary files https://review.openstack.org/292661 | 20:02 |
| notmyname | bendre101: FWIW, I've helped a customer do WORM-like stuff in swift before. it requires some other external system to know what can and can't be overwritten (in this case, the customer already had that exact system in place for other uses, so it was possible to make) | 20:02 |
| notmyname | bendre101: but looking at "just" swift, there's no way to effectively prevent overwrites 100% of the time (considering HW failures and adjusting capacity) | 20:03 |
| mminesh | ? | 20:05 |
| *** mminesh has quit IRC | 20:06 | |
| notmyname | mmotiani: looks like you can still register for the summit (at full price). that's probably the thing to do at this point, if you're going (/cc pdardeau) | 20:11 |
| *** nadeem has quit IRC | 20:15 | |
| *** delattec has quit IRC | 20:15 | |
| *** sileht has quit IRC | 20:19 | |
| *** sileht has joined #openstack-swift | 20:19 | |
| *** dukhlov_ has joined #openstack-swift | 20:20 | |
| bendre101 | notmyname: overwrites are not as deal breaker as long as you can go back to the original version quickly (wich seems to be the case with versioning). But can you elaborate on "HW failures"? My understanding is that with replicats and sufficiant amount of nodes, HW failures can't really cause loss of data | 20:21 |
| *** dukhlov has quit IRC | 20:22 | |
| *** sheel has quit IRC | 20:25 | |
| timur | lakshmiS_: makes sense. I was looking at the headers in the patch you had uploaded before and couldn't tell what would be the missing header from that code | 20:25 |
| *** esker has quit IRC | 20:26 | |
| *** bhakta has quit IRC | 20:26 | |
| timur | and sorry, not headers, but the keys and values in the elasticsearch documents | 20:27 |
| *** bhakta has joined #openstack-swift | 20:28 | |
| lakshmiS_ | i checked with him but doesn't remember top of his head. so i am running through each of the field to check it to make sure that's true | 20:28 |
| timur | ok. I wouldn't spend too much time on it, maybe, but it'd be good to document the required fields in the requirements document | 20:30 |
| timur | at least it would make it obvious to others why certain choices are made | 20:30 |
| lakshmiS_ | sure | 20:31 |
| *** siva_krishnan_ has joined #openstack-swift | 20:39 | |
| *** siva_kri- has quit IRC | 20:39 | |
| *** siva_krishnan_ has quit IRC | 20:41 | |
| *** cdelatte has joined #openstack-swift | 20:43 | |
| *** esker has joined #openstack-swift | 20:46 | |
| *** esker has quit IRC | 20:52 | |
| openstackgerrit | Merged openstack/swift: Add multipart content-type test https://review.openstack.org/305976 | 20:55 |
| *** nyarck has joined #openstack-swift | 21:00 | |
| klamath | has anyone used the xfs option "delaylog" with swift? | 21:03 |
| notmyname | klamath: I've not used it. but a quick google search shows that it might be an older option that is deprecated/removed http://oss.sgi.com/archives/xfs/2015-02/msg00306.html | 21:06 |
| klamath | looks like it is the default now | 21:07 |
| klamath | thanks notmyname saved me a benchmarking run | 21:08 |
| *** NM has left #openstack-swift | 21:30 | |
| *** itlinux has quit IRC | 21:34 | |
| *** haomaiwang has joined #openstack-swift | 21:41 | |
| *** haomaiwang has quit IRC | 21:46 | |
| *** trifon has quit IRC | 21:47 | |
| notmyname | jrichli: your picture is on page 48 of the openstack user survey | 21:49 |
| *** arch-nemesis has quit IRC | 21:51 | |
| notmyname | FYI the survey link is http://www.openstack.org/assets/survey/April-2016-User-Survey-Report.pdf | 21:52 |
| *** zaitcev has quit IRC | 21:52 | |
| *** jrichli has quit IRC | 21:52 | |
| *** gyee has quit IRC | 21:52 | |
| *** jrichli has joined #openstack-swift | 21:52 | |
| *** gyee has joined #openstack-swift | 21:53 | |
| *** citytiming has joined #openstack-swift | 21:53 | |
| *** zaitcev has joined #openstack-swift | 21:53 | |
| *** ChanServ sets mode: +v zaitcev | 21:53 | |
| *** jlvillal has quit IRC | 21:53 | |
| *** bhakta has quit IRC | 21:53 | |
| *** rsFF has quit IRC | 21:53 | |
| notmyname | on swift info, seems that about 153 people (of 290 respondents) said they are running swift | 21:54 |
| notmyname | and 73/72 people responded to the questions about how big their clusters are | 21:54 |
| tdasilva | notmyname: 153 out 290 is roughly 50%, do you know where that 30% number comes from? | 21:55 |
| *** AbyssOne has quit IRC | 21:55 | |
| notmyname | what 30% number? | 21:55 |
| notmyname | (it's actually 53% | 21:55 |
| *** citytiming has quit IRC | 21:56 | |
| notmyname | I got those from page 31 | 21:56 |
| notmyname | n=290, and 53% said they were using swift | 21:56 |
| *** tqtran has quit IRC | 21:56 | |
| tdasilva | ok, 53% total, got it | 21:56 |
| tdasilva | prod + testing | 21:56 |
| notmyname | and seems that thee were 1603 survey respondents overall | 21:57 |
| notmyname | (page 4) | 21:57 |
| *** jlvillal has joined #openstack-swift | 21:58 | |
| *** rsFF has joined #openstack-swift | 21:58 | |
| jrichli | notmyname: yes, tdasilva mentioned it the other day. I think i will be noticing the people with cameras a little more next time :-) | 21:59 |
| *** bill_az has quit IRC | 22:00 | |
| *** bhakta has joined #openstack-swift | 22:00 | |
| *** dukhlov_ has quit IRC | 22:04 | |
| *** AbyssOne has joined #openstack-swift | 22:05 | |
| *** arch-nemesis has joined #openstack-swift | 22:06 | |
| *** dmorita has quit IRC | 22:06 | |
| *** dmorita has joined #openstack-swift | 22:06 | |
| *** esker has joined #openstack-swift | 22:09 | |
| *** ametts has quit IRC | 22:10 | |
| *** tqtran has joined #openstack-swift | 22:10 | |
| *** citytiming has joined #openstack-swift | 22:12 | |
| *** esker has quit IRC | 22:13 | |
| *** mwheckmann has quit IRC | 22:18 | |
| *** citytiming has quit IRC | 22:20 | |
| *** klamath has quit IRC | 22:27 | |
| *** haomaiwa_ has joined #openstack-swift | 22:42 | |
| *** tqtran has quit IRC | 22:44 | |
| *** tqtran has joined #openstack-swift | 22:44 | |
| openstackgerrit | Janie Richling proposed openstack/swift: Encrypt/decrypt etag in container listing https://review.openstack.org/275492 | 22:46 |
| *** sheel has joined #openstack-swift | 22:47 | |
| *** haomaiwa_ has quit IRC | 22:47 | |
| jrichli | tdasilva: just left a comment for you on patch 305794 | 22:53 |
| patchbot | jrichli: https://review.openstack.org/#/c/305794/ - swift (feature/crypto) - crypto - only set body crypto meta if body is read... | 22:53 |
| *** itlinux has joined #openstack-swift | 22:56 | |
| *** jamielennox is now known as jamielennox|away | 22:58 | |
| *** dmorita has quit IRC | 23:01 | |
| *** dmorita has joined #openstack-swift | 23:02 | |
| *** km has joined #openstack-swift | 23:05 | |
| *** asettle has joined #openstack-swift | 23:16 | |
| openstackgerrit | Tim Burke proposed openstack/python-swiftclient: Add v1password keystoneauth plugin https://review.openstack.org/300697 | 23:22 |
| *** aj701 has joined #openstack-swift | 23:22 | |
| *** kei_yama has joined #openstack-swift | 23:37 | |
| *** hosanai has joined #openstack-swift | 23:50 | |
| *** ChanServ sets mode: +v hosanai | 23:50 | |
| *** jamielennox|away is now known as jamielennox | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!