Saturday, 2018-05-12

*** gyee has quit IRC00:02
*** mikecmpbll has quit IRC00:23
*** mikecmpbll has joined #openstack-swift00:24
*** mvenesio has quit IRC00:48
*** mvenesio has joined #openstack-swift00:50
*** mvenesio has quit IRC00:51
*** itlinux has quit IRC01:04
*** armaan has quit IRC01:23
*** armaan has joined #openstack-swift01:23
*** itlinux has joined #openstack-swift01:31
*** klamath has quit IRC02:37
*** klamath has joined #openstack-swift03:46
*** klamath has quit IRC04:00
*** germs has quit IRC04:17
*** germs has joined #openstack-swift04:17
*** SkyRocknRoll has joined #openstack-swift04:29
*** germs has quit IRC04:40
*** mikecmpbll has quit IRC04:49
*** germs has joined #openstack-swift04:56
*** germs has quit IRC04:56
*** germs has joined #openstack-swift04:56
*** germs has quit IRC05:01
*** SkyRocknRoll has quit IRC05:03
*** klamath has joined #openstack-swift05:57
*** klamath has quit IRC06:02
*** germs has joined #openstack-swift06:18
*** SkyRocknRoll has joined #openstack-swift06:19
*** zaitcev has quit IRC06:23
*** germs has quit IRC06:24
*** SkyRocknRoll has quit IRC06:33
*** armaan has quit IRC06:53
*** armaan has joined #openstack-swift06:54
*** pcaruana has joined #openstack-swift07:01
*** SkyRocknRoll has joined #openstack-swift07:28
*** armaan has quit IRC07:43
*** armaan has joined #openstack-swift07:43
*** klamath has joined #openstack-swift07:58
*** klamath has quit IRC08:03
*** germs has joined #openstack-swift08:20
*** germs has joined #openstack-swift08:20
*** germs has quit IRC08:25
*** gkadam has joined #openstack-swift08:43
*** mikecmpbll has joined #openstack-swift08:52
*** onovy has quit IRC09:44
*** cshastri_ has joined #openstack-swift09:58
*** klamath has joined #openstack-swift09:59
*** klamath has quit IRC10:04
*** cshastri_ has quit IRC10:10
*** germs has joined #openstack-swift10:21
*** germs has quit IRC10:21
*** germs has joined #openstack-swift10:21
*** germs has quit IRC10:25
*** geaaru_ has joined #openstack-swift10:26
*** geaaru has quit IRC10:28
*** gyankum has joined #openstack-swift10:34
*** gyan_ has joined #openstack-swift10:34
*** gyan_ has quit IRC10:40
*** gyankum has quit IRC10:40
*** onovy has joined #openstack-swift10:44
*** armaan_ has joined #openstack-swift11:54
*** armaan has quit IRC11:54
*** klamath has joined #openstack-swift12:00
*** gyankum has joined #openstack-swift12:01
*** gyan_ has joined #openstack-swift12:01
*** klamath has quit IRC12:04
*** armaan_ has quit IRC12:16
*** armaan has joined #openstack-swift12:17
*** torgomatic has quit IRC12:27
*** gyan_ has quit IRC12:28
*** gyankum has quit IRC12:28
*** torgomatic has joined #openstack-swift12:30
*** ChanServ sets mode: +v torgomatic12:30
*** gyankum has joined #openstack-swift12:30
*** gyan_ has joined #openstack-swift12:31
*** armaan has quit IRC12:37
*** armaan has joined #openstack-swift12:46
*** armaan has quit IRC12:50
*** vinsh has quit IRC12:56
DHEa (minor) bandwidth issue for multi-region situations occurs to me. I'm looking at building a multi-region (like, 4) cluster with 1 or 2 replicas per region. that means that PUTs are going to write a lot of copies out around the WAN links...13:13
*** persia has joined #openstack-swift13:15
*** Renich has quit IRC13:25
*** gyan_ has quit IRC13:38
*** gyankum has quit IRC13:39
*** Renich has joined #openstack-swift13:46
*** cshastri_ has joined #openstack-swift13:48
*** cshastri_ has quit IRC13:59
*** klamath has joined #openstack-swift14:01
*** klamath has quit IRC14:06
*** klamath has joined #openstack-swift14:07
*** jistr has quit IRC14:09
*** jistr has joined #openstack-swift14:14
*** jistr has quit IRC14:22
*** ianychoi_ has joined #openstack-swift14:22
*** ianychoi has quit IRC14:25
*** jistr has joined #openstack-swift14:28
*** armaan has joined #openstack-swift14:42
notmynameDHE: yes14:51
notmynameDHE: in a global cluster, I'd recommend setting up per-region memcache pools. you don't want a proxy in region A asking a memcache server in region B for cached data14:52
DHEwell, yes that makes sense.15:02
DHEmy main concern is I'm looking at 1.5 to 2 gigabits/second of raw uploads15:03
*** hseipp has joined #openstack-swift15:06
notmynamehave you come across write affinity yet?15:09
notmynamedisclaimer: I hate write affinity. it's almost never what you actually want15:09
notmynamewrite affinity let's you defer inter-region communication until later (ie not during the client request)15:10
notmynameit will make your utilization lumpier and it intentionally puts a ton of data in handoff locations (ie lots more work for the replication process to do later)15:10
notmynamebut, if you have bursty/seasonal workloads and if your ingest is lower than your ability do do the deferred work and if your users cannot tolerate additional latency on writes, then maybe just maybe write affinity is a thing that could help15:11
*** hseipp has quit IRC15:12
DHEyes I've read all the online docs (besides python API level stuff)15:19
DHEno, it's very continuous and borderline constant bitrate15:19
notmynameah15:20
notmynameunlikely that write affinity would make your job easier, then15:20
DHEwhat I do have in mind is a strange idea. there's a hundred-ish uploads of smallish (4 megabytes or less typically) files per second. it might be tactically useful to upload to a proxy in a different region so the multiplication factor of distributing to object servers is also distributed...15:22
DHEdoes that make sense?15:22
DHEthese 4 sites are in a ring15:22
DHEeven though all the uploads would originate from the same region15:23
*** armaan has quit IRC15:26
*** szaher_ has quit IRC15:41
*** szaher has joined #openstack-swift15:54
*** gkadam has quit IRC17:02
*** SkyRocknRoll has quit IRC17:43
*** ukaynar_ has joined #openstack-swift18:28
*** bkopilov_ has quit IRC18:37
*** bkopilov has quit IRC18:38
*** gkadam has joined #openstack-swift18:41
*** bkopilov has joined #openstack-swift18:49
*** bkopilov_ has joined #openstack-swift18:51
*** geaaru__ has joined #openstack-swift19:27
*** geaaru_ has quit IRC19:28
*** bkopilov has quit IRC19:38
*** bkopilov_ has quit IRC19:38
*** itlinux has quit IRC20:07
*** ukaynar_ has quit IRC20:08
*** ukaynar_ has joined #openstack-swift20:08
*** ukaynar_ has quit IRC20:12
*** itlinux has joined #openstack-swift20:46
*** ukaynar_ has joined #openstack-swift21:54
*** pcaruana has quit IRC22:24
*** ukaynar_ has quit IRC23:20
*** ukaynar_ has joined #openstack-swift23:20
*** ukaynar_ has quit IRC23:23

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!