Wednesday, 2018-05-02

*** armaan has quit IRC00:03
*** armaan has joined #openstack-swift00:04
*** armaan has quit IRC00:05
*** armaan has joined #openstack-swift00:05
openstackgerritSamuel Merritt proposed openstack/swift master: Remove empty part dirs during ssync replication  https://review.openstack.org/56561600:24
*** spsurya has joined #openstack-swift02:10
*** mingyu has joined #openstack-swift02:16
*** psachin has joined #openstack-swift02:16
*** gyee has quit IRC02:17
*** armaan has quit IRC03:03
*** armaan_ has joined #openstack-swift03:03
spsuryaDear swifters03:32
spsuryacan anybody help me to find the point where swift manage to add node feature03:32
spsurya?03:35
spsuryathanks in advance03:35
spsuryai am figuring out the parameters in terms of  "ip:port" configuration03:37
*** armaan_ has quit IRC03:39
*** armaan has joined #openstack-swift04:23
*** zaitcev_ is now known as zaitcev04:28
*** ianychoi has joined #openstack-swift04:34
*** links has joined #openstack-swift04:50
*** geaaru has quit IRC05:30
*** armaan has quit IRC06:20
*** armaan has joined #openstack-swift06:21
*** rcernin_ has joined #openstack-swift06:50
*** rcernin has quit IRC06:51
spsuryamattoliverau:  zaitcev  timburke  cschwede a bit of help07:00
mattoliverauspsurya: I'm about to leave for the day.. but what do you mean add node?07:01
spsuryathanks07:01
spsuryamattoliverau: support i have swift cluster and i want to add new node in swift cluster07:02
mattoliverauif you want to add nodes to the cluster, set up the storage node and or drives. Then add them to the relevant rings.07:02
spsuryaso what all i need to do07:02
mattoliverauit's the rings that tie it all together.07:02
mattoliveraulet me see if I can find some doco07:02
*** rcernin_ has quit IRC07:05
spsuryaswift must be install in new node and need to configure the ring file with node information07:06
spsuryafor addition into cluster07:06
openstackgerritTovin Seven proposed openstack/swift master: OSprofiler in OpenStack Swift  https://review.openstack.org/46831607:08
*** geaaru has joined #openstack-swift07:09
*** armaan has quit IRC07:12
*** armaan has joined #openstack-swift07:13
*** armaan has quit IRC07:18
*** armaan has joined #openstack-swift07:18
mattoliverauspsurya: yeah basically. I assume you have some provisioner for the storage nodes (ansible, puppet, chef, kickstart or something). In other words setup the new storage node (ie install swift, format and mount the drives etc). Then add the drives on that new node to all the rings you want it to participate in. Ie, you might have some disks for 1 storage policy or others for the account/container layer. If all disks07:22
mattoliverauare for all rings, then add them to all of them etc.07:22
mattoliverauIn essence you can follow the procedure for when you first built the rings. except instead of creating new ones, your just adding some more devices to the existing rings.07:23
mattoliverauso _very_ similar to what you would've done in the installation guide. except the ring builders already exist and you just add to it.07:24
*** tesseract has joined #openstack-swift07:25
*** armaan has quit IRC07:25
*** armaan has joined #openstack-swift07:26
mattoliverauie. add the new devices (which point to the new node) to the relevant builder file. Once all added rebalance to create a new ring and distribute the new ring to all the nodes and proxies.07:27
*** armaan has quit IRC07:27
*** armaan has joined #openstack-swift07:28
*** cschwede has left #openstack-swift07:28
*** cschwede has joined #openstack-swift07:29
mattoliverauto stop alot of data movement, you should probably add the devices with a small weight, rebalance, let the replicators push data around then slowly increase the weight. As to not max your iops and network with alot of data movement. that might effect users experience. obviously this also is depending on how much your expanding, how much data will move and if it's production, etc.07:30
*** armaan has quit IRC07:33
spsuryamattoliverau: thank for info07:33
*** armaan has joined #openstack-swift07:34
spsuryai am doing a POC, and into that i would be creating an object into existing cluster and after new node addition i would be listing that in respective container from newly added node07:35
spsuryano heavy data flow07:37
spsuryajust small one07:37
*** armaan has quit IRC07:41
*** ccamacho has joined #openstack-swift07:48
mattoliveraucool, then just add the devices at full weight and rebalance :)07:53
spsuryamattoliverau: big thanks07:56
spsuryasee you around in my POC07:56
*** hseipp has joined #openstack-swift07:57
*** DHE has quit IRC08:05
*** DHE has joined #openstack-swift08:05
*** pcaruana has joined #openstack-swift08:08
*** Renich has quit IRC08:20
*** Renich has joined #openstack-swift08:23
*** gkadam has joined #openstack-swift08:23
*** armaan has joined #openstack-swift09:23
*** armaan has quit IRC09:43
*** armaan has joined #openstack-swift10:03
*** silor has joined #openstack-swift10:15
*** armaan has quit IRC10:21
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Cleanup for review  https://review.openstack.org/56569110:28
*** armaan has joined #openstack-swift11:20
*** mvk has quit IRC11:40
*** pcaruana has quit IRC12:30
*** NM has joined #openstack-swift12:31
*** armaan has quit IRC12:44
*** psachin has quit IRC12:47
*** mvk has joined #openstack-swift12:50
*** pcaruana has joined #openstack-swift13:08
acolesI have just pushed sharding final review patches to feature/deep-review (the bot has not announced them here) https://review.openstack.org/#/q/branch:feature/deep-review13:11
*** rabel has joined #openstack-swift13:17
rabelhi there. when i try to build swift docs via tox -e docs, i revieve an error message: /home/rabel/Entwicklung/swift/swift/common/middleware/s3api/utils.py:docstring of swift.common.middleware.s3api.utils.mktime:11:Field list ends without a blank line; unexpected unindent.13:18
rabelERROR: InvocationError: '/home/rabel/Entwicklung/swift/.tox/docs/bin/sphinx-build -W -b html doc/source doc/build/html'13:18
*** mingyu has quit IRC13:19
*** vinsh_ has joined #openstack-swift13:21
*** vinsh_ has quit IRC13:21
*** vinsh has quit IRC13:21
*** vinsh has joined #openstack-swift13:22
*** bkopilov_ has quit IRC13:22
*** bkopilov has quit IRC13:22
*** bkopilov_ has joined #openstack-swift13:34
*** bkopilov has joined #openstack-swift13:34
openstackgerritMerged openstack/swift feature/deep: Cleanup for review  https://review.openstack.org/56569113:54
*** SkyRocknRoll has joined #openstack-swift14:01
openstackgerritThiago da Silva proposed openstack/swift master: fix s3api docstring  https://review.openstack.org/56576814:05
tdasilvarabel: ^^^14:05
zaitcevtdasilva: could you please look at this, while s3api is fresh in your mind? I promise it's 100 times simpler than PUT+POST: https://review.openstack.org/56538314:07
patchbotpatch 565383 - swift - Simplify the code in s3api14:07
tdasilvazaitcev: yep, will do14:08
openstackgerritDavid Rabel proposed openstack/swift master: Fix indentation in overview_backin_store.rst  https://review.openstack.org/56577414:25
notmynamegood morning14:26
notmynameacoles: feature/deep-review! thanks https://review.openstack.org/#/c/565742/14:27
patchbotpatch 565742 - swift (feature/deep-review) - Refactoring, test infrastructure changes and cleanup14:27
notmynameacoles: shall I put a -2 on that one?14:27
acolesnotmyname: oh, yeah good thinking14:28
notmynamedone14:28
acolesgreat! first review :P14:28
notmynameI'm helping!14:28
acoleslol14:28
*** openstackgerrit has quit IRC14:34
*** links has quit IRC14:34
*** mvk has quit IRC14:52
*** germs has joined #openstack-swift15:10
*** germs has quit IRC15:10
*** germs has joined #openstack-swift15:10
*** Guest29196 has quit IRC15:21
*** Rhvs has joined #openstack-swift15:21
*** mingyu has joined #openstack-swift15:24
*** mingyu has quit IRC15:43
*** mingyu has joined #openstack-swift15:47
*** gyee has joined #openstack-swift15:59
*** tesseract has quit IRC16:18
*** hseipp has quit IRC16:27
*** guimaluf has joined #openstack-swift16:42
*** mingyu has quit IRC16:58
*** mingyu has joined #openstack-swift17:02
notmynamehttps://review.openstack.org/#/c/565269/ merged, so feature/deep-review should be reporting in here17:05
patchbotpatch 565269 - openstack-infra/project-config - change irc bot branch reporting: remove s3api and ... (MERGED)17:05
*** germs has quit IRC17:14
*** germs has joined #openstack-swift17:17
*** germs has quit IRC17:17
*** germs has joined #openstack-swift17:17
*** germs has quit IRC17:18
*** germs has joined #openstack-swift17:19
*** germs has quit IRC17:19
*** germs has joined #openstack-swift17:19
*** ukaynar has joined #openstack-swift17:37
*** rabel has left #openstack-swift17:44
*** NM has quit IRC17:51
*** NM has joined #openstack-swift17:53
*** SkyRocknRoll has quit IRC17:53
*** ukaynar has quit IRC17:56
*** geaaru has quit IRC18:14
tdasilvanotmyname: wondering if we should close #swift3?18:19
*** ccamacho has quit IRC18:24
notmynametdasilva: good call. I changed the channel topic. I think the channel shouldn't be formally closed until the end of the openstack release cycle18:25
tdasilvanotmyname: makes sense18:27
*** mingyu has quit IRC18:27
tdasilvanotmyname: i have a todo to also update swift3 README18:31
notmynameah, good18:32
*** ukaynar has joined #openstack-swift18:33
notmynametdasilva: IMO go ahead and land it yourself. but if you want extra eyes on it, then ping me or kota_18:35
tdasilvanotmyname: I'm not even core there, so will ping you or kota to land it18:35
notmynameheh, ok18:35
*** cbartz has joined #openstack-swift18:37
*** openstackgerrit has joined #openstack-swift18:45
openstackgerritSamuel Merritt proposed openstack/swift master: Set swift_owner for requests from InternalClient  https://review.openstack.org/56586618:45
openstackgerritSamuel Merritt proposed openstack/swift master: Add live status report to object replicator  https://review.openstack.org/56586818:48
*** guimaluf has quit IRC18:50
tdasilvanotmyname: you are going to enjoy this: https://xkcd.com/1988/18:54
notmynameyep :-)18:54
*** silor has quit IRC18:56
notmynamethe mouseover text is the best18:56
tdasilvalol19:03
tdasilvahad missed that19:03
openstackgerritSamuel Merritt proposed openstack/swift master: s3api: simplify BaseAclHandler.request_with  https://review.openstack.org/56587219:04
*** hseipp has joined #openstack-swift19:08
*** spsurya has quit IRC19:09
*** guimaluf has joined #openstack-swift19:10
*** gkadam has quit IRC19:17
*** linkmark has joined #openstack-swift19:35
-openstackstatus- NOTICE: The Gerrit service at review.openstack.org will be offline starting at 20:00 (in roughly 25 minutes) for a server move and operating system upgrade: http://lists.openstack.org/pipermail/openstack-dev/2018-May/130118.html19:37
*** mvk has joined #openstack-swift19:45
*** linkmark has quit IRC19:46
*** hseipp has quit IRC19:49
*** mingyu has joined #openstack-swift19:52
*** NM has quit IRC19:52
*** NM has joined #openstack-swift19:56
*** cbartz has quit IRC20:04
-openstackstatus- NOTICE: The Gerrit service at review.openstack.org will be offline over the next 1-2 hours for a server move and operating system upgrade: http://lists.openstack.org/pipermail/openstack-dev/2018-May/130118.html20:06
*** mingyu has quit IRC20:06
*** ChanServ changes topic to "The Gerrit service at review.openstack.org will be offline over the next 1-2 hours for a server move and operating system upgrade: http://lists.openstack.org/pipermail/openstack-dev/2018-May/130118.html"20:06
openstackgerritMerged openstack/swift master: fix s3api docstring  https://review.openstack.org/56576820:11
*** spsurya has joined #openstack-swift20:27
*** openstackgerrit has quit IRC20:27
zaitcev500 in review.openstack.org? We used to have that at 1 a.m. every day, but this is in the middle of the day.20:27
notmynamezaitcev: yeah, but then we realized that for a globally-available service, it's always 1am and noon for someone, so might as well do the upgrade during your own waking hours20:28
notmyname:-)20:28
zaitcevsounds like a good time for some push-ups20:29
*** pcaruana has quit IRC20:34
notmynametdasilva: oh, I finally got some container stuff working yesterday. "working" to the point of being able to get swift up and running and responding to requests. the goal was/is for an app test target20:40
tdasilvanotmyname: what do you mean? is runaway already done?20:41
tdasilvas/is/isn't20:41
notmynamenext up is to refactor the existing upstream playbooks (or add new ones?) so that swift knows how to set itself up in a bunch of different ways (eg VM SAIO for probe tests, docker containers, etc)20:41
notmynamewhat I've done is something currently separate from runway20:42
notmynamerunway has lxc containers and this other thing I've got uses docker20:42
tdasilvaah! ok... and are you running all processes in single container?20:42
notmynameI definitely think there's a way to unify them. (and looking back at runway now, yikes. I've learned a bit since writing that)20:42
notmynameno! separate containers for everything!20:43
notmynameincluding memcache and rsyslog20:43
tdasilvahave you tried using something like minikube?20:43
notmynamenope. I don't even know what that is? is it a desk lamp from ikea?20:44
notmynameI mean, I assume it's some k8s thing. but no, I havne't done anything with that yet20:45
tdasilvaheh, ok, yeah it's k8s in a single vm...20:45
tdasilvaso you are running each container individually or using docker swarm?20:46
notmynametdasilva: http://d.not.mn/kubernetes.gif20:46
notmynamedocker compose20:46
notmynameie `docker-compose up` and things Just Work (tm)20:46
tdasilvalol @ gif...looking up docker compose20:48
tdasilvathat works :)20:50
notmynameswift team meeting in about 10 minutes. we're talking about reviewing feature/deep today20:52
*** ukaynar has quit IRC20:56
zaitcev"Your connection is not secure // The owner of review01.openstack.org has configured their website improperly. To protect your information from being stolen, Firefox has not connected to this website."20:57
notmynameyeah, they said it will be offline for 1-2 hours20:57
zaitcevmaybe #infra people already know20:57
notmynamethey're doing an OS upgrade20:57
zaitcevah20:57
kota_good morning20:57
notmynamesee the current /topic in here20:57
notmynamekota_: hello20:57
kota_notmyname: o/20:57
*** ukaynar has joined #openstack-swift20:59
notmynameacoles: clayg: torgomatic: cschwede: tdasilva: rledisez: zaitcev: mattoliverau: courtesy ping for the meeting20:59
kota_ah, zaitcev already said something about chrome reports security risks at gerrit review21:00
notmynamekota_: yeah, see the /topic in here. they're doing an upgrade21:02
*** ukaynar_ has joined #openstack-swift21:02
*** ukaynar__ has joined #openstack-swift21:04
*** ukaynar has quit IRC21:05
*** ukaynar_ has quit IRC21:07
*** linkmark has joined #openstack-swift21:16
*** NM has quit IRC21:34
notmynamemattoliverau: it was in aukland, right, where we first talked about it? in the catalyst.co.nz offices?21:35
acolesI added all the patch links to https://etherpad.openstack.org/p/deep-review21:35
mattoliverauClose to then, we talked about the post hashes version, because I remember you putting me on the trie idea :)21:37
tdasilvareminded me of this: https://twitter.com/thiagol11/status/75330843172182835221:38
mattoliverauMy first hashes version was sometime after Paris I think, as I started making notes and initial poc poc hacking while visiting Barcelona on holidays afterwards (wife remembers clearly)21:39
acolestdasilva: I remember that!21:40
acoleswe did a lot of talking about symlinks in san antonio too21:40
mattoliverauAnd I'm pretty sure we talked trie structures in the back room of the Catylist office :) with that view21:40
claygtdasilva: good times21:43
tdasilvaclayg: hear hear21:44
*** ChanServ changes topic to "feature/deep review meeting https://bluejeans.com/s/3TyWf | https://bugs.not.mn/project/Swift | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Review Dashboard: http://not.mn/reviews.html"22:11
-openstackstatus- NOTICE: Gerrit maintenance has concluded successfully22:12
notmynamewo. gerrit maintenance over22:13
notmyname*wooo22:13
claygwhy does _commit_puts_stale_ok sometimes still raise the LockTimeout?  That's a stupid name...22:24
notmynameanyone else having issues with loading etherpad?22:26
*** ukaynar__ has quit IRC22:30
*** ukaynar has joined #openstack-swift22:30
notmynameacoles: I'm starting to read over the docs. I am under the impression you'll be pushing a docs patch at some point, so I won't edit anything until I hear from you22:36
*** rcernin has joined #openstack-swift22:36
*** ChanServ changes topic to "master is frozen while we review feature/deep-review | https://etherpad.openstack.org/p/deep-review | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Review Dashboard: http://not.mn/reviews.html"22:38
*** spsurya has quit IRC23:04
*** clayg_ has joined #openstack-swift23:09
*** ChanServ sets mode: +v clayg_23:09
*** beisner_ has joined #openstack-swift23:09
*** Anticime1 has joined #openstack-swift23:12
*** jlvillal_ has joined #openstack-swift23:15
*** afazekas_ has joined #openstack-swift23:15
*** dhellmann_ has joined #openstack-swift23:15
*** _d34dh0r53_ has joined #openstack-swift23:15
*** beisner has quit IRC23:16
*** clayg has quit IRC23:16
*** afazekas has quit IRC23:16
*** jlvillal has quit IRC23:16
*** dhellmann has quit IRC23:16
*** Anticimex has quit IRC23:16
*** d34dh0r53 has quit IRC23:16
*** clayg_ is now known as clayg23:16
*** beisner_ is now known as beisner23:16
*** jlvillal_ is now known as jlvillal23:19
*** dhellmann_ is now known as dhellmann23:19
*** jlvillal is now known as Guest1001423:19
*** openstackgerrit has joined #openstack-swift23:27
openstackgerritMerged openstack/swift master: Fix indentation in overview_backin_store.rst  https://review.openstack.org/56577423:27

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!