| garthb | mattoliverau: yes it does, I put the output in http://paste.openstack.org/show/436088/ | 00:00 |
|---|---|---|
| *** aerwin has quit IRC | 00:00 | |
| mattoliverau | garthb: if you run the netstat with root (sudo netstat -ntlp) then it'll give you all the PID/Progam names | 00:01 |
| *** minwoob has quit IRC | 00:01 | |
| garthb | mattoliverau: it show stack@pts/35...full sudo output at http://paste.openstack.org/show/436095/ | 00:03 |
| mattoliverau | garthb: hmm, well the account server isn't running, so I think that's the problem, now we just need to find out what is using it. | 00:08 |
| mattoliverau | garthb: unless its a hung object server started by stack | 00:10 |
| garthb | mattoliverau: hmmm...here's the running swift servers http://paste.openstack.org/show/436113/ | 00:12 |
| garthb | mattoliverau: just want to be sure it's not running under a name I'm not familiar with... | 00:13 |
| garthb | mattoliverau: is there a way to try and start it on another port? | 00:13 |
| mattoliverau | garthb: yeah, you can change it in the conf, but the account ring would need to be updated too. | 00:15 |
| garthb | mattoliverau: ok, probably don't want to go there... | 00:17 |
| zaitcev | must be an ssh -L or something | 00:17 |
| zaitcev | or -Y | 00:17 |
| mattoliverau | garthb: so according to your last paste, the account-server, container-server and object-server isn't running, they are whay should be running on 6012, 6011, and 6010 (probably) | 00:17 |
| mattoliverau | zaitcev: ahh maybe | 00:18 |
| zaitcev | When will you people stop using 60xx block and go to 62xx. My goodness, I'm trying to tell you for years. | 00:18 |
| mattoliverau | garthb: are you running X or have sshed in with -X or -Y.. which port forward X stuff. | 00:19 |
| garthb | mattoliverau: I'm running MobaXterm | 00:19 |
| mattoliverau | I thought X stuff ran on 600* but something has stolen those ports. | 00:20 |
| zaitcev | It's not "something", he has it in the paste stack 16885 16730 0 08:00 ? 00:00:00 sshd: stack@pts/35 | 00:21 |
| * mattoliverau is glad zaitcev is here :) | 00:21 | |
| zaitcev | I'm going to eat a burger and calm down. Ceph is making me mad at the world. | 00:22 |
| *** gyee has quit IRC | 00:23 | |
| mattoliverau | zaitcev: enjoy the burger, and ignore ceph and just come back full time to swift ;) | 00:23 |
| mattoliverau | garthb: so it looks like it's the way your sshed in, it has stolen the swift *-server ports. | 00:24 |
| garthb | mattoliverau, yes... | 00:25 |
| garthb | mattoliverau: I don't know of a way to change that w/ MobaXterm...May need to restack w/ swift port changes... | 00:26 |
| garthb | mattoliverau: is that a common and easy update? | 00:26 |
| mattoliverau | garthb: to test it out, download putty (if your on windows) and ssh using it. It _should_ not set up X forwarding.. unless you specifially tell it to | 00:28 |
| mattoliverau | garthb: tho I'm sure there is a way to trun of X forwarding in mobaXterm | 00:30 |
| garthb | mattoliverau: yes that's a good idea (putty)...already installed...trying now...will take a bit to unstack/stack | 00:31 |
| *** hrou has joined #openstack-swift | 00:31 | |
| mattoliverau | garthb: just make sure when you log in, do a 'sudo netstat -nltp' and make sure the ports aren't in use. | 00:32 |
| *** dmorita has joined #openstack-swift | 00:38 | |
| garthb | mattoliverau: yeah MobaXterm was using that port...I had to kill to free it up | 00:39 |
| garthb | mattoliverau: still stacking... | 00:40 |
| * mattoliverau crosses fingers | 00:40 | |
| *** m_kazuhiro has joined #openstack-swift | 00:41 | |
| garthb | mattaliverau: looks good! | 00:46 |
| garthb | mattaliverau: passed the uploads and I see python owns port 6012 now... | 00:46 |
| garthb | mattaliverau: thanks for the help here...that was definitely an obscure issue...I hope I'm still able to use MobaXterm though! | 00:47 |
| mattoliverau | \o/ | 00:52 |
| mattoliverau | garthb: I'm not sure how devstack builds the swift rings, if there are variables you can set for the account, container and obj server ports then it might build the rings correctly and you can pick new ports (thus use mobaxterm) | 00:53 |
| garthb | mattoliverau: Stacked and MobaXterm works as well :) | 00:55 |
| garthb | \o/ | 00:55 |
| garthb | mattaliverau: signing off...thanks again...this was a big help! | 00:55 |
| mattoliverau | garthb: nps anytime! | 00:58 |
| *** garthb has quit IRC | 01:00 | |
| *** ahale has quit IRC | 01:02 | |
| *** ahale has joined #openstack-swift | 01:02 | |
| *** chlong has joined #openstack-swift | 01:02 | |
| *** DericHorn-HP has joined #openstack-swift | 01:13 | |
| *** bill_az has quit IRC | 01:19 | |
| *** haomaiwang has joined #openstack-swift | 01:33 | |
| *** DericHorn-HP has quit IRC | 01:34 | |
| openstackgerrit | janonymous proposed openstack/swift: Replace a / b with a // b to use integer division where needed https://review.openstack.org/208214 | 01:39 |
| *** jkugel has joined #openstack-swift | 01:41 | |
| *** haigang has quit IRC | 01:44 | |
| openstackgerrit | Matthew Oliver proposed openstack/swift-specs: Large containers (Sharding) - Pivot/Split Tree https://review.openstack.org/218738 | 01:45 |
| openstackgerrit | Matthew Oliver proposed openstack/swift-specs: Large containers (Sharding) - Pivot/Split Tree https://review.openstack.org/218738 | 01:50 |
| *** jkugel has left #openstack-swift | 02:08 | |
| *** I has joined #openstack-swift | 02:20 | |
| *** bkopilov has quit IRC | 02:20 | |
| *** I is now known as Guest10903 | 02:20 | |
| *** baojg has joined #openstack-swift | 02:23 | |
| *** blmartin has joined #openstack-swift | 02:47 | |
| *** baojg has quit IRC | 02:49 | |
| *** eranrom has joined #openstack-swift | 02:49 | |
| *** blmartin has quit IRC | 03:07 | |
| *** blmartin has joined #openstack-swift | 03:10 | |
| *** chlong has quit IRC | 03:12 | |
| *** jrichli has joined #openstack-swift | 03:15 | |
| *** proteusguy_ has quit IRC | 03:16 | |
| *** jrichli has quit IRC | 03:16 | |
| *** jrichli has joined #openstack-swift | 03:16 | |
| *** blmartin has quit IRC | 03:23 | |
| *** darrenc is now known as darrenc_afk | 03:28 | |
| *** proteusguy_ has joined #openstack-swift | 03:28 | |
| *** wbhuber has quit IRC | 03:34 | |
| *** chlong has joined #openstack-swift | 03:38 | |
| *** eranrom has quit IRC | 03:44 | |
| notmyname | good evening | 03:44 |
| *** links has joined #openstack-swift | 03:46 | |
| kota_ | notmyname: good evening | 03:50 |
| *** haomaiwang has quit IRC | 03:51 | |
| *** haomaiwang has joined #openstack-swift | 03:52 | |
| *** breitz has quit IRC | 03:52 | |
| *** breitz has joined #openstack-swift | 03:52 | |
| *** sanchitmalhotra has joined #openstack-swift | 03:53 | |
| mattoliverau | notmyname: evening | 03:58 |
| *** bkopilov has joined #openstack-swift | 04:00 | |
| *** ppai has joined #openstack-swift | 04:02 | |
| *** chlong_ has joined #openstack-swift | 04:04 | |
| *** chlong has quit IRC | 04:04 | |
| *** dimasot has joined #openstack-swift | 04:06 | |
| notmyname | wow. this release has 55 code contributors. 29 are first-time | 04:07 |
| jrichli | nice! | 04:10 |
| openstackgerrit | Merged openstack/swift: Updated CHANGELOG, AUTHORS, and .mailmap for 2.4.0 release. https://review.openstack.org/218681 | 04:19 |
| notmyname | yay, finally | 04:20 |
| *** janonymous has joined #openstack-swift | 04:21 | |
| jrichli | notmyname: ^^ I guess that means you're cutting the release? | 04:21 |
| notmyname | jrichli: yeah, I'm working on an announce email now | 04:21 |
| notmyname | now that the patch has landed, I'll do whatever the new thing is for cutting a release | 04:21 |
| jrichli | I wonder what the first-time contributors ratio has been in the past | 04:21 |
| jrichli | sounds high, but maybe it is always that high :-) | 04:22 |
| notmyname | note than numbers are higher this time. that's because (1) there are more people contributing and (2) it's been 4 months since the last release | 04:23 |
| janonymous | I am included in this too :) | 04:23 |
| notmyname | yup | 04:23 |
| *** baojg has joined #openstack-swift | 04:25 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 04:28 |
| *** raisE has quit IRC | 04:33 | |
| *** jrichli has quit IRC | 04:39 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 04:43 | |
| notmyname | gears cranked. wheels turned. let's see what the state of things is when i wake up in the morning | 04:45 |
| *** sanchitmalhotra has quit IRC | 04:45 | |
| *** raisE has joined #openstack-swift | 04:45 | |
| *** sanchitmalhotra has joined #openstack-swift | 04:52 | |
| *** darrenc_afk is now known as darrenc | 04:54 | |
| *** sanchitmalhotra1 has quit IRC | 04:55 | |
| *** SkyRocknRoll has joined #openstack-swift | 05:15 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 05:19 | |
| *** sanchitmalhotra has quit IRC | 05:21 | |
| *** sanchitmalhotra1 has quit IRC | 05:30 | |
| openstackgerrit | Pratik Mallya proposed openstack/python-swiftclient: Accept token and tenant_id for authenticating against KS https://review.openstack.org/172791 | 05:32 |
| *** sanchitmalhotra has joined #openstack-swift | 05:34 | |
| *** Guest10903 has quit IRC | 05:42 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 05:51 | |
| *** sanchitmalhotra has quit IRC | 05:53 | |
| *** I has joined #openstack-swift | 05:58 | |
| *** I is now known as Guest92023 | 05:58 | |
| *** silor has joined #openstack-swift | 06:06 | |
| *** baojg has quit IRC | 06:09 | |
| *** sanchitmalhotra has joined #openstack-swift | 06:33 | |
| *** sanchitmalhotra1 has quit IRC | 06:35 | |
| *** nakagawamsa has joined #openstack-swift | 06:35 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 06:39 | |
| *** sanchitmalhotra has quit IRC | 06:41 | |
| *** sanchitmalhotra has joined #openstack-swift | 06:52 | |
| *** hrou has quit IRC | 06:54 | |
| *** sanchitmalhotra1 has quit IRC | 06:55 | |
| *** rledisez has joined #openstack-swift | 07:11 | |
| *** hseipp has joined #openstack-swift | 07:24 | |
| *** chlong_ has quit IRC | 07:24 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: WIP: PUT/GET path for global ec cluster https://review.openstack.org/219165 | 07:38 |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: WIP: PUT/GET path for global ec cluster https://review.openstack.org/219165 | 07:38 |
| *** geaaru has joined #openstack-swift | 07:41 | |
| *** zaitcev has quit IRC | 07:49 | |
| *** jistr has joined #openstack-swift | 08:08 | |
| *** baojg has joined #openstack-swift | 08:16 | |
| openstackgerrit | Merged openstack/swift: Remove duplicate X-Backend-Storage-Policy-Index key https://review.openstack.org/218069 | 08:19 |
| *** pksingh has joined #openstack-swift | 08:20 | |
| pksingh | Hi Guys, could you please review https://review.openstack.org/#/c/183899/, its pending from very long time | 08:21 |
| openstackgerrit | Merged openstack/swift: Make ssync_sender send valid chunked requests https://review.openstack.org/218078 | 08:27 |
| *** baojg has quit IRC | 08:34 | |
| *** baojg has joined #openstack-swift | 08:44 | |
| *** aix has quit IRC | 08:50 | |
| *** marzif has joined #openstack-swift | 09:01 | |
| *** marzif has quit IRC | 09:04 | |
| *** marzif has joined #openstack-swift | 09:05 | |
| *** baojg has quit IRC | 09:12 | |
| *** aix has joined #openstack-swift | 09:19 | |
| *** joeljwright has joined #openstack-swift | 09:20 | |
| *** ChanServ sets mode: +v joeljwright | 09:20 | |
| *** baojg has joined #openstack-swift | 09:30 | |
| *** wbhuber has joined #openstack-swift | 09:30 | |
| *** wbhuber has quit IRC | 09:35 | |
| *** Guest92023 has quit IRC | 09:40 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 09:48 | |
| *** sanchitmalhotra has quit IRC | 09:50 | |
| *** baojg has quit IRC | 10:00 | |
| *** aix has quit IRC | 10:05 | |
| *** aix has joined #openstack-swift | 10:05 | |
| *** sanchitmalhotra has joined #openstack-swift | 10:16 | |
| *** sanchitmalhotra1 has quit IRC | 10:18 | |
| *** sanchitmalhotra1 has joined #openstack-swift | 10:20 | |
| *** sanchitmalhotra has quit IRC | 10:22 | |
| *** marzif has quit IRC | 10:24 | |
| *** chenhuayi has joined #openstack-swift | 10:33 | |
| openstackgerrit | Pratik Mallya proposed openstack/python-swiftclient: Accept token and tenant_id for authenticating against KS https://review.openstack.org/172791 | 10:34 |
| *** trifon has quit IRC | 10:43 | |
| *** h00327910__ has quit IRC | 10:43 | |
| *** marzif has joined #openstack-swift | 10:44 | |
| *** sanchitmalhotra has joined #openstack-swift | 10:47 | |
| *** sanchitmalhotra1 has quit IRC | 10:48 | |
| *** marzif has quit IRC | 11:02 | |
| *** haomaiwang has quit IRC | 11:08 | |
| openstackgerrit | Kota Tsuyuzaki proposed openstack/swift: WIP: PUT/GET path for global ec cluster https://review.openstack.org/219165 | 11:23 |
| *** kota_ has quit IRC | 11:29 | |
| *** hrou has joined #openstack-swift | 11:44 | |
| *** ho has quit IRC | 11:50 | |
| *** breitz1 has joined #openstack-swift | 11:51 | |
| *** breitz has quit IRC | 11:51 | |
| *** eandersson has joined #openstack-swift | 11:59 | |
| *** bkopilov has quit IRC | 12:02 | |
| *** SkyRocknRoll has quit IRC | 12:04 | |
| *** petertr7_away is now known as petertr7 | 12:06 | |
| *** chlong_ has joined #openstack-swift | 12:08 | |
| *** annegentle has joined #openstack-swift | 12:11 | |
| *** mahatic has joined #openstack-swift | 12:11 | |
| *** trifon has joined #openstack-swift | 12:23 | |
| *** nakagawamsa has quit IRC | 12:31 | |
| *** dmorita has quit IRC | 12:34 | |
| *** kei_yama has quit IRC | 12:39 | |
| *** baojg has joined #openstack-swift | 12:40 | |
| *** mahatic has quit IRC | 12:41 | |
| *** baojg has quit IRC | 12:42 | |
| *** haomaiwang has joined #openstack-swift | 12:48 | |
| *** tsubic has joined #openstack-swift | 12:50 | |
| *** m_kazuhiro has quit IRC | 12:55 | |
| *** dustins has joined #openstack-swift | 12:56 | |
| *** ppai has quit IRC | 12:56 | |
| *** km has quit IRC | 13:07 | |
| *** bill_az has joined #openstack-swift | 13:10 | |
| *** raisE has quit IRC | 13:11 | |
| *** lpabon has joined #openstack-swift | 13:11 | |
| *** baojg has joined #openstack-swift | 13:12 | |
| *** esker has quit IRC | 13:14 | |
| *** thurloat is now known as thurloat_isgone | 13:20 | |
| *** wbhuber has joined #openstack-swift | 13:23 | |
| *** changbl has quit IRC | 13:28 | |
| *** baojg has quit IRC | 13:29 | |
| *** petertr7 is now known as petertr7_away | 13:31 | |
| *** lpabon_ has joined #openstack-swift | 13:32 | |
| *** lpabon has quit IRC | 13:32 | |
| *** baojg has joined #openstack-swift | 13:32 | |
| *** lcurtis has joined #openstack-swift | 13:36 | |
| *** petertr7_away is now known as petertr7 | 13:37 | |
| *** mahatic has joined #openstack-swift | 13:40 | |
| *** baojg has quit IRC | 13:47 | |
| *** annegentle has quit IRC | 13:49 | |
| *** panbalag has left #openstack-swift | 13:53 | |
| *** bkopilov has joined #openstack-swift | 13:56 | |
| *** zul has quit IRC | 13:56 | |
| *** vinsh_ has joined #openstack-swift | 13:56 | |
| *** zul has joined #openstack-swift | 13:56 | |
| *** petertr7 is now known as petertr7_away | 13:59 | |
| *** vinsh has quit IRC | 13:59 | |
| *** chsc has joined #openstack-swift | 14:02 | |
| *** sanchitmalhotra has quit IRC | 14:03 | |
| *** Kennan has joined #openstack-swift | 14:03 | |
| *** Kennan2 has quit IRC | 14:03 | |
| *** jrichli has joined #openstack-swift | 14:12 | |
| *** trifon has quit IRC | 14:21 | |
| *** vinsh has joined #openstack-swift | 14:21 | |
| *** links has quit IRC | 14:23 | |
| *** annegentle has joined #openstack-swift | 14:25 | |
| *** vinsh_ has quit IRC | 14:25 | |
| *** alejandrito has joined #openstack-swift | 14:26 | |
| *** dustins_ has joined #openstack-swift | 14:28 | |
| *** petertr7_away is now known as petertr7 | 14:29 | |
| *** dustins has quit IRC | 14:31 | |
| *** hrou has quit IRC | 14:34 | |
| *** jlhinson has joined #openstack-swift | 14:38 | |
| *** minwoob has joined #openstack-swift | 14:52 | |
| *** cdelatte has joined #openstack-swift | 14:55 | |
| *** delattec has joined #openstack-swift | 14:55 | |
| *** links has joined #openstack-swift | 14:57 | |
| *** jistr is now known as jistr|call | 14:58 | |
| *** daemontool_ has quit IRC | 15:01 | |
| *** pksingh has quit IRC | 15:14 | |
| *** petertr7 is now known as petertr7_away | 15:15 | |
| *** links has quit IRC | 15:16 | |
| *** mahatic has quit IRC | 15:19 | |
| *** annegentle has quit IRC | 15:23 | |
| *** annegentle has joined #openstack-swift | 15:23 | |
| *** pksingh has joined #openstack-swift | 15:24 | |
| *** miurahr has joined #openstack-swift | 15:24 | |
| *** miurahr has quit IRC | 15:25 | |
| *** mahatic has joined #openstack-swift | 15:26 | |
| *** lpabon_ has quit IRC | 15:26 | |
| *** haomaiwang has quit IRC | 15:27 | |
| *** dustins_ has quit IRC | 15:43 | |
| *** zaitcev has joined #openstack-swift | 15:43 | |
| *** ChanServ sets mode: +v zaitcev | 15:43 | |
| *** j_king has left #openstack-swift | 15:51 | |
| openstackgerrit | Brian Cline proposed openstack/swift: Adds useful dispersion info from changelog https://review.openstack.org/219322 | 15:52 |
| *** garthb has joined #openstack-swift | 15:52 | |
| *** lpabon has joined #openstack-swift | 15:52 | |
| *** dustins has joined #openstack-swift | 15:54 | |
| notmyname | good morning | 15:56 |
| notmyname | looks like it was very quiet in here over night | 15:56 |
| notmyname | swift 2.4.0 has been tagged. sending release email now | 15:57 |
| *** lpabon has quit IRC | 15:57 | |
| *** esker has joined #openstack-swift | 15:59 | |
| *** esker has quit IRC | 16:00 | |
| openstackgerrit | Minwoo Bae proposed openstack/swift: EC: Handoff node to push existing fragment to the correct location. https://review.openstack.org/196848 | 16:00 |
| *** esker has joined #openstack-swift | 16:01 | |
| notmyname | http://lists.openstack.org/pipermail/openstack-announce/2015-September/000575.html and https://twitter.com/notmyname/status/638743400506884096 | 16:04 |
| *** changbl has joined #openstack-swift | 16:10 | |
| *** eranrom has joined #openstack-swift | 16:20 | |
| *** esker has quit IRC | 16:20 | |
| *** eranrom has quit IRC | 16:26 | |
| *** jistr|call has quit IRC | 16:28 | |
| *** hemanthm has joined #openstack-swift | 16:30 | |
| *** rledisez has quit IRC | 16:31 | |
| *** lpabon has joined #openstack-swift | 16:33 | |
| *** silor has quit IRC | 16:34 | |
| *** rjaiswal has joined #openstack-swift | 16:37 | |
| *** dustins has quit IRC | 16:39 | |
| *** dustins has joined #openstack-swift | 16:41 | |
| *** aix has quit IRC | 16:45 | |
| *** NM has joined #openstack-swift | 16:48 | |
| *** david-ly_ has joined #openstack-swift | 16:49 | |
| *** david-lyle has quit IRC | 16:49 | |
| tdasilva | 29 new contributors! that's great!!! | 16:53 |
| notmyname | I know! | 16:53 |
| *** ctrath has joined #openstack-swift | 16:54 | |
| *** eandersson has quit IRC | 16:55 | |
| notmyname | tdasilva: http://d.not.mn/active_contribs.png <-- very nice recent trends there | 16:58 |
| *** mahatic has quit IRC | 17:00 | |
| tdasilva | notmyname: yes, 10 new *active* contributors since april, 5 more and it would be a 100% increase...am i reading that right? | 17:04 |
| notmyname | the red line is the monthly average of how many individual people are active in a week | 17:05 |
| *** david-ly_ has quit IRC | 17:07 | |
| notmyname | and, yes, we're pretty close to a global maxima on that metric | 17:11 |
| *** hseipp has quit IRC | 17:12 | |
| *** petertr7_away is now known as petertr7 | 17:13 | |
| *** trifon has joined #openstack-swift | 17:15 | |
| *** aerwin has joined #openstack-swift | 17:15 | |
| aerwin | Hello all. | 17:15 |
| notmyname | good morning | 17:16 |
| hemanthm | Hi Swift folks. I work on Glance project. Sometimes when uploading data to Swift, I observed that some uploads take longer than the others | 17:16 |
| hemanthm | I was wondeirng if it'd be a good idea to re-try those upload after a certain threshold? | 17:16 |
| notmyname | hemanthm: are you getting timeouts or errors back? | 17:17 |
| hemanthm | notmyname: nope, the uploads eventually succeed. They just take longer than usual | 17:17 |
| *** lpabon has quit IRC | 17:17 | |
| notmyname | what's usual and what's longer? | 17:17 |
| notmyname | can you categorize the longer ones in any way? do they share any comonalities? | 17:18 |
| hemanthm | notmyname: say I'm uploading a 128MB object. Usually, I see these uploads take around 20 seconds or so | 17:19 |
| hemanthm | sometimes, they take like 3000 seconds | 17:19 |
| hemanthm | apparently, they hit 'bad' nodes | 17:20 |
| hemanthm | I understand that to some degree these numbers could be very specific to certain deployments | 17:20 |
| *** lpabon has joined #openstack-swift | 17:22 | |
| notmyname | is this a specific cluster that's yours? if you retry the upload does it go faster? | 17:22 |
| *** eranrom has joined #openstack-swift | 17:22 | |
| hemanthm | notmyname: Yes. Our Swift folks recommend retrying uploads | 17:23 |
| *** aix has joined #openstack-swift | 17:25 | |
| notmyname | if you log the transaction id that's returned on the slow request (the x-trans-id header) you'll be able to look for that in the logs and see where things are slow | 17:25 |
| notmyname | hemanthm: and you're saying that if you retry the exact same upload it will go faster? | 17:26 |
| hemanthm | notmyname: I can't say that it worked like that every time but yes, a lot of times when uploading image (in segments) to Swift, a random segment takes way too long | 17:27 |
| hemanthm | I did get some tx ids to our swift folks, I often get the explanation that the upload hit some 'bad' nodes | 17:29 |
| hemanthm | this is what I heard recently "the server it reached has been still up, no high load or anything..but I saw a connection timeout so I don't know if there was an issue with reaching that storage node and it timed out" | 17:29 |
| hemanthm | notmyname: sorry for not giving you much to work with. | 17:30 |
| notmyname | hemanthm: I'm not sure what I can do for you. it sounds like there's some sort of issue to diagnose based on your specific deployment | 17:36 |
| notmyname | it may be that there are some needs (upstream or in your deployment) for some additional monitoring | 17:36 |
| *** lpabon has quit IRC | 17:42 | |
| hemanthm | notmyname: what I actually wanted to ask you was, if I do want to retry uploads after a threshold, is there something in swiftclient that'd allow me to do it? | 17:42 |
| hemanthm | I checked the code, but I don't think I saw anything | 17:42 |
| *** aerwin has quit IRC | 17:43 | |
| *** aerwin3 has joined #openstack-swift | 17:43 | |
| hemanthm | notmyname: and, does it make sense for swiftclient to have this ability to retry the upload if it happens to go over say 'x' seconds? | 17:45 |
| *** lpabon has joined #openstack-swift | 17:46 | |
| scotticus | aerwin3 yo. | 17:48 |
| notmyname | hemanthm: no, I don't think "retry after X seconds" is good. however, there is an ability to put a per-socket timeout there. and the client will automatically retry after it gets a failure message | 17:48 |
| aerwin3 | scotticus: hello | 17:48 |
| *** david-lyle has joined #openstack-swift | 17:54 | |
| *** geaaru has quit IRC | 17:55 | |
| *** gyee has joined #openstack-swift | 17:59 | |
| *** david-lyle has quit IRC | 18:01 | |
| *** jrichli_ has joined #openstack-swift | 18:03 | |
| *** jrichli has quit IRC | 18:05 | |
| *** NM has quit IRC | 18:15 | |
| *** david-lyle has joined #openstack-swift | 18:19 | |
| *** jkugel has joined #openstack-swift | 18:23 | |
| *** NM has joined #openstack-swift | 18:24 | |
| *** lpabon has quit IRC | 18:26 | |
| *** egon has quit IRC | 18:27 | |
| *** lpabon has joined #openstack-swift | 18:29 | |
| *** esker has joined #openstack-swift | 18:35 | |
| *** pgbridge has joined #openstack-swift | 18:38 | |
| *** eranrom has quit IRC | 18:49 | |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/swift: Updated from global requirements https://review.openstack.org/88736 | 18:55 |
| *** chenhuayi has quit IRC | 18:58 | |
| *** annegent_ has joined #openstack-swift | 19:00 | |
| *** changbl has quit IRC | 19:02 | |
| *** annegentle has quit IRC | 19:03 | |
| *** marcusvrn_ has joined #openstack-swift | 19:03 | |
| *** dimasot has quit IRC | 19:05 | |
| *** petertr7 is now known as petertr7_away | 19:06 | |
| *** esker has joined #openstack-swift | 19:07 | |
| *** annegent_ has quit IRC | 19:08 | |
| *** lpabon has quit IRC | 19:09 | |
| *** annegentle has joined #openstack-swift | 19:11 | |
| *** lpabon has joined #openstack-swift | 19:15 | |
| clayg | torgomatic: thanks for the review on patch 212187 | 19:17 |
| patchbot | clayg: https://review.openstack.org/#/c/212187/ | 19:17 |
| clayg | (etag_buckets on EC) | 19:18 |
| torgomatic | clayg: no problem; I'm just sorry it took me so long to get to it | 19:18 |
| clayg | there's still so much that could be improved tho - explict tests around the extracted NodeIter class, using timestamps instead of etags, closing down unused etag connections immediately once we pick the winner, ... probably a dozen other's I'm forgetting about :'( | 19:19 |
| clayg | torgomatic: pshshththhtt - no worries! | 19:19 |
| *** wbhuber has quit IRC | 19:19 | |
| *** pgbridge has quit IRC | 19:34 | |
| *** bill_az has quit IRC | 19:34 | |
| *** lifeless has quit IRC | 19:34 | |
| *** mtreinish has quit IRC | 19:34 | |
| *** raginbajin has quit IRC | 19:34 | |
| *** goodygum has quit IRC | 19:34 | |
| *** whydidyoustealmy has quit IRC | 19:34 | |
| *** wer has quit IRC | 19:34 | |
| *** torgomatic has quit IRC | 19:34 | |
| *** cschwede has quit IRC | 19:34 | |
| *** briancline has quit IRC | 19:34 | |
| *** sc68cal has quit IRC | 19:34 | |
| *** briancline has joined #openstack-swift | 19:34 | |
| *** sc68cal has joined #openstack-swift | 19:34 | |
| *** pgbridge has joined #openstack-swift | 19:35 | |
| *** bill_az has joined #openstack-swift | 19:35 | |
| *** lifeless has joined #openstack-swift | 19:35 | |
| *** mtreinish has joined #openstack-swift | 19:35 | |
| *** raginbajin has joined #openstack-swift | 19:35 | |
| *** goodygum has joined #openstack-swift | 19:35 | |
| *** whydidyoustealmy has joined #openstack-swift | 19:35 | |
| *** wer has joined #openstack-swift | 19:35 | |
| *** torgomatic has joined #openstack-swift | 19:35 | |
| *** cschwede has joined #openstack-swift | 19:35 | |
| *** cameron.freenode.net sets mode: +vv torgomatic cschwede | 19:35 | |
| *** whydidyoustealmy has quit IRC | 19:35 | |
| *** whydidyoustealmy has joined #openstack-swift | 19:35 | |
| *** pgbridge has quit IRC | 19:47 | |
| *** bill_az has quit IRC | 19:47 | |
| *** lifeless has quit IRC | 19:47 | |
| *** mtreinish has quit IRC | 19:47 | |
| *** raginbajin has quit IRC | 19:47 | |
| *** goodygum has quit IRC | 19:47 | |
| *** wer has quit IRC | 19:47 | |
| *** torgomatic has quit IRC | 19:47 | |
| *** cschwede has quit IRC | 19:47 | |
| *** petertr7_away is now known as petertr7 | 19:48 | |
| *** pgbridge has joined #openstack-swift | 19:52 | |
| *** bill_az has joined #openstack-swift | 19:52 | |
| *** lifeless has joined #openstack-swift | 19:52 | |
| *** mtreinish has joined #openstack-swift | 19:52 | |
| *** raginbajin has joined #openstack-swift | 19:52 | |
| *** goodygum has joined #openstack-swift | 19:52 | |
| *** wer has joined #openstack-swift | 19:52 | |
| *** torgomatic has joined #openstack-swift | 19:52 | |
| *** cschwede has joined #openstack-swift | 19:52 | |
| *** cameron.freenode.net sets mode: +vv torgomatic cschwede | 19:52 | |
| *** lpabon has quit IRC | 20:04 | |
| *** lpabon has joined #openstack-swift | 20:07 | |
| peluse | yay patch 212187 -- thanks clayg, acoles, torgomatic!!! | 20:08 |
| patchbot | peluse: https://review.openstack.org/#/c/212187/ | 20:08 |
| openstackgerrit | Minwoo Bae proposed openstack/swift: Included reference in swift.obj.diskfile to enumerate the string used for data file paths. https://review.openstack.org/219438 | 20:12 |
| minwoob | The above is just a quick documentation review ^ | 20:13 |
| minwoob | Thanks clayg for the suggestion. | 20:13 |
| notmyname | minwoob: seems reasonable | 20:14 |
| clayg | peluse: no way paul - thank YOU! | 20:18 |
| clayg | go team swift! | 20:18 |
| *** esker has quit IRC | 20:20 | |
| peluse | working on a test for whimpy patch 211338 now... its small but it makes a huge impact on load testing let me tell ya! I'll head into work in a few hours and report how its running, has been going to a little over 24 hrs banging the crap out of the cluster | 20:21 |
| patchbot | peluse: https://review.openstack.org/#/c/211338/ | 20:21 |
| *** petertr7 is now known as petertr7_away | 20:22 | |
| clayg | torgomatic: ^ I hate having to catch ValueError so damn high - does this exception pop on replicated objects during client disconnect - or is somehow just EC's tranfer-encoding chunked that get's hit? | 20:23 |
| peluse | clayg, my understanding is that this is only 'unique' to use of footer and/or multiphase commit where the obj server is reading back from the proxy so EC is affected as well as crypto (but I didn't go look closer at the repl PUT) | 20:30 |
| peluse | clayg, and when torgomatics eventlet patch lands we'll be able to catch this for what it is instead of using the ValueError bucket | 20:30 |
| *** bill_az has quit IRC | 20:30 | |
| clayg | peluse: yeah that'll be great - I think it's landed (pretty sure) - we just don't want to require it (yet?) | 20:34 |
| peluse | clayg, not sure what the process is there for deciding we need to move to it? | 20:36 |
| clayg | peluse: yeah i have no idea - notmyname will figure it out | 20:37 |
| *** dustins has quit IRC | 20:37 | |
| *** lpabon has quit IRC | 20:40 | |
| *** lpabon has joined #openstack-swift | 20:53 | |
| *** slo_ has joined #openstack-swift | 20:56 | |
| *** changbl has joined #openstack-swift | 21:02 | |
| notmyname | joeljwright: timburke: all: we'll need to cut a python-swiftclient release very soon for it to be tagged in liberty | 21:05 |
| joeljwright | notmyname: ok, np, I'll take a list of the outstanding bugs | 21:07 |
| joeljwright | I mean patches | 21:07 |
| joeljwright | ! | 21:07 |
| joeljwright | and see if there's anything it would be nice to wait for | 21:08 |
| *** lcurtis_ has joined #openstack-swift | 21:08 | |
| joeljwright | discuss at the meeting tomrrow? | 21:08 |
| *** jrichli_ has quit IRC | 21:08 | |
| *** lpabon has quit IRC | 21:08 | |
| notmyname | yup | 21:09 |
| *** changbl has quit IRC | 21:09 | |
| notmyname | I just put it on the agenda | 21:09 |
| *** changbl has joined #openstack-swift | 21:13 | |
| *** slo_ has quit IRC | 21:23 | |
| clayg | re | 21:30 |
| torgomatic | clayg: peluse: yeah, that patch landed in eventlet master, so it should be in the next release (whenever that is) | 21:33 |
| clayg | torgomatic: oic, still need to wait on an *eventlet* release - *that* makes sense | 21:33 |
| *** philipw has joined #openstack-swift | 21:43 | |
| notmyname | philipw: what group is it you were saying you worked with (to be the swift cpl)? I missed that. | 21:44 |
| philipw | hey | 21:44 |
| philipw | i'm with rpc @ rax | 21:45 |
| notmyname | ah, ok. cool | 21:45 |
| notmyname | in san antonio? | 21:45 |
| philipw | principal architect / product manager for storage / tea maker | 21:45 |
| philipw | london actually | 21:45 |
| notmyname | great. | 21:45 |
| notmyname | what midcycle were you referring to? | 21:46 |
| philipw | there was a product-wg midcycle last week or the week before | 21:46 |
| notmyname | ah, ok | 21:47 |
| *** lcurtis_ has quit IRC | 21:47 | |
| notmyname | and you got voluntold to work with swift ;-) | 21:48 |
| philipw | not as harsh as that..i'm a through and through storage guy | 21:48 |
| notmyname | heh | 21:48 |
| philipw | we've met btw | 21:48 |
| philipw | IEEE MSST, in July | 21:48 |
| *** annegentle has quit IRC | 21:48 | |
| notmyname | ah! ok | 21:49 |
| philipw | ;-) | 21:49 |
| notmyname | you came to the swift workshop, right? | 21:50 |
| notmyname | I remember you | 21:50 |
| philipw | indeed, more for a nosey than anything | 21:50 |
| mattoliverau | Hey Philipw: I'm also with RPC @ Rackspace, I don't know if we've met. | 21:50 |
| notmyname | you two are antipodal | 21:50 |
| philipw | mattoliverau: hey matt, your nae rings a bell :-) | 21:50 |
| philipw | ^name | 21:51 |
| mattoliverau | philipw: I used to work in the London office (for a short time in 2013), back in Oz since working for RPC | 21:52 |
| notmyname | tristanC: any reason http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2015-5223 hasn't been updated yet? | 21:54 |
| philipw | mattoliverau: assuming the team wasn't all that far from their current location in my previous role I was no more than 25ft away.. | 21:55 |
| tristanC | notmyname: mitre website usualy take sometime to be updated | 21:55 |
| tristanC | not much we can do about it | 21:56 |
| notmyname | ack. thanks | 21:56 |
| notmyname | tristanC: the good news is that it gave us time for a real release before they updated :-) | 21:57 |
| tristanC | heh, that's good to know :-) | 21:57 |
| *** changbl has quit IRC | 21:57 | |
| *** NM has quit IRC | 21:59 | |
| mattoliverau | oh and morning BTW | 22:00 |
| notmyname | hi mattoliverau | 22:00 |
| notmyname | mattoliverau: we did a release while you were asleep | 22:00 |
| *** jkugel has left #openstack-swift | 22:04 | |
| minwoob | clayg: No need to review the handoff node patch yet ... I'm observing some failures that I hadn't seen before. | 22:04 |
| *** lpabon has joined #openstack-swift | 22:08 | |
| *** ctrath has quit IRC | 22:09 | |
| mattoliverau | notmyname: nice work \o/ | 22:12 |
| mattoliverau | And I just got to meet more team members I never knew existed, it would be funny if clayg was the one who introduced them to be again :P | 22:13 |
| *** lpabon has quit IRC | 22:13 | |
| *** joeljwright has quit IRC | 22:13 | |
| openstackgerrit | Samuel Merritt proposed openstack/swift: Preserve traceback in swift-dispersion-report https://review.openstack.org/219471 | 22:21 |
| *** jlhinson has quit IRC | 22:21 | |
| openstackgerrit | paul luse proposed openstack/swift: Better error handling for EC PUT path when client goes away https://review.openstack.org/211338 | 22:24 |
| openstackgerrit | Minwoo Bae proposed openstack/swift: EC: Handoff node to push existing fragment to the correct location. https://review.openstack.org/196848 | 22:30 |
| *** annegentle has joined #openstack-swift | 22:40 | |
| *** alejandrito_ has joined #openstack-swift | 22:43 | |
| *** alejandrito_ has quit IRC | 22:45 | |
| *** alejandrito has quit IRC | 22:45 | |
| minwoob | clayg: Now we are at 100% for both of those tests. | 22:47 |
| peluse | minwoob, what's your test setup (just curious), SAIO or real cluster? | 22:47 |
| clayg | minwoob: nice | 22:48 |
| minwoob | peluse: I'm on SAIO. | 22:48 |
| peluse | minwoob, OK I think by next week I'll have a decent 10 node cluster dedicated for EC reconstructor testing. Working with ctennis on some scenarios, he's also setting up some cloud VMs for the same. When we're ready I may ping you for some ideas based on your patches if that's cool | 22:49 |
| minwoob | peluse: Yeah, of course. | 22:49 |
| clayg | peluse: nice! | 22:49 |
| minwoob | peluse: Still kind of nebulous as to what you need, but I'd be happy to help out. | 22:50 |
| peluse | yeah, we know there are real failures with testing this on a real 10+ node cluster so need to repro them and investigate but the cluster we saw them on is way busy now running perf tests :) | 22:50 |
| peluse | minwoob, yeah, I don't have specifics but once we're ready we'll list out some of the shit we're planning on doing and then will be looking for feedback and/or other ideas | 22:50 |
| minwoob | peluse: Great. Just ping me whenever. | 22:51 |
| peluse | basically how it behaves when there a pile of strange crap for it to clean up (large pile)... | 22:51 |
| peluse | clayg, you know you'll be knee deep in it too! | 22:52 |
| minwoob | Hmm.. | 22:52 |
| clayg | ^ notmyname that's the queue for the obligitory "I'm pretty sure I'm helping" pic | 22:54 |
| notmyname | lol | 22:54 |
| notmyname | clayg: or https://s-media-cache-ak0.pinimg.com/originals/0a/43/9a/0a439af1b9a9a8964561e83eb167427f.jpg | 22:55 |
| clayg | ^ says anyone everytime they looks at one of my patches | 22:56 |
| *** lpabon has joined #openstack-swift | 22:57 | |
| *** lpabon has quit IRC | 23:00 | |
| *** lcurtis has quit IRC | 23:02 | |
| *** ahale has quit IRC | 23:05 | |
| *** MooingLemur has quit IRC | 23:05 | |
| *** km has joined #openstack-swift | 23:05 | |
| *** ahale has joined #openstack-swift | 23:05 | |
| *** MooingLemur has joined #openstack-swift | 23:05 | |
| *** chsc has quit IRC | 23:08 | |
| *** ho has joined #openstack-swift | 23:10 | |
| *** minwoob has quit IRC | 23:17 | |
| *** bkopilov has quit IRC | 23:17 | |
| *** chlong_ is now known as chlong | 23:18 | |
| *** bkopilov has joined #openstack-swift | 23:18 | |
| ho | good morning! | 23:20 |
| *** kevinc_ has joined #openstack-swift | 23:22 | |
| *** minwoob has joined #openstack-swift | 23:23 | |
| *** minwoob has quit IRC | 23:26 | |
| *** kei_yama has joined #openstack-swift | 23:26 | |
| openstackgerrit | paul luse proposed openstack/swift: Better error handling for EC PUT path when client goes away https://review.openstack.org/211338 | 23:35 |
| mattoliverau | ho: morning! | 23:47 |
| *** lpabon has joined #openstack-swift | 23:50 | |
| ho | mattoliverau: morning! | 23:51 |
| *** esker has joined #openstack-swift | 23:53 | |
| *** lpabon has quit IRC | 23:55 | |
| *** lpabon has joined #openstack-swift | 23:59 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!
