Thursday, 2016-07-14

« Wednesday, 2016-07-13 Index Friday, 2016-07-15 »
*** TravT has quit IRC00:22
*** TravT has joined #osic00:23
*** TravT has quit IRC00:27
*** adrian_otto has quit IRC00:30
*** david-lyle has quit IRC00:31
*** ravikama_ has joined #osic00:33
*** JRobinson__ has quit IRC00:38
*** ravikama_ has quit IRC00:38
*** cody-somerville has quit IRC00:38
*** karthikp_ has joined #osic00:54
*** JRobinson__ has joined #osic00:55
*** karthikp_ has quit IRC00:57
*** karthikp_ has joined #osic00:57
*** karthikp_ has quit IRC00:58
*** karthikp_ has joined #osic00:59
*** karthikp_ has quit IRC00:59
*** karthikp_ has joined #osic01:00
*** unrahul has quit IRC01:22
*** fnaval has quit IRC01:30
*** rajpatel has joined #osic01:39
*** ravelar159 has joined #osic01:40
*** fnaval has joined #osic01:43
*** ravelar159 has quit IRC01:45
*** rajpatel has quit IRC01:49
*** vinaypotluri has quit IRC01:51
*** rloo has quit IRC01:56
*** rderose has quit IRC02:08
*** davechen has joined #osic02:15
*** cody-somerville has joined #osic02:22
*** TravT has joined #osic02:31
*** woodster_ has quit IRC02:49
*** asettle has joined #osic03:03
*** asettle has quit IRC03:08
*** JRobinson__ is now known as JRobinson__afk03:35
*** davechen has left #osic04:06
*** adrian_otto has joined #osic04:09
*** JRobinson__afk is now known as JRobinson__04:13
*** GB21 has joined #osic04:34
*** asettle has joined #osic05:04
*** asettle has quit IRC05:09
*** davechen has joined #osic05:43
*** karthikp_ has quit IRC05:58
*** TravT has quit IRC06:35
*** yonglihe has joined #osic06:47
*** asettle has joined #osic06:58
*** asettle has quit IRC07:02
*** jascott1 has quit IRC07:18
*** JRobinson__ has quit IRC07:18
*** TravT has joined #osic07:26
*** TravT has quit IRC07:30
*** GB21 has quit IRC07:30
*** ravelar159 has joined #osic07:41
*** ravelar159 has quit IRC07:47
*** asettle has joined #osic08:06
*** GB21 has joined #osic08:17
*** cody-somerville has quit IRC08:29
*** adrian_otto has quit IRC08:41
*** asettle has quit IRC08:41
*** asettle has joined #osic08:47
*** aastha has quit IRC08:59
*** TravT has joined #osic09:14
*** TravT has quit IRC09:20
*** asettle has quit IRC09:34
*** woodburn has quit IRC09:35
*** asettle has joined #osic09:43
*** asettle has quit IRC09:50
*** GB21 has quit IRC09:53
*** TravT has joined #osic10:09
*** TravT has quit IRC10:13
*** GB21 has joined #osic10:35
*** davechen has quit IRC10:45
*** asettle has joined #osic10:50
*** TravT has joined #osic11:02
*** TravT has quit IRC11:07
*** GB21 has quit IRC12:23
*** TravT has joined #osic12:51
*** TravT has quit IRC12:56
*** woodster_ has joined #osic13:21
*** peristeri has joined #osic13:25
*** ametts has joined #osic13:33
kencjohnstonGood morning team!13:35
*** adrian_otto has joined #osic13:35
*** KLevenstein has joined #osic13:45
*** valw has joined #osic13:46
*** valw has quit IRC13:46
*** KrishR has joined #osic13:46
*** valw has joined #osic13:46
*** ccneill has joined #osic13:46
*** woodburn has joined #osic13:47
*** ametts has quit IRC13:54
*** rderose has joined #osic13:54
*** ccneill has quit IRC13:55
*** ravikama_ has joined #osic14:00
*** dasanind has joined #osic14:04
*** GB21 has joined #osic14:05
*** ametts has joined #osic14:07
*** Mudpuppy has joined #osic14:11
*** dasanind has quit IRC14:11
*** TxGirlGeek has joined #osic14:12
*** mohitmotiani has joined #osic14:14
*** sgundur1 has joined #osic14:15
*** dasanind has joined #osic14:17
*** fnaval has quit IRC14:19
*** aastha has joined #osic14:19
*** ravelar159 has joined #osic14:21
*** spotz_zzz is now known as spotz14:24
*** adrian_otto has quit IRC14:25
*** adrian_otto has joined #osic14:25
*** nadeem has joined #osic14:25
dasmg'morning14:26
*** ravelar159 has quit IRC14:26
dasmand now, everyone convince yourself: who sent and didn't send abstract for Barcelona? ;)14:27
*** ravelar159 has joined #osic14:27
spotzdasm morning14:29
*** GB21 has quit IRC14:30
*** fnaval has joined #osic14:32
dasmhey spotz. are you in castle?14:33
spotzdasm yep, walked behind you about5 minutes ago:)14:33
dasmspotz: great! i'm on a meeting right now, but will try to meet with you in few minutes.14:34
spotzdasm ok14:34
*** homerp has joined #osic14:34
dasm*in a meeting14:34
*** adrian_otto has quit IRC14:35
*** valw has quit IRC14:41
*** Tamayo has joined #osic14:42
*** adrian_otto has joined #osic14:43
*** rrecio has joined #osic14:52
*** valw has joined #osic14:52
*** rrecio_ has joined #osic14:53
*** mohitmotiani has quit IRC14:53
*** TravT has joined #osic14:55
*** mohitmotiani has joined #osic14:56
*** rrecio has quit IRC14:56
*** valw has quit IRC14:57
*** karthikp_ has joined #osic15:01
*** TxGirlGeek has quit IRC15:01
*** TxGirlGeek has joined #osic15:02
*** vinaypotluri has joined #osic15:09
*** mohitmotiani has quit IRC15:10
*** vijendar has joined #osic15:12
*** karthikp_ has quit IRC15:13
*** karthikp_ has joined #osic15:14
*** TxGirlGeek has quit IRC15:14
*** mohitmotiani has joined #osic15:15
*** mohitmotiani has quit IRC15:16
*** TxGirlGeek has joined #osic15:18
*** mohitmotiani has joined #osic15:19
*** valw has joined #osic15:19
*** dasanind has quit IRC15:22
*** mohitmotiani has quit IRC15:24
*** valw has quit IRC15:24
*** mohitmotiani has joined #osic15:24
*** TravT has quit IRC15:25
*** mohitmotiani has quit IRC15:26
*** ravelar159 has quit IRC15:26
*** ravelar159 has joined #osic15:27
*** mohitmotiani has joined #osic15:27
*** TxGirlGeek has quit IRC15:29
*** TxGirlGe_ has joined #osic15:29
*** karthikp_ has quit IRC15:29
*** nadeem has quit IRC15:29
*** mohitmotiani has quit IRC15:31
*** rderose has quit IRC15:35
*** mohitmotiani has joined #osic15:36
*** TxGirlGe_ has quit IRC15:36
*** TxGirlGeek has joined #osic15:37
*** dasanind has joined #osic15:41
*** homerp has quit IRC15:42
*** mohitmotiani has quit IRC15:45
*** mohitmotiani has joined #osic15:45
*** TxGirlGeek has quit IRC15:46
*** rloo has joined #osic15:46
*** valw has joined #osic15:46
*** mohitmotiani has quit IRC15:47
*** rderose has joined #osic15:48
*** mohitmotiani has joined #osic15:48
*** mohitmotiani has quit IRC15:50
*** valw has quit IRC15:51
*** TxGirlGeek has joined #osic15:51
*** mohitmotiani has joined #osic15:51
*** mohitmotiani has quit IRC15:52
*** mohitmotiani has joined #osic15:55
*** di has joined #osic15:55
*** mmalik4 has joined #osic15:56
*** mmalik4_ has joined #osic15:56
*** homerp has joined #osic15:56
*** karthikp_ has joined #osic15:57
*** TxGirlGeek has quit IRC16:00
*** TxGirlGeek has joined #osic16:00
dasmspotz: are you free now?16:02
spotzdasm yeah, doing OSA meeting in irc but I can multi-task16:03
*** asettle has quit IRC16:03
*** asettle has joined #osic16:04
*** TxGirlGeek has quit IRC16:04
*** TxGirlGeek has joined #osic16:05
*** mohitmotiani has quit IRC16:05
*** mohitmotiani has joined #osic16:06
*** mmalik4 has quit IRC16:06
*** dasanind has quit IRC16:07
*** di has quit IRC16:07
*** dasanind has joined #osic16:08
*** asettle has quit IRC16:09
*** mohitmotiani has quit IRC16:10
*** TxGirlGeek has quit IRC16:11
*** TxGirlGeek has joined #osic16:12
*** di has joined #osic16:12
*** TxGirlGeek has quit IRC16:13
*** di has quit IRC16:13
*** di has joined #osic16:13
*** valw has joined #osic16:14
*** valw has quit IRC16:19
*** GB21 has joined #osic16:19
*** valw has joined #osic16:28
*** cmspence has joined #osic16:30
*** valw has quit IRC16:32
*** cody-somerville has joined #osic16:33
*** cody-somerville has quit IRC16:33
*** cody-somerville has joined #osic16:33
*** mohitmotiani has joined #osic16:37
*** mohitmotiani has quit IRC16:41
*** valw has joined #osic16:41
*** valw has quit IRC16:46
*** karthikp_ has quit IRC16:52
*** valw has joined #osic16:55
*** cody-somerville has quit IRC16:56
*** cody-somerville has joined #osic16:56
*** unrahul has joined #osic16:58
*** valw has quit IRC17:00
*** karthikp_ has joined #osic17:01
*** GB21 has quit IRC17:02
*** asettle has joined #osic17:04
*** GB21 has joined #osic17:05
*** karthikp_ has quit IRC17:07
*** cmspence has quit IRC17:09
*** asettle has quit IRC17:09
*** mmalik4_ has quit IRC17:12
*** dasanind has quit IRC17:17
*** valw has joined #osic17:22
*** mmalik4_ has joined #osic17:26
*** valw has quit IRC17:26
*** valw has joined #osic17:30
dolphmadrian_otto: where is the shell script you're using to authenticate for a trust token?17:30
adrian_ottook, on the nova node, do a "find / -name part-006 -print"17:31
adrian_ottoand that will show you the script.17:31
adrian_ottothe script includes the heat-params file which contains the trust id and trustee userid17:31
*** muralia has joined #osic17:31
adrian_ottothe trust token is successfully generated by keystone, and when we try to use it with the magnum API, magnum rejects it with a 401 Unauthorized response.17:32
*** revon has joined #osic17:34
*** muralia_ has quit IRC17:34
*** di has quit IRC17:36
*** di has joined #osic17:37
*** cody-somerville has quit IRC17:40
*** cmspence has joined #osic17:46
dolphmadrian_otto: what's the password for your trustee user? it's not the password in your paste17:56
*** karthikp_ has joined #osic17:56
adrian_ottothat will be in the heat-params file17:57
adrian_ottodolphm: are you connected to the nova instance?17:59
dolphmadrian_otto: i'm not sure where you meant by nova node earlier? one of the nova containers?17:59
adrian_ottook, on the osad "infra1" box do: ssh infra1-utility-container-919baab517:59
adrian_ottoform there, do source openrc17:59
adrian_ottoand then nova list17:59
adrian_ottoyou will see a nova instance there.18:00
*** cmspence has quit IRC18:00
dolphmadrian_otto: ooh, i thought you meant an infrastructure node18:00
adrian_ottossh to the 172.29.24.x address18:00
cloudnulladrian_otto: all of the clients are installed on the utility container.18:00
*** cmspence has joined #osic18:00
adrian_ottoin this case:18:01
adrian_ottossh -i .ssh/id_rsa_os minion@172.29.248.1618:01
cloudnullif you need want to access the clients for a given service you can work from the venv in /openstack/venvs/$SERVICE/bin18:01
dolphmadrian_otto: gotcha18:01
adrian_ottodolphm: /etc/sysconfig/heat-params18:01
adrian_ottoTRUSTEE_USER_ID TRUSTEE_PASSWORD and TRUST_ID are the relevant values18:02
*** GB21 has quit IRC18:02
adrian_ottoand the part-006 file (get-cert.sh) is here: /var/lib/cloud/instances/a180ddd5-b38f-4754-bf56-0c9bc7c01798/scripts/part-00618:03
adrian_ottoso what I was doing is cd /var/lib/cloud/instances/a180ddd5-b38f-4754-bf56-0c9bc7c01798/scripts; sh -x part-00618:04
dolphmadrian_otto: thanks, got everything i was looking for18:05
adrian_ottoand I could see that I got the client token, and then when it made the curl request on line 71, that's where the 401 happened.18:05
adrian_ottoawesome18:05
dolphmadrian_otto: you said that script was failing with a 401 when it hit magnum, though?18:05
adrian_ottoyes18:05
adrian_ottoit gets the auth token from keystone fine18:05
dolphmadrian_otto: i'm getting a 40018:05
adrian_ottoand then magnum rejects it.18:06
adrian_ottothe 400 is a subsequent error18:06
adrian_ottoyou see "ValueError: No JSON object could be decoded" right?18:06
*** vijendar has quit IRC18:07
adrian_ottolook back further for this:18:08
adrian_ottohttp://172.29.236.200:9511/certificates/7556bde0-4048-41fb-bcbc-34ca42b2767418:08
adrian_ottothe curl for that results in a 401 result.18:08
adrian_ottocascading to the other problem18:08
dolphmadrian_otto: yes, okay18:09
adrian_ottohttp://paste.openstack.org/raw/DqRtuFzkN1qmjEzS9XYc/18:09
adrian_ottothat is what I see18:09
adrian_ottoand that is where we are really stuck18:09
adrian_ottoI do have a theory that we might want to explore. Let me know when you are ready to hear it.18:10
*** vijendar has joined #osic18:12
*** homerp has quit IRC18:20
dolphmadrian_otto: what's that?18:22
adrian_ottook, if you look carefully at the role assignment list on the devstack side, it has only one role: "admin"18:25
dolphmand there's heat_stack_owner delegated as part of the trust on the osad deploy18:25
dolphmin addition to admin18:25
adrian_ottoyes, that's it18:26
adrian_ottomy guess is that our policy enforcement on the magnum side may be confused by the additional role?18:26
dolphmwhich is delegated on the admin project itself, rather than a user's project18:26
adrian_ottois there a way to take out the second role as a way to prove/disprove this theory?18:27
*** TxGirlGeek has joined #osic18:27
dolphmadrian_otto: well, up until a minute ago, magnum wasn't seeing any roles at all18:27
dolphmadrian_otto: the auth request in that script was not consuming the trust https://github.com/openstack/keystone-specs/blob/master/api/v3/identity-api-v3-os-trust-ext.rst#consuming-a-trust18:28
dolphmadrian_otto: but i'm still getting a 400 from magnum18:28
dolphmadrian_otto: on curl --fail -X GET -H "X-Auth-Token: $USER_TOKEN" $MAGNUM_URL/certificates/$BAY_UUID18:28
dolphmcc- lbragstad18:28
dolphmadrian_otto: lbragstad: for example, http://cdn.pasteraw.com/35bheyf3hz5xmakdxra4on0mczc8atm18:29
adrian_ottook, looking18:30
dolphmadrian_otto: is magnum expecting something else as part of that request?18:30
lbragstaddolphm  is that a request you're making to magnum?18:30
dolphmlbragstad: yes18:30
lbragstadme internet just dropped for a minute18:30
lbragstadmy*18:30
lbragstadhuh - interesting18:31
adrian_ottooh, that's different than before18:32
*** nadeem has joined #osic18:33
dolphmadrian_otto: i added the --fail because it was breezing past that 40018:33
adrian_ottook18:34
adrian_ottothe magnum service may not be running18:36
adrian_ottono, it's up.18:37
adrian_ottooh, wait18:37
adrian_ottowe saw this once before18:37
adrian_ottothe service endpoint for the magnum API is front-ended by an haproxy18:37
adrian_ottoand the haproxy was returning a 400 wihtout passing the request through to magnum18:38
adrian_ottolet me see if that's happening again18:38
dolphmadrian_otto: strange -- the magnum logs report a 401, and the client sees a 40018:38
dolphmadrian_otto: oh, maybe that behavior is also related to haproxy18:39
adrian_ottoverified.18:39
lbragstadsounds like it18:39
adrian_ottohaproxy handles the request, and does not reverse proxy it to magnum18:39
adrian_ottoat least on eth018:39
adrian_ottolet me repeat that test on the other interfaces just in case18:40
adrian_ottook, I'm sure. Magnum is not getting contacted by haproxy.18:40
dolphmadrian_otto: to correct myself - magnum was not seeing 401's from keystone when a client made a request ... those were two separate requests. the 401 occurred in magnum's periodic job, and magnum is NOT seeing any requests from the script on the nova instance18:41
dolphmor at least, it's not logging anything18:41
* adrian_otto nod18:41
dolphmadrian_otto: so, i 100% agree with the haproxy thing18:41
dolphmlbragstad: this is also in magnum's logs http://cdn.pasteraw.com/9dttj5qbhjzs7l2k9jizvf5gua0mm8v18:42
adrian_ottoso the question is why18:42
adrian_ottoI will strace the haproxy to see if it drops any clues18:43
*** dasanind has joined #osic18:44
jrollcaching a 400 response for some reason?18:44
jrollor does haproxy have some rules to short-circuit certain requests to a 400?18:45
adrian_otto20510 recvfrom(313, "GET /certificates/7556bde0-4048-41fb-bcbc-34ca42b27674 HTTP/1.1\r\nHost: 172.29.236.200:9511\r\nUser-Agent: curl/7.43.0\r\nAccept: */*\r\nX-Auth-Token: gAAAAABXh92gt0VHUFiMtjaUbnIxS8IITgs1rlLqkfI0ut81VYZyxPis9AGko1XhVoZk5FMOlnF2X0lpHTP_eaAW9sgJ09ghtW16yYE7CQmhpPWCcQ1onUrHyVUsBmS_DSLReb1lw36G3IGeJtf4SWnlpEcVEq7JsA\r\r\n\r\n", 375808, 0, NULL, NULL) = 31118:45
adrian_otto20510 sendto(313, "HTTP/1.0 400 Bad request\r\nCache-Control: no-cache\r\nConnection: close\r\nContent-Type: text/html\r\n\r\n<html><body><h1>400 Bad request</h1>\nYour browser sent an invalid request.\n</body></html>\n\n", 188, MSG_DONTWAIT|MSG_NOSIGNAL|MSG_MORE, NULL, 0) = 18818:45
adrian_ottosee that?18:46
adrian_ottoit's immediately dumping the connection18:46
lbragstadso - it's a config issue with haproxy?18:47
adrian_ottoTo my disgust, haproxy is configured with 25 different configuration files.18:47
adrian_ottoI'm not exaggerating.18:47
adrian_ottolbragstad: I think this is part of the problem but not all of it18:47
jrollit can be configured with one file :)18:47
adrian_ottobecause the first time you make this request, you get a 401 back to the client18:48
jrollbut yeah I'd check the config first18:48
adrian_ottojroll: yes, I wish it were.18:48
jrolladrian_otto: I'm happy to take a look if you want to dump the configs somewhere18:48
dolphmJul 14 18:47:55 ip6-localhost haproxy[20510]: 172.29.248.16:34692 [14/Jul/2016:18:47:55.541] magnum-front magnum-front/<NOSRV> -1/-1/-1/-1/0 400 188 - - PR-- 231/0/0/0/0 0/0 "<BADREQ>"18:48
jroll<NOSRV>18:49
adrian_ottojroll: tx18:49
jrollmaybe all the backend servers dropped out of rotation for whatever reason?18:49
dolphmjroll: yeah /etc/haproxy/conf.d/magnum http://cdn.pasteraw.com/elm5g29ss1fx624b40k5lftd7p59bot18:49
jrolloption httpchk /status18:50
jrolldoes magnum have that endpoint?18:50
adrian_ottojroll: keep in mind that there are 23 other services with similar files, and a main one18:50
jrolladrian_otto: yeah, noted18:50
adrian_ottoI first fixated on "option httpchk /status"18:50
jrollworth looking at http://$haproxyhost:8080/haproxy?stats18:51
adrian_ottoand haproxy does request /status from magnum on the backend18:51
adrian_ottoand magnum replies in a timely fashion with 200 OK18:51
adrian_ottoso then I stopped looking at that18:51
jrollah ok cool18:51
jrolljust making sure that actually worked18:51
dolphmadrian_otto: /status is protected by keystone18:52
adrian_ottook, I need to pick up my son, be back in about 20 min.18:52
adrian_ottoof the status check is the problem I would expect a 50[34] error, not a 40018:53
adrian_ottothe abckend server beign judged as down is not a client error18:53
adrian_ottobbl18:53
jrollsame, but maybe one of those configs makes it a 400 :P18:53
*** ccneill has joined #osic18:56
*** valw has quit IRC18:57
dolphmtook off the /status and still seeing <NOSRV> in the haproxy log18:58
lbragstadhmm i believe osa sets up ha proxy - so i wonder if they are seeing this issue upstream?18:58
jrollrandom google says that <NOSRV> + 400 = "client did not finish making request before timeout"19:00
dolphmwell, when i manually make the same request that the script is running, i get a 404 from magnum -- auth succeeds just fine19:00
dolphmhttp://cdn.pasteraw.com/95k6ewvo77auk3pxf9mcravsnafbbbh19:00
lbragstaddolphm and that is a trust-scoped token?19:01
dolphmwhich makes me think that the code trying to parse the token out of the response from keystone is getting a trailing line break or something wonky19:01
dolphmlbragstad: it wasn't before, but it is now19:01
lbragstaddolphm so that should prove that the trust configuration seems to work on the osa setup19:05
*** asettle has joined #osic19:06
*** valw has joined #osic19:06
dolphmlbragstad: afaict, yes19:06
*** nadeem has quit IRC19:07
*** mohitmotiani has joined #osic19:10
*** asettle has quit IRC19:11
*** valw has quit IRC19:11
*** mohitmotiani has quit IRC19:11
*** mmalik4_ has quit IRC19:12
*** rloo has quit IRC19:13
*** rloo has joined #osic19:14
* adrian_otto back. Read scrollback.19:16
dolphmadrian_otto: tl;dr i'm getting a legit 404 from magnum now19:18
adrian_ottook19:18
dolphmadrian_otto: i've made 3 changes i'll summarize in an email - but i'19:18
dolphmi'm not sure how to proceed from here, other than to suggest killing the instance, update this script, and run everything again19:18
adrian_ottoterrific.19:18
adrian_ottoyou have my undivided attention19:19
*** karthikp_ has quit IRC19:22
*** rderose has quit IRC19:23
*** karthikp_ has joined #osic19:23
*** nadeem has joined #osic19:24
lbragstaddolphm are you going to send that out on adrian_otto's thread?19:24
*** nadeem has quit IRC19:25
*** mohitmotiani has joined #osic19:26
lbragstaddolphm adrian_otto i'm going to break for lunch - i'll catch the scroll back though19:26
*** cody-somerville has joined #osic19:26
*** cody-somerville has quit IRC19:26
*** cody-somerville has joined #osic19:26
*** cody-somerville has quit IRC19:28
*** cody-somerville has joined #osic19:28
adrian_ottotx lbragstad19:28
*** cody-somerville has quit IRC19:28
*** cody-somerville has joined #osic19:29
*** nadeem has joined #osic19:31
*** rderose has joined #osic19:32
*** mmalik4_ has joined #osic19:33
*** valw has joined #osic19:34
*** asettle has joined #osic19:35
*** valw has quit IRC19:38
*** asettle has quit IRC19:40
*** rmevans has joined #osic19:42
*** mohitmotiani has quit IRC19:42
*** Tamayo has quit IRC19:50
*** valw has joined #osic19:51
*** peristeri has quit IRC19:51
*** valw has quit IRC19:56
jrolldolphm: that tr O_o19:56
jrollyou know19:56
*** valw has joined #osic19:57
jrollI wonder if there's a \r in there somewhere and haproxy is hoping for a \n after that or something?19:57
*** ravelar159 has quit IRC19:57
*** fnaval has quit IRC19:57
*** fnaval has joined #osic19:57
dolphmjroll: i'm guessing curl -H 'Key: Value\r' results in an extra line break in the http request headers, effectively signaling that they've all been sent19:57
*** asettle has joined #osic19:59
*** asettle has quit IRC19:59
jrolldolphm: oh yeah, that too19:59
*** fnaval has quit IRC19:59
*** fnaval has joined #osic20:00
*** ametts has quit IRC20:00
*** ravelar159 has joined #osic20:02
*** di has left #osic20:09
*** di has joined #osic20:10
*** rderose has quit IRC20:10
*** rderose has joined #osic20:11
*** mohitmotiani has joined #osic20:13
*** ametts has joined #osic20:15
*** mohitmotiani has quit IRC20:17
*** asettle has joined #osic20:18
*** rderose has quit IRC20:19
*** peristeri has joined #osic20:19
*** asettle has quit IRC20:20
*** rderose has joined #osic20:20
*** asettle has joined #osic20:20
*** asettle has quit IRC20:25
*** rajpatel has joined #osic20:32
*** mohitmotiani has joined #osic20:34
*** ravelar159 has quit IRC20:35
*** mohitmotiani has quit IRC20:39
*** hemanthm is now known as hemanthm|afk20:39
*** mohitmotiani has joined #osic20:42
*** valw has quit IRC20:44
*** rderose has quit IRC20:44
*** Mudpuppy has quit IRC20:44
*** rderose has joined #osic20:45
*** mohitmotiani has quit IRC20:48
*** rmevans has quit IRC20:53
*** TxGirlGeek has quit IRC20:53
*** adrian_otto has quit IRC21:00
*** peristeri has quit IRC21:07
*** mohitmotiani has joined #osic21:12
*** dasanind has quit IRC21:14
*** mohitmotiani has quit IRC21:14
*** mmalik4_ has quit IRC21:17
*** rajpatel has quit IRC21:18
*** karthikp_ has quit IRC21:24
*** mohitmotiani has joined #osic21:25
*** KrishR has quit IRC21:30
*** KrishR has joined #osic21:31
*** rajpatel has joined #osic21:31
*** rajpatel1 has joined #osic21:32
*** vijendar has quit IRC21:35
*** mohitmotiani has quit IRC21:36
*** rajpatel has quit IRC21:36
*** dharinic_ has joined #osic21:39
*** cmspence has quit IRC21:44
*** karthikp_ has joined #osic21:47
*** rajpatel1 has quit IRC21:49
*** cmspence has joined #osic21:49
*** rajpatel has joined #osic21:57
*** nadeem has quit IRC22:00
*** ametts has quit IRC22:01
*** ccneill has quit IRC22:02
*** dharinic_ has quit IRC22:06
*** spotz is now known as spotz_zzz22:07
*** cody-somerville has quit IRC22:12
*** ravikama_ has quit IRC22:14
*** chris_hultin has joined #osic22:14
*** KLevenstein has quit IRC22:15
*** karthikp_ has quit IRC22:17
*** rajpatel has quit IRC22:18
*** cody-somerville has joined #osic22:18
*** nadeem has joined #osic22:20
*** cody-somerville has quit IRC22:23
*** JRobinson__ has joined #osic22:23
*** cody-somerville has joined #osic22:23
*** cody-somerville has quit IRC22:23
*** cody-somerville has joined #osic22:23
*** mohitmotiani has joined #osic22:29
*** nadeem has quit IRC22:29
*** ntpttr has quit IRC22:31
*** ntpttr has joined #osic22:31
*** karthikp_ has joined #osic22:32
*** ravikama_ has joined #osic22:33
*** mohitmotiani has quit IRC22:34
*** karthikp_ has quit IRC22:41
*** mmalik4_ has joined #osic22:49
*** ravikama_ has quit IRC22:49
*** mmalik4_ has quit IRC23:05
*** ccneill has joined #osic23:07
*** adrian_otto has joined #osic23:13
*** karthikp_ has joined #osic23:17
*** rrecio_ has quit IRC23:17
*** asettle has joined #osic23:26
*** asettle has quit IRC23:30
*** KrishR has quit IRC23:32
*** di has quit IRC23:41
*** ccneill has quit IRC23:46
*** cody-somerville has quit IRC23:54
*** cody-somerville has joined #osic23:55
« Wednesday, 2016-07-13 Index Friday, 2016-07-15 »

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!