Friday, 2018-05-18

*** sthussey has quit IRC00:04
*** yamamoto has joined #openstack-helm00:12
*** yamamoto has quit IRC00:17
*** caoyuan has joined #openstack-helm00:37
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: Fix log collection in zuul  https://review.openstack.org/56929400:47
*** caoyuan has quit IRC01:00
*** zhangfei has joined #openstack-helm01:09
openstackgerritPete Birley proposed openstack/openstack-helm master: Docs: Update ceph documentation  https://review.openstack.org/56638101:26
*** cNilesh has joined #openstack-helm01:31
*** caoyuan has joined #openstack-helm01:43
openstackgerritPete Birley proposed openstack/openstack-helm master: DNM: Release Support: OpenStack Pike & Queens  https://review.openstack.org/56746801:47
*** yamamoto has joined #openstack-helm01:58
*** yamamoto has quit IRC02:04
*** yamamoto has joined #openstack-helm02:20
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902102:21
*** yamamoto has quit IRC02:25
*** roman_g has quit IRC02:27
*** yamamoto has joined #openstack-helm02:43
openstackgerritTin Lam proposed openstack/openstack-helm-infra master: RFC: DNM: Update helm to v2.9.1  https://review.openstack.org/56930702:44
*** yamamoto has quit IRC02:48
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: Fix log collection in zuul  https://review.openstack.org/56929402:49
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902102:49
*** cNilesh has quit IRC02:53
*** cNilesh has joined #openstack-helm02:55
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902102:57
*** yamamoto has joined #openstack-helm03:04
*** yamamoto has quit IRC03:09
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902103:26
*** caoyuan has quit IRC03:32
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902103:33
*** caoyuan has joined #openstack-helm03:37
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902103:39
openstackgerritPete Birley proposed openstack/openstack-helm master: Release Support: OpenStack Pike  https://review.openstack.org/56931503:43
openstackgerritPete Birley proposed openstack/openstack-helm master: DNM: Release Support: OpenStack Queens  https://review.openstack.org/56746803:45
*** caoyuan has quit IRC03:45
openstackgerritPete Birley proposed openstack/openstack-helm master: DNM: Release Support: OpenStack Queens  https://review.openstack.org/56746803:45
*** yamamoto has joined #openstack-helm03:46
openstackgerritPete Birley proposed openstack/openstack-helm master: DNM: Release Support: OpenStack Queens  https://review.openstack.org/56746803:46
*** yamamoto has quit IRC03:52
*** caoyuan has joined #openstack-helm04:02
*** yamamoto has joined #openstack-helm04:08
*** yamamoto has quit IRC04:09
*** yamamoto has joined #openstack-helm04:09
openstackgerritTin Lam proposed openstack/openstack-helm-infra master: Update helm to v2.9.1  https://review.openstack.org/56930704:13
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902104:16
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: WIP: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902105:03
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902105:06
openstackgerritRenis Makadia proposed openstack/openstack-helm master: WIP Test/Fix Ceph deployment with diff namespace name  https://review.openstack.org/56888805:13
openstackgerritMerged openstack/openstack-helm-infra master: improvements/fixes for openstack dashboards for grafana  https://review.openstack.org/56285205:15
openstackgerritTin Lam proposed openstack/openstack-helm master: Fix typo  https://review.openstack.org/56932805:23
ethfciHello, I would like to perform OpenStack-Helm Infra KubeADM deployment. My05:36
ethfci> trials are failing with command  make dev-deploy k8s multinode, i am following https://docs.openstack.org/openstack-helm/latest/install/multinode.html05:36
ethfciended up with: http://paste.openstack.org/show/721202/. Wht did i wrong?05:36
ethfcithanks,05:36
ethfciFerenc05:36
portdirectwhat did `make dev-deploy setup-host multinode` output?05:37
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902105:54
*** MarkBaker has quit IRC06:28
*** yamamoto has quit IRC06:31
*** zhangfei has quit IRC06:32
*** zhangfei has joined #openstack-helm06:34
*** zhangfei has quit IRC06:39
*** zhangfei has joined #openstack-helm06:46
*** yamamoto has joined #openstack-helm06:51
*** yamamoto has quit IRC06:56
*** cfriesen has quit IRC07:04
*** yamamoto has joined #openstack-helm07:12
*** yamamoto has quit IRC07:20
*** yamamoto has joined #openstack-helm07:34
*** zhangfei has quit IRC07:51
*** sar has joined #openstack-helm07:51
*** roman_g has joined #openstack-helm07:59
*** zhangfei has joined #openstack-helm08:03
*** gkadam has joined #openstack-helm08:18
*** zhangfei has quit IRC08:35
openstackgerritPete Birley proposed openstack/openstack-helm master: DNM: Release Support: OpenStack Queens  https://review.openstack.org/56746808:40
*** zhangfei has joined #openstack-helm08:51
*** roman_g has quit IRC09:06
*** roman_g has joined #openstack-helm09:12
*** zhangfei has quit IRC09:27
*** zhangfei has joined #openstack-helm09:41
*** MarkBaker has joined #openstack-helm09:47
*** zhangfei has quit IRC09:57
*** zhangfei has joined #openstack-helm09:58
*** caoyuan has quit IRC10:07
*** yamamoto has quit IRC10:30
*** roman_g has quit IRC10:31
*** yamamoto has joined #openstack-helm10:51
*** yamamoto has quit IRC10:56
*** caoyuan has joined #openstack-helm11:03
*** zhangfei has quit IRC11:08
*** zhangfei has joined #openstack-helm11:10
*** yamamoto has joined #openstack-helm11:24
*** yamamoto has quit IRC11:29
*** yamamoto has joined #openstack-helm11:41
*** roman_g has joined #openstack-helm12:05
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Remove LDAP chart from openstack-helm  https://review.openstack.org/56789112:19
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911712:19
*** cNilesh has quit IRC13:10
*** yamamoto has quit IRC13:13
*** MarkBaker has quit IRC13:14
openstackgerritPete Birley proposed openstack/openstack-helm master: DNM: Release Support: OpenStack Queens  https://review.openstack.org/56746813:26
*** MarkBaker has joined #openstack-helm13:30
portdirectgagehugo: will this impact you? https://review.openstack.org/#/c/567891/13:31
*** yamamoto has joined #openstack-helm13:34
*** sawblade6 has quit IRC13:34
*** yamamoto has quit IRC13:35
*** yamamoto has joined #openstack-helm13:36
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911713:37
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Gate: simplify playbooks  https://review.openstack.org/56903813:37
*** felipemonteiro has joined #openstack-helm13:41
*** felipemonteiro_ has joined #openstack-helm13:44
*** eeiden has joined #openstack-helm13:46
*** felipemonteiro has quit IRC13:47
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifest with osh-infra updates  https://review.openstack.org/56941313:53
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP: armada manifest updates for OSH  https://review.openstack.org/56838513:54
*** mdih has joined #openstack-helm13:57
*** sawblade6 has joined #openstack-helm13:58
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifest with osh-infra updates  https://review.openstack.org/56941314:03
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP: armada manifest updates for OSH  https://review.openstack.org/56838514:03
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP: armada manifest updates for OSH  https://review.openstack.org/56838514:05
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP: armada manifest updates for OSH  https://review.openstack.org/56838514:06
*** felipemonteiro_ has quit IRC14:06
*** felipemonteiro_ has joined #openstack-helm14:07
openstackgerritMerged openstack/openstack-helm-infra master: Add kubernetes-keystone-webhook chart  https://review.openstack.org/56886314:36
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911714:36
openstackgerritMerged openstack/openstack-helm-infra master: Gate: Fix log collection in zuul  https://review.openstack.org/56929414:36
openstackgerritMerged openstack/openstack-helm master: Release Support: OpenStack Pike  https://review.openstack.org/56931514:38
*** MarkBaker has quit IRC14:40
gagehugoportdirect yup, but I'm also having loci issues with that ps14:43
gagehugohttp://logs.openstack.org/40/558940/11/check/keystone-osh-ldap-functional/0ba8608/job-output.txt.gz#_2018-05-15_20_54_30_79301114:44
portdirectUrg14:45
portdirectYeah that's an issue with master loco right now14:45
openstackgerritMerged openstack/openstack-helm-infra master: KubeADM: Keystone Kubernetes Webhook  https://review.openstack.org/56902114:45
portdirectAre you building the requirements image in that pipeline?14:46
portdirectIf so you could just add the package to that.14:46
portdirectBut we should chase up the global requirements and get it in there asap14:46
*** MarkBaker has joined #openstack-helm14:53
SamYapleportdirect: i found the patch a while back, but it was -2'd14:54
SamYapleill get it handled14:54
portdirectThanks SamYaple :D14:57
*** cfriesen has joined #openstack-helm14:59
*** p__arch has joined #openstack-helm15:07
*** p__arch has quit IRC15:08
gagehugoah ok15:17
*** dansmith is now known as superdan15:18
*** zhangfei has quit IRC15:19
*** gkadam_ has joined #openstack-helm15:21
*** gkadam has quit IRC15:24
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Add image management fucntion to manifests  https://review.openstack.org/56944815:43
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Add image management function to manifests  https://review.openstack.org/56944815:44
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911715:44
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifest with osh-infra updates  https://review.openstack.org/56941315:47
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP: armada manifest updates for OSH  https://review.openstack.org/56838515:48
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Add image management function to manifests  https://review.openstack.org/56944815:52
SamYapleportdirect: gagehugo https://review.openstack.org/#/c/569451/ -- once that merges and new images push out it should be fine15:53
SamYaplealternatively do a depends on and rebuild the requirements15:54
SamYaplei confirmed it was a bug in #openstack-requirements, tracking down the bug will take long15:54
*** caoyuan has quit IRC15:56
*** lrensing has joined #openstack-helm16:00
pcarverIs deploying OSH behind a proxy/firewall a "standard" use case?16:03
pcarverBy "standard" I mean is it something that is generally a goal that it will work and be automated, or is the assumption that direct, unproxied Internet connectivity is expected and getting it working behind a proxy is expected to be a bunch of manual work that's out of scope for OSH to automate?16:06
portdirectTotally an expected/standard use case16:06
portdirectWe currently have basic proxy support for the dev env, that does involve too much manual work16:07
pcarverI'm finding when I try it that https://docs.openstack.org/openstack-helm/latest/troubleshooting/proxy.html is a bit vague and I need to configure my proxy settings in a bunch of places16:07
portdirectBut would be great to improve this area16:07
pcarvere.g., there are a bunch of YAML files that override my proxy settings with "none"16:08
pcarverSo for example, if I run pip manually it works (because my proxy env is set correctly) but when OSH runs pip it overrides my proxy settings and explictly tells pip "none"16:08
pcarverwhich of course results in pip failing16:09
portdirectlamt, can you help pcarver ?16:09
pcarverI can copy the pip command directly out of the OSH failure message and paste it on the bash CLI and it succeeds16:09
portdirectWe run multiple pipelines behind a Corp proxy, so it should work16:10
portdirectThough many people are in transit atm for the summit16:10
pcarverIt could be that this line from the docs needs to be clarified "Either globally or in the tasks with pip or apt, ensure you add the following to the task:"16:11
pcarverIf there's a global location then I don't know where it is.16:11
pcarverBut still, that page seems to suggest that there are a number of different places that need to be manually configured and it seems like the page is possibly not an exhaustive list of all of them, but just a set of hints at where to start.16:12
portdirectYup, as I said it's an area we really need to improve16:13
portdirectWould you be up for making a ps?16:13
pcarverEspecially since it's listed under the heading "troubleshooting" rather than instead of the installtion proceedure stating specifically: "Enter your proxy config in this YAML file"16:13
pcarverI can definitely update docs if I get a good answer. As for improving the automation, maybe, it depends on how much time it ends up taking.16:14
pcarverAs of right now, I've entered my proxy settings in at least half a dozen different files under osh or osh-infra and still haven't gotten it to run successfully to completion, so I don't think I'm on the right track.16:15
pcarverBut I've deployed both the NFS and CEPH options under /developer/ successfully on Internet connected VMs, so I'm trying to get it to work behind proxy16:16
pcarverMy main focus will be on getting the OSH+Contrail to deploy behind proxy, but I'm trying OSH without Contrail behind proxy so that I have a baseline.16:17
pcarverI know Deepak has been able to deploy OSH+Contrail on direct Internet, no proxy, but hasn't had the opportunity to attempt from behind proxy yet.16:18
*** lrensing has quit IRC16:34
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911716:35
*** lrensing has joined #openstack-helm16:37
*** gkadam_ has quit IRC16:44
*** mdih has quit IRC16:50
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Add image management function to manifests  https://review.openstack.org/56944816:59
openstackgerritRenis Makadia proposed openstack/openstack-helm master: WIP Test/Fix Ceph deployment with diff namespace name  https://review.openstack.org/56888817:33
*** mdih has joined #openstack-helm17:35
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Update armada multinode manifest with osh-infra updates  https://review.openstack.org/56941317:36
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP: armada manifest updates for OSH  https://review.openstack.org/56838517:37
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: Fix task names in dev deploy playbooks  https://review.openstack.org/56911817:38
lamtJust catching up on the conversation, pcarver, that documentation needs to be updated.17:48
lamtthe proxy info should need to be specified in 1 place only17:49
lamtsince all the pip tasks should take in the proxy variables: https://github.com/openstack/openstack-helm-infra/blob/f461e53e521125dc5ba7912b3c37db9e79fc5c8c/tools/images/kubeadm-aio/assets/opt/playbooks/roles/deploy-package/tasks/pip.yaml17:50
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911717:52
cfriesenhas anyone thought about how to do resource pinning in nova with helm?  I think the most complicated piece is dealing with CPU pinning (ie instances with a cpu policy of "dedicated" in the flavor extra-spec) since we need to tell nova which host CPUs it can allocate to guests and that will vary depending on compute node topology.17:52
cfrieseneven without CPU pinning, it seems like Kubernetes resource tracking won't properly account for resources (CPU/RAM) consumed by OpenStack instances.17:53
pcarverlamt: I see that the file you referenced is an example of using the variable, but where is the "1 place" where it should be defined?17:57
lamtgimme a second17:57
pcarverfrom a "git status" on my clone of openstack-helm-infra, I've defined my proxy in the following files and still am having failures that I think are proxy related17:58
pcarver        modified:   roles/build-images/defaults/main.yml17:58
pcarver        modified:   roles/deploy-docker/defaults/main.yml17:58
pcarver        modified:   roles/deploy-package/defaults/main.yml17:58
pcarver        modified:   roles/deploy-python-pip/defaults/main.yml17:58
pcarver        modified:   tools/images/kubeadm-aio/Dockerfile17:58
lamthmmm, I think that was splitted out in this patch: https://github.com/openstack/openstack-helm-infra/commit/b5c63ea4be09ebaaafdbda3607b8d3ae484514a218:00
lamtit used to be in 1 place18:00
*** yamamoto has quit IRC18:02
lamtwhat's the errors you are seeing during make?18:03
openstackgerritMark Burnett proposed openstack/openstack-helm master: WIP: Be more conservative with Postgres liveness  https://review.openstack.org/56948018:03
pcarverLet me rerun. I was working on it yesterday but not today.18:04
pcarverErrors were occuring during the run of tools/deployment/developer/ceph/010-deploy-k8s.sh18:04
pcarverone example was pip install failing18:04
pcarverThat was fixed by defining the proxy in roles/deploy-python-pip/defaults/main.yml18:05
pcarverBut basically I was going through trial and error looking for all the places that proxy settings are defined as "none" and trying to identify where to put proxy settings in order to fix specific errors18:06
lamtI wonder if we should move the proxy info a level up instead in the various role18:07
lamtin ansible18:08
pcarverI think it's a question of use case. Are we trying to support a use case where someone is using lots of different proxies for different purposes? Does anybody really do that?18:09
pcarverI'd think that the most common two use cases would be direct Internet connectivity or one single proxy config.18:09
pcarverIt seems uncommon to have a variety of different proxies for different software18:10
openstackgerritPete Birley proposed openstack/openstack-helm master: WIP: Add image management function to manifests  https://review.openstack.org/56944818:14
openstackgerritPete Birley proposed openstack/openstack-helm master: Rally: update image ref to both be unique and match other charts  https://review.openstack.org/56948318:14
openstackgerritPete Birley proposed openstack/openstack-helm master: Nova: Use helm-toolkit template for placement user management  https://review.openstack.org/56948418:14
openstackgerritPete Birley proposed openstack/openstack-helm master: Nova: Use helm-toolkit template for placement service management  https://review.openstack.org/56948518:14
openstackgerritPete Birley proposed openstack/openstack-helm master: Add image management function to manifests  https://review.openstack.org/56944818:16
*** mdih has quit IRC18:21
*** yamamoto has joined #openstack-helm18:23
lamtpcarver: I agree that most folks won't have different proxies for18:27
lamtdifferent things. that sounds like a nightmare to maintain.18:27
*** yamamoto has quit IRC18:28
*** yamamoto has joined #openstack-helm18:33
*** yamamoto has quit IRC18:38
openstackgerritRenis Makadia proposed openstack/openstack-helm master: WIP Test/Fix Ceph deployment with diff namespace name  https://review.openstack.org/56888818:39
*** mdih has joined #openstack-helm18:51
*** mdih has quit IRC18:51
*** yamamoto has joined #openstack-helm18:54
*** yamamoto has quit IRC19:01
openstackgerritSteve Wilkerson proposed openstack/openstack-helm master: WIP/DNM: Add single node armada dev deployments  https://review.openstack.org/56911719:05
openstackgerritPete Birley proposed openstack/openstack-helm master: Nova: Use helm-toolkit template for placement endpoints management  https://review.openstack.org/56949919:14
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Helm-Toolkit: Use image template for keystone and db management jobs  https://review.openstack.org/56950019:14
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Ldap: Drive scheme via endpoints section  https://review.openstack.org/56950119:14
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Ldap: add image template function and basic tidy of template  https://review.openstack.org/56950219:14
*** yamamoto has joined #openstack-helm19:38
*** yamamoto has quit IRC19:43
*** felipemonteiro__ has joined #openstack-helm19:51
*** felipemonteiro_ has quit IRC19:55
*** yamamoto has joined #openstack-helm19:59
*** yamamoto has quit IRC20:05
*** lrensing has quit IRC20:08
*** lrensing has joined #openstack-helm20:12
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Grafana: Add Prometheus dashboard  https://review.openstack.org/56951620:26
*** felipemonteiro__ has quit IRC20:36
*** yamamoto has joined #openstack-helm20:37
*** yamamoto has quit IRC20:41
*** julim has quit IRC20:42
openstackgerritSteve Wilkerson proposed openstack/openstack-helm-infra master: Grafana: Add Elasticsearch dashboard  https://review.openstack.org/56951920:47
*** yamamoto has joined #openstack-helm20:53
*** yamamoto has quit IRC20:59
*** yamamoto has joined #openstack-helm21:07
*** yamamoto has quit IRC21:12
*** ericho has joined #openstack-helm21:12
*** yamamoto has joined #openstack-helm21:19
*** yamamoto has quit IRC21:24
*** yamamoto has joined #openstack-helm21:32
*** yamamoto has quit IRC21:38
openstackgerritPete Birley proposed openstack/openstack-helm-infra master: Keystone-Webhook: fix gate boolean  https://review.openstack.org/56952521:40
*** yamamoto has joined #openstack-helm21:47
*** yamamoto has quit IRC21:52
*** yamamoto has joined #openstack-helm21:58
*** lrensing has quit IRC22:01
*** yamamoto has quit IRC22:02
*** lrensing has joined #openstack-helm22:06
*** lrensing has quit IRC22:08
*** yamamoto has joined #openstack-helm22:18
*** eeiden has quit IRC22:21
*** yamamoto has quit IRC22:23
*** yamamoto has joined #openstack-helm22:28
*** yamamoto has quit IRC22:33
*** yamamoto has joined #openstack-helm22:38
*** sar has quit IRC22:39
roman_gpcarver: lamt: there are ~5 or even more proxies defined in corporate proxy autoconfig file, all for different url's and networks :)22:39
roman_gbut of course that's not the case for servers. typically either 1 proxy, or direct access (extranet ip or nat), and sometimes NO_PROXY variable22:41
*** yamamoto has quit IRC22:43
*** yamamoto has joined #openstack-helm22:48
*** yamamoto has quit IRC22:55
*** roman_g has quit IRC22:59
*** yamamoto has joined #openstack-helm23:01
*** yamamoto has quit IRC23:05
*** yamamoto has joined #openstack-helm23:11
*** yamamoto has quit IRC23:15
*** yamamoto has joined #openstack-helm23:40
*** yamamoto has quit IRC23:47
*** roman_g has joined #openstack-helm23:49
*** roman_g has quit IRC23:49
*** yamamoto has joined #openstack-helm23:53
*** yamamoto has quit IRC23:57

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!