Wednesday, 2018-04-25

*** Bakey has quit IRC00:03
openstackgerritMerged openstack/ansible-role-ara master: Refactoring ara role  https://review.openstack.org/52678601:01
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: WIP: Zuul jobs experiments  https://review.openstack.org/55793301:03
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Reload systemctl and restart ara on service unit file  https://review.openstack.org/56408101:14
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Reload systemctl and restart ara on service unit file  https://review.openstack.org/56408101:29
dmsimardhiroki: so I've made a bit of progress.. ^ I know it doesn't sound related but ideally I'd like to reproduce what you're after as an "extension" to the role (i.e, for CI purposes)01:31
dmsimardIt's natural that different people have different taste in software01:31
dmsimardsome run with nginx, some with apache, some with uwsgi, some with mod_wsgi.. some just run a systemd unit file for the embedded server, etc.01:32
dmsimardI feel like if there's anyone here who would be prone to actually ansibilize the setup of ara, it'd be the people in here so feel free to contribute :D01:33
*** bcoca has quit IRC02:14
_KaszpiR_hiroki you still did not set up ara under  specific path? (http://example.com:port/ara) ?05:04
hirokidmsimard: is there anything I can do to help ?05:12
hiroki_KaszpiR_: We did, but it's a very ugly workaround. Let me get you a snippet of our hacky configuration05:12
hirokihttps://ptpb.pw/AOowIoKZub0v_8hogJAQBkxRgcbd05:13
hirokiSo we're basically redirecting /ara to /ara/ and then reverseproxy /ara/ to /reports and a whole bunch of other redirects that start at the root, which is going to end in trouble someday. Surely ARA is not the only application that expects /static for instance, or /about ;)05:14
_KaszpiR_wny not nginx?05:14
hirokiIt sorta works. For instance, when there are no playbooks loaded in the sqlite database, ARA return's a URL that breaks the reverse proxying. So this workaround also requires at least 1 playbook run in order to preview properly05:15
hirokiBecause ARA runs on every single host as an autonomous entity for the playbooks ran on that specific host. Surely we're not going to go for NGINX on every individual host (hundreds, as it's in our baseline). We've chosen hiawatha as it takes a few MB of RAM and the only thing we really need is a reverse proxy to services hosted on localhost05:16
hirokiSeems a bit overkill and asking for trouble to put NGINX everywhere ;)05:16
_KaszpiR_with nginx you should be able to get it working with something as simple as below snippet (notice it's for gitlab, so location and port needs to be updated) https://ptpb.pw/pQqN05:17
_KaszpiR_we're running nginx with 5mb of memory :D05:17
hirokiAdditional reason not to go for general purpose web servers: we actually use NGINX as legitimate webservers to host actual websites. Packages used in the baseline should not conflict with potentially required packages in the services layer on top as that will create nasty and unnecessary dependencies05:18
hiroki_KaszpiR_: we tried NGINX, we tried Apache as well. They all suffer from the same problem05:19
_KaszpiR_well, i'd say introducting another web server if you have already one is making thing more complex05:19
_KaszpiR_it's just a matter of config05:19
_KaszpiR_also I've got jenkins set up in similiar way (and other nasty services like jira etc)05:19
_KaszpiR_I'll try to procy ara probably in this week05:20
_KaszpiR_*proxy with nginx05:20
hirokiYeah most services have no issue working this way. With ARA we couldn't get it working with any web server as ARA returns a different URL then the reverse proxy anticipates on05:20
_KaszpiR_ah05:20
_KaszpiR_well, blame devs ;D05:20
hirokiWe tried the UWSGI configuration with Apache, and we tried it with the internal ARA webserver (werkzeug) with NGINX, Apache, and Hiawatha. All the same results05:21
_KaszpiR_what version of ara do you use?05:21
hirokiHow about working with the devs, no one needs to blame others05:21
hirokiThe latest05:21
hiroki0.14.605:21
_KaszpiR_ok, thx for info05:21
hirokiWe also tried Python 3 instead of Python 2, same same05:21
hirokiI usually come to the devs as a last resort, FYI. ;)05:22
hirokiI'm suspecting the issue arises from how Werkzeug / Flask applications deal with routing internally. I've read a few things that a Python module 'ProxyFix' should be able to deal / resolve with it. But in general reverse proxying Flask applications within a subfolder is troublesome, or so it seems05:23
_KaszpiR_ah I think ara has the same issue as owncloud/nextcloud - it will require extra rewrite rules to make it work properly05:25
hirokiTried it, didn't work, but feel free to share any ideas, i'm eager to try anything we haven't tried out yet :)05:28
*** Brainspackle has quit IRC06:02
grumpyowldmsimard: thanks!06:12
*** gvincent has joined #ara07:09
*** hwoarang has quit IRC07:45
*** hwoarang_ has joined #ara07:45
*** Brainspackle has joined #ara07:50
*** hwoarang_ has quit IRC07:54
*** hwoarang has joined #ara07:54
grumpyowl:q09:14
*** rvgate has joined #ara09:44
*** zxiiro has quit IRC10:31
*** zxiiro has joined #ara10:32
*** jrist has quit IRC12:23
*** ara-slack2 has quit IRC12:23
*** _KaszpiR_ has quit IRC12:23
*** jrist has joined #ara12:26
*** ara-slack2 has joined #ara12:26
*** _KaszpiR_ has joined #ara12:26
dmsimardhiroki: do you have a role to configure Hiawatha ?12:38
hirokidmsimard: What do you mean exactly with role ?12:38
dmsimardAn Ansible role :p12:39
dmsimardLike I was mentioning yesterday, I'd like to have "community support" for they deployment use case within the ARA role ( https://github.com/openstack/ansible-role-ara )12:40
hirokiAh ! Yes, but not sure if it's readable, and we use a tarred gzip archive with the binary contents of Hiawatha due to the unavailability of the package on CentOS (we're creating SPEC files to build our Hiawatha as we speak, so not available as of right right now). Not sure you want to unpack binaries from strangers..12:40
dmsimardIs it available on another platform ? Fedora ? Ubuntu ?12:41
hirokiShould be on Debian, so I guess Ubuntu as well, i'll get you the URL's12:41
hirokiThere is a Anku CentOS repo that has Hiawatha BTW. :http://anku.ecualinux.com/12:42
*** jcl has joined #ara12:42
dmsimardhiroki: I have a few packages on Fedora -- if you already have a spec we could suggest it as a Fedora package so we can include it in EPEL afterwards :)12:43
dmsimardHiawatha isn't packaged in Fedora or EPEL right now12:43
dmsimardARA is packaged in Fedora but I need to update it though.12:43
hirokiI can provide the SPEC perhaps next monday as I anticipate our packager is finished with it by then12:43
hirokiSounds good, should be great if it ends up in EPEL :)12:44
dmsimardhiroki: well, I mean I can help you with that and the process but I don't necessarily have the bandwidth to do everything :p12:44
dmsimardhiroki: in the meantime, I haven't found hiawatha in Ubuntu's base repositories either12:45
hirokiMy only request for you is ARA on a subdomain, we can actually take care of the rest12:45
dmsimardhttps://pkgs.org/download/hiawatha12:45
hiroki I thought I saw that online, i'm looking as well. Found only the mirror on mirror.tuxhelp.org12:45
dmsimardyeah but I was looking to try and reproduce your issue so we can actually fixed it12:45
dmsimardcan I use apache for reproducing and you can work from there ?12:45
hirokiYes definitely, and NGINX as well12:46
hirokiSo you don't actually need Hiawatha. The download page of Hiawatha actually lists a few unofficial packages to download Hiawatha from: https://www.hiawatha-webserver.org/download12:46
dmsimardyou said you were reverse proxying to the embedded server or uwsgi ? does it matter ?12:46
hirokiWe tried both, neither worked. Extra detail, we run our Hiawatha instance off of port 444, just in case Werkzeug tries to do something smart with non-default ports12:47
dmsimarddoubt it12:47
hirokiWe run it off of the embedded server though, as Hiawatha only supports FastCGI and no direct UWSGI integration12:47
dmsimardsure, I'll try that.12:48
hirokihttps://ptpb.pw/AFYBhx7ymaCAWq0LsJdL4XgskF2o/bash12:48
hirokiThat's our Hiawatha virtual host configuration, it's pretty basic reverse proxying12:48
openstackgerritMerged openstack/ara-plugins master:  Bootstrap ara-plugins  https://review.openstack.org/56406312:48
dmsimardnhicher: do you want to review https://review.openstack.org/#/c/564081/ ? :D12:49
hirokiThe '1' in the first ReverseProxy entry on line #67 indicates that it will strip off the first 'directory' of the URL. So in this case it'll strip /ara12:49
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Reload systemctl and restart ara on service unit file  https://review.openstack.org/56408112:50
hirokiThis is our systemd service unit file BTW. As I can see it's a pendign activity: https://ptpb.pw/AFhZd2SRO0TOXhaJTD-f5JOEt4zE12:50
*** bcoca has joined #ara12:55
*** bcoca has joined #ara12:55
nhicherhi dmsimard, yes I will do a review =)13:06
*** rvgate has quit IRC13:51
*** tbielawa has joined #ara14:02
openstackgerritSorin Sbarnea proposed openstack/ara master: Allow ARA module to be run  https://review.openstack.org/56356114:02
*** grumpyowl has quit IRC14:11
*** grumpyowl has joined #ara14:13
*** grumpyowl has quit IRC14:19
*** jcl has quit IRC14:56
*** jrist has quit IRC15:01
*** ara-slack2 has quit IRC15:01
*** _KaszpiR_ has quit IRC15:01
*** sshnaidm|off has quit IRC15:01
*** gvincent has quit IRC15:01
*** ChanServ has quit IRC15:01
*** gvincent has joined #ara15:01
*** ChanServ has joined #ara15:01
*** barjavel.freenode.net sets mode: +o ChanServ15:01
*** jrist has joined #ara15:02
*** ara-slack2 has joined #ara15:02
*** _KaszpiR_ has joined #ara15:02
*** ara-slack has joined #ara15:03
*** ara-slack2 has quit IRC15:03
*** sshnaidm|off has joined #ara15:04
*** ara-slack has quit IRC15:04
*** ara-slack has joined #ara15:04
*** ChanServ sets mode: +v ara-slack15:04
*** weshay has quit IRC15:04
*** jlozadad[m] has quit IRC15:05
*** weshay has joined #ara15:06
*** tbielawa has quit IRC15:33
*** tbielawa has joined #ara15:34
*** tbielawa is now known as tbielawa|brb15:45
*** tbielawa|brb is now known as tbielawa16:03
*** BlessJah_ has joined #ara16:06
*** jmccrory_ has joined #ara16:09
*** BlessJah has quit IRC16:10
*** jmccrory has quit IRC16:10
*** jmccrory_ is now known as jmccrory16:11
*** jlozadad[m] has joined #ara16:18
openstackgerritMerged openstack/ansible-role-ara master: Reload systemctl and restart ara on service unit file  https://review.openstack.org/56408116:36
dmsimardssbarnea: I'm not very excited at __main__, it's something new that we're not testing right now and that we'll have to maintain. I've looked at a few different projects and I didn't see something like that. Do we really need it ?16:39
dmsimardAlso, did you see my comments on https://review.openstack.org/#/c/563712/ ?16:40
dmsimardI'd like to land patches that are in flight so I can cut a release16:40
ssbarneahttps://github.com/tox-dev/tox/blob/master/tox/__main__.py16:40
ssbarneahttps://github.com/PyCQA/pylint/blob/master/pylint/__main__.py16:40
dmsimardssbarnea: interesting, I guess I haven't been looking at those projects :p16:41
ssbarneaalso adding this file would not break anything, is just another way of calling it.16:41
ssbarneavery useful one for people that are affected by virtuanenv issues.16:42
ssbarneai doubt it can hurt16:42
dmsimardssbarnea: ok, let's land it then. Added a comment in https://review.openstack.org/#/c/563561/, after that I'll merge it16:42
ssbarneaalso, more important: it does not duplicate code.16:42
openstackgerritSorin Sbarnea proposed openstack/ara master: Allow ARA module to be run  https://review.openstack.org/56356116:44
*** tbielawa is now known as tbielawa|lunch17:00
dmsimardhiroki: still around ?17:31
*** jlozadad_ has joined #ara18:03
*** tbielawa|lunch is now known as tbielawa18:09
*** myoung is now known as myoung|dr19:03
dmsimardhiroki: I got your thing working, I think. I'll clean things up and send a patch,.19:30
*** gvincent has quit IRC19:44
*** tbielawa is now known as tbielawa|brb20:23
*** BlessJah_ is now known as BlessJah20:35
*** myoung|dr is now known as myoung20:41
openstackgerritDavid Moreau Simard proposed openstack/ara master: Add support for custom context/application root  https://review.openstack.org/48437820:50
openstackgerritDavid Moreau Simard proposed openstack/ara master: Add support for custom context/application root  https://review.openstack.org/48437820:52
dmsimardhiroki: ^ I suspect that this breaks something that I haven't tested yet but the implementation shouldn't meaningfully change if you want to try it out before I land it20:53
dmsimardhiroki: example how to install ara with that patch: http://paste.openstack.org/raw/719956/20:54
openstackgerritDavid Moreau Simard proposed openstack/ara master: Add support for custom context/application root  https://review.openstack.org/48437820:55
*** spiette has quit IRC20:57
*** tbielawa|brb is now known as tbielawa20:59
*** tbielawa has quit IRC20:59
*** openstackgerrit has quit IRC21:20
*** openstackgerrit has joined #ara22:52
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Refactor installation, configuration and web server implementation  https://review.openstack.org/56436222:52
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Add logrotate configuration  https://review.openstack.org/56436322:52
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: We don't need to check if selinux is enforcing  https://review.openstack.org/56436422:52
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Add support for nginx with reverse proxy to embedded server  https://review.openstack.org/56436522:52
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Install packages as a list instead of per item  https://review.openstack.org/56436722:56
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Add logrotate configuration  https://review.openstack.org/56436323:09
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: We don't need to check if selinux is enforcing  https://review.openstack.org/56436423:09
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Add support for nginx with reverse proxy to embedded server  https://review.openstack.org/56436523:09
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Install packages as a list instead of per item  https://review.openstack.org/56436723:09
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Add support for nginx with reverse proxy to embedded server  https://review.openstack.org/56436523:21
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Install packages as a list instead of per item  https://review.openstack.org/56436723:21
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Provide a hook for overriding configuration  https://review.openstack.org/56436923:21
*** JohnnyOSA has quit IRC23:21
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Add support for nginx with reverse proxy to embedded server  https://review.openstack.org/56436523:29
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Install packages as a list instead of per item  https://review.openstack.org/56436723:29
openstackgerritDavid Moreau Simard proposed openstack/ansible-role-ara master: Provide a hook for overriding configuration  https://review.openstack.org/56436923:29
*** JohnnyOSA has joined #ara23:48

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!