Thursday, 2018-03-15

*** wes_dillingham has joined #openstack-swift00:16
notmynamemattoliverau: ah, sorry to hear it. hope y'all get better soon!00:28
*** wes_dillingham has quit IRC00:29
*** NM has quit IRC00:34
*** gerardgine has quit IRC00:40
openstackgerritMerged openstack/swift master: Fix tests using O_TMPFILE  https://review.openstack.org/55209300:40
*** tovin07_ has joined #openstack-swift00:42
*** wes_dillingham has joined #openstack-swift00:54
*** gerardgine has joined #openstack-swift01:04
*** wes_dillingham has quit IRC01:12
*** cshastri has joined #openstack-swift01:30
*** gerardgine has quit IRC01:30
*** cshastri has quit IRC01:39
*** cshastri has joined #openstack-swift01:40
kota_mattoliverau: please take your time for your and her rest.01:55
openstackgerritMerged openstack/swift master: py3: port cli form_signature and unit tests  https://review.openstack.org/55231502:19
openstackgerritMerged openstack/swift master: Ensure reverting test env if the env is temporarily changed  https://review.openstack.org/54730602:19
*** mingyu_ has joined #openstack-swift02:23
*** mingyu has quit IRC02:25
*** itlinux has quit IRC02:32
*** gkadam has joined #openstack-swift02:42
*** saint_ has quit IRC02:45
*** gkadam has quit IRC02:46
*** psachin has joined #openstack-swift02:47
*** gerardgine has joined #openstack-swift02:52
*** bkopilov has quit IRC03:06
*** germs has quit IRC03:14
*** germs has joined #openstack-swift03:15
*** germs has quit IRC03:15
*** germs has joined #openstack-swift03:15
*** germs has quit IRC03:16
*** germs has joined #openstack-swift03:17
*** germs has joined #openstack-swift03:17
*** kei_yama has quit IRC03:40
*** links has joined #openstack-swift03:41
*** gerardgine has quit IRC03:50
*** saint_ has joined #openstack-swift03:58
*** kei_yama has joined #openstack-swift04:01
*** germs has quit IRC04:09
*** bkopilov has joined #openstack-swift04:21
*** gkadam has joined #openstack-swift04:33
*** gyee has quit IRC04:35
*** gkadam has quit IRC04:55
*** rickflare has joined #openstack-swift05:13
openstackgerritTim Burke proposed openstack/swift feature/deep: Be willing to cleave on handoffs  https://review.openstack.org/55069705:17
openstackgerritTim Burke proposed openstack/swift feature/deep: Stop replicating object rows from large DBs to sharded containers  https://review.openstack.org/54967805:17
*** hseipp has joined #openstack-swift05:30
kota_oh, timburke is still working?05:40
mattoliveraukota_: you've met timburke right... he's always working, even when he sleeps :P05:52
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/s3api: Update S3api Docs  https://review.openstack.org/55285305:57
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/s3api: Cleanup swift/common/middleware/s3api/test dir  https://review.openstack.org/55285405:57
kota_mattoliverau: :P05:57
kota_^^^ is fixed version of sphinx errors and pep8 errors.05:58
*** gkadam has joined #openstack-swift06:35
*** tovin07_ has quit IRC06:57
*** gkadam has quit IRC07:03
*** gkadam has joined #openstack-swift07:07
*** gkadam has quit IRC07:15
*** hseipp has quit IRC07:36
*** hseipp has joined #openstack-swift07:38
*** armaan has joined #openstack-swift07:41
*** pcaruana has joined #openstack-swift07:48
*** pcaruana has quit IRC07:50
*** pcaruana has joined #openstack-swift07:50
*** pcaruana is now known as pcaruana|wfh|07:53
*** hseipp has quit IRC07:59
*** gkadam has joined #openstack-swift08:00
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925008:04
acolesgood morning08:23
acolesmattoliverau: sounds rough, take it easy08:23
*** tesseract has joined #openstack-swift08:24
*** tovin07_ has joined #openstack-swift08:30
*** _alastor_ has quit IRC08:35
kota_acoles: good morning08:55
acoleskota_: o/08:56
*** rcernin has quit IRC09:00
*** geaaru has joined #openstack-swift09:00
*** geaaru has quit IRC09:09
*** geaaru has joined #openstack-swift09:22
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873609:35
*** hseipp has joined #openstack-swift09:35
*** ^andrea^ has joined #openstack-swift09:39
*** kei_yama has quit IRC09:53
*** kei_yama has joined #openstack-swift09:55
*** tovin07_ has quit IRC10:04
root_743hello, what would be the implication of disabling proxy-logging from my proxy-server.conf ?10:05
root_743when that option is enabled10:05
root_743swift 100% of the times fails to deal with big images10:05
openstackgerritKota Tsuyuzaki proposed openstack/swift feature/s3api: Remove conf from s3 request  https://review.openstack.org/55331510:12
acolesroot_743: you mean remove the proxy-logging middleware? you'd get no logging of requests in the proxy server10:12
kota_timburke: ^^ would make you happy, maybe?10:15
*** arunman has joined #openstack-swift10:27
*** cshastri has quit IRC10:31
*** arunman has quit IRC10:42
*** armaan_ has joined #openstack-swift11:09
*** armaan has quit IRC11:10
*** armaan has joined #openstack-swift11:13
*** armaan_ has quit IRC11:17
*** ianychoi_ has joined #openstack-swift11:19
*** jungleboyj_ has joined #openstack-swift11:20
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Require sufficient replication of each cleaved shard range  https://review.openstack.org/55333711:21
*** dosaboy_ has joined #openstack-swift11:22
*** Anticime1 has joined #openstack-swift11:23
*** thurloat_ has joined #openstack-swift11:23
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Require sufficient replication of each cleaved shard range  https://review.openstack.org/55333711:23
*** dcourtoi has joined #openstack-swift11:24
*** weezhard has joined #openstack-swift11:25
*** jiaopengju_ has joined #openstack-swift11:26
*** pcaruana|wfh| has quit IRC11:27
*** stewie925 has quit IRC11:27
*** jiaopengju has quit IRC11:27
*** patchbot has quit IRC11:27
*** dosaboy has quit IRC11:27
*** jungleboyj has quit IRC11:27
*** Anticimex has quit IRC11:27
*** jungleboyj_ is now known as jungleboyj11:27
*** patchbot has joined #openstack-swift11:28
*** pcaruana|wfh| has joined #openstack-swift11:28
*** thurloat has quit IRC11:28
*** ianychoi has quit IRC11:28
*** dcourtoi_ has quit IRC11:28
*** weezhard_ has quit IRC11:28
*** hseipp has quit IRC11:28
*** jungleboyj has quit IRC11:28
*** jungleboyj has joined #openstack-swift11:28
*** thurloat_ is now known as thurloat11:28
*** arunman has joined #openstack-swift11:48
*** armaan_ has joined #openstack-swift11:49
*** armaan has quit IRC11:52
*** bkopilov has quit IRC12:03
*** arunman has quit IRC12:04
*** stewie925 has joined #openstack-swift12:05
*** kei_yama has quit IRC12:05
*** pcaruana|wfh| is now known as pcaruana12:14
*** wes_dillingham has joined #openstack-swift12:18
root_743acoles: mmmm ok, I won't enable the logging before upgrading to a newer version of swift12:19
root_743thanks a lot :)12:19
tdasilvaroot_743: watch out when removing proxy_logging middleware, i remember seeing a bug where when removing only one of them, the proxy would consume a insane amount of memory12:22
tdasilvaroot_743: it turned out that it was because the pipeline had only one proxy_loggin in it12:22
tdasilvanever tried removing both....12:23
root_743tdasilva: at the moment I just removed the proxy-logging but kept the proxy-server12:28
root_743tdasilva: is that what you mean when you say both?12:29
tdasilvaroot_743: here's a sample pipeline: https://github.com/openstack/swift/blob/master/etc/proxy-server.conf-sample#L9712:30
tdasilvayou will notice that proxy_logging is listed twice12:30
*** armaan_ has quit IRC12:36
*** armaan has joined #openstack-swift12:37
*** psachin has quit IRC12:44
*** armaan has quit IRC12:45
*** armaan has joined #openstack-swift12:45
*** ianychoi_ is now known as ianychoi13:23
*** ukaynar has joined #openstack-swift13:31
*** bkopilov has joined #openstack-swift13:41
*** mvk has quit IRC13:42
*** links has quit IRC13:42
*** arunman has joined #openstack-swift13:59
-openstackstatus- NOTICE: POST_FAILURE results on Tempest-based jobs since the most recent Zuul security fixes are being investigated; rechecking those won't help for now but we'll keep you posted once a solution is identified14:11
*** ChanServ changes topic to "POST_FAILURE results on Tempest-based jobs since the most recent Zuul security fixes are being investigated; rechecking those won't help for now but we'll keep you posted once a solution is identified"14:11
*** mvk has joined #openstack-swift14:14
*** hseipp has joined #openstack-swift14:19
*** armaan has quit IRC14:31
*** germs has joined #openstack-swift14:33
*** germs has quit IRC14:33
*** germs has joined #openstack-swift14:33
*** germs has quit IRC14:33
*** arunman has quit IRC14:34
*** germs has joined #openstack-swift14:36
*** cshastri has joined #openstack-swift14:54
*** hseipp has quit IRC15:02
*** kallenp has joined #openstack-swift15:04
kallenpAny tip for S3 gateway to SMB/CIFS storage  ?15:05
openstackgerritNguyen Hai proposed openstack/python-swiftclient master: Remove py34 from envlist in tox.ini  https://review.openstack.org/55342915:14
*** armaan has joined #openstack-swift15:21
openstackgerritNguyen Hai proposed openstack/python-swiftclient master: Change python-swiftclient webpage from oslosphinx to openstackdocstheme  https://review.openstack.org/55343315:28
*** itlinux has joined #openstack-swift15:30
*** gerardgine has joined #openstack-swift15:47
*** mahatic has joined #openstack-swift15:53
*** mahatic has left #openstack-swift15:54
openstackgerritAlexandre Lécuyer proposed openstack/swift master: Change object_audit_location_generator() to yield for a single policy.  https://review.openstack.org/54858915:55
*** mahatic_ has joined #openstack-swift15:56
*** armaan has quit IRC16:02
*** armaan has joined #openstack-swift16:03
*** armaan has quit IRC16:03
*** armaan has joined #openstack-swift16:03
*** _alastor_ has joined #openstack-swift16:04
*** armaan has quit IRC16:07
*** armaan has joined #openstack-swift16:08
*** gerardgine has quit IRC16:16
*** gerardgine has joined #openstack-swift16:22
*** SkyRocknRoll has joined #openstack-swift16:23
*** ^andrea^ has quit IRC16:25
*** kallenp1 has joined #openstack-swift16:29
timburkegood morning16:30
*** kallenp has quit IRC16:32
*** kallenp has joined #openstack-swift16:37
*** kallenp1 has quit IRC16:39
*** ^andrea^ has joined #openstack-swift16:40
openstackgerritNguyen Hai proposed openstack/python-swiftclient master: Change python-swiftclient webpage from oslosphinx to openstackdocstheme  https://review.openstack.org/55343316:55
*** geaaru has quit IRC17:01
*** gkadam has quit IRC17:03
*** mahatic_ has quit IRC17:16
*** armaan has quit IRC17:17
*** armaan has joined #openstack-swift17:18
*** armaan has quit IRC17:19
*** armaan has joined #openstack-swift17:19
*** gkadam has joined #openstack-swift17:25
*** SkyRocknRoll has quit IRC17:29
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Add a direct_put_container function to direct_client  https://review.openstack.org/55350617:46
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Use direct client to PUT shard ranges to containers  https://review.openstack.org/55350717:46
acolesclayg: re p 553507 I still found I needed to persuade the proxy to allow a '.' prefixed container GET w/out its account, so that we can fetch objects before the container updater gets round to creating the account17:48
patchbothttps://review.openstack.org/#/c/553507/ - swift (feature/deep) - Use direct client to PUT shard ranges to containers17:48
acolesbut if the change to container.py is acceptable then it's all worked out ok.17:49
*** cshastri has quit IRC17:51
timburkei wonder if we need to zero out stats in container-updater for sharded containers... otherwise, won't account-level stats double up between the regular and sharded accounts?17:51
timburkeor rather, not for sharded containers, for *shard* containers17:51
*** gkadam has quit IRC18:00
*** mvk has quit IRC18:05
acolestimburke: or ignore .shards_ account stats? once we have multiple-replica object stats in the shard range table, the sharded container db should have a good if not better picture than the .shards account18:09
*** kallenp has left #openstack-swift18:09
timburkeyeah, i just mean that when a shard container's updater goes to report stats to its .shards_ account, it should always report 0 objects, 0 bytes18:10
*** silor has joined #openstack-swift18:10
acolesmakes sense18:11
acolesdoes the tiering work have a similar issue?18:12
timburkei think not? certainly not for bytes-used any way. quotas will probably be funky though18:14
*** ^andrea^ has quit IRC18:17
*** gerardgine has quit IRC18:19
*** ^andrea^ has joined #openstack-swift18:19
*** Nirbhay has joined #openstack-swift18:20
*** silor has quit IRC18:21
*** Nirbhay has quit IRC18:21
*** wes_dillingham has quit IRC18:23
*** tesseract has quit IRC18:39
*** gerardgine has joined #openstack-swift18:45
*** mvk has joined #openstack-swift18:51
notmynametdasilva: how do I find what repo an rpm is in? eg when I get "No package matching 'python-eventlet' found...", how do I learn where to get it?18:59
tdasilvanotmyname: not sure i have a good answer myself, for some packages it's just google, sometimes i use this page: http://cbs.centos.org/koji/19:03
tdasilvabut something like python-eventlet is a bit surprising19:04
tdasilvazaitcev might have a better idea19:04
notmynameok, thanks19:04
notmynameyeah, I think it may be in epel, but I just got some stuff out of order19:04
notmynamebut looking at http://cbs.centos.org/koji/packageinfo?packageID=189 I don't see "EPEL" anywhere19:04
notmynameah, yes. reorder worked19:05
notmynameso... I "fixed" it, but sortof by accident19:05
zaitcevI think very little comes from EPEL if anything.19:07
tdasilvanotmyname: EPEL is a fedora project so this could be useful too: https://koji.fedoraproject.org/koji/index19:09
zaitcev[root@keystone yum.repos.d]# yum info python2-eventlet | grep repo19:10
zaitcevFrom repo   : openstack-newton19:10
zaitcev[root@keystone yum.repos.d]# grep openstack-newton *.repo19:10
zaitcevrdo-release.repo:[openstack-newton]19:10
zaitcevSo basically just add RDO and everything magically works19:11
*** ukaynar has quit IRC19:12
tdasilvaheh19:13
*** hseipp has joined #openstack-swift19:15
*** gerardgine has quit IRC19:15
*** hseipp has quit IRC19:15
*** ukaynar has joined #openstack-swift19:22
*** ChanServ changes topic to "https://bugs.not.mn/project/Swift | Logs: http://eavesdrop.openstack.org/irclogs/%23openstack-swift/ | Meetings: https://wiki.openstack.org/wiki/Meetings/Swift | Review Dashboard: http://not.mn/reviews.html | https://etherpad.openstack.org/p/Dublin_PTG_Swift"19:26
-openstackstatus- NOTICE: The regression stemming from one of yesterday's Zuul security fixes has been rectified, and Devstack/Tempest jobs which encountered POST_FAILURE results over the past 24 hours can safely be rechecked now19:26
*** NM has joined #openstack-swift19:30
DHEzaitcev: the rdo repo and its dependencies (it will pull in additional repos) will cover everything for redhat installs on anything openstack related.. though I think it only carries newton19:34
*** ukaynar has quit IRC19:53
*** wes_dillingham has joined #openstack-swift20:01
*** wes_dillingham has quit IRC20:06
openstackgerritAlistair Coles proposed openstack/swift feature/deep: Make concatenation of shard listings more robust  https://review.openstack.org/55291320:30
*** gerardgine has joined #openstack-swift20:36
*** mvk has quit IRC20:53
*** armaan has quit IRC21:00
*** armaan has joined #openstack-swift21:00
*** armaan has quit IRC21:00
*** armaan has joined #openstack-swift21:01
*** mvk has joined #openstack-swift21:06
*** itlinux has quit IRC21:39
*** guimaluf has quit IRC21:58
*** rcernin has joined #openstack-swift22:02
DHEis there a reason for an object to be quarantined besides a checksum mismatch? I have a file put in quarantine but the md5sum matches the etag22:03
DHE(it's a lab system, so nothing of value is lost)22:03
openstackgerritTim Burke proposed openstack/swift feature/deep: Be willing to cleave on handoffs  https://review.openstack.org/55069722:12
openstackgerritTim Burke proposed openstack/swift feature/deep: Stop replicating object rows from large DBs to sharded containers  https://review.openstack.org/54967822:12
mattoliverauDHE can you find mention of the quarantine in the logs, that would help figure out why. It could be failure to read or access some metadata.22:16
mattoliverauif the file was un stat'able, etc.22:16
mattoliveraubut the log message should say22:16
DHEmattoliverau: thanks for the suggestion... I could only find one system's log... "Exception reading metadata" and an error above that /var/cache/swift had bad permissions...22:29
DHEif multiple systems had this problem they probably all ate the object...22:30
mattoliverauwhat file system are you running under the objects XFS?22:30
mattoliverauDHE ^^22:30
DHEsome XFS, some ZFS22:31
*** armaan has quit IRC22:31
mattoliverau/var/cache/swift is where recon stats tend to be dropped.22:31
mattoliveraufor some reason swift failed to read the metadata accociated with an object. Could be the metadata stored in the extended attributes (which is why we recommend XFS) or along side in the .meta file which is useally written on a post.22:33
DHEthis is my learning experience. I've intentionally made a slightly pathological environment and seeing how it goes...22:40
DHEpossibly xattrs were disabled on ZFS. that would have broken it... somewhat odd that only a few items were quarantined though...22:41
*** zaitcev_ has joined #openstack-swift22:47
*** ChanServ sets mode: +v zaitcev_22:47
*** zaitcev has quit IRC22:51
tdasilvaanybody know the history of swift not supporting VersionDiscovery? https://wiki.openstack.org/wiki/VersionDiscovery23:27
tdasilvaor does it and i don't know about it23:28
*** kei_yama has joined #openstack-swift23:28
notmynametdasilva: IIRC, because we only have one version that's the same everywhere, nobody thought it important enough to spend time one until we actually had something other than v123:28
torgomaticit'd be pretty easy for someone (else) to whip up a middleware to handle that stuff; it looks like it'd have to respond to GET/HEAD on "/versions" and "/v1" with some stuff23:30
torgomaticwe've got one that responds to GET /crossdomain.xml with some hard-coded string; maybe we can rename that one and jam it in there23:31
torgomaticswift/common/middleware/various_hard_coded_strings.py23:31
timburke"the same" -- fah!23:32
timburkethe closest equivalent is /info and we already have a standard of sorts23:32
notmynameI don't think there was any fundamental objection to it. just nobody typed it in23:33
notmynameI do like the example at the bottom of the wiki. "The return status code should be 200 OK ... Status: 300"23:34
*** rcernin has quit IRC23:39
*** gerardgine has quit IRC23:50
*** ^andrea^ has quit IRC23:52
*** gerardgine has joined #openstack-swift23:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!