Monday, 2021-12-06

opendevreviewMerged openstack/swift master: reconstructor: restrict max objects per revert job  https://review.opendev.org/c/openstack/swift/+/81801702:47
opendevreviewMatthew Oliver proposed openstack/swift master: POC: refactored errorlimited with global cache  https://review.opendev.org/c/openstack/swift/+/82031309:59
opendevreviewMatthew Oliver proposed openstack/swift master: WIP: Add global error_limiting to object-updater  https://review.opendev.org/c/openstack/swift/+/82048609:59
mattoliver^ acoles first pass at using a class too 10:11
acoles:thu10:13
acoles👍10:13
opendevreviewAlistair Coles proposed openstack/swift master: internal-client: pass global_conf to loadapp  https://review.opendev.org/c/openstack/swift/+/82002911:03
opendevreviewMerged openstack/swift master: reconstructor: include partially reverted handoffs in handoffs_remaining  https://review.opendev.org/c/openstack/swift/+/82038714:56
manuvakery1Hi what is SW in the source field of following proxy-server log15:35
manuvakery1Dec  2 10:59:50 swift-proxy2 proxy-server: 99.248.129.100 10.0.0.2 02/Dec/2021/10/59/50 GET /v1/d84a1s87f9bcc84edeb37a619d2f406f/ds9archive/DS920_hyperbackup.hbk/Pool/0/21/511.bucket.536 HTTP/1.0 200 - HyperBackup/2.2.8-1510%20%28DS920%2B%3B%20DSM%206.2-25556%29%20aws-sdk-php2/2.8.31%20Guzzle/3.9.3%20curl/7.54.0%20PHP/5.6.11%20StaticWeb - - 27264116 - tx0121737be1a849e688e10-0061a8a721 - 4.8183 SW - 15:35
manuvakery11638442785.342961073 1638442790.161214113 015:35
opendevreviewAlistair Coles proposed openstack/swift master: Modify internal client logger name  https://review.opendev.org/c/openstack/swift/+/82053915:39
acolesmanuvakery1: it's the 'swift source' which indicates the source of an (internally-generated) request, in this case 'Static Web' https://docs.openstack.org/swift/latest/logs.html15:42
manuvakery1acoles: what do you mean by  (internally-generated) request , will there be associated requests  when i make a GET call?15:44
manuvakery1acoles: what will be the source for the actual client request?15:48
acolessome client requests can result in multiple requests internal to Swift, for example with Static Web there may be requests to check container metadata15:53
acolesI don't think that the field is set for the original client request15:54
acoles(I could be wrong on that ^^)15:54
manuvakery1acoles: thanks for your response.  will the transaction id be same for these internally generated requests?16:05
acolesyes, it should be16:08
manuvakery1in logs my I see 2 requests with the same transaction id , one is GET call an other is a HEAD call .. I assume the HEAD call is internally generated and  the GET call is the actual client call. I see in both calls the source is set to SW 16:18
manuvakery1Its critical for me to find the actual bytes send/received from the client16:22
manuvakery1https://github.com/openstack/ceilometermiddleware/blob/master/ceilometermiddleware/swift.py#L294-L29816:22
manuvakery1the ceilometermiddleware here emit events only is the swift.source is None.. what will happen  if the calls s3/static web 16:23
timburkeclient request should have a swift.source that's unset; i.e., env.get('swift.source') will be None. in logs, it will show up as a dash: "-"16:26
manuvakery1 timburke which means for any request  there will be one line in the log with  swift.source is set as "-"16:35
manuvakery1and more logs with same transaction id but with other value in source field16:36
opendevreviewAlistair Coles proposed openstack/swift master: Improve updaters unit tests  https://review.opendev.org/c/openstack/swift/+/82057918:09
opendevreviewTim Burke proposed openstack/swift master: updaters: use replication network  https://review.opendev.org/c/openstack/swift/+/82040218:38
zaitcevYou're squashing? I had a question about Alistair's follow-up just now.18:38
acoleszaitcev: what's the question? (no comments on gerrit)18:40
zaitcevIndeed, strange. Anyway, why do you only add replication_ip but not replication_port? https://review.opendev.org/c/openstack/swift/+/820579/1/test/unit/obj/test_updater.py18:41
acoleszaitcev: because the replication_port is set in the test https://review.opendev.org/c/openstack/swift/+/820579/1/test/unit/obj/test_updater.py#54218:43
zaitcevthanks18:44
acolesbut, on reflection, would be no harm setting it in setUp anyway...to avoid us wondering again in the future18:44
timburke_feel free to push over :-)18:44
acoleswill do18:48
opendevreviewAlistair Coles proposed openstack/swift master: updaters: use replication network  https://review.opendev.org/c/openstack/swift/+/82040218:48
acoleszaitcev: timburke_ ^^ 18:49
opendevreviewTim Burke proposed openstack/swift master: updater: Add timing stats  https://review.opendev.org/c/openstack/swift/+/81973219:34
opendevreviewTim Burke proposed openstack/swift master: updater: Skip updates to overloaded nodes  https://review.opendev.org/c/openstack/swift/+/81993119:34
opendevreviewMatthew Oliver proposed openstack/swift master: POC: refactored errorlimited with global cache  https://review.opendev.org/c/openstack/swift/+/82031323:59
opendevreviewMatthew Oliver proposed openstack/swift master: WIP: Add global error_limiting to object-updater  https://review.opendev.org/c/openstack/swift/+/82048623:59

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!