Thursday, 2015-06-11

*** gyee has quit IRC00:00
*** petertr7 is now known as petertr7_away00:03
*** minwoob has quit IRC00:09
*** remix_tj has quit IRC00:17
*** zaitcev has quit IRC00:27
*** km has quit IRC00:35
*** km has joined #openstack-swift00:36
*** Barker has joined #openstack-swift01:02
*** Barker has quit IRC01:08
*** Barker has joined #openstack-swift01:08
*** chlong has quit IRC01:11
*** lcurtis has quit IRC01:18
*** ptb has joined #openstack-swift01:23
*** ptb has quit IRC01:24
*** ptb has joined #openstack-swift01:24
*** RackerShagz has joined #openstack-swift01:34
openstackgerritCharles Hsu proposed openstack/python-swiftclient: Add ability to download objects to particular folder.  https://review.openstack.org/16028301:36
*** RackerSh_ has joined #openstack-swift01:41
*** xnox has quit IRC01:44
*** RackerShagz has quit IRC01:45
*** xnox has joined #openstack-swift01:47
*** RackerSh_ has quit IRC02:00
*** marcusvrn has joined #openstack-swift02:01
*** thurloat_isgone is now known as thurloat02:08
openstackgerritHisashi Osanai proposed openstack/swift: Enable Object Replicator's failure count in recon  https://review.openstack.org/13834202:13
*** wbhuber has quit IRC02:16
homattoliverau, cschwede, briancline you might be available today to take a look at patch 138342. FYI: I got a good test result from our public cloud team (I asked it because I only have saio env for my development)02:21
patchbotho: https://review.openstack.org/#/c/138342/02:21
*** ian_brown has joined #openstack-swift02:32
*** thurloat is now known as thurloat_isgone02:36
*** david-lyle has joined #openstack-swift03:04
*** ronenkat_ has quit IRC03:09
openstackgerritJanie Richling proposed openstack/swift: WIP - working on the encryption feature.  https://review.openstack.org/15790703:17
*** mwheckmann has joined #openstack-swift03:19
*** jrichli has joined #openstack-swift03:20
*** jrichli has quit IRC03:22
*** silor has joined #openstack-swift03:37
*** mwheckmann has quit IRC03:39
charzDoes object-reconstructor get fragments from handoff node? Or it only check the normal node?03:45
*** kota_ has joined #openstack-swift03:49
*** ChanServ sets mode: +v kota_03:49
charzlog https://gist.github.com/charz/632b3575b72489548ba903:50
*** fifieldt has joined #openstack-swift03:58
*** ronenkat has joined #openstack-swift03:58
*** xnox has quit IRC04:05
*** ppai has joined #openstack-swift04:07
*** bill_az has quit IRC04:07
*** gvernik has joined #openstack-swift04:10
*** gvernik has quit IRC04:10
*** xnox has joined #openstack-swift04:11
*** ptb has quit IRC04:14
*** Barker has quit IRC04:18
*** marcusvrn has quit IRC04:24
mattoliveraucharz: I'm not fully up to speed, but it only looks at normal nodes. Because there was a bug where handoffs could hold more then 1 fragment causing issues. There was discussion at summit about a way to solve it.. not sure if thats been implemented yet.04:40
mattoliverauthus, the not up to speed part.. I'm been lost in a container sharding rabbit holes for a week or so :(04:41
swifterdarrellmattoliverau: charz: this bug? https://bugs.launchpad.net/swift/+bug/145261904:41
openstackLaunchpad bug 1452619 in OpenStack Object Storage (swift) "object-reconstructor crash in ssync_sender" [Undecided,Confirmed]04:41
mattoliverauswifterdarrell: yeah, that was it :)04:42
*** SkyRocknRoll has joined #openstack-swift04:47
*** SkyRocknRoll has joined #openstack-swift04:47
charzmattoliverau: swifterdarrell thanks, I forgot this bug.04:49
mattoliverau:)04:49
*** haomaiw__ has joined #openstack-swift04:55
*** haomaiwang has quit IRC04:56
*** ptb has joined #openstack-swift05:15
*** ptb has quit IRC05:17
janonymousHi , I am having a trouble , while i am sending a request for PUT. it hangs at read method05:28
janonymousi have debugged but i expects something after completing the content length.05:29
janonymousCould somebody help ?05:29
*** mmcardle has quit IRC05:31
kota_janonymous: Hi05:37
kota_janonymous: you means proxy stopped to read the body from client?05:38
kota_janonymous: (i didn't dig your problem about account header you told me before tho, but i expeted you have already an answer )05:40
janonymousyes , I thought the problem was in ft cleanup on my pc about account header. Thanks .05:42
janonymousi was sending requests on object Port thorugh a sample script. in read call (recv(4, )it is expecting something after reading all content length.05:43
janonymousdoes it expect some lines after sending data of content length.05:43
kota_Though depends on server implementation, AFAIK, default swift with eventlet seems to throw the redundant data tail after content length.05:45
kota_e.g. content length 1005:45
kota_and send 12 bytes05:45
kota_proxy throw away the last 2 bytes and store fist 10 bytes as a corrct object.05:46
kota_Maybe it depends on RFC...05:47
*** haomaiw__ has quit IRC05:51
janonymousThanks,  i will google it more on that.05:56
kota_janonymous: sample is here05:56
*** SkyRocknRoll_ has joined #openstack-swift05:56
janonymousyes please.05:56
kota_janonymous: curl http://<host>/v1/AUTH_swift/replica/sample -H 'X-Auth-Token: <token>' -H 'Content-Length:2' -XPUT -d 'aaaaa' -v05:56
kota_that request could get 201 created but actually stores 2 bytes object 'aa'05:57
*** haomaiwang has joined #openstack-swift05:57
janonymousOhhh... i see05:58
janonymousi'll try to send random data tail now.05:58
kota_janonymous: if you got something more, please let me know the condition (e.g. byte_size, charactor or so), I'll try to make sure on the condition.06:02
janonymousyes. are you sure it is not a particulat string06:03
janonymouslike '\r\n' or so06:06
kota_janonymous: i guess so, because swift can store any binaries...06:11
kota_janonymous: possibly, multipart-MINE expects a delimiter suggested in request header, but...06:13
kota_janonymous: normally we don't use it for single content object PUT request.06:13
janonymousthanks ,this will be helpful.06:14
*** csmart has quit IRC06:15
*** haomaiwang has quit IRC06:18
*** haomaiwa_ has joined #openstack-swift06:19
*** proteusguy has quit IRC06:19
*** Trixboxer has quit IRC06:22
*** proteusguy has joined #openstack-swift06:31
*** ian_brown has quit IRC06:33
*** proteusguy has quit IRC06:36
*** proteusguy has joined #openstack-swift06:38
*** proteusguy has quit IRC06:51
*** proteusguy has joined #openstack-swift06:54
*** slavisa has joined #openstack-swift06:57
*** slavisa has quit IRC07:06
hokota_: I reviewed your japanese subscription on erasure code explanation. Great work!07:10
hokota_: http://paste.openstack.org/show/283256/07:10
hokota_: I wrote some comments in above url.07:10
*** ptb has joined #openstack-swift07:14
*** ptb has quit IRC07:15
*** jordanP has joined #openstack-swift07:22
*** SkyRocknRoll_ has quit IRC07:23
*** SkyRocknRoll_ has joined #openstack-swift07:23
*** geaaru has joined #openstack-swift07:30
*** jistr has joined #openstack-swift07:33
*** silor has quit IRC07:35
*** remix_tj has joined #openstack-swift07:39
*** a1|away has quit IRC07:47
*** krykowski has joined #openstack-swift08:04
*** a1|away has joined #openstack-swift08:07
kota_ho: thx! I'll fix that around weekend as my homework :)08:17
hokota_: you are welcome! I'm really interested in conversation b/w Joe and Clay regarding "Clay's pronunciation for get". :-)08:22
*** acoles_away is now known as acoles08:25
*** jistr has quit IRC08:27
*** ronenkat has quit IRC08:30
*** mmcardle has joined #openstack-swift08:36
*** ronenkat has joined #openstack-swift08:36
*** mmcardle has quit IRC08:42
*** jistr has joined #openstack-swift08:43
*** mmcardle has joined #openstack-swift08:47
*** ptb has joined #openstack-swift09:14
*** ptb has quit IRC09:15
openstackgerritMerged openstack/swift-specs: Add event notification spec  https://review.openstack.org/18091409:16
*** acoles is now known as acoles_away09:17
*** acoles_away is now known as acoles09:17
*** remix_tj has quit IRC09:24
*** ho has quit IRC09:34
*** krzysiekj has joined #openstack-swift09:47
*** krzysiekj has quit IRC09:47
*** SkyRocknRoll has quit IRC10:37
*** mmcardle has quit IRC10:48
openstackgerritJiri Suchomel proposed openstack/swift: Let swift-object-info print information about files in given directory, if directory is provided instead of data file together with --recursive option.  https://review.openstack.org/18925811:01
*** aix has quit IRC11:07
*** openstackgerrit has quit IRC11:13
*** openstackgerrit has joined #openstack-swift11:14
*** ptb has joined #openstack-swift11:14
*** ptb has quit IRC11:15
*** silor has joined #openstack-swift11:34
openstackgerritJiri Suchomel proposed openstack/swift: Let swift-object-info print information about files in given directory, if directory is provided instead of data file together with --recursive option.  https://review.openstack.org/18925811:38
*** jith_ has joined #openstack-swift11:40
*** silor has quit IRC11:51
*** mmcardle has joined #openstack-swift11:57
*** marcusvrn has joined #openstack-swift11:57
*** joeljwright has joined #openstack-swift11:58
*** joeljwright1 has joined #openstack-swift12:03
*** joeljwright has quit IRC12:04
*** km has quit IRC12:07
*** aix has joined #openstack-swift12:09
*** RackerShagz has joined #openstack-swift12:09
jith_hi all, i m trying to install swift in a VM(using SAIO document).. Is it mandatory to install the swift client in the same VM... i m new to swift... i understand that i  have to run the swift code in VM.. but what about swift client??12:25
*** ptb has joined #openstack-swift12:32
*** ptb has quit IRC12:34
*** thurloat_isgone is now known as thurloat12:34
*** kota_ has quit IRC12:42
*** kei_yama has quit IRC12:45
ctennisno swift client does not have to be in the same vm jith_ - it just uses http to communicate12:48
*** fifieldt has quit IRC12:53
*** NM has joined #openstack-swift12:54
*** joeljwright1 has quit IRC12:59
*** petertr7_away is now known as petertr713:00
*** bill_az has joined #openstack-swift13:04
bill_azcschwede:  thanks for the explanation yesterday - very helpful!13:06
*** joeljwright has joined #openstack-swift13:07
*** SkyRocknRoll_ has quit IRC13:07
*** silor has joined #openstack-swift13:10
*** krykowski has quit IRC13:31
*** zhill_desktop has quit IRC13:39
jith_ctennis: thanks13:43
*** wbhuber has joined #openstack-swift14:02
*** breitz has quit IRC14:03
*** breitz has joined #openstack-swift14:03
*** petertr7 is now known as petertr7_away14:06
*** mahatic has joined #openstack-swift14:06
*** petertr7_away is now known as petertr714:06
openstackgerritMark Seger proposed openstack/swift: Assume policy index follows hypen in non-object named object ring  https://review.openstack.org/19064914:11
*** ronenkat has quit IRC14:12
cschwedebill_az: you’re welcome, glad i could help!14:28
*** ptb has joined #openstack-swift14:28
*** ptb has quit IRC14:30
*** ptb has joined #openstack-swift14:37
openstackgerritMerged openstack/swift: Add six requirement  https://review.openstack.org/18949514:38
*** mahatic has quit IRC14:48
*** minwoob has joined #openstack-swift14:49
*** mahatic has joined #openstack-swift14:50
*** mahatic_ has joined #openstack-swift14:53
*** jrichli has joined #openstack-swift14:55
*** mahatic has quit IRC14:55
*** ptb has quit IRC15:03
*** RackerSh_ has joined #openstack-swift15:05
*** mahatic_ has quit IRC15:07
*** RackerSh_ has quit IRC15:07
*** RackerS__ has joined #openstack-swift15:07
*** RackerShagz has quit IRC15:09
*** lcurtis has joined #openstack-swift15:15
*** jistr is now known as jistr|mtg15:17
*** jistr|mtg is now known as jistr15:35
*** thurloat is now known as thurloat_isgone15:35
*** RackerS__ has quit IRC15:35
*** janonymous_ has joined #openstack-swift15:43
*** si1v3r has joined #openstack-swift15:48
*** jordanP has quit IRC15:53
*** haypo has joined #openstack-swift15:56
haypohi. FYI i just wrote https://review.openstack.org/#/c/190700/ "Add a non-voting py34 check job to Swift", it was my action of the meeting yesterday ;-)15:56
*** RackerShagz has joined #openstack-swift15:57
claygnotmyname: should https://bugs.launchpad.net/swift/+bug/1464022 go to a spec - or the ideas page?  launchpad bug doesn't seem like the right place?16:01
openstackLaunchpad bug 1464022 in OpenStack Object Storage (swift) "Container sync does not replicate container metadata" [Undecided,New]16:01
haypoi wrote a small blueprint for cinder, just to write down my plan to port cinder to python 3. should I write a similar blueprint (without spec) for swift? https://blueprints.launchpad.net/cinder/+spec/cinder-python316:04
haypo(well, i can just copy/paste and replace cinder with swift :-))16:04
*** RackerShagz has quit IRC16:04
*** RackerShagz has joined #openstack-swift16:05
*** RackerShagz has quit IRC16:05
*** RackerShagz has joined #openstack-swift16:06
*** fthiagogv has joined #openstack-swift16:08
*** petertr7 is now known as petertr7_away16:22
*** janonymous_ has left #openstack-swift16:24
notmynamegood morning16:31
*** RackerShagz has quit IRC16:33
notmynamehaypo: hey look at that :-) https://review.openstack.org/#/c/190700/16:33
hayponotmyname, yeah, i wrote it :)16:33
*** RackerShagz has joined #openstack-swift16:33
notmynamehaypo: is there a corresponding tox.ini patch in swift?16:34
hayponotmyname, i'm not interested to add a py34 target to tox.ini yet since it's completly broken :)16:34
notmynameso what is the gate-swift-python34 job running?16:35
hayponotmyname, if there is no explicit py34 in tox.ini, tox uses the default testenv16:36
notmynameah ok16:37
notmynamebut doesn't that mean py2?16:37
hayponotmyname, tox is smarter than that ;)16:37
hayponotmyname, py34 will use python3.416:37
notmynameclearly I don't know much about how that works. thanks :-)16:37
haypoi just ran "tox -e py34" in master: tox succeded to create the venv (great!) but nose failed to load tests16:38
*** RackerShagz has quit IRC16:38
haypo  File "/home/haypo/prog/openstack/swift/swift/common/utils.py", line 28, in <module>16:38
haypo    import rfc82216:38
haypoImportError: No module named 'rfc822'16:38
haypoah yes, this email is gone in Python 3. replaced with the email module16:38
*** zhill has joined #openstack-swift16:38
haypooops16:38
haypoi mean, this *module* is gone16:38
notmynameheh. "email is gone". no such luck16:39
hayponotmyname, i mean, we should fix more python3 issues to get a subset of unit tests which pass on python 316:40
hayponotmyname, but just to add a check job, the tox.ini "works"16:40
haypoeven if the output is useless IMO16:41
notmynameok, good to know. thanks16:41
acolesnotmyname: yeah so tox -e py26 still works even though there is no py26 env in tox.ini16:41
hayponotmyname, don't worry, it took me a whole year to understand tox & testr machinery :)16:41
acolesnotmyname: an as haypo says tox -e py34 runs omm16:41
haypoacoles, ah yes, correct. tox has many implicit rules16:41
notmynamemagic! ;-)16:42
acoleswhere 'tox -e py34 runs' means stuff happens then barfs :)16:42
*** ppai has quit IRC16:43
haypoi have to go, bye guys16:43
portantetorgomatic: regarding that non-blocking disk patch, are you still interested in that?16:43
*** fthiagogv has quit IRC16:45
*** haypo has left #openstack-swift16:45
*** fthiagogv has joined #openstack-swift16:46
*** SkyRocknRoll has joined #openstack-swift16:47
*** ronenkat has joined #openstack-swift16:54
*** mmcardle has quit IRC16:57
*** annegentle has joined #openstack-swift17:03
*** ronenkat has quit IRC17:07
*** breitz has quit IRC17:12
*** mmcardle has joined #openstack-swift17:13
*** mmcardle has quit IRC17:14
*** wbhuber has quit IRC17:14
*** joeljwright has quit IRC17:14
*** ronenkat has joined #openstack-swift17:15
*** breitz has joined #openstack-swift17:18
torgomaticportante: I am, but seeing as how it's not actually in the kernel yet, I'm not paying much attention to it17:28
torgomaticI saw ongoing discussion leading up to about March of this year, but I didn't see anything after that17:29
*** acoles is now known as acoles_away17:31
*** petertr7_away is now known as petertr717:35
*** jistr has quit IRC17:35
openstackgerritRoxana Gherle proposed openstack/swift: Keystonemiddleware needs a "project" config option  https://review.openstack.org/19037017:41
portantetorgomatic: I understand that andrew morton, the mmtree maintainer, has some reservations, asking why folks should not consider a "fincore" implementation instead (if I understand what I heard today)17:44
portantemincore like interface but for files17:45
portanteno implementation of that yet, but if we had a compelling use case, with solid numbers, it might make a difference17:45
torgomaticfincore is racy, although I did see someone arguing that the race was rare enough to ignore... I'm too ignorant of kernel MM stuff to have an opinion on if the race is negligible or not17:46
portantefolks interested need to chime in on the thread to make sure folks know there is interest17:46
torgomaticalthough if Swift is going to go server-per-port, then perhaps this isn't necessary. thoughts? cc swifterdarrell17:47
portantetorgomatic: still would be useful there17:47
torgomaticportante: true, but somewhat less so than with server-per-node17:47
portantesure17:48
portantethe hot read case would be served well17:48
torgomaticright, buffercache-read in the main thread and disk-read in a worker thread or two17:49
torgomaticalthough if we're running 3 or 4 object workers per port, then that'll let us have 3 or 4 pending IOs per disk17:50
*** SkyRocknRoll has quit IRC17:52
portantetorgomatic: true18:02
portantebut the other side to consider is what the overhead cost of all those processes running on a box18:02
*** geaaru has quit IRC18:03
portantethe buffercache-read could let us reduce that to a more managable number18:03
*** SkyRocknRoll has joined #openstack-swift18:07
*** annegentle has quit IRC18:14
*** SkyRocknRoll_ has joined #openstack-swift18:17
*** SkyRocknRoll has quit IRC18:17
*** SkyRocknRoll has joined #openstack-swift18:17
*** SkyRocknRoll has joined #openstack-swift18:17
*** annegentle has joined #openstack-swift18:17
*** SkyRocknRoll has joined #openstack-swift18:18
*** SkyRocknRoll has joined #openstack-swift18:18
*** operator99 has quit IRC18:32
*** thurloat_isgone is now known as thurloat18:36
*** gyee has joined #openstack-swift18:41
*** breitz has quit IRC18:44
*** breitz has joined #openstack-swift18:44
*** annegentle has quit IRC18:45
*** NM has quit IRC18:47
*** mjseger has joined #openstack-swift18:49
*** aix has quit IRC18:49
mjsegerclayg: I added a comment to https://review.openstack.org/#/c/190649/ but am wondering if it might be easier to discuss here18:50
*** silor1 has joined #openstack-swift18:52
*** silor has quit IRC18:53
*** ronenkat has quit IRC19:02
*** zaitcev has joined #openstack-swift19:04
*** ChanServ sets mode: +v zaitcev19:04
*** greghaynes has quit IRC19:05
*** ronenkat has joined #openstack-swift19:05
*** greghaynes has joined #openstack-swift19:06
*** NM has joined #openstack-swift19:12
*** annegentle has joined #openstack-swift19:16
*** marcusvrn has quit IRC19:24
*** ronenkat has quit IRC19:30
*** thurloat is now known as thurloat_isgone19:52
*** proteusguy has quit IRC19:54
openstackgerritMichael Barton proposed openstack/swift: go: always asynchronous finalize PUT and DELETE  https://review.openstack.org/19078819:58
*** acampbell has quit IRC19:58
openstackgerritMichael Barton proposed openstack/swift: go: make full disk log message debug-level  https://review.openstack.org/19078920:00
*** silor1 has quit IRC20:00
*** proteusguy has joined #openstack-swift20:09
hurricanerix_torgomatic: Is there a reason SLO allows you to create a manifest of "{}"?  Or is this a bug nobody cares about because it doesn't really hurt anything?20:09
*** NM has quit IRC20:12
*** NM has joined #openstack-swift20:13
notmynamehurricanerix_: meh20:14
notmynamehurricanerix_: :-)20:14
notmynamehurricanerix_: I'd be fine with leaving it or disallowing it. I don't think any devs intended SLO manifests to be empty. but like you said, I don't htink it hurts anything20:15
hurricanerix_notmyname: yeah, I can't see it causing any problems unless there is an expectation somewhere that there is at least one segment.  But as far as I know, there isn't.20:20
*** zhill has quit IRC20:28
*** zhill has joined #openstack-swift20:30
*** zhill has quit IRC20:34
*** zhill has joined #openstack-swift20:37
*** remix_tj has joined #openstack-swift20:40
*** zhill has quit IRC20:41
*** fthiagogv has quit IRC20:43
*** zhill has joined #openstack-swift20:43
*** zhill has quit IRC20:44
*** zhill has joined #openstack-swift20:45
*** annegentle has quit IRC20:45
-openstackstatus- NOTICE: Gerrit has been restarted to terminate a persistent looping third-party CI bot21:07
*** petertr7 is now known as petertr7_away21:11
*** annegentle has joined #openstack-swift21:13
*** vinsh has joined #openstack-swift21:16
*** SkyRocknRoll has quit IRC21:21
*** kutija_ has joined #openstack-swift21:22
*** NM has quit IRC21:22
*** kutija has quit IRC21:25
torgomatichurricanerix_: that sounds pretty much useless to me; if it went away, I wouldn't shed any tears21:26
*** annegentle has quit IRC21:38
*** ian_brown has joined #openstack-swift21:39
*** nadeem has joined #openstack-swift21:54
*** annegentle has joined #openstack-swift22:00
*** sam9987 has joined #openstack-swift22:10
sam9987Is there a date or location for the next hackathon?22:12
*** jrichli has quit IRC22:22
*** annegentle has quit IRC22:23
notmynamesam9987: I'll expect to have some public info about it in the next couple of weeks22:32
openstackgerritJohn Dickinson proposed openstack/swift: do container listing updates in another (green)thread  https://review.openstack.org/18908022:34
mattoliverauMorning22:36
*** thurloat_isgone is now known as thurloat22:52
*** zhill has quit IRC23:00
*** km has joined #openstack-swift23:02
*** amoturi has joined #openstack-swift23:03
*** amoturi has quit IRC23:17
*** kei_yama has joined #openstack-swift23:23
*** annegentle has joined #openstack-swift23:24
*** zhill has joined #openstack-swift23:26
*** annegentle has quit IRC23:29
*** chlong has joined #openstack-swift23:35
claygthis is bs - apple is taking our search juice for "swift developer docs"23:48
*** zhill has quit IRC23:51
*** ho has joined #openstack-swift23:52
hogood morning!23:57

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!