Tuesday, 2014-02-04

MooingLemurthey are in the same container (cyberduck's default of putting them in .file-segments/...00:00
notmynameMooingLemur: can you read the segments normally?00:00
openstackgerritSamuel Merritt proposed a change to openstack/swift: Move all DLO functionality to middleware  https://review.openstack.org/6332600:01
*** mmcardle has quit IRC00:01
*** ekarlso- has joined #openstack-swift00:04
MooingLemurnotmyname: looks like it.  I picked one of the segments, and I was able to get a 200 off of it.   I can also read the manifest with ?multipart-manifest=get unauthenticated00:04
*** mlipchuk has quit IRC00:04
*** matsuhashi has joined #openstack-swift00:12
*** byeager has quit IRC00:23
*** shri has joined #openstack-swift00:27
*** nosnos has joined #openstack-swift00:33
*** nosnos_ has joined #openstack-swift00:44
*** nosnos has quit IRC00:47
*** ekarlso has quit IRC00:50
*** nosnos_ has quit IRC00:54
*** nosnos has joined #openstack-swift00:54
*** dmorita has joined #openstack-swift00:57
*** mmcardle has joined #openstack-swift00:58
*** gyee has quit IRC00:59
*** mmcardle has quit IRC01:02
openstackgerritJon Snitow proposed a change to openstack/swift: Non-blocking but useful improvements to Account ACLs  https://review.openstack.org/6932101:09
*** shri has quit IRC01:49
openstackgerritA change was merged to openstack/swift: Fix container quota MW for handling a bad source path  https://review.openstack.org/5850001:53
*** mmcardle has joined #openstack-swift01:58
*** mmcardle has quit IRC02:03
*** byeager has joined #openstack-swift02:18
openstackgerritSamuel Merritt proposed a change to openstack/swift: Move all DLO functionality to middleware  https://review.openstack.org/6332602:54
*** byeager has quit IRC02:56
*** byeager has joined #openstack-swift02:57
*** mmcardle has joined #openstack-swift02:59
*** mjseger has quit IRC03:00
*** mmcardle1 has joined #openstack-swift03:01
*** mmcardle has quit IRC03:01
*** mmcardle1 has quit IRC03:06
openstackgerritA change was merged to openstack/swift: Add some tests for bin/swift-recon  https://review.openstack.org/6258403:11
*** byeager_ has joined #openstack-swift03:50
*** byeager has quit IRC03:53
*** byeager_ has quit IRC03:59
*** byeager has joined #openstack-swift04:02
*** mmcardle has joined #openstack-swift04:02
*** byeager has quit IRC04:06
*** mmcardle has quit IRC04:06
*** ctennis has quit IRC04:16
*** joearnold has quit IRC04:16
*** swifterdarrell has quit IRC04:16
*** mlanner has quit IRC04:16
*** minnear has quit IRC04:16
*** otherjon has quit IRC04:16
*** zackmdavis has quit IRC04:16
*** amandap has quit IRC04:16
*** hugokuo has quit IRC04:16
*** acorwin has quit IRC04:16
*** koolhead17 has quit IRC04:16
*** anderstj has quit IRC04:16
*** acorwin has joined #openstack-swift04:22
*** minnear has joined #openstack-swift04:22
*** ctennis has joined #openstack-swift04:22
*** swifterdarrell has joined #openstack-swift04:23
*** ChanServ sets mode: +v swifterdarrell04:23
*** hugokuo has joined #openstack-swift04:24
*** joearnold has joined #openstack-swift04:25
*** mlanner has joined #openstack-swift04:26
*** alpha_ori has joined #openstack-swift04:27
*** otherjon has joined #openstack-swift04:28
*** zackmdavis has joined #openstack-swift04:29
*** amandap has joined #openstack-swift04:30
*** anderstj has joined #openstack-swift04:30
*** koolhead17 has joined #openstack-swift04:31
*** mmcardle has joined #openstack-swift05:02
*** mmcardle has quit IRC05:07
*** haomaiwang has quit IRC05:12
*** haomaiwang has joined #openstack-swift05:12
*** nshaikh has joined #openstack-swift05:23
*** mkollaro has joined #openstack-swift05:28
*** ppai has joined #openstack-swift05:43
*** nosnos_ has joined #openstack-swift06:00
*** nosnos has quit IRC06:03
*** mmcardle has joined #openstack-swift06:04
*** mmcardle has quit IRC06:09
*** zaitcev has quit IRC06:26
*** matsuhashi has quit IRC06:33
*** matsuhashi has joined #openstack-swift06:33
*** glange___ has joined #openstack-swift06:34
*** ChanServ sets mode: +v glange___06:34
openstackgerritA change was merged to openstack/swift: Add Requirement for Storage Policy Names  https://review.openstack.org/7049706:35
*** jd__` has joined #openstack-swift06:37
*** nshaikh has quit IRC06:38
*** alpha_ori has quit IRC06:38
*** joearnold has quit IRC06:38
*** acorwin has quit IRC06:38
*** peluse has quit IRC06:38
*** glange has quit IRC06:38
*** zul has quit IRC06:38
*** jd__ has quit IRC06:38
*** krtaylor has quit IRC06:38
*** mordred has quit IRC06:38
*** jd__` is now known as jd__06:38
*** alpha_ori has joined #openstack-swift06:39
*** acorwin has joined #openstack-swift06:40
*** joearnold has joined #openstack-swift06:41
*** zul has joined #openstack-swift06:45
*** nshaikh has joined #openstack-swift06:47
*** mordred has joined #openstack-swift06:54
*** krtaylor has joined #openstack-swift06:59
*** haomaiwa_ has joined #openstack-swift07:02
*** haomaiwang has quit IRC07:04
*** odyssey4me has joined #openstack-swift07:08
*** saju_m has joined #openstack-swift07:12
*** gvernik_ has joined #openstack-swift07:27
openstackgerritGil Vernik proposed a change to openstack/swift: On demand data migration for Swift  https://review.openstack.org/6443007:28
*** bvandenh has joined #openstack-swift08:04
*** mmcardle has joined #openstack-swift08:06
*** mfactor has joined #openstack-swift08:09
*** mmcardle has quit IRC08:11
*** xga has joined #openstack-swift08:11
*** gvernik_ has quit IRC08:12
*** mmcardle has joined #openstack-swift08:30
*** fbo is now known as fbo_away08:32
openstackgerritSascha Peilicke proposed a change to openstack/swift-bench: Sync with global requirements  https://review.openstack.org/6706408:43
*** cschwede has joined #openstack-swift08:49
openstackgerritSteve Kowalik proposed a change to openstack/swift: Drop nose, switching to testtools and testr  https://review.openstack.org/6501408:58
*** gvernik_ has joined #openstack-swift09:04
*** ctennis has quit IRC09:07
*** ctennis has joined #openstack-swift09:07
*** xga has quit IRC09:07
*** foexle has joined #openstack-swift09:09
*** flwang has joined #openstack-swift09:11
flwanghi guys, a question about a commit of swift client, see https://github.com/openstack/python-swiftclient/commit/d34f12614820416aebe5e91eab9726b556d1f97309:11
flwangI'd like to confirm if it's only existed since version 1.6, thanks09:11
flwangin glance, a recent patch is using the parameter 'headers' of get_object, but as you may know, the requirements is requiring version 1.5, the weird thing is we didn't run into any gate issue. Though we're running the issue in internal build server. so I'd like to confirm with you guys about my above question, thanks a lot.09:15
*** xga has joined #openstack-swift09:20
nacimHi everybody, a question about swift s3 plug-in status,09:20
nacimis there any plan for a new release ? last one has more than one year, and later commits fixes many serious bug (regarding url canonicalization for example) ?09:21
*** fbo_away is now known as fbo09:22
flwanganybody can help confirm my above question? thank you so much09:24
*** mlipchuk has joined #openstack-swift09:25
*** gvernik_ has quit IRC09:25
*** nshaikh has left #openstack-swift09:29
*** xga has quit IRC10:08
*** xga has joined #openstack-swift10:19
*** xga_ has joined #openstack-swift10:23
*** xga has quit IRC10:24
*** mkollaro has quit IRC10:42
openstackgerritA change was merged to openstack/swift: Documentation of the logs formats used in Swift  https://review.openstack.org/6434310:47
openstackgerritA change was merged to openstack/swift: Add missing sample config of object-replicator  https://review.openstack.org/6930110:47
*** russellb has joined #openstack-swift11:00
*** mef has joined #openstack-swift11:01
*** mfactor has quit IRC11:03
*** madhuri has quit IRC11:23
*** nshaikh has joined #openstack-swift11:24
*** xga_ has quit IRC11:24
*** nosnos_ has quit IRC11:30
openstackgerritFabien Boucher proposed a change to openstack/swift: Handle COPY verb in container quota middleware  https://review.openstack.org/6118111:31
*** dmorita has quit IRC11:52
*** mfactor_ has joined #openstack-swift12:03
*** mef has quit IRC12:07
*** bada_ has joined #openstack-swift12:21
*** bada has quit IRC12:25
*** xga has joined #openstack-swift12:26
*** mmcardle has quit IRC12:35
*** matsuhashi has quit IRC12:36
*** matsuhashi has joined #openstack-swift12:36
*** matsuhashi has quit IRC12:41
*** Trixboxer has joined #openstack-swift12:49
*** byeager has joined #openstack-swift12:51
*** mmcardle has joined #openstack-swift13:02
openstackgerritChristian Schwede proposed a change to openstack/swift: Add containeralias middleware  https://review.openstack.org/6249413:06
*** byeager has quit IRC13:19
openstackgerritPrashanth Pai proposed a change to openstack/swift: Move common expirer config params to swift.conf  https://review.openstack.org/7097813:22
*** annegentle has joined #openstack-swift13:27
openstackgerritChristian Schwede proposed a change to openstack/python-swiftclient: Add option to skip downloading/uploading identical files  https://review.openstack.org/6547013:29
openstackgerritChristian Schwede proposed a change to openstack/python-swiftclient: Add option to skip downloading/uploading identical files  https://review.openstack.org/6547013:36
*** saju_m has quit IRC13:41
*** nacim has quit IRC13:44
*** ekarlso- has quit IRC13:45
*** ekarlso has joined #openstack-swift13:45
*** nacim has joined #openstack-swift13:50
*** xga has quit IRC14:03
*** xga has joined #openstack-swift14:05
*** tongli has joined #openstack-swift14:07
*** ppai has quit IRC14:11
*** mkollaro has joined #openstack-swift14:18
*** glange___ is now known as glange14:21
chmouelfyi about asyncio/python2 http://article.gmane.org/gmane.comp.cloud.openstack.devel/15807 /cc creiht14:41
*** flwang has left #openstack-swift14:49
*** nshaikh has left #openstack-swift15:03
*** jasondotstar has joined #openstack-swift15:04
openstackgerritpaul luse proposed a change to openstack/swift: Add storage policy support for the Replicator  https://review.openstack.org/5219415:06
cschwedenotmyname: swifterdarrell: torgomatic: chmouel: thanks to all of you for the swift-recon-test review! wanted to discuss this with you in tomorrows meeting, but you were faster :) i will write more tests for the bin-scripts using this way15:24
notmynamecschwede: ya, swifterdarrell and torgomatic set me straight :-)15:25
cschwedenotmyname: i wasn't 100% sure about this, but looks like you all agree so I'm happy :) this makes it much easier for testing. I tried to do some tricks to import from bin, but that didn't feel very pythonic...15:27
notmynamecschwede: ya. everyone wants the existing bin scripts to have better testing. the question was pretty much around where the boilerplate for creating the actual executable script is15:27
*** hurricanerix has joined #openstack-swift15:28
notmynamecschwede: I was arguing for using the same pattern that eg swift-object-server has: boilerplate in a file in bin. swifterdarrell and torgomatic (and your patch) were arguing for doing that in setup.cfg15:28
cschwedenotmyname: the only thing which might be worth for a discussion in the meeting tomorrow is if i should submit a patch for moving all bin/* to swift.cli at once, which is then very easy to review15:29
notmynamecschwede: ya, that would be a good question to bring up15:29
cschwedenotmyname: the other way would be to just move each script when submitting a test for that script15:29
*** peluse has joined #openstack-swift15:30
cschwedenotmyname: ah yes, boilerplating would have been the other way to do this. but both ways need to move most of the code from bin/ to swift.cli (or somewhere else) and i wasn't sure about that15:31
notmynameright. none of us were arguing about that. the majority of the code (ie the full functionality) needs to be moved out of bin. the only question was how to do that15:33
notmynamecschwede: and you can see from my transcript that torgomatic and swifterdarrell tested it out on a couple of different configurations (eg bare precise install, sdist, etc) to see how it worked15:34
cschwedenotmyname: yes, posting the irc logs was very interesting, thanks for that!15:35
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy Support to ssync  https://review.openstack.org/6534715:35
notmynameunfortunately al that happened in our private IRC channel (which is why you didn't see it in here). we were halfway through it before anyone realized we were having a good discussion that should probably be in here. so we kept it in there, and I just copied the transcript15:36
notmynamecschwede: anyway, as chmouel said, it's probably good practice to include those sort of transcripts in gerrit when possible15:37
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy Support to list_endpoints  https://review.openstack.org/6551715:38
chmouelnotmyname:  or a link to the paste that include it :) since mister gerrit and madame formatting are not best buddies15:38
notmynameheh15:38
cschwedenotmyname: ah, ok - unfortunately my irc bouncer just died yesterday evening, and i only noticed it this morning. couldn't see it even if the discussion would have been here ;-)15:39
notmynameah yes. seems that freenode itself was having problems yesterday15:39
notmynameanyway, thanks for the patch. better testing == better swift15:40
notmynamegotta step out for a bit. I'll be around later15:40
*** zanc has quit IRC15:43
*** byeager has joined #openstack-swift15:47
openstackgerritEamonn O'Toole proposed a change to openstack/swift: Parallel object auditor  https://review.openstack.org/5977815:49
openstackgerritpaul luse proposed a change to openstack/swift: Add Storage Policy Support for /Info  https://review.openstack.org/6970016:06
*** mfactor has joined #openstack-swift16:14
*** mfactor_ has quit IRC16:15
*** xga has quit IRC16:20
*** byeager has quit IRC16:20
openstackgerritpaul luse proposed a change to openstack/swift: Replace Policy Index with Policy Name in Response Headers  https://review.openstack.org/7026516:22
*** zaitcev has joined #openstack-swift16:39
*** ChanServ sets mode: +v zaitcev16:39
*** tnewsome has quit IRC16:44
*** mef has joined #openstack-swift17:00
*** mfactor has quit IRC17:04
*** bvandenh has quit IRC17:06
*** gyee has joined #openstack-swift17:10
*** gyee has quit IRC17:11
*** mlipchuk has quit IRC17:12
*** gyee has joined #openstack-swift17:13
*** tnewsome has joined #openstack-swift17:20
*** peluse has quit IRC17:22
*** peluse has joined #openstack-swift17:23
*** jasondotstar has quit IRC17:25
*** jasondotstar has joined #openstack-swift17:44
*** fbo has quit IRC17:46
*** dfg has quit IRC17:46
*** creiht has quit IRC17:46
*** creiht has joined #openstack-swift17:47
*** ChanServ sets mode: +v creiht17:47
*** dfg has joined #openstack-swift17:48
*** peluse has quit IRC17:54
*** peluse has joined #openstack-swift17:55
*** fbo has joined #openstack-swift17:55
*** byeager has joined #openstack-swift17:58
*** bsdkurt1 has quit IRC18:01
*** mfactor_ has joined #openstack-swift18:03
*** nacim has quit IRC18:06
*** mef has quit IRC18:06
*** shri has joined #openstack-swift18:09
*** byeager has quit IRC18:12
*** pberis has joined #openstack-swift18:18
openstackgerritPete Zaitcev proposed a change to openstack/swift: Fix numbering of steps in proxy section of install_multinode  https://review.openstack.org/7105118:22
*** mmcardle has quit IRC18:41
*** byeager has joined #openstack-swift18:43
*** mfactor_ has quit IRC18:47
*** thebloggu has joined #openstack-swift18:48
*** Diddi has joined #openstack-swift18:48
thebloggui have done a careless reboot of all my servers and now my swift cluster is giving me errors like 404 when i try to create a new container. can someone guide me?18:51
*** byeager has quit IRC18:51
*** pheadron has joined #openstack-swift18:51
notmynamethebloggu: I'm hoping you mounted your drives via drive id (or something else stable across reboots). it may be that the drives were auto-mounted at boot in a different order (thus sdb is not sde or something)18:52
thebloggunotmyname: no, i believe the drives are fine18:52
thebloggunotmyname: problem is, for example, i try to create a new container and fives an error saying it couldn't create it, but it does18:53
notmynamethebloggu: hmm..18:54
thebloggunotmyname: and since i don't know even where to start troubleshooting, am asking here for help18:54
shrithebloggu: You can look at syslog on the servers for hints18:54
notmynamethebloggu: first look in the proxy logs to see what's happening there. you may see log messages about difficulty communicating with the backend servers.18:54
thebloggushri: i'm using fedora so i believe they'll be in /var/log/messages?18:55
shriyeah18:57
thebloggui see a lot of openstack2 object-replicator @ERROR: failed to open lock file18:57
theblogguand openstack2 object-replicator Bad rsync return code: 518:57
zaitcevthebloggu: yes, if you didn't edit rsyslog.conf, then everything localN ends in /var/log/messages.18:58
*** byeager has joined #openstack-swift19:02
thebloggunotmyname, shri, zaitcev: i see  lot of Bad rsync return code: 519:02
*** hugokuo has quit IRC19:02
*** swifterdarrell has quit IRC19:03
zaitcevthebloggu: just look into your /srv/node and verify that you mounted the volumes. I know you said "i believe the drives are fine" but they probably are not.19:03
*** amandap has quit IRC19:03
zaitcevthebloggu: I presume you already set SElinux to permissive in /etc/sysconfig/selinux.19:04
*** mlanner has quit IRC19:04
theblogguzaitcev: not really. on the proxy server or all of them?19:04
zaitcevthebloggu: wherever you get the error. Proxy does not typically have volumes of its own, unless you combine functions.19:05
*** mlanner has joined #openstack-swift19:05
theblogguzaitcev: yes, the proxy node has a storage node too19:06
*** swifterdarrell has joined #openstack-swift19:06
*** ChanServ sets mode: +v swifterdarrell19:06
*** hugokuo has joined #openstack-swift19:06
*** amandap has joined #openstack-swift19:07
theblogguzaitcev: it seems it was the selinux19:09
theblogguzaitcev: set enforce 0 on all my machines got it to work19:10
theblogguzaitcev: and yes, i checked and the drives are mounted19:10
zaitcevthebloggu: well, don't forget to make it permanent in /etc/sysconfig/selinux then19:10
*** jasondotstar has quit IRC19:27
*** bsdkurt has joined #openstack-swift19:28
*** Trixboxer has quit IRC19:32
*** Trixboxer has joined #openstack-swift19:32
theblogguzaitcev: already did, thank you very much for the reminder19:33
thebloggunotmyname, shri, zaitcev: thank you for the help!19:33
*** thebloggu has quit IRC19:34
*** pheadron has quit IRC19:44
*** shri has quit IRC19:48
*** fbo is now known as fbo_away19:52
*** bsdkurt has quit IRC20:02
*** jasondotstar has joined #openstack-swift20:09
*** bsdkurt has joined #openstack-swift20:10
*** mlipchuk has joined #openstack-swift20:10
*** foexle has quit IRC20:13
*** odyssey4me has quit IRC20:18
*** kragniz has quit IRC20:24
openstackgerritA change was merged to openstack/swift: Sanify handoff search depth with non-integer replica counts  https://review.openstack.org/6329820:25
openstackgerritA change was merged to openstack/swift: Fix up double mocking of swob.Request.__init__  https://review.openstack.org/7085520:25
*** mlipchuk has quit IRC20:30
openstackgerritA change was merged to openstack/swift: Fix numbering of steps in proxy section of install_multinode  https://review.openstack.org/7105121:01
*** kragniz has joined #openstack-swift21:02
notmynamechmouel: serious questions (because you're the non-native English speaker I know the best in here). are translated logs considered a good thing? seems that would make it terribly difficult to find things online when you are hunting down a problem21:16
openstackgerritChristian Schwede proposed a change to openstack/swift: WIP - Add tests for swift-recon-builder  https://review.openstack.org/7110621:30
chmouelnotmyname: i never configured any of my system in french including phone/tv or other stuff21:32
chmouelmost french people I know are against it21:32
chmoueli think it's just some gov requirement21:32
notmynameit seems to be important to some people on the mailing list and it was mentioned in the team meeting just now21:33
notmynameand the proposed "you can't google for swahili error messages" is "we'll log it in both languages"21:34
notmynamechmouel: thanks21:35
*** pscheie has joined #openstack-swift21:40
pscheieTrying to run 'swift list --insecure' but it's failing, saying 'OpenSSL.SSL.SysCallError: (9, 'Bad file descriptor')'21:44
pscheieApparently, someone else had a similar problem on Jan. 3: http://paste.openstack.org/show/59792/21:45
pscheieI'm running version 1.8.021:46
pscheieAny ideas as to the cause?21:46
pscheieMy colleagues tell me it was working just the other day.21:46
*** gyee has quit IRC21:50
torgomaticzaitcev: looks like your stack trace there; you have any thoughts on this? ^^21:56
zaitcevtorgomatic: looking...21:56
zaitcevpscheie, torgomatic: That trace is not supposed to be happening in current swiftclient. I hit that trace while running tests for the "Verify SSL cert" thing which is now in development. But I suppose if you hit it on stock swiftclient it makes Tristan's burden lighter.21:59
*** jasondotstar has quit IRC22:05
*** pheadron has joined #openstack-swift22:13
*** shri has joined #openstack-swift22:36
*** Trixboxer has quit IRC22:37
*** pheadron has quit IRC22:46
*** bsdkurt has quit IRC22:57
*** mdonohoe has joined #openstack-swift23:25
*** ChanServ sets mode: +v dfg23:26
*** markd has quit IRC23:29
*** tongli has quit IRC23:30
*** byeager has quit IRC23:35
*** byeager has joined #openstack-swift23:36
*** byeager has quit IRC23:45
*** themadcanudist has joined #openstack-swift23:51
themadcanudistguys, on a really busy swift server, why would keystone be pegged at 100%, running an strace i see most calls are on read/write.. (i'm using memcache as well) I would imagine this *shouldn't* be the case23:52
themadcanudistswift cluster , not server.23:52
themadcanudist 50.91    0.004397           0     19822           read23:53
themadcanudist 28.28    0.002442           0     19416           write23:53
portantethemadcanudist: the keystone daemon process?23:53
notmynamethe keystone process is pegged? the swift processes are not?23:53
themadcanudistyeah23:53
themadcanudistthey are *busy*, but keystone is a bottleneck23:53
portante:)23:53
themadcanudistturning logging off helped a LOT, but it's still a bottle neck23:53
themadcanudistis that "normal"?23:53
portanteis it backed by mysql?23:53
notmynameprobably23:53
themadcanudistportante: yes23:54
portantewhat version, master, havana?23:54
portantewhat does mytop report?23:54
portantewhat is the traffic like to your memcache servers?23:54
themadcanudisti have mysql query caching on… it's putting 0 load on server23:54
themadcanudistmysql is not the problem23:55
portantegood23:55
themadcanudistliterally it's sitting idle mostly23:55
themadcanudistsec re: version/memcache23:55
portantek23:55
portanteand what OS version?23:55
*** hurricanerix has quit IRC23:55
themadcanudistlinux kernel 2.6.32-279.14.1.el6.x86_64 / centos 6.323:56
themadcanudistkeystone 2012.2.123:56
themadcanudistmemcache is also mostly idle23:57
portanteso that would be folsom?23:57
themadcanudisti'll get some stats23:57
portantethemadcanudist: k23:57
portantecan you strace the keystone process to see what it is doing?23:57
notmynamehmm..folsom would be bad. it wasn't until grizzly that keystone could use swift's memcache ring23:57
portantenotmyname: yes, that is what I am hoping it is not23:57
themadcanudist=(23:58
portante=)23:58
themadcanudistportante: i did strace -c -p  to profile it, that's what i pasted… you want to know what it's read() write() 'ing?23:58
notmynamethemadcanudist: and do you know what version of swift you're using?23:58
portantepasted?23:58
portanteah, above I see23:58
* themadcanudist nods - swift 1.7.523:59
themadcanudistwhich memcache stat would you want to look at?23:59
themadcanudisti have em all ;)23:59
themadcanudistit looks sane23:59
portantehow many proxy nodes and where is this keystone server in relation to the proxy nodes?23:59
portantethat is folsom23:59

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!