| *** petertr7_away is now known as petertr7 | 00:00 | |
| *** petertr7 is now known as petertr7_away | 00:09 | |
| openstackgerrit | Merged openstack/swift: Fix Python 3 issues https://review.openstack.org/198088 | 00:37 |
|---|---|---|
| *** jasondotstar has joined #openstack-swift | 00:42 | |
| *** steve_mc has quit IRC | 00:45 | |
| *** rbrooker has quit IRC | 01:01 | |
| *** rbrooker has joined #openstack-swift | 01:10 | |
| *** janonymous_ has quit IRC | 01:25 | |
| *** jasondotstar has quit IRC | 01:40 | |
| *** NM has joined #openstack-swift | 01:56 | |
| *** mutoulbj has joined #openstack-swift | 02:39 | |
| *** mutoulbj has quit IRC | 02:57 | |
| *** thurloat is now known as thurloat_isgone | 03:02 | |
| *** jasondotstar has joined #openstack-swift | 03:49 | |
| *** silor has joined #openstack-swift | 04:15 | |
| *** NM has quit IRC | 04:20 | |
| *** mutoulbj has joined #openstack-swift | 04:23 | |
| *** zaitcev has quit IRC | 04:26 | |
| *** jasondotstar has quit IRC | 04:33 | |
| *** chlong has joined #openstack-swift | 04:35 | |
| *** silor has quit IRC | 05:22 | |
| *** acoles has quit IRC | 05:23 | |
| *** mutoulbj has quit IRC | 05:35 | |
| *** mutoulbj has joined #openstack-swift | 05:49 | |
| *** acoles_away has joined #openstack-swift | 05:50 | |
| *** mutoulbj has quit IRC | 05:50 | |
| *** acoles_away is now known as acoles | 05:50 | |
| *** ChanServ sets mode: +v acoles | 05:50 | |
| *** NM has joined #openstack-swift | 05:54 | |
| *** NM has quit IRC | 05:56 | |
| *** NM has joined #openstack-swift | 06:26 | |
| *** NM has quit IRC | 06:29 | |
| *** fifieldt_ has quit IRC | 06:57 | |
| *** hrou has quit IRC | 07:22 | |
| openstackgerrit | Pradeep Kumar Singh proposed openstack/swift: Read the response body, if response status is greater than 300. https://review.openstack.org/183899 | 07:43 |
| *** proteusguy has quit IRC | 08:06 | |
| *** mutoulbj has joined #openstack-swift | 08:06 | |
| *** mutoulbj has quit IRC | 08:10 | |
| *** proteusguy has joined #openstack-swift | 08:18 | |
| *** chlong has quit IRC | 08:44 | |
| *** jordanP has joined #openstack-swift | 08:50 | |
| *** rvasilets_ has joined #openstack-swift | 09:02 | |
| *** jordanP has quit IRC | 09:19 | |
| *** jasondotstar has joined #openstack-swift | 09:43 | |
| *** jamielennox is now known as jamielennox|away | 10:29 | |
| *** silor has joined #openstack-swift | 10:47 | |
| *** joeljwright has joined #openstack-swift | 11:09 | |
| *** ChanServ sets mode: +v joeljwright | 11:09 | |
| *** rvasilets_ has quit IRC | 11:14 | |
| *** ig0r_ has joined #openstack-swift | 11:15 | |
| *** igor___ has joined #openstack-swift | 11:17 | |
| *** igor___ has quit IRC | 11:47 | |
| *** silor has quit IRC | 12:04 | |
| *** jasondotstar has quit IRC | 12:06 | |
| *** silor has joined #openstack-swift | 12:20 | |
| *** benny__ has quit IRC | 12:47 | |
| *** jasondotstar has joined #openstack-swift | 12:53 | |
| *** chlong has joined #openstack-swift | 13:31 | |
| *** haomaiwang has quit IRC | 13:54 | |
| *** benny_ has joined #openstack-swift | 13:54 | |
| *** acoles has quit IRC | 13:55 | |
| *** si1v3r_ has quit IRC | 13:55 | |
| *** joeljwright1 has joined #openstack-swift | 13:56 | |
| *** joeljwright has quit IRC | 13:58 | |
| *** benny_ has quit IRC | 14:00 | |
| *** acoles_away has joined #openstack-swift | 14:04 | |
| *** acoles_away is now known as acoles | 14:04 | |
| *** ChanServ sets mode: +v acoles | 14:04 | |
| *** haomaiwang has joined #openstack-swift | 14:29 | |
| *** haomaiwang has quit IRC | 14:36 | |
| *** hrou has joined #openstack-swift | 14:39 | |
| *** LeSam has joined #openstack-swift | 14:43 | |
| LeSam | HiHi, | 14:48 |
| LeSam | We have 30 TB of mp4/flv videos manually (rsync) stored and duplicated accross a bunch of servers. We wish to improve this system by using some form of cloud storage. Is swift appropriate for this ? If yes, can it : | 14:48 |
| LeSam | - do pseudo streaming ? (honoring the start parameter) | 14:48 |
| LeSam | - handle 500MB files | 14:48 |
| LeSam | If yes, do you have a good document as a starting point ? It's hard to know what's the most up to date tutorial these days. | 14:48 |
| LeSam | We are only interested by the storage part, not the other tools. Can we use swift without using VM ? | 14:50 |
| *** haomaiwang has joined #openstack-swift | 14:51 | |
| hrou | I've been using swift just in the way you describe i.e. swift standalone (with no other component from openstack) | 14:51 |
| LeSam | cool | 14:52 |
| hrou | There are good instructions here: http://docs.openstack.org/developer/swift/development_saio.html | 14:52 |
| LeSam | thank you, that's very kind | 14:52 |
| LeSam | do you use some load balancer or front to stream your videos ? | 14:53 |
| LeSam | we use nginx, and I wonder how they play together | 14:53 |
| hrou | Technically those instructions are for a virtual machine emulating running a four node Swift cluster. But its easy to adjust the configuration as required. | 14:53 |
| hrou | No, as I'm just playing around for development, but you can ! | 14:54 |
| LeSam | ty | 14:56 |
| hrou | You can probably follow the main installation guide as well (this is for Ubunutu): http://docs.openstack.org/kilo/install-guide/install/apt/content/swift-install-controller-node.html | 14:56 |
| hrou | The only other component you'll see a reference to though is keystone, for an identity provider, but its not necessary | 14:57 |
| *** haomaiwang has quit IRC | 14:58 | |
| *** thurloat_isgone is now known as thurloat | 14:59 | |
| LeSam | will do | 15:01 |
| LeSam | cheers | 15:01 |
| *** joeljwright has joined #openstack-swift | 15:36 | |
| *** ChanServ sets mode: +v joeljwright | 15:36 | |
| *** joeljwright1 has quit IRC | 15:38 | |
| *** joeljwright has quit IRC | 15:39 | |
| notmyname | LeSam: good morning! great questions | 15:46 |
| notmyname | looks like hrou has given you some good places to start | 15:46 |
| LeSam | morning :) | 15:46 |
| *** jasondotstar has quit IRC | 15:46 | |
| notmyname | the SAIO is designed for a dev environment (ie you want to contribute to swift). it's not a great example of a prod cluster. or rather, it's got extra complexity because it simulates 4 servers in one VM | 15:48 |
| notmyname | however, if you do want to set up a dev SAIO, the easiest way is to use https://github.com/swiftstack/vagrant-swift-all-in-one | 15:48 |
| notmyname | the fastest way to set up a prod cluster is probably to use https://swiftstack.com/try-it-now/ (disclosure: that's my employer and the management piece is our product) | 15:49 |
| notmyname | if you want a good overview of the pieces and how they fit together (the open source bits) look at https://swiftstack.com/openstack-swift/ | 15:50 |
| notmyname | here's the upstream multi-server install guides: http://docs.openstack.org/developer/swift/howto_installmultinode.html | 15:50 |
| notmyname | LeSam: please feel free to drop in here and ask any questions as you work through it. there are people in here in all kinds of timezones, so you should be able to find help during someone's working day | 15:52 |
| notmyname | LeSam: and yes, to confirm what hrou said, swift is great for storing and streaming videos | 15:53 |
| notmyname | LeSam: just a question, when you say "honoring the start parameter", what do you mean? | 15:53 |
| *** chlong has quit IRC | 15:53 | |
| notmyname | swift supports range requests, but that's different than "start at this time offset (or start at the last keyframe before this given time offset)" | 15:54 |
| notmyname | depends if you're doing html5-style streaming or RTMP | 15:54 |
| *** haomaiwang has joined #openstack-swift | 15:58 | |
| notmyname | LeSam: so what are you looking to do? | 15:59 |
| LeSam | we got a flash player using making GET /video/url/?start=seconds to a nginx streaming server | 16:01 |
| notmyname | ah, cool | 16:01 |
| notmyname | so using flash streaming with the time offset (start=seconds) | 16:02 |
| notmyname | so your nginx server is translating that to the appropriate byte offset | 16:02 |
| LeSam | probably, it's a anofficial nginx plugin to stream mp4 videos | 16:03 |
| LeSam | i'm guessing some c code read the metadata and make the call | 16:03 |
| notmyname | specifically to stream via rtmp, right? | 16:03 |
| notmyname | you'd still need to have a server-side component to do that time->byte offset translation | 16:03 |
| LeSam | not rtpm, it's pure http | 16:03 |
| LeSam | not real streaming | 16:03 |
| notmyname | http is real streaming ;-) | 16:03 |
| notmyname | so, good news. you can still do that with swift | 16:04 |
| LeSam | that is good news | 16:04 |
| notmyname | bad news is that you can't out-of-the-box with just upstream code | 16:04 |
| notmyname | good news is that others have gone before you and you can stand on their shoulders | 16:04 |
| notmyname | so crunchyroll (the big anime video site) uses swift, and they've got a plugin you can use | 16:05 |
| notmyname | https://github.com/crunchyroll/swiftmp4 | 16:05 |
| notmyname | and they wrote that with the help of one of the swift core devs who is in here (clayg) | 16:06 |
| LeSam | nice | 16:06 |
| notmyname | point is, I think you can get swift to work for you :-) | 16:06 |
| LeSam | Ok, I'll have a look then. I have an appointement so I'm going afk, and I'll be back in 3 hours. Thanks a lot for you help, this is a very friendly community. | 16:06 |
| notmyname | and if you need help, this is the place to ask | 16:06 |
| LeSam | dully noted | 16:06 |
| notmyname | LeSam: happy to help. | 16:06 |
| LeSam | it will depend very much of my boss will to let me spend the proper amount of time on it | 16:07 |
| notmyname | note that today is a US holiday (and the weekend everywhere else). might be quiet-ish in here until monday | 16:07 |
| LeSam | ah right | 16:07 |
| LeSam | bald eagle day :) | 16:07 |
| LeSam | ok, see you around, and thanks again | 16:08 |
| *** thurloat is now known as thurloat_isgone | 16:29 | |
| *** ig0r_ has quit IRC | 16:44 | |
| *** jrichli has joined #openstack-swift | 17:33 | |
| *** jasondotstar has joined #openstack-swift | 17:36 | |
| *** jasondotstar has quit IRC | 18:01 | |
| *** jasondotstar has joined #openstack-swift | 18:08 | |
| *** silor has quit IRC | 18:14 | |
| *** jasondotstar has quit IRC | 18:34 | |
| *** hrou has quit IRC | 19:17 | |
| *** shlee322 has joined #openstack-swift | 20:00 | |
| *** jasondotstar has joined #openstack-swift | 20:09 | |
| *** jasondotstar has quit IRC | 21:11 | |
| *** jasondotstar has joined #openstack-swift | 21:21 | |
| *** rbrooker has quit IRC | 21:23 | |
| *** ChanServ sets mode: +v tdasilva | 21:24 | |
| *** jasondotstar has quit IRC | 21:26 | |
| *** shlee322 has quit IRC | 21:43 | |
| *** LeSam1 has joined #openstack-swift | 22:01 | |
| *** LeSam has quit IRC | 22:01 | |
| *** acoles has quit IRC | 22:08 | |
| *** acoles_away has joined #openstack-swift | 22:10 | |
| *** acoles_away is now known as acoles | 22:10 | |
| *** ChanServ sets mode: +v acoles | 22:10 | |
| openstackgerrit | Janie Richling proposed openstack/swift: Add CORS unit tests to base https://review.openstack.org/198510 | 22:10 |
| *** jrichli has quit IRC | 22:16 | |
| *** LeSam1 has quit IRC | 22:58 | |
| *** sorrison_laptop has joined #openstack-swift | 23:15 | |
| *** sorrison_laptop has quit IRC | 23:29 | |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!