Thursday, 2017-10-26

*** newmember has quit IRC00:00
Chaos_I'm not sure how to do the upload with cURL, from what I understood I had to use the Swift client for the keystone authentication00:02
Chaos_seems to happen with all sizes though. I've tried 10-21GB files00:02
timburkei was thinking particularly small files -- a couple bytes, or even zero bytes :-)00:04
*** chsc has quit IRC00:04
timburkeyou can run `swift auth` to get your token and storage url -- from there you should be able to make requests like `curl -H "X-Auth-Token: $OS_AUTH_TOKEN" $OS_STORAGE_URL`00:05
timburkecreate a container with `curl -H "X-Auth-Token: $OS_AUTH_TOKEN" $OS_STORAGE_URL/container-name -X PUT`00:05
timburkeupload an object with `curl -H "X-Auth-Token: $OS_AUTH_TOKEN" $OS_STORAGE_URL/container-name/object -T /path/to/some/file`00:06
Chaos_Tested a 0B file with that and it worked.. so its just the swift client having issues for some reason?00:15
Chaos_I can't do my larger file with curl so i'd still need the client to work :/00:16
mattoliverauChaos_: you can, but you need to split it up your self, load it up as segments and then create an SLO manifest. But if your having trouble with 10G+ then sounds like something is timing out while uploading maybe.00:18
mattoliveraudo you have a firewall or proxy on your end?00:18
Chaos_Not on my end, this server is just running cPanel00:19
*** abhitechie has joined #openstack-swift00:19
timburkecan you try out something in the 1-5GB range? what segment size are you using for the 10-20GB ones?00:20
timburkeand can we do tiny files with swiftclient?00:21
timburkejust trying to figure out some rough threshold for what works and what doesn't -- i'm glad *something* works! just gotta narrow down what's making it fail :-)00:23
*** links has joined #openstack-swift00:23
*** dja has quit IRC00:28
Chaos_Good news! Segmenting the large file with 1GB segments resolved the issue, i'm able to upload as long as I do that00:28
*** dja has joined #openstack-swift00:29
Chaos_For whatever reason it shows the uploaded file as being 0B but it might just take a few moments for the manifest to update to show the correct size https://i.imgur.com/SzpRS86.png00:29
Chaos_downloading it appears to have the full 25ish GBs00:29
timburketry tacking on a --use-slo flag -- then listings should show the right size00:36
Chaos_Worked perfectly, thank you so much for the hel00:44
Chaos_help*00:44
Chaos_dont know why i didn't think to change the segment size00:44
timburkeno worries! out of curiosity, what was it when it was failing?00:49
Chaos_The default, I didn't explicitly set it00:51
timburkeah... interesting that swift didn't immediately respond with a 413...00:51
*** tovin07_ has joined #openstack-swift00:51
Chaos_Interesting for sure00:52
*** dja has quit IRC01:02
*** dja has joined #openstack-swift01:03
*** Chaos_ has quit IRC01:04
*** klrmn has quit IRC01:06
*** dja has quit IRC01:08
*** tovin07_ has quit IRC01:16
*** peluse has quit IRC01:39
*** psachin has joined #openstack-swift01:41
*** tovin07_ has joined #openstack-swift01:41
openstackgerritjunbo.li proposed openstack/swift master: Make StringIO py3 compatible  https://review.openstack.org/51496201:42
*** wes_dillingham has quit IRC01:49
*** itlinux has joined #openstack-swift01:50
*** gyee has quit IRC01:52
*** spectr has quit IRC02:03
*** spectr has joined #openstack-swift02:04
*** mat128 has joined #openstack-swift02:05
*** peluse has joined #openstack-swift02:05
*** klrmn has joined #openstack-swift02:16
*** Sukhdev has joined #openstack-swift02:20
*** itlinux has quit IRC02:29
*** two_tired has joined #openstack-swift02:30
openstackgerritMerged openstack/swift feature/deep: db_file passed to broker should not affect it's sharding state  https://review.openstack.org/51515002:41
openstackgerritMerged openstack/swift feature/deep: simple tool to display shard relationships  https://review.openstack.org/51432902:42
*** silor has joined #openstack-swift02:43
*** itlinux has joined #openstack-swift02:45
*** itlinux has quit IRC02:48
*** itlinux has joined #openstack-swift02:53
*** silor has quit IRC03:12
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925003:12
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873603:15
*** itlinux has quit IRC03:22
*** kei_yama has quit IRC03:40
*** gkadam has joined #openstack-swift03:42
*** abhitechie has quit IRC03:46
notmynamekota_: so what's the news about SHSS? I didn't understand it03:58
*** kei_yama has joined #openstack-swift04:02
*** catintheroof has joined #openstack-swift04:19
*** catintheroof has quit IRC04:19
*** m_kazuhiro has joined #openstack-swift04:21
*** catintheroof has joined #openstack-swift04:23
*** abhitechie has joined #openstack-swift04:24
*** mat128 has quit IRC04:35
*** SkyRocknRoll has joined #openstack-swift04:38
*** catintheroof has quit IRC04:38
*** catintheroof has joined #openstack-swift04:38
*** m_kazuhiro_ has joined #openstack-swift04:40
*** catintheroof has quit IRC04:43
*** m_kazuhiro has quit IRC04:44
*** two_tired has quit IRC04:54
*** mabrams has joined #openstack-swift05:10
*** ChubYann has quit IRC05:27
*** kallenp has joined #openstack-swift05:29
*** kallenp has quit IRC05:30
*** abhitechie has quit IRC05:33
*** abhitechie has joined #openstack-swift05:33
openstackgerritOpenStack Proposal Bot proposed openstack/python-swiftclient master: Updated from global requirements  https://review.openstack.org/8925005:45
openstackgerritOpenStack Proposal Bot proposed openstack/swift master: Updated from global requirements  https://review.openstack.org/8873605:48
*** geaaru has quit IRC06:01
*** kallenp has joined #openstack-swift06:03
*** cshastri has joined #openstack-swift06:05
*** Sukhdev has quit IRC06:19
*** kallenp has joined #openstack-swift06:24
* kota_ is back to online06:27
*** SkyRocknRoll has quit IRC06:28
*** kallenp has joined #openstack-swift06:37
mattoliveraukota_: \o/ welcome!06:41
*** SkyRocknRoll has joined #openstack-swift06:41
*** abhitechie has quit IRC06:59
*** abhitechie has joined #openstack-swift06:59
*** rcernin has quit IRC07:04
kota_mattoliverau: hi!07:07
*** tesseract has joined #openstack-swift07:09
kota_notmyname: the iso work is by my colleague so I also don't get completely that :/07:11
kota_notmyname: however, the iso docs (for preview) is https://www.iso.org/obp/ui/#iso:std:iso-iec:19592:-2:ed-1:v1:en07:11
kota_notmyname: and our SHSS has been an instance of the standardized secret sharing library IIUC.07:13
kota_about secret sharing, https://en.wikipedia.org/wiki/Secret_sharing07:14
*** kallenp has joined #openstack-swift07:21
* kota_ starts to look up https://review.openstack.org/#/c/499634/3 but feeling he forgets a tons of things to be changed in the patch.07:22
patchbotpatch 499634 - swift - Respect co-builder partition moves when min_part_h...07:22
*** geaaru has joined #openstack-swift07:29
*** m_kazuhiro_ has quit IRC07:42
*** kallenp has quit IRC07:46
*** zhipeng has joined #openstack-swift07:53
*** cbartz has joined #openstack-swift07:58
*** oshritf has joined #openstack-swift08:05
acolesgood morning08:09
*** klrmn has quit IRC08:12
mattoliverauacoles: morning08:13
acolesmattoliverau: o/08:17
*** zhipeng has quit IRC08:18
*** d0ugal has quit IRC08:32
*** d0ugal_ has joined #openstack-swift08:32
*** d0ugal_ has quit IRC08:33
*** d0ugal has joined #openstack-swift08:33
*** d0ugal has quit IRC08:33
*** d0ugal has joined #openstack-swift08:33
kota_acoles: morning08:38
mattoliveraukota_: I just started looking at the same patch.. but think it's simply too late for my brain to work :P (patch 499634)08:44
mattoliverauacoles: ^ is that the same one your were talking about in Denver? Cause from an initial look, it looks familar :)08:45
kota_mattoliverau: hehe, I got back my head to the patch already, I think that looks almost good to me but just thinking of simplification...08:45
mattoliveraukota_: well I'll let you take a first stab, and then I'll try and get my head around it in the morning if it's still around :)08:46
* mattoliverau has decided he's too tired to look at anymore code, so is going to go be a good husband and spend time with the wife :)08:46
acolesmattoliverau: yep, bug in composite ring rebalance08:50
acolesmattoliverau: have a good evening08:50
kota_acoles, mattoliverau: done on patch 49963409:05
patchbothttps://review.openstack.org/#/c/499634/ - swift - Respect co-builder partition moves when min_part_h...09:05
kota_JUST LGTM :)09:06
kota_(after deep thinking but no better idea than current code, awesome!)09:07
acoleskota_: thank you! I appreciate your time reviewing that09:07
kota_acoles: you're welocome, and sorry it's been delayed.09:09
*** HCLTech-SSW has joined #openstack-swift09:12
openstackgerritKazuhiro MIYAHARA proposed openstack/swift master: Symlink implementation.  https://review.openstack.org/23216209:15
*** kallenp has joined #openstack-swift09:17
kota_m_kazuhiro: Is symlink patch ready to review?09:20
kota_m_kazuhiro: Or are you still doing to fix/change something?09:22
*** m_kazuhiro has joined #openstack-swift09:24
m_kazuhirokota_: Symlink patch is ready to review now! Please review it.09:29
openstackgerritHCLTech-SSW proposed openstack/swift master: Added the man page for container-reconciler.conf  https://review.openstack.org/51501809:32
kota_m_kazuhiro: quick question09:34
kota_m_kazuhiro: perhaps, does the change include almost of my follow-up at https://review.openstack.org/#/c/509149 ? not sure if all things are adrressed or not.09:35
patchbotpatch 509149 - swift - Follow up for symlink implementaion09:35
m_kazuhirokota_: Yes. Your follow-up is included.09:36
*** kallenp has quit IRC09:36
kota_m_kazuhiro: all things? can i abondon it?09:36
m_kazuhirokota_: Yes, all things. You can abondon it.09:37
kota_m_kazuhiro: thx09:37
openstackgerritKota Tsuyuzaki proposed openstack/swift master: Fix a small typo  https://review.openstack.org/51533509:43
*** kallenp has joined #openstack-swift09:44
*** m_kazuhiro has quit IRC09:52
*** hseipp has joined #openstack-swift09:55
*** tovin07_ has quit IRC10:04
*** kei_yama has quit IRC10:13
*** kallenp1 has joined #openstack-swift10:13
*** kallenp has quit IRC10:17
*** abhitechie has quit IRC10:18
*** abhitechie has joined #openstack-swift10:26
*** kallenp has joined #openstack-swift10:28
*** kallenp has left #openstack-swift10:30
*** kallenp1 has quit IRC10:30
openstackgerritMerged openstack/swift master: Fix a small typo  https://review.openstack.org/51533510:55
*** HCLTech-SSW has quit IRC11:00
kota_thx acoles :)11:06
*** abhinavtechie has joined #openstack-swift11:07
*** abhinavtechie has quit IRC11:08
*** abhitechie has quit IRC11:08
*** abhitechie has joined #openstack-swift11:09
*** oshritf has quit IRC11:11
*** oshritf has joined #openstack-swift11:12
*** bkopilov_ has quit IRC11:28
*** links has quit IRC11:36
*** portante has quit IRC11:38
*** ndk_ has quit IRC11:38
*** oshritf has quit IRC11:40
*** NM has joined #openstack-swift11:40
*** ndk_ has joined #openstack-swift11:44
*** portante has joined #openstack-swift11:44
*** oshritf has joined #openstack-swift11:46
*** oshritf has quit IRC11:49
*** oshritf has joined #openstack-swift11:51
*** wes_dillingham has joined #openstack-swift12:11
*** ukaynar has joined #openstack-swift12:26
kota_m_kazuhiro: it looks like you squashed up my buggy code as it is. please let me take a time to resolve it for a while. I have to leave my office today.12:49
*** mvk has quit IRC12:52
*** oshritf has quit IRC13:02
*** oshritf has joined #openstack-swift13:08
*** abhitechie has quit IRC13:12
*** oshritf has quit IRC13:17
*** oshritf has joined #openstack-swift13:21
*** mat128 has joined #openstack-swift13:24
*** gkadam_ has joined #openstack-swift13:26
*** gkadam has quit IRC13:27
*** SkyRocknRoll has quit IRC13:32
*** mvk has joined #openstack-swift13:32
*** oshritf has quit IRC13:35
*** gkadam_ has quit IRC13:37
*** mjturek has joined #openstack-swift13:38
*** oshritf has joined #openstack-swift13:40
*** catintheroof has joined #openstack-swift13:45
*** catintheroof has quit IRC13:46
*** catintheroof has joined #openstack-swift13:46
*** dosaboy has quit IRC13:48
*** catinthe_ has joined #openstack-swift13:52
*** catintheroof has quit IRC13:55
*** dosaboy has joined #openstack-swift14:00
*** rcernin has joined #openstack-swift14:08
*** catinthe_ has quit IRC14:17
*** catintheroof has joined #openstack-swift14:17
*** newmember has joined #openstack-swift14:25
*** ukaynar has quit IRC14:36
*** cshastri has quit IRC14:45
*** ianychoi_ has joined #openstack-swift14:45
*** ianychoi has quit IRC14:48
*** oshritf has quit IRC14:56
*** oshritf has joined #openstack-swift14:57
*** spectr has quit IRC15:02
*** gkadam_ has joined #openstack-swift15:02
*** rcernin has quit IRC15:04
*** klrmn has joined #openstack-swift15:07
*** newmember has quit IRC15:19
*** newmember has joined #openstack-swift15:19
*** catintheroof has quit IRC15:20
*** catintheroof has joined #openstack-swift15:20
*** catintheroof has quit IRC15:25
*** vint_bra has joined #openstack-swift15:36
*** mabrams has quit IRC15:38
*** mvk has quit IRC15:39
*** itlinux has joined #openstack-swift15:39
*** spetersen has joined #openstack-swift15:43
*** gyee has joined #openstack-swift15:43
spetersenI am stuck in a 100% disk full situation, I have added more drives to the three nodes but the drives are not emptying.15:44
spetersenIs this a setting I should entertain?  handoffs_first = False15:44
spetersenIs this a setting I should entertain?  handoffs_first = True15:44
spetersenWe increased the concurrency for the object-replicator and the max number of rsync connections for object server15:46
*** catintheroof has joined #openstack-swift15:51
*** catintheroof has quit IRC15:55
*** geaaru has quit IRC15:55
*** catintheroof has joined #openstack-swift16:01
*** HCLTech-SSW has joined #openstack-swift16:08
*** psachin has quit IRC16:17
notmynamegood morning16:20
*** cbartz has quit IRC16:21
*** hseipp has quit IRC16:22
*** cbartz has joined #openstack-swift16:25
*** silor has joined #openstack-swift16:26
*** silor has quit IRC16:35
*** cbartz has quit IRC16:36
timburkegood morning16:42
*** HCLTech-SSW has quit IRC16:51
*** mvk has joined #openstack-swift16:54
*** chsc has joined #openstack-swift16:57
*** chsc has joined #openstack-swift16:57
*** saint_ has joined #openstack-swift17:02
*** oshritf has quit IRC17:20
*** newmember has quit IRC17:33
*** gkadam_ has quit IRC17:40
*** tesseract has quit IRC17:45
*** newmember has joined #openstack-swift17:50
*** catintheroof has quit IRC18:13
*** Sukhdev has joined #openstack-swift18:25
*** Sukhdev has quit IRC18:33
*** saint_ has quit IRC18:35
*** SkyRocknRoll has joined #openstack-swift18:35
*** SkyRocknRoll has quit IRC18:41
*** catintheroof has joined #openstack-swift18:51
*** SkyRocknRoll has joined #openstack-swift18:55
*** catintheroof has quit IRC18:56
*** catintheroof has joined #openstack-swift19:05
*** catintheroof has quit IRC19:09
*** wes_dillingham has quit IRC19:19
*** ChubYann has joined #openstack-swift19:23
*** ChubYann has left #openstack-swift19:23
*** catintheroof has joined #openstack-swift19:28
*** SkyRocknRoll has quit IRC19:34
*** spetersen_ has joined #openstack-swift19:39
*** spetersen_ has quit IRC19:39
*** newmember has quit IRC20:28
*** NM has quit IRC20:40
*** catintheroof has quit IRC20:49
*** mat128 has quit IRC21:03
*** spetersen has quit IRC21:44
*** wes_dillingham has joined #openstack-swift22:11
*** itlinux has quit IRC22:39
*** thurloat has quit IRC22:46
*** mjturek has quit IRC22:52
*** vint_bra has quit IRC23:03
*** kei_yama has joined #openstack-swift23:33
*** abhitechie has joined #openstack-swift23:34
*** chsc has quit IRC23:35
*** links has joined #openstack-swift23:46
*** gkadam_ has joined #openstack-swift23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!