技术文档

功能描述: 1.目前从k版本开始支持lifecycle，且仅支持Expired，既过期对象删除。 2.AWS4认证下无法进行lifecycle的修改操作，HTTP层面会出现501错误。 3.boto和boto3可以支持AWS2认证下的get和put操作，测试功能可用 4.测试发现先对bucket进行…
Read more

compression功能测试 by_秦牧羊

启动compression 功能描述: 1.目前从k版本开始支持compression，目前支持zlib、snappy、zstd，注意从ceph version 12.0.0开始才加入了zstd插件。 2.注意配置的时候如果设置的插件不存在或者名称错误，则不启用压缩特性。 3.目前压缩特性只对dat…
Read more

Ceph RGW: J以上版本的用户placement设置 by_秦牧羊

功能描述通过设置用户的placement，对不同的bucket指定不同的pool，实现单个zone以pool为单位进行扩容，也可以利用这个特性实现bucket存储介质的差异化配置。配置流程新建一组pool存储index、data和extra数据 [crayon-6418a4107b35f205…
Read more

从hammer到jewel的RGW升级实战 by_秦牧羊

初始状态 pool状态

root@demo:/home/demouser# rados lspools
rbd
.cn.rgw.root
.cn-zone1.rgw.root
.cn-zone1.rgw.domain
.cn-zone1.rgw.control
.cn-zone1.rgw.gc
.cn-zone1.rgw.buckets.index
.cn-zone1.rgw.buckets.extra
.cn-zone1.rgw.buckets
.cn-zone1.log
.cn-zone1.intent-log
.cn-zone1.usage
.cn-zone1.users
.cn-zone1.users.email
.cn-zone1.users.swift
.cn-zone1.users.uid

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

root@demo:/home/demouser# rados lspools

rbd

.cn.rgw.root

.cn-zone1.rgw.root

.cn-zone1.rgw.domain

.cn-zone1.rgw.control

.cn-zone1.rgw.gc

.cn-zone1.rgw.buckets.index

.cn-zone1.rgw.buckets.extra

.cn-zone1.rgw.buckets

.cn-zone1.log

.cn-zone1.intent-log

.cn-zone1.usage

.cn-zone1.users

.cn-zone1.users.email

.cn-zone1.users.swift

.cn-zone1.users.uid

ceph.conf配置

[client.radosgw.us-zone1]
     rgw dns name = s3.ceph.work
     rgw frontends = fastcgi
     host = ceph.work
     rgw region = cn
     rgw region root pool = .cn.rgw.root
     rgw zone = us-zone1
     rgw zone root pool = .cn-zone1.rgw.root
     keyring = /etc/ceph/ceph.client.radosgw.keyring
     rgw socket path = /home/ceph/var/run/ceph-client.radosgw.us-zone1.sock
     log file = /home/ceph/log/radosgw.us-zone1.log
     rgw print continue = false
    rgw content length compat = true

1

2

3

4

5

6

7

8

9

10

11

12

13

[client.radosgw.us-zone1]

rgw dns name = s3.ceph.work

rgw frontends = fastcgi

host = ceph.work

rgw region = cn

rgw region root pool = .cn.rgw.root

rgw zone = us-zone1

rgw zone root pool = .cn-zone1.rgw.root

keyring = /etc/ceph/ceph.client.radosgw.keyring

rgw socket path = /home/ceph/var/run/ceph-client.radosgw.us-zone1.sock

log file = /home/ceph/log/radosgw.us-zone1.log

rgw print continue = false

rgw content length compat = true

元数据信息检查

root@demo:/home/demouser# radosgw-admin metadata list user --name client.radosgw.us-zone1
[
    "en-user1",
    "us-zone1",
    "us-user1",
    "cn-user1",
    "en-zone1",
    "cn-zone1",
    "cn-user2"

]
root@demo:/home/demouser# radosgw-admin metadata list bucket --name client.radosgw.us-zone1
[
    "cn-test1",
    "us-test1",
    "en-test1",
    "cn-test2"

]

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

root@demo:/home/demouser# radosgw-admin metadata list user --name client.radosgw.us-zone1

[

"en-user1",

"us-zone1",

"us-user1",

"cn-user1",

"en-zone1",

"cn-zone1",

"cn-user2"

]

root@demo:/home/demouser# radosgw-admin metadata list bucket --name client.radosgw.us-zone1

[

"cn-test1",

"us-test1",

"en-test1",

"cn-test2"

]

软件版本及集群状态 [crayon-6…
Read more

一个因boto支持aws4引发的悲剧故事 by_秦牧羊

环境介绍软件版本

root@demo:/home/demouser# ceph -v
ceph version 10.2.6 (656b5b63ed7c43bd014bcafd81b001959d5f089f)
boto版本:2.46.1

1

2

3

root@demo:/home/demouser# ceph -v

ceph version 10.2.6 (656b5b63ed7c43bd014bcafd81b001959d5f089f)

boto版本:2.46.1

rgw配置

[client.radosgw.cn-zone1]
     rgw dns name = ceph.work
     rgw frontends = fastcgi socket_port=9000 socket_host=127.0.0.1
     host = demo
     keyring = /etc/ceph/ceph.client.radosgw.keyring
     rgw socket path = /home/ceph/var/run/ceph-client.radosgw.cn-zone1.sock
     log file = /home/ceph/log/radosgw.cn-zone1.log
     rgw print continue = false
     rgw content length compat = true

1

2

3

4

5

6

7

8

9

[client.radosgw.cn-zone1]

rgw dns name = ceph.work

rgw frontends = fastcgi socket_port=9000 socket_host=127.0.0.1

host = demo

keyring = /etc/ceph/ceph.client.radosgw.keyring

rgw socket path = /home/ceph/var/run/ceph-client.radosgw.cn-zone1.sock

log file = /home/ceph/log/radosgw.cn-zone1.log

rgw print continue = false

rgw content length compat = true

boto对region支持的一些坑 boto用例

from boto.s3.connection import S3Connection
import boto
import os
os.environ['S3_USE_SIGV4'] = 'True' #启动对aws4的支持

endpoint = 'ceph.work'
bucket_name = 'test1'
access_key = ''
secret_key = ''

conn = boto.connect_s3(
    aws_access_key_id=access_key,
    aws_secret_access_key=secret_key,
    host=endpoint,
    is_secure=False,
    calling_format=boto.s3.connection.SubdomainCallingFormat(),
    validate_certs=True,
)

bucket = conn.get_all_buckets()
print bucket

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

from boto.s3.connection import S3Connection

import boto

import os

os.environ['S3_USE_SIGV4'] = 'True' #启动对aws4的支持

endpoint = 'ceph.work'

bucket_name = 'test1'

access_key = ''

secret_key = ''

conn = boto.connect_s3(

aws_access_key_id=access_key,

aws_secret_access_key=secret_key,

host=endpoint,

is_secure=False,

calling_format=boto.s3.connection.SubdomainCallingFormat(),

validate_certs=True,

)

bucket = conn.get_all_buckets()

print bucket

异常信息 [cray…
Read more

Ceph China 小编 2017-03-02 0 Comments

测试 Kraken 版 BlueStore

本文由Ceph中国社区-徐小胖翻译、Ceph中国社区-luokexue校稿英文出处：Testing Ceph BlueStore with the Kraken release 欢迎加入CCTG Ceph Kraken(11.2.0) 版本已经发布，版本说明告诉我们新的 OSD 后端 B…
Read more

技术文档, 翻译

从传统运维到云运维演进历程之软件定义存储（四）

Ceph China 小编 2016-10-21 0 Comments

前面系列已经讲完了硬件选型、部署、调优，在上线之前呢需要进行性能存储测试，本章主要讲述下测试Ceph的几种常用工具，以及测试方法。关卡四：性能测试关卡难度：四颗星说起存储性能永远是第一重要的问题。关于性能有以下几个指标：带宽（Bandwidth）、IOPS、顺序（Sequenti…
Read more

Ceph China 小编 2016-10-12 0 Comments

从传统运维到云运维演进历程之软件定义存储（三）下

上回书讲到了运维小哥的调优方法论（上），对于Ceph运维人员来说最头痛的莫过于两件事：一、Ceph调优；二、Ceph运维。调优是件非常头疼的事情，下面来看看运维小哥是如何调优的。关卡二：部署调优关之调优（二）难度：五颗星优化方法论通过对网上公开资料的分析进行总结，对Ceph的优化离不开以下几…
Read more

Ceph China 小编 2016-10-08 0 Comments

Swift vs Ceph for OpenStack object storage

Both Swift and Ceph are open source, object storage systems. But despite their similarities, there are differences to consider when choosing one for O…
Read more

技术文档, 翻译

从传统运维到云运维演进历程之软件定义存储（三）上

Ceph China 小编 2016-09-30 0 Comments

上回书讲完了部署，部署完成之后，就开始了无休止的调优，对于Ceph运维人员来说最头痛的莫过于两件事：一、Ceph调优；二、Ceph运维。调优是件非常头疼的事情，下面来看看运维小哥是如何调优的，运维小哥根据网上资料进行了一个调优方法论（调优总结）。关卡三：部署调优关之调优（一）难度：五颗星优化方…
Read more