Tag Archive: Ceph

功能描述: 1.目前从k版本开始支持lifecycle，且仅支持Expired，既过期对象删除。 2.AWS4认证下无法进行lifecycle的修改操作，HTTP层面会出现501错误。 3.boto和boto3可以支持AWS2认证下的get和put操作，测试功能可用 4.测试发现先对bucket进行…
Read more

compression功能测试 by_秦牧羊

启动compression 功能描述: 1.目前从k版本开始支持compression，目前支持zlib、snappy、zstd，注意从ceph version 12.0.0开始才加入了zstd插件。 2.注意配置的时候如果设置的插件不存在或者名称错误，则不启用压缩特性。 3.目前压缩特性只对dat…
Read more

Ceph RGW: J以上版本的用户placement设置 by_秦牧羊

功能描述通过设置用户的placement，对不同的bucket指定不同的pool，实现单个zone以pool为单位进行扩容，也可以利用这个特性实现bucket存储介质的差异化配置。配置流程新建一组pool存储index、data和extra数据 [crayon-6418b371bb307262…
Read more

从hammer到jewel的RGW升级实战 by_秦牧羊

初始状态 pool状态

root@demo:/home/demouser# rados lspools
rbd
.cn.rgw.root
.cn-zone1.rgw.root
.cn-zone1.rgw.domain
.cn-zone1.rgw.control
.cn-zone1.rgw.gc
.cn-zone1.rgw.buckets.index
.cn-zone1.rgw.buckets.extra
.cn-zone1.rgw.buckets
.cn-zone1.log
.cn-zone1.intent-log
.cn-zone1.usage
.cn-zone1.users
.cn-zone1.users.email
.cn-zone1.users.swift
.cn-zone1.users.uid

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

root@demo:/home/demouser# rados lspools

rbd

.cn.rgw.root

.cn-zone1.rgw.root

.cn-zone1.rgw.domain

.cn-zone1.rgw.control

.cn-zone1.rgw.gc

.cn-zone1.rgw.buckets.index

.cn-zone1.rgw.buckets.extra

.cn-zone1.rgw.buckets

.cn-zone1.log

.cn-zone1.intent-log

.cn-zone1.usage

.cn-zone1.users

.cn-zone1.users.email

.cn-zone1.users.swift

.cn-zone1.users.uid

ceph.conf配置

[client.radosgw.us-zone1]
     rgw dns name = s3.ceph.work
     rgw frontends = fastcgi
     host = ceph.work
     rgw region = cn
     rgw region root pool = .cn.rgw.root
     rgw zone = us-zone1
     rgw zone root pool = .cn-zone1.rgw.root
     keyring = /etc/ceph/ceph.client.radosgw.keyring
     rgw socket path = /home/ceph/var/run/ceph-client.radosgw.us-zone1.sock
     log file = /home/ceph/log/radosgw.us-zone1.log
     rgw print continue = false
    rgw content length compat = true

1

2

3

4

5

6

7

8

9

10

11

12

13

[client.radosgw.us-zone1]

rgw dns name = s3.ceph.work

rgw frontends = fastcgi

host = ceph.work

rgw region = cn

rgw region root pool = .cn.rgw.root

rgw zone = us-zone1

rgw zone root pool = .cn-zone1.rgw.root

keyring = /etc/ceph/ceph.client.radosgw.keyring

rgw socket path = /home/ceph/var/run/ceph-client.radosgw.us-zone1.sock

log file = /home/ceph/log/radosgw.us-zone1.log

rgw print continue = false

rgw content length compat = true

元数据信息检查

root@demo:/home/demouser# radosgw-admin metadata list user --name client.radosgw.us-zone1
[
    "en-user1",
    "us-zone1",
    "us-user1",
    "cn-user1",
    "en-zone1",
    "cn-zone1",
    "cn-user2"

]
root@demo:/home/demouser# radosgw-admin metadata list bucket --name client.radosgw.us-zone1
[
    "cn-test1",
    "us-test1",
    "en-test1",
    "cn-test2"

]

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

root@demo:/home/demouser# radosgw-admin metadata list user --name client.radosgw.us-zone1

[

"en-user1",

"us-zone1",

"us-user1",

"cn-user1",

"en-zone1",

"cn-zone1",

"cn-user2"

]

root@demo:/home/demouser# radosgw-admin metadata list bucket --name client.radosgw.us-zone1

[

"cn-test1",

"us-test1",

"en-test1",

"cn-test2"

]

软件版本及集群状态 [crayon-6…
Read more

一个因boto支持aws4引发的悲剧故事 by_秦牧羊

环境介绍软件版本

root@demo:/home/demouser# ceph -v
ceph version 10.2.6 (656b5b63ed7c43bd014bcafd81b001959d5f089f)
boto版本:2.46.1

1

2

3

root@demo:/home/demouser# ceph -v

ceph version 10.2.6 (656b5b63ed7c43bd014bcafd81b001959d5f089f)

boto版本:2.46.1

rgw配置

[client.radosgw.cn-zone1]
     rgw dns name = ceph.work
     rgw frontends = fastcgi socket_port=9000 socket_host=127.0.0.1
     host = demo
     keyring = /etc/ceph/ceph.client.radosgw.keyring
     rgw socket path = /home/ceph/var/run/ceph-client.radosgw.cn-zone1.sock
     log file = /home/ceph/log/radosgw.cn-zone1.log
     rgw print continue = false
     rgw content length compat = true

1

2

3

4

5

6

7

8

9

[client.radosgw.cn-zone1]

rgw dns name = ceph.work

rgw frontends = fastcgi socket_port=9000 socket_host=127.0.0.1

host = demo

keyring = /etc/ceph/ceph.client.radosgw.keyring

rgw socket path = /home/ceph/var/run/ceph-client.radosgw.cn-zone1.sock

log file = /home/ceph/log/radosgw.cn-zone1.log

rgw print continue = false

rgw content length compat = true

boto对region支持的一些坑 boto用例

from boto.s3.connection import S3Connection
import boto
import os
os.environ['S3_USE_SIGV4'] = 'True' #启动对aws4的支持

endpoint = 'ceph.work'
bucket_name = 'test1'
access_key = ''
secret_key = ''

conn = boto.connect_s3(
    aws_access_key_id=access_key,
    aws_secret_access_key=secret_key,
    host=endpoint,
    is_secure=False,
    calling_format=boto.s3.connection.SubdomainCallingFormat(),
    validate_certs=True,
)

bucket = conn.get_all_buckets()
print bucket

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

from boto.s3.connection import S3Connection

import boto

import os

os.environ['S3_USE_SIGV4'] = 'True' #启动对aws4的支持

endpoint = 'ceph.work'

bucket_name = 'test1'

access_key = ''

secret_key = ''

conn = boto.connect_s3(

aws_access_key_id=access_key,

aws_secret_access_key=secret_key,

host=endpoint,

is_secure=False,

calling_format=boto.s3.connection.SubdomainCallingFormat(),

validate_certs=True,

)

bucket = conn.get_all_buckets()

print bucket

异常信息 [cray…
Read more