Kubernetes rs与Deployment及Jenkins集成CI-CD
一、rs 控制器(ReplicaSet)
作用:实现 Pod 副本控制,相比 rc 功能更强、更轻量。selector 支持 matchLabels 和 matchExpressions 两种匹配方式。
1. matchLabels:类似 rc 的用法
apiVersion: apps/v1
kind: ReplicaSet
metadata:
name: rs-xiuxian
spec:
replicas: 3
selector:
matchLabels:
apps: xiuxian
template:
metadata:
labels:
apps: xiuxian
version: v1
spec:
containers:
- name: c1
image: registry.cn-hangzhou.aliyuncs.com/demo-k8s/apps:v1
2. matchExpressions:优于 rc 的能力
matchExpressions 可以基于表达式匹配多个标签值:
spec:
replicas: 5
selector:
matchExpressions:
- key: apps
values:
- v1
- v2
- v3
operator: In
template:
metadata:
labels:
apps: v1
school: demo
class: demo-class
operator 取值:
| 操作符 | 含义 |
|---|---|
| In | key 的值必须在 values 列表之中 |
| NotIn | 与 In 相反 |
| Exists | 只要存在该 key 即可,value 任意(可省略 values) |
| DoesNotExist | 不存在该 key,与 Exists 相反(可省略 values) |
上面例子
replicas: 5,但 selector 用In匹配了apps=v1/v2/v3三个既有 Pod,因此 rs 只会再补 2 个新 Pod,使满足条件的 Pod 总数达到 5。
二、deploy 控制器(Deployment)
作用:部署服务。底层调用 rs 控制 Pod 副本数,不直接控制 Pod。相比 rc/rs,Deployment 支持声明式更新。
1. 基于 matchLabels
apiVersion: apps/v1
kind: Deployment
metadata:
name: deloy-xiuxian
spec:
replicas: 3
selector:
matchLabels:
apps: xiuxian
template:
metadata:
labels:
apps: xiuxian
version: v1
spec:
containers:
- name: c1
image: registry.cn-hangzhou.aliyuncs.com/demo-k8s/apps:v2
2. 基于 matchExpressions
和 rs 的用法一致,selector 换成 matchExpressions 即可。
3. 关系验证
kubectl get deploy,rs,pods
每个 Deployment 都会对应一个 ReplicaSet,Pod 名带 rs 的哈希后缀(如 deloy-xiuxian-8676cbd54f-xxxx)。
三、Deployment 升级策略
1. Recreate(重建)
删除所有旧 Pod 再创建新 Pod,会有中断,不推荐。
spec:
strategy:
type: Recreate
replicas: 3
selector:
matchLabels:
apps: xiuxian
template:
metadata:
labels:
apps: xiuxian
version: v1
spec:
containers:
- name: c1
image: registry.cn-hangzhou.aliyuncs.com/demo-k8s/apps:v3
imagePullPolicy: Always
2. RollingUpdate(滚动更新,默认)
逐步替换旧 Pod,平滑升级:
spec:
strategy:
type: RollingUpdate
rollingUpdate:
maxSurge: 2 # 升级过程中最多多出的 Pod 数,支持数字或百分比,默认 25%
maxUnavailable: 1 # 升级过程中最多不可用的 Pod 数,支持数字或百分比,默认 25%
replicas: 5
selector:
matchLabels:
apps: xiuxian
template:
metadata:
labels:
apps: xiuxian
version: v1
spec:
containers:
- name: c1
image: registry.cn-hangzhou.aliyuncs.com/demo-k8s/apps:v2
imagePullPolicy: Always
滚动更新时用 kubectl get pods -w 能看到新旧 Pod 交替:一部分 ContainerCreating、一部分 Terminating,最终全部变成新版本。
四、镜像拉取策略 imagePullPolicy
| 值 | 含义 |
|---|---|
| Never | 本地有镜像才启动,没有也不去远程拉取 |
| IfNotPresent | 本地有就用,没有才去远程拉取 |
| Always | 本地有也会与远程摘要对比,不一致则重新拉取;没有则直接拉取 |
默认策略按 tag 决定:tag 是 latest 时为 Always,非 latest 时为 IfNotPresent。
五、deploy 响应式更新与回滚(kubectl rollout)
# 响应式更新镜像
kubectl set image deploy deloy-xiuxian-update-strategy \
c1=registry.cn-hangzhou.aliyuncs.com/demo-k8s/apps:v3
# 查看历史版本
kubectl rollout history deployment deloy-xiuxian-update-strategy
# 查看当前部署状态
kubectl rollout status deployment deloy-xiuxian-update-strategy
# 暂停 / 恢复更新
kubectl rollout pause deployment deloy-xiuxian-update-strategy
kubectl rollout resume deployment deloy-xiuxian-update-strategy
# 回滚到上一个版本
kubectl rollout undo deployment deloy-xiuxian-update-strategy
# 回滚到指定版本
kubectl rollout undo deployment deloy-xiuxian-update-strategy --to-revision=2
要点:
CHANGE-CAUSE默认显示<none>,除非记录了变更原因;undo到上一个版本会推进 revision 号;--to-revision=N可以回滚到任意历史版本。
六、Ubuntu 部署 Jenkins
参考:Oracle JDK 下载页、pkg.jenkins.io/debian-stable/、清华镜像 mirrors.jenkins-ci.org/。
1. 时区与密钥
ln -svf /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
curl -fsSL https://pkg.jenkins.io/debian-stable/jenkins.io-2023.key | sudo tee \
/usr/share/keyrings/jenkins-keyring.asc > /dev/null
echo deb [signed-by=/usr/share/keyrings/jenkins-keyring.asc] \
https://pkg.jenkins.io/debian-stable binary/ | sudo tee \
/etc/apt/sources.list.d/jenkins.list > /dev/null
2. 安装 JRE(JDK 17)
apt-get update
apt-get -y install fontconfig # 不装 fontconfig 启动会报 NullPointerException
mkdir -pv /demo/softwares
wget http://<下载服务器>/softwares/jenkins/jdk-17_linux-x64_bin.tar.gz
tar xf jdk-17_linux-x64_bin.tar.gz -C /demo/softwares/
写环境变量:
cat > /etc/profile.d/jdk.sh <<'EOF'
export JAVA_HOME=/demo/softwares/jdk-17.0.8
export PATH=$PATH:$JAVA_HOME/bin
EOF
source /etc/profile.d/jdk.sh
java --version
3. 安装 Jenkins
wget http://<下载服务器>/softwares/jenkins/jenkins_2.426.3_all.deb
dpkg -i jenkins_2.426.3_all.deb
修改 /lib/systemd/system/jenkins.service,把用户设为 root 并指定 JAVA_HOME:
User=root
Group=root
Environment="JENKINS_HOME=/var/lib/jenkins"
Environment="JAVA_HOME=/demo/softwares/jdk-17.0.8"
systemctl daemon-reload
systemctl restart jenkins
4. 初始化
cat /var/lib/jenkins/secrets/initialAdminPassword
浏览器访问 Jenkins WebUI,用初始密码登录,按向导安装插件(可跳过)、继续用 admin 账号、配置访问 URL 即可开始使用。
七、Jenkins 基础配置
1. 管理员密码与时区
在系统配置里修改管理员密码和时区(Asia/Shanghai),再用新密码重新登录。
2. 软件源配置
把插件和升级站点换成国内镜像:
sed -i.bak 's#updates.jenkins.io/download#mirror.tuna.tsinghua.edu.cn/jenkins#g' \
/var/lib/jenkins/updates/default.json
sed -i 's#www.google.com#www.baidu.com#g' /var/lib/jenkins/updates/default.json
升级站点 URL 改为:
https://mirror.tuna.tsinghua.edu.cn/jenkins/updates/update-center.json
八、安装 Jenkins 常用插件
常用插件:中文(Localization)、Git、Webhook、Pipeline、Ansible、Email、DingTalk、微信通知、Git Parameter 等。
一键导入:把准备好的插件包解压到 /var/lib/jenkins/plugins/ 后重启:
wget http://<下载服务器>/softwares/jenkins/demo-jenkins211-plugins.tar.gz
tar xf demo-jenkins211-plugins.tar.gz -C /var/lib/jenkins/plugins/
systemctl restart jenkins
## 九、推送代码到 Gitee
### 1. 新建仓库
略(见视频)。
### 2. 模拟开发人员编写代码
```bash
wget http://<下载服务器>/softwares/jenkins/demo-yiliao.zip
mkdir demo-class
apt -y install unzip
unzip demo-yiliao.zip -d demo-class/
cd demo-class/
3. 编写 Dockerfile
FROM registry.cn-hangzhou.aliyuncs.com/demo-k8s/apps:v1
LABEL auther=demo school=demo class=demo-class
EXPOSE 80
WORKDIR /usr/share/nginx/html/
ADD . /usr/share/nginx/html/
4. Git 配置并推送
git config --global user.name "demo"
git config --global user.email "demo@example.com"
git init
git add .
git commit -m 'add dockerfile'
git remote add origin https://gitee.com/demo/demo-class.git
git remote -v
git push -u origin "master"
十、Jenkins 从 Gitee 拉代码并推送镜像
1. 连通性测试
新建自由风格项目,配置 Gitee 仓库信息,加测试命令:
pwd
ls -l ./
立即构建,确认能拉取代码。
2. Jenkins 节点安装 docker
wget http://<下载服务器>/softwares/jenkins/demo-docker-compose-binary-install.tar.gz
tar xf demo-docker-compose-binary-install.tar.gz
./install-docker.sh install
3. 配置 Harbor 客户端
echo 10.0.0.250 harbor.example.com >> /etc/hosts
mkdir -pv /etc/docker/certs.d/harbor.example.com
scp harbor.example.com:/demo/softwares/harbor/certs/docker-client/* \
/etc/docker/certs.d/harbor.example.com
docker login -u admin -p 1 harbor.example.com
4. 构建并推送镜像
Jenkins 构建脚本:
docker image build -t harbor.example.com/demo-jenkins/yiliao:v1 .
docker push harbor.example.com/demo-jenkins/yiliao:v1
十一、Jenkins 一键更新 K8s 应用
1. K8s 部署医疗项目
# 01-ns-yiliao.yaml
apiVersion: v1
kind: Namespace
metadata:
labels:
school: demo
class: demo-class
name: yiliao
# 02-deploy-yiliao.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: deploy-yiliao
namespace: yiliao
spec:
replicas: 3
selector:
matchLabels:
apps: yiliao
template:
metadata:
labels:
apps: yiliao
spec:
containers:
- name: yiliao
image: harbor.example.com/demo-jenkins/yiliao:v1
# 03-svc-yiliao.yaml
apiVersion: v1
kind: Service
metadata:
name: yiliao-svc
namespace: yiliao
spec:
type: NodePort
selector:
apps: yiliao
ports:
- port: 80
targetPort: 80
nodePort: 30080
kubectl apply -f .
kubectl get svc,po -n yiliao
访问 http://10.0.0.233:30080/ 测试。
2. Jenkins 更新 K8s 应用
给 Jenkins 节点装 kubectl 并拷贝证书:
wget http://<下载服务器>/softwares/jenkins/kubectl-1.23.17
mv kubectl-1.23.17 /usr/local/sbin/kubectl
chmod +x /usr/local/sbin/kubectl
mkdir -pv ~/.kube/
scp 10.0.0.231:/root/.kube/config ~/.kube/
Jenkins 脚本:
docker image build -t harbor.example.com/demo-jenkins/yiliao:v3 .
docker push harbor.example.com/demo-jenkins/yiliao:v3
kubectl -n yiliao set image deploy deploy-yiliao \
yiliao=harbor.example.com/demo-jenkins/yiliao:v3
## 十二、Jenkins 参数化构建
### 1. 文本参数
添加文本参数变量 `$version`,脚本:
```bash
docker image build -t harbor.example.com/demo-jenkins/yiliao:$version .
docker push harbor.example.com/demo-jenkins/yiliao:$version
kubectl -n yiliao set image deploy deploy-yiliao \
yiliao=harbor.example.com/demo-jenkins/yiliao:$version
2. 选项参数
添加选项参数变量 $tag,脚本同上,把 $version 换成 $tag 即可。
3. Git 参数化构建
添加 Git Parameter 参数变量 $release(参数类型选「修订」,可按分支或标签构建):
docker image build -t harbor.example.com/demo-jenkins/yiliao:$release .
docker push harbor.example.com/demo-jenkins/yiliao:$release
kubectl -n yiliao set image deploy deploy-yiliao \
yiliao=harbor.example.com/demo-jenkins/yiliao:$release
十三、Jenkins 实现回滚
略(结合 kubectl rollout undo 或构建历史版本镜像再 set image 即可回滚)。
十四、总结
- rs 比 rc 功能强,selector 支持
matchLabels和matchExpressions(In / NotIn / Exists / DoesNotExist); - Deployment 底层调用 rs 控制副本,支持声明式更新,默认滚动更新;
- 升级策略:Recreate 先删后建(有中断),RollingUpdate 逐步替换(
maxSurge/maxUnavailable); - 镜像拉取策略:Never / IfNotPresent / Always,默认由 tag 是否为 latest 决定;
kubectl rollout:history / status / pause / resume / undo / undo --to-revision 用于查看和回滚;- Jenkins 部署要点:JDK 17、fontconfig、root 用户、JAVA_HOME、国内镜像源;
- CI/CD 链路:开发推代码到 Gitee → Jenkins 拉代码构建镜像 → 推 Harbor →
kubectl set image更新 K8s Deployment; - Jenkins 支持文本参数、选项参数、Git 参数化构建,实现按版本发布和回滚。