For docker installation and Harbor warehouse installation, please refer to this link:
https://blog.csdn.net/weixin_43810415/article/details/131142744
1. Overview:
jenkins builds the image and uploads it to harbor
2. Server
| ip | Deploy content |
|---|---|
| 192.168.88.20 | Docker(24.0.2)、Harbor(v2.8.2)、Docker Compose(v2.18.1)、Docker Portainer、Jenkins(2.410) |
3. Install Docker Portainer
docker pull portainer/portainer
docker run -p 9000:9000 -p 8000:8000 --name portainer \
--restart=always \
-v /var/run/docker.sock:/var/run/docker.sock \
-v /mydata/portainer/data:/data \
-d portainer/portainer
Access address: http://192.168.88.20:9000/#/home
4. Use portainer to install Jenkins
4-1. Install jdk and maven on the server
# 下载对应压缩包并上传到服务器/usr/local/java/目录下，解压
tar -zxvf jdk-8u291-linux-x64.tar.gz
tar -zxvf apache-maven-3.9.2-bin.tar.gz
# 编辑环境变量文件
vim /etc/profile
# 输入内容 :wq保存退出
JAVA_HOME=/usr/local/java/jdk1.8.0_291
CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar
PATH=$JAVA_HOME/bin:$PATH
export JAVA_HOME CLASSPATH PATH
export MAVEN_HOME=/usr/local/java/apache-maven-3.9.2
export PATH=${MAVEN_HOME}/bin:${
PATH}
# 使配置生效
source /etc/profile
# 检查是否安装成功
java -version
# 配置maven镜像加速
cd apache-maven-3.9.2/conf/
# 编辑配置文件
vim settings.xml
# mirrors标签内添加以下内容
<mirror>
<id>alimaven</id>
<name>aliyun maven</name>
<url>http://maven.aliyun.com/nexus/content/groups/public/</url>
<mirrorOf>central</mirrorOf>
</mirror>
4-2. Install Jenkins
cd /home
# 创建挂载目录
mkdir jenkins_home
# 赋权限
chmod -R 777 jenkins_home
# 尽量指定新一点且支持jdk1.8的版本下载,尽量不要使用lts，因为有些插件会要求达到某版本才能使用
docker pull jenkins/jenkins:2.410
# 执行命令
#-v /home/jenkins_home:/var/jenkins_home：是对容器内存储Jenkins的一些配置信息的文件夹
#-v /usr/local/java/jdk1.8.0_291:/usr/local/jdk1.8.0_291：是把linux下的jdk和容器内的关联（配置Jenkins时使用）
#-v /usr/local/java/apache-maven-3.9.2:/usr/local/apache-maven-3.9.2：是把linux下的maven和容器内的关联（配置Jenkins时使用）
#-v $(which docker):/usr/bin/docker -v /var/run/docker.sock:/var/run/docker.sock：是可以在Jenkins容器里使用我们Linux下的docker。
docker run -di --name=myJenkins -p 9003:8080 -v /home/jenkins_home:/var/jenkins_home \
-v /usr/local/java/jdk1.8.0_291:/usr/local/jdk1.8.0_291 \
-v /usr/local/java/apache-maven-3.9.2:/usr/local/apache-maven-3.9.2 \
-v $(which docker):/usr/bin/docker \
-v /var/run/docker.sock:/var/run/docker.sock jenkins/jenkins:2.410
4-3. Jenkins configures JDK and maven
4-4. Jenkins downloads related plug-ins
1. Publish Over SSH. The function is to allow connecting to Linux through SSH, and then deploying projects, etc.
2. Deploy to container. The function is to allow deployment to the container after the project is built.
3. Git
4. Gitee
5. Git Parameter. Parametric build requires
4-5. Jenkins configures Gitee credentials
Reference: https://help.gitee.com/devops/connect/Jenkins-Plugin
5. Jenkins builds the image and uploads it to Harbor
5-1 Create pipeline project
The following pipeline script can also create a Jenkinsfile in the project root directory and define an option "Pipeline script from SCM"
5-2 Add a plug-in to the project module pom.xml file that needs to generate an image and create a Dockerfile
# 模块pom.xml添加插件
<build>
<plugins>
<plugin>
<groupId>com.spotify</groupId>
<artifactId>dockerfile-maven-plugin</artifactId>
<version>1.4.13</version>
<configuration>
<repository>${project.artifactId}</repository>
<buildArgs>
<JAR_FILE>target/${project.build.finalName}.jar</JAR_FILE>
</buildArgs>
</configuration>
</plugin>
</plugins>
</build>
# 工程根目录添加Dockerfile文件
#FROM java:8
FROM openjdk:8-jdk-alpine
ARG JAR_FILE
COPY ${JAR_FILE} app.jar
EXPOSE 9000
ENTRYPOINT ["java","-jar","/app.jar"]
5-3 Add harbor credentials
5-4 Jenkinsfile reference
//harbor地址
def harbor_url="192.168.88.20:9002"
//镜像库的名称
def harbor_project="infra"
//Harbor的凭证
def harbor_auth = "9ed86288-cf38-4533-86ca-792b934452f9"
// 镜像
def authImage = "${harbor_url}/${harbor_project}/infra-auth:${env.TAG}"
def businessImage = "${harbor_url}/${harbor_project}/infra-business:${env.TAG}"
def gatewayImage = "${harbor_url}/${harbor_project}/infra-gateway:${env.TAG}"
pipeline {
agent any
tools {
// jenkins全局工具配置配置的maven和jdk
maven 'apache-maven-3.9.2'
jdk 'jdk1.8.0_291'
}
stages {
stage('拉取代码') {
steps {
echo '相关环境变量'
sh "printenv"
echo '-------------------------------------'
git 'https://gitee.com/dalao708/infra.git'
echo '拉取成功'
}
}
stage('清理maven库') {
steps {
dir("${env.WORKSPACE}"){
sh "rm -rf /var/jenkins_home/.m2/repository/com/infra/server/*"
echo '清理maven库完成'
}
}
}
stage('构建基础工程') {
steps {
dir("${env.WORKSPACE}/infra-server"){
sh "mvn -Dmaven.test.skip=true clean install"
//编译，安装公共工程
sh "mvn -f infra-support -Dmaven.test.skip=true clean install"
echo '构建基础工程'
}
}
}
stage('编译&构建镜像') {
steps {
dir("${env.WORKSPACE}/infra-server"){
sh "mvn -f infra-auth -Dmaven.test.skip=true clean package dockerfile:build"
sh "mvn -f infra-business -Dmaven.test.skip=true clean package dockerfile:build"
sh "mvn -f infra-gateway -Dmaven.test.skip=true clean package dockerfile:build"
echo '编译&构建镜像完成'
sh "docker tag infra-auth ${authImage}"
sh "docker tag infra-business ${businessImage}"
sh "docker tag infra-gateway ${gatewayImage}"
echo '镜像打标签完成'
}
}
}
stage('上传Harbor') {
steps {
withCredentials([usernamePassword(credentialsId: "${harbor_auth}", passwordVariable: 'password', usernameVariable: 'username')]) {
//登录到Harbor
sh "docker login -u ${username} -p ${password} ${harbor_url}"
//镜像上传
sh "docker push ${authImage}"
sh "docker push ${businessImage}"
sh "docker push ${gatewayImage}"
sh "echo 镜像上传成功"
//删除本地镜像
sh "docker rmi -f ${authImage}"
sh "docker rmi -f ${businessImage}"
sh "docker rmi -f ${gatewayImage}"
sh "docker rmi -f infra-auth"
sh "docker rmi -f infra-business"
sh "docker rmi -f infra-gateway"
sh "echo 删除本地镜像成功"
}
}
}
}
}
5-5 Build
6. Other questions
1、Caused by: java.util.concurrent.ExecutionException: com.spotify.docker.client.shaded.javax.ws.rs.ProcessingException: java.io.IOException: Permission denied
Solution:
# 修改/var/run/docker.sock文件的权限
chmod 777 /var/run/docker.sock
2、Error response from daemon: Get “https://192.168.88.20:9002/v2/”: http: server gave HTTP response to HTTPS client
Solution:
vim /etc/docker daemon.json
# 这是一个json格式，如何还有其他配置注意格式要求
{
"insecure-registries": ["192.168.88.20:9002"]
}
systemctl daemon-reload
systemctl restart docker
3、Error response from daemon: login attempt to http://192.168.88.20:9002/v2/ failed with status: 502 Bad Gateway
Solution:
cd /usr/local/harbor/
docker compose down -v
docker compose up -d