当前位置:首页 > 技术分析 > 正文内容

如何使用Github Action来自动化编译PolarDB-PG数据库

随着PolarDB在国产数据库领域荣膺桂冠并持续获得广泛认可,越来越多的学生和技术爱好者开始关注并涉足这款由阿里巴巴集团倾力打造且性能卓越的关系型云原生数据库。有很多同学想要上手尝试,却卡在了编译数据库这一关,下面介绍一种通过Github Action来自动化编译PolarDB数据库的方法,帮助大家快速编译可以在多个平台运行的PolarDB数据库。

准备工作

首先需要注册一个github账号,然后访问PolarDB-PG的github官方仓库,点击右上角的Fork,稍等片刻后,就可以在自己的账号下看到一个Fork的仓库。

切换到Fork的仓库后,把他克隆到本地,在本地执行下面的命令来从POLARDB_11_STABLE创建一个新的分支xxx

cd PolarDB-for-PostgreSQL
git checkout POLARDB_11_STABLE
git checkout -b xxx
git push -u origin xxx

配置Github Action

首先cd到本地仓库所在目录,切换到之前创建的新分支xxx,然后在.github/workflows目录下创建一个yml文件

cd PolarDB-for-PostgreSQL
git checkout xxx
vim .github/workflows/release-polardb.yml

yml文件内容如下

name: Csuopen Release PolarDB
on:
  push:
    tags:
      - b*
jobs:
  build_polardb_and_pfs_on_centos7:
    runs-on: ubuntu-latest
    container:
      image: polardb/polardb_pg_devel:centos7
      options: --entrypoint /bin/bash --user root
    steps:
      - name: Get the polardb version
        id: get_version
        run: echo "::set-output name=VERSION::${GITHUB_REF#refs/tags/}"
      - name: Build ZLog
        run: |
          mkdir /tmp/zlog_build
          cd /tmp
          wget https://github.com/HardySimpson/zlog/archive/refs/tags/1.2.16.tar.gz -O /tmp/zlog-1.2.16.tar.gz
          tar -xzf zlog-1.2.16.tar.gz
          cd zlog-1.2.16
          make && make install
          cp /usr/local/include/zlog.h /tmp/zlog_build
          cp /usr/local/bin/zlog-chk-conf /tmp/zlog_build
          cp /usr/local/lib/libzlog.so.1.2 /tmp/zlog_build/libzlog.so
          cp /usr/local/lib/libzlog.a /tmp/zlog_build
      - name: Build PFS
        run: |
          source /etc/bashrc
          mkdir /tmp/pfs_build
          cd /tmp
          wget https://github.com/ApsaraDB/PolarDB-FileSystem/archive/refs/tags/pfsd4pg-release-1.2.42-20220419.tar.gz -O /tmp/pfsd4pg-release-1.2.42-20220419.tar.gz
          tar -xzf pfsd4pg-release-1.2.42-20220419.tar.gz
          cd PolarDB-FileSystem-pfsd4pg-release-1.2.42-20220419
          ./autobuild.sh
          cp -r bin /tmp/pfs_build
          cp -r conf /tmp/pfs_build
          cp -r deploy_scripts /tmp/pfs_build
          cp -r etc /tmp/pfs_build
          cp -r install.sh /tmp/pfs_build
          cp -r lib /tmp/pfs_build
          cp -r src /tmp/pfs_build
          cp -r uninstall.sh /tmp/pfs_build
      - name: Build openSSL
        run: |
          mkdir /tmp/dependencies
          cd /tmp
          wget https://github.com/openssl/openssl/releases/download/OpenSSL_1_1_1w/openssl-1.1.1w.tar.gz -O /tmp/openssl-1.1.1w.tar.gz
          tar -xzf openssl-1.1.1w.tar.gz
          cd openssl-1.1.1w
          ./config --prefix=/usr/local/openssl --openssldir=/usr/local/openssl
          make && make install
          cp ./libssl.so.1.1 /tmp/dependencies
          cp ./libcrypto.so.1.1 /tmp/dependencies
          cp /lib64/libxerces-c-3.1.so /tmp/dependencies
      - name: Checkout
        uses: actions/checkout@v2
        with:
          ref: ${{ github.ref }}
      - name: Build PolarDB
        run: |
          source /etc/bashrc
          mkdir /tmp/polardb_build

          ./polardb_build.sh --basedir=/tmp/polardb_build --with-pfsd --withpx --noinit
          cd /tmp
          tar -cf polardb.tar polardb_build
      - name: Write install script
        run: |
          cat << 'EOF' > /tmp/install.sh
          #!/bin/bash

          date=$(date +%Y%m%d)
          basePath=$(cd `dirname $0`; pwd)
          dependence_path=$basePath/dependencies

          cd $dependence_path
          echo "copy依赖libssl.so.1.1和libcrypto.so.1.1"
          if [ ! -e "/usr/polardb/lib/libssl.so.1.1" ];then
              cp libs/libssl.so.1.1 /usr/polardb/lib
          fi
          if [ ! -e "/usr/polardb/lib/libcrypto.so.1.1" ];then
              cp libs/libcrypto.so.1.1 /usr/polardb/lib
          fi
          if [ ! -e "/usr/polardb/lib/libxerces-c-3.1.so" ];then
              cp libs/libxerces-c-3.1.so /usr/polardb/lib/libxerces-c-3.1.so
          fi


          echo "安装zlog"
          cd $dependence_path/zlog-1.2.16
          if [ ! -e "/usr/local/include/zlog.h" ];then
              mkdir -p /usr/local/include /usr/local/lib /usr/local/bin
              cp -a zlog.h /usr/local/include
              cp -a zlog-chk-conf /usr/local/bin
              cp -a libzlog.so /usr/local/lib/libzlog.so.1.2
              cp -a libzlog.a /usr/local/lib
              cd /usr/local/lib && ln -sf libzlog.so.1.2 libzlog.so.1
              cd /usr/local/lib && ln -sf libzlog.so.1 libzlog.so
          fi

          echo '/usr/local/lib' >> '/etc/ld.so.conf'
          ldconfig

          echo "安装pfs"
          cd $dependence_path
          if [ ! -e '/usr/local/bin/pfs' ];then
              cd $dependence_path/pfs-1.2.42
              ./install.sh
          fi

          echo "安装polardb"
          cd /usr
          if [ -d /usr/polardb ]
          then
              echo "重命名/usr下的旧版本polardb为polardb_bak_$date"
              mv polardb polardb_bak_$date
          fi
          mkdir polardb

          cd $basePath
          tar xkf polardb.tar -C /usr/polardb --strip-components=1 >> /dev/null
          echo "Polardb安装完成"
          EOF
      - name: Tar PolarDB
        run: |
          mkdir -p /tmp/polardb_tar/dependencies
          cp /tmp/polardb.tar /tmp/polardb_tar
          cp -r /tmp/zlog_build /tmp/polardb_tar/dependencies/zlog-1.2.16
          cp -r /tmp/pfs_build /tmp/polardb_tar/dependencies/pfs-1.2.42
          cp -r /tmp/dependencies /tmp/polardb_tar/dependencies/libs
          cp /tmp/install.sh /tmp/polardb_tar
          chmod +x /tmp/polardb_tar/install.sh
          cd /tmp
          tar -cf polardb-${{ steps.get_version.outputs.VERSION }}-el7.tar polardb_tar
          xz polardb-${{ steps.get_version.outputs.VERSION }}-el7.tar
      - name: Upload artifact
        uses: actions/upload-artifact@v2
        with:
          name: polardb-${{ steps.get_version.outputs.VERSION }}
          path: /tmp/polardb-${{ steps.get_version.outputs.VERSION }}-el7.tar.xz
  
  build_polardb_and_pfs_on_rockylinux8:
    runs-on: ubuntu-latest
    container:
      image: csuopen/polardb_pg_devel:rockylinux88
      options: --entrypoint /bin/bash --user root
    steps:
      - name: Get the polardb version
        id: get_version
        run: echo "::set-output name=VERSION::${GITHUB_REF#refs/tags/}"
      - name: Build ZLog
        run: |
          mkdir /tmp/zlog_build
          cp /usr/local/include/zlog.h /tmp/zlog_build
          cp /usr/local/bin/zlog-chk-conf /tmp/zlog_build
          cp /usr/local/lib/libzlog.so.1.2 /tmp/zlog_build/libzlog.so
          cp /usr/local/lib/libzlog.a /tmp/zlog_build
      - name: Build PFS
        run: |
          source /etc/bashrc
          mkdir /tmp/pfs_build
          cd /tmp
          wget https://github.com/ApsaraDB/PolarDB-FileSystem/archive/refs/tags/pfsd4pg-release-1.2.42-20220419.tar.gz -O /tmp/pfsd4pg-release-1.2.42-20220419.tar.gz
          tar -xzf pfsd4pg-release-1.2.42-20220419.tar.gz
          cd PolarDB-FileSystem-pfsd4pg-release-1.2.42-20220419
          ./autobuild.sh
          cp -r bin /tmp/pfs_build
          cp -r conf /tmp/pfs_build
          cp -r deploy_scripts /tmp/pfs_build
          cp -r etc /tmp/pfs_build
          cp -r install.sh /tmp/pfs_build
          cp -r lib /tmp/pfs_build
          cp -r src /tmp/pfs_build
          cp -r uninstall.sh /tmp/pfs_build
      - name: Build openSSL
        run: |
          mkdir /tmp/dependencies
          cp /usr/lib64/libssl.so.1.1 /tmp/dependencies
          cp /usr/lib64/libcrypto.so.1.1 /tmp/dependencies
          cp /lib64/libxerces-c-3.2.so /tmp/dependencies
      - name: Checkout
        uses: actions/checkout@v2
        with:
          ref: ${{ github.ref }}
      - name: Build PolarDB
        run: |
          source /etc/bashrc
          mkdir /tmp/polardb_build

          ./polardb_build.sh --basedir=/tmp/polardb_build --with-pfsd --withpx --noinit
          cd /tmp
          tar -cf polardb.tar polardb_build
      - name: Write install script
        run: |
          cat << 'EOF' > /tmp/install.sh
          #!/bin/bash

          date=$(date +%Y%m%d)
          basePath=$(cd `dirname $0`; pwd)
          dependence_path=$basePath/dependencies

          cd $dependence_path
          echo "copy依赖libssl.so.1.1和libcrypto.so.1.1"
          if [ ! -e "/usr/polardb/lib/libssl.so.1.1" ];then
              cp libs/libssl.so.1.1 /usr/polardb/lib
          fi
          if [ ! -e "/usr/polardb/lib/libcrypto.so.1.1" ];then
              cp libs/libcrypto.so.1.1 /usr/polardb/lib
          fi
          if [ ! -e "/usr/polardb/lib/libxerces-c-3.1.so" ];then
              cp libs/libxerces-c-3.1.so /usr/polardb/lib/libxerces-c-3.1.so
          fi

          echo "安装zlog"
          cd $dependence_path/zlog-1.2.16
          if [ ! -e "/usr/local/include/zlog.h" ];then
              mkdir -p /usr/local/include /usr/local/lib /usr/local/bin
              cp -a zlog.h /usr/local/include
              cp -a zlog-chk-conf /usr/local/bin
              cp -a libzlog.so /usr/local/lib/libzlog.so.1.2
              cp -a libzlog.a /usr/local/lib
              cd /usr/local/lib && ln -sf libzlog.so.1.2 libzlog.so.1
              cd /usr/local/lib && ln -sf libzlog.so.1 libzlog.so
          fi

          echo '/usr/local/lib' >> '/etc/ld.so.conf'
          ldconfig

          echo "安装pfs"
          cd $dependence_path
          if [ ! -e '/usr/local/bin/pfs' ];then
              cd $dependence_path/pfs-1.2.42
              ./install.sh
          fi

          echo "安装polardb"
          cd /usr
          if [ -d /usr/polardb ]
          then
              echo "重命名/usr下的旧版本polardb为polardb_bak_$date"
              mv polardb polardb_bak_$date
          fi
          mkdir polardb

          cd $basePath
          tar xkf polardb.tar -C /usr/polardb --strip-components=1 >> /dev/null
          echo "Polardb安装完成"
          EOF
      - name: Tar PolarDB
        run: |
          mkdir -p /tmp/polardb_tar/dependencies
          cp /tmp/polardb.tar /tmp/polardb_tar
          cp -r /tmp/zlog_build /tmp/polardb_tar/dependencies/zlog-1.2.16
          cp -r /tmp/pfs_build /tmp/polardb_tar/dependencies/pfs-1.2.42
          cp -r /tmp/dependencies /tmp/polardb_tar/dependencies/libs
          cp /tmp/install.sh /tmp/polardb_tar
          chmod +x /tmp/polardb_tar/install.sh
          cd /tmp
          tar -cf polardb-${{ steps.get_version.outputs.VERSION }}-el8.tar polardb_tar
          xz polardb-${{ steps.get_version.outputs.VERSION }}-el8.tar
      - name: Upload artifact
        uses: actions/upload-artifact@v2
        with:
          name: polardb-${{ steps.get_version.outputs.VERSION }}
          path: /tmp/polardb-${{ steps.get_version.outputs.VERSION }}-el8.tar.xz
  
  build_polardb_and_pfs_on_rockylinux9:
    runs-on: ubuntu-latest
    container:
      image: csuopen/polardb_pg_devel:rockylinux93
      options: --entrypoint /bin/bash --user root
    steps:
      - name: Get the polardb version
        id: get_version
        run: echo "::set-output name=VERSION::${GITHUB_REF#refs/tags/}"
      - name: Build ZLog
        run: |
          mkdir /tmp/zlog_build
          cp /usr/local/include/zlog.h /tmp/zlog_build
          cp /usr/local/bin/zlog-chk-conf /tmp/zlog_build
          cp /usr/local/lib/libzlog.so.1.2 /tmp/zlog_build/libzlog.so
          cp /usr/local/lib/libzlog.a /tmp/zlog_build
      - name: Build PFS
        run: |
          source /etc/bashrc
          mkdir /tmp/pfs_build
          cd /tmp
          wget https://github.com/ApsaraDB/PolarDB-FileSystem/archive/refs/tags/pfsd4pg-release-1.2.42-20220419.tar.gz -O /tmp/pfsd4pg-release-1.2.42-20220419.tar.gz
          tar -xzf pfsd4pg-release-1.2.42-20220419.tar.gz
          cd PolarDB-FileSystem-pfsd4pg-release-1.2.42-20220419
          ./autobuild.sh
          cp -r bin /tmp/pfs_build
          cp -r conf /tmp/pfs_build
          cp -r deploy_scripts /tmp/pfs_build
          cp -r etc /tmp/pfs_build
          cp -r install.sh /tmp/pfs_build
          cp -r lib /tmp/pfs_build
          cp -r src /tmp/pfs_build
          cp -r uninstall.sh /tmp/pfs_build
      - name: Build openSSL
        run: |
          mkdir /tmp/dependencies
          cp /usr/lib64/libssl.so.3.0.7 /tmp/dependencies
          cp /usr/lib64/libcrypto.so.3.0.7 /tmp/dependencies
          cp /lib64/libxerces-c-3.2.so /tmp/dependencies
      - name: Checkout
        uses: actions/checkout@v2
        with:
          ref: ${{ github.ref }}
      - name: Build PolarDB
        run: |
          source /etc/bashrc
          mkdir /tmp/polardb_build

          ./polardb_build.sh --basedir=/tmp/polardb_build --with-pfsd --withpx --noinit
          cd /tmp
          tar -cf polardb.tar polardb_build
      - name: Write install script
        run: |
          cat << 'EOF' > /tmp/install.sh
          #!/bin/bash

          date=$(date +%Y%m%d)
          basePath=$(cd `dirname $0`; pwd)
          dependence_path=$basePath/dependencies

          cd $dependence_path
          echo "copy依赖libssl.so.1.1和libcrypto.so.1.1"
          if [ ! -e "/usr/polardb/lib/libssl.so.1.1" ];then
              cp libs/libssl.so.1.1 /usr/polardb/lib
          fi
          if [ ! -e "/usr/polardb/lib/libcrypto.so.1.1" ];then
              cp libs/libcrypto.so.1.1 /usr/polardb/lib
          fi
          if [ ! -e "/usr/polardb/lib/libxerces-c-3.1.so" ];then
              cp libs/libxerces-c-3.1.so /usr/polardb/lib/libxerces-c-3.1.so
          fi

          echo "安装zlog"
          cd $dependence_path/zlog-1.2.16
          if [ ! -e "/usr/local/include/zlog.h" ];then
              mkdir -p /usr/local/include /usr/local/lib /usr/local/bin
              cp -a zlog.h /usr/local/include
              cp -a zlog-chk-conf /usr/local/bin
              cp -a libzlog.so /usr/local/lib/libzlog.so.1.2
              cp -a libzlog.a /usr/local/lib
              cd /usr/local/lib && ln -sf libzlog.so.1.2 libzlog.so.1
              cd /usr/local/lib && ln -sf libzlog.so.1 libzlog.so
          fi

          echo '/usr/local/lib' >> '/etc/ld.so.conf'
          ldconfig

          echo "安装pfs"
          cd $dependence_path
          if [ ! -e '/usr/local/bin/pfs' ];then
              cd $dependence_path/pfs-1.2.42
              ./install.sh
          fi

          echo "安装polardb"
          cd /usr
          if [ -d /usr/polardb ]
          then
              echo "重命名/usr下的旧版本polardb为polardb_bak_$date"
              mv polardb polardb_bak_$date
          fi
          mkdir polardb

          cd $basePath
          tar xkf polardb.tar -C /usr/polardb --strip-components=1 >> /dev/null
          echo "Polardb安装完成"
          EOF
      - name: Tar PolarDB
        run: |
          mkdir -p /tmp/polardb_tar/dependencies
          cp /tmp/polardb.tar /tmp/polardb_tar
          cp -r /tmp/zlog_build /tmp/polardb_tar/dependencies/zlog-1.2.16
          cp -r /tmp/pfs_build /tmp/polardb_tar/dependencies/pfs-1.2.42
          cp -r /tmp/dependencies /tmp/polardb_tar/dependencies/libs
          cp /tmp/install.sh /tmp/polardb_tar
          chmod +x /tmp/polardb_tar/install.sh
          cd /tmp
          tar -cf polardb-${{ steps.get_version.outputs.VERSION }}-el9.tar polardb_tar
          xz polardb-${{ steps.get_version.outputs.VERSION }}-el9.tar
      - name: Upload artifact
        uses: actions/upload-artifact@v2
        with:
          name: polardb-${{ steps.get_version.outputs.VERSION }}
          path: /tmp/polardb-${{ steps.get_version.outputs.VERSION }}-el9.tar.xz
  
  create-release:
    needs: [build_polardb_and_pfs_on_centos7, build_polardb_and_pfs_on_rockylinux8, build_polardb_and_pfs_on_rockylinux9]
    runs-on: ubuntu-latest
    steps:
      - name: Get the polardb version
        id: get_version
        run: echo "::set-output name=VERSION::${GITHUB_REF#refs/tags/}"
      - name: Download all workflow artifacts
        uses: actions/download-artifact@v2
        with:
          name: polardb-${{ steps.get_version.outputs.VERSION }}
          path: /tmp
      - name: Create Release
        id: create_release
        uses: actions/create-release@v1
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
        with:
          tag_name: ${{ steps.get_version.outputs.VERSION }}
          release_name: PolarDB ${{ steps.get_version.outputs.VERSION }}
          body: |
            PolarDB ${{ steps.get_version.outputs.VERSION }}

            ${{ steps.get_tag_message.outputs.TAG_MESSAGE }}
          draft: false
          prerelease: false
      - name: Upload EL8 Release Asset
        id: upload-release-asset-el8
        uses: actions/upload-release-asset@v1
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
        with:
          upload_url: ${{ steps.create_release.outputs.upload_url }}
          asset_path: /tmp/polardb-${{ steps.get_version.outputs.VERSION }}-el8.tar.xz
          asset_name: polardb-11.9-${{ steps.get_version.outputs.VERSION }}.el8.x86_64.tar.xz
          asset_content_type: application/x-xz
      - name: Upload EL7 Release Asset
        id: upload-release-asset-el7
        uses: actions/upload-release-asset@v1
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
        with:
          upload_url: ${{ steps.create_release.outputs.upload_url }}
          asset_path: /tmp/polardb-${{ steps.get_version.outputs.VERSION }}-el7.tar.xz
          asset_name: polardb-11.9-${{ steps.get_version.outputs.VERSION }}.el7.x86_64.tar.xz
          asset_content_type: application/x-xz
      - name: Upload EL9 Release Asset
        id: upload-release-asset-el9
        uses: actions/upload-release-asset@v1
        env:
          GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
        with:
          upload_url: ${{ steps.create_release.outputs.upload_url }}
          asset_path: /tmp/polardb-${{ steps.get_version.outputs.VERSION }}-el9.tar.xz
          asset_name: polardb-11.9-${{ steps.get_version.outputs.VERSION }}.el9.x86_64.tar.xz
          asset_content_type: application/x-xz

提交代码并推到github仓库

git commit -m "add polardb release action"
git push origin xxx

开始构建PolarDB

配置好Github Action后,每次推送一个以“b”开头的tag,都会触发构建流程,让我们来测试一下。

git tag b20240322
git push origin b20240322

在浏览器中打开我们Fork的github仓库,点击上方的Action,可以看到有一个workflow任务正在运行,稍等片刻等任务执行完成后,我们即可在github的release里看到一个新发布的release,里面有构建好的EL7, EL8, EL9的PolarDB安装包。

乘数科技提供了通过Github Action构建好的最新PolarDB-PG安装包,同学们如果觉得好用的话,请给项目仓库点一点star,让更多人可以看到。

仓库地址:
https://github.com/csudata/PolarDB-for-PostgreSQL

扫描二维码推送至手机访问。

版权声明:本文由ruisui88发布,如需转载请注明出处。

本文链接:http://www.ruisui88.com/post/3853.html

标签: libz.so.1
分享给朋友:

“如何使用Github Action来自动化编译PolarDB-PG数据库” 的相关文章

带你五步学会Vue SSR

作者:liuxuan 前端名狮转发链接:https://mp.weixin.qq.com/s/6K6GUHcLwLG4mzfaYtVMBQ前言SSR大家肯定都不陌生,通过服务端渲染,可以优化SEO抓取,提升首页加载速度等,我在学习SSR的时候,看过很多文章,有些对我有很大的启发作用,有些就只是照搬官...

面试被逼疯:聊聊Python Import System?

面试官一个小时逼疯面试者:聊聊Python Import System?对于每一位Python开发者来说,import这个关键字是再熟悉不过了,无论是我们引用官方库还是三方库,都可以通过import xxx的形式来导入。可能很多人认为这只是Python的一个最基础的常识之一,似乎没有可以扩展的点了,...

一次Java内存占用高的排查案例,解释了我对内存问题的所有疑问

问题现象7月25号,我们一服务的内存占用较高,约13G,容器总内存16G,占用约85%,触发了内存报警(阈值85%),而我们是按容器内存60%(9.6G)的比例配置的JVM堆内存。看了下其它服务,同样的堆内存配置,它们内存占用约70%~79%,此服务比其它服务内存占用稍大。那为什么此服务内存占用稍大...

Vue学习笔记之动态路由的参数传递应用及技巧

路由的参数传递:①通过params的类型· 配置路由格式:/router/:id· 传递的方式:在path后面跟上对应的值· 传递后形成的路径:/router/list,/router/profile这个就是前两篇中提到的"动态路由"中有应用过这个方法:②通过query的类型(对象方...

VUE 技术栈

官网链接:https://cn.vuejs.org/什么是vue:渐进式JavaScript 框架vue-cli链接:https://cli.vuejs.org/vue-cli安装:npm install -g @vue/clivue -V创建一个项目:vue create xxxxxx模版语法:文...

基于微信小程序+springboot+vue技术构建的开源微信商城

介绍基于 微信小程序 + springboot + vue 技术构建 ,支持单店铺,多店铺入驻的商城平台。项目包含 微信小程序,管理后台。基于java后台语言,已功能闭环,且达到商用标准的一套项目体系。技术栈平台功能介绍小程序演示图管理后端演示图小程序体验码演示地址1.0版演示地址说明后台管理端演示...