Impala源码编译全过程小结

企业开发 2022-09-05 01:17:56 阅读次数: 0

1.背景介绍

1、开源组件Impala-3.1.0、3.2.0、3.3.0版本进行编译操作。
2、Impala是交互式查询系统，内嵌了监控代理，保持原生功能，它提供SQL语义，能查询存储在Hadoop的HDFS和HBase中的PB级大数据

2.编译Impala源码

将源码下载后，在1000c版本环境下进行编译、适配。
Impala链接地址:
https://github.com/apache/impala/archive/refs/tags/3.1.0.tar.gz
https://github.com/apache/impala/archive/refs/tags/3.2.0.tar.gz
https://codeload.github.com/apache/impala/tar.gz/refs/tags/3.3.0

2.1.编译前的环境准备

1、源码编译前安装必要的依赖

yum -y install boost-test boost-program-options libevent-devel automake libtool flex bison gcc-c++ openssl-devel make cmake glib-devel boost-devel bzip2-devel svn libevent-devel cyrus-sasl-devel wget git unzip python2-pip python-devel python java-devel 
yum -y install redhat-lsb-submod-security redhat-lsb-core

2、由于cmake、gcc、maven版本过低，需要先进行编译安装对应版本

1)编译cmake
卸载cmake

yum remove cmake

下载cmake

wget https://github.com/Kitware/CMake/releases/download/v3.8.2/cmake-3.8.2.tar.gz

下载补丁包

wget https://github.com/cloudera/native-toolchain/archive/refs/heads/master.zip

拷贝进行打补丁

cp /home/native-toolchain-master/source/cmake/cmake-3.8.2-patches/0001-IMPALA-3191.patch /home/cmake-3.8.2
cd /home/cmake-3.8.2
patch -p1 < 0001-IMPALA-3191.patch

编译安装

./bootstrap
gmake -j
make install -j

添加环境变量

vim /etc/profile
	export PATH=/usr/local/cmake-3.8.2/bin:$PATH
source /etc/profile

使环境变量生效

source /etc/profile

2)编译gcc
下载gcc

wget http://ftp.gnu.org/gnu/gcc/gcc-4.9.2/gcc-4.9.2.tar.gz

执行脚本下载依赖

cd /home/gcc-4.9.2/
./contrib/download_prerequisites

编译安装

cd /home/gcc-4.9.2/
./configure --prefix=/usr/local/gcc-4.9.2 --enable-languages=c,c++,fortran --disable-multilib --with-build-config=bootstrap-debug
make -j
make install -j

添加环境变量

vim /etc/profile
export PATH=/usr/local/gcc-4.9.2/bin:$PATH
export LD_LIBRARY_PATH=/usr/local/gcc-4.9.2/lib64:$LD_LIBRARY_PATH

使环境变量生效

source /etc/profile

3)编译maven
下载maven

wget https://archive.apache.org/dist/maven/maven-3/3.6.3/binaries/apache-maven-3.6.3-bin.tar.gz

添加maven环境变量

mv apache-maven-3.6.3 /opt/tools/installed/
vim /etc/profile
export MAVEN_HOME=/opt/tools/installed/apache-maven-3.6.3
export PATH=$MAVEN_HOME/bin:$PATH

使环境变量生效

source /etc/profile

3、设置JDK环境变量

添加JAVA环境变量

vim /etc/profile
export JAVA_HOME=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.272.b10-1.uelc20.x86_64
export PATH=$JAVA_HOME/bin:$PATH

使环境变量生效

source /etc/profile

4、安装impyla

 pip install impyla

出现错误

pip install impyla

WARNING: Running pip install with root privileges is generally not a
good idea. Try pip install --user instead.
Collecting impyla Downloading
https://files.pythonhosted.org/packages/37/8f/0eb42391ef971698585aa6d8d76546be13c4beb08b9c09fcac645d4a1034/impyla-0.16.3.tar.gz
(232kB)
100% |████████████████████████████████| 235kB 1.5MB/s
Complete output from command python setup.py egg_info:

The required version of setuptools (>=3.4.4) is not available,
and can't be installed while this script is running. Please
install a more recent version first, using
'easy_install -U setuptools'.

(Currently using setuptools 0.9.8 (/usr/lib/python2.7/site-packages))

---------------------------------------- Command "python setup.py egg_info" failed with error code 2 in /tmp/pip-build-dQnfFT/impyla/

解决方案

#python -m pip install --upgrade --force pip
WARNING: Running pip install with root privileges is generally not a
good idea. Try __main__.py install --user instead.
Collecting pip Downloading
https://files.pythonhosted.org/packages/27/79/8a850fe3496446ff0d584327ae44e7500daf6764ca1a382d2d02789accf7/pip-20.3.4-py2.py3-none-any.whl
(1.5MB)
100% |████████████████████████████████| 1.5MB 559kB/s Installing collected packages: pip Found existing installation: pip 9.0.3
Uninstalling pip-9.0.3:
Successfully uninstalled pip-9.0.3 Successfully installed pip-20.3.4 You are using pip version 20.3.4, however version 21.1.1 is
available. You should consider upgrading via the ‘pip install
–upgrade pip’ command.
#pip install setuptools33.1.1
DEPRECATION: Python 2.7 reached the end of its life on January 1st,
2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021.
More details about Python 2 support in pip can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
pip 21.0 will remove support for this functionality.
Collecting setuptools33.1.1 Downloading
setuptools-33.1.1-py2.py3-none-any.whl (472 kB)
|████████████████████████████████| 472 kB 796 kB/s Installing collected packages: setuptools Attempting uninstall: setuptools
Found existing installation: setuptools 0.9.8
Uninstalling setuptools-0.9.8:
Successfully uninstalled setuptools-0.9.8 Successfully installed setuptools-33.1.1

#pip install impyla
DEPRECATION: Python 2.7 reached the end of its life on January 1st,
2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021.
More details about Python 2 support in pip can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
pip 21.0 will remove support for this functionality.
Collecting impyla Using cached impyla-0.16.3.tar.gz (232 kB)
Requirement already satisfied: six in /usr/lib/python2.7/site-packages
(from impyla) (1.10.0) Collecting bitarray Downloading
bitarray-2.1.0.tar.gz (71 kB)
|████████████████████████████████| 71 kB 642 kB/s Collecting thrift==0.9.3 Downloading thrift-0.9.3.tar.gz (38 kB) Using legacy
‘setup.py install’ for impyla, since package ‘wheel’ is not installed.
Using legacy ‘setup.py install’ for bitarray, since package ‘wheel’ is
not installed. Using legacy ‘setup.py install’ for thrift, since
package ‘wheel’ is not installed. Installing collected packages:
bitarray, thrift, impyla
Running setup.py install for bitarray … done
Running setup.py install for thrift … done
Running setup.py install for impyla … done Successfully installed bitarray-2.1.0 impyla-0.16.3 thrift-0.9.3

2.2.编译Impala-3.2.0

1、下载impala-3.2.0

wget https://github.com/apache/impala/archive/refs/tags/3.2.0.tar.gz

2、执行编译

cd /home/impala-3.2.0
export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

出现错误 Downloading and extracting toolchain dependencies.
INFO:bootstrap_virtualenv:Creating python virtualenv
INFO:bootstrap_virtualenv:Installing packages into the virtualenv
INFO:bootstrap_virtualenv:Installing stage 2 packages into the
virtualenv 2021-05-17 14:12:48,643 MainThread ERROR: The following
packages are not in their expected locations. <main.Package
object at 0x7fec6b78ee50> (expected directory
/home/impala-3.2.0/toolchain/gcc-4.9.2 to exist) Pre-built toolchain
archives not available for your platform. Clone and build native
toolchain from source using this repository:
https://github.com/cloudera/native-toolchain

Traceback (most recent call last): File
“/home/impala-3.2.0/bin/bootstrap_toolchain.py”, line 471, in
bootstrap(toolchain_root, [Package(“gcc”)]) File “/home/impala-3.2.0/bin/bootstrap_toolchain.py”, line 187, in
bootstrap
check_custom_toolchain(toolchain_root, packages) File “/home/impala-3.2.0/bin/bootstrap_toolchain.py”, line 239, in
check_custom_toolchain
raise Exception(“Toolchain bootstrap failed: required packages were missing”) Exception: Toolchain bootstrap failed: required
packages were missing

解决方案：

因为在编译过程依赖下载不了导致无法编译，该报错提示在/home/impala-3.2.0/toolchain/缺少gcc-4.9.2依赖
将编译好的gcc-4.9.2拷贝到/home/impala-3.2.0/toolchain/下重新执行编译

3、执行编译

cd /home/impala-3.2.0
export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

出现错误 No matching distribution found for thrift (from
impyla0.14.0->-r
/home/impala-3.2.0/bin/…/infra/python/deps/compiled-requirements.txt
(line 2)) Exception information: Traceback (most recent call last):
File
“/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/basecommand.py”,
line 223, in main
status = self.run(options, args) File “/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/commands/install.py”,
line 282, in run
requirement_set.prepare_files(finder) File “/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/req/req_set.py”,
line 334, in prepare_files
functools.partial(self._prepare_file, finder)) File “/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/req/req_set.py”,
line 321, in _walk_req_to_install
more_reqs = handler(req_to_install) File “/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/req/req_set.py”,
line 461, in _prepare_file
req_to_install.populate_link(finder, self.upgrade) File “/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/req/req_install.py”,
line 249, in populate_link
self.link = finder.find_requirement(self, upgrade) File “/home/impala-3.2.0/infra/python/env/lib/python2.7/site-packages/pip/index.py”,
line 571, in find_requirement
‘No matching distribution found for %s’ % req DistributionNotFound: No matching distribution found for thrift (from
impyla0.14.0->-r
/home/impala-3.2.0/bin/…/infra/python/deps/compiled-requirements.txt
(line 2))

ERROR in /home/impala-3.2.0/bin/impala-python at line 31: Generated:
/home/impala-3.2.0/logs/extra_junit_xml_logs/generate_junitxml.buildall.impala-python.20210508_03_35_22.xml

解决方案：

缺少相关依赖包///官网下载thrift 将thrift包大于0.9.0版本放入infra/python/deps/重新进行编译

4、执行编译

cd /home/impala-3.2.0
export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

出现错误 Downloading and extracting toolchain dependencies. n/an/a
INFO:bootstrap_virtualenv:Installing compiled requirements into the
virtualenv 2021-05-17 14:23:13,497 MainThread ERROR: The following
packages are not in their expected locations. <main.Package
object at 0x7fa28046e890> (expected directory
/home/impala-3.2.0/toolchain/thrift-0.11.0-p2 to exist)
<main.Package object at 0x7fa2804dcdd0> (expected directory
/home/impala-3.2.0/toolchain/llvm-5.0.1-asserts-p1 to exist)
<main.Package object at 0x7fa2804dcc90> (expected directory
/home/impala-3.2.0/toolchain/kudu-5211897 to exist)
<main.Package object at 0x7fa2804dccd0> (expected directory
/home/impala-3.2.0/toolchain/llvm-5.0.1-p1 to exist)
<main.Package object at 0x7fa2804dcf50> (expected directory
/home/impala-3.2.0/toolchain/avro-1.7.4-p4 to exist)
<main.Package object at 0x7fa2804dcfd0> (expected directory
/home/impala-3.2.0/toolchain/binutils-2.26.1 to exist)
<main.Package object at 0x7fa2804dcd90> (expected directory
/home/impala-3.2.0/toolchain/boost-1.57.0-p3 to exist)
<main.Package object at 0x7fa2804dced0> (expected directory
/home/impala-3.2.0/toolchain/breakpad-97a98836768f8f0154f8f86e5e14c2bb7e74132e-p2
to exist) <main.Package object at 0x7fa28046e050> (expected
directory /home/impala-3.2.0/toolchain/bzip2-1.0.6-p2 to exist)
<main.Package object at 0x7fa28046e090> (expected directory
/home/impala-3.2.0/toolchain/cctz-2.2 to exist) <main.Package
object at 0x7fa28046e0d0> (expected directory
/home/impala-3.2.0/toolchain/cmake-3.8.2-p1 to exist)
<main.Package object at 0x7fa28046e110> (expected directory
/home/impala-3.2.0/toolchain/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1
to exist) <main.Package object at 0x7fa28046e650> (expected
directory /home/impala-3.2.0/toolchain/flatbuffers-1.6.0 to exist)
<main.Package object at 0x7fa28046e5d0> (expected directory
/home/impala-3.2.0/toolchain/gdb-7.9.1-p1 to exist)
<main.Package object at 0x7fa28046e6d0> (expected directory
/home/impala-3.2.0/toolchain/gflags-2.2.0-p2 to exist)
<main.Package object at 0x7fa28046e710> (expected directory
/home/impala-3.2.0/toolchain/glog-0.3.4-p3 to exist)
<main.Package object at 0x7fa28046e750> (expected directory
/home/impala-3.2.0/toolchain/gperftools-2.5 to exist)
<main.Package object at 0x7fa28046e7d0> (expected directory
/home/impala-3.2.0/toolchain/gtest-1.6.0 to exist) <main.Package
object at 0x7fa28046e790> (expected directory
/home/impala-3.2.0/toolchain/libev-4.20 to exist) <main.Package
object at 0x7fa28046e810> (expected directory
/home/impala-3.2.0/toolchain/libunwind-1.3-rc1-p3 to exist)
<main.Package object at 0x7fa28046e350> (expected directory
/home/impala-3.2.0/toolchain/lz4-1.7.5 to exist) <main.Package
object at 0x7fa28046e310> (expected directory
/home/impala-3.2.0/toolchain/openldap-2.4.47 to exist)
<main.Package object at 0x7fa28046e390> (expected directory
/home/impala-3.2.0/toolchain/openssl-1.0.2l to exist)
<main.Package object at 0x7fa28046e3d0> (expected directory
/home/impala-3.2.0/toolchain/orc-1.4.3-p3 to exist)
<main.Package object at 0x7fa28046e290> (expected directory
/home/impala-3.2.0/toolchain/protobuf-3.5.1 to exist)
<main.Package object at 0x7fa28046e4d0> (expected directory
/home/impala-3.2.0/toolchain/rapidjson-1.1.0 to exist)
<main.Package object at 0x7fa28046e510> (expected directory
/home/impala-3.2.0/toolchain/re2-20130115-p1 to exist)
<main.Package object at 0x7fa28046e450> (expected directory
/home/impala-3.2.0/toolchain/snappy-1.1.4 to exist)
<main.Package object at 0x7fa28046e550> (expected directory
/home/impala-3.2.0/toolchain/thrift-0.9.3-p5 to exist)
<main.Package object at 0x7fa28046e590> (expected directory
/home/impala-3.2.0/toolchain/tpc-h-2.17.0 to exist)
<main.Package object at 0x7fa28046e250> (expected directory
/home/impala-3.2.0/toolchain/tpc-ds-2.1.0 to exist)
<main.Package object at 0x7fa28046e850> (expected directory
/home/impala-3.2.0/toolchain/zlib-1.2.8 to exist) Pre-built toolchain
archives not available for your platform. Clone and build native
toolchain from source using this repository:
https://github.com/cloudera/native-toolchain

Traceback (most recent call last): File
“/home/impala-3.2.0/bin/bootstrap_toolchain.py”, line 485, in
bootstrap(toolchain_root, packages) File “/home/impala-3.2.0/bin/bootstrap_toolchain.py”, line 187, in
bootstrap
check_custom_toolchain(toolchain_root, packages) File “/home/impala-3.2.0/bin/bootstrap_toolchain.py”, line 239, in
check_custom_toolchain
raise Exception(“Toolchain bootstrap failed: required packages were missing”) Exception: Toolchain bootstrap failed: required
packages were missing

解决方案

跟上述gcc状况一样都是下载依赖包失败，找不到相关依赖 需要进行单独编译每一个依赖包

3.编译安装依赖工具

3.1.编译安装cmake-3.8.2

cmake-3.8.2上述已编译安装完成。

拷贝对应目录

cp -r /usr/local/cmake-3.8.2 /home/impala-3.2.0/toolchain/

修改命名

mv cmake-3.8.2 cmake-3.8.2-p1

3.2.编译安装thrift-0.11.0

下载thrift

wget https://github.com/apache/thrift/archive/refs/tags/0.11.0.tar.gz

安装补丁

cd /home/thrift-0.11.0
cp /home/native-toolchain-master/source/thrift/thrift-0.11.0-patches/* /home/thrift-0.11.0
./bootstrap.sh
configure.ac:93: installing './config.guess'
configure.ac:93: installing './config.sub'
configure.ac:27: installing './install-sh'
configure.ac:27: installing './missing'
compiler/cpp/Makefile.am: installing './depcomp'
configure.ac: installing './ylwrap'

进行编译

./configure \
     --with-pic \
     --prefix="/usr/local/thrift-0.11.0" \
     --enable-tutorial=no \
     --with-c_glib=no \
     --with-php=no \
     --with-java=no \
     --with-perl=no \
     --with-erlang=no \
     --with-csharp=no \
     --with-ruby=no \
     --with-haskell=no \
     --with-erlang=no \
     --with-d=no \
     --with-boost="/usr/local/boost_1_57_0" \
     --with-zlib="/usr/local/zlib-1.2.8" \
     --with-nodejs=no \
     --with-lua=no \
     --with-go=no \
 --with-qt4=no \
 --with-qt5=no \
 --with-libevent=no \
 --with-openssl="/usr/local/openssl-1.0.2l"

C++ Library: C++ compiler … : g++ -std=c++11 Build
TZlibTransport … : yes Build TNonblockingServer … : Build
TQTcpServer (Qt4) … : no Build TQTcpServer (Qt5) … : no C++
compiler version … : g++_4.9.2 (GCC) 4.9.2

Python Library: Using Python … : /usr/bin/python
Using Python version … : Python 2.7.5

If something is missing that you think should be present, please skim
the output of configure to find the missing component. Details are
present in config.log.

make -j
make install -j

make[3]: 离开目录“/home/thrift-0.11.0/test/py.tornado” make[2]:
离开目录“/home/thrift-0.11.0/test/py.tornado” make[2]:
进入目录“/home/thrift-0.11.0/test” make[3]: 进入目录“/home/thrift-0.11.0/test”
make[3]: 对“install-exec-am”无需做任何事。 make[3]: 对“install-data-am”无需做任何事。
make[3]: 离开目录“/home/thrift-0.11.0/test” make[2]:
离开目录“/home/thrift-0.11.0/test” make[1]: 离开目录“/home/thrift-0.11.0/test”
make[1]: 进入目录“/home/thrift-0.11.0” make[2]: 进入目录“/home/thrift-0.11.0”
make[2]: 对“install-exec-am”无需做任何事。 make[2]: 对“install-data-am”无需做任何事。
make[2]: 离开目录“/home/thrift-0.11.0” make[1]: 离开目录“/home/thrift-0.11.0”

拷贝信息

cp -r /usr/local/thrift-0.11.0 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv thrift-0.11.0 thrift-0.11.0-p2

3.3.编译安装llvm-5.0.1
下载llvm-5.0.1

cd /home
wget https://releases.llvm.org/5.0.1/llvm-5.0.1.src.tar.xz
wget https://releases.llvm.org/5.0.1/cfe-5.0.1.src.tar.xz
wget https://releases.llvm.org/5.0.1/compiler-rt-5.0.1.src.tar.xz
wget https://releases.llvm.org/5.0.1/clang-tools-extra-5.0.1.src.tar.xz
tar -xvf llvm-5.0.1.src.tar.xz

将依赖组件放入相对应目录

cd /home
tar xf cfe-5.0.1.src.tar.xz
mv cfe-5.0.1.src /home/llvm-5.0.1.src/tools/clang
tar xf clang-tools-extra-5.0.1.src.tar.xz
mv clang-tools-extra-5.0.1.src /home/llvm-5.0.1.src/tools/clang/tools/extra
tar xf compiler-rt-5.0.1.src.tar.xz
mv compiler-rt-5.0.1.src /home/llvm-5.0.1.src/tools/compiler-rt

编译release版本

mkdir build
cd build
cmake -DCMAKE_BUILD_TYPE=Release  -DCMAKE_INSTALL_PREFIX=/usr/local/llvm-5.0.1-p1  -DLLVM_TARGETS_TO_BUILD="AArch64"  -DLLVM_ENABLE_RTTI=ON -DLLVM_ENABLE_TERMINFO=OFF -DPYTHON_EXECUTABLE=/usr/bin/python ..
make -j
make install -j
cd tools/clang
make install -j

编译release-asserts版本

cd /home/llvm-5.0.1.src
cd build
cmake -DCMAKE_BUILD_TYPE=Release  -DCMAKE_INSTALL_PREFIX=/usr/local/llvm-5.0.1-asserts  -DLLVM_TARGETS_TO_BUILD="AArch64"  -DLLVM_ENABLE_RTTI=ON -DLLVM_ENABLE_TERMINFO=OFF -DPYTHON_EXECUTABLE=/usr/bin/python ..
make -j
make install -j
cd tools/clang
make install -j

拷贝信息

cp -r /usr/local/llvm-5.0.1-p1 /home/impala-3.2.0/toolchain/
cp -r /usr/local/llvm-5.0.1-asserts/ /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv llvm-5.0.1-asserts llvm-5.0.1-asserts-p1

3.4.编译安装zlib-1.2.8

下载zlib包并解压

cd /home
wget http://zlib.net/fossils/zlib-1.2.8.tar.gz
tar -zxvf zlib-1.2.8.tar.gz
cd zlib-1.2.8

进行编译

./configure --prefix=/usr/local/zlib-1.2.8
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/zlib-1.2.8 /home/impala-3.2.0/toolchain/

3.5.编译安装boost-1.57.0

安装依赖

yum -y install boost boost-build boost-devel boost-thread boost-system boost-regex boost-static boost-filesystem boost-date-time

下载boost包并解压

cd /home
wget https://nchc.dl.sourceforge.net/project/boost/boost/1.57.0/boost_1_57_0.tar.gz
tar -zxvf boost_1_57_0.tar.gz
cd boost_1_57_0

拷贝补丁到目录

cp /home/native-toolchain-master/source/boost/boost-1.57.0-patches/* /home/boost_1_57_0

进行编译

./bootstrap.sh --prefix=/usr/local/boost_1_57_0 --with-libraries=all --with-toolset=gcc --with-libraries=/usr/local/openssl-1.0.2l
./b2 -s"NO_BZIP2=1" --without-python install

确认版本信息

cat /usr/local/boost_1_57_0/include/boost/version.hpp

拷贝信息到toolchain

cp -r /usr/local/boost_1_57_0 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv boost_1_57_0 boost-1.57.0-p3

3.6.编译安装openssl-1.0.2l

下载openssl包并解压

cd /home
wget https://github.com/openssl/openssl/archive/refs/tags/OpenSSL_1_0_2l.tar.gz
tar -zxvf OpenSSL_1_0_2l.tar.gz

进行编译

./config --prefix=/usr/local/openssl-1.0.2l shared
make -j
make install -j

查看版本

cd /usr/local/openssl-1.0.2l/bin
./openssl version

拷贝信息到toolchain

cp -r /usr/local/openssl-1.0.2l /home/impala-3.2.0/toolchain/

3.7.编译安装thrift-0.9.3

下载thrift包并解压

cd /home
wget https://github.com/apache/thrift/archive/refs/tags/0.9.3.tar.gz
tar -zxvf 0.9.3.tar.gz

安装补丁

cd /home/thrift-0.9.3
cp /home/native-toolchain-master/source/thrift/thrift-0.9.3-patches/* /home/thrift-0.9.3
./bootstrap.sh

修改参数

vim configure

删除23899行，新增如下内容

LIBS="-L/usr/local/openssl-1.0.2l/lib -lcrypto  $LIBS"

编译

./configure \
    --with-pic \
    --prefix="/usr/local/thrift-0.9.3" \
    --enable-tutorial=no \
    --with-c_glib=no \
    --with-php=no \
    --with-java=no \
    --with-perl=no \
    --with-erlang=no \
    --with-csharp=no \
    --with-ruby=no \
    --with-haskell=no \
    --with-erlang=no \
    --with-d=no \
    --with-boost="/usr/local/boost_1_57_0" \
    --with-zlib="/usr/local/zlib-1.2.8"  \
    --with-nodejs=no \
    --with-lua=no \
    --with-go=no \
    --with-qt4=no \
    --with-qt5=no \
    --with-libevent=no \
    --with-openssl="/usr/local/openssl-1.0.2l" \
    PY_PREFIX=/usr/local/thrift-0.9.3/python

make -j
make install -j
cd contrib/fb303/
./bootstrap.sh --with-boost="/usr/local/boost_1_57_0"
CPPFLAGS="-I /usr/local/thrift-0.9.3/include" ./configure --with-boost="/usr/local/boost_1_57_0" --with-java=no --with-php=no --prefix=/usr/local/thrift-0.9.3 --with-thriftpath=/usr/local/thrift-0.9.3 PY_PREFIX=/usr/local/thrift-0.9.3/python
make -j
make install

查看版本

cd /usr/local/thrift-0.9.3/bin
./thrift -version

拷贝信息到toolchain

cp -r /usr/local/thrift-0.9.3 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv thrift-0.9.3 thrift-0.9.3-p5

3.8.编译安装Snappy-1.1.4

下载thrift包并解压

cd /home
wget https://github.com/google/snappy/archive/refs/tags/1.1.4.tar.gz
tar -zxvf 1.1.4.tar.gz
cd /home/snappy-1.1.4

进行编译

./autogen.sh
./configure --prefix=/usr/local/snappy-1.1.4
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/snappy-1.1.4 /home/impala-3.2.0/toolchain/

3.9.编译安装RE2

下载thrift包并解压

cd /home
wget https://github.com/google/re2/archive/refs/tags/2015-05-01.tar.gz
tar -zxvf 2015-05-01.tar.gz
cd re2-2015-05-01

修改编译目录

vim Makefile

修改23行

prefix=/usr/local/re2

进行编译

make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/re2 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv re2 re2-20130115-p1

3.10.编译安装protobuf-3.5.1

下载protobuf包并解压

cd /home
wget https://github.com/protocolbuffers/protobuf/archive/refs/tags/v3.5.1.tar.gz
tar -zxvf v3.5.1.tar.gz
cd protobuf-3.5.1

编译软件

./autogen.sh
./configure --prefix=/usr/local/protobuf-3.5.1
make -j
make install -j

查看版本

cd /usr/local/protobuf-3.5.1/bin
./protoc --version

拷贝信息到toolchain

cp -r /usr/local/protobuf-3.5.1 /home/impala-3.2.0/toolchain/

3.11.编译安装lz4-1.7.5
下载lz4包并解压

cd /home
wget https://github.com/lz4/lz4/archive/refs/tags/v1.7.5.tar.gz
tar -zxvf v1.7.5.tar.gz
cd lz4-1.7.5
yum install lz4-devel

编译

make -j
make install -j

拷贝信息到toolchain

cp -r /home/lz4-1.7.5 /home/impala-3.2.0/toolchain/

3.12.编译安装openldap-2.4.47
下载openldap包并解压

cd /home
wget http://www.openldap.org/software/download/OpenLDAP/openldap-release/openldap-2.4.47.tgz
tar -zxvf openldap-2.4.47.tgz
cd openldap-2.4.47
yum -y install libtool-ltdl-devel libdb libdb-devel

修改configure文件

vim configure
删除12688和5727行“-V -qversion”
15583行改为
TLS_LIBS="-L/usr/local/openssl-1.0.2l/lib -lssl -lcrypto"

编译

CPPFLAGS='-L/usr/local/openssl-1.0.2l/lib -lssl -lcrypto -I/usr/local/openssl-1.0.2l/include' ./configure --prefix=/usr/local/openldap-2.4.47 --build=arm-linux  --with-tls=openssl
make depend
make -j
make install

查看版本

cd /usr/local/openldap-2.4.47/bin
./ldapadd -V

拷贝信息到toolchain

cp -r /usr/local/openldap-2.4.47 /home/impala-3.2.0/toolchain/

3.13.编译安装breakpad

下载breakpad包并解压

cd /home
wget https://chromium.googlesource.com/breakpad/breakpad/+archive/97a98836768f8f0154f8f86e5e14c2bb7e74132e.tar.gz
mkdir breakpad
tar -zxvf breakpad-97a98836768f8f0154f8f86e5e14c2bb7e74132e.tar.gz -C ./breakpad
cd breakpad

打补丁

cd /home
wget git clone https://chromium.googlesource.com/linux-syscall-support
unzip linux-syscall-support.zip
mkdir -p /home/breakpad/src/third_party/lss
cp /home/linux-syscall-support/linux_syscall_support.h /home/breakpad/src/third_party/lss/
cp /home/native-toolchain-master/source/breakpad/breakpad-97a98836768f8f0154f8f86e5e14c2bb7e74132e-patches/* /home/breakpad
patch -p1 < 0001-Add-basic-support-for-dwz-dwarf-extension.patch
patch -p1 < 0002-Build-breakpad-97a98836-on-ppc64le.patch

编译

./configure --prefix=/usr/local/breakpad
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/breakpad /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv breakpad breakpad-97a98836768f8f0154f8f86e5e14c2bb7e74132e-p2

3.14.编译安装glog-0.3.4
下载glog包并解压

cd /home
wget https://github.com/google/glog/archive/v0.3.4.zip
unzip v0.3.4.zip
cd glog-0.3.4

打补丁

cp /home/native-toolchain-master/source/glog/glog-0.3.4-patches/* /home/glog-0.3.4
patch -p1 < 0001-Allow-glog-to-accept-a-message-listener.patch
patch -p1 < 0002-Preserve-custom-signal-handler-for-dcheck.patch
patch -p1 < 0003-rate-limit-calls-to-posix_fadvise.patch

编译

./configure --with-pic --prefix=/usr/local/glog-0.3.4 CFLAGS="-fPIC -DPIC" -build=arm
make -j
make install

拷贝信息到toolchain

cp -r /usr/local/glog-0.3.4 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv glog-0.3.4 glog-0.3.4-p3

3.15.编译安装avro-1.7.4
下载avro包并解压

cd /home
wget https://archive.apache.org/dist/avro/avro-1.7.4/avro-src-1.7.4.tar.gz
tar -zxvf avro-src-1.7.4.tar.gz
cd avro-src-1.7.4

打补丁

cp /home/native-toolchain-master/source/avro/avro-1.7.4-patches/* /home/avro-src-1.7.4
patch -p2 < 0001-Patch-Avro-library-to-support-schemas-with-default-v.patch
patch -p2 < 0002-Changes-to-Avro-C-library-to-allow-parsing-decimal-s.patch
patch -p2 < 0003-IMPALA-1136-Skip-u0000-characters-when-dealing-Avro-.patch
patch -p2 < 0004-AVRO-1617-Fix-equality-checking-of-record-schemas.patch
patch -p2 < 0005-Changes-to-Avro-C-library-to-allow-parsing-DATE.patch

编译

cd lang/c
mkdir -p build
cd build
cmake -DCMAKE_BUILD_TYPE=Release -DCMAKE_INSTALL_PREFIX=/usr/local/avro-1.7.4 ..
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/avro-1.7.4 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv avro-1.7.4 avro-1.7.4-p4

3.16.编译安装gperftools-2.5

下载gperftools包并解压

cd /home
wget https://github.com/gperftools/gperftools/archive/refs/tags/gperftools-2.5.tar.gz
tar -zxvf gperftools-2.5.tar.gz
cd gperftools-gperftools-2.5

编译

./autogen.sh
./configure --enable-frame-pointers --with-pic --enable-emergency-malloc -- prefix=/usr/local/gperftools-2.5
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/gperftools-2.5 /home/impala-3.2.0/toolchain/

3.17.编译安装gflags-2.2.0

下载gflags包并解压

cd /home
wget https://github.com/gflags/gflags/archive/refs/tags/v2.2.0.tar.gz
tar -zxvf v2.2.0.tar.gz
cd gflags-2.2.0

打补丁

cp /home/native-toolchain-master/source/gflags/gflags-2.2.0-patches/* /home/gflags-2.2.0
patch -p1 < 0001-Allow-hidden-flags-e.g.-DEFINE_int32_hidden.patch
patch -p1 < 0002-Add-show_hidden-parameter-in-GetAllFlags-function.patch

编译

mkdir build
cd build
cmake -DBUILD_STATIC_LIBS=ON -DBUILD_SHARED_LIBS=ON -DCMAKE_INSTALL_PREFIX=/usr/local/gflags-2.2.0 -DCMAKE_BUILD_TYPE=RELEASE ..
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/gflags-2.2.0 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv gflags-2.2.0 gflags-2.2.0-p2

3.18.编译安装binutils-2.26.1

下载binutils包并解压

cd /home
wget https://ftp.gnu.org/gnu/binutils/binutils-2.26.1.tar.gz
tar -zxvf binutils-2.26.1.tar.gz
cd binutils-2.26.1

编译

./configure --enable-gold --enable-plugins --disable-x86-relax-relocations --prefix=/usr/local/binutils-2.26.1
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/binutils-2.26.1 /home/impala-3.2.0/toolchain/

3.19.编译安装flatbuffers-1.6.0
下载flatbuffers包并解压

cd /home
wget https://github.com/google/flatbuffers/archive/refs/tags/v1.6.0.tar.gz
tar -zxvf v1.6.0.tar.gz
cd flatbuffers-1.6.0

编译

mkdir build
cd build
cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX=/usr/local/flatbuffers-1.6.0 ..
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/flatbuffers-1.6.0 /home/impala-3.2.0/toolchain/

3.20.编译安装bzip2-1.0.6

下载bzip包并解压

cd /home
wget wget https://sourceware.org/pub/bzip2/bzip2-1.0.6.tar.gz
tar -zxvf bzip2-1.0.6.tar.gz
cd bzip2-1.0.6

打补丁

cp /home/native-toolchain-master/source/bzip2/bzip2-1.0.6-patches/* /home/bzip2-1.0.6
patch -p1 < 001-adjust-makefile-to-env-variables.diff
patch -p2 < 002-directoryless-executable-symlinks.diff

编译

CFLAGS="-fPIC -DPIC" CXXFLAGS="$CXXFLAGS -fPIC -DPIC" make install PREFIX=/usr/local/bzip2-1.0.6

拷贝信息到toolchain

cp -r /usr/local/bzip2-1.0.6 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv bzip2-1.0.6 bzip2-1.0.6-p2

3.21.编译安装crcutil

下载crcutil包并解压

cd /home
wget http://d3dr9sfxru4sde.cloudfront.net/crcutil-440ba7babeff77ffad992df3a10c767f184e946e.tar.gz
tar -zxvf crcutil-440ba7babeff77ffad992df3a10c767f184e946e.tar.gz
cd crcutil-440ba7babeff77ffad992df3a10c767f184e946e

打补丁

cp /home/native-toolchain-master/source/crcutil/crcutil-440ba7babeff77ffad992df3a10c767f184e946e-patches/* /home/crcutil-440ba7babeff77ffad992df3a10c767f184e946e
patch -p1 < 0001-Build-crcutil-440ba7b-on-ppc64le.patch
patch -p1 < 0002-Build-crcutil-440ba7b-on-aarch64.patch

编译

./autogen.sh
./configure --with-pic --prefix=/usr/local/crcutil-440ba7babeff77ffad992df3a10c767f184e946e
make -j
make install

拷贝信息到toolchain

cp -r /usr/local/crcutil-440ba7babeff77ffad992df3a10c767f184e946e /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv crcutil-440ba7babeff77ffad992df3a10c767f184e946e crcutil-440ba7babeff77ffad992df3a10c767f184e946e-p1

3.22.编译安装cctz-2.2

下载cctz包并解压

cd /home
wget https://github.com/google/cctz/archive/refs/tags/v2.2.tar.gz
tar -zxvf v2.2.tar.gz
cd cctz-2.2

修改Makefile文件

vim Makefile
修改35行内容
PREFIX ?= /usr/local/cctz-2.2

编译

make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/cctz-2.2 /home/impala-3.2.0/toolchain/

3.23.编译安装gdb-7.9.1

下载gdb包并解压

cd /home
wget http://ftp.gnu.org/gnu/gdb/gdb-7.9.1.tar.gz
tar -zxvf gdb-7.9.1.tar.gz
cd gdb-7.9.1

打补丁

cp /home/native-toolchain-master/source/gdb/gdb-7.9.1-patches/* /home/gdb-7.9.1
patch -p1 < 0001-Based-on-https-sourceware.org-ml-gdb-patches-2016-08.patch

编译安装依赖包termcap

cd /home
wget wget https://ftp.gnu.org/gnu/termcap/termcap-1.3.1.tar.gz
tar -zxvf termcap-1.3.1.tar.gz
cd termcap-1.3.1/
./configure --prefix=/usr/local/termcap-1.3.1 --build=arm-linux
make -j
make install -j

编译

cd /home/gdb-7.9.1
./configure --prefix=/usr/local/gdb-7.9.1
make -j
make install -j

查看版本

cd /usr/local/gdb-7.9.1/bin
./gdb --version

拷贝信息到toolchain

cp -r /usr/local/gdb-7.9.1 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv gdb-7.9.1 gdb-7.9.1-p1

3.24.编译安装gtest-1.6.0

下载gtest包并解压

cd /home
wget https://codeload.github.com/google/googletest/zip/release-1.6.0
mv release-1.6.0 gtest-1.6.0.zip
unzip gtest-1.6.0.zip
cd googletest-release-1.6.0

编译

mkdir build
cd build
cmake -DCMAKE_INSTALL_PREFIX=/usr/local/gtest-1.6.0 ..
make -j

拷贝信息到toolchain

mkdir -p /home/impala-3.2.0/toolchain/gtest-1.6.0
mkdir -p /home/impala-3.2.0/toolchain/gtest-1.6.0/lib
cp -r /home/googletest-release-1.6.0/include/ /home/impala-3.2.0/toolchain/gtest-1.6.0
cp /home/googletest-release-1.6.0/build/*.a /home/impala-3.2.0/toolchain/gtest-1.6.0/lib
cp -arf /home/googletest-release-1.6.0/* /home/impala-3.2.0/toolchain/gtest-1.6.0

3.25.编译安装libev-4.20

下载libev包并解压

cd /home
wget https://src.fedoraproject.org/lookaside/pkgs/libev/libev-4.20.tar.gz/1cac539cfc560f381a490c9fba940de9/libev-4.20.tar.gz
tar -zxvf libev-4.20.tar.gz
cd libev-4.20

编译

./configure --prefix=/usr/local/libev-4.20
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/libev-4.20 /home/impala-3.2.0/toolchain/

3.26.编译安装libunwind-1.3-rc1
下载libunwind包并解压

cd /home
wget https://github.com/libunwind/libunwind/archive/refs/tags/v1.3-rc1.zip
unzip v1.3-rc1.zip
cd libunwind-1.3-rc1

编译

./autogen.sh
./configure --prefix=/usr/local/libunwind-1.3-rc1
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/libunwind-1.3-rc1 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv libunwind-1.3-rc1 libunwind-1.3-rc1-p3

3.27.编译安装orc-1.5.5

下载orc包并解压

cd /home
wget https://github.com/apache/orc/archive/refs/tags/rel/release-1.5.5.zip
unzip release-1.5.5.zip
cd orc-rel-release-1.5.5

打补丁

cp /home/native-toolchain-master/source/orc/orc-1.5.5-patches/* /home/orc-rel-release-1.5.5
patch -p1 < 0001-ORC-396-also-look-for-LZ4-libs-in-lib64-subdir.patch

编译

mkdir build
cd build
cmake .. -DBUILD_JAVA=OFF -DCMAKE_INSTALL_PREFIX=/home/impala-3.2.0/toolchain/orc-1.4.3-p3
make -j
make install -j

3.28.编译安装Doxygen-1.8.16

下载doxygen包并解压

cd /home
wget https://codeload.github.com/doxygen/doxygen/tar.gz/Release_1_8_16
tar -zxvf Release_1_8_16
cd doxygen-Release_1_8_16

编译

mkdir build
cd build
cmake -G "Unix Makefiles" -DCMAKE_INSTALL_PREFIX=/usr/local/doxygen-1.8.16 ..
make -j
make install -j

配置环境变量

vim /etc/profile

最后新增如下内容

export PATH=/usr/local/doxygen-1.8.16/bin:$PATH
source /etc/profile

查看版本

doxygen --version

3.29.编译安装rapidjson-1.1.0

下载rapidjson包并解压

cd /home
wget https://github.com/Tencent/rapidjson/archive/refs/tags/v1.1.0.tar.gz
tar -zxvf v1.1.0.tar.gz
cd rapidjson-1.1.0

编译

git init
git submodule update --init
mkdir build
cd build
cmake .. -DCMAKE_INSTALL_PREFIX=/usr/local/rapidjson-1.1.0

vim /home/rapidjson-1.1.0/CMakeLists.txt

修改53和76行内容

-march=native 改为 -march=armv8-a+crc
make -j
make install -j

拷贝信息到toolchain

cp -r /usr/local/rapidjson-1.1.0 /home/impala-3.2.0/toolchain/

3.30.编译安装tpc-h-2.17.0

下载tpc-h包并解压

cd /home
git clone https://github.com/gregrahn/tpch-kit.git
cd tpch-kit

编译

cd dbgen
make MACHINE=LINUX DATABASE=POSTGRESQL

拷贝信息到toolchain

mkdir -p /home/impala-3.2.0/toolchain/tpc-h-2.17.0

3.31.编译安装tpc-ds-2.1.0

下载tpc-ds包并解压

cd /home
wget https://github.com/RunningJon/TPC-DS/archive/refs/heads/2.1.0.zip
unzip 2.1.0.zip
cd TPC-DS-2.1.0

编译

cd 00_compile_tpcds/tools
make

拷贝信息到toolchain

mkdir -p /home/impala-3.2.0/toolchain/tpc-ds-2.1.0/
cp /home/TPC-DS-2.1.0/00_compile_tpcds/tools/ds* /home/impala-3.2.0/toolchain/tpc-ds-2.1.0/

3.32.编译安装kudu

kudu编译很麻烦所以直接下载编译好的拷贝信息到kudu-5211897

wget https://native-toolchain.s3.amazonaws.com/build/cdh_components/1173663/tarballs/kudu-1.10.0-cdh6.x-SNAPSHOT-redhat7.tar.gz
tar -zxvf kudu-1.10.0-cdh6.x-SNAPSHOT-redhat7.tar.gz
cp -r kudu-1.10.0 /home/impala-3.2.0/toolchain/
cd /home/impala-3.2.0/toolchain/
mv kudu-1.10.0 kudu-5211897

4.重新编译Impala

1、执行编译

cd /home/impala-3.2.0
export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

出现错误 make[3]: *** [be/build/debug/service/impalad] Error 1 make[2]:
*** [be/src/service/CMakeFiles/impalad.dir/all] Error 2 make[1]: *** [be/src/service/CMakeFiles/impalad.dir/rule] Error 2 make: ***
[impalad] Error 2

解决方案 这个可以归于impala的一个bug，原因是调用了glog-0.3.4 中的logging.h头文件
然后本地os层面也安装了glog-0.3.4出现的报错

  1. 移除 os 层面安装的 glog 的头文件. 以及对应lib.
  2. 将 /home/impala-3.2.0/toolchain/glog-0.3.4-p3/include/glog copy 到/usr/local/include 下面
    /home/impala-3.2.0/toolchain/glog-0.3.4-p3/lib/* copy 到 /usr/local/lib 下面.

2、执行编译

cd /home/impala-3.2.0
export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

编译完成后出现测试报错
在这里插入图片描述

解决方案：修改错误的仓库地址

vim /home/impala-3.2.0/impala-parent/pom.xml
修改121、132行内容
<url>https://repository.cloudera.com/content/repositories/third-party</url>
改为
<url>https://repository.cloudera.com/artifactory/public/</url>

在这里插入图片描述

3、执行编译

cd /home/impala-3.2.0
export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

出现报错
在这里插入图片描述

修改文件

mkdir -p /home/impala-3.2.0/toolchain/thrift-0.9.3-p5/python/lib64/python2.7/site-packages
cp -r /usr/lib64/python2.7/site-packages/thrift /home/impala-3.2.0/toolchain/thrift-0.9.3-p5/python/lib64/python2.7/site-packages

4、执行编译

export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -skiptests -notests -release

在这里插入图片描述

编译完成后，编译debug

export IMPALA_HOME=/home/impala-3.2.0
./buildall.sh -v

5.生成impala-build服务目录

1、创建脚本，生成服务路径

#!/bin/bash
IMPALA_HOME=/home/impala-3.2.0
IMPALA_BUILD=/home/impala-build
#if exist the dest directory then clear it.
if [ -d "${IMPALA_BUILD}" ]; then
        rm -rf ${IMPALA_BUILD}/*
else
        mkdir -p ${IMPALA_BUILD}
fi

mkdir -p ${IMPALA_BUILD}/etc/default/
mkdir -p ${IMPALA_BUILD}/etc/hadoop/
mkdir -p ${IMPALA_BUILD}/be
mkdir -p ${IMPALA_BUILD}/lib64/
mkdir ${IMPALA_BUILD}/hadoop/
mkdir ${IMPALA_BUILD}/dependency/
mkdir ${IMPALA_BUILD}/shell

cp -rf ${IMPALA_HOME}/be/build/debug/* ${IMPALA_BUILD}/be/
cp -rf ${IMPALA_HOME}/toolchain/gcc-4.9.2/lib64/*   ${IMPALA_BUILD}/lib64/
cp -rf ${IMPALA_HOME}/fe/target/impala-frontend-0.1-SNAPSHOT.jar   ${IMPALA_BUILD}/dependency/
cp -rf ${IMPALA_HOME}/fe/target/dependency/*      ${IMPALA_BUILD}/dependency/
cp -rf ${IMPALA_HOME}/shell/build/impala-shell-3.2.0-SNAPSHOT/*   ${IMPALA_BUILD}/shell
cp -r ${IMPALA_HOME}/www ${IMPALA_BUILD}/

echo "Finished"

6.编译Impala3.3.0、3.1.0

依赖版本大致一样，根据上述编译后的依赖打包，放入所需要编译的impala版本进行验证。

impala-3.3.0的cmake版本为3.14.3
wget https://github.com/Kitware/CMake/releases/download/v3.14.3/cmake-3.14.3.tar.gz
tar -zxvf cmake-3.14.3.tar.gz
cd cmake-3.14.3
./bootstrap
./configure --prefix=/usr/local/cmake-3.14.3
make -j
make install

/usr/local/cmake-3.14.3替换到impala-3.3.0/toolchain/cmake-3.14.3目录
下载Impala-3.3.0

cd /home/
wget https://codeload.github.com/apache/impala/tar.gz/refs/tags/3.3.0
tar -zxvf 3.3.0
cd /home/impala-3.3.0/

按照以上步骤来搭建3.3.0，修改地方如下:

cp toolchain-3.3.0.tar.gz /home/impala-3.3.0/
cd /home/impala-3.3.0/
rm -rf toolchain
tar -zxvf toolchain-3.3.0.tar.gz

将toolchain中的cmake拷贝/usr/local/下

cd /home/impala-3.3.0/toolchain/
cp -r cmake-3.14.3 /usr/local
vim /etc/profile
export PATH=/usr/local/cmake-3.14.3/bin:$PATH
source /etc/profile
cmake --version #确认版本正确

编译结果出现如下证明成功
在这里插入图片描述

下载Impala-3.1.0

cd /home/
wget https://github.com/apache/impala/archive/refs/tags/3.1.0.tar.gz
tar -zxvf 3.1.0.tar.gz
cd /home/impala-3.1.0/

按照以上步骤来搭建3.3.0，修改地方如下:

cp toolchain-3.1.0.tar.gz /home/impala-3.1.0/
cd /home/impala-3.1.0/
rm -rf toolchain
tar -zxvf toolchain-3.1.0.tar.gz

将toolchain中的cmake拷贝/usr/local/下

cd /home/impala-3.1.0/toolchain/
cp -r cmake-3.8.2-p1 /usr/local
cd /usr/local/
mv cmake-3.8.2-p1 cmake-3.8.2
vim /etc/profile
export PATH=/usr/local/cmake-3.8.2/bin:$PATH
source /etc/profile
cmake --version #确认版本正确

编译结果出现如下证明成功
在这里插入图片描述

7.小结

编译impala的过程，出现的错误刚开始是环境依赖项的问题，安装完所需要的依赖后编译，出现缺 少包、对应的组件源码包未能下载，然后找相对应的包进行编译的过程消耗了大量时间，解决报错的过程存在的问题是不能很快去找到问题的原因，从而不能及时处理问题但最后都相应的解决了各个错误问题编译成功，然后编译完成后会进行对应依赖组件的测试，测试过程出现maven库的环境问题导致整体的测试无法通过，无法清除缓存然后进行进一步的重新编译，因为提前把所需要的依赖都编译好了，重新编译的时候很快，出现的仓库问题也相应的解决.

猜你喜欢

转载自blog.csdn.net/qq_51228157/article/details/125988634
今日推荐
火速冲上 GitHub 热榜 —— 开源编程语言、框架哪有这么可爱？
北京人形机器人创新中心发布全球首个纯电驱拟人奔跑的全尺寸人形机器人“天工”
LFOSSA 源来如此公开课 | 掌握云原生未来：CNCF 认证全面攻略与备考秘籍
国产云输入法——仅华为无云端数据上传安全问题
开源日报 | 工业开源项目OGG 1.0；姐姐，你要和我一起配置火狐吗；苹果AI遥遥落后？Fedora 40
开放签电子签章：停止新增，优化体验，前进更进（五一假期前工作）
周排行
Metasploit文件目录与入侵基本概念
跨域(CORS)请求问题[No 'Access-Control-Allow-Origin' header is present on the requested resource]常见解决方案
CodeIgniter 源码解读之 CodeIgniter.php（二）
SAS入门之（四）改变数据类型
初识元组
[数学建模]数学建模算法和模型（B站视频）（二）
Nginx 服务器源码安装配置流程
C#实现语音视频录制 【基于MCapture + MFile】
开发进度4
下载安装vue的方法网址
每日归档
更多
2024-04-28(0)
2024-04-27(56)
2024-04-26(39)
2024-04-25(22)
2024-04-24(36)
2024-04-23(26)
2024-04-22(39)
2024-04-21(0)
2024-04-20(6)
2024-04-19(5)

代码天地 © 2018 codetd.com

境外服务器   最新电视剧2022