bazel rules_go:将 go binary 链接到工作区中另一个目标生成的静态 c++ 库(.a 文件)
bazel rules_go: linking go binary against a static c++ library (.a file) produced by another target in the workspace
我在我的 go 二进制文件中使用 confluent-kafka-go 库,这个库需要针对 librdkafka linked。我项目中的其他目标使用 librdkakfa,因此我使用 rules_foreign_cc 的 cmake_external 规则生成了静态 librdkafka.a 和 librdkafka++.a:
//this is my "third_party/kafka/BUILD" file:
load("@rules_foreign_cc//tools/build_defs:cmake.bzl", "cmake_external")
cmake_external(
name = "librdkafka",
cache_entries = {
"RDKAFKA_BUILD_STATIC": "ON",
"WITH_ZSTD": "OFF",
"WITH_SSL": "OFF",
"WITH_SASL": "OFF",
"ENABLE_LZ4_EXT": "OFF",
"WITH_LIBDL": "OFF",
},
lib_source = "@kafka//:all",
static_libraries = [
"librdkafka++.a",
"librdkafka.a",
],
visibility = ["//visibility:public"],
)
生成 librdkafka 库和 headers 就好了:
$ bazel build //third_party/kafka:librdkafka
INFO: Analysed target //third_party/kafka:librdkafka (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
Target //third_party/kafka:librdkafka up-to-date:
bazel-genfiles/third_party/kafka/librdkafka/include
bazel-genfiles/third_party/kafka/librdkafka/lib/librdkafka++.a
bazel-genfiles/third_party/kafka/librdkafka/lib/librdkafka.a
bazel-genfiles/third_party/kafka/copy_librdkafka/librdkafka
bazel-genfiles/third_party/kafka/librdkafka/logs/CMake_script.sh
bazel-genfiles/third_party/kafka/librdkafka/logs/CMake.log
bazel-genfiles/third_party/kafka/librdkafka/logs/wrapper_script.sh
INFO: Elapsed time: 0.187s, Critical Path: 0.00s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
现在我正在尝试 link 反对 librdkafka.a(我不需要 librdkafka++.a 文件,只需要 c 版本)在我的 go_binary 规则中:
go_binary(
name = "foo",
srcs = ["foo.go"],
cdeps = [
"//third_party/kafka:librdkafka",
],
cgo = "True",
static = "on",
visibility = ["//visibility:public"],
deps = [
":ox_go_proto",
"@com_github_confluentinc_confluent_kafka_go//kafka:go_default_library",
"@com_github_golang_protobuf//proto:go_default_library",
],
)
但是当我 运行 bazel build //foo:foo
(我的二进制文件)
时,我得到了数百个未定义的 rdkafka 引用
unction _cgo_52d112b951a8_Cfunc_rd_kafka_AdminOptions_destroy: error: undefined reference to 'rd_kafka_AdminOptions_destroy'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_AlterConfigs: error: undefined reference to 'rd_kafka_AlterConfigs'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_AlterConfigs_result_resources: error: undefined reference to 'rd_kafka_AlterConfigs_result_resources'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_ConfigEntry_is_read_only: error: undefined reference to 'rd_kafka_ConfigEntry_is_read_only'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_ConfigEntry_is_sensitive: error: undefined reference to 'rd_kafka_ConfigEntry_is_sensitive'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_ConfigEntry_is_synonym: error: undefined reference to 'rd_kafka_ConfigEntry_is_synonym'
bazel-out/k8-
你很接近,但你需要将 cdeps 添加到融合的 Kafka go 库中,而不是你的 go_binary 目标。我假设您正在使用 Gazelle 和 rules_go 来拉入外部部门。您需要使用 go_repository “patch” 属性传递一个补丁文件,以便在生成的 BUILD 文件中对其进行排序。
我在最近的博客中记录了这一点 post:
https://rotemtam.com/2020/10/30/bazel-building-cgo-bindings/
我在我的 go 二进制文件中使用 confluent-kafka-go 库,这个库需要针对 librdkafka linked。我项目中的其他目标使用 librdkakfa,因此我使用 rules_foreign_cc 的 cmake_external 规则生成了静态 librdkafka.a 和 librdkafka++.a:
//this is my "third_party/kafka/BUILD" file:
load("@rules_foreign_cc//tools/build_defs:cmake.bzl", "cmake_external")
cmake_external(
name = "librdkafka",
cache_entries = {
"RDKAFKA_BUILD_STATIC": "ON",
"WITH_ZSTD": "OFF",
"WITH_SSL": "OFF",
"WITH_SASL": "OFF",
"ENABLE_LZ4_EXT": "OFF",
"WITH_LIBDL": "OFF",
},
lib_source = "@kafka//:all",
static_libraries = [
"librdkafka++.a",
"librdkafka.a",
],
visibility = ["//visibility:public"],
)
生成 librdkafka 库和 headers 就好了:
$ bazel build //third_party/kafka:librdkafka
INFO: Analysed target //third_party/kafka:librdkafka (0 packages loaded, 0 targets configured).
INFO: Found 1 target...
Target //third_party/kafka:librdkafka up-to-date:
bazel-genfiles/third_party/kafka/librdkafka/include
bazel-genfiles/third_party/kafka/librdkafka/lib/librdkafka++.a
bazel-genfiles/third_party/kafka/librdkafka/lib/librdkafka.a
bazel-genfiles/third_party/kafka/copy_librdkafka/librdkafka
bazel-genfiles/third_party/kafka/librdkafka/logs/CMake_script.sh
bazel-genfiles/third_party/kafka/librdkafka/logs/CMake.log
bazel-genfiles/third_party/kafka/librdkafka/logs/wrapper_script.sh
INFO: Elapsed time: 0.187s, Critical Path: 0.00s
INFO: 0 processes.
INFO: Build completed successfully, 1 total action
现在我正在尝试 link 反对 librdkafka.a(我不需要 librdkafka++.a 文件,只需要 c 版本)在我的 go_binary 规则中:
go_binary(
name = "foo",
srcs = ["foo.go"],
cdeps = [
"//third_party/kafka:librdkafka",
],
cgo = "True",
static = "on",
visibility = ["//visibility:public"],
deps = [
":ox_go_proto",
"@com_github_confluentinc_confluent_kafka_go//kafka:go_default_library",
"@com_github_golang_protobuf//proto:go_default_library",
],
)
但是当我 运行 bazel build //foo:foo
(我的二进制文件)
unction _cgo_52d112b951a8_Cfunc_rd_kafka_AdminOptions_destroy: error: undefined reference to 'rd_kafka_AdminOptions_destroy'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_AlterConfigs: error: undefined reference to 'rd_kafka_AlterConfigs'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_AlterConfigs_result_resources: error: undefined reference to 'rd_kafka_AlterConfigs_result_resources'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_ConfigEntry_is_read_only: error: undefined reference to 'rd_kafka_ConfigEntry_is_read_only'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_ConfigEntry_is_sensitive: error: undefined reference to 'rd_kafka_ConfigEntry_is_sensitive'
bazel-out/k8-fastbuild/bin/external/com_github_confluentinc_confluent_kafka_go/kafka/_objs/go_default_library%linux_amd64%cgo_c_lib/adminapi.cgo2.pic.o:adminapi.cgo2.c:function _cgo_52d112b951a8_Cfunc_rd_kafka_ConfigEntry_is_synonym: error: undefined reference to 'rd_kafka_ConfigEntry_is_synonym'
bazel-out/k8-
你很接近,但你需要将 cdeps 添加到融合的 Kafka go 库中,而不是你的 go_binary 目标。我假设您正在使用 Gazelle 和 rules_go 来拉入外部部门。您需要使用 go_repository “patch” 属性传递一个补丁文件,以便在生成的 BUILD 文件中对其进行排序。
我在最近的博客中记录了这一点 post:
https://rotemtam.com/2020/10/30/bazel-building-cgo-bindings/