使用 miller shell 命令为每一行创建带有值对的 HASH-ID 键并将其附加到包含 JSON 个对象的文件中

Question

我希望根据每个 JSON object

中的所有值为我的 JSONs 文件中的每一行创建一个 unique-ID/hash-ID

我从这里开始，但不确定我是否必须是显式列名，或者是否有一种方法可以包含所有列而无需明确列名。

mlr --json put -S '$hash_id=$f_name."".$l_name."".$title' then reorder -e -f job file.json

file.json 输入：

{"f_nams":"Hana","title":"Mrs","l_name":"Smith"}
{"f_nams":"Mike","title":"Mr","l_name":"Larry"}
{"f_nams":"Jhon","title":"Mr","l_name":"Doe"}

期望的输出：

{"f_nams":"Hana","title":"Mrs","l_name":"Smith","hash_id":"hash_value_based_on_all_columns"}
{"f_nams":"Mike","title":"Mr","l_name":"Larry","hash_id":"hash_value_based_on_all_columns"}
{"f_nams":"Jhon","title":"Mr","l_name":"Doe","hash_id":"hash_value_based_on_all_columns"}

Answer 1

假设输入 file.json 的格式如下所示：

cat file.json
{"f_nams":"Hana","title":"Mrs","l_name":"Smith"}
{"f_nams":"Mike","title":"Mr","l_name":"Larry"}
{"f_nams":"Jhon","title":"Mr","l_name":"Doe"}

然后一种方法是使用以下 perl 脚本来生成所需的输出：

perl -MMIME::Base64 -ne '
/"f_nams":"(\w+)","title":"(\w+)","l_name":"(\w+)"/ && do {
($fn,$tt,$ln)=(,,);
$x=$fn . $tt . $ln;
chomp($hashvalue = encode_base64($x));
s/\}/,"hash_id":"$hashvalue"\}/;print}' file.json

生产：

{"f_nams":"Hana","title":"Mrs","l_name":"Smith","hash_id":"SGFuYU1yc1NtaXRo"}
{"f_nams":"Mike","title":"Mr","l_name":"Larry","hash_id":"TWlrZU1yTGFycnk="}
{"f_nams":"Jhon","title":"Mr","l_name":"Doe","hash_id":"Smhvbk1yRG9l"}

使用 miller shell 命令为每一行创建带有值对的 HASH-ID 键并将其附加到包含 JSON 个对象的文件中

Create and append HASH-ID key with value pairs to a file of JSON objects for each row using miller shell command

json

linux

shell

cmd

miller