颠簸转换：从 json（列表元素）中删除重复项

Question

我正在寻找一些输入来从类似于以下示例的 json 字符串中删除重复项：

示例输入：

{
  "profile": true,
  "address": [
    "12",
    "23"
  ],
  "zipCodes": [
    "12345",
    "56789",
    "12345",
    "56789"
  ],
  "phoneNumber": [
    "87857",
    "927465",
    "274894",
    "87857"
  ],
  "userName": [
    "ABC",
    "PQR",
    "ABC"
  ],
  "enableEmailNot": "No"
}

预期输出：

{
  "profile": true,
  "zipCodes": [
    "12345",
    "56789"
  ],
  "phoneNumber": [
    "87857",
    "927465",
    "274894"
  ],
  "userName": [
    "ABC",
    "PQR"
  ],
  "address": [
    "12",
    "23"
  ],
  "enableEmailNot": "No"
}

感谢您的帮助

Answer 1

您可以使用以下规格

[
  {
   // exchange key-value pairs while seperating lists and non-lists by prefixing "xx" non-lists

    "operation": "shift",
    "spec": {
      "profile": "xx.&",
      "*": {
        "*": {
          "$": "&2.@(0)"
        }
      },
      "enableEmailNot": "xx.&"
    }
  },
  {
   // pick the first components of lists  
    "operation": "cardinality",
    "spec": {
      "*": {
        "*": "ONE"
      }
    }
  },
  {
   // reform the lists through use of "$" operator   
    "operation": "shift",
    "spec": {
      "xx": {
        "*": "&"
      },
      "*": {
        "*": {
          "$": "&2[]"
        }
      }
    }
  }
]

颠簸转换：从 json（列表元素）中删除重复项

jolt transformation : remove duplicates from json (list elements)

jolt