通过 Azure Datafactory V2 将简单 Json 导入 Sql table

Question

我想将每日 JSON 文件从 Azure Datalake V2 blob 复制到 Azure Sql 数据库 Table

--简单JSON代码结构

{
    "EmpRec": [{
            "PersNo": 5553345,
            "FirstName": "David",
            "LastName": "Bishop",
            "ContrType": "Permanent",
            "Age": 45,
            "Length": 5,
            "Wsr": "1001WK01 ",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "35,12",
            "SeptTHome": "50,40",
            "AugTHome": "10,0",
            "Site": "Home Depot",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553346,
            "FirstName": "Norris",
            "LastName": "OFdachuck",
            "ContrType": "Permanent",
            "Age": 42,
            "Length": 2,
            "Wsr": "1001WK012",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "66,35",
            "SeptTHome": "72,32",
            "AugTHome": "68,02",
            "Site": "Normandy",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553347,
            "FirstName": "List",
            "LastName": "Forbes",
            "ContrType": "Permanent",
            "Age": 30,
            "Length": 1,
            "Wsr": "1001WK011",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "35,12",
            "SeptTHome": "68,02",
            "AugTHome": "66,31",
            "Site": "Normandy",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553348,
            "FirstName": "Childs",
            "LastName": "Play",
            "ContrType": "Delivery",
            "Age": 25,
            "Length": 3,
            "Wsr": "1001WK10",
            "WorkSchedule": "Office Workers ",
            "OctTHome": "Office Workers ",
            "SeptTHome": "50,40",
            "AugTHome": "10,0",
            "Site": "Balamb Garden",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }, {
            "PersNo": 5553349,
            "FirstName": "Rob",
            "LastName": "Black",
            "ContrType": "Permanent",
            "Age": 28,
            "Length": 10,
            "Wsr": "1001WK05",
            "WorkSchedule": "Packing",
            "OctTHome": "66,35",
            "SeptTHome": "72,32",
            "AugTHome": "68,02",
            "Site": "Fisherman's Horizon",
            "SDate": "2012-04-17 ",
            "EDate": "2016-04-17 ",
            "Status": "Active",
            "Group": "Citizen",
            "Subarea": "Citizen",
            "SubGroup": "Citizen",
            "Position": "Driver",
            "Organization": "Loading RD"
        }
    ]

预计要上传 5 条记录，但只加载了第一条记录。有没有关于加载 JSON 到 SQL 的好教程？ ADFV2 可以处理这个问题还是我应该恢复为 OPENJSON ?

Answer 1

所以我设法将一些 Azure SQL 数据提取到 JSON，这是警告。 JSON 和 XML 一样有多个结构。确保您的 JSON 处于 ADFV2 数据导入和导出的最扁平形式。

假设右侧的 JSON 可能会加载多个表，只是不确定此时 ADFV2 是否能够将任何 JSON 格式复制到 Azure SQL 数据库表。

Answer 2

Json 是受支持的文件格式，您必须创建数据集并正确配置它。请记住在发布管道和运行之前使用 "preview data" 按钮查看配置是否正常工作。

Link 到文档： https://docs.microsoft.com/en-us/azure/data-factory/format-json

希望对您有所帮助！

通过 Azure Datafactory V2 将简单 Json 导入 Sql table

Import Simple Json into Sql table via Azure Datafactory V2

database

json

azure

azure-data-factory-2