You have a Microsoft Azure Data Factory pipeline that contains an input dataset.
You need to ensure that the data from Azure Table Storage is copied only if the table contains 1,000 records or more.
Which policy setting should you use in JSON?
A. "policy":
{
"validation":
{
"minimum":1000
}
}
B. "policy":
{
"validation":
{
"sqlRows":1000
}
}
C. "policy":
}
"validation":
}
"minimumRows":1000
}
}
D. "policy":
}
"validation":
{
"sqlMinimumRows":1000
}
}
Correct Answer: B
Explanation/Reference:
The following JSON defines a Linux-based on-demand HDInsight linked service. The Data Factory service automatically creates a Linux-based HDInsight cluster to process the required activity.
{
"name": "HDInsightOnDemandLinkedService", "properties":
{
"type": "HDInsightOnDemand", "typeProperties":
{
"clusterType": "hadoop", "clusterSize": 1,
"clusterSize": 1, "timeToLive": "00:15:00",
"timeToLive": "00:15:00", "hostSubscriptionId": "<subscription ID>",
"hostSubscriptionId": "<subscription ID>", "servicePrincipalId": "<service principal ID>",
"servicePrincipalId": "<service principal ID>", "servicePrincipalKey":
{
"value": "<service principal key>", "type": "SecureString"
},
"tenant": "<tenent id>", "clusterResourceGroup": "<resource group name>",
"clusterResourceGroup": "<resource group name>", "version": "3.6",
"version": "3.6", "osType": "Linux",
"osType": "Linux", "linkedServiceName":
{
"referenceName": "AzureStorageLinkedService", "type": "LinkedServiceReference"
}
},
"connectVia":
{
"referenceName": "<name of Integration Runtime>", "type": "IntegrationRuntimeReference"
}
}
}
References: https://docs.microsoft.com/en-us/azure/data-factory/compute-linked-services