Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
Spark Environment Events.
Table attributes
| Attribute | Value |
|---|---|
| Resource types | microsoft.hdinsight/clusters |
| Categories | Azure Resources |
| Solutions | LogManagement |
| Basic log | No |
| Ingestion-time transformation | Yes |
| Sample Queries | - |
Columns
| Column | Type | Description |
|---|---|---|
| ApplicationId | string | The application ID of the application producing the record. |
| _BilledSize | real | The record size in bytes |
| ClusterDnsName | string | The DNS name of the cluster running the application. |
| ClusterTenantId | string | The tenant ID of the cluster running the application. |
| Host | string | The FQDN of the host. |
| IpAddress | string | The IP Address of the node running the application. |
| _IsBillable | string | Specifies whether ingesting the data is billable. When _IsBillable is false ingestion isn't billed to your Azure account |
| Region | string | The region of the cluster running the application. |
| _ResourceId | string | A unique identifier for the resource that the record is associated with |
| Role | string | The type of node running the application. |
| SourceSystem | string | The type of agent the event was collected by. For example, OpsManager for Windows agent, either direct connect or Operations Manager, Linux for all Linux agents, or Azure for Azure Diagnostics |
| SparkDeployMode | string | The spark deployment mode of the application. |
| SparkExecutorCores | int | The number of Executor cores. |
| SparkExecutorInstances | int | The number of Spark Executor instances. |
| SparkExecutorMemory | string | The memory usage of the Spark Executor |
| SparkMaster | string | The master mode of the Spark Application |
| _SubscriptionId | string | A unique identifier for the subscription that the record is associated with |
| TenantId | string | The Log Analytics workspace ID |
| TimeGenerated | datetime | The timestamp (UTC) of when the log was generated. |
| Type | string | The name of the table |
| UserSubscriptionId | string | The subscription ID of the cluster running the application |
| YarnMaxAttempts | int | The max number of attempts Yarn will make for the application. |
| YarnQueue | string | The type of YARN queue for the application. |
| YarnTags | string | The YARN tag of the application. |