Agentic Service Discovery

Resources

D

Databricks

by Databricks, Inc.

Run notebooks, trigger jobs, execute SQL queries, and manage clusters on the Databricks Lakehouse platform

DatabasesPaidBearer tokendatasparknotebookssqlmletllakehousebig-data

How agents use Databricks

  • Agent triggers a Databricks ETL notebook to process new data files and reports the outcome
  • Agent runs SQL queries against Delta Lake tables to retrieve business metrics for a report
  • Agent monitors job run status and retries failed jobs or sends alerts after consecutive failures
  • Agent starts a cluster, runs a data transformation job, and terminates the cluster to optimize costs
  • Agent queries aggregated analytics data from Databricks to answer natural language questions about business performance

Agent actions

Run NotebookExecute a Databricks notebook and wait for completion

Inputs: notebookPath, clusterId, parameters, timeoutSeconds

Returns: runId, state, result, runPageUrl, durationMs

Trigger Job RunTrigger an existing Databricks job and optionally override parameters

Inputs: jobId, notebookParams, pythonParams, jarParams

Returns: runId, numberInJob

Get Run StatusCheck the status and result of a specific job or notebook run

Inputs: runId

Returns: state, result, startTime, endTime, runPageUrl

Execute SQLRun a SQL query on a Databricks SQL Warehouse and return results

Inputs: sql, warehouseId, catalog, schema, rowLimit

Returns: rows, columns, rowCount, statementId

List JobsList all Databricks jobs in the workspace

Inputs: limit, nameFilter

Returns: jobs, total

List ClustersList all Databricks clusters in the workspace

Returns: clusters

Start ClusterStart a terminated Databricks cluster

Inputs: clusterId

Returns: success

List Recent RunsList recent job runs with status information

Inputs: jobId, limit, activeOnly

Returns: runs, hasMore

Example workflows

1

Scheduled ETL pipeline

Trigger a Databricks notebook to process daily data and wait for successful completion

2

Ad-hoc data query

Run SQL against Delta Lake tables in Unity Catalog to answer data questions on demand

About Databricks

Vendor
Databricks, Inc.
Pricing Always review details with the vendor
PaidUsage-based pricing on DBUs (Databricks Units). Community edition available. AWS/Azure/GCP pricing varies.
Authentication
Bearer token
Rate limit Always review details with the vendor
200 requests / minute
Compatible nodes
AgentResource

Build an AI workflow with Databricks

Use the Agentic Planner to design, visualize, and connect Databricks with your other tools.

Open Agentic Planner

Related Databases tools

Databricks AI Agent Integration | Fugentic