| Use system tables to monitor Databricks job costs |
https://learn.microsoft.com/en-us/azure/databricks/admin/system-tables/jobs-cost |
| Query system tables to track model serving costs |
https://learn.microsoft.com/en-us/azure/databricks/admin/system-tables/model-serving-cost |
| Analyze serverless compute costs via billing system table |
https://learn.microsoft.com/en-us/azure/databricks/admin/system-tables/serverless-billing |
| Monitor Databricks default storage costs with system tables |
https://learn.microsoft.com/en-us/azure/databricks/admin/usage/default-storage |
| Query Databricks billable usage system table for costs |
https://learn.microsoft.com/en-us/azure/databricks/admin/usage/system-tables |
| Configure Slack notifications for dashboard subscriptions |
https://learn.microsoft.com/en-us/azure/databricks/ai-bi/admin/slack-subscriptions |
| Configure Microsoft Teams notifications for dashboards |
https://learn.microsoft.com/en-us/azure/databricks/ai-bi/admin/teams-subscriptions |
| Manage AI/BI assets using Databricks REST APIs |
https://learn.microsoft.com/en-us/azure/databricks/ai-bi/admin/use-apis |
| Integrate coding agents with Azure Databricks AI Gateway |
https://learn.microsoft.com/en-us/azure/databricks/ai-gateway/coding-agent-integration-beta |
| Query Azure Databricks AI Gateway endpoints via APIs |
https://learn.microsoft.com/en-us/azure/databricks/ai-gateway/query-endpoints-beta |
| Use legacy ABS-AQS connector for streaming from Blob |
https://learn.microsoft.com/en-us/azure/databricks/archive/azure/aqs |
| Read and write Azure Cosmos DB data from Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/azure/cosmosdb |
| Stream data from Databricks to Azure Synapse Analytics |
https://learn.microsoft.com/en-us/azure/databricks/archive/azure/stream-synapse |
| Configure legacy PolyBase integration with Azure Synapse |
https://learn.microsoft.com/en-us/azure/databricks/archive/azure/synapse-polybase |
| Query Amazon Redshift from Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/amazon-redshift |
| Read AWS S3 data using Databricks S3 Select |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/amazon-s3-select |
| Connect Azure Databricks to Google BigQuery |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/bigquery |
| Connect Cassandra to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/cassandra |
| Integrate Couchbase with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/couchbase |
| Connect one Databricks workspace to another |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/databricks |
| Use Elasticsearch from Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/elasticsearch |
| Overview of Databricks connectors to external systems |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/external-systems |
| Configure JDBC connections from Databricks to external databases |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/jdbc |
| Integrate Azure Databricks with MariaDB via JDBC |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/mariadb |
| Access MongoDB Atlas from Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/mongodb |
| Connect Azure Databricks to MySQL via JDBC |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/mysql |
| Integrate Azure Databricks with Neo4j via spark connector |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/neo4j |
| Query PostgreSQL from Azure Databricks via JDBC |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/postgresql |
| Read and write Snowflake data from Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/snowflake |
| Read and write XML data in Databricks using spark-xml |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/spark-xml-library |
| Use Apache Spark connector for Azure SQL and SQL Server |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/sql-databases-azure |
| Use Azure Databricks with SQL Server via JDBC |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/sql-server |
| Access Azure Synapse Analytics from Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/connectors/synapse-analytics |
| Use dbutils.library utilities in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbutils-library |
| Develop Databricks code with VS Code and dbx |
https://learn.microsoft.com/en-us/azure/databricks/archive/dev-tools/dbx/ide-how-to |
| Connect Azure Databricks to Excel via ODBC driver |
https://learn.microsoft.com/en-us/azure/databricks/archive/integrations/excel |
| Read Unity Catalog tables from Iceberg clients |
https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/external-access-iceberg |
| Import external Hive tables into Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/legacy/hive-tables |
| Analyze customer reviews with ai_generate_text() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/ai-generate-text-example |
| Load training data with Petastorm on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/petastorm |
| Use Horovod for distributed deep learning on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/horovod |
| Run distributed training jobs with HorovodRunner |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/horovod-runner |
| HorovodRunner distributed training examples on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/horovod-runner-examples |
| Use horovod.spark for distributed deep learning |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/horovod-spark |
| Scale single-node PyTorch training with HorovodRunner |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/mnist-pytorch |
| Distributed TensorFlow/Keras MNIST training with HorovodRunner |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/mnist-tensorflow-keras |
| Run Hugging Face Transformers NLP inference on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/model-inference-nlp |
| Distributed TensorFlow 2 training with spark-tensorflow-distributor |
https://learn.microsoft.com/en-us/azure/databricks/archive/machine-learning/train-model/spark-tf-distributor |
| Track ML experiments in Java/Scala with MLflow on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/mlflow/quick-start-java-scala |
| Track ML experiments in R with MLflow on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/mlflow/quick-start-r |
| Export and import ML models with MLeap on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/model-export/mleap-model-export |
| Train PySpark model and save in MLeap format |
https://learn.microsoft.com/en-us/azure/databricks/archive/model-export/tracking-ex-pyspark |
| Use bamboolib for no-code data wrangling in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/notebooks/bamboolib |
| Integrate Infoworks DataFoundry with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/partners/infoworks |
| Connect Spotfire Analyst to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/partners/spotfire |
| Use Syncsort (Precisely) with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/partners/syncsort |
| Connect SQL Workbench/J to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/partners/workbenchj |
| Access Amazon S3 from Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/storage/amazon-s3 |
| Use ABFS driver with ADLS and Blob Storage in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/archive/storage/azure-storage |
| Connect Azure Databricks to Google Cloud Storage |
https://learn.microsoft.com/en-us/azure/databricks/archive/storage/gcs |
| Connect Azure Databricks to Azure Data Lake Storage via OAuth |
https://learn.microsoft.com/en-us/azure/databricks/archive/storage/tutorial-azure-storage |
| Configure legacy WASB driver for Azure Blob Storage |
https://learn.microsoft.com/en-us/azure/databricks/archive/storage/wasb-blob |
| Enable enterprise code search via GitHub MCP in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/assistant/github-mcp |
| Integrate Databricks Assistant with MCP servers |
https://learn.microsoft.com/en-us/azure/databricks/assistant/mcp |
| Run distributed multi-GPU and multi-node training with Databricks serverless GPU API |
https://learn.microsoft.com/en-us/azure/databricks/compute/serverless/distributed-training |
| Configure JDBC Unity Catalog connections in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/connect/jdbc-connection |
| Stream with Apache Kafka as source or sink in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/connect/streaming/kafka |
| Subscribe to Google Pub/Sub with Structured Streaming |
https://learn.microsoft.com/en-us/azure/databricks/connect/streaming/pub-sub |
| Stream from Apache Pulsar using Databricks Structured Streaming |
https://learn.microsoft.com/en-us/azure/databricks/connect/streaming/pulsar |
| Use Unity Catalog service credentials to call external services |
https://learn.microsoft.com/en-us/azure/databricks/connect/unity-catalog/cloud-services/use-service-credentials |
| Manage Azure Databricks dashboards via REST API |
https://learn.microsoft.com/en-us/azure/databricks/dashboards/tutorials/dashboard-crud-api |
| Automate dashboard lifecycle with Workspace and Lakeview APIs |
https://learn.microsoft.com/en-us/azure/databricks/dashboards/tutorials/workspace-dashboard-api |
| Integrate external lineage sources with Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/data-governance/unity-catalog/external-lineage |
| Integrate SAP Business Data Cloud with Databricks via Delta Sharing |
https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/sap-bdc/ |
| Create and manage SAP BDC connections for Delta Sharing |
https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/sap-bdc/create-connection |
| Grant SAP BDC recipients access to Databricks Delta shares |
https://learn.microsoft.com/en-us/azure/databricks/delta-sharing/sap-bdc/share-to-sap |
| Use MERGE to upsert into Delta tables on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/delta/merge |
| Expose Delta tables as Iceberg to external clients (UniForm) |
https://learn.microsoft.com/en-us/azure/databricks/delta/uniform |
| Include private artifacts in Databricks Asset Bundles |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/bundles/artifact-private |
| Reference for Databricks CLI command groups and commands |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/commands |
| Download Databricks billable usage logs with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-billable-usage-commands |
| Manage Databricks account resources with CLI account commands |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-commands |
| Manage Databricks account credential configurations via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/account-credentials-commands |
| Call Databricks REST APIs via CLI api command |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/api-commands |
| Manage external data connections via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/connections-commands |
| Use Databricks CLI external-lineage commands |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/external-lineage-commands |
| Manage Unity Catalog external locations via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/external-locations-commands |
| Manage external metadata in Unity Catalog via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/external-metadata-commands |
| Administer Databricks feature store with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/feature-engineering-commands |
| Use Databricks CLI fs commands for DBFS and volumes |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/fs-commands |
| Manage Unity Catalog UDFs with Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/functions-commands |
| Control Databricks Genie spaces via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/genie-commands |
| Configure Git credentials using Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/git-credentials-commands |
| Administer Databricks instance pools via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/instance-pools-commands |
| Create and manage Databricks jobs via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/jobs-commands |
| Work with Databricks Labs apps using CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/labs-commands |
| Manage Lakeview dashboards with Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/lakeview-commands |
| Install and manage libraries via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/libraries-commands |
| Administer Unity Catalog metastores with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/metastores-commands |
| Use CLI to manage workspace model registry |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/model-registry-commands |
| Manage Unity Catalog model versions via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/model-versions-commands |
| Configure notification destinations with Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/notification-destinations-commands |
| Manage online tables from Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/online-tables-commands |
| Control Databricks pipelines using CLI commands |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/pipelines-commands |
| Manage Lakebase Postgres resources with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/postgres-commands |
| Administer Databricks marketplace exchanges via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/provider-exchanges-commands |
| Manage Databricks marketplace files with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/provider-files-commands |
| Manage Databricks marketplace listings via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/provider-listings-commands |
| Handle marketplace personalization requests with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/provider-personalization-requests-commands |
| Manage provider analytics dashboards via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/provider-provider-analytics-dashboards-commands |
| Manage marketplace providers using Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/provider-providers-commands |
| Manage Delta Sharing providers via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/providers-commands |
| Connect to Postgres databases with Databricks psql |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/psql-command |
| Manage Databricks quality monitors via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/quality-monitors-commands |
| Create and manage Databricks SQL queries via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/queries-commands |
| Use Databricks CLI queries-legacy commands |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/queries-legacy-commands |
| Manage query history with Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/query-history-commands |
| Retrieve recipient activation via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/recipient-activation-commands |
| Manage recipient federation policies with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/recipient-federation-policies-commands |
| Manage Unity Catalog recipients via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/recipients-commands |
| Manage registered ML models with Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/registered-models-commands |
| Manage Git repos folders using Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/repos-commands |
| Manage Unity Catalog resource quotas via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/resource-quotas-commands |
| Handle Unity Catalog access requests with CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/rfa-commands |
| Manage Unity Catalog schemas using CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/schemas-commands |
| Manage Databricks model serving endpoints via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/serving-endpoints-commands |
| Manage Unity Catalog shares via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/shares-commands |
| Create and use Databricks SSH tunnels via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/ssh-commands |
| Sync local files to Databricks workspace via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/sync-commands |
| Manage system schemas in Databricks via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/system-schemas-commands |
| Manage table constraints in Unity Catalog via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/table-constraints-commands |
| Manage Unity Catalog tables using Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/tables-commands |
| Manage governed tag policies via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/tag-policies-commands |
| Manage vector search endpoints via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/vector-search-endpoints-commands |
| Manage vector search indexes using Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/vector-search-indexes-commands |
| Check Databricks CLI version information |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/version-command |
| Manage Unity Catalog volumes via Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/volumes-commands |
| Manage SQL warehouses using Databricks CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/warehouses-commands |
| Manage Databricks workspace files and folders via CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/cli/reference/workspace-commands |
| Connect external data via Unity Catalog connections in Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/connections |
| Embed Databricks Apps in external web UIs |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/embed |
| Invoke Unity Catalog UDFs from Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/functions |
| Add Genie space AI/BI resource to Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/genie |
| Attach Lakebase database instances to Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/lakebase |
| Connect Lakeflow Jobs as resources in Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/lakeflow |
| Integrate MLflow experiments with Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/mlflow |
| Use model serving endpoints in Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/model-serving |
| Integrate Databricks Apps with platform resources |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/resources |
| Add SQL warehouse resources to Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/sql-warehouse |
| Access Unity Catalog volumes from Databricks Apps |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-apps/uc-volumes |
| Use Databricks Connect for Python with external tools |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/ |
| Handle asynchronous queries in Databricks Connect Python |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/async |
| Use Databricks Utilities via Databricks Connect for Python |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/databricks-utilities |
| Reference code examples for Databricks Connect Python |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/examples |
| Use the PySpark shell configured for Databricks Connect |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/spark-shell |
| Develop local Databricks apps with Databricks Connect |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/python/tutorial-apps |
| Use Databricks Connect with R via sparklyr |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/r/ |
| Use Databricks Connect for Scala with external tools |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/ |
| Handle async queries in Databricks Connect Scala |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/async |
| Use Databricks Utilities via Databricks Connect Scala |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/databricks-utilities |
| Reference code examples for Databricks Connect Scala |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/examples |
| Implement Scala UDFs with Databricks Connect |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-connect/scala/udf |
| Run queries with Databricks SQL CLI |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/databricks-sql-cli |
| Configure DataGrip to connect to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/datagrip |
| Configure DBeaver to connect to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/dbeaver |
| Use Databricks SQL Driver for Go |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/go-sql-driver |
| Use Databricks SQL Driver for Node.js |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/nodejs-sql-driver |
| Connect Python via pyodbc to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/pyodbc |
| Use Databricks SQL Connector for Python |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/python-sql-connector |
| Use English SDK to generate Spark objects |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdk-english |
| Automate Databricks with the Go SDK |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdk-go |
| Automate Databricks with the Java SDK |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdk-java |
| Automate Databricks with the Python SDK |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdk-python |
| Automate Databricks with the R SDK |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sdk-r |
| Use Databricks SQL Statement Execution API 2.0 |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sql-execution-tutorial |
| Integrate SQLAlchemy with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sqlalchemy |
| Configure Databricks Driver for SQLTools in VS Code |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/sqltools-driver |
| Debug Python with Databricks Connect in VS Code |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/databricks-connect |
| Run and debug Databricks notebooks in VS Code via Connect |
https://learn.microsoft.com/en-us/azure/databricks/dev-tools/vscode-ext/notebooks |
| Create Unity Catalog external Delta tables from external clients |
https://learn.microsoft.com/en-us/azure/databricks/external-access/create-external-tables |
| Configure Apache Iceberg clients for Unity Catalog tables |
https://learn.microsoft.com/en-us/azure/databricks/external-access/iceberg |
| Access Unity Catalog tables from external Delta clients |
https://learn.microsoft.com/en-us/azure/databricks/external-access/unity-rest |
| Import Python and R modules from Databricks workspace files |
https://learn.microsoft.com/en-us/azure/databricks/files/workspace-modules |
| Create custom text LLM agents with Agent Bricks |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/custom-llm |
| Implement information extraction agents with Agent Bricks |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/key-info-extraction |
| Build document-based chatbots with Knowledge Assistant |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-bricks/knowledge-assistant |
| Create and manage AI agent tools with MCP and Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/agent-tool |
| Integrate Anthropic SDK calls with Unity Catalog tools |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/anthropic-uc-integration |
| Add code interpreter tools to Databricks AI agents |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/code-interpreter-tools |
| Create AI agent tools using Unity Catalog functions |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/create-custom-tool |
| Connect Databricks AI tools to external HTTP services |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/external-connection-tools |
| Integrate LangChain workflows with Unity Catalog tools |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/langchain-uc-integration |
| Integrate LlamaIndex workflows with Unity Catalog tools |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/llamaindex-uc-integration |
| Integrate OpenAI workflows with Unity Catalog tools |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/openai-uc-integration |
| Query Databricks AI agents via APIs and SDKs |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/query-agent |
| Integrate Databricks AI agents with Slack via HTTP connections |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/slack-agent |
| Connect Databricks agents to structured data sources |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/structured-retrieval-tools |
| Connect Databricks AI agents to Microsoft Teams |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/teams-agent |
| Use Unity Catalog tools with third-party agent frameworks |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/unity-catalog-tool-integration |
| Connect Databricks agents to unstructured data via Vector Search |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/agent-framework/unstructured-retrieval-tools |
| Use Databricks managed MCP servers for agent tools |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/mcp/managed-mcp |
| Build unstructured data pipelines for RAG on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/ai-cookbook/quality-data-pipeline-rag |
| Configure external endpoints for OpenAI models on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/generative-ai/tutorials/external-models-tutorial |
| Integrate Genie via the Databricks Conversation API |
https://learn.microsoft.com/en-us/azure/databricks/genie/conversation-api |
| Implement common Auto Loader data ingestion patterns |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/auto-loader/patterns |
| Use temporary credentials with COPY INTO ingestion |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/temporary-credentials |
| Load ADLS data with COPY INTO and service principals |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/tutorial-dbsql |
| Use COPY INTO with Unity Catalog storage |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/cloud-object-storage/copy-into/unity-catalog |
| Incrementally clone Parquet and Iceberg tables to Delta |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/clone-parquet |
| Convert Parquet and Iceberg tables to Delta Lake |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/data-migration/convert-to-delta |
| Ingest Google Drive files with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/google-drive |
| Configure Databricks Lakeflow Connect for Confluence |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/confluence-pipeline |
| Ingest Microsoft Dynamics 365 data with Lakeflow |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/d365-pipeline |
| Set up Google Ads ingestion with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/google-ads-pipeline |
| Configure Lakeflow Connect ingestion from Salesforce |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/salesforce-pipeline |
| Build a Lakeflow Connect pipeline from ServiceNow |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/servicenow-pipeline |
| Create a Lakeflow Connect pipeline from SharePoint |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/lakeflow-connect/sharepoint-pipeline |
| Ingest SFTP files using Lakeflow Connect Auto Loader |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/sftp |
| Ingest SharePoint files into Delta tables |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/sharepoint |
| Ingest semi-structured data using VARIANT type |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/variant |
| Ingest data using Zerobus Ingest connector in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/ingestion/zerobus-ingest |
| Run and test dbt models locally with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/integrations/dbt-core-tutorial |
| Use Databricks Connector integration with Google Sheets |
https://learn.microsoft.com/en-us/azure/databricks/integrations/google-sheets/ |
| Set up Databricks Connector for Google Sheets workspaces |
https://learn.microsoft.com/en-us/azure/databricks/integrations/google-sheets/connect |
| Query Azure Databricks data from Google Sheets |
https://learn.microsoft.com/en-us/azure/databricks/integrations/google-sheets/query-data |
| Schedule Databricks data refreshes in Google Sheets |
https://learn.microsoft.com/en-us/azure/databricks/integrations/google-sheets/schedule-refresh |
| Use GraphFrames package on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/integrations/graphframes/ |
| Apply GraphFrames for graph analysis in Scala |
https://learn.microsoft.com/en-us/azure/databricks/integrations/graphframes/user-guide-scala |
| Run SQL queries using Databricks JDBC driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-oss/example |
| Use JDBC metadata to discover Databricks metric views |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-oss/metadata |
| Java API reference for Databricks JDBC driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-oss/reference |
| Manage Unity Catalog volume files via JDBC driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc-oss/volumes |
| Configure authentication for Databricks JDBC Driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/authentication |
| Configure advanced capabilities in Databricks JDBC Driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/capability |
| Set Databricks JDBC Driver compute options |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/compute |
| Configure authentication for legacy Databricks JDBC Driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/legacy |
| Manage Unity Catalog volume files via JDBC Driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/jdbc/volumes |
| Use Azure Databricks Genie MCP server in Foundry |
https://learn.microsoft.com/en-us/azure/databricks/integrations/microsoft-foundry |
| Integrate Azure Databricks with Microsoft Power Platform |
https://learn.microsoft.com/en-us/azure/databricks/integrations/msft-power-platform |
| Create Azure Databricks connections in Power Platform |
https://learn.microsoft.com/en-us/azure/databricks/integrations/msft-power-platform-setup |
| Use Databricks data and Genie in Power Platform apps |
https://learn.microsoft.com/en-us/azure/databricks/integrations/msft-power-platform-usage |
| Connect Azure Databricks to Python and R via ODBC |
https://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/connect-databricks-excel-python-r |
| Manage Unity Catalog volume files via ODBC driver |
https://learn.microsoft.com/en-us/azure/databricks/integrations/odbc/volumes |
| Automate Databricks job management with CLI, SDK, and API |
https://learn.microsoft.com/en-us/azure/databricks/jobs/automate |
| Configure dbt tasks to run projects on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/jobs/dbt |
| Orchestrate dbt platform jobs from Lakeflow Jobs |
https://learn.microsoft.com/en-us/azure/databricks/jobs/dbt-platform |
| Orchestrate Lakeflow Jobs using Apache Airflow |
https://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/use-airflow-with-jobs |
| Integrate dbt Core transformations in Lakeflow Jobs |
https://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/use-dbt-in-workflows |
| Package and run Python wheels in Lakeflow Jobs |
https://learn.microsoft.com/en-us/azure/databricks/jobs/how-to/use-python-wheels-in-workflows |
| Access job and task parameters from Databricks code |
https://learn.microsoft.com/en-us/azure/databricks/jobs/parameter-use |
| Pass task values between Azure Databricks job tasks |
https://learn.microsoft.com/en-us/azure/databricks/jobs/task-values |
| Deploy batch inference pipelines with AI Functions |
https://learn.microsoft.com/en-us/azure/databricks/large-language-models/batch-inference-pipelines |
| Use LangChain integrations with Databricks LLMs |
https://learn.microsoft.com/en-us/azure/databricks/large-language-models/langchain |
| Clone Hive metastore pipelines to Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/ldp/clone-hms-to-uc |
| Replicate external RDBMS tables with AUTO CDC |
https://learn.microsoft.com/en-us/azure/databricks/ldp/database-replication |
| Use Lakeflow pipelines features in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/ldp/dbsql/dbsql-for-ldp |
| Define pipeline datasets with Python decorators |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/definition-function |
| Use append_flow decorator for append-only sinks |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-append-flow |
| Process CDC data with create_auto_cdc_flow |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-apply-changes |
| Process snapshot CDC with create_auto_cdc_from_snapshot_flow |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-apply-changes-from-snapshot |
| Apply data quality expectations in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-expectations |
| Define materialized views with Python decorator |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-materialized-view |
| Create sinks for Kafka and Delta in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-sink |
| Create streaming tables with create_streaming_table |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-streaming-table |
| Create streaming tables with @table decorator |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-table |
| Create temporary views with @temporary_view |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-python-ref-view |
| Use AUTO CDC INTO for pipeline CDC flows |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-sql-ref-apply-changes-into |
| Create pipeline flows with CREATE FLOW SQL |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-sql-ref-create-flow |
| Define materialized views with SQL in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-sql-ref-create-materialized-view |
| Create streaming tables with SQL in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-sql-ref-create-streaming-table |
| Create temporary views with SQL in pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-sql-ref-create-temporary-view |
| Create views with SQL in Lakeflow pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/ldp-sql-ref-create-view |
| Develop Lakeflow pipelines using Python APIs |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/python-dev |
| Reference for Lakeflow pipeline Python APIs |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/python-ref |
| Develop Lakeflow pipelines using SQL syntax |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/sql-dev |
| Reference for Lakeflow pipeline SQL language |
https://learn.microsoft.com/en-us/azure/databricks/ldp/developer/sql-ref |
| Implement pipeline event hooks for custom monitoring |
https://learn.microsoft.com/en-us/azure/databricks/ldp/event-hooks |
| Ingest Azure Event Hubs data with pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/event-hubs |
| Process streaming data with ForEachBatch sinks |
https://learn.microsoft.com/en-us/azure/databricks/ldp/for-each-batch |
| Import Python modules from Git or workspace into pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/import-workspace-files |
| Use custom sinks in Lakeflow pipelines |
https://learn.microsoft.com/en-us/azure/databricks/ldp/sinks |
| Run Databricks pipelines from workflow tools |
https://learn.microsoft.com/en-us/azure/databricks/ldp/workflows |
| Use Hyperopt with HorovodRunner for distributed ML |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-distributed-ml |
| Model selection with Hyperopt and MLflow |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-model-selection |
| Parallelize Hyperopt tuning with Spark and MLflow |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/hyperopt-spark-mlflow-integration |
| Integrate Optuna hyperparameter tuning with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl-hyperparam-tuning/optuna |
| Use Azure Databricks AutoML Python API |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl/automl-api-reference |
| Integrate Databricks Feature Store with AutoML experiments |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/automl/feature-store-integration |
| Configure automatic feature lookup for model serving |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/automatic-feature-lookup |
| Set up and use Databricks Feature Serving endpoints |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/feature-function-serving |
| Deploy and query a Databricks feature serving endpoint |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/feature-serving-tutorial |
| Create and use on-demand features in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/on-demand-features |
| Publish features to third-party online stores |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/publish-features |
| Use Databricks Feature Engineering Python APIs |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/python-api |
| Use third-party online stores with Databricks Feature Store |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/third-party-online-stores |
| Train models using Databricks Feature Store features |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/train-models-with-feature-store |
| Create and manage Workspace Feature Store tables |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/feature-store/workspace-feature-store/feature-tables |
| REST API reference for Databricks Foundation Model APIs |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/foundation-model-apis/api-reference |
| Load training data with Mosaic Streaming |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/load-data/streaming |
| Save Spark DataFrames as TFRecord files |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/load-data/tfrecords-save-load |
| Deploy custom Python code with Databricks Model Serving |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/deploy-custom-python-code |
| Use provider-native OpenAI, Anthropic, and Gemini APIs on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/provider-native-apis |
| Query Databricks models with Anthropic Messages API |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-anthropic-messages |
| Query chat and general-purpose models on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-chat-models |
| Query embedding foundation models on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-embedding-models |
| Query Databricks models with Google Gemini API |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-gemini-api |
| Query Databricks models with OpenAI Responses API |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-openai-responses |
| Query reasoning models using Databricks Foundation Model API |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-reason-models |
| Query Databricks route-optimized model and feature serving endpoints |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-route-optimization |
| Query vision foundation models via Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/query-vision-models |
| Enable and configure route-optimized Databricks serving endpoints |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/route-optimization |
| Format and send scoring requests to Databricks custom model endpoints |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/score-custom-model-endpoints |
| Send requests to Databricks foundation model endpoints |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/model-serving/score-foundation-models |
| Featurization for transfer learning with pandas UDFs |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/preprocess-data/transfer-learning-tensorflow |
| Integrate and coordinate Spark and Ray workloads |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/connect-spark-ray |
| Integrate MLflow tracking with Ray workloads |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/ray/ray-mlflow |
| Perform NLP on Databricks with Spark and partners |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/reference-solutions/natural-language-processing |
| Train a CNN on MNIST using PyTorch on Databricks serverless GPU |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/sgc-examples/tutorials/sgc-cnn-mnist |
| Run distributed LoRA fine-tuning of Qwen2-0.5B on Databricks serverless GPU |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/sgc-examples/tutorials/sgc-distributed-finetune-qwen2-0.5b |
| Fine-tune BERT-style embedding model with contrastive learning on Databricks serverless GPU |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/sgc-examples/tutorials/sgc-finetune-embedding-model-llmfoundry |
| Fine-tune Llama-3.2-3B with Unsloth and LoRA on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/sgc-examples/tutorials/sgc-finetune-llama-unsloth |
| Fine-tune Qwen2-0.5B with LoRA on Databricks serverless GPU |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/sgc-examples/tutorials/sgc-finetune-qwen2-0.5b |
| Train a RetinaNet object detection model on Databricks serverless GPU |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/sgc-examples/tutorials/sgc-retinanet-image-detection-model-training |
| Distributed training with DeepSpeed distributor on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/distributed-training/deepspeed |
| Train Spark ML models with Databricks Connect |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/distributed-training/distributed-ml-for-spark-connect |
| Distributed PyTorch training with TorchDistributor |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/distributed-training/spark-pytorch-distributor |
| Train PyTorch models on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/pytorch |
| Distributed XGBoost with deprecated sparkdl.xgboost |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/sparkdl-xgboost |
| Use TensorBoard for ML debugging on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/tensorboard |
| Train XGBoost models on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/xgboost |
| Use XGBoost with Scala and Spark MLlib |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/xgboost-scala |
| Distributed XGBoost training with xgboost.spark |
https://learn.microsoft.com/en-us/azure/databricks/machine-learning/train-model/xgboost-spark |
| Define window measures in Databricks metric views |
https://learn.microsoft.com/en-us/azure/databricks/metric-views/data-modeling/window-measures |
| Customize Databricks Autologging with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow/databricks-autologging |
| Integrate Workspace Model Registry with webhooks |
https://learn.microsoft.com/en-us/azure/databricks/mlflow/model-registry-webhooks |
| Use MLflow GenAI prompt optimization with GEPA |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/automatically-optimize-prompts |
| Create and manage MLflow Prompt Registry entries |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/create-and-edit-prompts |
| Code examples for MLflow Prompt Registry operations |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/prompt-version-mgmt/prompt-registry/examples |
| Instrument Node.js AI apps with MLflow Tracing SDK |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/app-instrumentation/typescript-sdk |
| Enable MLflow tracing for AG2 multi-agent runs |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/ag2 |
| Trace Agno agents automatically with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/agno |
| Trace Anthropic LLM calls with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/anthropic |
| Trace AutoGen multi-agent workflows with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/autogen |
| Trace Amazon Bedrock LLM calls with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/bedrock |
| Trace Claude Code conversations with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/claude-code |
| Trace CrewAI multi-agent runs with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/crewai |
| Trace Databricks Foundation Models via MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/databricks-foundation-models |
| Trace DeepSeek models with MLflow OpenAI autolog |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/deepseek |
| Trace DSPy modules automatically with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/dspy |
| Trace Google Gemini calls with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/gemini |
| Trace Groq LLM usage with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/groq |
| Trace Haystack pipelines and components with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/haystack |
| Trace Instructor structured outputs via MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/instructor |
| Trace LangChain applications with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/langchain |
| Trace LangGraph workflows via MLflow LangChain autolog |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/langgraph |
| Trace LiteLLM gateway calls with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/litellm |
| Trace LlamaIndex engines and workflows with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/llama_index |
| Trace Mistral AI text generation with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/mistral |
| Trace Ollama local LLMs via MLflow OpenAI autolog |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/ollama |
| Trace OpenAI LLM calls with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/openai |
| Enable MLflow tracing for OpenAI Agents SDK |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/openai-agent |
| Integrate PydanticAI agents with MLflow tracing |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/pydantic-ai |
| Trace Semantic Kernel workflows with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/semantic-kernel |
| Trace Smolagents workflows using MLflow autologging |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/smolagents |
| Enable MLflow tracing for Strands Agents SDK |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/strands |
| Migrate from Swarm and trace OpenAI agents |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/swarm |
| Trace txtai semantic workflows with MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/integrations/txtai |
| Use MLflow MCP server to access traces |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/mlflow-mcp |
| Export Langfuse OpenTelemetry traces to Databricks MLflow |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tracing/third-party/langfuse |
| Build custom MLflow judges and scorers for RAG |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tutorials/examples/custom-scorers |
| Optimize chained prompts with MLflow GEPA |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tutorials/examples/multi-prompt-optimization |
| Tutorial: Optimize prompts with MLflow and GEPA |
https://learn.microsoft.com/en-us/azure/databricks/mlflow3/genai/tutorials/examples/prompt-optimization-quickstart |
| Share and import Python code across Databricks notebooks |
https://learn.microsoft.com/en-us/azure/databricks/notebooks/share-code |
| Query Lakebase from Databricks notebooks with examples |
https://learn.microsoft.com/en-us/azure/databricks/oltp/instances/query/notebook |
| Connect external SQL clients to Lakebase instances |
https://learn.microsoft.com/en-us/azure/databricks/oltp/instances/query/psql |
| Use Lakebase Autoscaling API, CLI, and SDKs |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/api-usage |
| Manage Lakebase with Databricks CLI commands |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/cli |
| Connect Lakebase Postgres to DBeaver |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/connect-dbeaver |
| Quickstart: Connect to Lakebase Postgres securely |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/connect-overview |
| Connect Lakebase Postgres to pgAdmin |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/connect-pgadmin |
| Monitor Lakebase Postgres with PgHero |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/connect-pghero |
| Connect to Lakebase Postgres with psql |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/connect-psql |
| Configure Lakebase Postgres connection strings |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/connection-strings |
| Use Lakebase Data API for Postgres access |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/data-api |
| Connect external apps to Lakebase via SDK |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/external-apps-connect |
| Connect external apps to Lakebase via REST API |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/external-apps-manual-api |
| Use external monitoring tools with Lakebase |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/external-monitoring-tools |
| Use frameworks to connect to Lakebase Postgres |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/framework-examples |
| Integrate Lakebase Postgres with Databricks services |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/integrations |
| Use pg_dump and pg_restore with Lakebase Postgres |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-dump-restore |
| Use pg_stat_statements with Lakebase Postgres |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/pg-stat-statements |
| Connect to Lakebase using Postgres clients |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/postgres-clients |
| Connect Lakehouse SQL editor to Lakebase |
https://learn.microsoft.com/en-us/azure/databricks/oltp/projects/query-sql-editor |
| Use pandas function APIs with PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pandas/pandas-function-apis |
| Convert between PySpark and pandas DataFrames |
https://learn.microsoft.com/en-us/azure/databricks/pandas/pyspark-pandas-conversion |
| Use Partner Connect for BI and visualization tools |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/bi |
| Use Partner Connect for data governance integrations |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/data-governance |
| Use Partner Connect for machine learning integrations |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/ml |
| Use Partner Connect for data prep integrations |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/prep |
| Use Partner Connect for reverse ETL integrations |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/reverse-etl |
| Use Partner Connect for semantic layer tools |
https://learn.microsoft.com/en-us/azure/databricks/partner-connect/semantic-layer |
| Read Unity Catalog data from Microsoft Fabric |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/fabric |
| Connect Hex collaborative workspace to Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/hex |
| Configure Looker with Azure Databricks clusters and SQL |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/looker |
| Connect Looker Studio dashboards to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/looker-studio |
| Connect MicroStrategy Workstation to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/microstrategy |
| Integrate Mode analytics with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/mode |
| Configure ADBC or ODBC drivers for Power BI on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi-adbc |
| Connect Power BI Desktop to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi-desktop |
| Publish Azure Databricks data to Power BI service |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi-service |
| Create Unity Catalog Power BI connection for jobs |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/power-bi-uc-connect |
| Connect Preset (Apache Superset) to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/preset |
| Use Qlik Sense with Azure Databricks and Delta Lake |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/qlik-sense |
| Connect Sigma cloud analytics to Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/sigma |
| Connect Tableau Desktop and Cloud to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/tableau |
| Integrate ThoughtSpot search analytics with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/bi/thoughtspot |
| Connect Anomalo data quality platform to Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/data-governance/anomalo |
| Connect erwin Data Modeler to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/data-governance/erwin |
| Integrate Lightup data quality indicators with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/data-governance/lightup |
| Connect Monte Carlo data observability to Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/data-governance/monte-carlo |
| Integrate Fivetran with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/fivetran |
| Integrate Hevo Data pipelines with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/hevo |
| Connect Informatica Cloud Data Integration to Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/informatica-cloud-data-integration |
| Configure Qlik Replicate ingestion into Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/qlik |
| Integrate Rivery with Azure Databricks SQL warehouses |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/rivery |
| Connect RudderStack customer data platform to Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/rudderstack |
| Integrate Snowplow behavioral data with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/snowplow |
| Set up StreamSets pipelines with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ingestion/streamsets |
| Connect Dataiku AI platform to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ml/dataiku |
| Integrate John Snow Labs NLP with Databricks clusters |
https://learn.microsoft.com/en-us/azure/databricks/partners/ml/john-snow-labs |
| Connect Labelbox training data platform to Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ml/labelbox |
| Integrate SuperAnnotate SDK with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/ml/superannotate |
| Configure dbt Core to run on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/prep/dbt |
| Connect dbt Cloud to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/prep/dbt-cloud |
| Integrate Matillion Data Productivity Cloud with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/prep/matillion |
| Connect Prophecy low-code platform to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/prep/prophecy |
| Connect Census reverse ETL to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/reverse-etl/census |
| Integrate Hightouch reverse ETL with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/reverse-etl/hightouch |
| Connect AtScale semantic layer to Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/semantic-layer/atscale |
| Integrate Stardog semantic data layer with Databricks |
https://learn.microsoft.com/en-us/azure/databricks/partners/semantic-layer/stardog |
| Build PySpark custom data sources on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/datasources |
| Use the PySpark Catalog API on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/catalog |
| Work with the PySpark Column class on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/column |
| Use the PySpark DataFrame class on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/dataframe |
| Handle nulls with DataFrameNaFunctions in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/dataframenafunctions |
| Load data using PySpark DataFrameReader on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/dataframereader |
| Compute statistics with DataFrameStatFunctions in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/dataframestatfunctions |
| Write data using PySpark DataFrameWriter on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/dataframewriter |
| Use DataFrameWriterV2 for advanced writes on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/dataframewriterv2 |
| Implement custom PySpark data sources on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasource |
| Implement Arrow-based batch writers for PySpark data sources |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourcearrowwriter |
| Implement custom DataSourceReader for PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourcereader |
| Register custom data sources with DataSourceRegistration |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourceregistration |
| Implement Arrow-based streaming writers for PySpark data sources |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourcestreamarrowwriter |
| Implement custom DataSourceStreamReader for PySpark streaming |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourcestreamreader |
| Implement custom DataSourceStreamWriter for PySpark streaming |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourcestreamwriter |
| Implement custom DataSourceWriter for PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/datasourcewriter |
| Use the Geography type in PySpark on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/geography |
| Use the Geometry type in PySpark on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/geometry |
| Aggregate data with GroupedData in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/groupeddata |
| Capture DataFrame metrics with Observation in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/observation |
| Generate plots with PySparkPlotAccessor on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/plotaccessor |
| Use the Row class in PySpark on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/classes/row |
| Use ceil PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ceil |
| Use ceiling PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ceiling |
| Use char PySpark function on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/char |
| Use char_length PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/char_length |
| Use character_length PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/character_length |
| Use chr PySpark function on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/chr |
| Apply coalesce PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/coalesce |
| Use col helper to reference columns in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/col |
| Apply collate PySpark function for string collation |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/collate |
| Use collation PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/collation |
| Use collect_list aggregation in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/collect_list |
| Use collect_set aggregation in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/collect_set |
| Concatenate columns with concat in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/concat |
| Concatenate strings with separators using concat_ws |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/concat_ws |
| Use contains string function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/contains |
| Convert number bases with conv in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/conv |
| Convert time zones with convert_timezone in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/convert_timezone |
| Compute Pearson correlation with corr in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/corr |
| Compute cosine with cos function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/cos |
| Compute hyperbolic cosine with cosh in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/cosh |
| Compute cotangent with cot in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/cot |
| Use count aggregation in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/count |
| Use count_distinct aggregation in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/count_distinct |
| Count conditional values with count_if in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/count_if |
| Generate count-min sketch with PySpark in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/count_min_sketch |
| Compute population covariance with covar_pop in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/covar_pop |
| Compute sample covariance with covar_samp in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/covar_samp |
| Calculate CRC32 checksums with Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/crc32 |
| Create map columns with create_map in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/create_map |
| Compute cosecant with csc in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/csc |
| Use cume_dist window function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/cume_dist |
| Get current date with curdate in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/curdate |
| Retrieve current catalog with Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_catalog |
| Retrieve current database with Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_database |
| Get current_date in Databricks PySpark queries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_date |
| Retrieve current schema with Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_schema |
| Get current_time in Databricks PySpark queries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_time |
| Get current_timestamp in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_timestamp |
| Retrieve current session time zone in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/current_timezone |
| Use PySpark filter function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/filter |
| Use find_in_set PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/find_in_set |
| Use first aggregate function with PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/first |
| Apply first_value window function in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/first_value |
| Flatten nested arrays with PySpark in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/flatten |
| Use floor numeric function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/floor |
| Evaluate array predicates with forall in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/forall |
| Format numbers with format_number in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/format_number |
| Build strings with format_string in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/format_string |
| Parse CSV strings to rows with from_csv in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/from_csv |
| Convert JSON strings to complex types with from_json |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/from_json |
| Convert Unix epoch seconds with from_unixtime in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/from_unixtime |
| Convert UTC timestamps to time zones in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/from_utc_timestamp |
| Parse XML strings to rows with from_xml in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/from_xml |
| Access array elements by index with get in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/get |
| Extract JSON fields with get_json_object in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/get_json_object |
| Read individual bits with getbit in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/getbit |
| Compute greatest value across columns in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/greatest |
| Use grouping function to detect aggregated columns |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/grouping |
| Calculate grouping_id levels in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/grouping_id |
| Get H3 cell boundary as GeoJSON in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_boundaryasgeojson |
| Get H3 cell boundary as WKB in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_boundaryaswkb |
| Get H3 cell boundary as WKT in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_boundaryaswkt |
| Get H3 cell center as GeoJSON in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_centerasgeojson |
| Get H3 cell center as WKB in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_centeraswkb |
| Get H3 cell center as WKT in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_centeraswkt |
| Compact H3 cell ID sets with h3_compact in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_compact |
| Cover geometries with H3 cells using h3_coverash3 |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_coverash3 |
| Cover geometries with H3 string IDs in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_coverash3string |
| Compute grid distance between H3 cells in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_distance |
| Convert H3 cell IDs to hex strings in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_h3tostring |
| Generate H3 hexagonal rings with h3_hexring |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_hexring |
| Check H3 parent-child relationships with h3_ischildof |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_ischildof |
| Detect H3 pentagon cells with h3_ispentagon |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_ispentagon |
| Validate H3 cell IDs with h3_isvalid in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_isvalid |
| Find H3 cells within k-ring distance in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_kring |
| Get H3 k-ring cells with distances in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_kringdistances |
| Convert longitude/latitude to H3 int IDs in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_longlatash3 |
| Convert longitude/latitude to H3 string IDs in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_longlatash3string |
| Get maximum child H3 cell at resolution in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_maxchild |
| Use h3_minchild PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_minchild |
| Convert point geography to H3 ID in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_pointash3 |
| Return H3 ID string from point in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_pointash3string |
| Fill polygon with H3 cell IDs in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_polyfillash3 |
| Fill polygon with string H3 IDs in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_polyfillash3string |
| Get H3 cell resolution with PySpark function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_resolution |
| Convert H3 ID string to integer in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_stringtoh3 |
| Tessellate geography into H3 WKB chips in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_tessellateaswkb |
| Get child H3 cells from parent in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_tochildren |
| Get parent H3 cell at resolution in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_toparent |
| Cover geography minimally with H3 IDs in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_coverash3 |
| Cover geography with string H3 IDs in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_coverash3string |
| Compute H3 grid distance safely in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_distance |
| Polyfill polygon with H3 IDs safely in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_polyfillash3 |
| Polyfill polygon with string H3 IDs in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_polyfillash3string |
| Tessellate geography to H3 WKB chips safely |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_tessellateaswkb |
| Validate H3 cell IDs safely in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_try_validate |
| Uncompact H3 cell sets to resolution in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_uncompact |
| Validate H3 cell IDs with strict errors |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/h3_validate |
| Use hash column function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hash |
| Convert values to hex with Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hex |
| Compute numeric histograms with PySpark function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/histogram_numeric |
| Create HllSketch aggregates with PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hll_sketch_agg |
| Estimate cardinality from HllSketch in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hll_sketch_estimate |
| Union HllSketch binaries with PySpark function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hll_union |
| Aggregate union of HllSketches in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hll_union_agg |
| Extract hour from timestamp in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hour |
| Partition data by hour using PySpark transform |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hours |
| Compute hypot function safely in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/hypot |
| Use ifnull for null coalescing in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ifnull |
| Perform case-insensitive LIKE matching in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ilike |
| Capitalize words with initcap in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/initcap |
| Explode array of structs with inline in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/inline |
| Explode arrays with null handling via inline_outer |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/inline_outer |
| Get input file block length in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/input_file_block_length |
| Get input file block start offset in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/input_file_block_start |
| Retrieve current input file name in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/input_file_name |
| Find substring position with instr in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/instr |
| Use length PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/length |
| Compute Levenshtein distance with Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/levenshtein |
| Pattern matching with like in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/like |
| Aggregate values using listagg in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/listagg |
| Use listagg_distinct for distinct aggregation in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/listagg_distinct |
| Create literal columns with lit in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/lit |
| Calculate natural logarithms with Databricks PySpark ln |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ln |
| Get query-start timestamps with localtimestamp in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/localtimestamp |
| Find substring positions using locate in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/locate |
| Use log function for logarithms in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/log |
| Compute base-10 logarithms with log10 in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/log10 |
| Use log1p for log(1+x) in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/log1p |
| Compute base-2 logarithms with log2 in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/log2 |
| Convert strings to lowercase with Databricks PySpark lower |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/lower |
| Left-pad strings using lpad in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/lpad |
| Trim leading spaces with ltrim in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ltrim |
| Build dates from components with make_date in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_date |
| Create DayTimeIntervalType with make_dt_interval in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_dt_interval |
| Construct intervals from components with make_interval in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_interval |
| Create time values with make_time in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_time |
| Create timestamps with make_timestamp in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_timestamp |
| Create local-timezone timestamps with make_timestamp_ltz |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_timestamp_ltz |
| Create local date-times with make_timestamp_ntz in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_timestamp_ntz |
| Sanitize invalid UTF-8 with make_valid_utf8 in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_valid_utf8 |
| Create year-month intervals with make_ym_interval in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/make_ym_interval |
| Merge maps with map_concat and key dedup policy in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_concat |
| Check map keys with map_contains_key in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_contains_key |
| List map entries with map_entries in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_entries |
| Filter map key-value pairs with map_filter in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_filter |
| Build maps from arrays with map_from_arrays in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_from_arrays |
| Transform key-value arrays to maps with map_from_entries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_from_entries |
| Extract map keys with map_keys in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_keys |
| Extract map values with map_values in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_values |
| Merge maps with custom logic using map_zip_with in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/map_zip_with |
| Mask sensitive strings with mask function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/mask |
| Compute group maximums with max in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/max |
| Select values by maximum ordering with max_by in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/max_by |
| Generate MD5 hashes with md5 in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/md5 |
| Calculate averages with mean (avg) in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/mean |
| Compute median values in groups with Databricks PySpark median |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/median |
| Use PySpark round function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/round |
| Apply row_number window function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/row_number |
| Right-pad strings with rpad in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/rpad |
| Trim right-side spaces using rtrim in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/rtrim |
| Infer CSV schema with schema_of_csv in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/schema_of_csv |
| Infer JSON schema with schema_of_json in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/schema_of_json |
| Get variant schema using schema_of_variant in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/schema_of_variant |
| Aggregate variant schemas with schema_of_variant_agg in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/schema_of_variant_agg |
| Infer XML schema with schema_of_xml in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/schema_of_xml |
| Compute secant with sec function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sec |
| Extract seconds from dates using second in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/second |
| Split text into sentences with sentences in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sentences |
| Generate integer ranges with sequence in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sequence |
| Retrieve current session_user in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/session_user |
| Use session_window for dynamic streaming windows in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/session_window |
| Compute SHA hash with sha in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sha |
| Generate SHA-1 hashes with sha1 in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sha1 |
| Use sha2 for SHA-2 family hashing in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sha2 |
| Shift bits left with shiftleft in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/shiftleft |
| Signed right bit shift with shiftright in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/shiftright |
| Unsigned right bit shift with shiftrightunsigned in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/shiftrightunsigned |
| Randomly permute arrays with shuffle in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/shuffle |
| Compute sign with sign function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sign |
| Compute signum with signum in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/signum |
| Compute sine with sin function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sin |
| Compute hyperbolic sine with sinh in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sinh |
| Get array or map length with size in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/size |
| Calculate skewness aggregation in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/skewness |
| Slice arrays with slice function in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/slice |
| Evaluate boolean any with some in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/some |
| Sort arrays with sort_array in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sort_array |
| Compute SoundEx codes with soundex in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/soundex |
| Access Spark partition IDs with spark_partition_id in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/spark_partition_id |
| Split strings with regex using split in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/split |
| Extract string segments with split_part in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/split_part |
| Compute square roots with sqrt in Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sqrt |
| Modify geospatial linestrings with st_addpoint in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_addpoint |
| Compute geospatial area with st_area in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_area |
| Convert geospatial data to WKB with st_asbinary in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_asbinary |
| Use st_asewkb PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_asewkb |
| Use st_asewkt PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_asewkt |
| Use st_asgeojson PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_asgeojson |
| Use st_astext PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_astext |
| Use st_aswkb PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_aswkb |
| Use st_aswkt PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_aswkt |
| Use st_azimuth PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_azimuth |
| Use st_boundary PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_boundary |
| Use st_buffer PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_buffer |
| Use st_centroid PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_centroid |
| Use st_closestpoint PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_closestpoint |
| Use st_concavehull PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_concavehull |
| Use st_contains PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_contains |
| Use st_convexhull PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_convexhull |
| Use st_covers PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_covers |
| Use st_difference PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_difference |
| Use st_dimension PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_dimension |
| Use st_disjoint PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_disjoint |
| Use st_distance PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_distance |
| Use st_distancesphere PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_distancesphere |
| Use st_distancespheroid PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_distancespheroid |
| Use st_dump PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_dump |
| Use st_dwithin PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_dwithin |
| Use st_endpoint PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_endpoint |
| Use st_envelope PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_envelope |
| Use st_envelope_agg PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_envelope_agg |
| Use st_equals PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_equals |
| Use st_exteriorring PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_exteriorring |
| Use st_flipcoordinates PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_flipcoordinates |
| Use st_geogfromewkt PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geogfromewkt |
| Use st_geogfromgeojson PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geogfromgeojson |
| Use st_geogfromtext PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geogfromtext |
| Use st_geogfromwkb PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geogfromwkb |
| Use st_geogfromwkt PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geogfromwkt |
| Use st_geohash PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geohash |
| Use st_geometryn PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geometryn |
| Use st_geometrytype PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geometrytype |
| Use st_geomfromewkb PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromewkb |
| Use st_geomfromewkt PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromewkt |
| Use st_geomfromgeohash PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromgeohash |
| Use st_geomfromgeojson in Azure Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromgeojson |
| Use st_geomfromtext in Azure Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromtext |
| Use st_geomfromwkb in Azure Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromwkb |
| Use st_geomfromwkt in Azure Databricks PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_geomfromwkt |
| Use st_interiorringn for polygon rings in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_interiorringn |
| Use st_intersection for geometry intersections in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_intersection |
| Use st_intersects to test geometry intersections |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_intersects |
| Use st_isempty to check empty geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_isempty |
| Use st_isvalid to validate geometries in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_isvalid |
| Use st_length to measure geometry length |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_length |
| Use st_m to read M coordinate from points |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_m |
| Use st_makeline to build linestrings from geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_makeline |
| Use st_makepolygon to construct polygons in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_makepolygon |
| Use st_multi to convert to multi geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_multi |
| Use st_ndims to get geometry coordinate dimensions |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_ndims |
| Use st_npoints to count points in geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_npoints |
| Use st_numgeometries to count sub-geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_numgeometries |
| Use st_numinteriorrings to count polygon holes |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_numinteriorrings |
| Use st_perimeter to compute geometry perimeter |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_perimeter |
| Use st_point to create point geometries with SRID |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_point |
| Use st_pointfromgeohash to get geohash centers |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_pointfromgeohash |
| Use st_pointn to access nth point in linestrings |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_pointn |
| Use st_removepoint to modify linestring geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_removepoint |
| Use st_reverse to reverse geometry vertex order |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_reverse |
| Use st_rotate to rotate geometries around Z axis |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_rotate |
| Use st_scale to scale geometries in X, Y, Z |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_scale |
| Use st_setpoint to update points in linestrings |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_setpoint |
| Use st_setsrid to change geometry SRID |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_setsrid |
| Use st_simplify to simplify geometries in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_simplify |
| Use st_srid to read geometry SRID values |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_srid |
| Use st_startpoint to get first point of linestring |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_startpoint |
| Use st_touches to test touching geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_touches |
| Use st_transform to change geometry CRS in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_transform |
| Use st_translate to offset geometries in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_translate |
| Use st_union to compute union of geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_union |
| Use st_union_agg to aggregate geometry unions |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_union_agg |
| Use st_within to test geometry containment |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_within |
| Use st_x to read X coordinate from points |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_x |
| Use st_xmax to get maximum X of geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_xmax |
| Use st_xmin to get minimum X of geometries |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_xmin |
| Use st_y PySpark function for geometry Y coordinate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_y |
| Use st_ymax PySpark function for max Y coordinate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_ymax |
| Use st_ymin PySpark function for min Y coordinate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_ymin |
| Use st_z PySpark function for geometry Z coordinate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_z |
| Use st_zmax PySpark function for max Z coordinate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_zmax |
| Use st_zmin PySpark function for min Z coordinate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/st_zmin |
| Apply stack PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/stack |
| Use startswith PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/startswith |
| Use std aggregate PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/std |
| Use stddev PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/stddev |
| Use stddev_pop PySpark aggregate in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/stddev_pop |
| Use stddev_samp PySpark aggregate in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/stddev_samp |
| Convert strings to maps with str_to_map in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/str_to_map |
| Aggregate strings with string_agg in PySpark Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/string_agg |
| Use string_agg_distinct for distinct string aggregation |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/string_agg_distinct |
| Create struct columns with PySpark struct in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/struct |
| Extract substrings with substr PySpark function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/substr |
| Use substring PySpark function with 1-based indexing |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/substring |
| Use substring_index PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/substring_index |
| Compute sums with sum aggregate in PySpark Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sum |
| Use sum_distinct aggregate in PySpark Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/sum_distinct |
| Compute tangent with tan PySpark function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tan |
| Compute hyperbolic tangent with tanh in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tanh |
| Compute Theta Sketch set difference with theta_difference |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_difference |
| Compute Theta Sketch intersection with theta_intersection |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_intersection |
| Aggregate Theta Sketch intersections with theta_intersection_agg |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_intersection_agg |
| Build Theta Sketch aggregates with theta_sketch_agg |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_sketch_agg |
| Estimate unique counts with theta_sketch_estimate |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_sketch_estimate |
| Merge Theta Sketches with theta_union in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_union |
| Aggregate Theta Sketch unions with theta_union_agg |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/theta_union_agg |
| Calculate time differences with time_diff in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_diff |
| Create TIME values from microseconds with time_from_micros |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_from_micros |
| Create TIME values from milliseconds with time_from_millis |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_from_millis |
| Create TIME values from seconds with time_from_seconds |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_from_seconds |
| Extract microseconds from TIME with time_to_micros |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_to_micros |
| Extract milliseconds from TIME with time_to_millis |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_to_millis |
| Extract seconds from TIME with time_to_seconds |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_to_seconds |
| Truncate TIME values by unit with time_trunc |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/time_trunc |
| Use timestamp_add to compute timestamp differences |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/timestamp_add |
| Use timestamp_diff PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/timestamp_diff |
| Create timestamps from microseconds with timestamp_micros |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/timestamp_micros |
| Create timestamps from milliseconds with timestamp_millis |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/timestamp_millis |
| Convert Unix seconds to timestamp with timestamp_seconds |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/timestamp_seconds |
| Convert values to binary with to_binary in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_binary |
| Format values as strings using to_char in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_char |
| Serialize structs to CSV with to_csv in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_csv |
| Convert columns to dates with to_date in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_date |
| Parse binary or text to Geography with to_geography |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_geography |
| Parse binary or text to Geometry with to_geometry |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_geometry |
| Convert complex columns to JSON with to_json |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_json |
| Parse formatted strings to numbers with to_number |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_number |
| Convert columns to TimeType with to_time in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_time |
| Convert columns to TimestampType with to_timestamp |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_timestamp |
| Parse timestamps with time zone using to_timestamp_ltz |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_timestamp_ltz |
| Parse timestamps without time zone using to_timestamp_ntz |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_timestamp_ntz |
| Get UNIX timestamps with to_unix_timestamp in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_unix_timestamp |
| Convert local timestamps to UTC with to_utc_timestamp |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_utc_timestamp |
| Format values as VARCHAR using to_varchar in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_varchar |
| Convert nested columns to variant objects with to_variant_object |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_variant_object |
| Serialize structs to XML with to_xml in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/to_xml |
| Transform array elements with transform function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/transform |
| Transform map keys with transform_keys in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/transform_keys |
| Transform map values with transform_values in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/transform_values |
| Translate characters in strings with translate in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/translate |
| Trim whitespace from strings with trim in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/trim |
| Truncate dates to units with trunc in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/trunc |
| Safely add values with try_add in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_add |
| Decrypt values safely with try_aes_decrypt in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_aes_decrypt |
| Compute averages safely with try_avg in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_avg |
| Safely divide values with try_divide in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_divide |
| Safely access array or map elements with try_element_at |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_element_at |
| Safely build intervals with try_make_interval in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_make_interval |
| Safely construct timestamps with try_make_timestamp |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_make_timestamp |
| Safely construct LTZ timestamps with try_make_timestamp_ltz |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_make_timestamp_ltz |
| Safely construct NTZ timestamps with try_make_timestamp_ntz |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_make_timestamp_ntz |
| Safely compute remainders with try_mod in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_mod |
| Safely multiply values with try_multiply in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_multiply |
| Safely parse JSON strings to Variant with try_parse_json |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_parse_json |
| Safely parse URLs with try_parse_url in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_parse_url |
| Use try_reflect PySpark function in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_reflect |
| Use try_subtract PySpark function with overflow handling |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_subtract |
| Use try_sum PySpark aggregate with overflow safety |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_sum |
| Convert data safely with try_to_binary in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_binary |
| Convert values to dates using try_to_date in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_date |
| Parse geography values with try_to_geography in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_geography |
| Parse geometry values with try_to_geometry in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_geometry |
| Convert formatted strings to numbers with try_to_number |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_number |
| Convert columns to TimeType using try_to_time in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_time |
| Parse timestamps with try_to_timestamp in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_to_timestamp |
| Decode URLs safely with try_url_decode in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_url_decode |
| Validate UTF-8 strings using try_validate_utf8 in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_validate_utf8 |
| Extract sub-variants safely with try_variant_get in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_variant_get |
| Decompress Zstandard data with try_zstd_decompress in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/try_zstd_decompress |
| List available Spark SQL collations in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-collations |
| Use TableValuedFunction.inline to explode structs |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-inline |
| Use TableValuedFunction.inline_outer with null arrays |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-inline_outer |
| List Spark SQL reserved words with sql_keywords in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-sql_keywords |
| Use TableValuedFunction.stack in PySpark Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-stack |
| Explode variant arrays/objects with variant_explode TVF |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-variant_explode |
| Explode variant data with variant_explode_outer TVF |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/tvf-variant_explode_outer |
| Get DDL-formatted type strings with typeof in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/typeof |
| Convert strings to uppercase using ucase in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/ucase |
| Create and use PySpark UDFs in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/udf |
| Create user-defined table functions (UDTF) in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/udtf |
| Decode Base64 strings with unbase64 in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unbase64 |
| Convert hex strings to bytes using unhex in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unhex |
| Generate uniform random values with uniform in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/uniform |
| Get days since epoch using unix_date in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unix_date |
| Get microseconds since epoch with unix_micros in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unix_micros |
| Get milliseconds since epoch with unix_millis in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unix_millis |
| Get seconds since epoch with unix_seconds in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unix_seconds |
| Convert time strings to Unix timestamps with unix_timestamp |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unix_timestamp |
| Unwrap PySpark UDT columns to underlying types |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/unwrap_udt |
| Convert strings to uppercase using upper in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/upper |
| Decode URL-encoded strings with url_decode in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/url_decode |
| Encode strings as URLs with url_encode in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/url_encode |
| Get current Databricks user with user PySpark function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/user |
| Generate UUID strings using uuid in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/uuid |
| Validate UTF-8 strings with validate_utf8 in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/validate_utf8 |
| Compute population variance with var_pop in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/var_pop |
| Compute sample variance with var_samp in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/var_samp |
| Use variance alias for var_samp in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/variance |
| Extract sub-variants with variant_get in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/variant_get |
| Get Spark version information with version in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/version |
| Use Databricks PySpark weekday date function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/weekday |
| Use Databricks PySpark weekofyear function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/weekofyear |
| Apply conditional logic with PySpark when |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/when |
| Bucket numeric values with width_bucket in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/width_bucket |
| Create time windows with PySpark window function |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/window |
| Compute event time using window_time in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/window_time |
| Extract XML values with PySpark xpath |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath |
| Evaluate XML XPath to boolean in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_boolean |
| Get numeric XML values with xpath_double |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_double |
| Get numeric XML values with xpath_float |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_float |
| Get integer XML values with xpath_int |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_int |
| Get long XML values with xpath_long |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_long |
| Get numeric XML values with xpath_number |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_number |
| Get short XML values with xpath_short |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_short |
| Extract XML text with xpath_string in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xpath_string |
| Hash columns with xxhash64 in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/xxhash64 |
| Extract year from dates with PySpark year |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/year |
| Partition data by year with PySpark years |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/years |
| Replace nulls with zero using zeroifnull in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/zeroifnull |
| Merge arrays element-wise with zip_with in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/zip_with |
| Compress data with zstd_compress in PySpark |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/zstd_compress |
| Decompress Zstandard data with zstd_decompress |
https://learn.microsoft.com/en-us/azure/databricks/pyspark/reference/functions/zstd_decompress |
| Configure Lakehouse Federation for Google BigQuery |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/bigquery |
| Federate Databricks queries to generic HTTP APIs |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/http |
| Set up Lakehouse Federation for MySQL |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/mysql |
| Set up Lakehouse Federation for Oracle databases |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/oracle |
| Set up Lakehouse Federation for PostgreSQL |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/postgresql |
| Set up Lakehouse Federation for Amazon Redshift |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/redshift |
| Use remote_query to run SQL on external databases |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/remote-queries |
| Run federated queries on Salesforce Data 360 |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/salesforce-data-cloud |
| Set up Lakehouse Federation for SQL Server and Azure SQL |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/sql-server |
| Configure Lakehouse Federation for Azure Synapse |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/sqldw |
| Set up Lakehouse Federation for Teradata |
https://learn.microsoft.com/en-us/azure/databricks/query-federation/teradata |
| Read and write Avro files in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/avro |
| Read binary files using Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/binary |
| Read CSV files in Azure Databricks with read_files |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/csv |
| Read Delta Sharing tables with Spark DataFrames |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/deltasharing |
| Read Excel files using built-in Databricks support |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/excel |
| Load image data with Databricks image and binary formats |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/image |
| Read JSON files with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/json |
| Load MLflow experiment run data in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/mlflow-experiment |
| Use ORC file format with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/orc |
| Read Parquet files using Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/parquet |
| Process text files using Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/text |
| Read and write XML files in Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/query/formats/xml |
| Access Delta Lake API references from Databricks |
https://learn.microsoft.com/en-us/azure/databricks/reference/delta-lake |
| Use MLflow REST APIs on Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/reference/mlflow-api |
| Integrate Git repositories with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/repos/ |
| Configure KMS encryption for S3 paths in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/security/keys/kms-s3 |
| Query JSON string data with Databricks SQL operators |
https://learn.microsoft.com/en-us/azure/databricks/semi-structured/json |
| Query semi-structured VARIANT data in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/semi-structured/variant |
| Work with R and Spark DataFrames on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sparkr/dataframes-tables |
| Integrate Shiny applications with Azure Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sparkr/shiny |
| Develop Spark workloads in R using sparklyr |
https://learn.microsoft.com/en-us/azure/databricks/sparkr/sparklyr |
| Migrate to the latest Databricks SQL REST API |
https://learn.microsoft.com/en-us/azure/databricks/sql/dbsql-api-latest |
| Convert Parquet tables to Delta with SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-convert-to-delta |
| Load files into Delta tables with COPY INTO |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-copy-into |
| Delete rows from Delta tables in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-delete-from |
| Drop Delta Lake Bloom filter indexes in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-drop-bloomfilter-index |
| Generate Delta table artifacts with GENERATE |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-generate |
| Merge data into Delta tables with MERGE INTO |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-merge-into |
| Restore Delta tables to previous versions |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-restore |
| Update Delta tables using Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/delta-update |
| Use abs numeric function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/abs |
| Use acos trigonometric function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/acos |
| Use acosh hyperbolic function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/acosh |
| Use add_months date function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/add_months |
| Use ai_analyze_sentiment SQL function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_analyze_sentiment |
| Classify text with ai_classify in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_classify |
| Extract entities using ai_extract in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_extract |
| Fix grammar with ai_fix_grammar in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_fix_grammar |
| Forecast time series with ai_forecast in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_forecast |
| Generate text with ai_gen in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_gen |
| Use deprecated ai_generate_text function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_generate_text |
| Mask sensitive entities with ai_mask in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_mask |
| Parse documents using ai_parse_document in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_parse_document |
| Call model serving endpoints with ai_query in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_query |
| Compute semantic similarity with ai_similarity in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_similarity |
| Summarize text using ai_summarize in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_summarize |
| Translate text with ai_translate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ai_translate |
| Use CASE expression in Databricks SQL queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/case |
| Cast values between types in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cast |
| Compute cube root with cbrt in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cbrt |
| Round numbers up using ceil in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ceil |
| Round numbers up using ceiling in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ceiling |
| Return UTF-16 character with char in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/char |
| Measure string length with char_length in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/char_length |
| Measure string length with character_length in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/character_length |
| Return UTF-16 character with chr in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/chr |
| Inspect Auto Loader file state with cloud_files_state |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cloud_files_state |
| Return first non-null value with coalesce in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/coalesce |
| Apply explicit collation using collate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/collate |
| Retrieve string collation with collation function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/collation |
| List supported collations with collations table function |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/collations |
| Aggregate values into arrays with collect_list in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/collect_list |
| Aggregate unique values with collect_set in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/collect_set |
| Use :: operator for type casting in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/coloncolonsign |
| Extract JSON content with : operator in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/colonsign |
| Concatenate values with concat in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/concat |
| Concatenate strings with separator using concat_ws |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/concat_ws |
| Check substring presence with contains in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/contains |
| Convert number bases with conv in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/conv |
| Convert timestamps between time zones in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/convert_timezone |
| Compute Pearson correlation with corr in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/corr |
| Calculate cosine values with cos in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cos |
| Calculate hyperbolic cosine with cosh in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cosh |
| Calculate cotangent with cot in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cot |
| Count rows and values with count in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/count |
| Count true conditions with count_if in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/count_if |
| Build count-min sketch aggregates in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/count_min_sketch |
| Compute population covariance with covar_pop in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/covar_pop |
| Compute sample covariance with covar_samp in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/covar_samp |
| Generate CRC32 checksums with crc32 in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/crc32 |
| Calculate cosecant with csc in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/csc |
| Create multi-dimensional cubes with cube in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cube |
| Compute cumulative distribution with cume_dist window function |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/cume_dist |
| Get current date with curdate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/curdate |
| Return active catalog with current_catalog in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/current_catalog |
| Return active schema with current_database in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/current_database |
| Get current date with current_date in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/current_date |
| Use h3_centeraswkt for H3 cell centers in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_centeraswkt |
| Compact H3 cell sets with h3_compact in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_compact |
| Cover geography with H3 cells using h3_coverash3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_coverash3 |
| Cover geography with H3 strings using h3_coverash3string |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_coverash3string |
| Compute H3 grid distance with h3_distance in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_distance |
| Convert H3 IDs to hex strings with h3_h3tostring |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_h3tostring |
| Generate H3 hexagonal rings with h3_hexring in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_hexring |
| Check H3 parent-child relationships with h3_ischildof |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_ischildof |
| Detect pentagonal H3 cells with h3_ispentagon in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_ispentagon |
| Validate H3 cell IDs with h3_isvalid in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_isvalid |
| Get H3 k-ring neighborhoods with h3_kring in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_kring |
| Return H3 k-ring cells and distances with h3_kringdistances |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_kringdistances |
| Convert longitude/latitude to H3 IDs with h3_longlatash3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_longlatash3 |
| Convert longitude/latitude to H3 hex strings with h3_longlatash3string |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_longlatash3string |
| Get maximum child H3 cell with h3_maxchild in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_maxchild |
| Get minimum child H3 cell with h3_minchild in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_minchild |
| Convert geometry points to H3 IDs with h3_pointash3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_pointash3 |
| Convert geometry points to H3 strings with h3_pointash3string |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_pointash3string |
| Fill polygons with H3 IDs using h3_polyfillash3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_polyfillash3 |
| Fill polygons with H3 strings using h3_polyfillash3string |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_polyfillash3string |
| Get H3 cell resolution with h3_resolution in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_resolution |
| Convert H3 hex strings to IDs with h3_stringtoh3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_stringtoh3 |
| Tessellate geography into H3 cells with h3_tessellateaswkb |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_tessellateaswkb |
| List child H3 cells at resolution with h3_tochildren |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_tochildren |
| Get parent H3 cell at resolution with h3_toparent |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_toparent |
| Safely cover geography with H3 IDs using h3_try_coverash3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_coverash3 |
| Safely cover geography with H3 strings using h3_try_coverash3string |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_coverash3string |
| Safely compute H3 grid distance with h3_try_distance |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_distance |
| Safely polyfill polygons with H3 IDs using h3_try_polyfillash3 |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_polyfillash3 |
| Safely polyfill polygons with H3 strings using h3_try_polyfillash3string |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_polyfillash3string |
| Safely tessellate geography into H3 cells with h3_try_tessellateaswkb |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_tessellateaswkb |
| Validate H3 IDs safely with h3_try_validate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_try_validate |
| Uncompact H3 cell sets with h3_uncompact in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_uncompact |
| Strictly validate H3 IDs with h3_validate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/h3_validate |
| Compute hash values with hash function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/hash |
| Convert expressions to hexadecimal with hex in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/hex |
| Compute numeric histograms with histogram_numeric aggregate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/histogram_numeric |
| Create HyperLogLog sketch buffers with hll_sketch_agg in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/hll_sketch_agg |
| Estimate unique counts from HLL sketches with hll_sketch_estimate |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/hll_sketch_estimate |
| Union HyperLogLog sketches with hll_union in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/hll_union |
| Use hll_union_agg for HyperLogLog sketches in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/hll_union_agg |
| Call external HTTP endpoints with Databricks SQL http_request |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/http_request |
| Explode array-of-structs with inline in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/inline |
| Use inline_outer for outer explode of structs in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/inline_outer |
| Invoke Java methods from Databricks SQL with java_method |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/java_method |
| Extract multiple JSON fields with json_tuple in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/json_tuple |
| Aggregate integer KLL sketches with kll_merge_agg_bigint |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_merge_agg_bigint |
| Aggregate double KLL sketches with kll_merge_agg_double |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_merge_agg_double |
| Aggregate float KLL sketches with kll_merge_agg_float |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_merge_agg_float |
| Create KLL sketches for bigint quantiles in Databricks Runtime |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_agg_bigint |
| Create KLL sketches for double quantiles in Databricks Runtime |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_agg_double |
| Create KLL sketches for float quantiles in Databricks Runtime |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_agg_float |
| Get item count from bigint KLL sketch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_n_bigint |
| Get item count from double KLL sketch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_n_double |
| Get item count from float KLL sketch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_n_float |
| Estimate quantiles from bigint KLL sketch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_quantile_bigint |
| Estimate quantiles from double KLL sketch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_quantile_double |
| Use kll_sketch_get_quantile_float in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_quantile_float |
| Use kll_sketch_get_rank_bigint in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_rank_bigint |
| Use kll_sketch_get_rank_double in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_rank_double |
| Use kll_sketch_get_rank_float in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_get_rank_float |
| Merge integer KLL sketches with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_merge_bigint |
| Merge double KLL sketches with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_merge_double |
| Merge float KLL sketches with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_merge_float |
| Debug integer KLL sketches with kll_sketch_to_string_bigint |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_to_string_bigint |
| Debug double KLL sketches with kll_sketch_to_string_double |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_to_string_double |
| Debug float KLL sketches with kll_sketch_to_string_float |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kll_sketch_to_string_float |
| Calculate kurtosis with Databricks SQL aggregate function |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/kurtosis |
| Use lag analytic window function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lag |
| Use last aggregate function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/last |
| Get month end dates with last_day in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/last_day |
| Use last_value aggregate function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/last_value |
| Convert strings to lowercase with lcase in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lcase |
| Use lead analytic window function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lead |
| Return minimum values with least in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/least |
| Extract left substring with left function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/left |
| Measure string length with len in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/len |
| Measure string length with length in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/length |
| Compute Levenshtein distance with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/levenshtein |
| Pattern matching with like operator in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/like |
| Concatenate values with listagg aggregate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/listagg |
| Compute natural logarithms with ln in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ln |
| Find substring positions with locate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/locate |
| Compute logarithms with log function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/log |
| Compute base-10 logarithms with log10 in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/log10 |
| Use log1p for log(1+x) in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/log1p |
| Compute base-2 logarithms with log2 in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/log2 |
| Convert strings to lowercase with lower in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lower |
| Left-pad strings with lpad in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lpad |
| Use null-safe equality <=> operator in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lteqgtsign |
| Use <= comparison operator in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/lteqsign |
| Use <> inequality operator in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ltgtsign |
| Trim leading characters with ltrim in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ltrim |
| Parse strings and Unix timestamps to TIMESTAMP in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/parse_timestamp |
| Use read_files table function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_files |
| Read Kafka data with Databricks SQL read_kafka |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_kafka |
| Stream from Kinesis using Databricks read_kinesis |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_kinesis |
| Stream from Pub/Sub using Databricks read_pubsub |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_pubsub |
| Stream from Pulsar using Databricks read_pulsar |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_pulsar |
| Read streaming state metadata with read_state_metadata |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_state_metadata |
| Access streaming state store via read_statestore |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/read_statestore |
| Query remote databases using Databricks remote_query |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/remote_query |
| Use schema_of_json_agg in Databricks SQL queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/schema_of_json_agg |
| Derive VARIANT schemas with schema_of_variant |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/schema_of_variant |
| Aggregate VARIANT schemas with schema_of_variant_agg |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/schema_of_variant_agg |
| Infer XML schemas using schema_of_xml in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/schema_of_xml |
| Calculate secant with sec in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sec |
| Extract seconds from timestamps with second |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/second |
| Split text into sentences with Databricks sentences |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sentences |
| Generate value ranges with sequence in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sequence |
| Group streaming data with session_window in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/session_window |
| Perform bitwise left shifts with shiftleft in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/shiftleft |
| Perform signed right shifts with shiftright in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/shiftright |
| Perform unsigned right shifts with shiftrightunsigned |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/shiftrightunsigned |
| Randomize array order with shuffle in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/shuffle |
| Determine numeric sign with sign in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sign |
| Determine numeric sign with signum in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/signum |
| Compute sine values with sin in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sin |
| Compute hyperbolic sine with sinh in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sinh |
| Get array or map length with size in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/size |
| Calculate distribution skewness with skewness aggregate |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/skewness |
| Use division operator in Databricks SQL expressions |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/slashsign |
| Extract array subsets with slice in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/slice |
| Cast values to SMALLINT with smallint in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/smallint |
| Evaluate boolean aggregates with some/any/bool_or |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/some |
| Sort arrays with sort_array in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sort_array |
| Generate phonetic codes with soundex in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/soundex |
| Create space-filled strings with space in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/space |
| Identify Spark partition with spark_partition_id in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/spark_partition |
| Split strings by regex with split in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/split |
| Extract delimited string parts with split_part |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/split_part |
| Compute square roots with sqrt in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sqrt |
| Modify linestrings with st_addpoint in Databricks geospatial |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_addpoint |
| Compute area of geospatial shapes with st_area |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_area |
| Export geospatial data as WKB with st_asbinary |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_asbinary |
| Export geometry as EWKB with st_asewkb in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_asewkb |
| Access n-th geometry with st_geometryn in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_geometryn |
| Get geometry type with st_geometrytype in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_geometrytype |
| Use st_geomfromwkt in Databricks SQL queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_geomfromwkt |
| Return polygon interior ring with st_interiorringn |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_interiorringn |
| Compute geometry intersection with st_intersection |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_intersection |
| Test geometry intersection with st_intersects in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_intersects |
| Check empty geospatial values with st_isempty |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_isempty |
| Validate geometries with st_isvalid in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_isvalid |
| Measure geospatial length with st_length in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_length |
| Get M coordinate from point with st_m |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_m |
| Build linestrings from points using st_makeline |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_makeline |
| Construct polygons from rings with st_makepolygon |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_makepolygon |
| Convert to multi-geometry with st_multi in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_multi |
| Get coordinate dimension with st_ndims in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_ndims |
| Count points in geospatial values with st_npoints |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_npoints |
| Count geometries in collections with st_numgeometries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_numgeometries |
| Get polygon interior ring count with st_numinteriorrings |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_numinteriorrings |
| Compute geospatial perimeter with st_perimeter in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_perimeter |
| Create point geometries with st_point in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_point |
| Convert geohash to point with st_pointfromgeohash |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_pointfromgeohash |
| Access n-th point in linestring with st_pointn |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_pointn |
| Remove points from linestrings with st_removepoint |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_removepoint |
| Reverse geospatial geometries with st_reverse |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_reverse |
| Rotate geometries around Z axis with st_rotate |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_rotate |
| Scale geometries in Databricks with st_scale |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_scale |
| Set linestring points with st_setpoint in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_setpoint |
| Assign SRID to geospatial values with st_setsrid |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_setsrid |
| Simplify geometries with st_simplify in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_simplify |
| Retrieve SRID from geospatial values with st_srid |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_srid |
| Get starting point of linestring with st_startpoint |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_startpoint |
| Test if geometries touch with st_touches in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_touches |
| Transform geometry CRS with st_transform in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_transform |
| Translate geometries with st_translate in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_translate |
| Union two geometries with st_union in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_union |
| Aggregate geometry unions with st_union_agg in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_union_agg |
| Test geometry containment with st_within in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_within |
| Get X coordinate from point with st_x in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_x |
| Get maximum X of geometry with st_xmax |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_xmax |
| Get minimum X of geometry with st_xmin |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_xmin |
| Get Y coordinate from point with st_y in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_y |
| Use st_ymax geometry function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_ymax |
| Use st_ymin geometry function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_ymin |
| Use st_z point geometry function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_z |
| Use st_zmax geometry function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_zmax |
| Use st_zmin geometry function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/st_zmin |
| Generate rows with stack table-valued function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/stack |
| Use startswith string function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/startswith |
| Calculate sample standard deviation with std in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/std |
| Calculate sample standard deviation with stddev in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/stddev |
| Calculate population standard deviation with stddev_pop |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/stddev_pop |
| Calculate sample standard deviation with stddev_samp |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/stddev_samp |
| Create maps from strings with str_to_map in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/str_to_map |
| Cast expressions to STRING with string function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/string |
| Aggregate strings with string_agg in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/string_agg |
| Build STRUCT values with struct function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/struct |
| Extract substrings with substr function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/substr |
| Extract substrings with substring function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/substring |
| Use substring_index to split strings in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/substring_index |
| Compute sums with sum aggregate function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/sum |
| Query Delta Lake change data with table_changes in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/table_changes |
| Compute tangent values with tan function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tan |
| Compute hyperbolic tangent with tanh in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tanh |
| Compute Theta Sketch set difference in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_difference |
| Compute Theta Sketch intersection in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_intersection |
| Aggregate Theta Sketch intersections with theta_intersection_agg |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_intersection_agg |
| Create Theta Sketches for approximate distinct counts in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_sketch_agg |
| Estimate unique counts from Theta Sketches in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_sketch_estimate |
| Union Theta Sketches with theta_union in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_union |
| Aggregate Theta Sketch unions with theta_union_agg in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/theta_union_agg |
| Use bitwise NOT (~) operator in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tildesign |
| Compute timestamp differences with timediff in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timediff |
| Cast expressions to TIMESTAMP with timestamp function |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timestamp |
| Create timestamps from microseconds since epoch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timestamp_micros |
| Create timestamps from milliseconds since epoch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timestamp_millis |
| Create timestamps from seconds since epoch in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timestamp_seconds |
| Add time units to timestamps with timestampadd in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timestampadd |
| Compute timestamp differences with timestampdiff in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/timestampdiff |
| Cast expressions to TINYINT with tinyint function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tinyint |
| Serialize values to Avro with to_avro in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/to_avro |
| Use try_validate_utf8 in Databricks SQL queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/try_validate_utf8 |
| Extract values with try_variant_get in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/try_variant_get |
| Decompress data with try_zstd_decompress in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/try_zstd_decompress |
| Compute TupleSketch difference with double summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_difference_double |
| Compute TupleSketch difference with integer summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_difference_integer |
| Aggregate TupleSketch intersection with double summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_intersection_agg_double |
| Aggregate TupleSketch intersection with integer summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_intersection_agg_integer |
| Use tuple_intersection_double for TupleSketch sets |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_intersection_double |
| Use tuple_intersection_integer for TupleSketch sets |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_intersection_integer |
| Build TupleSketch aggregates with double summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_agg_double |
| Build TupleSketch aggregates with integer summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_agg_integer |
| Estimate unique keys from TupleSketch (double) |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_estimate_double |
| Estimate unique keys from TupleSketch (integer) |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_estimate_integer |
| Summarize TupleSketch double summary values |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_summary_double |
| Summarize TupleSketch integer summary values |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_summary_integer |
| Get theta sampling rate from TupleSketch (double) |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_theta_double |
| Get theta sampling rate from TupleSketch (integer) |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_sketch_theta_integer |
| Union multiple TupleSketches with double summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_union_agg_double |
| Union multiple TupleSketches with integer summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_union_agg_integer |
| Union two TupleSketches with double summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_union_double |
| Union two TupleSketches with integer summaries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/tuple_union_integer |
| Determine expression data type with typeof in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/typeof |
| Convert strings to uppercase with ucase in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/ucase |
| Decode Base64 strings with unbase64 in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unbase64 |
| Convert hex strings to binary with unhex in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unhex |
| Generate uniform random numbers with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/uniform |
| Get days since epoch with unix_date in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unix_date |
| Get microseconds since epoch with unix_micros |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unix_micros |
| Get milliseconds since epoch with unix_millis |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unix_millis |
| Get seconds since epoch with unix_seconds |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unix_seconds |
| Work with UNIX timestamps using unix_timestamp |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/unix_timestamp |
| Convert strings to uppercase with upper in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/upper |
| Decode URL-encoded strings with url_decode in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/url_decode |
| Encode strings to URL format with url_encode |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/url_encode |
| Retrieve current user with user function in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/user |
| Generate UUID values with uuid function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/uuid |
| Validate UTF-8 strings with validate_utf8 in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/validate_utf8 |
| Compute population variance with var_pop in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/var_pop |
| Compute sample variance with var_samp in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/var_samp |
| Compute sample variance with variance aggregate function |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/variance |
| Use variant_explode table function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/variant_explode |
| Use variant_explode_outer table function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/variant_explode_outer |
| Extract values with variant_get in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/variant_get |
| Query Mosaic AI Vector Search with vector_search() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/vector_search |
| Get Apache Spark version with version() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/version |
| Compute weekday values in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/weekday |
| Compute weekofyear in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/weekofyear |
| Use width_bucket histogram function in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/width_bucket |
| Define window grouping expressions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/window |
| Get window_time boundaries in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/window_time |
| Extract XML nodes with xpath() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath |
| Evaluate XML XPath booleans in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_boolean |
| Extract DOUBLE values from XML with xpath_double() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_double |
| Extract FLOAT values from XML with xpath_float() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_float |
| Extract INTEGER values from XML with xpath_int() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_int |
| Extract BIGINT values from XML with xpath_long() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_long |
| Extract numeric values from XML with xpath_number() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_number |
| Extract SMALLINT values from XML with xpath_short() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_short |
| Extract string values from XML with xpath_string() |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xpath_string |
| Compute 64-bit hashes with xxhash64 in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/xxhash64 |
| Extract year component with year() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/year |
| Handle NULLs with zeroifnull() in Databricks Runtime |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/zeroifnull |
| Merge arrays with zip_with() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/zip_with |
| Compress data with zstd_compress() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/zstd_compress |
| Decompress data with zstd_decompress() in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/functions/zstd_decompress |
| Build SQL expressions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-expression |
| Invoke built-in and user-defined functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-function-invocation |
| Create and register UDAFs in Databricks Runtime |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-functions-udf-aggregate |
| Integrate Hive UDFs, UDAFs, and UDTFs with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-functions-udf-hive |
| Implement external scalar UDFs in Databricks Runtime |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-functions-udf-scalar |
| Use H3 geospatial functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-h3-geospatial-functions |
| Alphabetical reference of H3 functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-h3-geospatial-functions-alpha |
| Analyze flight data with H3 geospatial functions |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-h3-geospatial-functions-examples |
| Quickstart with H3 geospatial functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-h3-geospatial-functions-quickstart |
| Use JSON path expressions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-json-path-expression |
| Define and use lambda functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-lambda-functions |
| Understand NULL handling semantics in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-null-semantics |
| Use ST geospatial functions with GEOGRAPHY/GEOMETRY in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-st-geospatial-functions |
| Alphabetical reference of ST geospatial functions in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-st-geospatial-functions-alpha |
| Use REFRESH CACHE in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-cache-refresh |
| Use REFRESH FUNCTION in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-cache-refresh-function |
| Use REFRESH TABLE in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-cache-refresh-table |
| Use UNCACHE TABLE in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-cache-uncache-table |
| Describe catalogs with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-catalog |
| Describe connections in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-connection |
| Describe credentials in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-credential |
| Use DESCRIBE DATABASE in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-database |
| Describe functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-function |
| Describe external locations in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-location |
| Describe procedures in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-procedure |
| Describe Delta Sharing providers in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-provider |
| Describe query output in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-query |
| Describe recipients in Databricks Delta Sharing |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-recipient |
| Describe schemas in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-schema |
| Describe Delta Sharing shares in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-share |
| Describe tables in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-table |
| Describe Unity Catalog volumes in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-describe-volume |
| List objects at URLs in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-list |
| Show all objects in a Delta share |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-all-in-share |
| Show catalogs in Databricks Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-catalogs |
| Show table columns in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-columns |
| Show connections in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-connections |
| Show CREATE TABLE statements in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-create-table |
| Use SHOW DATABASES in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-databases |
| Show and discover functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-functions |
| Show external locations in Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-locations |
| Show table partitions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-partitions |
| Show stored procedures in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-procedures |
| Show Delta Sharing providers in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-providers |
| Show Delta Sharing recipients in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-recipients |
| Show schemas in Databricks SQL catalogs |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-schemas |
| Show Delta Sharing shares in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-shares |
| Show provider shares in Databricks Delta Sharing |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-shares-in-provider |
| Show extended table information in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-table |
| Show tables in Databricks schemas |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-show-tables |
| Use SYNC to upgrade tables to Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-aux-sync |
| Add comments and hints in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-comment |
| Use Databricks SQL CREATE TABLE syntax correctly |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-create-table |
| Define views with Databricks SQL CREATE VIEW |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-create-view |
| Create Unity Catalog volumes with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-create-volume |
| Declare and use session variables in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-declare-variable |
| Drop Unity Catalog catalogs with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-catalog |
| Drop Unity Catalog connections via Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-connection |
| Drop Unity Catalog credentials with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-credential |
| Drop databases (schemas) in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-database |
| Drop user-defined functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-function |
| Drop Unity Catalog external locations via SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-location |
| Drop Unity Catalog policies with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-policy |
| Drop user-defined procedures in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-procedure |
| Drop Delta Sharing providers with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-provider |
| Drop Delta Sharing recipients via Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-recipient |
| Drop schemas in Databricks SQL and Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-schema |
| Drop Delta Sharing shares with Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-share |
| Drop tables and metadata in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-table |
| Drop temporary variables in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-variable |
| Drop views and clean metadata in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-drop-view |
| Refresh materialized views and streaming tables |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-refresh-full |
| Repair tables and sync metadata in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-repair-table |
| Truncate tables and partitions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-ddl-truncate-table |
| Insert data into Databricks tables with SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-dml-insert-into |
| Insert overwrite directories in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-dml-insert-overwrite-directory |
| Insert overwrite directories using Hive SerDe |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-dml-insert-overwrite-directory-hive |
| Load data into Hive SerDe tables in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-dml-load |
| Inspect query plans with EXPLAIN in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-explain |
| Use EXPLAIN CREATE MATERIALIZED VIEW in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-explain-materialized-view |
| Compose Databricks SQL pipelines with chained operators |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-pipeline |
| Write SELECT queries in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-query |
| Write SELECT subqueries in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select |
| Use CLUSTER BY in Databricks SELECT queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-clusterby |
| Select and compute columns in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-column-list |
| Define common table expressions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-cte |
| Repartition data with DISTRIBUTE BY in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-distributeby |
| Use GROUP BY in Databricks SQL queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-groupby |
| Filter grouped results with HAVING in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-having |
| Use JOIN operations in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-join |
| Use LATERAL VIEW with generators in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-lateral-view |
| Limit query result rows in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-limit |
| Define reusable WINDOW specifications in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-named-window |
| Sort query results with ORDER BY in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-orderby |
| Use piped operations in Databricks SQL queries |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-pipeop |
| Transform rows to columns with PIVOT in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-pivot |
| Filter window function results with QUALIFY |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-qualify |
| Sample tables with TABLESAMPLE in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-sampling |
| Use set operators in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-setops |
| Sort partitions with SORT BY in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-sortby |
| Reference tables and inline data in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-table-reference |
| Invoke table-valued functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-tvf |
| Convert columns to rows with UNPIVOT in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-unpivot |
| Create inline tables with VALUES in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-values |
| Apply WATERMARK to streaming queries in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-watermark |
| Filter query rows with WHERE in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-select-where |
| Use star expansion and metadata columns in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-qry-star |
| Configure window frame clauses in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-syntax-window-functions-frame |
| Use window functions in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/language-manual/sql-ref-window-functions |
| Implement query parameters in Databricks SQL editor |
https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-parameters |
| Create and use query snippets in Databricks SQL |
https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/query-snippets |
| Work with SQL warehouse sessions in Databricks |
https://learn.microsoft.com/en-us/azure/databricks/sql/user/queries/sessions |
| Build custom stateful applications with transformWithState |
https://learn.microsoft.com/en-us/azure/databricks/stateful-applications/ |
| Implement example custom stateful streaming apps with transformWithState |
https://learn.microsoft.com/en-us/azure/databricks/stateful-applications/examples |
| Use legacy arbitrary stateful operators mapGroupsWithState and flatMapGroupsWithState |
https://learn.microsoft.com/en-us/azure/databricks/stateful-applications/legacy |
| Build streaming pipelines with Avro and Schema Registry |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/avro-dataframe |
| Apply Structured Streaming patterns with external systems |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/examples |
| Use foreachBatch to write custom streaming sinks |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/foreach |
| Read and write protocol buffers with Structured Streaming |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/protocol-buffers |
| Implement real-time Structured Streaming integrations |
https://learn.microsoft.com/en-us/azure/databricks/structured-streaming/real-time-examples |
| Implement Scala user-defined aggregate functions |
https://learn.microsoft.com/en-us/azure/databricks/udf/aggregate-scala |
| Create and use pandas UDFs on Databricks |
https://learn.microsoft.com/en-us/azure/databricks/udf/pandas |
| Implement Python scalar UDFs for Spark SQL |
https://learn.microsoft.com/en-us/azure/databricks/udf/python |
| Implement batch Python UDFs in Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/udf/python-batch-udf |
| Develop Python user-defined table functions |
https://learn.microsoft.com/en-us/azure/databricks/udf/python-udtf |
| Create Scala scalar UDFs for Spark SQL |
https://learn.microsoft.com/en-us/azure/databricks/udf/scala |
| Register Python UDTFs in Unity Catalog |
https://learn.microsoft.com/en-us/azure/databricks/udf/udtf-unity-catalog |
| Create Mosaic AI Vector Search endpoints and indexes |
https://learn.microsoft.com/en-us/azure/databricks/vector-search/create-vector-search |
| Use custom embedding models with Mosaic Vector Search |
https://learn.microsoft.com/en-us/azure/databricks/vector-search/custom-embedding-model |
| Query Mosaic AI Vector Search indexes with filters |
https://learn.microsoft.com/en-us/azure/databricks/vector-search/query-vector-search |
| Use example notebooks for Mosaic AI Vector Search |
https://learn.microsoft.com/en-us/azure/databricks/vector-search/vs-example-notebooks |
| Use Unity Catalog volumes with files and tools |
https://learn.microsoft.com/en-us/azure/databricks/volumes/volume-files |