Serverless SQL – Azure Synapse Analytics

Time 2022-09-17 20:59:28

Web Name: Serverless SQL – Azure Synapse Analytics

WebSite: http://www.serverlesssql.com

ID:319007

Keywords:

SQL,Serverless,Analytics,Synapse

Description:

Skip to the content

Serverless SQL

Azure Synapse Analytics

Welcome to this data community blog all about Azure Synapse Analytics created by Andy Cutler covering Dedicated SQL Pools, Serverless SQL Pools, Pipelines, and Power BI . Click here to find out more…Keep up to date by adding your email to the newsletter here.

For all blogs, see the RECENT BLOGS section or jump into curated content directly below.

General Synapse

Azure Synapse Analytics in the Azure Architecture Centre

Serverless SQL Pools

Getting Started with Serverless SQL PoolsServerless SQL Pools Learning ResourcesServerless SQL Best PracticesCreating a Logical Data Warehouse with Serverless SQL Pools

Conference & User Groups

Links to session recordings and session notes

DP-500 Enterprise Data Analyst

New Certification: Microsoft Certified Azure Enterprise Data Analyst Associate

Hints and Tips

Using CETAS in Serverless SQL Pools to write results to Azure Data Lake Gen2How Serverless SQL Pools deals with different file schemasUsing Temporary Tables within Serverless SQL PoolsAzure Storage Folder Filtering using the Filepath Function10 Billion Rows: Parquet File Size and Distribution When using CETAS

FEATURED BLOG

Elastic Queries with Azure SQL Database and Synapse Analytics Serverless SQL Poolsby AndySeptember 12, 2022Recently I have been exploring an option to use an Azure SQL Database for a small footprint Data Warehouse and…

---

RECENT BLOGS

Elastic Queries with Azure SQL Database and Synapse Analytics Serverless SQL PoolsSeptember 12, 2022Recently I have been exploring an option to use an Azure SQL Database for a small footprint Data Warehouse and…Use Azure Log Analytics to analyse Azure Data Lake Gen2 activity from Serverless SQL PoolsAugust 11, 2022This blog is marked asintermediate knowledgeas an understanding of Serverless SQL Pools is preferable, but not essential. Refer toGetting Started…Use Azure Storage Logs to analyse Synapse Analytics Serverless SQL Pools ActivityJuly 21, 2022This blog is marked as intermediate knowledge as an understanding of Serverless SQL Pools is preferable, but not essential. Refer…PASS Summit Recording Available: Creating a Logical Data Warehouse using Azure Synapse Analytics Serverless SQL PoolsJuly 14, 2022My PASS Data Community Summit 2021 recording is now available, please click here for the recording. I’ve re-watched the session…How does Serverless SQL Pools deal with different file schemas? Part 3 – DeltaJuly 7, 2022Welcome to the 3rd and final part in this blog series in which we’re looking at how Azure Synapse Analytics…How does Serverless SQL Pools deal with different file schemas? Part 2 – ParquetJune 30, 2022Welcome to part 2 in this blog series in which we’re looking at what happens when schema changes are made…How does Serverless SQL Pools deal with different file schemas? Part 1 – CSVMarch 24, 2022Serverless SQL Pools offers a straight-forward method of querying data including CSV, JSON, and Parquet format stored in Azure Storage.…Integrating Power BI & Azure Synapse Analytics – Power BI UK User GroupMarch 17, 2022Here is the link to the slides for the Power BI UK User Group session on Thursday 17th March, 2022…SQLBits 2022 – The Dream Team: Synapse Analytics Serverless SQL Pools and PipelinesMarch 14, 2022I presented a 20 minute session at SQLBits 2022 in which I talked about how useful Synapse Pipelines can be…

---

LEARNING: AZURE ENTERPRISE DATA ANALYST ASSOCIATE

Mastering DP-500 Exam: Using the Data Map in Microsoft PurviewMay 3, 2022Part of the upcoming Azure Enterprise Data Analyst Associate exam, the DP-500, is to understand how to identify data sources…Mastering DP-500 Exam: Integrating Microsoft Purview with Power BIApril 29, 2022Part of the upcoming Azure Enterprise Data Analyst Associate exam, the DP-500, is to understand how Microsoft Purview integrates with…Mastering DP-500 Exam: Querying Partitioned Sources in Azure StorageApril 21, 2022This blog forms part of the Mastering DP-500 exam series. A list of available blogs is here and is in…Mastering DP-500 Exam: Using Synapse Analytics Serverless SQL Pools to query Azure StorageApril 19, 2022This blog forms part of the Mastering DP-500 exam series. A list of available blogs is here and is in…Mastering DP-500 Exam: Blog ResourcesApril 18, 2022I am collaborating with Data Mozart on blogging around the upcoming Microsoft Certified: Azure Enterprise Data Analyst Associate certification. Please…New Certification: Microsoft Certified Azure Enterprise Data Analyst AssociateApril 9, 2022Microsoft has created a new certification, the Microsoft Certified Azure Enterprise Data Analyst Associate (link here). There is a single…

BLOG TAGS

A

Architecture Azure SQL Database

B

Best Practices

C

Certification CETAS Conference CSV

D

Data Community Data Lake Data Processing database designer Dataflows Dedicated SQL Pools Delta Documentation DP-500

E

ELastic Query Events Exam External Tables

F

filepath

G

Getting Started

L

lake database Learning Resources Log Analytics Logging Logical Data Warehouse

O

OPENROWSET

P

Parquet Permissions Pipelines Power BI purview

S

Schema Evolution Schemas Security Serverless Serverless SQL Pools Spark Pools Star Schema

T

Temp Tables

V

Views

BLOG CATEGORIES

CertificationData GovernanceGetting StartedLearningLogical Data WarehouseOptimisationProblem SolvingSessionUncategorized

---

FEATURED VIDEO

---

---

LOGICAL DATA WAREHOUSE SERIES

Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 1 of 4 – Setting Up and Querying Source DataMay 1, 2021Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 2 of 4 – Creating a Dimensional ModelMay 31, 2021Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 3 of 4 – Incremental Fact Loading and Slowly Changing DimensionsJune 26, 2021Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 4 of 4 – Connecting Power BI to the Dimensional ModelJuly 1, 2021

---

BLOG ARCHIVE

Elastic Queries with Azure SQL Database and Synapse Analytics Serverless SQL PoolsSeptember 12, 2022Recently I have been exploring an option to use an Azure SQL Database for a small footprint Data Warehouse and…Use Azure Log Analytics to analyse Azure Data Lake Gen2 activity from Serverless SQL PoolsAugust 11, 2022This blog is marked asintermediate knowledgeas an understanding of Serverless SQL Pools is preferable, but not essential. Refer toGetting Started…Use Azure Storage Logs to analyse Synapse Analytics Serverless SQL Pools ActivityJuly 21, 2022This blog is marked as intermediate knowledge as an understanding of Serverless SQL Pools is preferable, but not essential. Refer…PASS Summit Recording Available: Creating a Logical Data Warehouse using Azure Synapse Analytics Serverless SQL PoolsJuly 14, 2022My PASS Data Community Summit 2021 recording is now available, please click here for the recording. I’ve re-watched the session…How does Serverless SQL Pools deal with different file schemas? Part 3 – DeltaJuly 7, 2022Welcome to the 3rd and final part in this blog series in which we’re looking at how Azure Synapse Analytics…How does Serverless SQL Pools deal with different file schemas? Part 2 – ParquetJune 30, 2022Welcome to part 2 in this blog series in which we’re looking at what happens when schema changes are made…Lake Databases And The Importance of Data TypesMay 18, 2022I encountered an issue with Azure Synapse Analytics Lake Databases and I’d like to share the problem and the solution.…Mastering DP-500 Exam: Using the Data Map in Microsoft PurviewMay 3, 2022Part of the upcoming Azure Enterprise Data Analyst Associate exam, the DP-500, is to understand how to identify data sources…Mastering DP-500 Exam: Integrating Microsoft Purview with Power BIApril 29, 2022Part of the upcoming Azure Enterprise Data Analyst Associate exam, the DP-500, is to understand how Microsoft Purview integrates with…Mastering DP-500 Exam: Querying Partitioned Sources in Azure StorageApril 21, 2022This blog forms part of the Mastering DP-500 exam series. A list of available blogs is here and is in…Mastering DP-500 Exam: Using Synapse Analytics Serverless SQL Pools to query Azure StorageApril 19, 2022This blog forms part of the Mastering DP-500 exam series. A list of available blogs is here and is in…Mastering DP-500 Exam: Blog ResourcesApril 18, 2022I am collaborating with Data Mozart on blogging around the upcoming Microsoft Certified: Azure Enterprise Data Analyst Associate certification. Please…New Certification: Microsoft Certified Azure Enterprise Data Analyst AssociateApril 9, 2022Microsoft has created a new certification, the Microsoft Certified Azure Enterprise Data Analyst Associate (link here). There is a single…How does Serverless SQL Pools deal with different file schemas? Part 1 – CSVMarch 24, 2022Serverless SQL Pools offers a straight-forward method of querying data including CSV, JSON, and Parquet format stored in Azure Storage.…Integrating Power BI & Azure Synapse Analytics – Power BI UK User GroupMarch 17, 2022Here is the link to the slides for the Power BI UK User Group session on Thursday 17th March, 2022…SQLBits 2022 – The Dream Team: Synapse Analytics Serverless SQL Pools and PipelinesMarch 14, 2022I presented a 20 minute session at SQLBits 2022 in which I talked about how useful Synapse Pipelines can be…Trigger The Process – Using CETAS in Serverless SQL Pools to Generate Pre-Calculated Datasets – Part 2 of 2February 10, 2022In part one we looked at a process in which a pre-aggregated dataset can be created by Azure Synapse Analytics…Using CETAS in Serverless SQL Pools to Generate Pre-Calculated Datasets – Part 1 of 2January 27, 2022Dedicated SQL Pools have a feature called Materialized Views which can generate a pre-calculated/processed dataset ready for consumption and is…DataMinutes #2 Session Companion for Turbocharging Power BI using Synapse AnalyticsJanuary 21, 2022The slides for the DataMinutes #2 session Turbocharging Power BI using Synapse Analytics is available here to download. GitHub Code…SQLBits Session – The Dream Team: Synapse Analytics Serverless SQL Pools and PipelinesJanuary 13, 2022SQLBits is back this year and is running from Tuesday 8th to Sunday 12th March at the ExCel in London.…DataMinutes #2 Conference – Azure Synapse Analytics SessionsJanuary 5, 2022The next DataMinutes conference (#2) is taking place on Friday 21st January. What’s different about DataMinutes is that it is…Power BI Hybrid Tables with Synapse Analytics Serverless SQL PoolsDecember 23, 2021In this video we’re talking a look at the new Power BI Hybrid Tables feature which combines Import, Incremental Refresh,…View Generation in Serverless SQL PoolsDecember 16, 2021One of the objects that can be created within a Serverless SQL Pools database is a View. A View, along…Testing Error Handling in Serverless SQL PoolsDecember 9, 2021A recent feature to be released for Serverless SQL Pools is error handling when processing external data (please see the…Data Toboggan Azure Synapse Analytics Event – Call For SpeakersDecember 2, 2021Data Toboggan is a community-driven conference focused on Azure Synapse Analytics, Microsoft’s flagship data warehousing, big data, and analytics service.…PASS Data Community Summit Companion ResourcesNovember 12, 2021PASS Data Community Summit 2021 Slides Please click here for a PDF copy of the slides. Polaris (Serverless SQL Pools…Creating a Lake Database using the Database DesignerNovember 3, 2021Synapse Analytics allows the creation of External Tables and Views within a Serverless SQL Pools database and also a Spark…Azure Synapse Analytics in the Azure Architecture CentreOctober 22, 2021Microsoft provide an Azure Architecture Centre which contains resources to understand which Azure services are appropriate in certain scenarios and…Using Access Control Lists To Manage Fine-Grain Data Lake PermissionsOctober 11, 2021When data is stored in Azure Data Lake Gen2, we can use Azure Active Directory and Access Control Lists (ACLs)…Integrating Azure Purview with Synapse Analytics Serverless SQL PoolsSeptember 16, 2021Azure Purview is a Microsoft Data Governance service which enables an organisation to map their data infrastructure including data lineage…Using Temporary Tables within Serverless SQL PoolsAugust 29, 2021Temporary (temp) tables have been a feature of Microsoft SQL Server (and other database systems) for many years. Temp tables…External Tables vs Views…Which to Use and Why?July 22, 2021Serverless SQL Pools do not contain data (unlike Dedicated SQL Pools) but rather allow you to cast structure over data…Azure Storage Folder Filtering using the Filepath FunctionJuly 7, 2021Serverless SQL Pools includes 2 SQL functions, filepath and filename, that can be used to return the folder path/name and…10 Billion Rows: Parquet File Size and Distribution When using CETASJuly 5, 2021When using Serverless SQL Pools to write data to Azure Storage/Data Lake Gen2 using the CREATE EXTERNAL TABLE AS SELECT…Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 4 of 4 – Connecting Power BI to the Dimensional ModelJuly 1, 2021Welcome to Part 4 in the Creating a Logical Data Warehouse with Synapse Serverless SQL Pools series. We are now…Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 3 of 4 – Incremental Fact Loading and Slowly Changing DimensionsJune 26, 2021Welcome to part 3 of the Logical Data Warehouse with Serverless SQL Pools series. In this part we’ll be covering…Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 2 of 4 – Creating a Dimensional ModelMay 31, 2021Welcome to part 2 of this 4 part blog series on creating a Logical Data Warehouse with Azure Synapse Analytics…Creating a Logical Data Warehouse with Synapse Serverless SQL: Part 1 of 4 – Setting Up and Querying Source DataMay 1, 2021Welcome to part one of a four part blog series where we’ll be looking at one of the main scenarios…Azure Synapse Analytics Serverless SQL Pools Learning ResourcesApril 1, 2021Welcome to this collection of links to resources focussed on Azure Synapse Analytics Serverless SQL Pools. It includes official Microsoft…Azure Synapse Analytics Serverless SQL Best PracticesMarch 1, 2021Microsoft have a best practices document available here which highlights certain actions that can be taken to optimise use of…Getting Started with Azure Synapse Analytics SQL ServerlessFebruary 1, 2021The new Azure Synapse Analytics SQL Serverless service enables querying file-based data stored in an Azure Data Lake Gen2 storage…Harnessing Azure Synapse Analytics SQL Serverless in Power BI DataflowsJanuary 1, 2021Power BI Dataflows are a Power BI Service component that allow the creation of centralised, cleansed, transformed and certified tabular…Serverless SQL Pools Managed Private EndpointJune 11, 2020Steps Created new Synapse Workspace and selected Managed VNet option Opened Synapse Studio and clicked Manage > Manage Private Endpoints…

TAGS:SQL Serverless Analytics Synapse

<<< Thank you for your visit >>>

Hot Websites