5,357 questions with Azure Synapse Analytics tags

Sort by: Updated
0 answers

Create DB identity in synapse notebook

Hi, I want to create a Synapse notebook where can read data from Azure SQL server DB. So I need to connect the DB via jdbc and enter the user name and password like code below. Is there a way where I can store this username and password somewhere so that…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-04-24T03:06:32.7566667+00:00
Lotus88 176 Reputation points
commented 2025-06-15T03:16:32.4966667+00:00
Lotus88 176 Reputation points
0 answers

How do I fix a synapse link that was updating partition tables but stopped on June 4th.

We're doing a proof of concept for a Dataverse to Synapse data link which was working fine until about June 4th. For some reason, since then, the partition folders of the tables have stopped updating. The "live" folder for tables is continuing…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-12T14:12:23.38+00:00
Al Villeneuve 0 Reputation points
commented 2025-06-13T15:50:22.5733333+00:00
Venkat Reddy Navari 2,295 Reputation points Microsoft External Staff Moderator
0 answers

Need suggestion for good storage of data in azure like an RDBMS

Hi, We have a requirement where we want extract information from multiple payload json file which will be in blob storage and so many internal products will be pushing these files in azure data lake storage. Our goal is to extract the data from these…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-12T16:44:15.2833333+00:00
Anirudh Bharti 0 Reputation points
commented 2025-06-13T09:40:11.2533333+00:00
Smaran Thoomu 24,015 Reputation points Microsoft External Staff Moderator
1 answer

Connect to Serverless SQL Pool using Synapse Notebook

I'm trying to connect my database in serverless sql pool and create/drop some external tables in synapse notebook. I'm using below to connect to the sql: jdbc_url =…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-11T07:26:40.1766667+00:00
Haoran Bai 80 Reputation points
edited an answer 2025-06-13T00:52:04.1433333+00:00
Krupal Bandari 660 Reputation points Microsoft External Staff Moderator
1 answer

Issue using linked service v 2.0 on notebook

Hi, I am accessing the DB in Synapse notebook with linked service version 1. It is working ok but when I changed to version 2, error occurs. Is there any additional setting I need to set in Notebook ? Thank you!

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-05-28T03:35:15.4666667+00:00
Lotus88 176 Reputation points
answered 2025-06-12T17:48:54.5266667+00:00
Bajura, Keith 0 Reputation points
0 answers

How to resolve an error with too many vcores being requested?

I'm trying to run a simple script on a spark notebook. But I keep running into this error. Your Spark job requested 672 vcores. However, the workspace has a 12 core limit. The script in itself should not require that many vcores as it is only checking…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-09T16:58:20.6533333+00:00
Joseph Y. Lee 0 Reputation points
commented 2025-06-12T16:59:11.4266667+00:00
Chandra Boorla 13,790 Reputation points Microsoft External Staff Moderator
1 answer

Not able to truncate heap table

Hi team , This morning, we encountered an issue with the heap table—we attempted to truncate it, but the process has been running indefinitely. Could there be an issue on Azure's side?

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-10T12:03:16.1833333+00:00
Mayur Patil 35 Reputation points
commented 2025-06-12T09:24:38.6366667+00:00
Venkat Reddy Navari 2,295 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Permission to turn on Interactive Authoring in Azure Synapse Analytics

I'm a part of team that regularly ingests external files/tables using activity pipelines. To do this I need to turn on interactive authoring. I've been given Admin access to the site, but I always have to ask my boss to activate it because for some…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-10T19:07:05.3433333+00:00
Jonathan Kelly 20 Reputation points
accepted 2025-06-11T19:40:42.2366667+00:00
Jonathan Kelly 20 Reputation points
2 answers One of the answers was accepted by the question author.

Synapse workspace - Realtime data

Hi, Can you suggest a web link which I can study and use it to convince the management to use synapse workspace to process realtime data and capture them for presentation? Thank you

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2022-02-18T06:36:17.19+00:00
arkiboys 9,706 Reputation points
answered 2025-06-11T12:50:40.6466667+00:00
Ankur 0 Reputation points
2 answers

@@LANGID is not supported in Microsoft SQL Azure (RTM) - 12.0.2000.8 (Azure Synapse) - most accurate way of determining the LANGID?

As per the title, according to https://learn.microsoft.com/en-us/sql/t-sql/functions/langid-transact-sql?view=sql-server-ver17&viewFallbackFrom=azure-sqldw-latest, LANGID is not supported in Azure Synapse. What's the recommended (most accurate) way…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-09T11:29:55.49+00:00
Adrian CB 0 Reputation points
answered 2025-06-11T09:44:25.0666667+00:00
Adrian CB 0 Reputation points
2 answers

Issue with partitioned views/snapshot tables in azure synapse/ADLS

There seems to be an issue with the partitioned views (which run off the snapshot csv's in ADLS) for our data (we use Azure Synapse Link for Dataverse). Querying these views doesn't fail, but it cannot read all records in an entity, which is causing…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2023-11-06T12:04:08.94+00:00
Phil Haywood 0 Reputation points
commented 2025-06-11T06:50:26.4+00:00
Musarrat Aziz 5 Reputation points
2 answers One of the answers was accepted by the question author.

Unexpected $500 Billing for Azure Synapse

I activated the Azure Synapse service on August 1st using the default settings. However, I noticed that I am being billed $250 per day, which has accumulated to a total of $500 over the last two days. As a student, I am using this service solely for…

Azure Cost Management
Azure Cost Management
A Microsoft offering that enables tracking of cloud usage and expenditures for Azure and other cloud providers.
3,528 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,582 questions
asked 2024-08-03T18:13:18+00:00
Paramjeet Singh 20 Reputation points
commented 2025-06-10T08:37:04.43+00:00
BeresfordBear 0 Reputation points
1 answer

I need to get the Synapse workspace Outbound IP address for my workspace

I need to get the Synapse workspace Outbound IP address for my workspace

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-04T08:49:36.4366667+00:00
Prabhu 60 Reputation points
commented 2025-06-10T01:45:47.9566667+00:00
J N S S Kasyap 3,300 Reputation points Microsoft External Staff Moderator
1 answer

The dedicated sql pool memory usage is constantly 95%-96% without any activity. It's running on DW300c service level. Is there a way to find out what exactly is utilizing this much memory?

The dedicated sql pool memory usage is constantly 95%-96% without any activity. It's running on DW300c service level. Is there a way to find out what exactly is utilizing this much memory? I'm trying to avoid increasing the service level without finding…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-05T04:58:02.76+00:00
Raj Singh 0 Reputation points
edited an answer 2025-06-10T00:47:57.9666667+00:00
Krupal Bandari 660 Reputation points Microsoft External Staff Moderator
2 answers One of the answers was accepted by the question author.

Getting Error: Failed to save Arm Templates. Error: { "message": "Sorry, your input was too large to process.

We merged Pull requests which contained many changes in Synapse pipelines and then we were trying to publish the changes and generate a ARM template. Publish was successful The generation of ARM template got failed. Generating templates Failed to…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-05-30T17:32:34.3266667+00:00
PATEL, SACHIN KUMAR 40 Reputation points
accepted 2025-06-09T18:39:49.7566667+00:00
PATEL, SACHIN KUMAR 40 Reputation points
2 answers One of the answers was accepted by the question author.

Dataverse Synapse Link to Lake Database pulling Date and Datetime fields.

Our Dynamics Dataverse is using the Synapse Data Link to move data to Azure Data Lake gen 2. We then use a Synapse Analytics Data flows to transform the data to a Lake Database parquet file. Up until last week this was working great, but recently any…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-02T16:30:56.75+00:00
Dax Kent 25 Reputation points
accepted 2025-06-09T14:48:41.38+00:00
Dax Kent 25 Reputation points
0 answers

Not able to create an azure synaps analytics workspace in west europe

I'm trying to create an Azure Synapse Analytics workspace located in westeurope but when I try, I recieve the error: {"code":"ValidationFailed","message":"Workspace request validation failed, check error details for…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-05-30T12:05:20.93+00:00
Esther Kiel 0 Reputation points
commented 2025-06-09T07:10:15.7533333+00:00
Smaran Thoomu 24,015 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Using filepath() in synapse

I created an extrenal table in synapse and try to use filepath function on it, but got below error: Here is my table: CREATE EXTERNAL TABLE bronze.trip_data_green_csv ( VendorID INT, lpep_pickup_datetime datetime2(7), …

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-05-30T08:15:21.2033333+00:00
Haoran Bai 80 Reputation points
accepted 2025-06-05T08:20:36.1066667+00:00
Haoran Bai 80 Reputation points
0 answers

There are not enough vcores resources available in the workspace while running the synapse dataflows

Hi Team, we are getting the below error dataflow while running in for each activity, Could you please help us to fix this **There are not enough resources available in the workspace, details: 'Your job requested 8 vcores. However, the workspace…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-04-15T11:09:50.6333333+00:00
commented 2025-06-05T04:22:37.6266667+00:00
Dileep Raj Narayan Thumula 255 Reputation points Microsoft External Staff Moderator
1 answer

Azure Synapse Runtime for Apache Spark 3.5 Java Version

The recently released Azure Synapse Runtime for Apache Spark 3.5 mentions support for Java 17. However, the Github page for this runtime specifies Java version 11.0.27…

Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2025-06-03T18:34:25.3666667+00:00
Ty Gross 0 Reputation points
commented 2025-06-05T02:08:40.7333333+00:00
Smaran Thoomu 24,015 Reputation points Microsoft External Staff Moderator