1,559 questions with Azure Data Lake Storage tags

Sort by: Updated
1 answer

GDPR Handling In ADLS Gen2

I am creating a Centralised Data LAKEHOUSE as shown in Diagram. I have created a Second ADLS Gen2 so it easily connect with Databricks. I am seeking your valuable help in designing ADLS Gen 2 for silver layer. Do This approach is good. Do I need to…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-06-18T13:43:02.8566667+00:00
Relay 100 Reputation points
edited the question 2025-06-18T16:58:32.53+00:00
Chandra Boorla 13,885 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Is it possible to create Lakehouse with case insensitive collation in Fabric?

Is it possible to make lakehouse SQL end point as case insensitive collation, Or is there way to create a lakehouse with  case insensitive collation like we create warehouse (https://learn.microsoft.com/en-us/fabric/data-warehouse/collation)

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-06-09T20:24:18.4133333+00:00
Venkateswarlu Pottapalli 40 Reputation points Microsoft External Staff
accepted 2025-06-09T23:08:53.4933333+00:00
Venkateswarlu Pottapalli 40 Reputation points Microsoft External Staff
1 answer One of the answers was accepted by the question author.

Folder and contents within an ADLS blob deleted, no records within logs

Between the hours of 3:00 PM CST on 6/4/2025 and 8:20 AM CST on 6/5/2025, a folder and it's contents were deleted from one of our storage containers. This folder is not within our deleted items (we have 7 day retention enabled), and I cannot locate any…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-06-05T18:53:09.0166667+00:00
LanceKramer-6297 20 Reputation points
accepted 2025-06-09T14:55:49.67+00:00
LanceKramer-6297 20 Reputation points
3 answers

create hive metastore in Databricks with non-SQL DB

Hi Expert, How to create Hive Metastore in Azure databricks DB

Azure SQL Database
Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Databricks
Azure Databricks
An Apache Spark-based analytics platform optimized for Azure.
2,492 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,596 questions
Azure Database for PostgreSQL
asked 2023-07-17T13:56:46.3466667+00:00
Shambhu Rai 1,411 Reputation points
answered 2025-06-04T06:21:20.8966667+00:00
Dennis Schulist 0 Reputation points
2 answers

Logic app to retrieve the latest file from a blob folder

How can I create a logic app that retrieves the latest file from a blob folder when a Http request is received, where there are multiple files, and sends it as an attachment? Are there any specific steps or configurations required for this process?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,179 questions
Azure Logic Apps
Azure Logic Apps
An Azure service that automates the access and use of data across clouds without writing code.
3,530 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,596 questions
asked 2024-04-01T14:00:18+00:00
Aditya Singh 160 Reputation points
commented 2025-06-02T14:29:04.2166667+00:00
Lennart Bauer 0 Reputation points
1 answer One of the answers was accepted by the question author.

data lake and database migration

Hi Friends, we are developing a data lake, we are building till bronze layer, now I am in a dilemma. We have a Postgres database data (which is one time load and incremental load afterwards) on premise and we need to move that data into the data lake.…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-05-28T15:13:49.77+00:00
azure_learner 615 Reputation points
accepted 2025-05-29T07:49:48.7+00:00
azure_learner 615 Reputation points
1 answer

Content of directory on path 'https://datalakecohswtr.dfs.core.windows.net/files/sales/csv/**' cannot be listed.

I am trying to View Top 100 row of my file but it keeps bringing up error

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-05-20T05:25:24.1866667+00:00
Adeymola 0 Reputation points
commented 2025-05-23T21:07:06.0833333+00:00
Syed Aaqid Ali 580 Reputation points Microsoft External Staff Volunteer Moderator
1 answer

Generated Storage level SAS token using Logic Apps not working as expected

Hello Team, I did Automate generation of SAS token using http action in Azure Logic Apps. Here is the token generated -…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-04-30T11:50:59.89+00:00
Varun Reddy Gurram 0 Reputation points
answered 2025-05-09T18:13:37.97+00:00
KarishmaTiwari-MSFT 20,772 Reputation points Microsoft Employee Moderator
4 answers

How to send a mail notification for a failed pipeline in Azure Synapse Analytics?

How can I send a notification email to a specific email address without using a logic app when one of my Synapse Analytics pipelines fails? I would like to include the error message in the email notification.

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Blob Storage
Azure Blob Storage
An Azure service that stores unstructured data in the cloud as blobs.
3,179 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,596 questions
asked 2024-03-20T15:48:58.53+00:00
Aditya Singh 160 Reputation points
commented 2025-04-30T06:47:54.5966667+00:00
Muthusamy, Nandha Kumar 0 Reputation points
0 answers

Error generated in Synapse when I query dataverse data in Spark Notebook

Hey there, I am having an issue querying the data from the Synapse Link for Dataverse in a Spark Notebook within Synapse. I am able to run a SQL query against the data (which appears in Synapse as a Lake Database) and it returns data. See below …

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
.NET Machine learning
.NET Machine learning
.NET: Microsoft Technologies based on the .NET software framework.Machine learning: A type of artificial intelligence focused on enabling computers to use observed data to evolve new behaviors that have not been explicitly programmed.
162 questions
asked 2022-05-18T08:17:36.823+00:00
Robert O'Neill 6 Reputation points
commented 2025-04-26T05:44:01.75+00:00
Broomfield, Darrien 0 Reputation points
1 answer One of the answers was accepted by the question author.

Ingress and Egress cost in azure

I have gone through below thread: https://learn.microsoft.com/en-us/answers/questions/892660/will-the-ingress-egress-costs-of-a-azure-storage-a but still confused and clear about the ingress and egress costs of ADLS, and what parameters it takes to…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,596 questions
asked 2024-08-08T15:31:30.9766667+00:00
azure_learner 615 Reputation points
commented 2025-04-22T18:11:08.6666667+00:00
Jeff Strupp 20 Reputation points
1 answer One of the answers was accepted by the question author.

How is AI and Data lake going to work ahead

How is Azure Data lake place in future with AI, Co-pilot. Is Fabric the only way. How can the designing be done. What can help ?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-04-17T10:42:11.1133333+00:00
Hemelia Fernandes 20 Reputation points
accepted 2025-04-22T13:41:20.97+00:00
Hemelia Fernandes 20 Reputation points
1 answer

unable to disable download option in azure blob storage for video files

unable to disable download option in azure blob storage for video files

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-04-18T11:30:34.2666667+00:00
Bhoodev Sharma 0 Reputation points
commented 2025-04-22T10:57:27.7933333+00:00
Hari Babu Vattepally 3,270 Reputation points Microsoft External Staff Moderator
7 answers

Error trying to validate storage account name while creating a new synapse workspace

I am unable to create a new data lake storage (gen2) account name in the basic tab for create Azure Synapse Workspace. The error I get is - " There was an error trying to validate storage account name. please try again ". The error message is…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Synapse Analytics
Azure Synapse Analytics
An Azure analytics service that brings together data integration, enterprise data warehousing, and big data analytics. Previously known as Azure SQL Data Warehouse.
5,357 questions
asked 2022-08-03T07:01:54.587+00:00
Jozure 551 Reputation points
commented 2025-04-22T09:34:51.37+00:00
Pranav Kankane 0 Reputation points
1 answer

Best Archival Strategy for delta parquet in ADLS ?

We have a situation where we will be loading SAP data into ADLS layer using SAP Datasphere in delta parquet format. Now, we want to implement a robust archival framework for this data. Can you please guide/help me with the correct/MS recommended approach…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-04-16T07:55:41.4+00:00
Sagar, Sawan 0 Reputation points
answered 2025-04-16T10:36:44.73+00:00
Vinod Kumar Reddy Chilupuri 4,180 Reputation points Microsoft External Staff Moderator
1 answer

Azure Data Lake Analytics Retirement - Frequently Asked Questions

On 29 February 2024, we will retire Azure Data Lake Analytics and this service will no longer be available. Before that date, please migrate your services that were deployed using Azure Data Lake Analytics to another Azure data processing product of…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Data Lake Analytics
asked 2022-03-17T19:20:07.157+00:00
Michael Rys [MSFT] 11 Reputation points Microsoft Employee
commented 2025-04-16T06:56:19.18+00:00
Karan Kumar Bakhri 0 Reputation points
2 answers

Datalake data

Hi Friends, I want to understand exactly how data compression takes place in Data Lake behind the hood.What kind of algorithms techniques  if there are any applied within datalake ? Or do we need to take care of data compression needs by ourselves.Please…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-04-09T10:56:21.1866667+00:00
azure_learner 615 Reputation points
commented 2025-04-14T08:32:52.9433333+00:00
Vinod Kumar Reddy Chilupuri 4,180 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

I would like to know if connector is available for SAP BPC?

Hi Experts, I am working on solution development to ingest data from different SAP systems to ADLS Gen 2. I have selected ADF for the integration and could see ADF connectors available for SAP BW, HANA, C2C etc. However, I don't find any information…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
Azure Data Explorer
Azure Data Explorer
An Azure data analytics service for real-time analysis on large volumes of data streaming from sources including applications, websites, and internet of things devices.
571 questions
Azure Data Factory
Azure Data Factory
An Azure service for ingesting, preparing, and transforming data at scale.
11,596 questions
SQL Server Integration Services
SQL Server Integration Services
A Microsoft platform for building enterprise-level data integration and data transformations solutions.
2,700 questions
asked 2023-12-18T13:44:07.4133333+00:00
Sivaramakrishnan S 20 Reputation points
commented 2025-04-09T08:08:05.3266667+00:00
Gowtham Selvaraj 0 Reputation points
1 answer One of the answers was accepted by the question author.

Unable to rename a directory named space character using ADLS Gen2 REST API

The rename operation fails when the source directory contains a space in its name. I've been trying to understand why this happens. In my Golang code, I have multiple test cases, and the rename operation consistently fails when the directory name…

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-04-03T17:20:30.6833333+00:00
Juan Carlos Fernández Umaña 25 Reputation points
commented 2025-04-07T13:39:58.6666667+00:00
Juan Carlos Fernández Umaña 25 Reputation points
1 answer One of the answers was accepted by the question author.

Extract Refresh Failed: Databricks OAuth credentials expire in Tableau if a change is not made

Every 7 days or so, my Tableau Developers get this issue below, the current quick fix is for them to re-enter the Databricks credentials for the OAuth Clients Registry. Is there a setting that is causing this issue on the Databricks side?

Azure Data Lake Storage
Azure Data Lake Storage
An Azure service that provides an enterprise-wide hyper-scale repository for big data analytic workloads and is integrated with Azure Blob Storage.
1,559 questions
asked 2025-03-31T19:21:58.1633333+00:00
Tyler Mann 20 Reputation points
accepted 2025-04-02T20:27:00.2633333+00:00
Tyler Mann 20 Reputation points