397 questions with Azure Stream Analytics tags

Sort by: Updated
2 answers

Which solution on Azure is better and why

Scenario 1 : when I am consuming data from Stream Analytics to Azure SQL via service bus, as these services was already in used in different Pipeline. Pic 1 Secenerio 2 : I am thinking to Leverage ADF to bring same data from ADLS Gen2 to Azure SQL. As…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-22T14:44:28.7666667+00:00
Relay 100 Reputation points
commented 2025-06-03T15:20:30.2666667+00:00
Chandra Boorla 13,885 Reputation points Microsoft External Staff Moderator
2 answers

How to fix this error Value cannot be null.\r\nParameter name: s", azure stream analytics

I'm onboarding datasets from Kafka. Everything works fine when I onboard up to 6 datasets. But when I try to add a 7th dataset, I get the following error from Azure Stream Analytics: "The streaming job failed: Value cannot be null. Parameter name:…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-28T14:17:47.5666667+00:00
Naveen S Kumar 0 Reputation points
edited a comment 2025-06-03T07:10:18.8366667+00:00
Venkat Reddy Navari 2,380 Reputation points Microsoft External Staff Moderator
2 answers

How can I troubleshoot latency issues in Azure Stream Analytics job output?

I'm experiencing increased latency in the output of my Azure Stream Analytics job. The input is coming from an Event Hub and the output is going to an Azure SQL Database. I’ve checked that the Event Hub is receiving data in near real-time, but the…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-27T18:46:40.6766667+00:00
Stephen27 60 Reputation points
commented 2025-05-28T19:19:24.88+00:00
Ganesh Gurram 7,140 Reputation points Microsoft External Staff Moderator
1 answer

Low Level Design For Batch and Streaming Data Platform In Azure

Hello, I am trying to create Low level design Document for below mention diagram. May Someone please help me what all should be consider for each component. How to handle Error and Failure and Restartibility. Thank You So Much for your help.

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-19T15:52:01.6033333+00:00
Relay 100 Reputation points
commented 2025-05-21T17:20:11.44+00:00
Ganesh Gurram 7,140 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

How to do Low Level Design for Given HLD in Azure

I have created a High level design where I am consuming JSON file from Azure Stream Analytics to Azure SQL. What all are properties I should consider for creating Low Level Design for same. Please help me with your expertise knowledge. Thanks a lot

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-18T03:57:50.1766667+00:00
Relay 100 Reputation points
accepted 2025-05-19T05:00:58.3366667+00:00
Relay 100 Reputation points
2 answers

Design Real Time Streaming with Azure

I am in process of designing a real time (15 sec latency) data streaming system. Please share your thoughts on Pros and Cons for below scenerio. I have to replace SAP Connector with Azure Tech stack with lowest latency for process data, as shown in pic…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-13T06:12:26.8833333+00:00
Relay 100 Reputation points
answered 2025-05-13T08:16:46.0866667+00:00
phemanth 15,755 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Stream Analytics compatibility 1.2 - PARTITION BY PartitionId

Will the PARTITION BY PartitionId statement still ensure parallel processing (and make sure that input partition = output partition) for compatibility level 1.2 when we don't specify a partition key column? Our situation: we have 2 input eventhubs…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-05-12T10:53:56.6233333+00:00
Guusje 40 Reputation points
accepted 2025-05-12T12:02:49.27+00:00
Guusje 40 Reputation points
1 answer

How to fix We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached

We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached. Ensure that other Stream Analytics jobs or Service Bus Explorer are not using the same consumer group. The…

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
716 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-02-12T16:07:20.29+00:00
h85824 0 Reputation points
commented 2025-04-29T16:34:32.18+00:00
Sander van de Velde | MVP 36,526 Reputation points MVP Volunteer Moderator
1 answer

Unable to connect kafka topic as input in Azure Stream Analytics Job

We are getting error while establishing connection with kafka in Azure Stream Analytics Exception thrown while trying to retrieve Kafka partition count for <

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-16T10:04:36.4033333+00:00
Raghav, Omkar S 0 Reputation points
commented 2025-04-18T16:32:42.06+00:00
Chandra Boorla 13,885 Reputation points Microsoft External Staff Moderator
1 answer

azure stream analytics job issue.

For Cost management we tried the autoscaling option but as soon as that is configured, we stop receiving data in ADLS. currently we are receiving data only with manual Scale using 2SU JOB works with 2SU but not with 1SU even though we are processing…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-15T08:38:44.45+00:00
Muralikrishna Chintada 0 Reputation points
answered 2025-04-16T07:24:26.36+00:00
Sander van de Velde | MVP 36,526 Reputation points MVP Volunteer Moderator
1 answer

[Error] An error happened while submitting Job 'sql-job-0', error detail: Cannot read properties of undefined (reading 'length')

Error while submitting stream analytics job to azure from visual studio code - [Error] An error happened while submitting Job 'sql-job-0', error detail: Cannot read properties of undefined (reading 'length') I dont see any 'length' in my configs.

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-11T21:53:45.3+00:00
Suraj Pawar Vadeghar 0 Reputation points
commented 2025-04-15T06:06:36.31+00:00
Ganesh Gurram 7,140 Reputation points Microsoft External Staff Moderator
0 answers

When will Kafka Streaming Analytics REST/ARM deployments & documentation be available?

Now that Kafka inputs/outputs are GA as of November 2024 in Streaming Analytics, when will they be available to deploy programmatically? The following link indicates that you can deploy Kafka inputs with ARM, but there is no documentation in the Azure…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-04-03T15:30:35.2633333+00:00
Steve Hibit 0 Reputation points
commented 2025-04-03T17:25:53.2066667+00:00
Chandra Boorla 13,885 Reputation points Microsoft External Staff Moderator
1 answer

How to create cross tenant Output with Private Endpoint from Stream Analytics Job (Cluster) to an Event Hub (namespace)?

Hello Community! I'm currently trying to set up an Event Hub (on a namespace) output which exists in another Tenant, and Directory (and of course, Subscription) for a Stream Analytics Job within a Stream Analytics Cluster. I have verified that the…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-19T15:24:47.3766667+00:00
Sinipelto 0 Reputation points
commented 2025-03-26T07:22:06.7666667+00:00
Anonymous
1 answer

How to fix "where' operator: Failed to resolve scalar expression named 'properties_s'" when running the standard query named "List all input deserialization errors" in Stream Analytics job

When attempting to run the following standard query: The following error message is displayed 'where' operator: Failed to resolve scalar expression named 'properties_s' If the column properties_s doesn't exist, which column should I use instead?

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-18T14:46:52.2233333+00:00
Lucas Pires Savassa 0 Reputation points
commented 2025-03-20T09:16:36.3+00:00
Venkat Reddy Navari 2,380 Reputation points Microsoft External Staff Moderator
1 answer

Memory Usage Over Capacity error in Stream Analytics

Hi Team, I have stream analytics setup which is consuming data from an EventHub, I am constantly getting the below error message : The memory usage is over the capacity for one or more of the query steps. Event processing may be delayed or stop making…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-11T12:30:33.31+00:00
h85824 0 Reputation points
commented 2025-03-18T13:01:09.6833333+00:00
J N S S Kasyap 3,300 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

How streaming data is processed in real time projects , which was ingested through azure event hubs

And I have few questions : How streaming data is processed in real time projects?, lets say my streaming data is stored in adls gen-2, where every minute a new blob file is created. Does it should be treated as batch data and should process…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-10T21:16:06.5233333+00:00
Prakash Mj 20 Reputation points
edited a comment 2025-03-13T01:00:22.4166667+00:00
Ganesh Gurram 7,140 Reputation points Microsoft External Staff Moderator
1 answer One of the answers was accepted by the question author.

Azure stream analytics

I get this error when I want to display the data generated from this script

Azure Event Hubs
Azure Event Hubs
An Azure real-time data ingestion service.
716 questions
Visual Studio
Visual Studio
A family of Microsoft suites of integrated development tools for building applications for Windows, the web and mobile devices.
5,449 questions
Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
Azure Cosmos DB
Azure Cosmos DB
An Azure NoSQL database service for app development.
1,892 questions
Azure Event Grid
Azure Event Grid
An Azure event routing service designed for high availability, consistent performance, and dynamic scale.
448 questions
asked 2023-10-19T13:35:01.65+00:00
Given Mnisi 40 Reputation points
commented 2025-03-10T18:52:01.63+00:00
Prakash Mj 20 Reputation points
1 answer

Azure SQL DB not returning correct results

Hello All, I have a stream analytics job that is left outer joining an event hub dataset and a sql db reference table. When I left outer join the datasets, the result returns null: You can see the result in the picture. The column called LEDT should…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-03-03T15:19:12.8+00:00
Woebbeking, William K 0 Reputation points
commented 2025-03-10T10:09:00.39+00:00
AnnuKumari-MSFT 34,551 Reputation points Microsoft Employee Moderator
1 answer One of the answers was accepted by the question author.

Azure Data Streaming Issue: Switching from Block Blobs to Append Blobs

I've recently made a change to my telemetry stream architecture that's causing some data loss, and I'm hoping to get some insights from those with experience. Current Setup & Issue Original configuration: Telemetry stream using Block Blobs New…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-02-26T22:01:03.1966667+00:00
Annie Zhou 40 Reputation points Microsoft Employee
accepted 2025-03-03T18:42:04.3533333+00:00
Annie Zhou 40 Reputation points Microsoft Employee
2 answers

Azure Stream Analytics - Can't Access Metadata

I am using stream analytics to consume event from EventHub and aggregate them into a Data Lake Storage account. I am trying to access the "applicationProperties" of the event to add it to the data. I have tried using but the main issue is…

Azure Stream Analytics
Azure Stream Analytics
An Azure real-time analytics service designed for mission-critical workloads.
397 questions
asked 2025-02-21T14:40:23.6333333+00:00
Quentin Levasseur 0 Reputation points
commented 2025-02-26T11:15:35.84+00:00
Smaran Thoomu 24,095 Reputation points Microsoft External Staff Moderator