Which solution on Azure is better and why
Scenario 1 : when I am consuming data from Stream Analytics to Azure SQL via service bus, as these services was already in used in different Pipeline. Pic 1 Secenerio 2 : I am thinking to Leverage ADF to bring same data from ADLS Gen2 to Azure SQL. As…
Azure Stream Analytics
How to fix this error Value cannot be null.\r\nParameter name: s", azure stream analytics
I'm onboarding datasets from Kafka. Everything works fine when I onboard up to 6 datasets. But when I try to add a 7th dataset, I get the following error from Azure Stream Analytics: "The streaming job failed: Value cannot be null. Parameter name:…
Azure Stream Analytics
How can I troubleshoot latency issues in Azure Stream Analytics job output?
I'm experiencing increased latency in the output of my Azure Stream Analytics job. The input is coming from an Event Hub and the output is going to an Azure SQL Database. I’ve checked that the Event Hub is receiving data in near real-time, but the…
Azure Stream Analytics
Low Level Design For Batch and Streaming Data Platform In Azure
Hello, I am trying to create Low level design Document for below mention diagram. May Someone please help me what all should be consider for each component. How to handle Error and Failure and Restartibility. Thank You So Much for your help.
Azure Stream Analytics
How to do Low Level Design for Given HLD in Azure
I have created a High level design where I am consuming JSON file from Azure Stream Analytics to Azure SQL. What all are properties I should consider for creating Low Level Design for same. Please help me with your expertise knowledge. Thanks a lot
Azure Stream Analytics
Design Real Time Streaming with Azure
I am in process of designing a real time (15 sec latency) data streaming system. Please share your thoughts on Pros and Cons for below scenerio. I have to replace SAP Connector with Azure Tech stack with lowest latency for process data, as shown in pic…
Azure Stream Analytics
Stream Analytics compatibility 1.2 - PARTITION BY PartitionId
Will the PARTITION BY PartitionId statement still ensure parallel processing (and make sure that input partition = output partition) for compatibility level 1.2 when we don't specify a partition key column? Our situation: we have 2 input eventhubs…
Azure Stream Analytics
How to fix We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached
We cannot connect to Event Hub partition [0] because the maximum number of allowed receivers per partition in a consumer group has been reached. Ensure that other Stream Analytics jobs or Service Bus Explorer are not using the same consumer group. The…
Azure Event Hubs
Azure Stream Analytics

Unable to connect kafka topic as input in Azure Stream Analytics Job
We are getting error while establishing connection with kafka in Azure Stream Analytics Exception thrown while trying to retrieve Kafka partition count for <
Azure Stream Analytics
azure stream analytics job issue.
For Cost management we tried the autoscaling option but as soon as that is configured, we stop receiving data in ADLS. currently we are receiving data only with manual Scale using 2SU JOB works with 2SU but not with 1SU even though we are processing…
Azure Stream Analytics

[Error] An error happened while submitting Job 'sql-job-0', error detail: Cannot read properties of undefined (reading 'length')
Error while submitting stream analytics job to azure from visual studio code - [Error] An error happened while submitting Job 'sql-job-0', error detail: Cannot read properties of undefined (reading 'length') I dont see any 'length' in my configs.
Azure Stream Analytics
When will Kafka Streaming Analytics REST/ARM deployments & documentation be available?
Now that Kafka inputs/outputs are GA as of November 2024 in Streaming Analytics, when will they be available to deploy programmatically? The following link indicates that you can deploy Kafka inputs with ARM, but there is no documentation in the Azure…
Azure Stream Analytics
How to create cross tenant Output with Private Endpoint from Stream Analytics Job (Cluster) to an Event Hub (namespace)?
Hello Community! I'm currently trying to set up an Event Hub (on a namespace) output which exists in another Tenant, and Directory (and of course, Subscription) for a Stream Analytics Job within a Stream Analytics Cluster. I have verified that the…
Azure Stream Analytics
How to fix "where' operator: Failed to resolve scalar expression named 'properties_s'" when running the standard query named "List all input deserialization errors" in Stream Analytics job
When attempting to run the following standard query: The following error message is displayed 'where' operator: Failed to resolve scalar expression named 'properties_s' If the column properties_s doesn't exist, which column should I use instead?
Azure Stream Analytics

Memory Usage Over Capacity error in Stream Analytics
Hi Team, I have stream analytics setup which is consuming data from an EventHub, I am constantly getting the below error message : The memory usage is over the capacity for one or more of the query steps. Event processing may be delayed or stop making…
Azure Stream Analytics
How streaming data is processed in real time projects , which was ingested through azure event hubs
And I have few questions : How streaming data is processed in real time projects?, lets say my streaming data is stored in adls gen-2, where every minute a new blob file is created. Does it should be treated as batch data and should process…
Azure Stream Analytics
Azure stream analytics
I get this error when I want to display the data generated from this script
Azure Event Hubs
Visual Studio
Azure Stream Analytics
Azure Cosmos DB
Azure Event Grid
Azure SQL DB not returning correct results
Hello All, I have a stream analytics job that is left outer joining an event hub dataset and a sql db reference table. When I left outer join the datasets, the result returns null: You can see the result in the picture. The column called LEDT should…
Azure Stream Analytics

Azure Data Streaming Issue: Switching from Block Blobs to Append Blobs
I've recently made a change to my telemetry stream architecture that's causing some data loss, and I'm hoping to get some insights from those with experience. Current Setup & Issue Original configuration: Telemetry stream using Block Blobs New…
Azure Stream Analytics
Azure Stream Analytics - Can't Access Metadata
I am using stream analytics to consume event from EventHub and aggregate them into a Data Lake Storage account. I am trying to access the "applicationProperties" of the event to add it to the data. I have tried using but the main issue is…